Measuring segment size
This page covers how you can monitor your segment’s membership and size.
Segment membership calculation
Braze updates the user’s segment membership as data is sent back to our servers and processed, typically instantaneously. A user’s segment membership will not change until that session has been processed. For example, a user who falls into a lapsed user segment when the session first starts will be immediately moved out of the lapsed user segment when the session is processed.
Total reachable users calculation
Each segment displays the total number of users that are members of that segment. When filtering for Users from all apps, it also displays some of the most frequently used messaging channels (such as web push or email) and the number of reachable users for those specific channels.
It is possible that the number of total users is different than the number of users reachable by each channel. In addition, not all channels are listed in the reachable users table. For example, Content Cards, webhooks, and WhatsApp aren’t shown in the breakdown. This means that the total reachable users count could be greater than the sum of the users for each displayed channel.
For a user to be listed as reachable through a certain channel, the user must have both:
- A valid email address or push token associated with their profile; and
- Opted in or subscribed to your app.
A single user may belong to different reachable user groups. For example, a user might have both a valid email address and valid Android push token and be opted in to both, but have no associated iOS push token. The gap between the total reachable users and the sum of the different channels are the number of users who qualified for the segment but they are not reachable through those communication channels.
Statistics for segment size
Estimated statistics are approximated by sampling only a portion of your segment, so you should expect to see estimated sizes that are larger or smaller than the actual value, with larger workspaces seeing potentially larger margins of error. To get an accurate count of users in your segment, select Calculate Exact Statistics. The exact segment membership will always be calculated before a segment is affected by a message sent in a campaign or Canvas.
Braze provides the following statistics on segment size.
Filter statistics
For each filter group, you can view estimated reachable users. Select Expand extra funnel statistics to see a breakdown across channels.
Reachable users estimate
You can view an entire segment’s estimated reachable users, including estimated user counts for each channel, in the Reachable users side panel. This estimation shows you an approximate range for your segment size, and an estimate of what percentage of your overall user base falls into this segment. You can also view an exact count of reachable users (for both the segment overall and per channel) by selecting Calculate exact statistics.
Considerations for estimate counts
Braze measures the number of estimated users by querying a subset of your users, and then extrapolates those results to your entire audience. Because the subset of users that Braze queries may differ each time we calculate this estimate, the estimate may also change in cases where your audience membership technically should have stayed the same. For example, if you re-order your filters or re-check the same segment at a different time, it’s possible that the estimated count changes (even though Calculate exact stats would reveal the same results if your segment didn’t change).
If you have a large user population in your workspace, you may see more variation between your estimated counts compared to your exact calculation counts, especially in cases where your segment is a very small percentage of your overall workspace population. This is because Braze measures the estimate by querying a subset of your users and extrapolating the results to your entire user base. For larger user bases, larger differences between estimated and exact counts are to be expected.
Very small segments will have an estimated range that includes 0, meaning the percentage of total users may round to 0. In these cases, Calculate exact stats will help you see an accurate count of your segment size, which may not actually be 0.
Reachable users by channel
To view the number of users that are reachable for each message channel, select Show breakdown in the Reachable users panel. This displays some of the most frequently used messaging channels (such as web push or email) and the number of reachable users for those specific channels.
The Total metric represents unique users. For example, if a user has both Android push and iOS push, they will get counted for both of those rows, but will only count as 1 user in the Total row.
However, it’s possible that the number of total users is different than the sum of users reachable by each channel, as a single user may belong to different reachable user groups. For example, a user might have both a valid email address and valid Android push token and be opted in to both, but have no associated iOS push token.
Keep in mind, not all channels are listed in the Reachable users table (such as Content Cards, webhooks, and WhatsApp). For example, if you have users only reachable through Whatsapp, they will be reflected in the Total but not in any of the channel-specific rows. This means that the total reachable users count can be different from the sum of the users for each displayed channel.
In cases where the Total is higher than the sum of the channels, the gap represents the number of users who qualified for the segment but aren’t reachable through those communication channels.
For a user to be listed as reachable through a certain channel, the user must have:
- A valid email address or push token associated with their profile, and
- Opted-in or subscribed to your app.
Calculating exact statistics
To view an accurate count of the number of users in your segment, select Calculate exact stats in the Reachable users pane.
To update the stats for a calculation you’ve previously run, select Refresh exact statistics. The date this calculation was last ran will automatically be updated.
Note that a calculation’s accuracy is only 99.999% or greater. So for large segments, you may notice slight variations—even when calculating exact statistics—which is normal behavior.
The statistics on a per-filter level will always be estimated, even if you calculate exact stats. Calculate exact stats only calculates the exact statistics at the segment level, not at the filter or filter group level. This calculation may take a few minutes to run. Larger workspaces in particular may require longer periods to complete calculations. You can track your progress on the progress bar in the Reachable users panel. When a calculation is expected to run more than five minutes, Braze will email you the results.
Braze prioritizes one calculation at a time per workspace, so running multiple calculations at once will cause delays. You can select View calculation queue to see what segments are ahead of yours, their progress, and their initiator, and get an idea of when your calculation may be prioritized.
You can cancel an exact statistics calculation by selecting Cancel. This can be beneficial if there are multiple calculations in the queue and you want to prioritize another calculation first.
Viewing historical segment membership size
For all segments, you can view a historical membership chart that shows the estimated segment membership for each day. This chart shows how the size of your segment changed over time. Use the dropdown to filter segment membership by date range.
Because the goal of this chart is to give you a sense of overall segment membership trends, the daily count is an estimate, similar to how the segment size is an estimate before you select Calculate Exact Statistics. And because this graph shows estimates, it’s possible that your segment’s size appears as “0” in this chart, even though its actual size (which can be determined after selecting Calculate Exact Stats) is not “0”. It is especially likely for the chart to show an estimate of “0” if your segment is very small relative to the size of your workspace population.
Braze estimates the segment membership count by querying a subset of your users, and then extrapolating those results to your entire audience. This means that the chart’s results provide only an estimate of what segment membership might be on that day, and is expected to also fluctuate from day-to-day because a different sample of users may get queried for this estimate each day.
All estimates may be higher or lower than the shown value by approximately 1% of your workspace’s entire population size. Larger workspaces with more users are more likely to have estimates that may differ from exact calculations by a higher numerical amount, even if the difference is still 1% of the workspace’s user population. This means that bigger differences between estimates and exact counts among large workspaces are to be expected.
Reasons for significant changes
The membership count may significantly change for a number of reasons, such as those in this table.
Reason | Example |
---|---|
Normal user behavior | Users subscribe after a particularly successful campaign. |
Users are imported by CSV | A CSV file of users was imported that significantly increased segment membership. |
Segment audience criteria is modified | An existing segment’s audience rules (such as filters) were changed, causing significant changes in the segment membership. |
Users are deleted | A significant number of users were deleted. |
A partner integration synced with Braze | A third party sent data to Braze that significantly influenced segment membership. |
Dormant users are archived | A significant number of inactive profiles were archived. For example, a large number of CSV-imported users never log activity and get archived at the same time. |