This report is not yet available to our clients deployed in our EU region, or on our HIPPA-compliant cluster. We will make this report available to those regions as we continue to deploy functionality across our entire platform.
This reference article goes over how to measure user retention for users who have performed a selected retention event in a specific Canvas. By knowing how your users are being retained after sending a message, you can measure the effectiveness of your Canvases.
User retention is one of the most important metrics for any marketer. Keeping engaged users coming back for more indicates that business is healthy.
Braze allows you to measure user retention right on the Canvas Analytics page.
Run a Retention Report
Get started by visiting any Canvas in your Braze Dashboard, and select a date range for your report. Selecting an appropriate date range is crucial because of the way it affects the retention reports. This report will includes all users who initially entered the canvas during this window, and of those users, the data of those that performed their retention event during the date range will appear in the report. To select a date range, you must navigate to the upper right-hand corner of the Canvas Analytics page, here, you may select various ranges or set a custom range for your report.
Next, select the Analyze Variants button at the bottom of the page. From here, you can analyze your variants, check out your funnel report, and view your retention report. Canvas Retention shows you the rate at which any user who has received this specific Canvas has performed a Retention Event (specified by you on the Retention Report) over the 30 days from the time they received the Canvas.
Once you’ve selected a Retention event, click “Run Report” to start the query.
This query may take a few minutes to run, depending on how much data needs to be retrieved to generate the results. If it takes too long, you’ll see a notification asking you to Retry loading the report again (just by clicking the “Retry” button in the body of the report.) You may need to wait up to five minutes before the report will load.
Once the report is generated, it can’t be re-run with the same Retention event for 24 hours. You will always see a timestamp of when the report was last generated, and an option to Regenerate, if it’s been more than a day. You can, however, change the Retention Event and re-run the report to look at the impact of the Canvas on different KPIs.
The report will only show days down the left column on which the Canvas was sending messages. For some Canvases, that may mean the report only shows one day if it was a one-and-done Canvas. If it’s recurring or triggered, you may/will see multiple days down the left.
Our Retention Report uses the Rolling Retention formula, which measures how many users come back and do the retention event on or after any of the days listed across the top of the report. So, if a user started a session between day 3 and 7, the user will be counted as retained under the “3 days”, “1 day”, and “0 days” columns. Any user who is counted as retained after the 30-day mark from when the Canvas was sent on the date in the left column will be counted under the “30 days” column in that row.
Braze Retention Reports Components:
- Users Column: The value shown is the number of unique users that performed the start action within the selected time frame; the count of users for the present day will be excluded since it is being calculated.
- Cohort Z Rows: Shows the days in which the Canvas was sending messages.
- Day X Columns: Days spanning between 0 and 30 days at various increments.
- All Users Row: Also known as the Report Summary Row, summarizes the retention data for the entire time period. Note that if a user has entered the canvas in multiple cohorts, their results will be counted twice here.
- Percentages/Numbers: Shows the percentage/number of users who performed the event X or more days after receiving the Canvas on Z day. These percentages are the weighted average percentages. Incomplete values will be denoted by an asterisk.
- Date Range: Set on the Canvas Details page, the date range includes all users who received the campaign during this window, and of those users, the data of those that performed their retention event during the date range will appear in the report.
- Units: You can adjust the units between the percentage of users and the number of users in the upper right-hand corner of the chart, specific units may prove to be more significant when judging the impact of a Canvas.
- Color Mapping: In your retention report, higher percentages/number of users are assigned darker shades of blue. Lower percentage/number of users, lighter shades of blue. This is done to help users visualize this data.
- Retention Report Graph: This graph summarizes the results for all cohorts for the selected date range.
The way to read the retention report chart for the day 3 column would be Y% or Y number of users (based on units chosen) performed the event 3 or more days after receiving the Canvas on day Z.
As another example, referring to the table above, on March 25th, a total of 38 users performed the retention event. Day 0 retention was 68.42%, meaning that 68.42% of users performed the retention event 0 or more days (on Day 0 or later) after receiving the Canvas. Day 7 retention was 57.89%, meaning 57.89% of users performed the event 7 or more days (on Day 7 or later) after receiving the Canvas.
This information can be useful if you want to know the percentage of users who have and have not used your product 30+ days after first use. A percentage/number value in the day 30 column tells you the percentage of users who returned on day 30 or after.
Things to Look For in your Retention Reports
Retention Reports are easy to generate, yet challenging to interpret and act on. To help aid marketers, we have assembled a couple of topics/questions to consider when looking at your Retention Reports.
- Day-of-week trends for recurring Canvases (e.g Do Monday cohorts perform better than Saturday cohorts?)
- Where does the impact start to decline? This could be a signal that a new Canvas that targets users at that point in time is needed as another boost to retention.
- Am I seeing Canvas fatigue?
- Did that optimization to this Canvas I made X days ago have a positive impact?