Issue :
As per the Product behaviour, for any active AB Test, Results should be available ~ 24 hours after starting the test and will continue to show updated data. The update schedule may vary across different merchant groups. The data might reflect updates from a few hours ago or, at most, 24 hours prior.
However, often, even two days after starting an A/B test, the Dashboard UI shows missing results - either no test bucket details or no graphical representation of the visitor report.
Environment :
It is a general product behaviour and can be seen in all environments (PROD/STG).
Cause :
A common issue and a good first step is to check for trailing spaces in A/B test bucket names (e.g., extra space before or after the name). This cause inconsistencies in backend logic, leading to incomplete or broken result datasets.
Example :
A merchant reported that no results were showing for a specific A/B test that was activated two days ago.
Upon further investigation, it was identified that a trailing space was present in the name of the A/B test, as shown in the screenshot below.
The screenshot below shows an ideal UI representation of an accurate A/B test report, where no trailing spaces exist in the bucket names.
Technical Logic:
In the backend, additional spaces are interpreted as “+” characters, which alters the bucket name string and prevents proper result tracking for the affected buckets.
Resolution:
To prevent this issue from occurring (steps to validate before creating any new A/B test):
1. Go to the Dashboard.
2. Navigate to the A/B Test section (create a new A/B Test)
3. Before naming the test bucket, carefully check for any extra spaces before or after the name, as shown below.
Conclusion:
Always validate bucket names during A/B test creation to ensure that no spaces exist before or after the name.