How do I read A/B tests, and find the best time to send?
See which message wins, and which weekday and hour get the most replies.
#A/B tests
Add an A/B test step in a campaign's builder to compare two messages. When it has enough data, the A/B tests section of Analytics lists every test across your campaigns with a plain-language verdict.
| Verdict | What it means |
|---|---|
| Collecting data | Not enough replies to tell the versions apart yet. |
| Winner found | One version is clearly ahead. Press Review and promote to open the campaign's results and choose it. |
| Too close to call | The versions are about equal. Keep the one you like better. |
| Winner picked | You promoted a winner already. |
Press Compare the versions to see both side by side. Open results (or Review and promote when there is a winner) takes you to the campaign's results page, where promoting happens.
#What people replied
A ring and a list show your replies sorted by meaning as they arrive (interested, not now, not interested and so on). It is the same sorting you see in your Inbox.
#Best time to send
A map of weekdays and hours, shaded by reply rate for messages sent in that slot. HeyLeads writes the finding in a sentence, for example Tuesday around 9 AM does best, with the numbers behind it and the overall reply rate for comparison.
- It needs at least 60 messages in the period before it shows anything.
- A slot only counts when it has enough messages behind it, so a lucky single reply doesn't light it up.
- A fair read of the best time needs a few thousand sends, because each hour only gets a small slice.
- If nothing clearly beats the rest, it says No time of day clearly beats the others yet.
Do my campaigns send at the best time automatically?
No. Messages go out inside the working hours you set for each campaign. Use the map to choose those hours.
Why is the map empty?
There aren't enough messages yet in the period. Try a longer period.