Opinions about subject lines and layouts are unreliable; tests turn them into evidence and compound small gains over time.
The metrics that matter#
- Authentication pass rate: share of mail passing SPF, DKIM, and DMARC alignment. Healthy: 99% or higher.
- Spam complaint rate: Gmail enforces at 0.3%; stay under 0.1%.
- Hard bounce rate: under 2%; above 5% triggers platform reviews.
- Inbox placement: above 90% across major providers via seed tests.
- Engagement: click and reply rates by segment; opens are unreliable after Mail Privacy Protection.
Where to read them#
- Google Postmaster Tools for Gmail domain reputation, spam rate, and authentication.
- Microsoft SNDS and JMRP for Outlook.com IP reputation and complaints.
- Your ESP's delivery and bounce reports.
- DMARC aggregate reports for authentication by source.
Improving the numbers#
- Choose one variable per test and one primary metric (clicks or revenue, not opens).
- Size samples so results are statistically meaningful; small lists need bigger splits.
- Run long enough to capture late openers, typically 4 to 24 hours.
- Log results so learnings persist beyond one campaign.
Frequently asked questions#
What should I A/B test first in email?
Subject lines, then the primary call to action, then send time. These have the largest measurable effect.