I’m looking for a simple, cheap solution to test headlines on a website that generates less than 600 views a month. I’ve identified a few companies that offer this service; here, I’ll reprint their replies to my questions. Below: Nelio A/B Testing.
From David Aguilera via email on March 7, 2020:
Indeed, A/B testing works best on websites that have mid to high traffic. When run on low-traffic sites, it’s difficult to get meaningful results because there simply isn’t enough data.
If you have a low-traffic site, we recommend you run radical tests with only two variants (A and B) in those pages that get the most traffic, then track conversion actions that are in early stages of your conversion funnel.
So, for example, instead of testing different color buttons or a different copy, create a completely different landing page. The more radical the changes, the more likely it’ll be to see any statistically significant differences between variants A and B.
