More Advice on A/B testing
It’s not uncommon to see seemingly conclusive results after a short period of time… but statistics can be misleading. To avoid the trap of making a hasty decision about what’s working (and what isn’t), try to wait until your best-performing page alternative has produced at least 100 “conversions”.