You have to pre-calculate the pattern size with an A/B test sample dimension calculator. As you’ll see, mistaken or misleading conclusions like this might be mitigated by directionality and sensitivity, which essentially make sure that completely different AB testing metrics are weighted appropriately. ComScore A/B tested logos
