This is extremely common! Here's why it might be happening.
You're focused on UX
- UX-focused experiments will only take you so farUX-focused experiments will only take you so far
User experience matters, and it's worth addressing friction and confusion on your site, but Cosmetic changes don't matter.
Start with the offer and Learn what's unique about your custome... - Cosmetic changes don't matterCosmetic changes don't matter
In ecommerce, minor styling changes can have a measurable impact on shopper behavior.
But B2B decisions are much higher consideration, and this type of change is unlikely to influence your potenti...
Insufficient traffic / conversions
- Run only as many variants as the hypothesis requiresRun only as many variants as the hypothesis requires
If it's possible to test a hypothesis with a single variant, don't test additional variants.
Running fewer variants lowers your Minimum Detectable Effect and simplifies implementation and QA.
...
Variants are too similar to the control experience
- Take big swings early onTake big swings early on
You should be testing drastic, ambitious changes early in your experimentation program.
This type of test will have a higher Minimum Detectable Effect, which means you'll get results faster.
...