Conversion rate optimisation and landing pages. Scored hardest on whether their experiments are statistically valid — because most in this field are not.
26 evaluated, of which we would put 25 in front of a client and cut 1.
Most ‘CRO’ is not statistically valid
Experimentation rigour is the heaviest dimension here because it is the one most often faked: tests stopped early when the number looks good, sample sizes too small to detect the effect claimed, win rates reported without the losses. Ask how they decide a test is finished, and whether they publish flat and negative results. An agency that has never had a losing test is telling you something about its reporting, not its skill.
Tests should come from research, not from a list of ideas
The strongest operators ground every test in heuristic analysis, analytics, session replay, surveys or user testing. The weakest run a backlog of best practices — button colours, urgency banners, social proof — that were someone else's findings on someone else's traffic.
Ask for revenue per visitor, not conversion rate
A conversion-rate lift on a micro-conversion can coexist with flat revenue, and frequently does. This rubric rewards reporting in revenue per visitor or incremental revenue. If the case studies only show percentage lifts on clicks and form fills, the money question has been avoided.
A well-reviewed full-service digital agency, but public evidence centers on SEO, PPC, web design, and social rather than a rigorous experimentation program; not a category fit for specialist CRO.
Generalist service mix
Insufficient public proof of valid A/B testing
No clear incremental-revenue CRO reporting
How this page is built: every vendor here is scored against the published web_cro rubric — the one written for what this category actually sells, not a general agency rubric. Several of these records were first filed elsewhere and scored against a rubric they were not competing in; where that happened, the record carries a rescored_from field showing the previous verdict and score, so the change is auditable rather than silent.