Category Archive for "Experimentation"

Partitioned ramps: A surprising feature of using hash functions for A/B split tests

Whilst improving Mojito’s PRNG & devising an ITP2.X workaround last year we introduced a modular splitting tool in Mojito that lets users split traffic with hash functions. We’re amazed by the features that hash functions enable in split testing such…

Read More

Presentation: How to avoid 5 testing pitfalls & run trustworthy experiments (Web Analytics Wednesday Melbourne, 2019-11-06)

Earlier this month, I gave a talk to the local Web Analytics Wednesday group in Melbourne on running A/B tests and trustworthy experimentation. It features some of our biggest mistakes in split testing and the simple methods we take to…

Read More

Why we build experiments in an IDE rather than a WYSIWYG

Experiments built entirely within SaaS platforms’ web interfaces often take longer and require unnecessary busy-work. This article explores the reasons we would rather build experiments in an IDE and how Mojito supports this approach, so you don’t have to touch…

Read More

Why you need error tracking & handling in your split tests

Building large, complex experiments introduces new logic, new code and sometimes new bugs. But most A/B testing tools don’t perform error tracking or handling for you. So when you launch your experiment and it tanks… …did your awesome new idea…

Read More

How to reduce your A/B testing tool’s page speed impact

Client-side A/B testing tools get criticised for loading huge chunks of JS synchronously in the head (rightfully so). Despite the speed impact, these tools deliver far more value through the experiments they deliver. And luckily, we can help manage the…

Read More