As as startup, you should be running tests all the time. Making sure you are drawing the right conclusions from those tests is also a vital part of this: it helps you get those customers and save precious time. There are lots of mistakes you can make when A/B testing. In this 45mn workshop, Côme tells you about them, why they happen, and how to avoid them. He is also share tips and tricks to get your A/B testing right. Côme Courteault is Growth Hacker at TheFamily. He helps many of our startups build sustainable growth practices, and is also a teacher at our Growth Hacking school.

1. #TFWORKSHOP
7 WAYS YOU ARE DOING YOUR A/B TESTING WRONG
CÔME COURTEAULT
GROWTH HACKER AT THEFAMILY
@C2PRODS

2. A/B TESTING

3. A/B TESTING

4. #1 NOT ENOUGH
PEOPLE
You must A/B test on a lot
of people
Check the χ² test
(evanmiller.org/ab-testing/chi-squared.html)

5. GOOD
BAD

6. #2 NOT BEING
RADICAL
Don’t start by testing shades of
red for the uppermost button!
In the beginning, focus on
changes that have impact.

7. #3 TIME
2 days are not enough.
2 months are too much.
Run your tests for one week.

8. #4 NOT PAYING ATTENTION
TO THE CONTEXT
Shit happens in the world. Holidays, too.
Pay attention to what’s going on, this can
have an effect on the way your users behave.

9. #5 NOT HAVING AN
HYPOTHESIS
Don’t run tests just because you can.
Think of an hypothesis. Why are
you running this test?

10. #6 NO FOLLOW-
UP TESTS
Double down on what works.
Kill what doesn’t.
A/B testing is never over!

11. #7 IGNORING
SMALL GAINS
A/B testing doesn’t always bring
a 1000% increase!
Even a 10% gain on 100 000
users can prove worthy ;-)

12. PLEASE
Build an awesome product before
running A/B tests.
But after, use A/B testing to improve
your onboarding and your retention.
Run multivariate tests only when you
can (i.e. when you have bandwidth)
Don’t forget to care personally!

13. LET’S TALK!

14. SEE YOU SOON!
LOVE.
THEFAMILY.CO
___
___