10. 10
This way or that
A / B testing direct visitors at random to
different versions of a page or a
component.
The experiment is performed on your
regular site on your real visitors and they
are not aware that they are in an
experiment.
12. 12
We have a winner!
You measure the outcome against
the experiment goals (for example
sales) for the different variations.
When the test has reached statistical
significance a winner can be
declared.
37. Premium trial for US market
High Dropoff rate
Original
You must leave your credit card
details in order to start your 30
day free trial
WHY?
37
38. Input to the hypothesis
We made a short exit survey.
The main reason stated:
38
“I don’t want to leave my
credit card details for
something that is free”!
39. Hypothesis:
Give the user “A reason why”
39
We only use this to verify your account, you
won't be charged anything for your trial
We need this just in case you decide to stay
Premium after your free month
We need this because our music deals only
allow free trials for users that are credit card or
PayPal holders
A
B
C