An introduction guide to AB Testing for growth hackers. Starts with why we test, how we prove a winner and ultimately how to make more money with better converting sites and applications. It includes rules to live by when AB Testing and as well as examples from sites like http://raygun.io and 37 Signals. This presentation was for the Wellington Growth Hackers group in New Zealand but is applicable to both technical and non-technical users. Presentation was for about 30 minutes and presented by John-Daniel Trask.

1. SEXYTIMES WITH A/BTESTS
How to put more money in your pocket
John-DanielTrask
Mindscape

2. WHAT DO WE WANT?
WHAT DO WE WANT?

3. WHAT DO WE HAVE?

4. TYPICAL EXAMPLE
With some ideas

10. WHERETOTEST
Build a funnel.
Find biggest drop offs.
Fix them with tests.
More bling in your wallet.

11. WHERETOTEST

12. 37 SIGNALS
TwoTests.

13. LONG FORM
37 Signals
37% more signups!

14. HUMANS
37 Signals

15. RAYGUN.IO
One test.

16. ORIGINALVERSION

17. VERSION 1
Test 1 - An account in seconds

18. VERSION 2
Test 1 - under 1 minute!

19. VERSION 3
Test 1 - create my account now!

21. ANDTHE WINNER IS...

22. SLOTH HAS CALCULATED...
Test Visitors Conversions Change
Original / Control 10 1 -
Account in seconds 10 4 300% more
Under 1 minute 10 5 400% more
Create account now 10 2 100% more

23. YOU SURE?
I have no confidence (those numbers were a trick!)

24. MATHS IS HARD
https://developer.amazon.com/sdk/ab-testing/reference/ab-math.html

25. SLOTH HAS CALCULATED...
Original / Control -
Account in seconds 125% more signups
Under 1 minute 100% more signups
Create account now 62% more signups

26. YOU SURE SLOTH?
96% confident bro! Real numbers!

27. TOOL OFTHETRADE
VisualWebsiteOptimizer.com

28. RULES ARE FOR LOSERS
(and good A/B testers)
Test one thing at a time.
Always include your hypothesis.
Make sure it’s statistically significant.
Don’t waste your time building your own system.
Test everything.
“I like it this way” - prove it’s better buster!
Sad rule: If it looks like shit it probably converts better.

29. JUST DO IT!
Take an hour & make some money!

30. KEEP INTOUCH
I like to get around
@traskjd
jd@mindscape.co.nz
Questions? Lets go A/BTest some beers!