A/B testing in large scale. Few examples how big companies could validate their product before building it.

1. The 80% case
Konrad Synoradzki, UX Team Leader

2. „
Without data you’re just
another person with an
opinion
W. Edwards Deming

3. The 80% case
Konrad Synoradzki
UX Team Leader at Allegro Group
@sykonrad
#extreme #ABtesting

4. The 80% case - agenda
1. Speed matters!
2. What to build?
3. Examples
4. Q&A

5. Speed matters
https://www.flickr.com/photos/mckaysavage/255451714

6. Speed matters

7. Speed matters
https://www.flickr.com/photos/71363363@N06/7664623602

8. The 80% case - agenda
1. Speed matters!
2. What to build?
3. Examples
4. Q&A

9. What to build?
https://flic.kr/p/4ASwgW

10. What to build?

11. almost 80% of ideas fails
What to build?

12. What to build?
one of recipes - A/B test yours ideas!

13. Size doesn’t matter

14. The 80% case - agenda
1. Speed matters!
2. What to build?
3. Examples
4. Q&A

15. Example no. 1
What to do after adding product to cart?
or

16. Example no. 1
http://www.flickr.com/photos/instantvantage/5989252218/

17. Example no. 1
fail!

18. Example no. 2
Think about product you do not have…
But you really want to have it…
But the ‘cost’ of developing it is ~3 months
and the result is unknown

19. Example no. 2
Product - coupon codes - we didn’t have it!

20. Example no. 2
Experts saids:

21. Example no. 2

22. Example no. 2
but we added one field for 50% of users
not working field

23. Example no. 2
and the result….

24. Example no. 2
we didn’t noticed decrease conversion rate

25. Example no. 2
we repeat this test
and we was sure that it is safe for our business

26. Example no. 3
Somewhere in the universe allegro.pl

27. Example no. 3
exists quite important form

28. Example no. 3
with quite good hidden line

29. Example no. 3
with quite good hidden line
here it is!

30. Example no. 3
Iteration #1: why don’t test copy & location?

31. Example no. 3
tadamm

32. Example no. 3
oh wait! Maybe next iteration?
Iteration #2: let’s add some color!

33. Example no. 3
could be even better?

34. Example no. 3
finally
80% increase conversion rate

35. The 80% case
Q&A
Konrad Synoradzki
UX Team Leader at Allegro Group
@sykonrad
#extreme #ABtesting

36. that’s all