0
GROWTH HACKING             AND                 THE BANDIT PROBLEM      Starring            Noel Welsh   A   ProductionFrid...
WHAT DO             GROWTH HACKERS                            DO?Friday, 8 February 2013
GROW!Friday, 8 February 2013
Metric                          (sign-ups, revenue, etc)Friday, 8 February 2013
Make this happenFriday, 8 February 2013
Friday, 8 February 2013                          HOW?
Build                          Learn           MeasureFriday, 8 February 2013
BuildFriday, 8 February 2013
Build                                  MeasureFriday, 8 February 2013
Build                          Learn           MeasureFriday, 8 February 2013
FASTER IS BETTERFriday, 8 February 2013
HOW                          DO WE MEASURE &                              LEARN?Friday, 8 February 2013
A/BFriday, 8 February 2013
Build   Measure   LearnFriday, 8 February 2013
Build                          Learn           MeasureFriday, 8 February 2013
Build                                  Measure/                                   LearnFriday, 8 February 2013
Build   Measure / LearnFriday, 8 February 2013
THE BANDIT PROBLEM                          (EST 1952 ... OR 1933)Friday, 8 February 2013
k arms (or variants)Friday, 8 February 2013
Select a variantFriday, 8 February 2013
                          Receive a rewardFriday, 8 February 2013
REPEATFriday, 8 February 2013
TOTAL                          MAXIMISE                             REWARDFriday, 8 February 2013
Friday, 8 February 2013
HOW?Friday, 8 February 2013
DISPLAY VARIANT WITH                HIGHEST AVERAGE                    REWARDFriday, 8 February 2013
Good Variant   Bad VariantFriday, 8 February 2013
Good Variant   Bad Variant                            Views: 1                           Reward: 0                        ...
Good Variant   Bad Variant                            Views: 1      Views: 1                           Reward: 0     Rewar...
OOPS!Friday, 8 February 2013
Good Variant   Bad Variant                    WILL NEVER TRY THE                     GOOD VARIANT AGAIN!                  ...
BALANCE EXPLOIT                          AND EXPLOREFriday, 8 February 2013
EXPLOIT               TRY THE VARIANT THAT                HAS WORKED BEST IN                     THE PASTFriday, 8 Februar...
EXPLORE                          TRY OTHER VARIANTS                           TO SEE IF THEY’RE                           ...
E-GREEDYFriday, 8 February 2013
10% EXPLORE                          90% EXPLOIT                           Don’t like 10% and 90%? Change it.Friday, 8 Feb...
MORE INTRICATE            BALANCING IS POSSIBLE.             SEE UCB-1, THOMPSON                SAMPLING, etc.Friday, 8 Fe...
Friday, 8 February 2013
DOES IT                          WORK?Friday, 8 February 2013
Friday, 8 February 2013
REAL WORLD                          CONSIDERATIONSFriday, 8 February 2013
WORKFLOWFriday, 8 February 2013
DEFINING                          REWARDSFriday, 8 February 2013
STABLE PREFERENCESFriday, 8 February 2013
THANK YOU!                          NOW GO FORTH AND                            ENGAGE IN                            BANDI...
CREDITS               Photos and artwork by the following people were used in                                 this present...
Upcoming SlideShare
Loading in...5
×

Growth Hacking and the Bandit Problem

10,571

Published on

Growth hackers rely on A/B testing to validate their improvement, but A/B testing is slow and inefficient. How do we make it faster? By solving the bandit problem! Bandit algorithms provide an alternative to A/B testing that is faster and more efficient, allowing more tests in less time.

Video of the talk: http://www.youtube.com/watch?v=h7SG_Wo8sPQ

Myna:
http://mynaweb.com/?utm_source=awareness&utm_medium=slideshare&utm_campaign=Growth%2BHacker

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
10,571
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
2
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Transcript of "Growth Hacking and the Bandit Problem"

  1. 1. GROWTH HACKING AND THE BANDIT PROBLEM Starring Noel Welsh A ProductionFriday, 8 February 2013
  2. 2. WHAT DO GROWTH HACKERS DO?Friday, 8 February 2013
  3. 3. GROW!Friday, 8 February 2013
  4. 4. Metric (sign-ups, revenue, etc)Friday, 8 February 2013
  5. 5. Make this happenFriday, 8 February 2013
  6. 6. Friday, 8 February 2013 HOW?
  7. 7. Build Learn MeasureFriday, 8 February 2013
  8. 8. BuildFriday, 8 February 2013
  9. 9. Build MeasureFriday, 8 February 2013
  10. 10. Build Learn MeasureFriday, 8 February 2013
  11. 11. FASTER IS BETTERFriday, 8 February 2013
  12. 12. HOW DO WE MEASURE & LEARN?Friday, 8 February 2013
  13. 13. A/BFriday, 8 February 2013
  14. 14. Build Measure LearnFriday, 8 February 2013
  15. 15. Build Learn MeasureFriday, 8 February 2013
  16. 16. Build Measure/ LearnFriday, 8 February 2013
  17. 17. Build Measure / LearnFriday, 8 February 2013
  18. 18. THE BANDIT PROBLEM (EST 1952 ... OR 1933)Friday, 8 February 2013
  19. 19. k arms (or variants)Friday, 8 February 2013
  20. 20. Select a variantFriday, 8 February 2013
  21. 21.  Receive a rewardFriday, 8 February 2013
  22. 22. REPEATFriday, 8 February 2013
  23. 23. TOTAL MAXIMISE REWARDFriday, 8 February 2013
  24. 24. Friday, 8 February 2013
  25. 25. HOW?Friday, 8 February 2013
  26. 26. DISPLAY VARIANT WITH HIGHEST AVERAGE REWARDFriday, 8 February 2013
  27. 27. Good Variant Bad VariantFriday, 8 February 2013
  28. 28. Good Variant Bad Variant Views: 1 Reward: 0 Average: 0Friday, 8 February 2013
  29. 29. Good Variant Bad Variant Views: 1 Views: 1 Reward: 0 Reward: 1 Average: 0 Average: 1Friday, 8 February 2013
  30. 30. OOPS!Friday, 8 February 2013
  31. 31. Good Variant Bad Variant WILL NEVER TRY THE GOOD VARIANT AGAIN! Views: 1 Views: 1 Reward: 0 Reward: 1 Average: 0 Average: 1Friday, 8 February 2013
  32. 32. BALANCE EXPLOIT AND EXPLOREFriday, 8 February 2013
  33. 33. EXPLOIT TRY THE VARIANT THAT HAS WORKED BEST IN THE PASTFriday, 8 February 2013
  34. 34. EXPLORE TRY OTHER VARIANTS TO SEE IF THEY’RE BETTERFriday, 8 February 2013
  35. 35. E-GREEDYFriday, 8 February 2013
  36. 36. 10% EXPLORE 90% EXPLOIT Don’t like 10% and 90%? Change it.Friday, 8 February 2013
  37. 37. MORE INTRICATE BALANCING IS POSSIBLE. SEE UCB-1, THOMPSON SAMPLING, etc.Friday, 8 February 2013
  38. 38. Friday, 8 February 2013
  39. 39. DOES IT WORK?Friday, 8 February 2013
  40. 40. Friday, 8 February 2013
  41. 41. REAL WORLD CONSIDERATIONSFriday, 8 February 2013
  42. 42. WORKFLOWFriday, 8 February 2013
  43. 43. DEFINING REWARDSFriday, 8 February 2013
  44. 44. STABLE PREFERENCESFriday, 8 February 2013
  45. 45. THANK YOU! NOW GO FORTH AND ENGAGE IN BANDITRYFriday, 8 February 2013
  46. 46. CREDITS Photos and artwork by the following people were used in this presentation: Moyan Brenn http://www.flickr.com/photos/aigle_dore/ Suicine http://www.flickr.com/photos/bigmikeyeah ankakay http://www.flickr.com/photos/ankakay/ Cdr Aitch http://www.flickr.com/people/hjsouthgate/ StJost http://stjost.deviantart.com/Friday, 8 February 2013
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×