Growth Hacking and the Bandit Problem

  • 10,479 views
Uploaded on

Growth hackers rely on A/B testing to validate their improvement, but A/B testing is slow and inefficient. How do we make it faster? By solving the bandit problem! Bandit algorithms provide an …

Growth hackers rely on A/B testing to validate their improvement, but A/B testing is slow and inefficient. How do we make it faster? By solving the bandit problem! Bandit algorithms provide an alternative to A/B testing that is faster and more efficient, allowing more tests in less time.

Video of the talk: http://www.youtube.com/watch?v=h7SG_Wo8sPQ

Myna:
http://mynaweb.com/?utm_source=awareness&utm_medium=slideshare&utm_campaign=Growth%2BHacker

More in: Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
10,479
On Slideshare
0
From Embeds
0
Number of Embeds
1

Actions

Shares
Downloads
0
Comments
0
Likes
1

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. GROWTH HACKING AND THE BANDIT PROBLEM Starring Noel Welsh A ProductionFriday, 8 February 2013
  • 2. WHAT DO GROWTH HACKERS DO?Friday, 8 February 2013
  • 3. GROW!Friday, 8 February 2013
  • 4. Metric (sign-ups, revenue, etc)Friday, 8 February 2013
  • 5. Make this happenFriday, 8 February 2013
  • 6. Friday, 8 February 2013 HOW?
  • 7. Build Learn MeasureFriday, 8 February 2013
  • 8. BuildFriday, 8 February 2013
  • 9. Build MeasureFriday, 8 February 2013
  • 10. Build Learn MeasureFriday, 8 February 2013
  • 11. FASTER IS BETTERFriday, 8 February 2013
  • 12. HOW DO WE MEASURE & LEARN?Friday, 8 February 2013
  • 13. A/BFriday, 8 February 2013
  • 14. Build Measure LearnFriday, 8 February 2013
  • 15. Build Learn MeasureFriday, 8 February 2013
  • 16. Build Measure/ LearnFriday, 8 February 2013
  • 17. Build Measure / LearnFriday, 8 February 2013
  • 18. THE BANDIT PROBLEM (EST 1952 ... OR 1933)Friday, 8 February 2013
  • 19. k arms (or variants)Friday, 8 February 2013
  • 20. Select a variantFriday, 8 February 2013
  • 21.  Receive a rewardFriday, 8 February 2013
  • 22. REPEATFriday, 8 February 2013
  • 23. TOTAL MAXIMISE REWARDFriday, 8 February 2013
  • 24. Friday, 8 February 2013
  • 25. HOW?Friday, 8 February 2013
  • 26. DISPLAY VARIANT WITH HIGHEST AVERAGE REWARDFriday, 8 February 2013
  • 27. Good Variant Bad VariantFriday, 8 February 2013
  • 28. Good Variant Bad Variant Views: 1 Reward: 0 Average: 0Friday, 8 February 2013
  • 29. Good Variant Bad Variant Views: 1 Views: 1 Reward: 0 Reward: 1 Average: 0 Average: 1Friday, 8 February 2013
  • 30. OOPS!Friday, 8 February 2013
  • 31. Good Variant Bad Variant WILL NEVER TRY THE GOOD VARIANT AGAIN! Views: 1 Views: 1 Reward: 0 Reward: 1 Average: 0 Average: 1Friday, 8 February 2013
  • 32. BALANCE EXPLOIT AND EXPLOREFriday, 8 February 2013
  • 33. EXPLOIT TRY THE VARIANT THAT HAS WORKED BEST IN THE PASTFriday, 8 February 2013
  • 34. EXPLORE TRY OTHER VARIANTS TO SEE IF THEY’RE BETTERFriday, 8 February 2013
  • 35. E-GREEDYFriday, 8 February 2013
  • 36. 10% EXPLORE 90% EXPLOIT Don’t like 10% and 90%? Change it.Friday, 8 February 2013
  • 37. MORE INTRICATE BALANCING IS POSSIBLE. SEE UCB-1, THOMPSON SAMPLING, etc.Friday, 8 February 2013
  • 38. Friday, 8 February 2013
  • 39. DOES IT WORK?Friday, 8 February 2013
  • 40. Friday, 8 February 2013
  • 41. REAL WORLD CONSIDERATIONSFriday, 8 February 2013
  • 42. WORKFLOWFriday, 8 February 2013
  • 43. DEFINING REWARDSFriday, 8 February 2013
  • 44. STABLE PREFERENCESFriday, 8 February 2013
  • 45. THANK YOU! NOW GO FORTH AND ENGAGE IN BANDITRYFriday, 8 February 2013
  • 46. CREDITS Photos and artwork by the following people were used in this presentation: Moyan Brenn http://www.flickr.com/photos/aigle_dore/ Suicine http://www.flickr.com/photos/bigmikeyeah ankakay http://www.flickr.com/photos/ankakay/ Cdr Aitch http://www.flickr.com/people/hjsouthgate/ StJost http://stjost.deviantart.com/Friday, 8 February 2013