Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

of

Lean Analytics Cycle Slide 1 Lean Analytics Cycle Slide 2 Lean Analytics Cycle Slide 3 Lean Analytics Cycle Slide 4 Lean Analytics Cycle Slide 5 Lean Analytics Cycle Slide 6 Lean Analytics Cycle Slide 7 Lean Analytics Cycle Slide 8 Lean Analytics Cycle Slide 9 Lean Analytics Cycle Slide 10 Lean Analytics Cycle Slide 11 Lean Analytics Cycle Slide 12 Lean Analytics Cycle Slide 13 Lean Analytics Cycle Slide 14 Lean Analytics Cycle Slide 15 Lean Analytics Cycle Slide 16 Lean Analytics Cycle Slide 17 Lean Analytics Cycle Slide 18 Lean Analytics Cycle Slide 19 Lean Analytics Cycle Slide 20 Lean Analytics Cycle Slide 21 Lean Analytics Cycle Slide 22 Lean Analytics Cycle Slide 23 Lean Analytics Cycle Slide 24 Lean Analytics Cycle Slide 25 Lean Analytics Cycle Slide 26 Lean Analytics Cycle Slide 27 Lean Analytics Cycle Slide 28 Lean Analytics Cycle Slide 29 Lean Analytics Cycle Slide 30 Lean Analytics Cycle Slide 31 Lean Analytics Cycle Slide 32 Lean Analytics Cycle Slide 33 Lean Analytics Cycle Slide 34 Lean Analytics Cycle Slide 35 Lean Analytics Cycle Slide 36 Lean Analytics Cycle Slide 37 Lean Analytics Cycle Slide 38 Lean Analytics Cycle Slide 39 Lean Analytics Cycle Slide 40 Lean Analytics Cycle Slide 41 Lean Analytics Cycle Slide 42 Lean Analytics Cycle Slide 43 Lean Analytics Cycle Slide 44 Lean Analytics Cycle Slide 45 Lean Analytics Cycle Slide 46 Lean Analytics Cycle Slide 47 Lean Analytics Cycle Slide 48 Lean Analytics Cycle Slide 49 Lean Analytics Cycle Slide 50 Lean Analytics Cycle Slide 51 Lean Analytics Cycle Slide 52 Lean Analytics Cycle Slide 53 Lean Analytics Cycle Slide 54 Lean Analytics Cycle Slide 55 Lean Analytics Cycle Slide 56 Lean Analytics Cycle Slide 57 Lean Analytics Cycle Slide 58 Lean Analytics Cycle Slide 59 Lean Analytics Cycle Slide 60 Lean Analytics Cycle Slide 61 Lean Analytics Cycle Slide 62 Lean Analytics Cycle Slide 63 Lean Analytics Cycle Slide 64 Lean Analytics Cycle Slide 65 Lean Analytics Cycle Slide 66 Lean Analytics Cycle Slide 67 Lean Analytics Cycle Slide 68 Lean Analytics Cycle Slide 69 Lean Analytics Cycle Slide 70 Lean Analytics Cycle Slide 71 Lean Analytics Cycle Slide 72 Lean Analytics Cycle Slide 73 Lean Analytics Cycle Slide 74 Lean Analytics Cycle Slide 75 Lean Analytics Cycle Slide 76 Lean Analytics Cycle Slide 77 Lean Analytics Cycle Slide 78 Lean Analytics Cycle Slide 79 Lean Analytics Cycle Slide 80 Lean Analytics Cycle Slide 81 Lean Analytics Cycle Slide 82 Lean Analytics Cycle Slide 83 Lean Analytics Cycle Slide 84 Lean Analytics Cycle Slide 85 Lean Analytics Cycle Slide 86 Lean Analytics Cycle Slide 87 Lean Analytics Cycle Slide 88 Lean Analytics Cycle Slide 89 Lean Analytics Cycle Slide 90 Lean Analytics Cycle Slide 91 Lean Analytics Cycle Slide 92 Lean Analytics Cycle Slide 93 Lean Analytics Cycle Slide 94 Lean Analytics Cycle Slide 95 Lean Analytics Cycle Slide 96
Upcoming SlideShare
Slack's Ali Rayl on Scaling Support for User Growth
Next
Download to read offline and view in fullscreen.

372 Likes

Share

Download to read offline

Lean Analytics Cycle

Download to read offline

Related Books

Free with a 30 day trial from Scribd

See all

Related Audiobooks

Free with a 30 day trial from Scribd

See all

Lean Analytics Cycle

  1. Lean Analytics Lean Product & Lean UX Silicon Valley - July 2014 Hiten Shah hnshah@gmail.com Download the slides: h p://kiss.ly/leanprod2014
  2. Continuous Learning & Improvement
  3. Don’t know where to start?
  4. Wondering if you’re working on the right things?
  5. Or, you just want to hear me babble!
  6. HTTP://KISS.LY/LEANLYTICSBOOK
  7. Lean Analytics helps you Optimize for Learning
  8. Lean Analytics Cycle AVINASH KAUSHIK HTTP://KISS.LY/LEANAC
  9. Metrics  →  Hypothesis  →  Experiment  →  Act
  10. HTTP://HELLOBAR.COM
  11. What is Hello Bar?
  12.  Metrics    Figure  out  what  to  improve    Hypothesis    Make  an  educated  guess        Experiment    Test  your  guess    Act    Decide  what’s  next
  13. Our funnel showed a low installation rate Hello Bar Funnel Metrics Steps Visitors Homepage URL Entries Created First Bar Completed Registration Installed Totals 15068 1868 716 688 398 % prev step 12.40% 38.33% 96.09% 57.85% % drop off -87.60% -61.67% -3.91% -42.15% % of visitors 100% 12.40% 4.75% 4.57% 2.64%
  14. We  achieved  a  40%  increase  for  our   installa2on  rate  with  just  this  one   first  experiment. The Lean Analytics Cycle At Work
  15. Original Hello Bar installation screen
  16.  Metrics    Figure  out  what  to  improve    Hypothesis    Make  an  educated  guess        Experiment    Test  your  guess    Act    Decide  what’s  next
  17. Find out why people don’t install Hello Bar
  18. Didn’t Meet My Expectations
  19. I Had Trouble Installing It
  20. I Don’t Have A Website
  21. Not Ready To Install
  22. Other
  23. Hello Bar Experiment Hypothesis If  more  installa2on  op2ons  are  given,   then  more  people  will  add  Hello  Bar   to  their  website  due  to  the  need  for  a   WordPress  plugin  and  ability  to  email   the  code  to  someone  else.
  24.  Metrics    Figure  out  what  to  improve    Hypothesis    Make  an  educated  guess        Experiment    Test  your  guess    Act    Decide  what’s  next
  25. Created a new flow to test
  26. I can install code myself.
  27. 41.67% responded with “WordPress Plugin”
  28. 25% responded with “email my developer / web designer”
  29. I need help.
  30.  Metrics    Figure  out  what  to  improve    Hypothesis    Make  an  educated  guess        Experiment    Test  your  guess    Act    Decide  what’s  next
  31. Full funnel metrics for the experiment Variation Steps Visitors Homepage URL Entries Created First Bar Completed Registration Installed Totals 7456 906 342 329 276 % prev step 12.15% 37.75% 96.20% 83.89% % drop off -87.85% -62.25% -3.80% -16.11% % of visitors 100% 12.15% 4.59% 4.41% 3.70% Control Steps Visitors Homepage URL Entries Created First Bar Completed Registration Installed Totals 7469 925 353 341 197 % prev step 12.38% 38.16% 96.60% 57.77% % drop off -87.62% -61.84% -3.40% -42.23% % of visitors 100% 12.38% 4.73% 4.57% 2.64%
  32. Resulted in a 30% installation rate increase HTTP://ISVALID.ORG Experiment resulted in a 40% improvement
  33. ACer  a  dozen  more  experiments,  our   installa2on  rate  is  now  hovering   between  5%  and  7%   That’s  an  addi;onal  89%  increase!!! The Lean Analytics Cycle At Work
  34. Metrics  →  Hypothesis  →  Experiment  →  Act How You Can Put It Into Practice
  35. Metrics   Figure  out  what  to  improve
  36. “What gets measured, gets managed.” Peter Drucker
  37. Baselines DATA DNA EBOOK HTTP://KISS.LY/OPTDATADNA
  38. Funnels KISSMETRICS FUNNEL REPORT HTTP://KISS.LY/KMFUNNEL
  39. SaaS Funnel KISSMETRICS FUNNEL REPORT HTTP://KISS.LY/KMFUNNEL
  40. eCommerce Funnel KISSMETRICS FUNNEL REPORT HTTP://KISS.LY/KMFUNNEL
  41. Revenue BUFFER BAREMETRICS HTTP://KISS.LY/BUFFERBARE
  42. Spreadsheets and Calculations HELLOBAR HTTP://HELLOBAR.COM Steps Visitors Homepage URL Entries Created First Bar Completed Registration Installed Created Second Bar Totals 15068 1868 716 688 398 193 % prev step 12.40% 38.33% 96.09% 57.85% 48.49% % drop off -87.60% -61.67% -3.91% -42.15% -51.51% % of visitors 100% 12.40% 4.75% 4.57% 2.64% 1.28%
  43. Hypothesis   Make  an  educated  guess
  44. “A solid test hypothesis is an informed solution to a real problem – not an arbitrary guess. The more research and data you have to base your hypothesis on, the be er it will be.”
 — Michael Aagaard, h p://kiss.ly/abthypo
  45. Research   Tools  &  Tac;cs
  46. Customer Development HTTP://WWW.CUSTDEV.COM
  47. Jobs To Be Done #JTBD HTTP://JOBSTOBEDONE.ORG
  48. Usability Testing HTTP://USERTESTING.COM
  49. Live Chat HTTP://OLARK.COM
  50. Mouse Tracking HTTP://CRAZYEGG.COM
  51. Long Form Surveying HTTP://SURVEYMONKEY.COM
  52. On-Page Surveying HTTP://QUALAROO.COM
  53. Personalized Messaging HTTP://INTERCOM.IO
  54. Email a survey to people HTTP://SURVEYMONKEY.COM
  55. Ask people why they canceled HTTP://SURVEYMONKEY.COM
  56. Get feedback right when they cancel
  57. Exit Surveys HTTP://QUALAROO.COM
  58. Discover what’s missing HTTP://QUALAROO.COM
  59. Find out what words people use to describe your product HTTP://QUALAROO.COM
  60. Learn about people’s expectations HTTP://INTERCOM.IO
  61. Learn what frustrates people HTTP://INTERCOM.IO
  62. More actionable reading… QUALITATIVE DATA HTTP://KISS.LY/QUALABT
  63. Experiment Hypothesis Formula DATA DNA EBOOK HTTP://KISS.LY/OPTDATADNA
  64. Experiment   Test  your  guess
  65. Only  1  out  of  5  tests  win. 4  out  of  5  tests   cost  you  money. $
  66. 1)  Which  top  metric  are  we  trying  to  improve?   2)  What  can  you  anchor  your  metric  against?   3)  What  is  your  hypothesis  about  why  this  metric  is  at  x%?   4)  What  do  we  expect  from  this  experiment?   5)  What  was  the  result  and  what  did  we  learn  from  it? HTTP://KISS.LY/6QSAB Answer key questions for each experiment
  67. Prioritize your experiments HTTP://KISS.LY/ABPIE
  68. Don’t copy “best practices” blindly
  69. Learn what works best for you
  70. Act   Decide  what’s  next
  71. Explore  the  results  and  make   data  informed  decisions. THE ANALYTICS THAT MATTER TO FACEBOOK HTTP://KISS.LY/FBINFORM
  72. KISSmetrics A/B Testing Report KISSMETRICS A/B TESTING REPORT HTTP://KISS.LY/KMABTEST
  73. We know that people love Google Analytics
  74. KISSmetrics Experiment Hypothesis If  people  authen2cate  with  Google,   then  more  people  will  sign  up  due  to   their  exis2ng  familiarity  with  Google   Analy2cs  and  alignment  with  our   winning  headline.
  75. KISSmetrics Homepage Test Control
  76. KISSmetrics Homepage Test Variation
  77. KISSmetrics Homepage Test Signup Conversion Rate KISSMETRICS A/B TESTING REPORT HTTP://KISS.LY/KMABTEST
  78. KISSmetrics Homepage Test Received Data KISSMETRICS A/B TESTING REPORT HTTP://KISS.LY/KMABTEST
  79. KISSmetrics Homepage New Control
  80. Inspiration
  81. KISSmetrics Homepage New Test Variation
  82. KISSmetrics Homepage Test Signup Conversion Rate KISSMETRICS A/B TESTING REPORT HTTP://KISS.LY/KMABTEST
  83. KISSmetrics Homepage Test Received Data KISSMETRICS A/B TESTING REPORT HTTP://KISS.LY/KMABTEST
  84. Growth! HTTP://KISSMETRICS.COM
  85.  Metrics    Figure  out  what  to  improve    Hypothesis    Make  an  educated  guess        Experiment    Test  your  guess    Act    Decide  what’s  next
  86. Hiten Shah hnshah@gmail.com @hnshah You will get all you want in life if you help enough other people get what they want. Zig Ziglar Download the slides: h p://kiss.ly/leanprod2014
  • TeresaPatel2

    Nov. 26, 2021
  • Denizt3

    Sep. 3, 2020
  • lucasslide

    Aug. 22, 2020
  • WhitneyHope

    Jun. 9, 2020
  • TillyYaduvansi

    Feb. 5, 2020
  • NancyDembia

    Nov. 19, 2019
  • ANMOLJAIN129

    Oct. 9, 2019
  • RicciSchooler

    Jun. 11, 2019
  • TumuhimbiseDeus

    Mar. 13, 2019
  • MohamedAbdelaalAhmed

    Jan. 17, 2019
  • kipotzulkifli

    Dec. 9, 2018
  • zahernourredine

    Dec. 7, 2018
  • JacobPetoskey

    Nov. 25, 2018
  • VojtchHublovsk

    Nov. 19, 2018
  • LekanAbudu1

    Sep. 17, 2018
  • mohinipatil123

    Jul. 22, 2018
  • jeevanand

    May. 24, 2018
  • MaximilianMhring

    May. 3, 2018
  • zhangboface

    Mar. 20, 2018
  • ShuheiNagasawa

    Feb. 11, 2018

Views

Total views

394,519

On Slideshare

0

From embeds

0

Number of embeds

170,247

Actions

Downloads

2,326

Shares

0

Comments

0

Likes

372

×