Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Cześć
Build Measure Learn Is Broken
@MandaLaceyS
@MandaLaceyS | #aceconf
3
Image from http://theleanstartup.com/principles @MandaLaceyS | #aceconf
What is The Lean Startup, again?
@MandaLaceyS | #aceconf
Lean Startup
A method to develop new businesses and products that addresses
uncertainty and risk
through cycles of rapid e...
@MandaLaceyS | #aceconf
Art by Allie Brosh @MandaLaceyS | #aceconf
@MandaLaceyS | #aceconf
@MandaLaceyS | #aceconf
@MandaLaceyS | #aceconf
Lean Startup Concepts
Entrepreneurship is everywhere.
Eliminate waste.
Innovation Accounting.
Validated Learning.
Build. M...
12
@MandaLaceyS | #aceconf
Observe
Question
Hypothesize
Experiment
Conclusion
@MandaLaceyS | #aceconf
Observe
Question
Hypothesize
Experiment
Conclusion Learn
Measure
Build
@MandaLaceyS | #aceconf
Build.
Measure.
Learn.
@MandaLaceyS | #aceconf
Build - MVP
Measure - Meaningful data
Learn - To pivot or persevere
@MandaLaceyS | #aceconf
Build
@MandaLaceyS | #aceconf
Minimum
Viable
Product (required to learn)
@MandaLaceyS | #aceconf
DA REAL MVP
NOT half baked
NOT a bad experience
NOT necessarily code
@MandaLaceyS | #aceconf
GOOD MVP
@MandaLaceyS | #aceconf
GOOD ITERATION
@MandaLaceyS | #aceconf
GOOD ITERATION
@MandaLaceyS | #aceconf
NOT MINIMUM @MandaLaceyS | #aceconf
NOT VIABLE
@MandaLaceyS | #aceconf
NOT HALF-Baked
NOT VIABLE @MandaLaceyS | #aceconf
Measure
@MandaLaceyS | #aceconf
Validated Learning
@MandaLaceyS | #aceconf
answer
Actionable MetricsVanity Metrics*
Anything that looks good
but doesn’t help you
make a decision
Examples:
• Faceboo...
*Metric Caveat
@MandaLaceyS | #aceconf
Learn
@MandaLaceyS | #aceconf
31
Pivot! Pivot! PIVOT! @MandaLaceyS | #aceconf
32
@UXDC @MandaLaceyS | #UXDC2017@MandaLaceyS | #aceconf
Observe
Question
Hypothesize
Experiment
Conclusion Learn
Measure
Build
@MandaLaceyS | #aceconf
Observe
Question
Hypothesize
Experiment
Conclusion Learn
Measure
Build
@MandaLaceyS | #aceconf
??
??
??
Art by Allie Brosh @MandaLaceyS | #aceconf
@MandaLaceyS | #aceconf
So what should the team do?
@MandaLaceyS | #aceconf
1.
Start with a problem
[Based on GOOB]
@MandaLaceyS | #aceconf
39
Interview
@MandaLaceyS | #aceconf
40
Diary
Study
or
Experience
Sampling
@MandaLaceyS | #aceconf
Interviews, diary studies,
experience mapping, etc.
Experience Map
@MandaLaceyS | #aceconf
42
@MandaLaceyS | #aceconf
43
The cat doesn’t have a bed, causing
him to look for other places to sleep.
@MandaLaceyS | #aceconf
44
NOT: We should build a cat bed.
@MandaLaceyS | #aceconf
45
NOT: The cat is too big for the box.
@MandaLaceyS | #aceconf
2. Make a clear hypothesis
@MandaLaceyS | #aceconf
If we [do, build, provide x thing],
then [these people]
will [some desirable outcome].
We’ll know when [actionable metrics...
48
If we build a comfy nap place,
then Sammy
won’t sleep on my keyboard.
We’ll know this when I’m able to work 2
hours of ...
3. Design your experiment
@MandaLaceyS | #aceconf
A/B Tests
@MandaLaceyS | #aceconf
Wizard of Oz
@MandaLaceyS | #aceconf
Ad Tests
@MandaLaceyS | #aceconf
4.
Generate solutions together
[Aka figure out what your MVP is]
@MandaLaceyS | #aceconf
Participatory Design @MandaLaceyS | #aceconf
6 up, 1 ups
Idea
IdeaIdeaIdea
IdeaIdea
6 Ideas
@MandaLaceyS | #aceconf
6 up, 1 ups
Idea
Best Idea Notes
@MandaLaceyS | #aceconf
57
@MandaLaceyS | #aceconf
58
@MandaLaceyS | #aceconf
59
@MandaLaceyS | #aceconf
60
@MandaLaceyS | #aceconf
5. THEN run your test
@MandaLaceyS | #aceconf
Start with Think
@MandaLaceyS | #aceconf
63
Image from http://theleanstartup.com/principles @MandaLaceyS | #aceconf
64
Image from http://theleanstartup.com/principles @MandaLaceyS | #aceconf
@MandaLaceyS | #aceconf
Start here!!
@MandaLaceyS | #aceconf
Reduce cycle time.
Not build time.
@MandaLaceyS | #aceconf
@MandaLaceyS | #aceconf
The more precise your hypothesis,
the less you have to build,
the easier it is to come to conclusions,
the faster you can ...
The more precise your hypothesis,
the less you have to build,
the easier it is to come to conclusions,
the faster you can ...
The more precise your hypothesis,
the less you have to build,
the easier it is to come to conclusions,
the faster you can ...
The more precise your hypothesis,
the less you have to build,
the easier it is to come to conclusions,
the faster you can ...
Don’t forget the big picture.
@MandaLaceyS | #aceconf
74
@MandaLaceyS | #aceconf
Dziękuję Ci bardzo!
@MandaLaceyS
amanda.stockwell@gmail.com
Upcoming SlideShare
Loading in …5
×

Build Measure Learn is Broken, ACE!

278 views

Published on

The Build, Measure, Learn loop is at the center of the Lean Startup approach, which is becoming increasingly popular among companies of all sizes. While the framework calls for very UX-friendly processes, such as collecting iterative feedback and focusing on building a Minimal Viable Product (MVP) required for doing so, the way most companies implement Build, Measure, Learn is broken and reinforces bad old habits of building first, assuming later. Many engineering teams use Build Measure Learn as an excuse to jump into building a skeleton version of a product, assuming that they can only get good feedback once they have working code. While most of us know you should incorporate research earlier, and the Lean Startup approach actually calls for it, it can be hard to change the minds of development-centered thinkers.

In this session, I’ll provide an overview of the Lean Startup and Build Measure Learn framework, pros and cons of these approaches, and tips for teams to utilize these approaches to infuse learning into their process as soon as possible.

Published in: Software
  • Be the first to comment

Build Measure Learn is Broken, ACE!

  1. 1. Cześć
  2. 2. Build Measure Learn Is Broken @MandaLaceyS @MandaLaceyS | #aceconf
  3. 3. 3 Image from http://theleanstartup.com/principles @MandaLaceyS | #aceconf
  4. 4. What is The Lean Startup, again? @MandaLaceyS | #aceconf
  5. 5. Lean Startup A method to develop new businesses and products that addresses uncertainty and risk through cycles of rapid experimentation. @MandaLaceyS | #aceconf
  6. 6. @MandaLaceyS | #aceconf
  7. 7. Art by Allie Brosh @MandaLaceyS | #aceconf
  8. 8. @MandaLaceyS | #aceconf
  9. 9. @MandaLaceyS | #aceconf
  10. 10. @MandaLaceyS | #aceconf
  11. 11. Lean Startup Concepts Entrepreneurship is everywhere. Eliminate waste. Innovation Accounting. Validated Learning. Build. Measure. Learn. @MandaLaceyS | #aceconf
  12. 12. 12 @MandaLaceyS | #aceconf
  13. 13. Observe Question Hypothesize Experiment Conclusion @MandaLaceyS | #aceconf
  14. 14. Observe Question Hypothesize Experiment Conclusion Learn Measure Build @MandaLaceyS | #aceconf
  15. 15. Build. Measure. Learn. @MandaLaceyS | #aceconf
  16. 16. Build - MVP Measure - Meaningful data Learn - To pivot or persevere @MandaLaceyS | #aceconf
  17. 17. Build @MandaLaceyS | #aceconf
  18. 18. Minimum Viable Product (required to learn) @MandaLaceyS | #aceconf
  19. 19. DA REAL MVP NOT half baked NOT a bad experience NOT necessarily code @MandaLaceyS | #aceconf
  20. 20. GOOD MVP @MandaLaceyS | #aceconf
  21. 21. GOOD ITERATION @MandaLaceyS | #aceconf
  22. 22. GOOD ITERATION @MandaLaceyS | #aceconf
  23. 23. NOT MINIMUM @MandaLaceyS | #aceconf
  24. 24. NOT VIABLE @MandaLaceyS | #aceconf
  25. 25. NOT HALF-Baked NOT VIABLE @MandaLaceyS | #aceconf
  26. 26. Measure @MandaLaceyS | #aceconf
  27. 27. Validated Learning @MandaLaceyS | #aceconf
  28. 28. answer Actionable MetricsVanity Metrics* Anything that looks good but doesn’t help you make a decision Examples: • Facebook likes • Pageviews • Event attendees Tied to specific, repeatable tasks and help you decide whether you’re succeeding or not Examples: • Revenue per customer • Retention rate • Customer source @MandaLaceyS | #aceconf
  29. 29. *Metric Caveat @MandaLaceyS | #aceconf
  30. 30. Learn @MandaLaceyS | #aceconf
  31. 31. 31 Pivot! Pivot! PIVOT! @MandaLaceyS | #aceconf
  32. 32. 32 @UXDC @MandaLaceyS | #UXDC2017@MandaLaceyS | #aceconf
  33. 33. Observe Question Hypothesize Experiment Conclusion Learn Measure Build @MandaLaceyS | #aceconf
  34. 34. Observe Question Hypothesize Experiment Conclusion Learn Measure Build @MandaLaceyS | #aceconf ?? ?? ??
  35. 35. Art by Allie Brosh @MandaLaceyS | #aceconf
  36. 36. @MandaLaceyS | #aceconf
  37. 37. So what should the team do? @MandaLaceyS | #aceconf
  38. 38. 1. Start with a problem [Based on GOOB] @MandaLaceyS | #aceconf
  39. 39. 39 Interview @MandaLaceyS | #aceconf
  40. 40. 40 Diary Study or Experience Sampling @MandaLaceyS | #aceconf
  41. 41. Interviews, diary studies, experience mapping, etc. Experience Map @MandaLaceyS | #aceconf
  42. 42. 42 @MandaLaceyS | #aceconf
  43. 43. 43 The cat doesn’t have a bed, causing him to look for other places to sleep. @MandaLaceyS | #aceconf
  44. 44. 44 NOT: We should build a cat bed. @MandaLaceyS | #aceconf
  45. 45. 45 NOT: The cat is too big for the box. @MandaLaceyS | #aceconf
  46. 46. 2. Make a clear hypothesis @MandaLaceyS | #aceconf
  47. 47. If we [do, build, provide x thing], then [these people] will [some desirable outcome]. We’ll know when [actionable metrics]. @MandaLaceyS | #aceconf
  48. 48. 48 If we build a comfy nap place, then Sammy won’t sleep on my keyboard. We’ll know this when I’m able to work 2 hours of uninterrupted work 5 days in a row. @MandaLaceyS | #aceconf
  49. 49. 3. Design your experiment @MandaLaceyS | #aceconf
  50. 50. A/B Tests @MandaLaceyS | #aceconf
  51. 51. Wizard of Oz @MandaLaceyS | #aceconf
  52. 52. Ad Tests @MandaLaceyS | #aceconf
  53. 53. 4. Generate solutions together [Aka figure out what your MVP is] @MandaLaceyS | #aceconf
  54. 54. Participatory Design @MandaLaceyS | #aceconf
  55. 55. 6 up, 1 ups Idea IdeaIdeaIdea IdeaIdea 6 Ideas @MandaLaceyS | #aceconf
  56. 56. 6 up, 1 ups Idea Best Idea Notes @MandaLaceyS | #aceconf
  57. 57. 57 @MandaLaceyS | #aceconf
  58. 58. 58 @MandaLaceyS | #aceconf
  59. 59. 59 @MandaLaceyS | #aceconf
  60. 60. 60 @MandaLaceyS | #aceconf
  61. 61. 5. THEN run your test @MandaLaceyS | #aceconf
  62. 62. Start with Think @MandaLaceyS | #aceconf
  63. 63. 63 Image from http://theleanstartup.com/principles @MandaLaceyS | #aceconf
  64. 64. 64 Image from http://theleanstartup.com/principles @MandaLaceyS | #aceconf
  65. 65. @MandaLaceyS | #aceconf
  66. 66. Start here!! @MandaLaceyS | #aceconf
  67. 67. Reduce cycle time. Not build time. @MandaLaceyS | #aceconf
  68. 68. @MandaLaceyS | #aceconf
  69. 69. The more precise your hypothesis, the less you have to build, the easier it is to come to conclusions, the faster you can go. PROTIP
  70. 70. The more precise your hypothesis, the less you have to build, the easier it is to come to conclusions, the faster you can go. PROTIP
  71. 71. The more precise your hypothesis, the less you have to build, the easier it is to come to conclusions, the faster you can go. PROTIP
  72. 72. The more precise your hypothesis, the less you have to build, the easier it is to come to conclusions, the faster you can go. PROTIP
  73. 73. Don’t forget the big picture. @MandaLaceyS | #aceconf
  74. 74. 74 @MandaLaceyS | #aceconf
  75. 75. Dziękuję Ci bardzo! @MandaLaceyS amanda.stockwell@gmail.com

×