SlideShare a Scribd company logo
1 of 65
Download to read offline
Tristan.Kromer@TriKro.com
WWW
GrasshopperHerder.com
Real MVP:
1. Explain the vision
2. Ask questions
3. Take a guess
4. Real example
Let musicians make money doing what they love
without dealing with marketing.
Create a two sided market to connect
musicians in low cost countries with content
producers.
Constraints
You have no technical abilities, no technical
co-founder, and $1500 dollars to your name.
Vision
A social news reader that delivers inspiring
articles to you based on your likes and
follows.
Vision
What is lean?
The
Real Startup Book
• 5 second tests
• Comprehension
• Conjoint Analysis
• Data mining / market
research
• Surveys* (closed)
• Smoke tests
• Video
• Landing page
• Customer Discovery
Interviews
• Contextual inquiry
/ ethnography
• Data mining
• Focus groups*
• Surveys* (open
ended)
• Solution
interview
• Contextual
inquiry /
ethnography
• Demo pitch
• Concierge test /
Consulting
• Competitor
Usability
• Picnic in the
Graveyard
• Paper prototypes
Quantitative
• Do people use the product?
• Does this feature increase
retention?
• What are our customer
demographics?
• Which color is better?
• What’s the average basket size?
• What’s the LTV?
CLOSED-ENDED QUESTIONS
What?

Qualitative
• Why do people use it?
• What’s wrong with this?
• How should I design it?
• How could I make this better?
• Why do people do that?
• What do people love about it?
• Why is there drop off?
• What do they think?
OPEN-ENDED QUESTIONS
Why?
Market
• What are our customer
demographics?
• What are their pains?
• Is our segment too broad?
• What job needs to be done?
• How do we find them?
• How much will they pay?
• How do we convince them to buy?
• How much will it cost to sell?
• Can we scale marketing?
Problem

Product
• Do people use the product?
• How can we solve this problem?
• What form should this take?
• How important is the design?
• Does this feature increase
retention?
• What’s the quickest hack?
• What’s the minimum feature set?
• How should we prioritize?
• Is this solution working?
• What do people like / dislike?
• Why do they do that?
• What’s the average basket size?
Solution
Research
• What are our customer demos?
• What are their pains?
• What job needs to be done?
• Is our segment too broad?
• How do we find them?
• How can we solve this problem?
• What form should this take?
• How important is the design?
• What’s the quickest hack?
• What’s the minimum feature set?
• How should we prioritize?
Generate Ideas &
Identify Assumptions

Experiments
• How much will they pay?
• How do we convince them to buy?
• How much will it cost to sell?
• Can we scale marketing?
• Is this solution working?
• Are people using it?
• Which solution is better?
• Does this feature increase
retention?
• How should we optimize this?
• What do people like / dislike?
• Why do they do that?
Test Hypotheses
• Who is our customer?
• What are their pains?
• What job needs to be done?
• Is our customer segment too broad?
• How do we find them?
+ =
• Customer Discovery Interviews
• Contextual inquiry / ethnography
• Data mining
• Focus groups*
• Surveys* (open ended)
• Are they really willing to pay?
• How much will they pay?
• How do we convince them to buy?
• How much will it cost to sell?
• Can we scale marketing?
+ =
• Smoke tests
• Video
• Landing page
• Sales pitch
• Pre-sales
• Flyers
• Pocket test
• Event
• Fake door
• High bar
• 5 second tests
• Comprehension
• Conjoint Analysis
• Data mining /
market research
• Surveys* (closed)
• How can we solve this problem?
• What form should this take?
• How important is the design?
• What’s the quickest hack?
• What is the minimum feature set?
• How should we prioritize?
+ =
• Solution interview
• Contextual inquiry / ethnography
• Demo pitch
• Concierge test / Consulting
• Competitor Usability
• Picnic in the Graveyard
• Is this solution working?
• Are people using it?
• Which solution is better?
• How should we optimize this?
• What do people like / dislike?
• Why do they do that?
+ =
• Paper prototypes
• Clickable prototypes
• Usability
• Hallway
• Live
• Remote
• Wizard of Oz
• Takeaway
• Functioning products
• Analytics / Dashboards
• Surveys* (NPS)
For more info and updates:
http://trikro.com/downloads/playbook
Designing & Measuring
Experiments
!
Experiment Herder Template* by TriKro LLC!
(For S.M.A.R.T Experiments: Smart Measurable Achievable Relevant Timely)
Learning Goal!
!What do we need to learn?!
What is our riskiest assumption?!
What is our one priority?
Hypothesis!
!Is it falsifiable?!
Is it specific?!
Is it causal? e.g. If X then Y!
Is it Relevant to the learning goal?
Metric!
!Qualitative or quantitative?!
Is it actionable?!
Is it Measurable?
Fail Condition!
!!!!If this happens,!
our hypothesis is clearly false!
wtf,s!!
!!!!If this happens, stop!!
Experiment is broken, retro!
Experiment!
!How will you collect the data?!
Is it Specific?!
Is it Achievable?!
!Link to any supporting documents
Time Box!
!Is the experiment Timely?!
Can we get data faster?!
Would less data be sufficient?!
Is the retro in our calendar?
Start End Retro
Result!
!What happened?!
What data did we collect?!
Anything unexpected?
Next Step!
!Pivot or persevere?!
Another experiment for this goal?!
Do we need to clean up?
Designed by: TriKro LLC - Lean Coaching and Innovation Ecosystem Design!
The Smart Experiment Template by TriKro LLC is licensed under!
a Creative Commons Attribution-ShareAlike 4.0 International License
Designed for:
Designed by:
* Templates are bad,!
make your own!
Experiment Templates*
1. Learning Goal
2. Hypothesis
3. Metric
4. Fail Condition
5. Plan
6. Time Box
7. Results
8. Next Step
9. wtf,s!
Interactions
Events
Happiness
Retrospectives
Experiment Templates*
1. Learning Goal
2. Hypothesis
3. Metric
4. Fail Condition
5. Plan
6. Time Box
7. Results
8. Next Step
9. wtf,s!
Tristan.Kromer@TriKro.com
WWW
GrasshopperHerder.com
This presentation by TriKro LLC is licensed under a
Creative Commons Attribution-NonCommercial-ShareAlike
4.0 International License excepting those images
where other copyright holders are noted.
Based on a work at http://GrasshopperHerder.com.

More Related Content

What's hot

Intro to Design w/ Pivotal Labs
Intro to Design w/ Pivotal LabsIntro to Design w/ Pivotal Labs
Intro to Design w/ Pivotal Labs
500 Startups
 

What's hot (20)

A Primer on Primary Market Research
A Primer on Primary Market ResearchA Primer on Primary Market Research
A Primer on Primary Market Research
 
Anatomy of a killer retail website - 'Triggr The Web'
Anatomy of a killer retail website - 'Triggr The Web'Anatomy of a killer retail website - 'Triggr The Web'
Anatomy of a killer retail website - 'Triggr The Web'
 
Practical customer development
Practical customer developmentPractical customer development
Practical customer development
 
“Golden questions” that reveal exactly why your website's visitors aren’t con...
“Golden questions” that reveal exactly why your website's visitors aren’t con...“Golden questions” that reveal exactly why your website's visitors aren’t con...
“Golden questions” that reveal exactly why your website's visitors aren’t con...
 
Customer Discovery: Validating New Product Opportunities
Customer Discovery: Validating New Product OpportunitiesCustomer Discovery: Validating New Product Opportunities
Customer Discovery: Validating New Product Opportunities
 
MEMSI June 2018: Primary Market Research Workshop
MEMSI June 2018: Primary Market Research WorkshopMEMSI June 2018: Primary Market Research Workshop
MEMSI June 2018: Primary Market Research Workshop
 
Are your visitors losing the will to live?
Are your visitors losing the will to live?Are your visitors losing the will to live?
Are your visitors losing the will to live?
 
Marketing Institute | Optimisation course
Marketing Institute | Optimisation courseMarketing Institute | Optimisation course
Marketing Institute | Optimisation course
 
NUX Leeds: Enemies of UX
NUX Leeds: Enemies of UXNUX Leeds: Enemies of UX
NUX Leeds: Enemies of UX
 
Intro to Design w/ Pivotal Labs
Intro to Design w/ Pivotal LabsIntro to Design w/ Pivotal Labs
Intro to Design w/ Pivotal Labs
 
Defying Gravity: Channeling Newton to Up-Level Your Experiments
Defying Gravity: Channeling Newton to Up-Level Your ExperimentsDefying Gravity: Channeling Newton to Up-Level Your Experiments
Defying Gravity: Channeling Newton to Up-Level Your Experiments
 
Conversion Optimization with Peep Laja
Conversion Optimization with Peep LajaConversion Optimization with Peep Laja
Conversion Optimization with Peep Laja
 
Building Products At Amazon
Building Products At AmazonBuilding Products At Amazon
Building Products At Amazon
 
How To Do Landing Page Optimisation
How To Do Landing Page OptimisationHow To Do Landing Page Optimisation
How To Do Landing Page Optimisation
 
Guerrilla Validation
Guerrilla ValidationGuerrilla Validation
Guerrilla Validation
 
Understanding users without getting bored
Understanding users without getting boredUnderstanding users without getting bored
Understanding users without getting bored
 
Be More Valuable, Faster
Be More Valuable, FasterBe More Valuable, Faster
Be More Valuable, Faster
 
Rich Mironov (CEO, Mironov Consulting) - What To Do About Your Audience's Rea...
Rich Mironov (CEO, Mironov Consulting) - What To Do About Your Audience's Rea...Rich Mironov (CEO, Mironov Consulting) - What To Do About Your Audience's Rea...
Rich Mironov (CEO, Mironov Consulting) - What To Do About Your Audience's Rea...
 
MEMSI June: DE2 - What can you do for your customer?
MEMSI June: DE2 - What can you do for your customer?MEMSI June: DE2 - What can you do for your customer?
MEMSI June: DE2 - What can you do for your customer?
 
Building Products The Amazon Way
Building Products The Amazon WayBuilding Products The Amazon Way
Building Products The Amazon Way
 

Similar to 2016 03-15 lean @ lsc rotterdam by Tristan Kromer

10 things to keep in mind
10 things to keep in mind10 things to keep in mind
10 things to keep in mind
Michael Burcham
 
Customer Development - Notes from the Field
Customer Development - Notes from the FieldCustomer Development - Notes from the Field
Customer Development - Notes from the Field
Christian Gammill
 

Similar to 2016 03-15 lean @ lsc rotterdam by Tristan Kromer (20)

Aligning Content to the B2B Buyer's Journey
Aligning Content to the B2B Buyer's JourneyAligning Content to the B2B Buyer's Journey
Aligning Content to the B2B Buyer's Journey
 
What Is Content Strategy?
What Is Content Strategy?What Is Content Strategy?
What Is Content Strategy?
 
2a customer discovery ( canvas and story ).2013.q2
2a customer discovery ( canvas and story ).2013.q22a customer discovery ( canvas and story ).2013.q2
2a customer discovery ( canvas and story ).2013.q2
 
Content the Searh Engines will Love with Andy Arestodina
Content the Searh Engines will Love with Andy ArestodinaContent the Searh Engines will Love with Andy Arestodina
Content the Searh Engines will Love with Andy Arestodina
 
10 things to keep in mind
10 things to keep in mind10 things to keep in mind
10 things to keep in mind
 
3 marketing
3 marketing3 marketing
3 marketing
 
Webinar- How to turn your Website Into Leads
Webinar- How to turn your Website Into LeadsWebinar- How to turn your Website Into Leads
Webinar- How to turn your Website Into Leads
 
Leanconf 2014: the agony of lean startup by tristan kromer
Leanconf 2014: the agony of lean startup by tristan kromerLeanconf 2014: the agony of lean startup by tristan kromer
Leanconf 2014: the agony of lean startup by tristan kromer
 
What analytics can do for you
What analytics can do for youWhat analytics can do for you
What analytics can do for you
 
JTBD for Marketering - Nopadon.pdf
JTBD for Marketering - Nopadon.pdfJTBD for Marketering - Nopadon.pdf
JTBD for Marketering - Nopadon.pdf
 
Customer Development - Notes from the Field
Customer Development - Notes from the FieldCustomer Development - Notes from the Field
Customer Development - Notes from the Field
 
20 Ways to Shaft your Split Tesring : Conversion Conference
20 Ways to Shaft your Split Tesring : Conversion Conference20 Ways to Shaft your Split Tesring : Conversion Conference
20 Ways to Shaft your Split Tesring : Conversion Conference
 
#BeginAtEnd: Content Planning For Insights - Liveworld #SXSW2014
#BeginAtEnd: Content Planning For Insights - Liveworld #SXSW2014#BeginAtEnd: Content Planning For Insights - Liveworld #SXSW2014
#BeginAtEnd: Content Planning For Insights - Liveworld #SXSW2014
 
Conversion Hotel 2014: Craig Sullivan (UK) keynote
Conversion Hotel 2014: Craig Sullivan (UK) keynoteConversion Hotel 2014: Craig Sullivan (UK) keynote
Conversion Hotel 2014: Craig Sullivan (UK) keynote
 
Selling UX
Selling UXSelling UX
Selling UX
 
Figuring out your ideal client
Figuring out your ideal clientFiguring out your ideal client
Figuring out your ideal client
 
The importance of getting a creative brief right
The importance of getting a creative brief rightThe importance of getting a creative brief right
The importance of getting a creative brief right
 
Buyer personas & Customer journey
Buyer personas & Customer journeyBuyer personas & Customer journey
Buyer personas & Customer journey
 
How to teach salespeople to always ask the right questions
How to teach salespeople to always ask the right questionsHow to teach salespeople to always ask the right questions
How to teach salespeople to always ask the right questions
 
So You Wanna Be a Content Strategist: SXSW 2016
So You Wanna Be a Content Strategist: SXSW 2016So You Wanna Be a Content Strategist: SXSW 2016
So You Wanna Be a Content Strategist: SXSW 2016
 

Recently uploaded

Call Girls in Delhi, Escort Service Available 24x7 in Delhi 959961-/-3876
Call Girls in Delhi, Escort Service Available 24x7 in Delhi 959961-/-3876Call Girls in Delhi, Escort Service Available 24x7 in Delhi 959961-/-3876
Call Girls in Delhi, Escort Service Available 24x7 in Delhi 959961-/-3876
dlhescort
 
Call Girls Jp Nagar Just Call 👗 7737669865 👗 Top Class Call Girl Service Bang...
Call Girls Jp Nagar Just Call 👗 7737669865 👗 Top Class Call Girl Service Bang...Call Girls Jp Nagar Just Call 👗 7737669865 👗 Top Class Call Girl Service Bang...
Call Girls Jp Nagar Just Call 👗 7737669865 👗 Top Class Call Girl Service Bang...
amitlee9823
 
Call Girls In DLf Gurgaon ➥99902@11544 ( Best price)100% Genuine Escort In 24...
Call Girls In DLf Gurgaon ➥99902@11544 ( Best price)100% Genuine Escort In 24...Call Girls In DLf Gurgaon ➥99902@11544 ( Best price)100% Genuine Escort In 24...
Call Girls In DLf Gurgaon ➥99902@11544 ( Best price)100% Genuine Escort In 24...
lizamodels9
 
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
lizamodels9
 
Call Girls Kengeri Satellite Town Just Call 👗 7737669865 👗 Top Class Call Gir...
Call Girls Kengeri Satellite Town Just Call 👗 7737669865 👗 Top Class Call Gir...Call Girls Kengeri Satellite Town Just Call 👗 7737669865 👗 Top Class Call Gir...
Call Girls Kengeri Satellite Town Just Call 👗 7737669865 👗 Top Class Call Gir...
amitlee9823
 
0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdf0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdf
Renandantas16
 
Call Girls Electronic City Just Call 👗 7737669865 👗 Top Class Call Girl Servi...
Call Girls Electronic City Just Call 👗 7737669865 👗 Top Class Call Girl Servi...Call Girls Electronic City Just Call 👗 7737669865 👗 Top Class Call Girl Servi...
Call Girls Electronic City Just Call 👗 7737669865 👗 Top Class Call Girl Servi...
amitlee9823
 
FULL ENJOY Call Girls In Majnu Ka Tilla, Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Majnu Ka Tilla, Delhi Contact Us 8377877756FULL ENJOY Call Girls In Majnu Ka Tilla, Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Majnu Ka Tilla, Delhi Contact Us 8377877756
dollysharma2066
 

Recently uploaded (20)

Call Girls Service In Old Town Dubai ((0551707352)) Old Town Dubai Call Girl ...
Call Girls Service In Old Town Dubai ((0551707352)) Old Town Dubai Call Girl ...Call Girls Service In Old Town Dubai ((0551707352)) Old Town Dubai Call Girl ...
Call Girls Service In Old Town Dubai ((0551707352)) Old Town Dubai Call Girl ...
 
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Pune Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service Available
 
Ensure the security of your HCL environment by applying the Zero Trust princi...
Ensure the security of your HCL environment by applying the Zero Trust princi...Ensure the security of your HCL environment by applying the Zero Trust princi...
Ensure the security of your HCL environment by applying the Zero Trust princi...
 
Mondelez State of Snacking and Future Trends 2023
Mondelez State of Snacking and Future Trends 2023Mondelez State of Snacking and Future Trends 2023
Mondelez State of Snacking and Future Trends 2023
 
Falcon Invoice Discounting platform in india
Falcon Invoice Discounting platform in indiaFalcon Invoice Discounting platform in india
Falcon Invoice Discounting platform in india
 
Call Girls in Delhi, Escort Service Available 24x7 in Delhi 959961-/-3876
Call Girls in Delhi, Escort Service Available 24x7 in Delhi 959961-/-3876Call Girls in Delhi, Escort Service Available 24x7 in Delhi 959961-/-3876
Call Girls in Delhi, Escort Service Available 24x7 in Delhi 959961-/-3876
 
John Halpern sued for sexual assault.pdf
John Halpern sued for sexual assault.pdfJohn Halpern sued for sexual assault.pdf
John Halpern sued for sexual assault.pdf
 
Business Model Canvas (BMC)- A new venture concept
Business Model Canvas (BMC)-  A new venture conceptBusiness Model Canvas (BMC)-  A new venture concept
Business Model Canvas (BMC)- A new venture concept
 
Organizational Transformation Lead with Culture
Organizational Transformation Lead with CultureOrganizational Transformation Lead with Culture
Organizational Transformation Lead with Culture
 
B.COM Unit – 4 ( CORPORATE SOCIAL RESPONSIBILITY ( CSR ).pptx
B.COM Unit – 4 ( CORPORATE SOCIAL RESPONSIBILITY ( CSR ).pptxB.COM Unit – 4 ( CORPORATE SOCIAL RESPONSIBILITY ( CSR ).pptx
B.COM Unit – 4 ( CORPORATE SOCIAL RESPONSIBILITY ( CSR ).pptx
 
Call Girls Jp Nagar Just Call 👗 7737669865 👗 Top Class Call Girl Service Bang...
Call Girls Jp Nagar Just Call 👗 7737669865 👗 Top Class Call Girl Service Bang...Call Girls Jp Nagar Just Call 👗 7737669865 👗 Top Class Call Girl Service Bang...
Call Girls Jp Nagar Just Call 👗 7737669865 👗 Top Class Call Girl Service Bang...
 
Falcon's Invoice Discounting: Your Path to Prosperity
Falcon's Invoice Discounting: Your Path to ProsperityFalcon's Invoice Discounting: Your Path to Prosperity
Falcon's Invoice Discounting: Your Path to Prosperity
 
Call Girls In DLf Gurgaon ➥99902@11544 ( Best price)100% Genuine Escort In 24...
Call Girls In DLf Gurgaon ➥99902@11544 ( Best price)100% Genuine Escort In 24...Call Girls In DLf Gurgaon ➥99902@11544 ( Best price)100% Genuine Escort In 24...
Call Girls In DLf Gurgaon ➥99902@11544 ( Best price)100% Genuine Escort In 24...
 
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
 
Call Girls Kengeri Satellite Town Just Call 👗 7737669865 👗 Top Class Call Gir...
Call Girls Kengeri Satellite Town Just Call 👗 7737669865 👗 Top Class Call Gir...Call Girls Kengeri Satellite Town Just Call 👗 7737669865 👗 Top Class Call Gir...
Call Girls Kengeri Satellite Town Just Call 👗 7737669865 👗 Top Class Call Gir...
 
0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdf0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdf
 
Call Girls Electronic City Just Call 👗 7737669865 👗 Top Class Call Girl Servi...
Call Girls Electronic City Just Call 👗 7737669865 👗 Top Class Call Girl Servi...Call Girls Electronic City Just Call 👗 7737669865 👗 Top Class Call Girl Servi...
Call Girls Electronic City Just Call 👗 7737669865 👗 Top Class Call Girl Servi...
 
BAGALUR CALL GIRL IN 98274*61493 ❤CALL GIRLS IN ESCORT SERVICE❤CALL GIRL
BAGALUR CALL GIRL IN 98274*61493 ❤CALL GIRLS IN ESCORT SERVICE❤CALL GIRLBAGALUR CALL GIRL IN 98274*61493 ❤CALL GIRLS IN ESCORT SERVICE❤CALL GIRL
BAGALUR CALL GIRL IN 98274*61493 ❤CALL GIRLS IN ESCORT SERVICE❤CALL GIRL
 
FULL ENJOY Call Girls In Majnu Ka Tilla, Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Majnu Ka Tilla, Delhi Contact Us 8377877756FULL ENJOY Call Girls In Majnu Ka Tilla, Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Majnu Ka Tilla, Delhi Contact Us 8377877756
 
Value Proposition canvas- Customer needs and pains
Value Proposition canvas- Customer needs and painsValue Proposition canvas- Customer needs and pains
Value Proposition canvas- Customer needs and pains
 

2016 03-15 lean @ lsc rotterdam by Tristan Kromer

  • 1.
  • 4.
  • 5. Real MVP: 1. Explain the vision 2. Ask questions 3. Take a guess 4. Real example
  • 6. Let musicians make money doing what they love without dealing with marketing. Create a two sided market to connect musicians in low cost countries with content producers. Constraints You have no technical abilities, no technical co-founder, and $1500 dollars to your name. Vision
  • 7.
  • 8.
  • 9.
  • 10.
  • 11. A social news reader that delivers inspiring articles to you based on your likes and follows. Vision
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 19. • 5 second tests • Comprehension • Conjoint Analysis • Data mining / market research • Surveys* (closed) • Smoke tests • Video • Landing page • Customer Discovery Interviews • Contextual inquiry / ethnography • Data mining • Focus groups* • Surveys* (open ended) • Solution interview • Contextual inquiry / ethnography • Demo pitch • Concierge test / Consulting • Competitor Usability • Picnic in the Graveyard • Paper prototypes
  • 20. Quantitative • Do people use the product? • Does this feature increase retention? • What are our customer demographics? • Which color is better? • What’s the average basket size? • What’s the LTV? CLOSED-ENDED QUESTIONS What?
 Qualitative • Why do people use it? • What’s wrong with this? • How should I design it? • How could I make this better? • Why do people do that? • What do people love about it? • Why is there drop off? • What do they think? OPEN-ENDED QUESTIONS Why?
  • 21. Market • What are our customer demographics? • What are their pains? • Is our segment too broad? • What job needs to be done? • How do we find them? • How much will they pay? • How do we convince them to buy? • How much will it cost to sell? • Can we scale marketing? Problem
 Product • Do people use the product? • How can we solve this problem? • What form should this take? • How important is the design? • Does this feature increase retention? • What’s the quickest hack? • What’s the minimum feature set? • How should we prioritize? • Is this solution working? • What do people like / dislike? • Why do they do that? • What’s the average basket size? Solution
  • 22. Research • What are our customer demos? • What are their pains? • What job needs to be done? • Is our segment too broad? • How do we find them? • How can we solve this problem? • What form should this take? • How important is the design? • What’s the quickest hack? • What’s the minimum feature set? • How should we prioritize? Generate Ideas & Identify Assumptions
 Experiments • How much will they pay? • How do we convince them to buy? • How much will it cost to sell? • Can we scale marketing? • Is this solution working? • Are people using it? • Which solution is better? • Does this feature increase retention? • How should we optimize this? • What do people like / dislike? • Why do they do that? Test Hypotheses
  • 23.
  • 24.
  • 25. • Who is our customer? • What are their pains? • What job needs to be done? • Is our customer segment too broad? • How do we find them? + =
  • 26. • Customer Discovery Interviews • Contextual inquiry / ethnography • Data mining • Focus groups* • Surveys* (open ended)
  • 27.
  • 28. • Are they really willing to pay? • How much will they pay? • How do we convince them to buy? • How much will it cost to sell? • Can we scale marketing? + =
  • 29. • Smoke tests • Video • Landing page • Sales pitch • Pre-sales • Flyers • Pocket test • Event • Fake door • High bar • 5 second tests • Comprehension • Conjoint Analysis • Data mining / market research • Surveys* (closed)
  • 30.
  • 31.
  • 32.
  • 33.
  • 34.
  • 35. • How can we solve this problem? • What form should this take? • How important is the design? • What’s the quickest hack? • What is the minimum feature set? • How should we prioritize? + =
  • 36. • Solution interview • Contextual inquiry / ethnography • Demo pitch • Concierge test / Consulting • Competitor Usability • Picnic in the Graveyard
  • 37.
  • 38.
  • 39.
  • 40. • Is this solution working? • Are people using it? • Which solution is better? • How should we optimize this? • What do people like / dislike? • Why do they do that? + =
  • 41. • Paper prototypes • Clickable prototypes • Usability • Hallway • Live • Remote • Wizard of Oz • Takeaway • Functioning products • Analytics / Dashboards • Surveys* (NPS)
  • 42.
  • 43.
  • 44.
  • 45. For more info and updates: http://trikro.com/downloads/playbook
  • 47. ! Experiment Herder Template* by TriKro LLC! (For S.M.A.R.T Experiments: Smart Measurable Achievable Relevant Timely) Learning Goal! !What do we need to learn?! What is our riskiest assumption?! What is our one priority? Hypothesis! !Is it falsifiable?! Is it specific?! Is it causal? e.g. If X then Y! Is it Relevant to the learning goal? Metric! !Qualitative or quantitative?! Is it actionable?! Is it Measurable? Fail Condition! !!!!If this happens,! our hypothesis is clearly false! wtf,s!! !!!!If this happens, stop!! Experiment is broken, retro! Experiment! !How will you collect the data?! Is it Specific?! Is it Achievable?! !Link to any supporting documents Time Box! !Is the experiment Timely?! Can we get data faster?! Would less data be sufficient?! Is the retro in our calendar? Start End Retro Result! !What happened?! What data did we collect?! Anything unexpected? Next Step! !Pivot or persevere?! Another experiment for this goal?! Do we need to clean up? Designed by: TriKro LLC - Lean Coaching and Innovation Ecosystem Design! The Smart Experiment Template by TriKro LLC is licensed under! a Creative Commons Attribution-ShareAlike 4.0 International License Designed for: Designed by: * Templates are bad,! make your own!
  • 48. Experiment Templates* 1. Learning Goal 2. Hypothesis 3. Metric 4. Fail Condition 5. Plan 6. Time Box 7. Results 8. Next Step 9. wtf,s!
  • 49.
  • 50.
  • 51.
  • 52.
  • 54.
  • 55.
  • 56.
  • 58.
  • 59.
  • 60.
  • 61. Experiment Templates* 1. Learning Goal 2. Hypothesis 3. Metric 4. Fail Condition 5. Plan 6. Time Box 7. Results 8. Next Step 9. wtf,s!
  • 62.
  • 65. This presentation by TriKro LLC is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License excepting those images where other copyright holders are noted. Based on a work at http://GrasshopperHerder.com.