SlideShare a Scribd company logo
1 of 33
@nataliewarnert
#dpm2016
Show me
the
MVP!Natalie Warnert – #dpm2016
@nataliewarnert
#dpm2016
@nataliewarnert
#dpm2016 Natalie
Warnert
Agile Coach & Trainer
www.nataliewarnert.com
@nataliewarnert
@nataliewarnert
#dpm2016
A Minimum Viable
Product is that
version of a new
product which allows
a team to collect the
maximum amount of
validated learning
about customers
with the least effort.
– Eric Ries, Lean Startup
”
@nataliewarnert
#dpm2016
What is a Minimum Viable
Product?
• Building just enough to learn and validate a hypothesis
• Learning not optimizing
• Find a plan that works before running out of resources
• Provide enough value to justify charging
THE MVP
@nataliewarnert
#dpm2016
What is Lean UX?
• Interaction design
• Constant measurement and learning loops
• Business, development, customer, and UX unification
• Less focused on deliverables, more on data
LEAN USER EXPERIENCE
@nataliewarnert
#dpm2016
*The difference
between BUILDING
the right thing and
LEARNING the right
thing
THEPOINT
@nataliewarnert
#dpm2016
Problem/Solution fit
Do I have a problem worth solving?
Product Market Fit
Have I built something people want?
Scale
How do I accelerate growth and maximize
learning?
WHERE TO START
@nataliewarnert
#dpm2016
Problem/Solution fit
Do I have a problem worth solving?
Product Market Fit
Have I built something people want?
Scale
How do I accelerate growth and maximize
learning?
WHERE TO START
Ideas are cheap!
Acting on them
is expensive $$
@nataliewarnert
#dpm2016
Problem/Solution fit
Do I have a problem worth solving?
Product Market Fit
Have I built something people want?
Scale
How do I accelerate growth and maximize
learning?
WHERE TO START
Ideas are cheap!
Acting on them
is expensive $$
Learning over
growth
Don’t scale
@nataliewarnert
#dpm2016
Customers
don’t care
about your
solution.
They care
about their
problems.
- Dave McClure, 500
Startups
”
@nataliewarnert
#dpm2016
UNDERSTAND THE PROBLEM
• What is the customer’s problem?
• Fit into the business model
@nataliewarnert
#dpm2016
UNDERSTAND THE PROBLEM
• What is the customer’s problem?
• Fit into the business model
@nataliewarnert
#dpm2016
UNDERSTAND THE PROBLEM
• What is the customer’s problem?
• Fit into the business model
What is the
customer hiring
your product to
do?
@nataliewarnert
#dpm2016
DEFINE THE SOLUTION
Smallest possible solution to speed up
learning
Build only what is needed (MVP)
Pick bold outcomes to validate learning
Business outcomes over solution
@nataliewarnert
#dpm2016
DEFINE THE SOLUTION
Smallest possible solution to speed up
learning
Build only what is needed (MVP)
Pick bold outcomes to validate learning
Business outcomes over solution
More relevant
product
recommendation +
in-cart experience
=
increased
@nataliewarnert
#dpm2016 most Plan A’s
don’t work
@nataliewarnert
#dpm2016
VALIDATE QUALITATIVELY
What are our customers doing?
Continuous feedback loop with customers
Get out of the building!
@nataliewarnert
#dpm2016
VALIDATE QUALITATIVELY
What are our customers doing?
Continuous feedback loop with customers
Get out of the building – or get customers in the building!
@nataliewarnert
#dpm2016
A startup can
focus on only
one metric.
So you have
to decide
what that is
and ignore
everything
else
– Noah
Kagan,
”
@nataliewarnert
#dpm2016
VALIDATE QUANTITATIVELY
Pirate metrics
Acquisition
Activation
Retention
Revenue
Referral
@nataliewarnert
#dpm2016
VALIDATE QUANTITATIVELY
Pirate metrics
Acquisition
Activation
Retention
Revenue
Referral
What is your one metric to
rule them all? What are you
trying to validate (hypothesis)
@nataliewarnert
#dpm2016
Product risk
Getting it right
Customer
riskRight path
Market risk
Viable business
BUT RISKS!
@nataliewarnert
#dpm2016
Run a
Business
Satisfy
the
Customer
BALANCING NEEDS
@nataliewarnert
#dpm2016
Run a
Business
Satisfy
the
Customer
BALANCING NEEDS
@nataliewarnert
#dpm2016
BUILD MODEL
Build right
thing
Build
thing
right
Build it
fast
@nataliewarnert
#dpm2016
LEARNING MODEL
Build right
thing
Build
thing
right
Build it
fast
Learning
FocusSpeed
@nataliewarnert
#dpm2016
WHERE IS THE LEARNING?
Requiremen
ts
Dev QA Releas
e
@nataliewarnert
#dpm2016
WHERE IS THE LEARNING?
Requiremen
ts
Dev QA Releas
eLittle learning
some learning Most learning
@nataliewarnert
#dpm2016
You stand to
learn the most
when the
probability of
the expected
outcome is
50%; that is,
when you don’t
know what to
expect
-Lean Analytics ”
@nataliewarnert
#dpm2016
SHOW ME THE MVP!
Declare
assumptions and
hypothesis Create an MVP
Run an experiment
to prove or disprove
hypothesis
Customer
feedback (qual
and quant) and
research
alternatives
@nataliewarnert
#dpm2016
WHAT DID WE LEARN?
Reduce scope
Shorten the cycle time to
feedback
Get out the deliverables
business
@nataliewarnert
#dpm2016
QUESTIONS
?
Running Lean - Ash Maurya
Lean UX – Jeff Gothelf, Josh Seiden

More Related Content

What's hot

Be Our Guest(Presentation)
Be Our Guest(Presentation)Be Our Guest(Presentation)
Be Our Guest(Presentation)
Teneka Williams
 

What's hot (20)

How to win in the product led era - SF Product Analytics Summit 10/12/17
How to win in the product led era - SF Product Analytics Summit 10/12/17How to win in the product led era - SF Product Analytics Summit 10/12/17
How to win in the product led era - SF Product Analytics Summit 10/12/17
 
Best Practices Are Killing Marketing - It's Time to Get Agile
Best Practices Are Killing Marketing - It's Time to Get AgileBest Practices Are Killing Marketing - It's Time to Get Agile
Best Practices Are Killing Marketing - It's Time to Get Agile
 
Culture @ food x
Culture @ food xCulture @ food x
Culture @ food x
 
The Family London - 5 steps to replicate TransferWise's growth
The Family London - 5 steps to replicate TransferWise's growthThe Family London - 5 steps to replicate TransferWise's growth
The Family London - 5 steps to replicate TransferWise's growth
 
Nagaraju ppt
Nagaraju pptNagaraju ppt
Nagaraju ppt
 
Go From Idea To MVP – FAST! - By Amy Jo Kim
Go From Idea To MVP – FAST! - By Amy Jo KimGo From Idea To MVP – FAST! - By Amy Jo Kim
Go From Idea To MVP – FAST! - By Amy Jo Kim
 
Be Our Guest(Presentation)
Be Our Guest(Presentation)Be Our Guest(Presentation)
Be Our Guest(Presentation)
 
SF Design Week - First Use Playbook
SF Design Week - First Use PlaybookSF Design Week - First Use Playbook
SF Design Week - First Use Playbook
 
Happy to Help by Merci Victoria Grace, Partner, Lightspeed Venture Partners
Happy to Help by Merci Victoria Grace, Partner, Lightspeed Venture PartnersHappy to Help by Merci Victoria Grace, Partner, Lightspeed Venture Partners
Happy to Help by Merci Victoria Grace, Partner, Lightspeed Venture Partners
 
Designing To Learn: Creating Effective MVP Experiments - Lean UX NYC 2014
Designing To Learn: Creating Effective MVP Experiments - Lean UX NYC 2014Designing To Learn: Creating Effective MVP Experiments - Lean UX NYC 2014
Designing To Learn: Creating Effective MVP Experiments - Lean UX NYC 2014
 
Customer feedback: practical advice
Customer feedback: practical adviceCustomer feedback: practical advice
Customer feedback: practical advice
 
It's not your grandmother's lean anymore!
It's not your grandmother's lean anymore!It's not your grandmother's lean anymore!
It's not your grandmother's lean anymore!
 
The Product Journey: The Importance of Having Strong Decision Agility in Your...
The Product Journey: The Importance of Having Strong Decision Agility in Your...The Product Journey: The Importance of Having Strong Decision Agility in Your...
The Product Journey: The Importance of Having Strong Decision Agility in Your...
 
Pre-startership slides
Pre-startership slidesPre-startership slides
Pre-startership slides
 
Plr high ticket
Plr high ticketPlr high ticket
Plr high ticket
 
Designing to Learn
Designing to LearnDesigning to Learn
Designing to Learn
 
Vision 2022 slides tf
Vision 2022 slides tfVision 2022 slides tf
Vision 2022 slides tf
 
Deck December 2013
Deck December 2013 Deck December 2013
Deck December 2013
 
LKCE16 - Putting lean into product management by Markus Andrezak
LKCE16 - Putting lean into product management by Markus AndrezakLKCE16 - Putting lean into product management by Markus Andrezak
LKCE16 - Putting lean into product management by Markus Andrezak
 
Opticon 2015-From Skeptic to Champion
Opticon 2015-From Skeptic to ChampionOpticon 2015-From Skeptic to Champion
Opticon 2015-From Skeptic to Champion
 

Viewers also liked

Drupal Distributions, an Open Source Product Model
Drupal Distributions, an Open Source Product ModelDrupal Distributions, an Open Source Product Model
Drupal Distributions, an Open Source Product Model
Lev Tsypin
 

Viewers also liked (20)

Creating Sustainable Website Processes
Creating Sustainable Website ProcessesCreating Sustainable Website Processes
Creating Sustainable Website Processes
 
MIE Toolbox, a Case for Drupal as an Application Framework
MIE Toolbox, a Case for Drupal as an Application FrameworkMIE Toolbox, a Case for Drupal as an Application Framework
MIE Toolbox, a Case for Drupal as an Application Framework
 
NTEN Content Strategy Part I: Getting Started
NTEN Content Strategy Part I: Getting StartedNTEN Content Strategy Part I: Getting Started
NTEN Content Strategy Part I: Getting Started
 
Drupal presentations-badcamp-2014
Drupal presentations-badcamp-2014Drupal presentations-badcamp-2014
Drupal presentations-badcamp-2014
 
Future-Proofing Your Content
Future-Proofing Your ContentFuture-Proofing Your Content
Future-Proofing Your Content
 
Launching for the Web
Launching for the WebLaunching for the Web
Launching for the Web
 
Drupal Distributions, an Open Source Product Model
Drupal Distributions, an Open Source Product ModelDrupal Distributions, an Open Source Product Model
Drupal Distributions, an Open Source Product Model
 
Fundraising with Drupal
Fundraising with DrupalFundraising with Drupal
Fundraising with Drupal
 
Show, Don't Tell: Online Storytelling through Digital Media
Show, Don't Tell: Online Storytelling through Digital MediaShow, Don't Tell: Online Storytelling through Digital Media
Show, Don't Tell: Online Storytelling through Digital Media
 
If I Only Had a Frame(work): 2016 NTC
If I Only Had a Frame(work): 2016 NTCIf I Only Had a Frame(work): 2016 NTC
If I Only Had a Frame(work): 2016 NTC
 
Content Strategy in Popular Culture
Content Strategy in Popular CultureContent Strategy in Popular Culture
Content Strategy in Popular Culture
 
It Takes Two: The Case for CRM’s in Drupal
It Takes Two: The Case for CRM’s in DrupalIt Takes Two: The Case for CRM’s in Drupal
It Takes Two: The Case for CRM’s in Drupal
 
Discover Discovery
Discover DiscoveryDiscover Discovery
Discover Discovery
 
It Takes Two: The Case for CRMs in Drupal
 It Takes Two: The Case for CRMs in Drupal It Takes Two: The Case for CRMs in Drupal
It Takes Two: The Case for CRMs in Drupal
 
If I Only Had a Frame(work): Crafting Experiences Across 3rd-party Systems
If I Only Had a Frame(work): Crafting Experiences Across 3rd-party SystemsIf I Only Had a Frame(work): Crafting Experiences Across 3rd-party Systems
If I Only Had a Frame(work): Crafting Experiences Across 3rd-party Systems
 
Digital Experience Management in Drupal
Digital Experience Management in DrupalDigital Experience Management in Drupal
Digital Experience Management in Drupal
 
What's new in "event management" with Drupal
What's new in "event management" with DrupalWhat's new in "event management" with Drupal
What's new in "event management" with Drupal
 
SOTM - Integrating Maps with Drupal
SOTM - Integrating Maps with DrupalSOTM - Integrating Maps with Drupal
SOTM - Integrating Maps with Drupal
 
Meet ThinkShout, Inc.
Meet ThinkShout, Inc.Meet ThinkShout, Inc.
Meet ThinkShout, Inc.
 
Content Strategy 101
Content Strategy 101Content Strategy 101
Content Strategy 101
 

Similar to Show Me the MVP - Digital PM Summit 2016 Natalie Warnert

Similar to Show Me the MVP - Digital PM Summit 2016 Natalie Warnert (20)

Customer Centric & Hypothesis Driven Innovation by Cruise VP of Product Engin...
Customer Centric & Hypothesis Driven Innovation by Cruise VP of Product Engin...Customer Centric & Hypothesis Driven Innovation by Cruise VP of Product Engin...
Customer Centric & Hypothesis Driven Innovation by Cruise VP of Product Engin...
 
7 Lead Nurturing Secrets To Turn Strangers Into Customers
7 Lead Nurturing Secrets To Turn Strangers Into Customers7 Lead Nurturing Secrets To Turn Strangers Into Customers
7 Lead Nurturing Secrets To Turn Strangers Into Customers
 
BFBM(1-2016) Startup with mvp
 BFBM(1-2016) Startup with mvp BFBM(1-2016) Startup with mvp
BFBM(1-2016) Startup with mvp
 
Using Amazon's PRFAQ Methodology! by Amazon Product Leader
Using Amazon's PRFAQ Methodology! by Amazon Product LeaderUsing Amazon's PRFAQ Methodology! by Amazon Product Leader
Using Amazon's PRFAQ Methodology! by Amazon Product Leader
 
How to startup
How to startupHow to startup
How to startup
 
Value based-design
Value based-designValue based-design
Value based-design
 
Wow Now overview: why, what & how
Wow Now overview: why, what & howWow Now overview: why, what & how
Wow Now overview: why, what & how
 
How to Be an Impactful Product Manager by Uber Product Manager
How to Be an Impactful Product Manager by Uber Product ManagerHow to Be an Impactful Product Manager by Uber Product Manager
How to Be an Impactful Product Manager by Uber Product Manager
 
Quant + Qual + Iteration for Great Products
Quant + Qual + Iteration for Great ProductsQuant + Qual + Iteration for Great Products
Quant + Qual + Iteration for Great Products
 
Design for Conversion: Top 5 Ways to Make Your Value Proposition Perform
Design for Conversion: Top 5 Ways to Make Your Value Proposition PerformDesign for Conversion: Top 5 Ways to Make Your Value Proposition Perform
Design for Conversion: Top 5 Ways to Make Your Value Proposition Perform
 
SELLING WITH MAXIMUM VALUES: STRATEGIES THAT MAXIMIZE THE VALUE AND POWER OF ...
SELLING WITH MAXIMUM VALUES: STRATEGIES THAT MAXIMIZE THE VALUE AND POWER OF ...SELLING WITH MAXIMUM VALUES: STRATEGIES THAT MAXIMIZE THE VALUE AND POWER OF ...
SELLING WITH MAXIMUM VALUES: STRATEGIES THAT MAXIMIZE THE VALUE AND POWER OF ...
 
Workshop MVP
Workshop MVPWorkshop MVP
Workshop MVP
 
Hack your Net Promoter Score® Data
Hack your Net Promoter Score® DataHack your Net Promoter Score® Data
Hack your Net Promoter Score® Data
 
Lean Analytics - Communication Layer into the World of Business
Lean Analytics - Communication Layer into the World of BusinessLean Analytics - Communication Layer into the World of Business
Lean Analytics - Communication Layer into the World of Business
 
LEARN START UP
LEARN START UPLEARN START UP
LEARN START UP
 
Methodolgies for Creating Worthwhile Information Systems
Methodolgies for Creating Worthwhile Information SystemsMethodolgies for Creating Worthwhile Information Systems
Methodolgies for Creating Worthwhile Information Systems
 
Lean Startup Methodology
Lean Startup MethodologyLean Startup Methodology
Lean Startup Methodology
 
ProductX2014 Neta haiby.microsoft
ProductX2014 Neta haiby.microsoftProductX2014 Neta haiby.microsoft
ProductX2014 Neta haiby.microsoft
 
Workshop mvp general
Workshop mvp generalWorkshop mvp general
Workshop mvp general
 
Customer Effort and How to Measure It
Customer Effort and How to Measure ItCustomer Effort and How to Measure It
Customer Effort and How to Measure It
 

More from Natalie Warnert

More from Natalie Warnert (6)

#WomenInAgile Workshop: The Changing Face of Agile - Agile2016 Atlanta, GA
#WomenInAgile Workshop: The Changing Face of Agile - Agile2016 Atlanta, GA#WomenInAgile Workshop: The Changing Face of Agile - Agile2016 Atlanta, GA
#WomenInAgile Workshop: The Changing Face of Agile - Agile2016 Atlanta, GA
 
Objectivity or Subjectivity - Owning your bias and interactions - Natalie War...
Objectivity or Subjectivity - Owning your bias and interactions - Natalie War...Objectivity or Subjectivity - Owning your bias and interactions - Natalie War...
Objectivity or Subjectivity - Owning your bias and interactions - Natalie War...
 
Prioritizing Value Beyond Boundaries - Scrum Gathering Bengaluru - Natalie Wa...
Prioritizing Value Beyond Boundaries - Scrum Gathering Bengaluru - Natalie Wa...Prioritizing Value Beyond Boundaries - Scrum Gathering Bengaluru - Natalie Wa...
Prioritizing Value Beyond Boundaries - Scrum Gathering Bengaluru - Natalie Wa...
 
Houston - We Have a Priority - Natalie Warnert Scrum Gathering Orlando 2016
Houston - We Have a Priority - Natalie Warnert Scrum Gathering Orlando 2016Houston - We Have a Priority - Natalie Warnert Scrum Gathering Orlando 2016
Houston - We Have a Priority - Natalie Warnert Scrum Gathering Orlando 2016
 
Women In Agile Thesis Research - Natalie Warnert, St. Catherine University
Women In Agile Thesis Research - Natalie Warnert, St. Catherine UniversityWomen In Agile Thesis Research - Natalie Warnert, St. Catherine University
Women In Agile Thesis Research - Natalie Warnert, St. Catherine University
 
Lean Business Analysis and UX Runway - Natalie Warnert
Lean Business Analysis and UX Runway - Natalie WarnertLean Business Analysis and UX Runway - Natalie Warnert
Lean Business Analysis and UX Runway - Natalie Warnert
 

Recently uploaded

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 

Recently uploaded (20)

Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of Brazil
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 

Show Me the MVP - Digital PM Summit 2016 Natalie Warnert

Editor's Notes

  1. TOM
  2. 3 min
  3. Corrupted and confused with MMP
  4. This is my definition What are resources It doesn’t mean half baked or buggy What are table stakes? 6 min
  5. Designing for the customer and with the customer – how they want to work, not how we want them to, hard shift to make, think testing a product you wrote Deliverables – less over the wall and more collaborative All of our traditional language is missing 8 min
  6. 9 min
  7. This is where the investigation starts – don’t just keep the idea in your head but SHARE it….start with problem
  8. 13 min
  9. 14 min
  10. THIS COULD BE ANY RETAILER – ultimately bought, required, also viewed BBY example here with CWBAB and it not working – started with customers wanting add on accessories How that ties into the business model and problem of attach rates and conversion Business problem and customer problem – our one hypothesis fits both
  11. Halloween costume – snoopy book and not even the great pumpkin So much data we don’t know what to do with it – so focused on this data but it was the wrong data 18 min
  12. Bold outcomes – change something big over small. Page over button. Or in this case embedded in cart vs. just changing items BBY example – we have our problem and our market fit. So what did we do with it.
  13. Bold outcomes – change something big over small. Page over button. Or in this case embedded in cart vs. just changing items BBY example – we have our problem and our market fit. So what did we do with it. Interruption of the data they are used to seeing Besides CYP what else do we see in Carts? Buy it again…save for later...guests also bought – we have so much data we don’t know what to do with it. Bad example - polaris and having what we were going to build so defined that it couldn’t pivot (large release one, op model/workstation) – total customization vs. Packages what the customer actually needed vs. What we thought they wanted SOLUTION and BDUF What is the unique value proposition? This is somewhere in “solution” but we don’t know it...YET 25 min
  14. Remember our plan A here was rich relevance data… A – assumption that you know what the customer wants...and you know what you do when you assumption...
  15. walk the walls at polaris Qualitatively – WHAT are they doing once we get them into cart – conversion from there is higher than browse…we know they are looking for more to buy...UX programs to see where hovers are, time spent, clicks, paper prototyping and contextual inquiry (modified)
  16. When did we get out of the building? Went an did customer interviews and showed them what we were thinking (small margin) – is it stat sig? No. Is it sig? yes Also by walking through with everyone it’s easier to determine what is too high scope 30 min
  17. Validate quantitatively – analytics and A/B testing – How do we quantify what they are doing? Conversion rates, add rates, abandon rates…we wouldn’t have gotten here if we didn’t build something though. (large releases don’t work for this)
  18. Validate quantitatively – analytics and A/B testing - one ring to rule them all You can tell any story with numbers, so what are the important ones? This is why we also use qualitative. It tells more of the story How do we quantify what they are doing? Conversion rates, add rates, abandon rates…we wouldn’t have gotten here if we didn’t build something though. (large releases don’t work for this)
  19. But we are addressing these risks up front by talking with customers, experimenting, and validating with data Failing fast so oppty cost is less – talk about massive req and traditional stuff 35 min
  20. So what did we learn????
  21. So we have to shorten this cycle!
  22. Mvp != half baked or buggy Deliver enough value to justify charging (or running more experiments) Prioritize hypotheses
  23. Attach rate went up Interaction in cart when the user has already showed more intent to buy Language of CYP vs. required, vs. CWBAB vs. Suggested… Try other products before we start to scale more – rich relevance data was expensive and didn’t want to “waste the money” – sunk cost