SlideShare a Scribd company logo
1 of 59
The Lean Startup:  A disciplined approach to Imagining, Designing, and Building New Products Workshop Edition Eric Ries http://StartupLessonsLearned.com
Most Startups Fail
Most Startups Fail
Most Startups Fail
Most Startups Fail But it doesn’t have to be that way.  We can do better.  This talk is about how.
What is a startup? A startup is a human institution designed to deliver a new product or service under conditions of extreme uncertainty.  Nothing to do with size of company, sector of the economy, or industry
The Pivot What do successful startups have in common? They started out as digital cash for PDAs, but evolved into online payments for eBay.  They started building BASIC interpreters, but evolved into the world's largest operating systems monopoly.  They were shocked to discover their online games company was actually a photo-sharing site. Pivot: change directions but stay grounded in what we’ve learned.  http://startuplessonslearned.blogspot.com/2009/06/pivot-dont-jump-to-new-vision.html
Speed Wins if we can reduce the time between major iterations we can increase our odds of success
A Tale of Two Startups
Startup #1
Stealth Startup Circa 2001
All about the team
A good plan? Start a company with a compelling long-term vision.  Raise plenty of capital. Hire the absolute best and the brightest. Hire an experienced management team with tons of startup experience. Focus on quality.  Build a world-class technology platform. Build buzz in the press and blogosphere.
Achieving Failure Company failed utterly, $40MM and five years of pain. Crippled by “shadow beliefs” that destroyed the effort of all those smart people.
Shadow Belief #1 We know what customers want.
Shadow Belief #2 We can accurately predict the future.
Shadow Belief #3 Advancing the plan is progress.
A good plan? Start a company with a compelling long-term vision.  Raise plenty of capital. Hire the absolute best and the brightest. Hire an experienced management team with tons of startup experience. Focus on quality.  Build a world-class technology platform. Build buzz in the press and blogosphere.
Startup #2
IMVU  
IMVU  
New plan Shipped in six months – a horribly buggy beta product Charged from day one Shipped multiple times a day (by 2008, on average 50 times a day) No PR, no launch Results 2009: profitable, revenue > $20MM
Lean Startups Go Faster Commodity technology stack, highly leveraged (free/open source, user-generated content, SEM). Customer development – find out what customers want before you build it.  Agile (lean) product development – but tuned to the startup condition.
Customer Development ,[object Object]
Rapid hypothesis testing about market, pricing, customers, …
Extreme low cost, low burn, tight focus
Measurable gates for investorshttp://bit.ly/FourSteps
Agile Product Development(A tale of two startups, revisited) ,[object Object]
These examples are drawn from software startups, but increasingly:
All products require software
All companies are operating in a startup-like environment of extreme uncertainty,[object Object]
Agile Product Development Unit of Progress: A line of Working Code “Product Owner” or in-house customer Problem: known Solution: unknown
Product Development at Lean Startup Unit of Progress: Validated Learning About Customers ($$$) Customer Development Hypotheses, Experiments, Insights Problem: unknown Data, Feedback, Insights Solution: unknown
Minimize TOTAL time through the loop IDEAS LEARN BUILD DATA CODE MEASURE
There’s much more… IDEAS Code Faster Learn Faster BUILD LEARN Unit Tests Usability Tests Continuous Integration Incremental Deployment Free & Open-Source Components Cloud Computing Cluster Immune System Just-in-time Scalability Refactoring Developer Sandbox Minimum Viable Product Split Tests Customer Interviews Customer Development Five Whys Root Cause Analysis Customer Advisory Board Falsifiable Hypotheses Product Owner Accountability Customer Archetypes Cross-functional Teams Semi-autonomous Teams Smoke Tests CODE DATA Measure Faster MEASURE Split Tests Clear Product Owner Continuous Deployment Usability Tests Real-time Monitoring Customer Liaison Funnel Analysis Cohort Analysis Net Promoter Score Search Engine Marketing Real-Time Alerting Predictive Monitoring
There’s much more… Startup Lessons Learned   (season one 2008-2009) Every essay from the blog’s first year http://bit.ly/SLLbookbeta
Thanks! ,[object Object]
http://StartupLessonsLearned.com/
Getting in touch (#leanstartup)
http://twitter.com/ericries
eric@theleanstartup.com
Startup Lessons Learned – in print
Beta version available today
http://bit.ly/SLLbookbeta,[object Object]
How to build a Lean Startup Let’s talk about some specifics.  Rapid Split-tests Five Why’s  Continuous Deployment Minimum Viable Product
Rapid Split Tests IDEAS Code Faster Learn Faster BUILD LEARN Continuous Deployment Five Whys Root Cause Analysis CODE DATA Measure Faster MEASURE Rapid Split Tests
Split-testing all the time A/B testing is key to validating your hypotheses Has to be simple enough for everyone to use and understand it Make creating a split-test no more than one line of code: if( setup_experiment(...) == "control" ) {     // do it the old way } else {    // do it the new way }
The AAA’s of Metrics Actionable Accessible Auditable
Measure the Macro Always look at cohort-based metrics over time Split-test the small, measure the large
Five Whys IDEAS Code Faster Learn Faster BUILD LEARN Continuous Deployment Five Whys Root Cause Analysis CODE DATA Measure Faster MEASURE Rapid Split Tests
Five Whys Root Cause Analysis ,[object Object]
Ask “why” five times when something unexpected happens.
Make proportional investments in prevention at all five levels of the hierarchy.
Behind every supposed technical problem is usually a human problem. Fix the cause, not just the symptom.,[object Object]
Continuous Deployment ,[object Object]
At IMVU time from check-in to production = 20 minutes
Tell a good change from a bad change (quickly)
Revert a bad change quickly
And “shut down the line”

More Related Content

More from Eric Ries

Tendai Charasika - 2012 Lean Startup Conference
Tendai Charasika - 2012 Lean Startup ConferenceTendai Charasika - 2012 Lean Startup Conference
Tendai Charasika - 2012 Lean Startup ConferenceEric Ries
 
Stephanie Hay - Lean Startup Conference 2012
Stephanie Hay - Lean Startup Conference 2012Stephanie Hay - Lean Startup Conference 2012
Stephanie Hay - Lean Startup Conference 2012Eric Ries
 
Jessica Scorpio - 2012 Lean Startup Conference
Jessica Scorpio - 2012 Lean Startup ConferenceJessica Scorpio - 2012 Lean Startup Conference
Jessica Scorpio - 2012 Lean Startup ConferenceEric Ries
 
Robert Fan - 2012 Lean Startup Conference
Robert Fan - 2012 Lean Startup ConferenceRobert Fan - 2012 Lean Startup Conference
Robert Fan - 2012 Lean Startup ConferenceEric Ries
 
Leah Busque - 2012 Lean Startup Conference
Leah Busque - 2012 Lean Startup ConferenceLeah Busque - 2012 Lean Startup Conference
Leah Busque - 2012 Lean Startup ConferenceEric Ries
 
Lane Halley - 2012 Lean Startup Conference
Lane Halley - 2012 Lean Startup ConferenceLane Halley - 2012 Lean Startup Conference
Lane Halley - 2012 Lean Startup ConferenceEric Ries
 
Justin Wilcox - Lean Startup Conference 2012
Justin Wilcox - Lean Startup Conference 2012Justin Wilcox - Lean Startup Conference 2012
Justin Wilcox - Lean Startup Conference 2012Eric Ries
 
Ivory Madison - 2012 Lean Startup Conference
Ivory Madison - 2012 Lean Startup ConferenceIvory Madison - 2012 Lean Startup Conference
Ivory Madison - 2012 Lean Startup ConferenceEric Ries
 
Daniel Kim - 2012 Lean Startup Conference
Daniel Kim - 2012 Lean Startup ConferenceDaniel Kim - 2012 Lean Startup Conference
Daniel Kim - 2012 Lean Startup ConferenceEric Ries
 
Charles Hudson - 2012 Lean Startup Conference
Charles Hudson - 2012 Lean Startup ConferenceCharles Hudson - 2012 Lean Startup Conference
Charles Hudson - 2012 Lean Startup ConferenceEric Ries
 
George Bilbrey - 2012 Lean Startup Conference
George Bilbrey - 2012 Lean Startup ConferenceGeorge Bilbrey - 2012 Lean Startup Conference
George Bilbrey - 2012 Lean Startup ConferenceEric Ries
 
Ash Maurya Innovation Accounting - 2012 Lean Startup Conference
Ash Maurya Innovation Accounting - 2012 Lean Startup ConferenceAsh Maurya Innovation Accounting - 2012 Lean Startup Conference
Ash Maurya Innovation Accounting - 2012 Lean Startup ConferenceEric Ries
 
Andres Glusman - 2012 Lean Startup Conference
Andres Glusman - 2012 Lean Startup ConferenceAndres Glusman - 2012 Lean Startup Conference
Andres Glusman - 2012 Lean Startup ConferenceEric Ries
 
Back to the Roots - 2012 Lean Startup Conference
Back to the Roots - 2012 Lean Startup ConferenceBack to the Roots - 2012 Lean Startup Conference
Back to the Roots - 2012 Lean Startup ConferenceEric Ries
 
Dropbox startup lessons learned 2011
Dropbox   startup lessons learned 2011Dropbox   startup lessons learned 2011
Dropbox startup lessons learned 2011Eric Ries
 
2011 10 12 eric ries lean startup web 2.0 expo ny keynote
2011 10 12 eric ries lean startup web 2.0 expo ny keynote2011 10 12 eric ries lean startup web 2.0 expo ny keynote
2011 10 12 eric ries lean startup web 2.0 expo ny keynoteEric Ries
 
The Lean Startup debuts at #2 on the New York Times Bestseller List
The Lean Startup debuts at #2 on the New York Times Bestseller ListThe Lean Startup debuts at #2 on the New York Times Bestseller List
The Lean Startup debuts at #2 on the New York Times Bestseller ListEric Ries
 
The Lean Startup 10-Book Package
The Lean Startup 10-Book PackageThe Lean Startup 10-Book Package
The Lean Startup 10-Book PackageEric Ries
 
The Lean Startup 30-Book Package
The Lean Startup 30-Book PackageThe Lean Startup 30-Book Package
The Lean Startup 30-Book PackageEric Ries
 
The Lean Startup - Book Tour In Your City Package
The Lean Startup - Book Tour In Your City PackageThe Lean Startup - Book Tour In Your City Package
The Lean Startup - Book Tour In Your City PackageEric Ries
 

More from Eric Ries (20)

Tendai Charasika - 2012 Lean Startup Conference
Tendai Charasika - 2012 Lean Startup ConferenceTendai Charasika - 2012 Lean Startup Conference
Tendai Charasika - 2012 Lean Startup Conference
 
Stephanie Hay - Lean Startup Conference 2012
Stephanie Hay - Lean Startup Conference 2012Stephanie Hay - Lean Startup Conference 2012
Stephanie Hay - Lean Startup Conference 2012
 
Jessica Scorpio - 2012 Lean Startup Conference
Jessica Scorpio - 2012 Lean Startup ConferenceJessica Scorpio - 2012 Lean Startup Conference
Jessica Scorpio - 2012 Lean Startup Conference
 
Robert Fan - 2012 Lean Startup Conference
Robert Fan - 2012 Lean Startup ConferenceRobert Fan - 2012 Lean Startup Conference
Robert Fan - 2012 Lean Startup Conference
 
Leah Busque - 2012 Lean Startup Conference
Leah Busque - 2012 Lean Startup ConferenceLeah Busque - 2012 Lean Startup Conference
Leah Busque - 2012 Lean Startup Conference
 
Lane Halley - 2012 Lean Startup Conference
Lane Halley - 2012 Lean Startup ConferenceLane Halley - 2012 Lean Startup Conference
Lane Halley - 2012 Lean Startup Conference
 
Justin Wilcox - Lean Startup Conference 2012
Justin Wilcox - Lean Startup Conference 2012Justin Wilcox - Lean Startup Conference 2012
Justin Wilcox - Lean Startup Conference 2012
 
Ivory Madison - 2012 Lean Startup Conference
Ivory Madison - 2012 Lean Startup ConferenceIvory Madison - 2012 Lean Startup Conference
Ivory Madison - 2012 Lean Startup Conference
 
Daniel Kim - 2012 Lean Startup Conference
Daniel Kim - 2012 Lean Startup ConferenceDaniel Kim - 2012 Lean Startup Conference
Daniel Kim - 2012 Lean Startup Conference
 
Charles Hudson - 2012 Lean Startup Conference
Charles Hudson - 2012 Lean Startup ConferenceCharles Hudson - 2012 Lean Startup Conference
Charles Hudson - 2012 Lean Startup Conference
 
George Bilbrey - 2012 Lean Startup Conference
George Bilbrey - 2012 Lean Startup ConferenceGeorge Bilbrey - 2012 Lean Startup Conference
George Bilbrey - 2012 Lean Startup Conference
 
Ash Maurya Innovation Accounting - 2012 Lean Startup Conference
Ash Maurya Innovation Accounting - 2012 Lean Startup ConferenceAsh Maurya Innovation Accounting - 2012 Lean Startup Conference
Ash Maurya Innovation Accounting - 2012 Lean Startup Conference
 
Andres Glusman - 2012 Lean Startup Conference
Andres Glusman - 2012 Lean Startup ConferenceAndres Glusman - 2012 Lean Startup Conference
Andres Glusman - 2012 Lean Startup Conference
 
Back to the Roots - 2012 Lean Startup Conference
Back to the Roots - 2012 Lean Startup ConferenceBack to the Roots - 2012 Lean Startup Conference
Back to the Roots - 2012 Lean Startup Conference
 
Dropbox startup lessons learned 2011
Dropbox   startup lessons learned 2011Dropbox   startup lessons learned 2011
Dropbox startup lessons learned 2011
 
2011 10 12 eric ries lean startup web 2.0 expo ny keynote
2011 10 12 eric ries lean startup web 2.0 expo ny keynote2011 10 12 eric ries lean startup web 2.0 expo ny keynote
2011 10 12 eric ries lean startup web 2.0 expo ny keynote
 
The Lean Startup debuts at #2 on the New York Times Bestseller List
The Lean Startup debuts at #2 on the New York Times Bestseller ListThe Lean Startup debuts at #2 on the New York Times Bestseller List
The Lean Startup debuts at #2 on the New York Times Bestseller List
 
The Lean Startup 10-Book Package
The Lean Startup 10-Book PackageThe Lean Startup 10-Book Package
The Lean Startup 10-Book Package
 
The Lean Startup 30-Book Package
The Lean Startup 30-Book PackageThe Lean Startup 30-Book Package
The Lean Startup 30-Book Package
 
The Lean Startup - Book Tour In Your City Package
The Lean Startup - Book Tour In Your City PackageThe Lean Startup - Book Tour In Your City Package
The Lean Startup - Book Tour In Your City Package
 

Recently uploaded

Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfPrecisely
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clashcharlottematthew16
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 

Recently uploaded (20)

Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 

2009 11 16 Web 2.0 Expo New York Workshop

  • 1. The Lean Startup: A disciplined approach to Imagining, Designing, and Building New Products Workshop Edition Eric Ries http://StartupLessonsLearned.com
  • 5. Most Startups Fail But it doesn’t have to be that way. We can do better. This talk is about how.
  • 6. What is a startup? A startup is a human institution designed to deliver a new product or service under conditions of extreme uncertainty. Nothing to do with size of company, sector of the economy, or industry
  • 7. The Pivot What do successful startups have in common? They started out as digital cash for PDAs, but evolved into online payments for eBay. They started building BASIC interpreters, but evolved into the world's largest operating systems monopoly. They were shocked to discover their online games company was actually a photo-sharing site. Pivot: change directions but stay grounded in what we’ve learned. http://startuplessonslearned.blogspot.com/2009/06/pivot-dont-jump-to-new-vision.html
  • 8. Speed Wins if we can reduce the time between major iterations we can increase our odds of success
  • 9. A Tale of Two Startups
  • 13. A good plan? Start a company with a compelling long-term vision. Raise plenty of capital. Hire the absolute best and the brightest. Hire an experienced management team with tons of startup experience. Focus on quality. Build a world-class technology platform. Build buzz in the press and blogosphere.
  • 14. Achieving Failure Company failed utterly, $40MM and five years of pain. Crippled by “shadow beliefs” that destroyed the effort of all those smart people.
  • 15. Shadow Belief #1 We know what customers want.
  • 16. Shadow Belief #2 We can accurately predict the future.
  • 17. Shadow Belief #3 Advancing the plan is progress.
  • 18. A good plan? Start a company with a compelling long-term vision. Raise plenty of capital. Hire the absolute best and the brightest. Hire an experienced management team with tons of startup experience. Focus on quality. Build a world-class technology platform. Build buzz in the press and blogosphere.
  • 22. New plan Shipped in six months – a horribly buggy beta product Charged from day one Shipped multiple times a day (by 2008, on average 50 times a day) No PR, no launch Results 2009: profitable, revenue > $20MM
  • 23. Lean Startups Go Faster Commodity technology stack, highly leveraged (free/open source, user-generated content, SEM). Customer development – find out what customers want before you build it. Agile (lean) product development – but tuned to the startup condition.
  • 24.
  • 25. Rapid hypothesis testing about market, pricing, customers, …
  • 26. Extreme low cost, low burn, tight focus
  • 27. Measurable gates for investorshttp://bit.ly/FourSteps
  • 28.
  • 29. These examples are drawn from software startups, but increasingly:
  • 31.
  • 32. Agile Product Development Unit of Progress: A line of Working Code “Product Owner” or in-house customer Problem: known Solution: unknown
  • 33. Product Development at Lean Startup Unit of Progress: Validated Learning About Customers ($$$) Customer Development Hypotheses, Experiments, Insights Problem: unknown Data, Feedback, Insights Solution: unknown
  • 34. Minimize TOTAL time through the loop IDEAS LEARN BUILD DATA CODE MEASURE
  • 35. There’s much more… IDEAS Code Faster Learn Faster BUILD LEARN Unit Tests Usability Tests Continuous Integration Incremental Deployment Free & Open-Source Components Cloud Computing Cluster Immune System Just-in-time Scalability Refactoring Developer Sandbox Minimum Viable Product Split Tests Customer Interviews Customer Development Five Whys Root Cause Analysis Customer Advisory Board Falsifiable Hypotheses Product Owner Accountability Customer Archetypes Cross-functional Teams Semi-autonomous Teams Smoke Tests CODE DATA Measure Faster MEASURE Split Tests Clear Product Owner Continuous Deployment Usability Tests Real-time Monitoring Customer Liaison Funnel Analysis Cohort Analysis Net Promoter Score Search Engine Marketing Real-Time Alerting Predictive Monitoring
  • 36. There’s much more… Startup Lessons Learned (season one 2008-2009) Every essay from the blog’s first year http://bit.ly/SLLbookbeta
  • 37.
  • 39. Getting in touch (#leanstartup)
  • 42. Startup Lessons Learned – in print
  • 44.
  • 45. How to build a Lean Startup Let’s talk about some specifics. Rapid Split-tests Five Why’s Continuous Deployment Minimum Viable Product
  • 46. Rapid Split Tests IDEAS Code Faster Learn Faster BUILD LEARN Continuous Deployment Five Whys Root Cause Analysis CODE DATA Measure Faster MEASURE Rapid Split Tests
  • 47. Split-testing all the time A/B testing is key to validating your hypotheses Has to be simple enough for everyone to use and understand it Make creating a split-test no more than one line of code: if( setup_experiment(...) == "control" ) { // do it the old way } else { // do it the new way }
  • 48. The AAA’s of Metrics Actionable Accessible Auditable
  • 49. Measure the Macro Always look at cohort-based metrics over time Split-test the small, measure the large
  • 50. Five Whys IDEAS Code Faster Learn Faster BUILD LEARN Continuous Deployment Five Whys Root Cause Analysis CODE DATA Measure Faster MEASURE Rapid Split Tests
  • 51.
  • 52. Ask “why” five times when something unexpected happens.
  • 53. Make proportional investments in prevention at all five levels of the hierarchy.
  • 54.
  • 55.
  • 56. At IMVU time from check-in to production = 20 minutes
  • 57. Tell a good change from a bad change (quickly)
  • 58. Revert a bad change quickly
  • 59. And “shut down the line”
  • 60. Work in small batches
  • 61. At IMVU, a large batch = 3 days worth of work
  • 62.
  • 63. Everyone has a complete sandbox
  • 65. All tests must pass or “shut down the line”
  • 66. Automatic feedback if the team is going too fast
  • 68. Monitor cluster and business metrics in real-time
  • 69. Reject changes that move metrics out-of-bounds
  • 70. Alerting & Predictive monitoring (Nagios)
  • 71. Monitor all metrics that stakeholders care about
  • 72. If any metric goes out-of-bounds, wake somebody up
  • 73.
  • 74.
  • 75. Possible Approaches “Maximize chances of success” Build a great product with many features that increase the odds that customers will want it Problem: no feedback until the end, might be too late to adjust “Release early, release often” Get as much feedback as possible, as soon as possible Problem: run around in circles, chasing what customers think they want
  • 76. Minimum Viable Product The minimum set of features needed to learn from earlyvangelists – visionary early adopters Avoid building products that nobody wants Maximize the learning per dollar spent Get the facts before it’s too late Probably much more minimum than you think!
  • 77. Minimum Viable Product Visionary customers can “fill in the gaps” on missing features, if the product solves a real problem Allows us to achieve a big vision in small increments without going in circles Requires a commitment to iteration
  • 78. Fears False negative: “customers would have liked the full product, but the MVP sucks, so we abandoned the vision” Visionary complex: “but customers don’t know what they want!” Too busy to learn: “it would be faster to just build it right, all this measuring distracts from delighting customers”
  • 79. Get Started Today You are ready to do this, no matter who you are what job you have what stage of company you’re in Get started now, today.
  • 80. There’s much more… IDEAS Code Faster Learn Faster BUILD LEARN Unit Tests Usability Tests Continuous Integration Incremental Deployment Free & Open-Source Components Cloud Computing Cluster Immune System Just-in-time Scalability Refactoring Developer Sandbox Minimum Viable Product Split Tests Customer Interviews Customer Development Five Whys Root Cause Analysis Customer Advisory Board Falsifiable Hypotheses Product Owner Accountability Customer Archetypes Cross-functional Teams Semi-autonomous Teams Smoke Tests CODE DATA Measure Faster MEASURE Split Tests Clear Product Owner Continuous Deployment Usability Tests Real-time Monitoring Customer Liaison Funnel Analysis Cohort Analysis Net Promoter Score Search Engine Marketing Real-Time Alerting Predictive Monitoring
  • 81. There’s much more… Startup Lessons Learned (season one 2008-2009) Every essay from the blog’s first year: http://bit.ly/SLLbookbeta
  • 82.
  • 84. Getting in touch (#leanstartup)
  • 87. Startup Lessons Learned – in print
  • 89.
  • 90. Don’t Launch IDEAS Code Faster Learn Faster BUILD LEARN Continuous Deployment Don’t Launch CODE DATA Measure Faster MEASURE Rapid Split Tests
  • 91. Don’t Launch What is a launch? Marketing Launch Announce a new product, start its PR campaign, and engage in buzz marketing activities. Product Launch Make a new product available to customers in the general public.
  • 92. Effects of Marketing Launch Drive customers into your sales pipeline Establish credibility with potential partners Help you raise money … however …
  • 93. Other Consequences A marketing launch establishes your positioning Waste customers on a non-working business model You never get a second chance to launch
  • 94. Why do we launch? Investors push for it (ego?) Founders push for it (ego?) Fear of the accidental launch Instead: build a Minimum Viable Product, establish small but renewable audience, iterate iterate iterate
  • 95. Know When to Launch When you have a strategy for the launch Know the success metrics Know your fundamental driver of growth Know where, when, and how to launch Launch when you can predict the future