SlideShare a Scribd company logo
1 of 16
2015
From Lean Experiments
To Successful
Productization!
Rekha Joshi, Intuit
14 Oct. 2015
#GHC15
2015
2015
Work: As We Know It
2015
Released Failures Are Expensive
But pre-release
failures can be a
valuable step toward
success!
2015
Success: an Ambiguous Word
Hmm, success …
Achieving scalable, available, efficient
solutions …
Millions of transactions per second …
A huge customer base …
2015
Every Product Has Its Own Definition
2015
What They Have In Common
Striving for a high success rate If failure, low impact
2015
The Lean Experimentation Model
• Compare metrics to
hypotheses
• Get to root cause
• Savor the surprises
• Write down the Leap of
Faith Assumptions
• Select metric and test
method
• Declare the numeric
hypothesis you expect
to achieve
• Design it to be fast and frugal
• Collect behavioral data
2015
Slice the Problem Into Smaller Tasks
2015
Use Continuous Integration to Move Fast
2015
Make It Easy for Customers to Provide Feedback
2015
Be Flexible About Changing Direction
2015
Customer Sign-off is the Definition of Done
2015
Example: Lean Experiment on Mobile
Stage 0: Let’s build an inventory billing app
Stage 1: Bluetooth printing; get it working for one set of
customers (hardware stores)
Stage 2: Change direction – customer needs export of
transactions for accounting
Stage 3: Customer feedback – need email/SMS preferences
Stage 4: Let’s expand to other types of customers (food vendors)
Stage 5: Success for market segment
Inventory billing app for small business
2015
Example: Lean Experiment in Cloud
Stage 0: Let’s create a A/B testing product
Stage 1: Get it working for one set of customers (TurboTax Online)
Stage 2: Customer feedback – works for them!
Stage 3: Customer feedback – needs advanced segmentation,
mutual exclusions on experiments, more features
Stage 4: Change direction – need scalability/reliability/availability
 move to AWS
Stage 5: Let’s expand to other products (QuickBooks Online)
Stage 6: Let’s make it personalized with real-time A/B testing based
on decision models
Personalized A/B testing platform
2015
Lean Experiment Your Way to Success!
2015
Got Feedback?
Rate and review the session on our mobile app
Download at http://ddut.ch/ghc15
or search GHC 2015 in the app store

More Related Content

What's hot

Landing Pages & A/B Testing
Landing Pages & A/B TestingLanding Pages & A/B Testing
Landing Pages & A/B TestingVigLink
 
KPIs for agile transformation
KPIs for agile transformationKPIs for agile transformation
KPIs for agile transformationRamkumar Arumugam
 
CMMi journey at small Organizations
CMMi journey at small OrganizationsCMMi journey at small Organizations
CMMi journey at small OrganizationsJyoti Chopra
 
A Roadmap for a Successful P2P Automation Journey
A Roadmap for a Successful P2P Automation JourneyA Roadmap for a Successful P2P Automation Journey
A Roadmap for a Successful P2P Automation JourneyKissflow
 
KPIs for Successful Agile Transformation
KPIs for Successful Agile TransformationKPIs for Successful Agile Transformation
KPIs for Successful Agile TransformationRamkumar Arumugam
 
Walgreens webinar final ns
Walgreens webinar final nsWalgreens webinar final ns
Walgreens webinar final nsDynatrace
 
SaasBOOMi Build - How we Prioritize Features for 1000’s of customers?
SaasBOOMi Build - How we  Prioritize Features  for 1000’s of customers?SaasBOOMi Build - How we  Prioritize Features  for 1000’s of customers?
SaasBOOMi Build - How we Prioritize Features for 1000’s of customers?Kissflow
 
To be or not to be Agile ?
To be or not to be Agile ?To be or not to be Agile ?
To be or not to be Agile ?AgileNetwork
 
Kissflow School Cloud - Webinar 10th Feb 2021
Kissflow School Cloud - Webinar 10th Feb 2021Kissflow School Cloud - Webinar 10th Feb 2021
Kissflow School Cloud - Webinar 10th Feb 2021Kissflow
 
Denver Startup Week - Balancing Voices in Product Management
Denver Startup Week - Balancing Voices in Product ManagementDenver Startup Week - Balancing Voices in Product Management
Denver Startup Week - Balancing Voices in Product Managementlindsayhunt
 
PwC Accelerates Bizagi Path to Expansion
PwC Accelerates Bizagi Path to ExpansionPwC Accelerates Bizagi Path to Expansion
PwC Accelerates Bizagi Path to ExpansionBizagi
 
How mobile first led to adopting lean startup
How mobile first led to adopting lean startupHow mobile first led to adopting lean startup
How mobile first led to adopting lean startupLonneke Vink
 
Baby Steps To Agility
Baby Steps To AgilityBaby Steps To Agility
Baby Steps To AgilityNaresh Jain
 
Lean & Agile: What Publishing Can Learn From Startups
Lean & Agile: What Publishing Can Learn From StartupsLean & Agile: What Publishing Can Learn From Startups
Lean & Agile: What Publishing Can Learn From Startupsrwillmer
 
The Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsThe Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsOptimizely
 
Pipefy Full Presentation
Pipefy Full Presentation Pipefy Full Presentation
Pipefy Full Presentation Felipe Scholz
 
What you need to know before starting B2B product
What you need to know before starting B2B productWhat you need to know before starting B2B product
What you need to know before starting B2B productProvectus
 
Best Practices for Embedding Analytics by GoodData Product Leader
Best Practices for Embedding Analytics by GoodData Product LeaderBest Practices for Embedding Analytics by GoodData Product Leader
Best Practices for Embedding Analytics by GoodData Product LeaderProduct School
 
Realign Process & Data To Improve Your Customer-Centricity
Realign Process & Data To Improve Your Customer-CentricityRealign Process & Data To Improve Your Customer-Centricity
Realign Process & Data To Improve Your Customer-CentricityBizagi
 

What's hot (20)

Landing Pages & A/B Testing
Landing Pages & A/B TestingLanding Pages & A/B Testing
Landing Pages & A/B Testing
 
KPIs for agile transformation
KPIs for agile transformationKPIs for agile transformation
KPIs for agile transformation
 
CMMi journey at small Organizations
CMMi journey at small OrganizationsCMMi journey at small Organizations
CMMi journey at small Organizations
 
A Roadmap for a Successful P2P Automation Journey
A Roadmap for a Successful P2P Automation JourneyA Roadmap for a Successful P2P Automation Journey
A Roadmap for a Successful P2P Automation Journey
 
KPIs for Successful Agile Transformation
KPIs for Successful Agile TransformationKPIs for Successful Agile Transformation
KPIs for Successful Agile Transformation
 
Walgreens webinar final ns
Walgreens webinar final nsWalgreens webinar final ns
Walgreens webinar final ns
 
SaasBOOMi Build - How we Prioritize Features for 1000’s of customers?
SaasBOOMi Build - How we  Prioritize Features  for 1000’s of customers?SaasBOOMi Build - How we  Prioritize Features  for 1000’s of customers?
SaasBOOMi Build - How we Prioritize Features for 1000’s of customers?
 
To be or not to be Agile ?
To be or not to be Agile ?To be or not to be Agile ?
To be or not to be Agile ?
 
Kissflow School Cloud - Webinar 10th Feb 2021
Kissflow School Cloud - Webinar 10th Feb 2021Kissflow School Cloud - Webinar 10th Feb 2021
Kissflow School Cloud - Webinar 10th Feb 2021
 
PIPEFY presentation - 2018
PIPEFY presentation - 2018PIPEFY presentation - 2018
PIPEFY presentation - 2018
 
Denver Startup Week - Balancing Voices in Product Management
Denver Startup Week - Balancing Voices in Product ManagementDenver Startup Week - Balancing Voices in Product Management
Denver Startup Week - Balancing Voices in Product Management
 
PwC Accelerates Bizagi Path to Expansion
PwC Accelerates Bizagi Path to ExpansionPwC Accelerates Bizagi Path to Expansion
PwC Accelerates Bizagi Path to Expansion
 
How mobile first led to adopting lean startup
How mobile first led to adopting lean startupHow mobile first led to adopting lean startup
How mobile first led to adopting lean startup
 
Baby Steps To Agility
Baby Steps To AgilityBaby Steps To Agility
Baby Steps To Agility
 
Lean & Agile: What Publishing Can Learn From Startups
Lean & Agile: What Publishing Can Learn From StartupsLean & Agile: What Publishing Can Learn From Startups
Lean & Agile: What Publishing Can Learn From Startups
 
The Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsThe Future of Optimizely for Technical Teams
The Future of Optimizely for Technical Teams
 
Pipefy Full Presentation
Pipefy Full Presentation Pipefy Full Presentation
Pipefy Full Presentation
 
What you need to know before starting B2B product
What you need to know before starting B2B productWhat you need to know before starting B2B product
What you need to know before starting B2B product
 
Best Practices for Embedding Analytics by GoodData Product Leader
Best Practices for Embedding Analytics by GoodData Product LeaderBest Practices for Embedding Analytics by GoodData Product Leader
Best Practices for Embedding Analytics by GoodData Product Leader
 
Realign Process & Data To Improve Your Customer-Centricity
Realign Process & Data To Improve Your Customer-CentricityRealign Process & Data To Improve Your Customer-Centricity
Realign Process & Data To Improve Your Customer-Centricity
 

Viewers also liked

How to build a product
How to build a productHow to build a product
How to build a productAndrew Law
 
Productizing a Cassandra-Based Solution (Brij Bhushan Ravat, Ericsson) | C* S...
Productizing a Cassandra-Based Solution (Brij Bhushan Ravat, Ericsson) | C* S...Productizing a Cassandra-Based Solution (Brij Bhushan Ravat, Ericsson) | C* S...
Productizing a Cassandra-Based Solution (Brij Bhushan Ravat, Ericsson) | C* S...DataStax
 
XentiQ- Productization: From Lab to the Marketplace
XentiQ- Productization:From Lab to the MarketplaceXentiQ- Productization:From Lab to the Marketplace
XentiQ- Productization: From Lab to the MarketplaceBilal Serlaman
 
Types of contract
Types of contractTypes of contract
Types of contractSweetp999
 

Viewers also liked (6)

Zebulon Solutions
Zebulon SolutionsZebulon Solutions
Zebulon Solutions
 
Zeb Pitch
Zeb PitchZeb Pitch
Zeb Pitch
 
How to build a product
How to build a productHow to build a product
How to build a product
 
Productizing a Cassandra-Based Solution (Brij Bhushan Ravat, Ericsson) | C* S...
Productizing a Cassandra-Based Solution (Brij Bhushan Ravat, Ericsson) | C* S...Productizing a Cassandra-Based Solution (Brij Bhushan Ravat, Ericsson) | C* S...
Productizing a Cassandra-Based Solution (Brij Bhushan Ravat, Ericsson) | C* S...
 
XentiQ- Productization: From Lab to the Marketplace
XentiQ- Productization:From Lab to the MarketplaceXentiQ- Productization:From Lab to the Marketplace
XentiQ- Productization: From Lab to the Marketplace
 
Types of contract
Types of contractTypes of contract
Types of contract
 

Similar to Lean Experiments To Successful Productization!

Culture Clash: Agile Cadence vs. Business Cadence
Culture Clash:  Agile Cadence vs. Business CadenceCulture Clash:  Agile Cadence vs. Business Cadence
Culture Clash: Agile Cadence vs. Business CadencePivotal Product Management
 
FCB Partners Webinar: Process 2020: The Cutting Edge of Process Innovation
FCB Partners Webinar: Process 2020: The Cutting Edge of Process Innovation FCB Partners Webinar: Process 2020: The Cutting Edge of Process Innovation
FCB Partners Webinar: Process 2020: The Cutting Edge of Process Innovation FCBPartners
 
Summary of The Lean Startup (Eric Ries)
Summary of The Lean Startup (Eric Ries)Summary of The Lean Startup (Eric Ries)
Summary of The Lean Startup (Eric Ries)Vinsol
 
Lean Startup in eHealth
Lean Startup in eHealthLean Startup in eHealth
Lean Startup in eHealthforumvirium
 
#DFB2B 2015 - Diederik Martens, Optimaliseer (met) marketing automation
#DFB2B 2015 - Diederik Martens, Optimaliseer (met) marketing automation#DFB2B 2015 - Diederik Martens, Optimaliseer (met) marketing automation
#DFB2B 2015 - Diederik Martens, Optimaliseer (met) marketing automationWebs.nl B2B Inbound Marketing
 
Lean start up bootcamp 4 measure test pivot or perservere
Lean start up bootcamp 4   measure test pivot or perservereLean start up bootcamp 4   measure test pivot or perservere
Lean start up bootcamp 4 measure test pivot or perservereJames Cracknell
 
[Webinar] Visa's Journey to a Culture of Experimentation
[Webinar] Visa's Journey to a Culture of Experimentation[Webinar] Visa's Journey to a Culture of Experimentation
[Webinar] Visa's Journey to a Culture of ExperimentationOptimizely
 
Subscribed 2016: Extending Your Zuora Platform
Subscribed 2016: Extending Your Zuora PlatformSubscribed 2016: Extending Your Zuora Platform
Subscribed 2016: Extending Your Zuora PlatformZuora, Inc.
 
Growth Startup - How to Build Scalable & Flexible Applications to Manage Hype...
Growth Startup - How to Build Scalable & Flexible Applications to Manage Hype...Growth Startup - How to Build Scalable & Flexible Applications to Manage Hype...
Growth Startup - How to Build Scalable & Flexible Applications to Manage Hype...Christian Zacharias
 
Cigniti joint webinar with Soasta - Agile DevOps: Test-driven IT Environment ...
Cigniti joint webinar with Soasta - Agile DevOps: Test-driven IT Environment ...Cigniti joint webinar with Soasta - Agile DevOps: Test-driven IT Environment ...
Cigniti joint webinar with Soasta - Agile DevOps: Test-driven IT Environment ...Cigniti Technologies Ltd
 
Startup KPIs and A/B Testing
Startup KPIs and A/B TestingStartup KPIs and A/B Testing
Startup KPIs and A/B TestingJeff McClelland
 
On product failure
On product failureOn product failure
On product failureAmr Medhat
 
Lean Startup: Pivot vs Persevere
Lean Startup: Pivot vs PersevereLean Startup: Pivot vs Persevere
Lean Startup: Pivot vs PersevereCarlos Morales
 
Lean Product Management for ISVs (October 14, 2014)
Lean Product Management for ISVs (October 14, 2014)Lean Product Management for ISVs (October 14, 2014)
Lean Product Management for ISVs (October 14, 2014)Salesforce Partners
 
Get Scrappy: Start Measuring Customer LTV With Digital
Get Scrappy: Start Measuring Customer LTV With DigitalGet Scrappy: Start Measuring Customer LTV With Digital
Get Scrappy: Start Measuring Customer LTV With DigitalJoshua Stauffer
 
10 Immutable Steps to Mobilize Your Business
10 Immutable Steps to Mobilize Your Business10 Immutable Steps to Mobilize Your Business
10 Immutable Steps to Mobilize Your BusinessProntoForms
 
CP15-Presentation-KHC Deloitte Trade Promotion_20151005
CP15-Presentation-KHC Deloitte Trade Promotion_20151005CP15-Presentation-KHC Deloitte Trade Promotion_20151005
CP15-Presentation-KHC Deloitte Trade Promotion_20151005Jeff Wagner
 
Introduction to Running Lean Startups
Introduction to Running Lean StartupsIntroduction to Running Lean Startups
Introduction to Running Lean Startupsamr0mt
 
How different Minimum Viable Products helped us understand customers.
How different Minimum Viable Products helped us understand customers.How different Minimum Viable Products helped us understand customers.
How different Minimum Viable Products helped us understand customers.Pushkar Gaikwad
 

Similar to Lean Experiments To Successful Productization! (20)

Culture Clash: Agile Cadence vs. Business Cadence
Culture Clash:  Agile Cadence vs. Business CadenceCulture Clash:  Agile Cadence vs. Business Cadence
Culture Clash: Agile Cadence vs. Business Cadence
 
FCB Partners Webinar: Process 2020: The Cutting Edge of Process Innovation
FCB Partners Webinar: Process 2020: The Cutting Edge of Process Innovation FCB Partners Webinar: Process 2020: The Cutting Edge of Process Innovation
FCB Partners Webinar: Process 2020: The Cutting Edge of Process Innovation
 
Summary of The Lean Startup (Eric Ries)
Summary of The Lean Startup (Eric Ries)Summary of The Lean Startup (Eric Ries)
Summary of The Lean Startup (Eric Ries)
 
Lean Startup in eHealth
Lean Startup in eHealthLean Startup in eHealth
Lean Startup in eHealth
 
#DFB2B 2015 - Diederik Martens, Optimaliseer (met) marketing automation
#DFB2B 2015 - Diederik Martens, Optimaliseer (met) marketing automation#DFB2B 2015 - Diederik Martens, Optimaliseer (met) marketing automation
#DFB2B 2015 - Diederik Martens, Optimaliseer (met) marketing automation
 
Lean start up bootcamp 4 measure test pivot or perservere
Lean start up bootcamp 4   measure test pivot or perservereLean start up bootcamp 4   measure test pivot or perservere
Lean start up bootcamp 4 measure test pivot or perservere
 
[Webinar] Visa's Journey to a Culture of Experimentation
[Webinar] Visa's Journey to a Culture of Experimentation[Webinar] Visa's Journey to a Culture of Experimentation
[Webinar] Visa's Journey to a Culture of Experimentation
 
Subscribed 2016: Extending Your Zuora Platform
Subscribed 2016: Extending Your Zuora PlatformSubscribed 2016: Extending Your Zuora Platform
Subscribed 2016: Extending Your Zuora Platform
 
Growth Startup - How to Build Scalable & Flexible Applications to Manage Hype...
Growth Startup - How to Build Scalable & Flexible Applications to Manage Hype...Growth Startup - How to Build Scalable & Flexible Applications to Manage Hype...
Growth Startup - How to Build Scalable & Flexible Applications to Manage Hype...
 
Cigniti joint webinar with Soasta - Agile DevOps: Test-driven IT Environment ...
Cigniti joint webinar with Soasta - Agile DevOps: Test-driven IT Environment ...Cigniti joint webinar with Soasta - Agile DevOps: Test-driven IT Environment ...
Cigniti joint webinar with Soasta - Agile DevOps: Test-driven IT Environment ...
 
Startup KPIs and A/B Testing
Startup KPIs and A/B TestingStartup KPIs and A/B Testing
Startup KPIs and A/B Testing
 
On product failure
On product failureOn product failure
On product failure
 
Lean Startup: Pivot vs Persevere
Lean Startup: Pivot vs PersevereLean Startup: Pivot vs Persevere
Lean Startup: Pivot vs Persevere
 
Lean Product Management for ISVs (October 14, 2014)
Lean Product Management for ISVs (October 14, 2014)Lean Product Management for ISVs (October 14, 2014)
Lean Product Management for ISVs (October 14, 2014)
 
Get Scrappy: Start Measuring Customer LTV With Digital
Get Scrappy: Start Measuring Customer LTV With DigitalGet Scrappy: Start Measuring Customer LTV With Digital
Get Scrappy: Start Measuring Customer LTV With Digital
 
10 Immutable Steps to Mobilize Your Business
10 Immutable Steps to Mobilize Your Business10 Immutable Steps to Mobilize Your Business
10 Immutable Steps to Mobilize Your Business
 
CP15-Presentation-KHC Deloitte Trade Promotion_20151005
CP15-Presentation-KHC Deloitte Trade Promotion_20151005CP15-Presentation-KHC Deloitte Trade Promotion_20151005
CP15-Presentation-KHC Deloitte Trade Promotion_20151005
 
Scaling Up Your Startups
Scaling Up Your StartupsScaling Up Your Startups
Scaling Up Your Startups
 
Introduction to Running Lean Startups
Introduction to Running Lean StartupsIntroduction to Running Lean Startups
Introduction to Running Lean Startups
 
How different Minimum Viable Products helped us understand customers.
How different Minimum Viable Products helped us understand customers.How different Minimum Viable Products helped us understand customers.
How different Minimum Viable Products helped us understand customers.
 

More from Rekha Joshi

Berlin buzzwords 2018
Berlin buzzwords 2018Berlin buzzwords 2018
Berlin buzzwords 2018Rekha Joshi
 
Innersource Summit 2018
Innersource Summit 2018Innersource Summit 2018
Innersource Summit 2018Rekha Joshi
 
Security And Performance: A Tale Of Two Cities
Security And Performance: A Tale Of Two CitiesSecurity And Performance: A Tale Of Two Cities
Security And Performance: A Tale Of Two CitiesRekha Joshi
 
Hadoop Summit 2016 - Evolution of Big Data Pipelines At Intuit
Hadoop Summit 2016 - Evolution of Big Data Pipelines At IntuitHadoop Summit 2016 - Evolution of Big Data Pipelines At Intuit
Hadoop Summit 2016 - Evolution of Big Data Pipelines At IntuitRekha Joshi
 
O'Reilly Velocity Europe
O'Reilly Velocity EuropeO'Reilly Velocity Europe
O'Reilly Velocity EuropeRekha Joshi
 
ApacheCon - Seven habits of highly effective big data programmers
ApacheCon - Seven habits of highly effective big data programmersApacheCon - Seven habits of highly effective big data programmers
ApacheCon - Seven habits of highly effective big data programmersRekha Joshi
 
CassandraSummit'2015:Reporting From Trenches: Using Cassandra Effectively!
CassandraSummit'2015:Reporting From Trenches: Using Cassandra Effectively!CassandraSummit'2015:Reporting From Trenches: Using Cassandra Effectively!
CassandraSummit'2015:Reporting From Trenches: Using Cassandra Effectively!Rekha Joshi
 
HadoopSummit'2015:Self Evolving Models for Dynamic System Accuracy
HadoopSummit'2015:Self Evolving Models for Dynamic System AccuracyHadoopSummit'2015:Self Evolving Models for Dynamic System Accuracy
HadoopSummit'2015:Self Evolving Models for Dynamic System AccuracyRekha Joshi
 

More from Rekha Joshi (8)

Berlin buzzwords 2018
Berlin buzzwords 2018Berlin buzzwords 2018
Berlin buzzwords 2018
 
Innersource Summit 2018
Innersource Summit 2018Innersource Summit 2018
Innersource Summit 2018
 
Security And Performance: A Tale Of Two Cities
Security And Performance: A Tale Of Two CitiesSecurity And Performance: A Tale Of Two Cities
Security And Performance: A Tale Of Two Cities
 
Hadoop Summit 2016 - Evolution of Big Data Pipelines At Intuit
Hadoop Summit 2016 - Evolution of Big Data Pipelines At IntuitHadoop Summit 2016 - Evolution of Big Data Pipelines At Intuit
Hadoop Summit 2016 - Evolution of Big Data Pipelines At Intuit
 
O'Reilly Velocity Europe
O'Reilly Velocity EuropeO'Reilly Velocity Europe
O'Reilly Velocity Europe
 
ApacheCon - Seven habits of highly effective big data programmers
ApacheCon - Seven habits of highly effective big data programmersApacheCon - Seven habits of highly effective big data programmers
ApacheCon - Seven habits of highly effective big data programmers
 
CassandraSummit'2015:Reporting From Trenches: Using Cassandra Effectively!
CassandraSummit'2015:Reporting From Trenches: Using Cassandra Effectively!CassandraSummit'2015:Reporting From Trenches: Using Cassandra Effectively!
CassandraSummit'2015:Reporting From Trenches: Using Cassandra Effectively!
 
HadoopSummit'2015:Self Evolving Models for Dynamic System Accuracy
HadoopSummit'2015:Self Evolving Models for Dynamic System AccuracyHadoopSummit'2015:Self Evolving Models for Dynamic System Accuracy
HadoopSummit'2015:Self Evolving Models for Dynamic System Accuracy
 

Recently uploaded

ROBOETHICS-CCS345 ETHICS AND ARTIFICIAL INTELLIGENCE.ppt
ROBOETHICS-CCS345 ETHICS AND ARTIFICIAL INTELLIGENCE.pptROBOETHICS-CCS345 ETHICS AND ARTIFICIAL INTELLIGENCE.ppt
ROBOETHICS-CCS345 ETHICS AND ARTIFICIAL INTELLIGENCE.pptJohnWilliam111370
 
Main Memory Management in Operating System
Main Memory Management in Operating SystemMain Memory Management in Operating System
Main Memory Management in Operating SystemRashmi Bhat
 
Engineering Drawing section of solid
Engineering Drawing     section of solidEngineering Drawing     section of solid
Engineering Drawing section of solidnamansinghjarodiya
 
Input Output Management in Operating System
Input Output Management in Operating SystemInput Output Management in Operating System
Input Output Management in Operating SystemRashmi Bhat
 
DEVICE DRIVERS AND INTERRUPTS SERVICE MECHANISM.pdf
DEVICE DRIVERS AND INTERRUPTS  SERVICE MECHANISM.pdfDEVICE DRIVERS AND INTERRUPTS  SERVICE MECHANISM.pdf
DEVICE DRIVERS AND INTERRUPTS SERVICE MECHANISM.pdfAkritiPradhan2
 
Turn leadership mistakes into a better future.pptx
Turn leadership mistakes into a better future.pptxTurn leadership mistakes into a better future.pptx
Turn leadership mistakes into a better future.pptxStephen Sitton
 
Research Methodology for Engineering pdf
Research Methodology for Engineering pdfResearch Methodology for Engineering pdf
Research Methodology for Engineering pdfCaalaaAbdulkerim
 
Robotics Group 10 (Control Schemes) cse.pdf
Robotics Group 10  (Control Schemes) cse.pdfRobotics Group 10  (Control Schemes) cse.pdf
Robotics Group 10 (Control Schemes) cse.pdfsahilsajad201
 
System Simulation and Modelling with types and Event Scheduling
System Simulation and Modelling with types and Event SchedulingSystem Simulation and Modelling with types and Event Scheduling
System Simulation and Modelling with types and Event SchedulingBootNeck1
 
Paper Tube : Shigeru Ban projects and Case Study of Cardboard Cathedral .pdf
Paper Tube : Shigeru Ban projects and Case Study of Cardboard Cathedral .pdfPaper Tube : Shigeru Ban projects and Case Study of Cardboard Cathedral .pdf
Paper Tube : Shigeru Ban projects and Case Study of Cardboard Cathedral .pdfNainaShrivastava14
 
OOP concepts -in-Python programming language
OOP concepts -in-Python programming languageOOP concepts -in-Python programming language
OOP concepts -in-Python programming languageSmritiSharma901052
 
Cost estimation approach: FP to COCOMO scenario based question
Cost estimation approach: FP to COCOMO scenario based questionCost estimation approach: FP to COCOMO scenario based question
Cost estimation approach: FP to COCOMO scenario based questionSneha Padhiar
 
List of Accredited Concrete Batching Plant.pdf
List of Accredited Concrete Batching Plant.pdfList of Accredited Concrete Batching Plant.pdf
List of Accredited Concrete Batching Plant.pdfisabel213075
 
TEST CASE GENERATION GENERATION BLOCK BOX APPROACH
TEST CASE GENERATION GENERATION BLOCK BOX APPROACHTEST CASE GENERATION GENERATION BLOCK BOX APPROACH
TEST CASE GENERATION GENERATION BLOCK BOX APPROACHSneha Padhiar
 
TechTAC® CFD Report Summary: A Comparison of Two Types of Tubing Anchor Catchers
TechTAC® CFD Report Summary: A Comparison of Two Types of Tubing Anchor CatchersTechTAC® CFD Report Summary: A Comparison of Two Types of Tubing Anchor Catchers
TechTAC® CFD Report Summary: A Comparison of Two Types of Tubing Anchor Catcherssdickerson1
 
Robotics-Asimov's Laws, Mechanical Subsystems, Robot Kinematics, Robot Dynami...
Robotics-Asimov's Laws, Mechanical Subsystems, Robot Kinematics, Robot Dynami...Robotics-Asimov's Laws, Mechanical Subsystems, Robot Kinematics, Robot Dynami...
Robotics-Asimov's Laws, Mechanical Subsystems, Robot Kinematics, Robot Dynami...Sumanth A
 
SOFTWARE ESTIMATION COCOMO AND FP CALCULATION
SOFTWARE ESTIMATION COCOMO AND FP CALCULATIONSOFTWARE ESTIMATION COCOMO AND FP CALCULATION
SOFTWARE ESTIMATION COCOMO AND FP CALCULATIONSneha Padhiar
 
US Department of Education FAFSA Week of Action
US Department of Education FAFSA Week of ActionUS Department of Education FAFSA Week of Action
US Department of Education FAFSA Week of ActionMebane Rash
 
CS 3251 Programming in c all unit notes pdf
CS 3251 Programming in c all unit notes pdfCS 3251 Programming in c all unit notes pdf
CS 3251 Programming in c all unit notes pdfBalamuruganV28
 
Module-1-(Building Acoustics) Noise Control (Unit-3). pdf
Module-1-(Building Acoustics) Noise Control (Unit-3). pdfModule-1-(Building Acoustics) Noise Control (Unit-3). pdf
Module-1-(Building Acoustics) Noise Control (Unit-3). pdfManish Kumar
 

Recently uploaded (20)

ROBOETHICS-CCS345 ETHICS AND ARTIFICIAL INTELLIGENCE.ppt
ROBOETHICS-CCS345 ETHICS AND ARTIFICIAL INTELLIGENCE.pptROBOETHICS-CCS345 ETHICS AND ARTIFICIAL INTELLIGENCE.ppt
ROBOETHICS-CCS345 ETHICS AND ARTIFICIAL INTELLIGENCE.ppt
 
Main Memory Management in Operating System
Main Memory Management in Operating SystemMain Memory Management in Operating System
Main Memory Management in Operating System
 
Engineering Drawing section of solid
Engineering Drawing     section of solidEngineering Drawing     section of solid
Engineering Drawing section of solid
 
Input Output Management in Operating System
Input Output Management in Operating SystemInput Output Management in Operating System
Input Output Management in Operating System
 
DEVICE DRIVERS AND INTERRUPTS SERVICE MECHANISM.pdf
DEVICE DRIVERS AND INTERRUPTS  SERVICE MECHANISM.pdfDEVICE DRIVERS AND INTERRUPTS  SERVICE MECHANISM.pdf
DEVICE DRIVERS AND INTERRUPTS SERVICE MECHANISM.pdf
 
Turn leadership mistakes into a better future.pptx
Turn leadership mistakes into a better future.pptxTurn leadership mistakes into a better future.pptx
Turn leadership mistakes into a better future.pptx
 
Research Methodology for Engineering pdf
Research Methodology for Engineering pdfResearch Methodology for Engineering pdf
Research Methodology for Engineering pdf
 
Robotics Group 10 (Control Schemes) cse.pdf
Robotics Group 10  (Control Schemes) cse.pdfRobotics Group 10  (Control Schemes) cse.pdf
Robotics Group 10 (Control Schemes) cse.pdf
 
System Simulation and Modelling with types and Event Scheduling
System Simulation and Modelling with types and Event SchedulingSystem Simulation and Modelling with types and Event Scheduling
System Simulation and Modelling with types and Event Scheduling
 
Paper Tube : Shigeru Ban projects and Case Study of Cardboard Cathedral .pdf
Paper Tube : Shigeru Ban projects and Case Study of Cardboard Cathedral .pdfPaper Tube : Shigeru Ban projects and Case Study of Cardboard Cathedral .pdf
Paper Tube : Shigeru Ban projects and Case Study of Cardboard Cathedral .pdf
 
OOP concepts -in-Python programming language
OOP concepts -in-Python programming languageOOP concepts -in-Python programming language
OOP concepts -in-Python programming language
 
Cost estimation approach: FP to COCOMO scenario based question
Cost estimation approach: FP to COCOMO scenario based questionCost estimation approach: FP to COCOMO scenario based question
Cost estimation approach: FP to COCOMO scenario based question
 
List of Accredited Concrete Batching Plant.pdf
List of Accredited Concrete Batching Plant.pdfList of Accredited Concrete Batching Plant.pdf
List of Accredited Concrete Batching Plant.pdf
 
TEST CASE GENERATION GENERATION BLOCK BOX APPROACH
TEST CASE GENERATION GENERATION BLOCK BOX APPROACHTEST CASE GENERATION GENERATION BLOCK BOX APPROACH
TEST CASE GENERATION GENERATION BLOCK BOX APPROACH
 
TechTAC® CFD Report Summary: A Comparison of Two Types of Tubing Anchor Catchers
TechTAC® CFD Report Summary: A Comparison of Two Types of Tubing Anchor CatchersTechTAC® CFD Report Summary: A Comparison of Two Types of Tubing Anchor Catchers
TechTAC® CFD Report Summary: A Comparison of Two Types of Tubing Anchor Catchers
 
Robotics-Asimov's Laws, Mechanical Subsystems, Robot Kinematics, Robot Dynami...
Robotics-Asimov's Laws, Mechanical Subsystems, Robot Kinematics, Robot Dynami...Robotics-Asimov's Laws, Mechanical Subsystems, Robot Kinematics, Robot Dynami...
Robotics-Asimov's Laws, Mechanical Subsystems, Robot Kinematics, Robot Dynami...
 
SOFTWARE ESTIMATION COCOMO AND FP CALCULATION
SOFTWARE ESTIMATION COCOMO AND FP CALCULATIONSOFTWARE ESTIMATION COCOMO AND FP CALCULATION
SOFTWARE ESTIMATION COCOMO AND FP CALCULATION
 
US Department of Education FAFSA Week of Action
US Department of Education FAFSA Week of ActionUS Department of Education FAFSA Week of Action
US Department of Education FAFSA Week of Action
 
CS 3251 Programming in c all unit notes pdf
CS 3251 Programming in c all unit notes pdfCS 3251 Programming in c all unit notes pdf
CS 3251 Programming in c all unit notes pdf
 
Module-1-(Building Acoustics) Noise Control (Unit-3). pdf
Module-1-(Building Acoustics) Noise Control (Unit-3). pdfModule-1-(Building Acoustics) Noise Control (Unit-3). pdf
Module-1-(Building Acoustics) Noise Control (Unit-3). pdf
 

Lean Experiments To Successful Productization!

  • 1. 2015 From Lean Experiments To Successful Productization! Rekha Joshi, Intuit 14 Oct. 2015 #GHC15 2015
  • 3. 2015 Released Failures Are Expensive But pre-release failures can be a valuable step toward success!
  • 4. 2015 Success: an Ambiguous Word Hmm, success … Achieving scalable, available, efficient solutions … Millions of transactions per second … A huge customer base …
  • 5. 2015 Every Product Has Its Own Definition
  • 6. 2015 What They Have In Common Striving for a high success rate If failure, low impact
  • 7. 2015 The Lean Experimentation Model • Compare metrics to hypotheses • Get to root cause • Savor the surprises • Write down the Leap of Faith Assumptions • Select metric and test method • Declare the numeric hypothesis you expect to achieve • Design it to be fast and frugal • Collect behavioral data
  • 8. 2015 Slice the Problem Into Smaller Tasks
  • 10. 2015 Make It Easy for Customers to Provide Feedback
  • 11. 2015 Be Flexible About Changing Direction
  • 12. 2015 Customer Sign-off is the Definition of Done
  • 13. 2015 Example: Lean Experiment on Mobile Stage 0: Let’s build an inventory billing app Stage 1: Bluetooth printing; get it working for one set of customers (hardware stores) Stage 2: Change direction – customer needs export of transactions for accounting Stage 3: Customer feedback – need email/SMS preferences Stage 4: Let’s expand to other types of customers (food vendors) Stage 5: Success for market segment Inventory billing app for small business
  • 14. 2015 Example: Lean Experiment in Cloud Stage 0: Let’s create a A/B testing product Stage 1: Get it working for one set of customers (TurboTax Online) Stage 2: Customer feedback – works for them! Stage 3: Customer feedback – needs advanced segmentation, mutual exclusions on experiments, more features Stage 4: Change direction – need scalability/reliability/availability  move to AWS Stage 5: Let’s expand to other products (QuickBooks Online) Stage 6: Let’s make it personalized with real-time A/B testing based on decision models Personalized A/B testing platform
  • 15. 2015 Lean Experiment Your Way to Success!
  • 16. 2015 Got Feedback? Rate and review the session on our mobile app Download at http://ddut.ch/ghc15 or search GHC 2015 in the app store

Editor's Notes

  1. This is the last slide and must be included in the slide deck