Intuit's Rekha Joshi talks about how every product has its own definition at the 2015 Grace Hopper Celebration of Women in Computing .

1. 2015
From Lean Experiments
To Successful
Productization!
Rekha Joshi, Intuit
14 Oct. 2015
#GHC15
2015

2. 2015
Work: As We Know It

3. 2015
Released Failures Are Expensive
But pre-release
failures can be a
valuable step toward
success!

4. 2015
Success: an Ambiguous Word
Hmm, success …
Achieving scalable, available, efficient
solutions …
Millions of transactions per second …
A huge customer base …

5. 2015
Every Product Has Its Own Definition

6. 2015
What They Have In Common
Striving for a high success rate If failure, low impact

7. 2015
The Lean Experimentation Model
• Compare metrics to
hypotheses
• Get to root cause
• Savor the surprises
• Write down the Leap of
Faith Assumptions
• Select metric and test
method
• Declare the numeric
hypothesis you expect
to achieve
• Design it to be fast and frugal
• Collect behavioral data

8. 2015
Slice the Problem Into Smaller Tasks

9. 2015
Use Continuous Integration to Move Fast

10. 2015
Make It Easy for Customers to Provide Feedback

11. 2015
Be Flexible About Changing Direction

12. 2015
Customer Sign-off is the Definition of Done

13. 2015
Example: Lean Experiment on Mobile
Stage 0: Let’s build an inventory billing app
Stage 1: Bluetooth printing; get it working for one set of
customers (hardware stores)
Stage 2: Change direction – customer needs export of
transactions for accounting
Stage 3: Customer feedback – need email/SMS preferences
Stage 4: Let’s expand to other types of customers (food vendors)
Stage 5: Success for market segment
Inventory billing app for small business

14. 2015
Example: Lean Experiment in Cloud
Stage 0: Let’s create a A/B testing product
Stage 1: Get it working for one set of customers (TurboTax Online)
Stage 2: Customer feedback – works for them!
Stage 3: Customer feedback – needs advanced segmentation,
mutual exclusions on experiments, more features
Stage 4: Change direction – need scalability/reliability/availability
 move to AWS
Stage 5: Let’s expand to other products (QuickBooks Online)
Stage 6: Let’s make it personalized with real-time A/B testing based
on decision models
Personalized A/B testing platform

15. 2015
Lean Experiment Your Way to Success!

16. 2015
Got Feedback?
Rate and review the session on our mobile app
Download at http://ddut.ch/ghc15
or search GHC 2015 in the app store