SlideShare a Scribd company logo
1 of 28
Download to read offline
The Product Development
Checklist Manifesto
How To Get Features Right
Jordan Berman
VP Product, Contactually
About the Presenter
VP of Product at Contactually
since April 2014
Leads x-fn team and develops the
product vision, strategy, and roadmap
Jordan Berman
Atul Gawande, MD, MPH, is a surgeon,
writer, and public health researcher.
“[Gawande] is really interested in a
problem that afflicts virtually every aspect
of the modern world–and that is how
professionals deal with the increasing
complexity of their responsibilities.”
— Malcolm Gladwell
About the Author & Book
Problems to-be-solved
☑ How do we improve quality of our output throughout the product
development process, from conception through deployment?
☑ How do we create repeatable processes that are lightweight and help us
scale our team?
☑ How do we get increase collaboration and coordination across roles on
the team?
circa July 2015
✓Example Checklists
Johns Hopkins’ Infection Checklist
☑ Wash hands with soap
☑ Clean the patient's skin w. chlorhexidine antiseptic
☑ Put sterile drapes over the entire patient
☑ Wear a mask, hat, sterile gown, and gloves before operating
☑ Put a sterile dressing over the insertion site once the line was in
RESULTS
Year 1: Hopkins' rate of infections went from 11% to
zero. 



Year 2: prevented 43 infections, 8 fatalities, and
saved over $2m
WHO Safe Surgery Checklist
Surgery has four big killers: infection, bleeding, unsafe anesthesia, and “the
unexpected.”
Gawande concluded a standardized checklist could address the first three,
and the fourth could only be surfaced by provoking a discussion about team
member concerns.
The first draft of the WHO Safe Surgery Checklist was piloted at eight
hospitals of widely varying geography, wealth, and resources. A three month
baseline review was conducted and complication rates varied from 6-21% of
surgeries.
RESULTS
No new equipment or techniques were introduced
during the experiment - surgical teams just added
the checklist to their processes.
By the end of the pilot program, major complications
fell by 36% across the eight hospitals and deaths
fell by 47%. In the sample of 4000 patients, 150
fewer experienced complications and 27 fewer died
than without the checklist use.
Apple New Product Process
“[I]n the world according to Steve Jobs, the ANPP would rapidly evolve into a
well-defined process for bringing new products to market by laying out in
extreme detail every stage of product development.
“Embodied in a program that runs on the company’s internal network, the
ANPP resembled a giant checklist. It detailed exactly what everyone was to
do at every stage for every product …”
— Leander Kahney, “Jony Ive: The Genius Behind Apple's Greatest Products”
RESULTS
✓Why Checklists?
☑ Increase “Eptitude”
Human endeavors fail for three reasons:
1. we attempt things beyond our ability;
2. we are ignorant of what we need to know to succeed;
3. we ineptly apply available knowledge.
The explosion of knowledge in the last century has cut down on failure due to
ignorance and shifted to failure from ineptitude. Our chief concern is now
“eptitude—making sure we apply the knowledge we have consistently and
correctly.”
☑ Diminish Complexity
“The volume and complexity of what we know has exceeded our individual
ability to deliver tis benefits correctly, safely, or reliably. Knowledge has both
saved us and burdened us.”
☑ Impose Discipline
“In complex environments, experts are up against two main difficulties. The
first is the fallibility of human memory and attention, especially when it comes
to mundane, routine matters that are easily overlooked under the strain of
more pressing events. . . . People can lull themselves into skipping steps. . . .
Checklists instill a kind of discipline of higher performance.”
“Just ticking boxes is not the ultimate goal here. Embracing a culture of
teamwork and discipline is.”
☑ Focus Attention
Checklists “provide a cognitive net. They catch mental flaws . . . of memory
and attention and thoroughness.”
☑ Aid Judgment
Checklists are not designed to make us automatons and remove the need for
craft or judgment. They produce judgment, aided and enhanced by
procedure.
☑ Gain Efficiency
Investors who added checklists to their process saw their returns improve
and got efficiency gains: “The process was more thorough but faster.” They
could evaluate more deals than before.
☑ Encourage Conversation
Checklists are reviewed jointly by multiple members of the team at key
“pause points” where multiple members of the team need to work together
but may otherwise “hand off” work from one person to the other.
✓Checklist Best Practices
Gawande looked to other disciplines, namely construction project
management, aviation, and supply chain/logistics, to develop general
principles for a good checklist. What he found in common:
☑ Forcing functions exist to provoke conversation between multidisciplinary teams, referred to as
"pause points."
☑ These conversations, focused on what could go wrong, produce an "activation phenomenon."
☑ Interventions must be simple, measurable, and produce widely transmissible benefits (high ROI)
☑ Each item on the checklist must be precise, easy to complete, and essential to success.
☑ Measures must be taken to make the checklist use habitual.
☑ Behaviors that are already routine should be omitted.
☑ When possible checklists should be limited to 5-9 items (the limit of working memory)
✓Product Development
Checklists
Feature Go/No Go
UAT, QA, Code Review
Deployment
✓How to Roll Your Own
☑ Get team buy-in; persuade with data; treat it as an experiment
☑ Create & roll out one checklist at-a-time
☑ Focus on area of highest repeatability (code reviews?) - ingrains habits
☑ Review bug reports, error logs, and other sources of data for patterns
☑ Ask the team!
☑ Iterate, iterate, iterate

More Related Content

What's hot

The manifesto of Romantic Digital Consulting
The manifesto of Romantic Digital ConsultingThe manifesto of Romantic Digital Consulting
The manifesto of Romantic Digital ConsultingMaurizio Savoca
 
How To Build An Innovation Lab
How To Build An Innovation LabHow To Build An Innovation Lab
How To Build An Innovation LabPaul Taylor
 
Curate Learning Experiences to Ensure Change Success
Curate Learning Experiences to Ensure Change SuccessCurate Learning Experiences to Ensure Change Success
Curate Learning Experiences to Ensure Change SuccessANCILE Solutions, Inc.
 
Dealing with Estimation, Uncertainty, Risk, and Commitment
Dealing with Estimation, Uncertainty, Risk, and CommitmentDealing with Estimation, Uncertainty, Risk, and Commitment
Dealing with Estimation, Uncertainty, Risk, and CommitmentTechWell
 
12 Months of Failure: Lessons Learned in Year One of Bromford Lab
12 Months of Failure: Lessons Learned in Year One of Bromford Lab12 Months of Failure: Lessons Learned in Year One of Bromford Lab
12 Months of Failure: Lessons Learned in Year One of Bromford LabBromford Lab
 
Documenting a New Process with SOPs
Documenting a New Process with SOPsDocumenting a New Process with SOPs
Documenting a New Process with SOPsMatt Hansen
 
Getting Feedback with a Plus/Delta Tool
Getting Feedback with a Plus/Delta ToolGetting Feedback with a Plus/Delta Tool
Getting Feedback with a Plus/Delta ToolMatt Hansen
 
Closing a Project
Closing a ProjectClosing a Project
Closing a ProjectMatt Hansen
 
Diatom Enterprises Experts in Custom Software development
Diatom Enterprises Experts in Custom Software developmentDiatom Enterprises Experts in Custom Software development
Diatom Enterprises Experts in Custom Software developmentEvgueny Lemasov
 
What Awesome Sauce Tastes Like: Getting & Keeping Your Teams Healthy... the A...
What Awesome Sauce Tastes Like: Getting & Keeping Your Teams Healthy... the A...What Awesome Sauce Tastes Like: Getting & Keeping Your Teams Healthy... the A...
What Awesome Sauce Tastes Like: Getting & Keeping Your Teams Healthy... the A...Atlassian
 
[CXL Live 16] Growth Hacking BS: Fixing Marketing One Truth at a Time by Morg...
[CXL Live 16] Growth Hacking BS: Fixing Marketing One Truth at a Time by Morg...[CXL Live 16] Growth Hacking BS: Fixing Marketing One Truth at a Time by Morg...
[CXL Live 16] Growth Hacking BS: Fixing Marketing One Truth at a Time by Morg...CXL
 
Risk Assessment with a FMEA Tool
Risk Assessment with a FMEA ToolRisk Assessment with a FMEA Tool
Risk Assessment with a FMEA ToolMatt Hansen
 
Agency innovation labs 10 steps to success
Agency innovation labs   10 steps to successAgency innovation labs   10 steps to success
Agency innovation labs 10 steps to successBrunner
 
Proofhub Survey 2015
Proofhub Survey 2015Proofhub Survey 2015
Proofhub Survey 2015ProofHub
 
Rethinking Concept Testing to Innovate With Customers
Rethinking Concept Testing to Innovate With CustomersRethinking Concept Testing to Innovate With Customers
Rethinking Concept Testing to Innovate With CustomersResearchShare
 
Job Monitoring and Failure Analysis
Job Monitoring and Failure AnalysisJob Monitoring and Failure Analysis
Job Monitoring and Failure AnalysisJohn Ansa
 
Product Management. Lifecycles, customer input, innovation
Product Management. Lifecycles, customer input, innovationProduct Management. Lifecycles, customer input, innovation
Product Management. Lifecycles, customer input, innovationShiftup
 
Strategizing to build a perfect test environment
Strategizing to build a perfect test environmentStrategizing to build a perfect test environment
Strategizing to build a perfect test environmentEnov8
 
Story of innovation by Ayan Chtterjee
Story of innovation by Ayan ChtterjeeStory of innovation by Ayan Chtterjee
Story of innovation by Ayan ChtterjeeAyan Chatterjee
 

What's hot (20)

The manifesto of Romantic Digital Consulting
The manifesto of Romantic Digital ConsultingThe manifesto of Romantic Digital Consulting
The manifesto of Romantic Digital Consulting
 
How To Build An Innovation Lab
How To Build An Innovation LabHow To Build An Innovation Lab
How To Build An Innovation Lab
 
Curate Learning Experiences to Ensure Change Success
Curate Learning Experiences to Ensure Change SuccessCurate Learning Experiences to Ensure Change Success
Curate Learning Experiences to Ensure Change Success
 
Dealing with Estimation, Uncertainty, Risk, and Commitment
Dealing with Estimation, Uncertainty, Risk, and CommitmentDealing with Estimation, Uncertainty, Risk, and Commitment
Dealing with Estimation, Uncertainty, Risk, and Commitment
 
12 Months of Failure: Lessons Learned in Year One of Bromford Lab
12 Months of Failure: Lessons Learned in Year One of Bromford Lab12 Months of Failure: Lessons Learned in Year One of Bromford Lab
12 Months of Failure: Lessons Learned in Year One of Bromford Lab
 
Documenting a New Process with SOPs
Documenting a New Process with SOPsDocumenting a New Process with SOPs
Documenting a New Process with SOPs
 
Getting Feedback with a Plus/Delta Tool
Getting Feedback with a Plus/Delta ToolGetting Feedback with a Plus/Delta Tool
Getting Feedback with a Plus/Delta Tool
 
Closing a Project
Closing a ProjectClosing a Project
Closing a Project
 
Diatom Enterprises Experts in Custom Software development
Diatom Enterprises Experts in Custom Software developmentDiatom Enterprises Experts in Custom Software development
Diatom Enterprises Experts in Custom Software development
 
What Awesome Sauce Tastes Like: Getting & Keeping Your Teams Healthy... the A...
What Awesome Sauce Tastes Like: Getting & Keeping Your Teams Healthy... the A...What Awesome Sauce Tastes Like: Getting & Keeping Your Teams Healthy... the A...
What Awesome Sauce Tastes Like: Getting & Keeping Your Teams Healthy... the A...
 
[CXL Live 16] Growth Hacking BS: Fixing Marketing One Truth at a Time by Morg...
[CXL Live 16] Growth Hacking BS: Fixing Marketing One Truth at a Time by Morg...[CXL Live 16] Growth Hacking BS: Fixing Marketing One Truth at a Time by Morg...
[CXL Live 16] Growth Hacking BS: Fixing Marketing One Truth at a Time by Morg...
 
Risk Assessment with a FMEA Tool
Risk Assessment with a FMEA ToolRisk Assessment with a FMEA Tool
Risk Assessment with a FMEA Tool
 
Agency innovation labs 10 steps to success
Agency innovation labs   10 steps to successAgency innovation labs   10 steps to success
Agency innovation labs 10 steps to success
 
Proofhub Survey 2015
Proofhub Survey 2015Proofhub Survey 2015
Proofhub Survey 2015
 
Rethinking Concept Testing to Innovate With Customers
Rethinking Concept Testing to Innovate With CustomersRethinking Concept Testing to Innovate With Customers
Rethinking Concept Testing to Innovate With Customers
 
Job Monitoring and Failure Analysis
Job Monitoring and Failure AnalysisJob Monitoring and Failure Analysis
Job Monitoring and Failure Analysis
 
Product Management. Lifecycles, customer input, innovation
Product Management. Lifecycles, customer input, innovationProduct Management. Lifecycles, customer input, innovation
Product Management. Lifecycles, customer input, innovation
 
Scrum x version 2
Scrum x version 2 Scrum x version 2
Scrum x version 2
 
Strategizing to build a perfect test environment
Strategizing to build a perfect test environmentStrategizing to build a perfect test environment
Strategizing to build a perfect test environment
 
Story of innovation by Ayan Chtterjee
Story of innovation by Ayan ChtterjeeStory of innovation by Ayan Chtterjee
Story of innovation by Ayan Chtterjee
 

Similar to product development checklist manifesto

The taste of innovation build-10 x-valuefactory-90days-master-program-brochure
The taste of innovation   build-10 x-valuefactory-90days-master-program-brochureThe taste of innovation   build-10 x-valuefactory-90days-master-program-brochure
The taste of innovation build-10 x-valuefactory-90days-master-program-brochureFlevum
 
North west center Non Profit Business Model
North west center Non Profit Business ModelNorth west center Non Profit Business Model
North west center Non Profit Business ModelPhilip Corsano
 
Imperial College Presentation - PJ v1.1
Imperial College Presentation - PJ v1.1Imperial College Presentation - PJ v1.1
Imperial College Presentation - PJ v1.1Dr Phil Jacobs
 
Aging2.0 melbourne elevating caregiving overview
Aging2.0 melbourne   elevating caregiving   overviewAging2.0 melbourne   elevating caregiving   overview
Aging2.0 melbourne elevating caregiving overviewStephen Johnston
 
NZ Health Congress 2013
NZ Health Congress 2013NZ Health Congress 2013
NZ Health Congress 2013Locus Research
 
Brand Tip Top Ice Cream Is Produced By The Great And Fresh...
Brand Tip Top Ice Cream Is Produced By The Great And Fresh...Brand Tip Top Ice Cream Is Produced By The Great And Fresh...
Brand Tip Top Ice Cream Is Produced By The Great And Fresh...Susan Cox
 
Lean on Agile: Getting the Best of Both Worlds
Lean on Agile: Getting the Best of Both WorldsLean on Agile: Getting the Best of Both Worlds
Lean on Agile: Getting the Best of Both WorldsSam McAfee
 
Agile Product Management - Co-Training with Angel Medinilla (c)
Agile Product Management - Co-Training with Angel Medinilla (c)Agile Product Management - Co-Training with Angel Medinilla (c)
Agile Product Management - Co-Training with Angel Medinilla (c)Andrea Darabos
 
Excel in Health: Proposition
Excel in Health: PropositionExcel in Health: Proposition
Excel in Health: PropositionInnovation Agency
 
Dynamo 21 open leads the way
Dynamo 21 open leads the wayDynamo 21 open leads the way
Dynamo 21 open leads the wayKatrina Novakovic
 
Agile Kaizen: Agile Product Management - Course Slides
Agile Kaizen: Agile Product Management - Course SlidesAgile Kaizen: Agile Product Management - Course Slides
Agile Kaizen: Agile Product Management - Course SlidesProyectalis / Improvement21
 
Nielsen Breakthrough Innovation Report 2015 - Robinsons Squash'd
Nielsen Breakthrough Innovation Report 2015 - Robinsons Squash'dNielsen Breakthrough Innovation Report 2015 - Robinsons Squash'd
Nielsen Breakthrough Innovation Report 2015 - Robinsons Squash'dOunal Bailey
 
Iterate. Calculate. Communicate.
Iterate. Calculate. Communicate.Iterate. Calculate. Communicate.
Iterate. Calculate. Communicate.Laure Parsons
 
Innovations in Global Health: Ten Ways to Add Value to Your Global Health Pro...
Innovations in Global Health: Ten Ways to Add Value to Your Global Health Pro...Innovations in Global Health: Ten Ways to Add Value to Your Global Health Pro...
Innovations in Global Health: Ten Ways to Add Value to Your Global Health Pro...Elvira Beracochea
 
Dr. elvira beracochea ten things every global health professional must know!
Dr. elvira beracochea   ten things every global health professional must know!Dr. elvira beracochea   ten things every global health professional must know!
Dr. elvira beracochea ten things every global health professional must know!Elvira Beracochea
 
ICH Guidelines Effective for Regulating Quality of Medicines?
ICH Guidelines Effective for Regulating Quality of Medicines?ICH Guidelines Effective for Regulating Quality of Medicines?
ICH Guidelines Effective for Regulating Quality of Medicines?Ajaz Hussain
 

Similar to product development checklist manifesto (20)

The taste of innovation build-10 x-valuefactory-90days-master-program-brochure
The taste of innovation   build-10 x-valuefactory-90days-master-program-brochureThe taste of innovation   build-10 x-valuefactory-90days-master-program-brochure
The taste of innovation build-10 x-valuefactory-90days-master-program-brochure
 
North west center Non Profit Business Model
North west center Non Profit Business ModelNorth west center Non Profit Business Model
North west center Non Profit Business Model
 
Imperial College Presentation - PJ v1.1
Imperial College Presentation - PJ v1.1Imperial College Presentation - PJ v1.1
Imperial College Presentation - PJ v1.1
 
Aging2.0 melbourne elevating caregiving overview
Aging2.0 melbourne   elevating caregiving   overviewAging2.0 melbourne   elevating caregiving   overview
Aging2.0 melbourne elevating caregiving overview
 
NZ Health Congress 2013
NZ Health Congress 2013NZ Health Congress 2013
NZ Health Congress 2013
 
Brand Tip Top Ice Cream Is Produced By The Great And Fresh...
Brand Tip Top Ice Cream Is Produced By The Great And Fresh...Brand Tip Top Ice Cream Is Produced By The Great And Fresh...
Brand Tip Top Ice Cream Is Produced By The Great And Fresh...
 
Modes of project resilience APM event 9th February 2016
Modes of project resilience APM event 9th February 2016Modes of project resilience APM event 9th February 2016
Modes of project resilience APM event 9th February 2016
 
Lean on Agile: Getting the Best of Both Worlds
Lean on Agile: Getting the Best of Both WorldsLean on Agile: Getting the Best of Both Worlds
Lean on Agile: Getting the Best of Both Worlds
 
Agile Product Management - Co-Training with Angel Medinilla (c)
Agile Product Management - Co-Training with Angel Medinilla (c)Agile Product Management - Co-Training with Angel Medinilla (c)
Agile Product Management - Co-Training with Angel Medinilla (c)
 
Excel in Health: Proposition
Excel in Health: PropositionExcel in Health: Proposition
Excel in Health: Proposition
 
Drivers of innovation
Drivers of innovationDrivers of innovation
Drivers of innovation
 
GoInnovate! Brochure
GoInnovate! BrochureGoInnovate! Brochure
GoInnovate! Brochure
 
Dynamo 21 open leads the way
Dynamo 21 open leads the wayDynamo 21 open leads the way
Dynamo 21 open leads the way
 
Agile Kaizen: Agile Product Management - Course Slides
Agile Kaizen: Agile Product Management - Course SlidesAgile Kaizen: Agile Product Management - Course Slides
Agile Kaizen: Agile Product Management - Course Slides
 
Nielsen Breakthrough Innovation Report 2015 - Robinsons Squash'd
Nielsen Breakthrough Innovation Report 2015 - Robinsons Squash'dNielsen Breakthrough Innovation Report 2015 - Robinsons Squash'd
Nielsen Breakthrough Innovation Report 2015 - Robinsons Squash'd
 
Iterate. Calculate. Communicate.
Iterate. Calculate. Communicate.Iterate. Calculate. Communicate.
Iterate. Calculate. Communicate.
 
BPM2014
BPM2014BPM2014
BPM2014
 
Innovations in Global Health: Ten Ways to Add Value to Your Global Health Pro...
Innovations in Global Health: Ten Ways to Add Value to Your Global Health Pro...Innovations in Global Health: Ten Ways to Add Value to Your Global Health Pro...
Innovations in Global Health: Ten Ways to Add Value to Your Global Health Pro...
 
Dr. elvira beracochea ten things every global health professional must know!
Dr. elvira beracochea   ten things every global health professional must know!Dr. elvira beracochea   ten things every global health professional must know!
Dr. elvira beracochea ten things every global health professional must know!
 
ICH Guidelines Effective for Regulating Quality of Medicines?
ICH Guidelines Effective for Regulating Quality of Medicines?ICH Guidelines Effective for Regulating Quality of Medicines?
ICH Guidelines Effective for Regulating Quality of Medicines?
 

product development checklist manifesto

  • 1. The Product Development Checklist Manifesto How To Get Features Right Jordan Berman VP Product, Contactually
  • 2. About the Presenter VP of Product at Contactually since April 2014 Leads x-fn team and develops the product vision, strategy, and roadmap Jordan Berman
  • 3. Atul Gawande, MD, MPH, is a surgeon, writer, and public health researcher. “[Gawande] is really interested in a problem that afflicts virtually every aspect of the modern world–and that is how professionals deal with the increasing complexity of their responsibilities.” — Malcolm Gladwell About the Author & Book
  • 4. Problems to-be-solved ☑ How do we improve quality of our output throughout the product development process, from conception through deployment? ☑ How do we create repeatable processes that are lightweight and help us scale our team? ☑ How do we get increase collaboration and coordination across roles on the team? circa July 2015
  • 6. Johns Hopkins’ Infection Checklist ☑ Wash hands with soap ☑ Clean the patient's skin w. chlorhexidine antiseptic ☑ Put sterile drapes over the entire patient ☑ Wear a mask, hat, sterile gown, and gloves before operating ☑ Put a sterile dressing over the insertion site once the line was in
  • 7. RESULTS Year 1: Hopkins' rate of infections went from 11% to zero. 
 
 Year 2: prevented 43 infections, 8 fatalities, and saved over $2m
  • 8. WHO Safe Surgery Checklist Surgery has four big killers: infection, bleeding, unsafe anesthesia, and “the unexpected.” Gawande concluded a standardized checklist could address the first three, and the fourth could only be surfaced by provoking a discussion about team member concerns. The first draft of the WHO Safe Surgery Checklist was piloted at eight hospitals of widely varying geography, wealth, and resources. A three month baseline review was conducted and complication rates varied from 6-21% of surgeries.
  • 9.
  • 10. RESULTS No new equipment or techniques were introduced during the experiment - surgical teams just added the checklist to their processes. By the end of the pilot program, major complications fell by 36% across the eight hospitals and deaths fell by 47%. In the sample of 4000 patients, 150 fewer experienced complications and 27 fewer died than without the checklist use.
  • 11. Apple New Product Process “[I]n the world according to Steve Jobs, the ANPP would rapidly evolve into a well-defined process for bringing new products to market by laying out in extreme detail every stage of product development. “Embodied in a program that runs on the company’s internal network, the ANPP resembled a giant checklist. It detailed exactly what everyone was to do at every stage for every product …” — Leander Kahney, “Jony Ive: The Genius Behind Apple's Greatest Products”
  • 14. ☑ Increase “Eptitude” Human endeavors fail for three reasons: 1. we attempt things beyond our ability; 2. we are ignorant of what we need to know to succeed; 3. we ineptly apply available knowledge. The explosion of knowledge in the last century has cut down on failure due to ignorance and shifted to failure from ineptitude. Our chief concern is now “eptitude—making sure we apply the knowledge we have consistently and correctly.”
  • 15. ☑ Diminish Complexity “The volume and complexity of what we know has exceeded our individual ability to deliver tis benefits correctly, safely, or reliably. Knowledge has both saved us and burdened us.”
  • 16. ☑ Impose Discipline “In complex environments, experts are up against two main difficulties. The first is the fallibility of human memory and attention, especially when it comes to mundane, routine matters that are easily overlooked under the strain of more pressing events. . . . People can lull themselves into skipping steps. . . . Checklists instill a kind of discipline of higher performance.” “Just ticking boxes is not the ultimate goal here. Embracing a culture of teamwork and discipline is.”
  • 17. ☑ Focus Attention Checklists “provide a cognitive net. They catch mental flaws . . . of memory and attention and thoroughness.”
  • 18. ☑ Aid Judgment Checklists are not designed to make us automatons and remove the need for craft or judgment. They produce judgment, aided and enhanced by procedure.
  • 19. ☑ Gain Efficiency Investors who added checklists to their process saw their returns improve and got efficiency gains: “The process was more thorough but faster.” They could evaluate more deals than before.
  • 20. ☑ Encourage Conversation Checklists are reviewed jointly by multiple members of the team at key “pause points” where multiple members of the team need to work together but may otherwise “hand off” work from one person to the other.
  • 22. Gawande looked to other disciplines, namely construction project management, aviation, and supply chain/logistics, to develop general principles for a good checklist. What he found in common: ☑ Forcing functions exist to provoke conversation between multidisciplinary teams, referred to as "pause points." ☑ These conversations, focused on what could go wrong, produce an "activation phenomenon." ☑ Interventions must be simple, measurable, and produce widely transmissible benefits (high ROI) ☑ Each item on the checklist must be precise, easy to complete, and essential to success. ☑ Measures must be taken to make the checklist use habitual. ☑ Behaviors that are already routine should be omitted. ☑ When possible checklists should be limited to 5-9 items (the limit of working memory)
  • 25. UAT, QA, Code Review
  • 27. ✓How to Roll Your Own
  • 28. ☑ Get team buy-in; persuade with data; treat it as an experiment ☑ Create & roll out one checklist at-a-time ☑ Focus on area of highest repeatability (code reviews?) - ingrains habits ☑ Review bug reports, error logs, and other sources of data for patterns ☑ Ask the team! ☑ Iterate, iterate, iterate