SlideShare a Scribd company logo
Double K: Kanban and Kata

The continuous improvement journey of two
IT teams using Kanban and the Toyota Kata

Bernadette Dario
Twitter: @BernadetteDario
bernadettedario@gmail.com
CSM
ACP

Bernadette
Dario
IT Group
SERVICE LINES

PROJECTS

220+
people

Project A
Project B

Project C

Agile/Kanban/Lean Coaches

Other Support Groups
Project C

PROJECT “CONNECT”
Challenges
Change Canvas

http://canvanizer.com/canvas/yrT8bQ39xW4
K for Kanban
RISKS, ISSUES, BLOCKERS
--- May 2012
--- July 2012
--- Sept 2012
--- Nov 2012
--- Dec 2012
Improvements
Observations

Improvement

Features stuck in
Requirements
Validation

Policy Change –
Developers can pull
even without “sign
off”

Same blocker on 3rd
party service provider
always comes up
(environment setup
and moving stuff
through the
environments)

New Policy
Established – Inform
service provider of
requests 2 weeks
before
Initiate – Root cause
analysis

Features stuck in
development for our
3rd party developer

New process - Setup
a cadence of biweekly
releases

Outcome

Improvement
in the flow of
work
Power-Up for Kaizen!
• Develop team’s capability to problem-solve
Power-Up for Kaizen!
• Utilize feedback loops as kaizen events
DAILY STANDUPS = mini
KAIZEN
• How can we improve the flow
of the work?
Bottlenecks
Issues/blockers
Recurring issues
Internal and External
Dependencies
– Stalled work
– Work in inactive states
– Vacant states
–
–
–
–

RETROSPECTIVES
Power-Up for Kaizen!
• Improvement as a work type
Power-Up for Kaizen!
• Recognize people who initiate improvements
Power-Up for Kaizen!
• Push ownership of the processes to the
team
Power-Up for Kaizen!
• Do not settle for workarounds. Dig deep
when necessary.
Results
•
•
•
•

Improvement in delivery
Better collaboration within the team
Enhanced relationship with Business
Team members who care about improving
Project Team Feedback
Kanban was very
effective for team
collaboration and
daily touch point
Kanban enabled
team to be
mindful of work
in progress

Issue resolution
was faster by
making issues
visible on the
Kanban board.
Team swarmed on
every issue!

Kanban allowed for
volume and flow of
work to be visible to
the Business
Business Feedback
Great, open
communication
between IT and
Business

Prioritization
with the
Business during
weekly stand
ups

Collaboration
within team
brought out
great ideas
Liked the visibility
and transparency
of work on
Kanban Board

Kanban allowed for
early identification of
issues/discuss
solutions and resolve
Challenges of Kanban
• Keeping electronic board synchronized with the
physical board
• Collecting metrics manually
• Keeping to WIP limits
K for Kata

KATA = “form”

Routine that is practiced so it becomes
second nature
K for Kata

Routines that enable continuous
improvement
Roles

Go!

2

3

1

COACH

2nd COACH

LEARNER

MANAGER

LEAN COACH

PROJECT TEAM
Improvement Kata
Coaching Kata
The Five Questions
Go!

1. What is the Target Condition?
2. What is the Actual Condition now?
- What was your last step?
- What did you expect?
- What actually happened?
- What did you learn?
3. What Obstacles do you think are preventing you
from reaching the target condition? Which one are
you addressing now?
4. What is your Next Step? What do you expect?
5. When can we go and see what we Have Learned
from taking that step?
Deliver the best
product possible;
Zero defects that
interfere with/disrupt
business operations
Improvement Focus: Quality
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%
Probing
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%

Incomplete test cases
Requirements not clear
to Testers
Testers not part of
collaboration sessions
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%

By involving the Testers
during requirements
walkthroughs, they will
be able to capture
critical scenarios in their
test cases resulting to
less defects escaped to
BAT/Prod.
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%

Inconsistent
participation by
testers during
requirements
walkthroughs
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%

By having the BAs go
through the test cases,
validation as to the
completeness of the
scenarios will be made
resulting to less defects
escaped to BAT/Prod.
Defect Density = .61
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%

MMF 4,5,9 Escaped
defect density – .61
Requirements %Dist –
50%
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%

It was a challenge for
BAs to go through the
test cases; not their
language
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%

By co-locating the team
and pairing BAs and
Testers during Testing,
more requirements
related defects will be
identified during
functional testing
resulting in less defects
escaped to BAT/Prod.
Defect Density = .1
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%

MMF6,10,3,7 Escaped
defect density - .1
Requirements %Dist - 0
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%

Co-location is a must!
Pairing during testing
works to ensure all
scenarios are tested!
Challenges of Kata
• Need more opportunities to practice the
desired behavior
• Inconsistent participation of managers as
Coaches
• Long PDCA cycles
IT Group
SERVICE LINES

PROJECTS

220+
people

Project A
Project B

Project C

Agile/Kanban/Lean Coaches

Other Support Groups
SERVICE LINE “WELLNESS”
Features

SLM
Service
Requests

Incidents

Prioritized
queue for
Service Line
(mixed work types)
K for Kanban
Classes of Service
--- July 2012
--- Aug 2012
--- Sept 2012
--- Dec 2012
--- March 2013
Results
• Improvement in customer satisfaction
Customer Satisfaction Survey
Oct 2012

Fair

Jan 2013

Good V.Good Excellent

Use of new techniques to bring about collaboration

2.4

Communicate progress of work on a timely basis

3.0
2.8

Openness/responsiveness to your requirements or to changes in
requirements

3.2
3.0

Deliver on time

3.2

Quality of output

3.0

Enable understanding of incremental delivery and Kanban
Team’s understanding of business needs
Leadership of Team

3.2

2.75
2.0

3.4

3.4
3.2

2.6
3.0

3.4
Net Promoter Score
How likely is it that you would recommend the team to deliver IT solutions
for a colleague?
1-20%

3-60%

Oct 2012: NPS = 20% - 20% = 0

1-20%
Net Promoter Score
How likely is it that you would recommend the team to deliver IT solutions
for a colleague?
1-20%

2-40%

Jan 2013: NPS = 40% - 20% = 20

2-40%
Results
• Improvement in customer satisfaction
• Fully engaged Business stakeholders
What worked well

Business

IT Team+Bus
working
very well
together

We are more
in tune with
Kanban
process now

Business willing to
adapt to changes
with the team and
support new ideas

Open
Communication

Good working
relationship
(professional,
friendly,
responsive)

IT Team

Working with
Business to
gather
requirements

Cooperation
between IT &
Business
Additional Challenges of Kanban
• Unstable team
• Getting Business to correctly classify work
according to cost of delay
Improvement Focus: Lead time
Improvement Focus: Quality (3rd party)
High performing team
capable of delivering
QUALITY and VALUE
to Business
3rd party Feature Lead
time Avg = 76 days
3rd party generated
high/serious escaped
defects > 0
Reduce Feature lead
time by 10%
3rd party generated
high/serious escaped
defects = 0
Requirements not clear
to testers
3rd party engagement
model not followed

People not 100%
allocated
By getting the
agreement from the
Business on the 3rd party
engagement model,
requirements will be
better understood by
the Testers and will
result to reduced lead
time & escaped defects
Business has agreed
to model
Business now going
through team
By having BDD
collaboration sessions,
a common
understanding of the
requirements will be
achieved and will result
to less requirements
churn/decrease in lead
time & escaped defects
Business was receptive
to BDDs during training
Improvement Focus: Lead time
Lead time = 39 days
3rd party generated
high/serious defects = 0
Gaining an
understanding of
req before passing
it on to 3rd party is
essential
BDDs helped in gaining
common understanding
of requirements
Key Points
Kanban is a framework that enables
continuous improvement. The deeper your
Kanban adoption, the more you can utilize
the system to bring about kaizen.
Supplementing Kanban with Kata (routines)
enables kaizen through data-driven
improvements executed via short
experimentation cycles.

More Related Content

What's hot

Lean Office
Lean OfficeLean Office
Lean Office
ZavalaJV
 
Why Chinese Manufacturers Must Adopt Lean Manufacturing to Stay Competitive
Why Chinese Manufacturers Must Adopt Lean Manufacturing to Stay CompetitiveWhy Chinese Manufacturers Must Adopt Lean Manufacturing to Stay Competitive
Why Chinese Manufacturers Must Adopt Lean Manufacturing to Stay Competitive
TXM Lean Solutions
 
Agile Metrics
Agile MetricsAgile Metrics
Agile Metrics
Erik Weber
 
Visual Mangement & Safety in the Workplace
Visual Mangement & Safety in the WorkplaceVisual Mangement & Safety in the Workplace
Visual Mangement & Safety in the WorkplaceRhonda Kovera
 
BenchmarkQA Services Overview
BenchmarkQA Services OverviewBenchmarkQA Services Overview
BenchmarkQA Services Overviewmattpagel
 
Engineering quality assurance manual
Engineering quality assurance manualEngineering quality assurance manual
Engineering quality assurance manual
simonhackett1
 
Suman Ip - AirMiles - How "Agile" Are We?
Suman Ip - AirMiles  - How "Agile" Are We?Suman Ip - AirMiles  - How "Agile" Are We?
Suman Ip - AirMiles - How "Agile" Are We?
Kanban Conferences
 
Scrum: Project Focus or Product Focus
Scrum: Project Focus or Product FocusScrum: Project Focus or Product Focus
Scrum: Project Focus or Product Focus
Scrum Australia Pty Ltd
 
5 s
5 s5 s
A3 Management: Effective Problem Solving via PDSA
A3 Management: Effective Problem Solving via PDSAA3 Management: Effective Problem Solving via PDSA
A3 Management: Effective Problem Solving via PDSA
TKMG, Inc.
 
Lean presentation amc
Lean presentation amcLean presentation amc
Lean presentation amc
Wafa AlAhmed
 
Commit to Becoming an Outstanding Organization
Commit to Becoming an Outstanding OrganizationCommit to Becoming an Outstanding Organization
Commit to Becoming an Outstanding Organization
TKMG, Inc.
 
Offshore development model in 10 steps sap yard
Offshore development model in 10 steps   sap yardOffshore development model in 10 steps   sap yard
Offshore development model in 10 steps sap yard
SAPYard
 
#2 PPT - Optimize Your Workflow using Visual Management
#2 PPT - Optimize Your Workflow using Visual Management#2 PPT - Optimize Your Workflow using Visual Management
#2 PPT - Optimize Your Workflow using Visual Management
Rhonda Kovera
 
Agile Metrics for Senior Managers and Executives
Agile Metrics for Senior Managers and ExecutivesAgile Metrics for Senior Managers and Executives
Agile Metrics for Senior Managers and Executives
VersionOne
 
[Process Day 2011] Alec Sharp – Making Process Real Engaging the CXOs Recurso
[Process Day 2011] Alec Sharp – Making Process Real Engaging the CXOs Recurso[Process Day 2011] Alec Sharp – Making Process Real Engaging the CXOs Recurso
[Process Day 2011] Alec Sharp – Making Process Real Engaging the CXOs Recurso
EloGroup
 
Adaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAdaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshare
Ananya Pani
 
Hourly Lean Introduction
Hourly Lean IntroductionHourly Lean Introduction
Hourly Lean Introduction
Harold Philbrick
 
#1 PPT - Improving Business Performance with Visual Management
#1 PPT - Improving Business Performance with Visual Management#1 PPT - Improving Business Performance with Visual Management
#1 PPT - Improving Business Performance with Visual Management
Rhonda Kovera
 
Lean Office by Operational Excellence Consulting
Lean Office by Operational Excellence ConsultingLean Office by Operational Excellence Consulting
Lean Office by Operational Excellence Consulting
Operational Excellence Consulting
 

What's hot (20)

Lean Office
Lean OfficeLean Office
Lean Office
 
Why Chinese Manufacturers Must Adopt Lean Manufacturing to Stay Competitive
Why Chinese Manufacturers Must Adopt Lean Manufacturing to Stay CompetitiveWhy Chinese Manufacturers Must Adopt Lean Manufacturing to Stay Competitive
Why Chinese Manufacturers Must Adopt Lean Manufacturing to Stay Competitive
 
Agile Metrics
Agile MetricsAgile Metrics
Agile Metrics
 
Visual Mangement & Safety in the Workplace
Visual Mangement & Safety in the WorkplaceVisual Mangement & Safety in the Workplace
Visual Mangement & Safety in the Workplace
 
BenchmarkQA Services Overview
BenchmarkQA Services OverviewBenchmarkQA Services Overview
BenchmarkQA Services Overview
 
Engineering quality assurance manual
Engineering quality assurance manualEngineering quality assurance manual
Engineering quality assurance manual
 
Suman Ip - AirMiles - How "Agile" Are We?
Suman Ip - AirMiles  - How "Agile" Are We?Suman Ip - AirMiles  - How "Agile" Are We?
Suman Ip - AirMiles - How "Agile" Are We?
 
Scrum: Project Focus or Product Focus
Scrum: Project Focus or Product FocusScrum: Project Focus or Product Focus
Scrum: Project Focus or Product Focus
 
5 s
5 s5 s
5 s
 
A3 Management: Effective Problem Solving via PDSA
A3 Management: Effective Problem Solving via PDSAA3 Management: Effective Problem Solving via PDSA
A3 Management: Effective Problem Solving via PDSA
 
Lean presentation amc
Lean presentation amcLean presentation amc
Lean presentation amc
 
Commit to Becoming an Outstanding Organization
Commit to Becoming an Outstanding OrganizationCommit to Becoming an Outstanding Organization
Commit to Becoming an Outstanding Organization
 
Offshore development model in 10 steps sap yard
Offshore development model in 10 steps   sap yardOffshore development model in 10 steps   sap yard
Offshore development model in 10 steps sap yard
 
#2 PPT - Optimize Your Workflow using Visual Management
#2 PPT - Optimize Your Workflow using Visual Management#2 PPT - Optimize Your Workflow using Visual Management
#2 PPT - Optimize Your Workflow using Visual Management
 
Agile Metrics for Senior Managers and Executives
Agile Metrics for Senior Managers and ExecutivesAgile Metrics for Senior Managers and Executives
Agile Metrics for Senior Managers and Executives
 
[Process Day 2011] Alec Sharp – Making Process Real Engaging the CXOs Recurso
[Process Day 2011] Alec Sharp – Making Process Real Engaging the CXOs Recurso[Process Day 2011] Alec Sharp – Making Process Real Engaging the CXOs Recurso
[Process Day 2011] Alec Sharp – Making Process Real Engaging the CXOs Recurso
 
Adaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAdaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshare
 
Hourly Lean Introduction
Hourly Lean IntroductionHourly Lean Introduction
Hourly Lean Introduction
 
#1 PPT - Improving Business Performance with Visual Management
#1 PPT - Improving Business Performance with Visual Management#1 PPT - Improving Business Performance with Visual Management
#1 PPT - Improving Business Performance with Visual Management
 
Lean Office by Operational Excellence Consulting
Lean Office by Operational Excellence ConsultingLean Office by Operational Excellence Consulting
Lean Office by Operational Excellence Consulting
 

Similar to Double K: Kanban and Kata

Case Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software DevelopmentCase Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software Development
CA Technologies
 
Case Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software DevelopmentCase Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software Development
CA Technologies
 
Isabel Evans - Working Ourselves out of a Job: A Passion For Improvement - Eu...
Isabel Evans - Working Ourselves out of a Job: A Passion For Improvement - Eu...Isabel Evans - Working Ourselves out of a Job: A Passion For Improvement - Eu...
Isabel Evans - Working Ourselves out of a Job: A Passion For Improvement - Eu...
TEST Huddle
 
Why Value Stream is key to Digital Product Delivery
Why Value Stream is key to Digital Product Delivery Why Value Stream is key to Digital Product Delivery
Why Value Stream is key to Digital Product Delivery
Mani Maun
 
From four to forty in four years - lessons from growing a team
From four to forty in four years - lessons from growing a teamFrom four to forty in four years - lessons from growing a team
From four to forty in four years - lessons from growing a team
Rich Allen
 
Agile ncr pramila hitachi consulting_future_coaching
Agile ncr pramila hitachi consulting_future_coachingAgile ncr pramila hitachi consulting_future_coaching
Agile ncr pramila hitachi consulting_future_coaching
AgileNCR2016
 
Radical Quality From Toyota to Tech
Radical Quality From Toyota to TechRadical Quality From Toyota to Tech
Radical Quality From Toyota to Tech
Flavian Hautbois
 
Lean Software Development Is for Everyone
Lean Software Development Is for EveryoneLean Software Development Is for Everyone
Lean Software Development Is for Everyone
TechWell
 
Baby Steps To Agility
Baby Steps To AgilityBaby Steps To Agility
Baby Steps To Agility
Naresh Jain
 
Deloitte lean agile state of the nation
Deloitte lean   agile state of the nationDeloitte lean   agile state of the nation
Deloitte lean agile state of the nationAlexis Hui
 
dev@InterConnect workshop - Lean and DevOps
dev@InterConnect workshop - Lean and DevOpsdev@InterConnect workshop - Lean and DevOps
dev@InterConnect workshop - Lean and DevOps
Sanjeev Sharma
 
Sanitized tb swstmppp1516july
Sanitized tb swstmppp1516julySanitized tb swstmppp1516july
Sanitized tb swstmppp1516july
Agile Testing alliance
 
Managing an Experimentation Platform by LinkedIn Product Leader
Managing an Experimentation Platform by LinkedIn Product LeaderManaging an Experimentation Platform by LinkedIn Product Leader
Managing an Experimentation Platform by LinkedIn Product Leader
Product School
 
End-to-End Quality Approach: 14 Levels of Testing
End-to-End Quality Approach: 14 Levels of TestingEnd-to-End Quality Approach: 14 Levels of Testing
End-to-End Quality Approach: 14 Levels of Testing
Josiah Renaudin
 
Implementing a Test Dashboard to Boost Quality
Implementing a Test Dashboard to Boost QualityImplementing a Test Dashboard to Boost Quality
Implementing a Test Dashboard to Boost Quality
TechWell
 
Accelerating Delivery of Value
Accelerating Delivery of ValueAccelerating Delivery of Value
Accelerating Delivery of Value
Ryan D. Hatch
 
Learn to see, measure and automate with value stream management
Learn to see, measure and automate with value stream managementLearn to see, measure and automate with value stream management
Learn to see, measure and automate with value stream management
Lance Knight
 
HeartofAgile_Presentation_v3
HeartofAgile_Presentation_v3HeartofAgile_Presentation_v3
HeartofAgile_Presentation_v3Armand Spoto
 
Popular Pitfalls In Sdlc Phases 1
Popular Pitfalls In Sdlc Phases 1Popular Pitfalls In Sdlc Phases 1
Popular Pitfalls In Sdlc Phases 1
Ramkumar Ramachandran
 

Similar to Double K: Kanban and Kata (20)

Case Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software DevelopmentCase Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software Development
 
Case Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software DevelopmentCase Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software Development
 
Isabel Evans - Working Ourselves out of a Job: A Passion For Improvement - Eu...
Isabel Evans - Working Ourselves out of a Job: A Passion For Improvement - Eu...Isabel Evans - Working Ourselves out of a Job: A Passion For Improvement - Eu...
Isabel Evans - Working Ourselves out of a Job: A Passion For Improvement - Eu...
 
Why Value Stream is key to Digital Product Delivery
Why Value Stream is key to Digital Product Delivery Why Value Stream is key to Digital Product Delivery
Why Value Stream is key to Digital Product Delivery
 
From four to forty in four years - lessons from growing a team
From four to forty in four years - lessons from growing a teamFrom four to forty in four years - lessons from growing a team
From four to forty in four years - lessons from growing a team
 
Agile ncr pramila hitachi consulting_future_coaching
Agile ncr pramila hitachi consulting_future_coachingAgile ncr pramila hitachi consulting_future_coaching
Agile ncr pramila hitachi consulting_future_coaching
 
Radical Quality From Toyota to Tech
Radical Quality From Toyota to TechRadical Quality From Toyota to Tech
Radical Quality From Toyota to Tech
 
Lean Software Development Is for Everyone
Lean Software Development Is for EveryoneLean Software Development Is for Everyone
Lean Software Development Is for Everyone
 
Baby Steps To Agility
Baby Steps To AgilityBaby Steps To Agility
Baby Steps To Agility
 
Deloitte lean agile state of the nation
Deloitte lean   agile state of the nationDeloitte lean   agile state of the nation
Deloitte lean agile state of the nation
 
dev@InterConnect workshop - Lean and DevOps
dev@InterConnect workshop - Lean and DevOpsdev@InterConnect workshop - Lean and DevOps
dev@InterConnect workshop - Lean and DevOps
 
Sanitized tb swstmppp1516july
Sanitized tb swstmppp1516julySanitized tb swstmppp1516july
Sanitized tb swstmppp1516july
 
Managing an Experimentation Platform by LinkedIn Product Leader
Managing an Experimentation Platform by LinkedIn Product LeaderManaging an Experimentation Platform by LinkedIn Product Leader
Managing an Experimentation Platform by LinkedIn Product Leader
 
cost of quality
cost of qualitycost of quality
cost of quality
 
End-to-End Quality Approach: 14 Levels of Testing
End-to-End Quality Approach: 14 Levels of TestingEnd-to-End Quality Approach: 14 Levels of Testing
End-to-End Quality Approach: 14 Levels of Testing
 
Implementing a Test Dashboard to Boost Quality
Implementing a Test Dashboard to Boost QualityImplementing a Test Dashboard to Boost Quality
Implementing a Test Dashboard to Boost Quality
 
Accelerating Delivery of Value
Accelerating Delivery of ValueAccelerating Delivery of Value
Accelerating Delivery of Value
 
Learn to see, measure and automate with value stream management
Learn to see, measure and automate with value stream managementLearn to see, measure and automate with value stream management
Learn to see, measure and automate with value stream management
 
HeartofAgile_Presentation_v3
HeartofAgile_Presentation_v3HeartofAgile_Presentation_v3
HeartofAgile_Presentation_v3
 
Popular Pitfalls In Sdlc Phases 1
Popular Pitfalls In Sdlc Phases 1Popular Pitfalls In Sdlc Phases 1
Popular Pitfalls In Sdlc Phases 1
 

Recently uploaded

UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
Dorra BARTAGUIZ
 
Enhancing Performance with Globus and the Science DMZ
Enhancing Performance with Globus and the Science DMZEnhancing Performance with Globus and the Science DMZ
Enhancing Performance with Globus and the Science DMZ
Globus
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
Ralf Eggert
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
Peter Spielvogel
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
UiPath Community Day Dubai: AI at Work..
UiPath Community Day Dubai: AI at Work..UiPath Community Day Dubai: AI at Work..
UiPath Community Day Dubai: AI at Work..
UiPathCommunity
 
Quantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIsQuantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIs
Vlad Stirbu
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
RinaMondal9
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
James Anderson
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Nexer Digital
 

Recently uploaded (20)

UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
 
Enhancing Performance with Globus and the Science DMZ
Enhancing Performance with Globus and the Science DMZEnhancing Performance with Globus and the Science DMZ
Enhancing Performance with Globus and the Science DMZ
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
UiPath Community Day Dubai: AI at Work..
UiPath Community Day Dubai: AI at Work..UiPath Community Day Dubai: AI at Work..
UiPath Community Day Dubai: AI at Work..
 
Quantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIsQuantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIs
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
 

Double K: Kanban and Kata

  • 1. Double K: Kanban and Kata The continuous improvement journey of two IT teams using Kanban and the Toyota Kata Bernadette Dario Twitter: @BernadetteDario bernadettedario@gmail.com
  • 3. IT Group SERVICE LINES PROJECTS 220+ people Project A Project B Project C Agile/Kanban/Lean Coaches Other Support Groups
  • 7. K for Kanban RISKS, ISSUES, BLOCKERS
  • 8. --- May 2012 --- July 2012 --- Sept 2012 --- Nov 2012 --- Dec 2012
  • 9. Improvements Observations Improvement Features stuck in Requirements Validation Policy Change – Developers can pull even without “sign off” Same blocker on 3rd party service provider always comes up (environment setup and moving stuff through the environments) New Policy Established – Inform service provider of requests 2 weeks before Initiate – Root cause analysis Features stuck in development for our 3rd party developer New process - Setup a cadence of biweekly releases Outcome Improvement in the flow of work
  • 10. Power-Up for Kaizen! • Develop team’s capability to problem-solve
  • 11. Power-Up for Kaizen! • Utilize feedback loops as kaizen events DAILY STANDUPS = mini KAIZEN • How can we improve the flow of the work? Bottlenecks Issues/blockers Recurring issues Internal and External Dependencies – Stalled work – Work in inactive states – Vacant states – – – – RETROSPECTIVES
  • 12. Power-Up for Kaizen! • Improvement as a work type
  • 13. Power-Up for Kaizen! • Recognize people who initiate improvements
  • 14. Power-Up for Kaizen! • Push ownership of the processes to the team
  • 15. Power-Up for Kaizen! • Do not settle for workarounds. Dig deep when necessary.
  • 16. Results • • • • Improvement in delivery Better collaboration within the team Enhanced relationship with Business Team members who care about improving
  • 17. Project Team Feedback Kanban was very effective for team collaboration and daily touch point Kanban enabled team to be mindful of work in progress Issue resolution was faster by making issues visible on the Kanban board. Team swarmed on every issue! Kanban allowed for volume and flow of work to be visible to the Business
  • 18. Business Feedback Great, open communication between IT and Business Prioritization with the Business during weekly stand ups Collaboration within team brought out great ideas Liked the visibility and transparency of work on Kanban Board Kanban allowed for early identification of issues/discuss solutions and resolve
  • 19. Challenges of Kanban • Keeping electronic board synchronized with the physical board • Collecting metrics manually • Keeping to WIP limits
  • 20. K for Kata KATA = “form” Routine that is practiced so it becomes second nature
  • 21. K for Kata Routines that enable continuous improvement
  • 24. Coaching Kata The Five Questions Go! 1. What is the Target Condition? 2. What is the Actual Condition now? - What was your last step? - What did you expect? - What actually happened? - What did you learn? 3. What Obstacles do you think are preventing you from reaching the target condition? Which one are you addressing now? 4. What is your Next Step? What do you expect? 5. When can we go and see what we Have Learned from taking that step?
  • 25.
  • 26. Deliver the best product possible; Zero defects that interfere with/disrupt business operations
  • 28.
  • 29. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63%
  • 30. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20%
  • 32. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20% Incomplete test cases Requirements not clear to Testers Testers not part of collaboration sessions
  • 33. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20%
  • 34. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20% By involving the Testers during requirements walkthroughs, they will be able to capture critical scenarios in their test cases resulting to less defects escaped to BAT/Prod.
  • 35. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20% Inconsistent participation by testers during requirements walkthroughs
  • 36. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20% By having the BAs go through the test cases, validation as to the completeness of the scenarios will be made resulting to less defects escaped to BAT/Prod.
  • 38. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20% MMF 4,5,9 Escaped defect density – .61 Requirements %Dist – 50%
  • 39. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20% It was a challenge for BAs to go through the test cases; not their language
  • 40. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20% By co-locating the team and pairing BAs and Testers during Testing, more requirements related defects will be identified during functional testing resulting in less defects escaped to BAT/Prod.
  • 42. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20% MMF6,10,3,7 Escaped defect density - .1 Requirements %Dist - 0
  • 43. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20% Co-location is a must! Pairing during testing works to ensure all scenarios are tested!
  • 44.
  • 45. Challenges of Kata • Need more opportunities to practice the desired behavior • Inconsistent participation of managers as Coaches • Long PDCA cycles
  • 46. IT Group SERVICE LINES PROJECTS 220+ people Project A Project B Project C Agile/Kanban/Lean Coaches Other Support Groups
  • 51. --- July 2012 --- Aug 2012 --- Sept 2012 --- Dec 2012 --- March 2013
  • 52. Results • Improvement in customer satisfaction
  • 53. Customer Satisfaction Survey Oct 2012 Fair Jan 2013 Good V.Good Excellent Use of new techniques to bring about collaboration 2.4 Communicate progress of work on a timely basis 3.0 2.8 Openness/responsiveness to your requirements or to changes in requirements 3.2 3.0 Deliver on time 3.2 Quality of output 3.0 Enable understanding of incremental delivery and Kanban Team’s understanding of business needs Leadership of Team 3.2 2.75 2.0 3.4 3.4 3.2 2.6 3.0 3.4
  • 54. Net Promoter Score How likely is it that you would recommend the team to deliver IT solutions for a colleague? 1-20% 3-60% Oct 2012: NPS = 20% - 20% = 0 1-20%
  • 55. Net Promoter Score How likely is it that you would recommend the team to deliver IT solutions for a colleague? 1-20% 2-40% Jan 2013: NPS = 40% - 20% = 20 2-40%
  • 56. Results • Improvement in customer satisfaction • Fully engaged Business stakeholders
  • 57. What worked well Business IT Team+Bus working very well together We are more in tune with Kanban process now Business willing to adapt to changes with the team and support new ideas Open Communication Good working relationship (professional, friendly, responsive) IT Team Working with Business to gather requirements Cooperation between IT & Business
  • 58. Additional Challenges of Kanban • Unstable team • Getting Business to correctly classify work according to cost of delay
  • 61. High performing team capable of delivering QUALITY and VALUE to Business
  • 62. 3rd party Feature Lead time Avg = 76 days 3rd party generated high/serious escaped defects > 0
  • 63. Reduce Feature lead time by 10% 3rd party generated high/serious escaped defects = 0
  • 64. Requirements not clear to testers 3rd party engagement model not followed People not 100% allocated
  • 65.
  • 66. By getting the agreement from the Business on the 3rd party engagement model, requirements will be better understood by the Testers and will result to reduced lead time & escaped defects
  • 67. Business has agreed to model Business now going through team
  • 68.
  • 69. By having BDD collaboration sessions, a common understanding of the requirements will be achieved and will result to less requirements churn/decrease in lead time & escaped defects
  • 70. Business was receptive to BDDs during training
  • 72.
  • 73. Lead time = 39 days 3rd party generated high/serious defects = 0
  • 74. Gaining an understanding of req before passing it on to 3rd party is essential
  • 75. BDDs helped in gaining common understanding of requirements
  • 76. Key Points Kanban is a framework that enables continuous improvement. The deeper your Kanban adoption, the more you can utilize the system to bring about kaizen. Supplementing Kanban with Kata (routines) enables kaizen through data-driven improvements executed via short experimentation cycles.

Editor's Notes

  1. Insights:On the average, it took the team 45 days to deliver each feature +/- 6 days (average mR) A lot of outliers, range between max and min is huge Reasons discussed by the team as to why lead time is long: Requirements not clear to the testers; People are not 100% allocated; A lot of waiting time for 3rd party to complete work (they submit in big batches); Business keeps on changing requirements; 3rd party engagement model not followed – business goes straight to 3rd party bypassing internal team