SlideShare a Scribd company logo
1 of 76
Download to read offline
Double K: Kanban and Kata

The continuous improvement journey of two
IT teams using Kanban and the Toyota Kata

Bernadette Dario
Twitter: @BernadetteDario
bernadettedario@gmail.com
CSM
ACP

Bernadette
Dario
IT Group
SERVICE LINES

PROJECTS

220+
people

Project A
Project B

Project C

Agile/Kanban/Lean Coaches

Other Support Groups
Project C

PROJECT “CONNECT”
Challenges
Change Canvas

http://canvanizer.com/canvas/yrT8bQ39xW4
K for Kanban
RISKS, ISSUES, BLOCKERS
--- May 2012
--- July 2012
--- Sept 2012
--- Nov 2012
--- Dec 2012
Improvements
Observations

Improvement

Features stuck in
Requirements
Validation

Policy Change –
Developers can pull
even without “sign
off”

Same blocker on 3rd
party service provider
always comes up
(environment setup
and moving stuff
through the
environments)

New Policy
Established – Inform
service provider of
requests 2 weeks
before
Initiate – Root cause
analysis

Features stuck in
development for our
3rd party developer

New process - Setup
a cadence of biweekly
releases

Outcome

Improvement
in the flow of
work
Power-Up for Kaizen!
• Develop team’s capability to problem-solve
Power-Up for Kaizen!
• Utilize feedback loops as kaizen events
DAILY STANDUPS = mini
KAIZEN
• How can we improve the flow
of the work?
Bottlenecks
Issues/blockers
Recurring issues
Internal and External
Dependencies
– Stalled work
– Work in inactive states
– Vacant states
–
–
–
–

RETROSPECTIVES
Power-Up for Kaizen!
• Improvement as a work type
Power-Up for Kaizen!
• Recognize people who initiate improvements
Power-Up for Kaizen!
• Push ownership of the processes to the
team
Power-Up for Kaizen!
• Do not settle for workarounds. Dig deep
when necessary.
Results
•
•
•
•

Improvement in delivery
Better collaboration within the team
Enhanced relationship with Business
Team members who care about improving
Project Team Feedback
Kanban was very
effective for team
collaboration and
daily touch point
Kanban enabled
team to be
mindful of work
in progress

Issue resolution
was faster by
making issues
visible on the
Kanban board.
Team swarmed on
every issue!

Kanban allowed for
volume and flow of
work to be visible to
the Business
Business Feedback
Great, open
communication
between IT and
Business

Prioritization
with the
Business during
weekly stand
ups

Collaboration
within team
brought out
great ideas
Liked the visibility
and transparency
of work on
Kanban Board

Kanban allowed for
early identification of
issues/discuss
solutions and resolve
Challenges of Kanban
• Keeping electronic board synchronized with the
physical board
• Collecting metrics manually
• Keeping to WIP limits
K for Kata

KATA = “form”

Routine that is practiced so it becomes
second nature
K for Kata

Routines that enable continuous
improvement
Roles

Go!

2

3

1

COACH

2nd COACH

LEARNER

MANAGER

LEAN COACH

PROJECT TEAM
Improvement Kata
Coaching Kata
The Five Questions
Go!

1. What is the Target Condition?
2. What is the Actual Condition now?
- What was your last step?
- What did you expect?
- What actually happened?
- What did you learn?
3. What Obstacles do you think are preventing you
from reaching the target condition? Which one are
you addressing now?
4. What is your Next Step? What do you expect?
5. When can we go and see what we Have Learned
from taking that step?
Deliver the best
product possible;
Zero defects that
interfere with/disrupt
business operations
Improvement Focus: Quality
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%
Probing
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%

Incomplete test cases
Requirements not clear
to Testers
Testers not part of
collaboration sessions
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%

By involving the Testers
during requirements
walkthroughs, they will
be able to capture
critical scenarios in their
test cases resulting to
less defects escaped to
BAT/Prod.
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%

Inconsistent
participation by
testers during
requirements
walkthroughs
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%

By having the BAs go
through the test cases,
validation as to the
completeness of the
scenarios will be made
resulting to less defects
escaped to BAT/Prod.
Defect Density = .61
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%

MMF 4,5,9 Escaped
defect density – .61
Requirements %Dist –
50%
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%

It was a challenge for
BAs to go through the
test cases; not their
language
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%

By co-locating the team
and pairing BAs and
Testers during Testing,
more requirements
related defects will be
identified during
functional testing
resulting in less defects
escaped to BAT/Prod.
Defect Density = .1
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%

MMF6,10,3,7 Escaped
defect density - .1
Requirements %Dist - 0
Deliver the best
product possible;
Zero defects that
interfere
with/disrupt
business
operations

Escaped Defect
Density – .50
Requirements %
Dist – 63%

Escaped Defect
Density – decrease
by 20%
Requirements %
Dist – decrease by
20%

Co-location is a must!
Pairing during testing
works to ensure all
scenarios are tested!
Challenges of Kata
• Need more opportunities to practice the
desired behavior
• Inconsistent participation of managers as
Coaches
• Long PDCA cycles
IT Group
SERVICE LINES

PROJECTS

220+
people

Project A
Project B

Project C

Agile/Kanban/Lean Coaches

Other Support Groups
SERVICE LINE “WELLNESS”
Features

SLM
Service
Requests

Incidents

Prioritized
queue for
Service Line
(mixed work types)
K for Kanban
Classes of Service
--- July 2012
--- Aug 2012
--- Sept 2012
--- Dec 2012
--- March 2013
Results
• Improvement in customer satisfaction
Customer Satisfaction Survey
Oct 2012

Fair

Jan 2013

Good V.Good Excellent

Use of new techniques to bring about collaboration

2.4

Communicate progress of work on a timely basis

3.0
2.8

Openness/responsiveness to your requirements or to changes in
requirements

3.2
3.0

Deliver on time

3.2

Quality of output

3.0

Enable understanding of incremental delivery and Kanban
Team’s understanding of business needs
Leadership of Team

3.2

2.75
2.0

3.4

3.4
3.2

2.6
3.0

3.4
Net Promoter Score
How likely is it that you would recommend the team to deliver IT solutions
for a colleague?
1-20%

3-60%

Oct 2012: NPS = 20% - 20% = 0

1-20%
Net Promoter Score
How likely is it that you would recommend the team to deliver IT solutions
for a colleague?
1-20%

2-40%

Jan 2013: NPS = 40% - 20% = 20

2-40%
Results
• Improvement in customer satisfaction
• Fully engaged Business stakeholders
What worked well

Business

IT Team+Bus
working
very well
together

We are more
in tune with
Kanban
process now

Business willing to
adapt to changes
with the team and
support new ideas

Open
Communication

Good working
relationship
(professional,
friendly,
responsive)

IT Team

Working with
Business to
gather
requirements

Cooperation
between IT &
Business
Additional Challenges of Kanban
• Unstable team
• Getting Business to correctly classify work
according to cost of delay
Improvement Focus: Lead time
Improvement Focus: Quality (3rd party)
High performing team
capable of delivering
QUALITY and VALUE
to Business
3rd party Feature Lead
time Avg = 76 days
3rd party generated
high/serious escaped
defects > 0
Reduce Feature lead
time by 10%
3rd party generated
high/serious escaped
defects = 0
Requirements not clear
to testers
3rd party engagement
model not followed

People not 100%
allocated
By getting the
agreement from the
Business on the 3rd party
engagement model,
requirements will be
better understood by
the Testers and will
result to reduced lead
time & escaped defects
Business has agreed
to model
Business now going
through team
By having BDD
collaboration sessions,
a common
understanding of the
requirements will be
achieved and will result
to less requirements
churn/decrease in lead
time & escaped defects
Business was receptive
to BDDs during training
Improvement Focus: Lead time
Lead time = 39 days
3rd party generated
high/serious defects = 0
Gaining an
understanding of
req before passing
it on to 3rd party is
essential
BDDs helped in gaining
common understanding
of requirements
Key Points
Kanban is a framework that enables
continuous improvement. The deeper your
Kanban adoption, the more you can utilize
the system to bring about kaizen.
Supplementing Kanban with Kata (routines)
enables kaizen through data-driven
improvements executed via short
experimentation cycles.

More Related Content

What's hot

Visual Mangement & Safety in the Workplace
Visual Mangement & Safety in the WorkplaceVisual Mangement & Safety in the Workplace
Visual Mangement & Safety in the Workplace
Rhonda Kovera
 
BenchmarkQA Services Overview
BenchmarkQA Services OverviewBenchmarkQA Services Overview
BenchmarkQA Services Overview
mattpagel
 
Scrum: Project Focus or Product Focus
Scrum: Project Focus or Product FocusScrum: Project Focus or Product Focus
Scrum: Project Focus or Product Focus
Scrum Australia Pty Ltd
 
[Process Day 2011] Alec Sharp – Making Process Real Engaging the CXOs Recurso
[Process Day 2011] Alec Sharp – Making Process Real Engaging the CXOs Recurso[Process Day 2011] Alec Sharp – Making Process Real Engaging the CXOs Recurso
[Process Day 2011] Alec Sharp – Making Process Real Engaging the CXOs Recurso
EloGroup
 

What's hot (20)

Lean Office
Lean OfficeLean Office
Lean Office
 
Why Chinese Manufacturers Must Adopt Lean Manufacturing to Stay Competitive
Why Chinese Manufacturers Must Adopt Lean Manufacturing to Stay CompetitiveWhy Chinese Manufacturers Must Adopt Lean Manufacturing to Stay Competitive
Why Chinese Manufacturers Must Adopt Lean Manufacturing to Stay Competitive
 
Agile Metrics
Agile MetricsAgile Metrics
Agile Metrics
 
Visual Mangement & Safety in the Workplace
Visual Mangement & Safety in the WorkplaceVisual Mangement & Safety in the Workplace
Visual Mangement & Safety in the Workplace
 
BenchmarkQA Services Overview
BenchmarkQA Services OverviewBenchmarkQA Services Overview
BenchmarkQA Services Overview
 
Engineering quality assurance manual
Engineering quality assurance manualEngineering quality assurance manual
Engineering quality assurance manual
 
Suman Ip - AirMiles - How "Agile" Are We?
Suman Ip - AirMiles  - How "Agile" Are We?Suman Ip - AirMiles  - How "Agile" Are We?
Suman Ip - AirMiles - How "Agile" Are We?
 
Scrum: Project Focus or Product Focus
Scrum: Project Focus or Product FocusScrum: Project Focus or Product Focus
Scrum: Project Focus or Product Focus
 
5 s
5 s5 s
5 s
 
A3 Management: Effective Problem Solving via PDSA
A3 Management: Effective Problem Solving via PDSAA3 Management: Effective Problem Solving via PDSA
A3 Management: Effective Problem Solving via PDSA
 
Lean presentation amc
Lean presentation amcLean presentation amc
Lean presentation amc
 
Commit to Becoming an Outstanding Organization
Commit to Becoming an Outstanding OrganizationCommit to Becoming an Outstanding Organization
Commit to Becoming an Outstanding Organization
 
Offshore development model in 10 steps sap yard
Offshore development model in 10 steps   sap yardOffshore development model in 10 steps   sap yard
Offshore development model in 10 steps sap yard
 
#2 PPT - Optimize Your Workflow using Visual Management
#2 PPT - Optimize Your Workflow using Visual Management#2 PPT - Optimize Your Workflow using Visual Management
#2 PPT - Optimize Your Workflow using Visual Management
 
Agile Metrics for Senior Managers and Executives
Agile Metrics for Senior Managers and ExecutivesAgile Metrics for Senior Managers and Executives
Agile Metrics for Senior Managers and Executives
 
[Process Day 2011] Alec Sharp – Making Process Real Engaging the CXOs Recurso
[Process Day 2011] Alec Sharp – Making Process Real Engaging the CXOs Recurso[Process Day 2011] Alec Sharp – Making Process Real Engaging the CXOs Recurso
[Process Day 2011] Alec Sharp – Making Process Real Engaging the CXOs Recurso
 
Adaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAdaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshare
 
Hourly Lean Introduction
Hourly Lean IntroductionHourly Lean Introduction
Hourly Lean Introduction
 
#1 PPT - Improving Business Performance with Visual Management
#1 PPT - Improving Business Performance with Visual Management#1 PPT - Improving Business Performance with Visual Management
#1 PPT - Improving Business Performance with Visual Management
 
Lean Office by Operational Excellence Consulting
Lean Office by Operational Excellence ConsultingLean Office by Operational Excellence Consulting
Lean Office by Operational Excellence Consulting
 

Similar to Double K: Kanban and Kata

Deloitte lean agile state of the nation
Deloitte lean   agile state of the nationDeloitte lean   agile state of the nation
Deloitte lean agile state of the nation
Alexis Hui
 
HeartofAgile_Presentation_v3
HeartofAgile_Presentation_v3HeartofAgile_Presentation_v3
HeartofAgile_Presentation_v3
Armand Spoto
 

Similar to Double K: Kanban and Kata (20)

Case Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software DevelopmentCase Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software Development
 
Case Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software DevelopmentCase Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software Development
 
Isabel Evans - Working Ourselves out of a Job: A Passion For Improvement - Eu...
Isabel Evans - Working Ourselves out of a Job: A Passion For Improvement - Eu...Isabel Evans - Working Ourselves out of a Job: A Passion For Improvement - Eu...
Isabel Evans - Working Ourselves out of a Job: A Passion For Improvement - Eu...
 
Why Value Stream is key to Digital Product Delivery
Why Value Stream is key to Digital Product Delivery Why Value Stream is key to Digital Product Delivery
Why Value Stream is key to Digital Product Delivery
 
From four to forty in four years - lessons from growing a team
From four to forty in four years - lessons from growing a teamFrom four to forty in four years - lessons from growing a team
From four to forty in four years - lessons from growing a team
 
Agile ncr pramila hitachi consulting_future_coaching
Agile ncr pramila hitachi consulting_future_coachingAgile ncr pramila hitachi consulting_future_coaching
Agile ncr pramila hitachi consulting_future_coaching
 
Radical Quality From Toyota to Tech
Radical Quality From Toyota to TechRadical Quality From Toyota to Tech
Radical Quality From Toyota to Tech
 
Lean Software Development Is for Everyone
Lean Software Development Is for EveryoneLean Software Development Is for Everyone
Lean Software Development Is for Everyone
 
Baby Steps To Agility
Baby Steps To AgilityBaby Steps To Agility
Baby Steps To Agility
 
Deloitte lean agile state of the nation
Deloitte lean   agile state of the nationDeloitte lean   agile state of the nation
Deloitte lean agile state of the nation
 
dev@InterConnect workshop - Lean and DevOps
dev@InterConnect workshop - Lean and DevOpsdev@InterConnect workshop - Lean and DevOps
dev@InterConnect workshop - Lean and DevOps
 
Sanitized tb swstmppp1516july
Sanitized tb swstmppp1516julySanitized tb swstmppp1516july
Sanitized tb swstmppp1516july
 
Managing an Experimentation Platform by LinkedIn Product Leader
Managing an Experimentation Platform by LinkedIn Product LeaderManaging an Experimentation Platform by LinkedIn Product Leader
Managing an Experimentation Platform by LinkedIn Product Leader
 
cost of quality
cost of qualitycost of quality
cost of quality
 
End-to-End Quality Approach: 14 Levels of Testing
End-to-End Quality Approach: 14 Levels of TestingEnd-to-End Quality Approach: 14 Levels of Testing
End-to-End Quality Approach: 14 Levels of Testing
 
Implementing a Test Dashboard to Boost Quality
Implementing a Test Dashboard to Boost QualityImplementing a Test Dashboard to Boost Quality
Implementing a Test Dashboard to Boost Quality
 
Accelerating Delivery of Value
Accelerating Delivery of ValueAccelerating Delivery of Value
Accelerating Delivery of Value
 
Learn to see, measure and automate with value stream management
Learn to see, measure and automate with value stream managementLearn to see, measure and automate with value stream management
Learn to see, measure and automate with value stream management
 
HeartofAgile_Presentation_v3
HeartofAgile_Presentation_v3HeartofAgile_Presentation_v3
HeartofAgile_Presentation_v3
 
Popular Pitfalls In Sdlc Phases 1
Popular Pitfalls In Sdlc Phases 1Popular Pitfalls In Sdlc Phases 1
Popular Pitfalls In Sdlc Phases 1
 

Recently uploaded

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 

Recently uploaded (20)

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 

Double K: Kanban and Kata

  • 1. Double K: Kanban and Kata The continuous improvement journey of two IT teams using Kanban and the Toyota Kata Bernadette Dario Twitter: @BernadetteDario bernadettedario@gmail.com
  • 3. IT Group SERVICE LINES PROJECTS 220+ people Project A Project B Project C Agile/Kanban/Lean Coaches Other Support Groups
  • 7. K for Kanban RISKS, ISSUES, BLOCKERS
  • 8. --- May 2012 --- July 2012 --- Sept 2012 --- Nov 2012 --- Dec 2012
  • 9. Improvements Observations Improvement Features stuck in Requirements Validation Policy Change – Developers can pull even without “sign off” Same blocker on 3rd party service provider always comes up (environment setup and moving stuff through the environments) New Policy Established – Inform service provider of requests 2 weeks before Initiate – Root cause analysis Features stuck in development for our 3rd party developer New process - Setup a cadence of biweekly releases Outcome Improvement in the flow of work
  • 10. Power-Up for Kaizen! • Develop team’s capability to problem-solve
  • 11. Power-Up for Kaizen! • Utilize feedback loops as kaizen events DAILY STANDUPS = mini KAIZEN • How can we improve the flow of the work? Bottlenecks Issues/blockers Recurring issues Internal and External Dependencies – Stalled work – Work in inactive states – Vacant states – – – – RETROSPECTIVES
  • 12. Power-Up for Kaizen! • Improvement as a work type
  • 13. Power-Up for Kaizen! • Recognize people who initiate improvements
  • 14. Power-Up for Kaizen! • Push ownership of the processes to the team
  • 15. Power-Up for Kaizen! • Do not settle for workarounds. Dig deep when necessary.
  • 16. Results • • • • Improvement in delivery Better collaboration within the team Enhanced relationship with Business Team members who care about improving
  • 17. Project Team Feedback Kanban was very effective for team collaboration and daily touch point Kanban enabled team to be mindful of work in progress Issue resolution was faster by making issues visible on the Kanban board. Team swarmed on every issue! Kanban allowed for volume and flow of work to be visible to the Business
  • 18. Business Feedback Great, open communication between IT and Business Prioritization with the Business during weekly stand ups Collaboration within team brought out great ideas Liked the visibility and transparency of work on Kanban Board Kanban allowed for early identification of issues/discuss solutions and resolve
  • 19. Challenges of Kanban • Keeping electronic board synchronized with the physical board • Collecting metrics manually • Keeping to WIP limits
  • 20. K for Kata KATA = “form” Routine that is practiced so it becomes second nature
  • 21. K for Kata Routines that enable continuous improvement
  • 24. Coaching Kata The Five Questions Go! 1. What is the Target Condition? 2. What is the Actual Condition now? - What was your last step? - What did you expect? - What actually happened? - What did you learn? 3. What Obstacles do you think are preventing you from reaching the target condition? Which one are you addressing now? 4. What is your Next Step? What do you expect? 5. When can we go and see what we Have Learned from taking that step?
  • 25.
  • 26. Deliver the best product possible; Zero defects that interfere with/disrupt business operations
  • 28.
  • 29. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63%
  • 30. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20%
  • 32. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20% Incomplete test cases Requirements not clear to Testers Testers not part of collaboration sessions
  • 33. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20%
  • 34. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20% By involving the Testers during requirements walkthroughs, they will be able to capture critical scenarios in their test cases resulting to less defects escaped to BAT/Prod.
  • 35. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20% Inconsistent participation by testers during requirements walkthroughs
  • 36. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20% By having the BAs go through the test cases, validation as to the completeness of the scenarios will be made resulting to less defects escaped to BAT/Prod.
  • 38. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20% MMF 4,5,9 Escaped defect density – .61 Requirements %Dist – 50%
  • 39. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20% It was a challenge for BAs to go through the test cases; not their language
  • 40. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20% By co-locating the team and pairing BAs and Testers during Testing, more requirements related defects will be identified during functional testing resulting in less defects escaped to BAT/Prod.
  • 42. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20% MMF6,10,3,7 Escaped defect density - .1 Requirements %Dist - 0
  • 43. Deliver the best product possible; Zero defects that interfere with/disrupt business operations Escaped Defect Density – .50 Requirements % Dist – 63% Escaped Defect Density – decrease by 20% Requirements % Dist – decrease by 20% Co-location is a must! Pairing during testing works to ensure all scenarios are tested!
  • 44.
  • 45. Challenges of Kata • Need more opportunities to practice the desired behavior • Inconsistent participation of managers as Coaches • Long PDCA cycles
  • 46. IT Group SERVICE LINES PROJECTS 220+ people Project A Project B Project C Agile/Kanban/Lean Coaches Other Support Groups
  • 51. --- July 2012 --- Aug 2012 --- Sept 2012 --- Dec 2012 --- March 2013
  • 52. Results • Improvement in customer satisfaction
  • 53. Customer Satisfaction Survey Oct 2012 Fair Jan 2013 Good V.Good Excellent Use of new techniques to bring about collaboration 2.4 Communicate progress of work on a timely basis 3.0 2.8 Openness/responsiveness to your requirements or to changes in requirements 3.2 3.0 Deliver on time 3.2 Quality of output 3.0 Enable understanding of incremental delivery and Kanban Team’s understanding of business needs Leadership of Team 3.2 2.75 2.0 3.4 3.4 3.2 2.6 3.0 3.4
  • 54. Net Promoter Score How likely is it that you would recommend the team to deliver IT solutions for a colleague? 1-20% 3-60% Oct 2012: NPS = 20% - 20% = 0 1-20%
  • 55. Net Promoter Score How likely is it that you would recommend the team to deliver IT solutions for a colleague? 1-20% 2-40% Jan 2013: NPS = 40% - 20% = 20 2-40%
  • 56. Results • Improvement in customer satisfaction • Fully engaged Business stakeholders
  • 57. What worked well Business IT Team+Bus working very well together We are more in tune with Kanban process now Business willing to adapt to changes with the team and support new ideas Open Communication Good working relationship (professional, friendly, responsive) IT Team Working with Business to gather requirements Cooperation between IT & Business
  • 58. Additional Challenges of Kanban • Unstable team • Getting Business to correctly classify work according to cost of delay
  • 61. High performing team capable of delivering QUALITY and VALUE to Business
  • 62. 3rd party Feature Lead time Avg = 76 days 3rd party generated high/serious escaped defects > 0
  • 63. Reduce Feature lead time by 10% 3rd party generated high/serious escaped defects = 0
  • 64. Requirements not clear to testers 3rd party engagement model not followed People not 100% allocated
  • 65.
  • 66. By getting the agreement from the Business on the 3rd party engagement model, requirements will be better understood by the Testers and will result to reduced lead time & escaped defects
  • 67. Business has agreed to model Business now going through team
  • 68.
  • 69. By having BDD collaboration sessions, a common understanding of the requirements will be achieved and will result to less requirements churn/decrease in lead time & escaped defects
  • 70. Business was receptive to BDDs during training
  • 72.
  • 73. Lead time = 39 days 3rd party generated high/serious defects = 0
  • 74. Gaining an understanding of req before passing it on to 3rd party is essential
  • 75. BDDs helped in gaining common understanding of requirements
  • 76. Key Points Kanban is a framework that enables continuous improvement. The deeper your Kanban adoption, the more you can utilize the system to bring about kaizen. Supplementing Kanban with Kata (routines) enables kaizen through data-driven improvements executed via short experimentation cycles.

Editor's Notes

  1. Insights:On the average, it took the team 45 days to deliver each feature +/- 6 days (average mR) A lot of outliers, range between max and min is huge Reasons discussed by the team as to why lead time is long: Requirements not clear to the testers; People are not 100% allocated; A lot of waiting time for 3rd party to complete work (they submit in big batches); Business keeps on changing requirements; 3rd party engagement model not followed – business goes straight to 3rd party bypassing internal team