SlideShare a Scribd company logo
HOW TO INTRODUCE
CONTINUOUS DELIVERY?
      Alexander Schwartz
  Nokia Location & Commerce
Which delivery style you have?
          “Big ship”                             “Kaiten Sushi”




www.flickr.com/photos/burtonandy/4702810536/   www.flickr.com/photos/mc_masterchef/178245348/




                          How to do the transition?
What
helps?
4 Stories:
     What helps? What not?


Story #1   Story #2   Story #3   Story #4



     context #1           context #2
       NOKIA            another company
Context: Nokia L&C Places

Story #1   RESTful services to show Place
           information on maps
           applications.
Story #1: The Initial Challenges

                           •complicated
                               dependencies
                           •integration problems
                           •production bugs
                           •big bang releases




Approach: Ask for smart people for help.

  -> Delivery Pipelines
  -> CDCs (Consumer Driven Contracts)
From Services Dependencies to Pipelines
                                                       City Pages
                                                        <<webapp>>


                 Places
                Registry                               Maps app for
                 <<REST>>
                                                        Windows 7
                                                        <<device app>>
Account
Service         Search
                                        Places
<<REST>>        <<REST>>
                                       Backend           Maps Web
                                                          <<webapp>>
                                         API
           Recommendations
               <<REST>>
                                                       PBAPI client
                                                           API
                                                        <<client API>>




             Upstream                               Downstream

                             Build Pipeline Order
The Result After 1 Year
                               Dev                         QA       Shipping
SNAPSHOTS




             Component
 Pipeline




                                Integration
             Component
                                          Build
             Component
                                          Mgmt.
Releases
Pipeline




             Component                            Deploy    Test    Deploy   Deploy
                              Build

                                                                   Manual
             Component
                              Mgmt.                         Test


                                                            Test
            Co   Co      Co
Dev Team
 builds




            Co   Co      Co
                                                                                 Ops
            Co   Co
                                                           QA      Rel. Mg.
                                  Dev
The Result After 1 Year

Developer buy-in
                    fair
in the ideas


Developer buy-in
                    0 %
in implementation



Improvement of
                    none
Cycle Time
Learnings

Bad:                         Good:
• It was build by another    • it established a
 team.                         “we should do...”
• It was build beside the      - CDCs
 teams builds.                 - pipelines
• Big Bang Rollout             - deliver faster
• no shared responsibility   • it fixed other
• no proof that it works       problems: server
                               config, etc.
Context: Nokia L&C Places

Story #2   RESTful services to show Place
           information on maps
           applications.




Focus on Delivering
What we achieved?


                                   1 year




   #Releases        5 in 6 month        >110 in 6 month

 Cycle Time av.    approx. 35 days          11 days

 Cycle Time min.       1 week               2 hours

 Release Success        10 %                 97 %

 Unplanned Work         80 %                 20 %
What helped....
                  DevQA
   DevOps                   TDD


                           Trust
        Test Automation

 Kanban
        Pairing
                          Baby
People                    Steps
Build one team

 Dev
             QA       Rel.Mgt
 Dev
                                OPS
         Build Mgmt
 Dev




       Dev

       Dev        +


       Dev
DevOps + DevQA

Dev   QA   Ship



Dev   QA   Ops


                  Dev   QA   Ops
Focus process: Kanban
Focus process: Kanban




                  Avatar
BFocus
 on the
 value stream




         Main Metric:
         Release Cycle Time
BBAutomation


“
    Automating the
    wrong thing to
    early is
    dangerous
                  • Automate
                    everything you do
                    twice.
                  • Automation will
                    be your rescue.
        www.flickr.com/photos/gibbisons/5538845069/
Automation




Our Automation:
 Full E2E pipeline in one
 tool, from commit to
 prod
Eat your Own Dog Food
   You understand the value of
   Continuous Delivery?

   Use the same principle for your
   Improvement Process.
   Baby Steps,             Baby Steps,     Baby Steps,   Baby Steps….




www.flickr.com/photos/mshades/2132689629/
Why we should care
about fast delivery?
How to find the
  balance + rhythm?
     Firefighting

     Deliver
     Improve




                    …
Context: eBay company

Story #3   biggest e-commerce market
           place for vehicles in Germany
The Architecture
web app for a single
use case, e.g. “search”     – eBay “pillar architecture”

                              (every major use case is separate)
                            – a lot of shared code
                            – big domain model
                            – typical change:
                   shared          • impacts one component
                     code
                                   • the domain model
                                   • full rollout
        DB                  – big bang rollouts, no downtime
                            – deployment army
What we achieved?


                                   2 years




   #Releases        every 2-3 weeks          every week


 Cycle Time av.       10-30 days               30 days


 Cycle Time min.       30 days                 10 days

                       room for               room for
 External quality
                     improvement             improvement
Context: eBay company

Story #4   biggest e-commerce market
           place for vehicles in Germany




 Why don’t just skip
the hardening phase?
What we achieved?


                                   3 years




   #Releases        every 2-3 weeks      4-8 per week


 Cycle Time av.       10-30 days              1-5 days


 Cycle Time min.       30 days                 2 hours

                       room for
 External quality                            pretty good
                     improvement
What helped....

                           Kanban
  Baby
                        Test Automation
  Steps
           A huge step
          - make the right thing easy
          - share responsibility
          - cross-functional teams
4 Stories:
       What helps? What not?


Story #1     Story #2     Story #3     Story #4



Huge Step    Baby Steps   Baby Steps   Huge Step


            Continuous                 Disruptive
            Improvement                 Change
Questions?


Alexander Schwartz
twitter: @alexschwartzbln
e-mail: alexander.schwartz@nokia.com

More Related Content

What's hot

Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
TechWell
 
Is Test Planning a lost art in Agile? by Michelle Williams
Is Test Planning a lost art in Agile? by Michelle WilliamsIs Test Planning a lost art in Agile? by Michelle Williams
Is Test Planning a lost art in Agile? by Michelle Williams
QA or the Highway
 
Quality Jam 2016 Product Roadmap
Quality Jam 2016 Product RoadmapQuality Jam 2016 Product Roadmap
Quality Jam 2016 Product Roadmap
QASymphony
 
Continuous test automation
Continuous test automationContinuous test automation
Continuous test automation
Viresh Doshi
 
Performance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
Performance Metrics for your Delivery Pipeline - Wolfgang GottesheimPerformance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
Performance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
JAXLondon2014
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
TechWell
 
Closing the Requirements and Testing Loop Webinar
Closing the Requirements and Testing Loop WebinarClosing the Requirements and Testing Loop Webinar
Closing the Requirements and Testing Loop Webinar
QASymphony
 
Agile Testing Analytics
Agile Testing AnalyticsAgile Testing Analytics
Agile Testing Analytics
QASymphony
 
Agile Testing Transformation is as Easy as 1, 2, 3 by Michael Buening
Agile Testing Transformation is as Easy as 1, 2, 3 by Michael BueningAgile Testing Transformation is as Easy as 1, 2, 3 by Michael Buening
Agile Testing Transformation is as Easy as 1, 2, 3 by Michael Buening
QA or the Highway
 
QASymphony and TestPlant: Bringing Together Best-in-Class Test Management and...
QASymphony and TestPlant: Bringing Together Best-in-Class Test Management and...QASymphony and TestPlant: Bringing Together Best-in-Class Test Management and...
QASymphony and TestPlant: Bringing Together Best-in-Class Test Management and...
QASymphony
 
Machine learning in software testing
Machine learning in software testingMachine learning in software testing
Machine learning in software testing
Thoughtworks
 
10 Benefits of Automated Testing
10 Benefits of Automated Testing10 Benefits of Automated Testing
10 Benefits of Automated Testing
TestObject - Mobile Testing
 
Agile Testing 2020
Agile Testing 2020Agile Testing 2020
Agile Testing 2020
arzu TR
 
Diving into the World of Test Automation The Approach and the Technologies
Diving into the World of Test Automation The Approach and the TechnologiesDiving into the World of Test Automation The Approach and the Technologies
Diving into the World of Test Automation The Approach and the Technologies
QASymphony
 
Automate More with Selenium for your RWD
Automate More with Selenium for your RWDAutomate More with Selenium for your RWD
Automate More with Selenium for your RWD
Perfecto by Perforce
 
SpiraTest: Designing and Creating Test Script
SpiraTest: Designing and Creating Test ScriptSpiraTest: Designing and Creating Test Script
SpiraTest: Designing and Creating Test Script
Inflectra
 
ISTQB Foundation and Selenium Java Automation Testing
ISTQB Foundation and Selenium Java Automation TestingISTQB Foundation and Selenium Java Automation Testing
ISTQB Foundation and Selenium Java Automation Testing
HiraQureshi22
 
7 QA Tests You Should Be Running
7 QA Tests You Should Be Running7 QA Tests You Should Be Running
7 QA Tests You Should Be Running
Rainforest QA
 
Ssw forte-agile-seminar
Ssw forte-agile-seminarSsw forte-agile-seminar
Ssw forte-agile-seminarSSW
 
Building Quality into Your DevSecOps Pipelines
Building Quality into Your DevSecOps PipelinesBuilding Quality into Your DevSecOps Pipelines
Building Quality into Your DevSecOps Pipelines
Inflectra
 

What's hot (20)

Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
 
Is Test Planning a lost art in Agile? by Michelle Williams
Is Test Planning a lost art in Agile? by Michelle WilliamsIs Test Planning a lost art in Agile? by Michelle Williams
Is Test Planning a lost art in Agile? by Michelle Williams
 
Quality Jam 2016 Product Roadmap
Quality Jam 2016 Product RoadmapQuality Jam 2016 Product Roadmap
Quality Jam 2016 Product Roadmap
 
Continuous test automation
Continuous test automationContinuous test automation
Continuous test automation
 
Performance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
Performance Metrics for your Delivery Pipeline - Wolfgang GottesheimPerformance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
Performance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
 
Closing the Requirements and Testing Loop Webinar
Closing the Requirements and Testing Loop WebinarClosing the Requirements and Testing Loop Webinar
Closing the Requirements and Testing Loop Webinar
 
Agile Testing Analytics
Agile Testing AnalyticsAgile Testing Analytics
Agile Testing Analytics
 
Agile Testing Transformation is as Easy as 1, 2, 3 by Michael Buening
Agile Testing Transformation is as Easy as 1, 2, 3 by Michael BueningAgile Testing Transformation is as Easy as 1, 2, 3 by Michael Buening
Agile Testing Transformation is as Easy as 1, 2, 3 by Michael Buening
 
QASymphony and TestPlant: Bringing Together Best-in-Class Test Management and...
QASymphony and TestPlant: Bringing Together Best-in-Class Test Management and...QASymphony and TestPlant: Bringing Together Best-in-Class Test Management and...
QASymphony and TestPlant: Bringing Together Best-in-Class Test Management and...
 
Machine learning in software testing
Machine learning in software testingMachine learning in software testing
Machine learning in software testing
 
10 Benefits of Automated Testing
10 Benefits of Automated Testing10 Benefits of Automated Testing
10 Benefits of Automated Testing
 
Agile Testing 2020
Agile Testing 2020Agile Testing 2020
Agile Testing 2020
 
Diving into the World of Test Automation The Approach and the Technologies
Diving into the World of Test Automation The Approach and the TechnologiesDiving into the World of Test Automation The Approach and the Technologies
Diving into the World of Test Automation The Approach and the Technologies
 
Automate More with Selenium for your RWD
Automate More with Selenium for your RWDAutomate More with Selenium for your RWD
Automate More with Selenium for your RWD
 
SpiraTest: Designing and Creating Test Script
SpiraTest: Designing and Creating Test ScriptSpiraTest: Designing and Creating Test Script
SpiraTest: Designing and Creating Test Script
 
ISTQB Foundation and Selenium Java Automation Testing
ISTQB Foundation and Selenium Java Automation TestingISTQB Foundation and Selenium Java Automation Testing
ISTQB Foundation and Selenium Java Automation Testing
 
7 QA Tests You Should Be Running
7 QA Tests You Should Be Running7 QA Tests You Should Be Running
7 QA Tests You Should Be Running
 
Ssw forte-agile-seminar
Ssw forte-agile-seminarSsw forte-agile-seminar
Ssw forte-agile-seminar
 
Building Quality into Your DevSecOps Pipelines
Building Quality into Your DevSecOps PipelinesBuilding Quality into Your DevSecOps Pipelines
Building Quality into Your DevSecOps Pipelines
 

Similar to How to Introduce Continuous Delivery

REA Sydney Customer Appreciation Day
REA Sydney Customer Appreciation DayREA Sydney Customer Appreciation Day
REA Sydney Customer Appreciation Day
Amazon Web Services
 
SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA Webinar: Process Compression For Mobile App Dev 120612SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA Webinar: Process Compression For Mobile App Dev 120612SOASTA
 
Continuous Delivery Overview
Continuous Delivery OverviewContinuous Delivery Overview
Continuous Delivery Overview
Will Iverson
 
Beyond Scrum: Scaling Agile with Continuous Delivery and Subversion
Beyond Scrum: Scaling Agile with Continuous Delivery and SubversionBeyond Scrum: Scaling Agile with Continuous Delivery and Subversion
Beyond Scrum: Scaling Agile with Continuous Delivery and Subversion
Product Marketing Services
 
Case Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software DevelopmentCase Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software Development
CA Technologies
 
Case Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software DevelopmentCase Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software Development
CA Technologies
 
Continuous Delivery: releasing Better and Faster at Dashlane
Continuous Delivery: releasing Better and Faster at DashlaneContinuous Delivery: releasing Better and Faster at Dashlane
Continuous Delivery: releasing Better and Faster at Dashlane
Dashlane
 
Deploy Faster Without Failing Faster - Metrics-Driven - Dynatrace User Groups...
Deploy Faster Without Failing Faster - Metrics-Driven - Dynatrace User Groups...Deploy Faster Without Failing Faster - Metrics-Driven - Dynatrace User Groups...
Deploy Faster Without Failing Faster - Metrics-Driven - Dynatrace User Groups...
Andreas Grabner
 
Mobile DevOps - Trends and Chellenges
Mobile DevOps - Trends and ChellengesMobile DevOps - Trends and Chellenges
Mobile DevOps - Trends and Chellenges
Sanjeev Sharma
 
Faster apps. faster time to market. faster mean time to repair
Faster apps. faster time to market. faster mean time to repairFaster apps. faster time to market. faster mean time to repair
Faster apps. faster time to market. faster mean time to repair
Compuware ASEAN
 
How to build cost and plan App Development - Fuerte International App Developers
How to build cost and plan App Development - Fuerte International App DevelopersHow to build cost and plan App Development - Fuerte International App Developers
How to build cost and plan App Development - Fuerte International App Developers
Greg Jarrett
 
APIdays Barcelona 2019 - How to build a social network on Serverless with Yan...
APIdays Barcelona 2019 - How to build a social network on Serverless with Yan...APIdays Barcelona 2019 - How to build a social network on Serverless with Yan...
APIdays Barcelona 2019 - How to build a social network on Serverless with Yan...
apidays
 
How to build a social network on serverless
How to build a social network on serverlessHow to build a social network on serverless
How to build a social network on serverless
Yan Cui
 
Four Steps Toward a Safer Continuous Delivery Practice (Hint: Add Monitoring)
Four Steps Toward a Safer Continuous Delivery Practice (Hint: Add Monitoring)Four Steps Toward a Safer Continuous Delivery Practice (Hint: Add Monitoring)
Four Steps Toward a Safer Continuous Delivery Practice (Hint: Add Monitoring)
VMware Tanzu
 
Metrics-Driven Devops: Delivering High Quality Software Faster!
Metrics-Driven Devops: Delivering High Quality Software Faster! Metrics-Driven Devops: Delivering High Quality Software Faster!
Metrics-Driven Devops: Delivering High Quality Software Faster!
Dynatrace
 
WSO2Con EU 2015: Keynote - The Containerization of the Developer Workspace
WSO2Con EU 2015: Keynote - The Containerization of the Developer WorkspaceWSO2Con EU 2015: Keynote - The Containerization of the Developer Workspace
WSO2Con EU 2015: Keynote - The Containerization of the Developer Workspace
WSO2
 
From 0 to DevOps in 80 Days [Webinar Replay]
From 0 to DevOps in 80 Days [Webinar Replay]From 0 to DevOps in 80 Days [Webinar Replay]
From 0 to DevOps in 80 Days [Webinar Replay]
Dynatrace
 
XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...
XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...
XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...
XebiaLabs
 
Chef for DevOps - an Introduction
Chef for DevOps - an IntroductionChef for DevOps - an Introduction
Chef for DevOps - an Introduction
Sanjeev Sharma
 
Scaling Continuous Integration Practices to Teams with Parallel Development
Scaling Continuous Integration Practices to Teams with Parallel DevelopmentScaling Continuous Integration Practices to Teams with Parallel Development
Scaling Continuous Integration Practices to Teams with Parallel Development
IBM UrbanCode Products
 

Similar to How to Introduce Continuous Delivery (20)

REA Sydney Customer Appreciation Day
REA Sydney Customer Appreciation DayREA Sydney Customer Appreciation Day
REA Sydney Customer Appreciation Day
 
SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA Webinar: Process Compression For Mobile App Dev 120612SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA Webinar: Process Compression For Mobile App Dev 120612
 
Continuous Delivery Overview
Continuous Delivery OverviewContinuous Delivery Overview
Continuous Delivery Overview
 
Beyond Scrum: Scaling Agile with Continuous Delivery and Subversion
Beyond Scrum: Scaling Agile with Continuous Delivery and SubversionBeyond Scrum: Scaling Agile with Continuous Delivery and Subversion
Beyond Scrum: Scaling Agile with Continuous Delivery and Subversion
 
Case Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software DevelopmentCase Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software Development
 
Case Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software DevelopmentCase Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software Development
 
Continuous Delivery: releasing Better and Faster at Dashlane
Continuous Delivery: releasing Better and Faster at DashlaneContinuous Delivery: releasing Better and Faster at Dashlane
Continuous Delivery: releasing Better and Faster at Dashlane
 
Deploy Faster Without Failing Faster - Metrics-Driven - Dynatrace User Groups...
Deploy Faster Without Failing Faster - Metrics-Driven - Dynatrace User Groups...Deploy Faster Without Failing Faster - Metrics-Driven - Dynatrace User Groups...
Deploy Faster Without Failing Faster - Metrics-Driven - Dynatrace User Groups...
 
Mobile DevOps - Trends and Chellenges
Mobile DevOps - Trends and ChellengesMobile DevOps - Trends and Chellenges
Mobile DevOps - Trends and Chellenges
 
Faster apps. faster time to market. faster mean time to repair
Faster apps. faster time to market. faster mean time to repairFaster apps. faster time to market. faster mean time to repair
Faster apps. faster time to market. faster mean time to repair
 
How to build cost and plan App Development - Fuerte International App Developers
How to build cost and plan App Development - Fuerte International App DevelopersHow to build cost and plan App Development - Fuerte International App Developers
How to build cost and plan App Development - Fuerte International App Developers
 
APIdays Barcelona 2019 - How to build a social network on Serverless with Yan...
APIdays Barcelona 2019 - How to build a social network on Serverless with Yan...APIdays Barcelona 2019 - How to build a social network on Serverless with Yan...
APIdays Barcelona 2019 - How to build a social network on Serverless with Yan...
 
How to build a social network on serverless
How to build a social network on serverlessHow to build a social network on serverless
How to build a social network on serverless
 
Four Steps Toward a Safer Continuous Delivery Practice (Hint: Add Monitoring)
Four Steps Toward a Safer Continuous Delivery Practice (Hint: Add Monitoring)Four Steps Toward a Safer Continuous Delivery Practice (Hint: Add Monitoring)
Four Steps Toward a Safer Continuous Delivery Practice (Hint: Add Monitoring)
 
Metrics-Driven Devops: Delivering High Quality Software Faster!
Metrics-Driven Devops: Delivering High Quality Software Faster! Metrics-Driven Devops: Delivering High Quality Software Faster!
Metrics-Driven Devops: Delivering High Quality Software Faster!
 
WSO2Con EU 2015: Keynote - The Containerization of the Developer Workspace
WSO2Con EU 2015: Keynote - The Containerization of the Developer WorkspaceWSO2Con EU 2015: Keynote - The Containerization of the Developer Workspace
WSO2Con EU 2015: Keynote - The Containerization of the Developer Workspace
 
From 0 to DevOps in 80 Days [Webinar Replay]
From 0 to DevOps in 80 Days [Webinar Replay]From 0 to DevOps in 80 Days [Webinar Replay]
From 0 to DevOps in 80 Days [Webinar Replay]
 
XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...
XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...
XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...
 
Chef for DevOps - an Introduction
Chef for DevOps - an IntroductionChef for DevOps - an Introduction
Chef for DevOps - an Introduction
 
Scaling Continuous Integration Practices to Teams with Parallel Development
Scaling Continuous Integration Practices to Teams with Parallel DevelopmentScaling Continuous Integration Practices to Teams with Parallel Development
Scaling Continuous Integration Practices to Teams with Parallel Development
 

More from Dr. Alexander Schwartz

Wrestling with Conway's Law: How to support cross-functional teams working on...
Wrestling with Conway's Law: How to support cross-functional teams working on...Wrestling with Conway's Law: How to support cross-functional teams working on...
Wrestling with Conway's Law: How to support cross-functional teams working on...
Dr. Alexander Schwartz
 
#AT16VIE: Does Agile mean we have no time for testing?
#AT16VIE: Does Agile mean we have no time for testing?#AT16VIE: Does Agile mean we have no time for testing?
#AT16VIE: Does Agile mean we have no time for testing?
Dr. Alexander Schwartz
 
Does agile mean having even less time for testing?!
Does agile mean having even less time for testing?!Does agile mean having even less time for testing?!
Does agile mean having even less time for testing?!
Dr. Alexander Schwartz
 
User Stories Schneiden mit Elefanten-Carpaccio (Scrum-Day 2016)
User Stories Schneiden mit Elefanten-Carpaccio (Scrum-Day 2016)User Stories Schneiden mit Elefanten-Carpaccio (Scrum-Day 2016)
User Stories Schneiden mit Elefanten-Carpaccio (Scrum-Day 2016)
Dr. Alexander Schwartz
 
Hilfe, wir haben keine Zeit zum Testen!
Hilfe, wir haben keine Zeit zum Testen!Hilfe, wir haben keine Zeit zum Testen!
Hilfe, wir haben keine Zeit zum Testen!
Dr. Alexander Schwartz
 
Change Dojo - Agile Testing Days 2015
Change Dojo - Agile Testing Days 2015Change Dojo - Agile Testing Days 2015
Change Dojo - Agile Testing Days 2015
Dr. Alexander Schwartz
 
ScrumDay2015: Ein neues Dojo: Anwendergeschichten zerschneiden
ScrumDay2015: Ein neues Dojo: Anwendergeschichten zerschneidenScrumDay2015: Ein neues Dojo: Anwendergeschichten zerschneiden
ScrumDay2015: Ein neues Dojo: Anwendergeschichten zerschneiden
Dr. Alexander Schwartz
 
Insights From Happy Change Agents
Insights From Happy Change AgentsInsights From Happy Change Agents
Insights From Happy Change Agents
Dr. Alexander Schwartz
 
Ein neues Dojo: Anwendergeschichten zerschneiden
Ein neues Dojo: Anwendergeschichten zerschneidenEin neues Dojo: Anwendergeschichten zerschneiden
Ein neues Dojo: Anwendergeschichten zerschneiden
Dr. Alexander Schwartz
 
A New Dojo: The Art of Story Splitting
A New Dojo: The Art of Story SplittingA New Dojo: The Art of Story Splitting
A New Dojo: The Art of Story Splitting
Dr. Alexander Schwartz
 
DevOps in the Enterprise: Our Experiences at HERE/Nokia
DevOps in the Enterprise: Our Experiences at HERE/NokiaDevOps in the Enterprise: Our Experiences at HERE/Nokia
DevOps in the Enterprise: Our Experiences at HERE/Nokia
Dr. Alexander Schwartz
 
Wie verändert sich Testen mit Continuous Delivery?
Wie verändert sich Testen mit Continuous Delivery?Wie verändert sich Testen mit Continuous Delivery?
Wie verändert sich Testen mit Continuous Delivery?
Dr. Alexander Schwartz
 
What is Agile Testing?
What is Agile Testing? What is Agile Testing?
What is Agile Testing?
Dr. Alexander Schwartz
 
Ripening of a RESTful API
Ripening of a RESTful APIRipening of a RESTful API
Ripening of a RESTful API
Dr. Alexander Schwartz
 
Help, we have no more time for testing! (gotoCon Berlin 2013)
Help, we have no more time for testing! (gotoCon Berlin 2013)Help, we have no more time for testing! (gotoCon Berlin 2013)
Help, we have no more time for testing! (gotoCon Berlin 2013)
Dr. Alexander Schwartz
 
AWS Ingredients for Deployment Patterns & the PBAPI canary-blue/green-hotstan...
AWS Ingredients for Deployment Patterns & the PBAPI canary-blue/green-hotstan...AWS Ingredients for Deployment Patterns & the PBAPI canary-blue/green-hotstan...
AWS Ingredients for Deployment Patterns & the PBAPI canary-blue/green-hotstan...
Dr. Alexander Schwartz
 
Ignite Talk: Help, we have no more time for testing!
Ignite Talk: Help, we have no more time for testing!Ignite Talk: Help, we have no more time for testing!
Ignite Talk: Help, we have no more time for testing!
Dr. Alexander Schwartz
 
How releasing faster changes testing
How releasing faster changes testingHow releasing faster changes testing
How releasing faster changes testing
Dr. Alexander Schwartz
 
How We Introduced Continuous Delivery?
How We Introduced Continuous Delivery?How We Introduced Continuous Delivery?
How We Introduced Continuous Delivery?
Dr. Alexander Schwartz
 

More from Dr. Alexander Schwartz (20)

Wrestling with Conway's Law: How to support cross-functional teams working on...
Wrestling with Conway's Law: How to support cross-functional teams working on...Wrestling with Conway's Law: How to support cross-functional teams working on...
Wrestling with Conway's Law: How to support cross-functional teams working on...
 
#AT16VIE: Does Agile mean we have no time for testing?
#AT16VIE: Does Agile mean we have no time for testing?#AT16VIE: Does Agile mean we have no time for testing?
#AT16VIE: Does Agile mean we have no time for testing?
 
Does agile mean having even less time for testing?!
Does agile mean having even less time for testing?!Does agile mean having even less time for testing?!
Does agile mean having even less time for testing?!
 
User Stories Schneiden mit Elefanten-Carpaccio (Scrum-Day 2016)
User Stories Schneiden mit Elefanten-Carpaccio (Scrum-Day 2016)User Stories Schneiden mit Elefanten-Carpaccio (Scrum-Day 2016)
User Stories Schneiden mit Elefanten-Carpaccio (Scrum-Day 2016)
 
Hilfe, wir haben keine Zeit zum Testen!
Hilfe, wir haben keine Zeit zum Testen!Hilfe, wir haben keine Zeit zum Testen!
Hilfe, wir haben keine Zeit zum Testen!
 
Change Dojo - Agile Testing Days 2015
Change Dojo - Agile Testing Days 2015Change Dojo - Agile Testing Days 2015
Change Dojo - Agile Testing Days 2015
 
ScrumDay2015: Ein neues Dojo: Anwendergeschichten zerschneiden
ScrumDay2015: Ein neues Dojo: Anwendergeschichten zerschneidenScrumDay2015: Ein neues Dojo: Anwendergeschichten zerschneiden
ScrumDay2015: Ein neues Dojo: Anwendergeschichten zerschneiden
 
Insights From Happy Change Agents
Insights From Happy Change AgentsInsights From Happy Change Agents
Insights From Happy Change Agents
 
Ein neues Dojo: Anwendergeschichten zerschneiden
Ein neues Dojo: Anwendergeschichten zerschneidenEin neues Dojo: Anwendergeschichten zerschneiden
Ein neues Dojo: Anwendergeschichten zerschneiden
 
A New Dojo: The Art of Story Splitting
A New Dojo: The Art of Story SplittingA New Dojo: The Art of Story Splitting
A New Dojo: The Art of Story Splitting
 
DevOps in the Enterprise: Our Experiences at HERE/Nokia
DevOps in the Enterprise: Our Experiences at HERE/NokiaDevOps in the Enterprise: Our Experiences at HERE/Nokia
DevOps in the Enterprise: Our Experiences at HERE/Nokia
 
Wie verändert sich Testen mit Continuous Delivery?
Wie verändert sich Testen mit Continuous Delivery?Wie verändert sich Testen mit Continuous Delivery?
Wie verändert sich Testen mit Continuous Delivery?
 
What is Agile Testing?
What is Agile Testing? What is Agile Testing?
What is Agile Testing?
 
Ripening of a RESTful API
Ripening of a RESTful APIRipening of a RESTful API
Ripening of a RESTful API
 
Help, we have no more time for testing! (gotoCon Berlin 2013)
Help, we have no more time for testing! (gotoCon Berlin 2013)Help, we have no more time for testing! (gotoCon Berlin 2013)
Help, we have no more time for testing! (gotoCon Berlin 2013)
 
AWS Ingredients for Deployment Patterns & the PBAPI canary-blue/green-hotstan...
AWS Ingredients for Deployment Patterns & the PBAPI canary-blue/green-hotstan...AWS Ingredients for Deployment Patterns & the PBAPI canary-blue/green-hotstan...
AWS Ingredients for Deployment Patterns & the PBAPI canary-blue/green-hotstan...
 
Ignite Talk: Help, we have no more time for testing!
Ignite Talk: Help, we have no more time for testing!Ignite Talk: Help, we have no more time for testing!
Ignite Talk: Help, we have no more time for testing!
 
How releasing faster changes testing
How releasing faster changes testingHow releasing faster changes testing
How releasing faster changes testing
 
How We Introduced Continuous Delivery?
How We Introduced Continuous Delivery?How We Introduced Continuous Delivery?
How We Introduced Continuous Delivery?
 
Kanban und DevOps bei Nokia
Kanban und DevOps bei NokiaKanban und DevOps bei Nokia
Kanban und DevOps bei Nokia
 

Recently uploaded

Sustainability: Balancing the Environment, Equity & Economy
Sustainability: Balancing the Environment, Equity & EconomySustainability: Balancing the Environment, Equity & Economy
Sustainability: Balancing the Environment, Equity & Economy
Operational Excellence Consulting
 
ikea_woodgreen_petscharity_dog-alogue_digital.pdf
ikea_woodgreen_petscharity_dog-alogue_digital.pdfikea_woodgreen_petscharity_dog-alogue_digital.pdf
ikea_woodgreen_petscharity_dog-alogue_digital.pdf
agatadrynko
 
Bài tập - Tiếng anh 11 Global Success UNIT 1 - Bản HS.doc.pdf
Bài tập - Tiếng anh 11 Global Success UNIT 1 - Bản HS.doc.pdfBài tập - Tiếng anh 11 Global Success UNIT 1 - Bản HS.doc.pdf
Bài tập - Tiếng anh 11 Global Success UNIT 1 - Bản HS.doc.pdf
daothibichhang1
 
Meas_Dylan_DMBS_PB1_2024-05XX_Revised.pdf
Meas_Dylan_DMBS_PB1_2024-05XX_Revised.pdfMeas_Dylan_DMBS_PB1_2024-05XX_Revised.pdf
Meas_Dylan_DMBS_PB1_2024-05XX_Revised.pdf
dylandmeas
 
Introduction to Amazon company 111111111111
Introduction to Amazon company 111111111111Introduction to Amazon company 111111111111
Introduction to Amazon company 111111111111
zoyaansari11365
 
3.0 Project 2_ Developing My Brand Identity Kit.pptx
3.0 Project 2_ Developing My Brand Identity Kit.pptx3.0 Project 2_ Developing My Brand Identity Kit.pptx
3.0 Project 2_ Developing My Brand Identity Kit.pptx
tanyjahb
 
Project File Report BBA 6th semester.pdf
Project File Report BBA 6th semester.pdfProject File Report BBA 6th semester.pdf
Project File Report BBA 6th semester.pdf
RajPriye
 
Company Valuation webinar series - Tuesday, 4 June 2024
Company Valuation webinar series - Tuesday, 4 June 2024Company Valuation webinar series - Tuesday, 4 June 2024
Company Valuation webinar series - Tuesday, 4 June 2024
FelixPerez547899
 
Enterprise Excellence is Inclusive Excellence.pdf
Enterprise Excellence is Inclusive Excellence.pdfEnterprise Excellence is Inclusive Excellence.pdf
Enterprise Excellence is Inclusive Excellence.pdf
KaiNexus
 
Bài tập - Tiếng anh 11 Global Success UNIT 1 - Bản HS.doc
Bài tập - Tiếng anh 11 Global Success UNIT 1 - Bản HS.docBài tập - Tiếng anh 11 Global Success UNIT 1 - Bản HS.doc
Bài tập - Tiếng anh 11 Global Success UNIT 1 - Bản HS.doc
daothibichhang1
 
Event Report - SAP Sapphire 2024 Orlando - lots of innovation and old challenges
Event Report - SAP Sapphire 2024 Orlando - lots of innovation and old challengesEvent Report - SAP Sapphire 2024 Orlando - lots of innovation and old challenges
Event Report - SAP Sapphire 2024 Orlando - lots of innovation and old challenges
Holger Mueller
 
Building Your Employer Brand with Social Media
Building Your Employer Brand with Social MediaBuilding Your Employer Brand with Social Media
Building Your Employer Brand with Social Media
LuanWise
 
Organizational Change Leadership Agile Tour Geneve 2024
Organizational Change Leadership Agile Tour Geneve 2024Organizational Change Leadership Agile Tour Geneve 2024
Organizational Change Leadership Agile Tour Geneve 2024
Kirill Klimov
 
Exploring Patterns of Connection with Social Dreaming
Exploring Patterns of Connection with Social DreamingExploring Patterns of Connection with Social Dreaming
Exploring Patterns of Connection with Social Dreaming
Nicola Wreford-Howard
 
ikea_woodgreen_petscharity_cat-alogue_digital.pdf
ikea_woodgreen_petscharity_cat-alogue_digital.pdfikea_woodgreen_petscharity_cat-alogue_digital.pdf
ikea_woodgreen_petscharity_cat-alogue_digital.pdf
agatadrynko
 
Premium MEAN Stack Development Solutions for Modern Businesses
Premium MEAN Stack Development Solutions for Modern BusinessesPremium MEAN Stack Development Solutions for Modern Businesses
Premium MEAN Stack Development Solutions for Modern Businesses
SynapseIndia
 
In the Adani-Hindenburg case, what is SEBI investigating.pptx
In the Adani-Hindenburg case, what is SEBI investigating.pptxIn the Adani-Hindenburg case, what is SEBI investigating.pptx
In the Adani-Hindenburg case, what is SEBI investigating.pptx
Adani case
 
Search Disrupted Google’s Leaked Documents Rock the SEO World.pdf
Search Disrupted Google’s Leaked Documents Rock the SEO World.pdfSearch Disrupted Google’s Leaked Documents Rock the SEO World.pdf
Search Disrupted Google’s Leaked Documents Rock the SEO World.pdf
Arihant Webtech Pvt. Ltd
 
Putting the SPARK into Virtual Training.pptx
Putting the SPARK into Virtual Training.pptxPutting the SPARK into Virtual Training.pptx
Putting the SPARK into Virtual Training.pptx
Cynthia Clay
 
Affordable Stationery Printing Services in Jaipur | Navpack n Print
Affordable Stationery Printing Services in Jaipur | Navpack n PrintAffordable Stationery Printing Services in Jaipur | Navpack n Print
Affordable Stationery Printing Services in Jaipur | Navpack n Print
Navpack & Print
 

Recently uploaded (20)

Sustainability: Balancing the Environment, Equity & Economy
Sustainability: Balancing the Environment, Equity & EconomySustainability: Balancing the Environment, Equity & Economy
Sustainability: Balancing the Environment, Equity & Economy
 
ikea_woodgreen_petscharity_dog-alogue_digital.pdf
ikea_woodgreen_petscharity_dog-alogue_digital.pdfikea_woodgreen_petscharity_dog-alogue_digital.pdf
ikea_woodgreen_petscharity_dog-alogue_digital.pdf
 
Bài tập - Tiếng anh 11 Global Success UNIT 1 - Bản HS.doc.pdf
Bài tập - Tiếng anh 11 Global Success UNIT 1 - Bản HS.doc.pdfBài tập - Tiếng anh 11 Global Success UNIT 1 - Bản HS.doc.pdf
Bài tập - Tiếng anh 11 Global Success UNIT 1 - Bản HS.doc.pdf
 
Meas_Dylan_DMBS_PB1_2024-05XX_Revised.pdf
Meas_Dylan_DMBS_PB1_2024-05XX_Revised.pdfMeas_Dylan_DMBS_PB1_2024-05XX_Revised.pdf
Meas_Dylan_DMBS_PB1_2024-05XX_Revised.pdf
 
Introduction to Amazon company 111111111111
Introduction to Amazon company 111111111111Introduction to Amazon company 111111111111
Introduction to Amazon company 111111111111
 
3.0 Project 2_ Developing My Brand Identity Kit.pptx
3.0 Project 2_ Developing My Brand Identity Kit.pptx3.0 Project 2_ Developing My Brand Identity Kit.pptx
3.0 Project 2_ Developing My Brand Identity Kit.pptx
 
Project File Report BBA 6th semester.pdf
Project File Report BBA 6th semester.pdfProject File Report BBA 6th semester.pdf
Project File Report BBA 6th semester.pdf
 
Company Valuation webinar series - Tuesday, 4 June 2024
Company Valuation webinar series - Tuesday, 4 June 2024Company Valuation webinar series - Tuesday, 4 June 2024
Company Valuation webinar series - Tuesday, 4 June 2024
 
Enterprise Excellence is Inclusive Excellence.pdf
Enterprise Excellence is Inclusive Excellence.pdfEnterprise Excellence is Inclusive Excellence.pdf
Enterprise Excellence is Inclusive Excellence.pdf
 
Bài tập - Tiếng anh 11 Global Success UNIT 1 - Bản HS.doc
Bài tập - Tiếng anh 11 Global Success UNIT 1 - Bản HS.docBài tập - Tiếng anh 11 Global Success UNIT 1 - Bản HS.doc
Bài tập - Tiếng anh 11 Global Success UNIT 1 - Bản HS.doc
 
Event Report - SAP Sapphire 2024 Orlando - lots of innovation and old challenges
Event Report - SAP Sapphire 2024 Orlando - lots of innovation and old challengesEvent Report - SAP Sapphire 2024 Orlando - lots of innovation and old challenges
Event Report - SAP Sapphire 2024 Orlando - lots of innovation and old challenges
 
Building Your Employer Brand with Social Media
Building Your Employer Brand with Social MediaBuilding Your Employer Brand with Social Media
Building Your Employer Brand with Social Media
 
Organizational Change Leadership Agile Tour Geneve 2024
Organizational Change Leadership Agile Tour Geneve 2024Organizational Change Leadership Agile Tour Geneve 2024
Organizational Change Leadership Agile Tour Geneve 2024
 
Exploring Patterns of Connection with Social Dreaming
Exploring Patterns of Connection with Social DreamingExploring Patterns of Connection with Social Dreaming
Exploring Patterns of Connection with Social Dreaming
 
ikea_woodgreen_petscharity_cat-alogue_digital.pdf
ikea_woodgreen_petscharity_cat-alogue_digital.pdfikea_woodgreen_petscharity_cat-alogue_digital.pdf
ikea_woodgreen_petscharity_cat-alogue_digital.pdf
 
Premium MEAN Stack Development Solutions for Modern Businesses
Premium MEAN Stack Development Solutions for Modern BusinessesPremium MEAN Stack Development Solutions for Modern Businesses
Premium MEAN Stack Development Solutions for Modern Businesses
 
In the Adani-Hindenburg case, what is SEBI investigating.pptx
In the Adani-Hindenburg case, what is SEBI investigating.pptxIn the Adani-Hindenburg case, what is SEBI investigating.pptx
In the Adani-Hindenburg case, what is SEBI investigating.pptx
 
Search Disrupted Google’s Leaked Documents Rock the SEO World.pdf
Search Disrupted Google’s Leaked Documents Rock the SEO World.pdfSearch Disrupted Google’s Leaked Documents Rock the SEO World.pdf
Search Disrupted Google’s Leaked Documents Rock the SEO World.pdf
 
Putting the SPARK into Virtual Training.pptx
Putting the SPARK into Virtual Training.pptxPutting the SPARK into Virtual Training.pptx
Putting the SPARK into Virtual Training.pptx
 
Affordable Stationery Printing Services in Jaipur | Navpack n Print
Affordable Stationery Printing Services in Jaipur | Navpack n PrintAffordable Stationery Printing Services in Jaipur | Navpack n Print
Affordable Stationery Printing Services in Jaipur | Navpack n Print
 

How to Introduce Continuous Delivery

  • 1. HOW TO INTRODUCE CONTINUOUS DELIVERY? Alexander Schwartz Nokia Location & Commerce
  • 2. Which delivery style you have? “Big ship” “Kaiten Sushi” www.flickr.com/photos/burtonandy/4702810536/ www.flickr.com/photos/mc_masterchef/178245348/ How to do the transition?
  • 4. 4 Stories: What helps? What not? Story #1 Story #2 Story #3 Story #4 context #1 context #2 NOKIA another company
  • 5. Context: Nokia L&C Places Story #1 RESTful services to show Place information on maps applications.
  • 6. Story #1: The Initial Challenges •complicated dependencies •integration problems •production bugs •big bang releases Approach: Ask for smart people for help. -> Delivery Pipelines -> CDCs (Consumer Driven Contracts)
  • 7. From Services Dependencies to Pipelines City Pages <<webapp>> Places Registry Maps app for <<REST>> Windows 7 <<device app>> Account Service Search Places <<REST>> <<REST>> Backend Maps Web <<webapp>> API Recommendations <<REST>> PBAPI client API <<client API>> Upstream Downstream Build Pipeline Order
  • 8. The Result After 1 Year Dev QA Shipping SNAPSHOTS Component Pipeline Integration Component Build Component Mgmt. Releases Pipeline Component Deploy Test Deploy Deploy Build Manual Component Mgmt. Test Test Co Co Co Dev Team builds Co Co Co Ops Co Co QA Rel. Mg. Dev
  • 9. The Result After 1 Year Developer buy-in fair in the ideas Developer buy-in 0 % in implementation Improvement of none Cycle Time
  • 10. Learnings Bad: Good: • It was build by another • it established a team. “we should do...” • It was build beside the - CDCs teams builds. - pipelines • Big Bang Rollout - deliver faster • no shared responsibility • it fixed other • no proof that it works problems: server config, etc.
  • 11. Context: Nokia L&C Places Story #2 RESTful services to show Place information on maps applications. Focus on Delivering
  • 12. What we achieved? 1 year #Releases 5 in 6 month >110 in 6 month Cycle Time av. approx. 35 days 11 days Cycle Time min. 1 week 2 hours Release Success 10 % 97 % Unplanned Work 80 % 20 %
  • 13. What helped.... DevQA DevOps TDD Trust Test Automation Kanban Pairing Baby People Steps
  • 14. Build one team Dev QA Rel.Mgt Dev OPS Build Mgmt Dev Dev Dev + Dev
  • 15. DevOps + DevQA Dev QA Ship Dev QA Ops Dev QA Ops
  • 18. BFocus on the value stream Main Metric: Release Cycle Time
  • 19. BBAutomation “ Automating the wrong thing to early is dangerous • Automate everything you do twice. • Automation will be your rescue. www.flickr.com/photos/gibbisons/5538845069/
  • 20. Automation Our Automation: Full E2E pipeline in one tool, from commit to prod
  • 21. Eat your Own Dog Food You understand the value of Continuous Delivery? Use the same principle for your Improvement Process. Baby Steps, Baby Steps, Baby Steps, Baby Steps…. www.flickr.com/photos/mshades/2132689629/
  • 22. Why we should care about fast delivery?
  • 23. How to find the balance + rhythm? Firefighting Deliver Improve …
  • 24. Context: eBay company Story #3 biggest e-commerce market place for vehicles in Germany
  • 25. The Architecture web app for a single use case, e.g. “search” – eBay “pillar architecture” (every major use case is separate) – a lot of shared code – big domain model – typical change: shared • impacts one component code • the domain model • full rollout DB – big bang rollouts, no downtime – deployment army
  • 26. What we achieved? 2 years #Releases every 2-3 weeks every week Cycle Time av. 10-30 days 30 days Cycle Time min. 30 days 10 days room for room for External quality improvement improvement
  • 27. Context: eBay company Story #4 biggest e-commerce market place for vehicles in Germany Why don’t just skip the hardening phase?
  • 28. What we achieved? 3 years #Releases every 2-3 weeks 4-8 per week Cycle Time av. 10-30 days 1-5 days Cycle Time min. 30 days 2 hours room for External quality pretty good improvement
  • 29. What helped.... Kanban Baby Test Automation Steps A huge step - make the right thing easy - share responsibility - cross-functional teams
  • 30. 4 Stories: What helps? What not? Story #1 Story #2 Story #3 Story #4 Huge Step Baby Steps Baby Steps Huge Step Continuous Disruptive Improvement Change