Case Study: ING Builds Highly Available Continuous
Delivery Pipeline with Microservices and
Containers
Taco Bakker
DevOps: Continuous Delivery
ING
Continuous Delivery Specialist
DO4T18S
#CAWorld
2 Š 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Agenda
INTRODUCTION
THE AGILE JOURNEY OF ING
CONTINUOUS DELIVERY PIPELINE ANALYTICS
CONTINUOUS DELIVERY PIPELINE WITH APIS, MICROSERVICES, AND CONTAINERS
SUMMARY
1
2
3
4
5
3 Š 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
About Me
Certified Scrum master
Continuous Delivery specialist
Lean Six Sigma Black Belt
CD tooling geek
Chairman Release Automation
user groupTACO BAKKER
The Agile Journey of ING
5 Š 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
About ING
ING IS A GLOBAL FINANCIAL INSTITUTION
WITH A STRONG EUROPEAN BASE
THE PURPOSE OF ING BANK IS TO EMPOWER PEOPLE
TO STAY A STEP AHEAD IN LIFE AND IN BUSINESS
Customers Countries Employees
more than
33M
private, corporate
and institutional
customers
more than
40in Europe, North
America, Latin
America and Australia
more than
52,000
6 Š 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
ING’s Continuous Delivery Journey
SEP
2014
MAY
2013
NOV
2011
MAY
2011
OCT
2010
OCT
2009
MAY
2010
Google IO
The will to change
New IT mgt team
1st Scrum team and start
agile development
Start of mobile app
development
Clear demarcation
responsibilities infra and app
Discussion – who runs
production
Need full automation
infra & scalable systems
Build private cloud
Engineers hunger to
take responsibility
Full reorganization
(180 full DevOps teams)
Continuous delivery
pipeline – Jez Humble
Start full automation
of IT processes
Engineering culture
Start of our own
Java community
COMMON GOALS Higher quality Higher productivity Frequent releases
7 Š 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
We Have Achieved Continuous Delivery
PRACTICES AND PEOPLE:
 Agile scrum or kanban for all our changes
 Continuous delivery for all our releases
 DevOps and skilled IT engineers for our
complete organization
AUTOMATE EVERYTHING:
 Provisioning of
virtual machines
 Builds
 Code quality checks
 Security checks
TOTAL NUMBER OF RELEASES
THE RESULTS SO FAR ARE GREAT:
 Faster time to market (<6wks cycle time)
 Lower number of incidents (>50% reduction)
 Higher frequency of releases (>12,000
releases per month)
 Deployments
 Tests
 Acceptance criteria
 Metrics & analysis
 Monitoring
8 Š 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
TEAM MATURITY TOOL STANDARDS INSIGHTS RESILIENCY
But How Can We Get to the Next Level?
Continuous Delivery Pipeline Analytics
10 Š 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Our Continuous Delivery Pipeline Collects Metrics from
All Parts of the Process
CA Release
Automation
GitLab ArtifactoryJenkins Test tooling
METRICS TOOLS
EVENTBUS
SOURCE BUILD REPOSITORY DEPLOYMENT TESTING DTAP
11 Š 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
The Collected Data Is Used to Determine Release
Maturity and Team Maturity
BEFORE A RELEASE CAN BE DEPLOYED INTO
PRODUCTION IT NEEDS TO COMPLY TO ALL
THE ACCEPTANCE CRITERIA.
WE COLLECT DATA IN A DATABASE SYSTEM AND
MAKE COMPARISON WITH OTHER TEAMS POSSIBLE,
TO HELP TEAMS TO IMPROVE!
App 1
App 1 App 2
12 Š 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
THIS MEANS THE CD PIPELINE
BECOMES TOO IMPORTANT TO FAIL!
The CD Pipeline Is Becoming the Single Point of Control
for the IT Landscape
 Build new releases
 Get feedback on the quality of the release
 Deploy releases
 Ensure built in quality of releases
 Insight in the maturity of DevOps teams
 Insight in the quality and costs of systems
 What can be released to the customers
ENGINEERS MANAGERS
Continuous Delivery Pipeline with APIs,
Microservices and Containers
14 Š 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
USER PORTAL
We Improve Resilience with Microservices and
Docker Containers
CA Release
Automation
GitLab ArtifactoryJenkins Test tooling
METRICS TOOLS
EVENTBUS
SOURCE BUILD REPOSITORY DEPLOYMENT TESTING DTAP
APIs
Container Platform (Mesos, Marathon, Chronos, Zookeeper)
Run Microservices in
a Docker container
Run tools in
a Docker container
15 Š 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
New Techniques Maximize the Resilience of the CD Pipeline
PRINCIPLES OF
MAXIMIZING
RESILIENCY
MICROSERVICES
OF CD PIPELINE
CONTAINERS
FOR
MICROSERVICES
AND TOOLS
DATA OUTSIDE
CONTAINERS
REDUNDANT
SERVICES
CONTINUOUS
IMPROVEMENT
16 Š 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Summary
 The last 6 years ING has been transforming itself
to an Agile organization.
 A Continuous Delivery Pipeline has been developed
for IT engineers to improve their software delivery.
 Now we have to roll this out globally within ING
to enable collaboration.
 To make this pipeline more resilient, we run a lot of
solutions in containers.
 We split our custom build software in microservices,
and run them in a High Availability mode.
 We use APIs to connect standard tooling to portals,
to enhance user experience.
1
2
3
4
5
6
17 Š 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Recommended Sessions
SESSION # TITLE DATE/TIME
DO4T31T
Tech Talk: Harness the Power of Innovations Like
Microservice Architecture and Containers
11/18/2015 at 3:45 pm
DO4T152S
Tech Primer: Exploit New Levels of Insight,
Orchestration and Governance for Complex
Application Releases, End-to-End, with New
Continuous Delivery Solution
11/18/2015 at 4:30 pm
DO4X213L
Hands-On Lab: Complement CA Release Automation
with a New Continuous Delivery Solution Offering A
Visual Approach for Complex Application Releases
11/19/2015 at 2:00 pm
18 Š 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Must See Demos
CA Release
Automation
CA Release
Automation
Theater 4
Cloud & SaaS
Deployments
CA Release
Automation
Theater 4
CA RA Rapid
Dev. Kit, SDK
CA Release
Automation
Theater 4
Integrations
CA Release
Automation
Theater 4
19 Š 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Follow On Conversations At…
Smart Bar
CA Release
Automation
Theater 4
Tech Talks
CA Release
Automation
Theater 4
20 Š 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Q & A
21 Š 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
For Informational Purposes Only
Š 2015 CA. All rights reserved. All trademarks referenced herein belong to their respective companies.
The content provided in this CA World 2015 presentation is intended for informational purposes only and does not form any type
of warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA.
Terms of this Presentation
22 Š 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
For More Information
To learn more, please visit:
http://cainc.to/Nv2VOe
CA World ’15

Case Study: ING Builds Highly Available Continuous Delivery Pipeline with Microservices and Containers

  • 1.
    Case Study: INGBuilds Highly Available Continuous Delivery Pipeline with Microservices and Containers Taco Bakker DevOps: Continuous Delivery ING Continuous Delivery Specialist DO4T18S #CAWorld
  • 2.
    2 Š 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Agenda INTRODUCTION THE AGILE JOURNEY OF ING CONTINUOUS DELIVERY PIPELINE ANALYTICS CONTINUOUS DELIVERY PIPELINE WITH APIS, MICROSERVICES, AND CONTAINERS SUMMARY 1 2 3 4 5
  • 3.
    3 Š 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD About Me Certified Scrum master Continuous Delivery specialist Lean Six Sigma Black Belt CD tooling geek Chairman Release Automation user groupTACO BAKKER
  • 4.
  • 5.
    5 Š 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD About ING ING IS A GLOBAL FINANCIAL INSTITUTION WITH A STRONG EUROPEAN BASE THE PURPOSE OF ING BANK IS TO EMPOWER PEOPLE TO STAY A STEP AHEAD IN LIFE AND IN BUSINESS Customers Countries Employees more than 33M private, corporate and institutional customers more than 40in Europe, North America, Latin America and Australia more than 52,000
  • 6.
    6 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD ING’s Continuous Delivery Journey SEP 2014 MAY 2013 NOV 2011 MAY 2011 OCT 2010 OCT 2009 MAY 2010 Google IO The will to change New IT mgt team 1st Scrum team and start agile development Start of mobile app development Clear demarcation responsibilities infra and app Discussion – who runs production Need full automation infra & scalable systems Build private cloud Engineers hunger to take responsibility Full reorganization (180 full DevOps teams) Continuous delivery pipeline – Jez Humble Start full automation of IT processes Engineering culture Start of our own Java community COMMON GOALS Higher quality Higher productivity Frequent releases
  • 7.
    7 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD We Have Achieved Continuous Delivery PRACTICES AND PEOPLE:  Agile scrum or kanban for all our changes  Continuous delivery for all our releases  DevOps and skilled IT engineers for our complete organization AUTOMATE EVERYTHING:  Provisioning of virtual machines  Builds  Code quality checks  Security checks TOTAL NUMBER OF RELEASES THE RESULTS SO FAR ARE GREAT:  Faster time to market (<6wks cycle time)  Lower number of incidents (>50% reduction)  Higher frequency of releases (>12,000 releases per month)  Deployments  Tests  Acceptance criteria  Metrics & analysis  Monitoring
  • 8.
    8 Š 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD TEAM MATURITY TOOL STANDARDS INSIGHTS RESILIENCY But How Can We Get to the Next Level?
  • 9.
  • 10.
    10 Š 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Our Continuous Delivery Pipeline Collects Metrics from All Parts of the Process CA Release Automation GitLab ArtifactoryJenkins Test tooling METRICS TOOLS EVENTBUS SOURCE BUILD REPOSITORY DEPLOYMENT TESTING DTAP
  • 11.
    11 Š 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD The Collected Data Is Used to Determine Release Maturity and Team Maturity BEFORE A RELEASE CAN BE DEPLOYED INTO PRODUCTION IT NEEDS TO COMPLY TO ALL THE ACCEPTANCE CRITERIA. WE COLLECT DATA IN A DATABASE SYSTEM AND MAKE COMPARISON WITH OTHER TEAMS POSSIBLE, TO HELP TEAMS TO IMPROVE! App 1 App 1 App 2
  • 12.
    12 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD THIS MEANS THE CD PIPELINE BECOMES TOO IMPORTANT TO FAIL! The CD Pipeline Is Becoming the Single Point of Control for the IT Landscape  Build new releases  Get feedback on the quality of the release  Deploy releases  Ensure built in quality of releases  Insight in the maturity of DevOps teams  Insight in the quality and costs of systems  What can be released to the customers ENGINEERS MANAGERS
  • 13.
    Continuous Delivery Pipelinewith APIs, Microservices and Containers
  • 14.
    14 Š 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD USER PORTAL We Improve Resilience with Microservices and Docker Containers CA Release Automation GitLab ArtifactoryJenkins Test tooling METRICS TOOLS EVENTBUS SOURCE BUILD REPOSITORY DEPLOYMENT TESTING DTAP APIs Container Platform (Mesos, Marathon, Chronos, Zookeeper) Run Microservices in a Docker container Run tools in a Docker container
  • 15.
    15 Š 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD New Techniques Maximize the Resilience of the CD Pipeline PRINCIPLES OF MAXIMIZING RESILIENCY MICROSERVICES OF CD PIPELINE CONTAINERS FOR MICROSERVICES AND TOOLS DATA OUTSIDE CONTAINERS REDUNDANT SERVICES CONTINUOUS IMPROVEMENT
  • 16.
    16 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Summary  The last 6 years ING has been transforming itself to an Agile organization.  A Continuous Delivery Pipeline has been developed for IT engineers to improve their software delivery.  Now we have to roll this out globally within ING to enable collaboration.  To make this pipeline more resilient, we run a lot of solutions in containers.  We split our custom build software in microservices, and run them in a High Availability mode.  We use APIs to connect standard tooling to portals, to enhance user experience. 1 2 3 4 5 6
  • 17.
    17 Š 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Recommended Sessions SESSION # TITLE DATE/TIME DO4T31T Tech Talk: Harness the Power of Innovations Like Microservice Architecture and Containers 11/18/2015 at 3:45 pm DO4T152S Tech Primer: Exploit New Levels of Insight, Orchestration and Governance for Complex Application Releases, End-to-End, with New Continuous Delivery Solution 11/18/2015 at 4:30 pm DO4X213L Hands-On Lab: Complement CA Release Automation with a New Continuous Delivery Solution Offering A Visual Approach for Complex Application Releases 11/19/2015 at 2:00 pm
  • 18.
    18 Š 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Must See Demos CA Release Automation CA Release Automation Theater 4 Cloud & SaaS Deployments CA Release Automation Theater 4 CA RA Rapid Dev. Kit, SDK CA Release Automation Theater 4 Integrations CA Release Automation Theater 4
  • 19.
    19 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Follow On Conversations At… Smart Bar CA Release Automation Theater 4 Tech Talks CA Release Automation Theater 4
  • 20.
    20 Š 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Q & A
  • 21.
    21 Š 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD For Informational Purposes Only Š 2015 CA. All rights reserved. All trademarks referenced herein belong to their respective companies. The content provided in this CA World 2015 presentation is intended for informational purposes only and does not form any type of warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA. Terms of this Presentation
  • 22.
    22 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD For More Information To learn more, please visit: http://cainc.to/Nv2VOe CA World ’15