SlideShare a Scribd company logo
1 of 95
Download to read offline
Continuous Delivery - The ING Story 
Improving time to market with DevOps and Continuous Delivery 
Wouter Meijs 
DOT05S #CAWorld 
ING Bank 
Head of Delivery Center Core Bank 
DevOps
2 
© 2014 CA. ALL RIGHTS RESERVED. 
Agenda 
INTRODUCTION 
CHANGING WORLD 
THE NEXT FRONTIERS: WHAT LIES AHEAD? 
CONTINUOUS DELIVERY: REDEFINING IT 
WHAT WE DID AT ING 
CHALLENGES 
1 
2 
3 
4 
5 
6
3 
© 2014 CA. ALL RIGHTS RESERVED. 
ING: A global Financial Services Group 
Over 33 millionclients 
40different countries 
64,000employees of which15,000IT 
€15 bn annual revenue
4 © 2014 CA. ALL RIGHTS RESERVED. 
160 million 
euro 
distributed 
each day 
in the 
Netherlands
5 
© 2014 CA. ALL RIGHTS RESERVED. 
every 5 minutes, 100 million euro is turned over at the dealing room and our systems
6 
© 2014 CA. ALL RIGHTS RESERVED. 
Agenda 
INTRODUCTION 
CHANGING WORLD 
THE NEXT FRONTIERS: WHAT LIES AHEAD? 
CONTINUOUS DELIVERY: REDEFINING IT 
WHAT WE DID AT ING 
CHALLENGES 
1 
2 
3 
4 
5 
6
7 
© 2014 CA. ALL RIGHTS RESERVED. 
Technology is changing faster every year
8 
© 2014 CA. ALL RIGHTS RESERVED. 
From 0 to 1 billion smart phones 
In less than 10 years
9 
© 2014 CA. ALL RIGHTS RESERVED. 
People’s expectations grow along 
Both customers and employees
10 
© 2014 CA. ALL RIGHTS RESERVED. 
Access anytime anywhere anyhow
11 
© 2014 CA. ALL RIGHTS RESERVED. 
Zero tolerance for digital failure
12 
© 2014 CA. ALL RIGHTS RESERVED. 
Be amazed by new features
13 
© 2014 CA. ALL RIGHTS RESERVED.
14 
© 2014 CA. ALL RIGHTS RESERVED. 
Complete industries are changing
15 
© 2014 CA. ALL RIGHTS RESERVED. 
Spotifyand Netflix are obliterating video and record stores
16 
© 2014 CA. ALL RIGHTS RESERVED. 
As a Bank We are not Immune
17 
© 2014 CA. ALL RIGHTS RESERVED. 
Traditionally people deposited their money into banks
18 
© 2014 CA. ALL RIGHTS RESERVED. 
It was kept in safes 
And accessed through checks
19 
© 2014 CA. ALL RIGHTS RESERVED. 
You don’t need 150 years of tradition to start a bank anymore
20 
© 2014 CA. ALL RIGHTS RESERVED. 
Technology opens the door to many more competitors 
…and perhaps takes banks out of the equation
21 
© 2014 CA. ALL RIGHTS RESERVED. 
People Need Banking 
not banks
22 
© 2014 CA. ALL RIGHTS RESERVED. 
Agenda 
INTRODUCTION 
CHANGING WORLD 
THE NEXT FRONTIERS: WHAT LIES AHEAD? 
CONTINUOUS DELIVERY: REDEFINING IT 
WHAT WE DID AT ING 
CHALLENGES 
1 
2 
3 
4 
5 
6
23 
© 2014 CA. ALL RIGHTS RESERVED. 
Traditional Waterfall Projects Fail to Support this
24 
© 2014 CA. ALL RIGHTS RESERVED. 
The OLDways
25 
© 2014 CA. ALL RIGHTS RESERVED. 
The Dream
26 
© 2014 CA. ALL RIGHTS RESERVED. 
The Design
27 
© 2014 CA. ALL RIGHTS RESERVED. 
The Specs
28 
© 2014 CA. ALL RIGHTS RESERVED. 
The PiD
29 
© 2014 CA. ALL RIGHTS RESERVED. 
The Development 
CHANGING REQUIREMENTS 
DESIGN FAILS
30 
© 2014 CA. ALL RIGHTS RESERVED. 
The Testing 
TEST 
FAILURES 
DEPLOYMENT ISSUES
31 
© 2014 CA. ALL RIGHTS RESERVED. 
The Result
32 
© 2014 CA. ALL RIGHTS RESERVED. 
The Result
33 
© 2014 CA. ALL RIGHTS RESERVED. 
The Result
34 
© 2014 CA. ALL RIGHTS RESERVED. 
To stop this … 
You have to speed up your delivery cycle
35 
© 2014 CA. ALL RIGHTS RESERVED. 
Agile Scrum Made the First Move… 
…but the next bottleneck is deployment on production
36 
© 2014 CA. ALL RIGHTS RESERVED. 
Continuous delivery 
Every change tested on production like environment
37 
© 2014 CA. ALL RIGHTS RESERVED. 
Continuous delivery 
Multiple deploys on preproduction per day 
Releasing becomes business decision
38 
© 2014 CA. ALL RIGHTS RESERVED. 
Everything is automated 
Configuration management 
Testing 
Deployments
39 
© 2014 CA. ALL RIGHTS RESERVED. 
Bridge the gap between Devand Ops
40 
© 2014 CA. ALL RIGHTS RESERVED.
41 
© 2014 CA. ALL RIGHTS RESERVED.
42 
© 2014 CA. ALL RIGHTS RESERVED. 
DevOps 
Devand Ops working together in one team with one backlog
43 
© 2014 CA. ALL RIGHTS RESERVED. 
A NEWway of working
44 
© 2014 CA. ALL RIGHTS RESERVED. 
The Dream
45 
© 2014 CA. ALL RIGHTS RESERVED. 
The Demo
46 
© 2014 CA. ALL RIGHTS RESERVED. 
The Minimal Viable Product
47 
© 2014 CA. ALL RIGHTS RESERVED. 
The Second Release
48 
© 2014 CA. ALL RIGHTS RESERVED. 
The Nth Release
49 
© 2014 CA. ALL RIGHTS RESERVED. 
The Nth Release
50 
© 2014 CA. ALL RIGHTS RESERVED. 
The Nth Release
51 
© 2014 CA. ALL RIGHTS RESERVED. 
The Nth Release
52 
© 2014 CA. ALL RIGHTS RESERVED. 
MAKE YOUR OWN EGGS! BUY OUR PAINT
53 
© 2014 CA. ALL RIGHTS RESERVED. 
Agenda 
INTRODUCTION 
CHANGING WORLD 
THE NEXT FRONTIERS: WHAT LIES AHEAD? 
CONTINUOUS DELIVERY: REDEFINING IT 
WHAT WE DID AT ING 
CHALLENGES 
1 
2 
3 
4 
5 
6
54 
© 2014 CA. ALL RIGHTS RESERVED. 
Mobile Banking App 
0 
2000 
4000 
6000 
8000 
10000 
12000 
14000 
16000 
18000 
Total number of deployments per month
55 
© 2014 CA. ALL RIGHTS RESERVED. 
Mobile Banking App
56 
© 2014 CA. ALL RIGHTS RESERVED. 
Full Continuous Delivery Process with Nightly Builds
57 
© 2014 CA. ALL RIGHTS RESERVED.
58 
© 2014 CA. ALL RIGHTS RESERVED. 
Failed test results sent by WhatsAppto all developers
59 
© 2014 CA. ALL RIGHTS RESERVED. 
3-6 Weeks Releases, Priority Set by Customers in iStore
60 
© 2014 CA. ALL RIGHTS RESERVED. 
From 1 Star to 4 Stars in the iStore
61 
© 2014 CA. ALL RIGHTS RESERVED.
62 
© 2014 CA. ALL RIGHTS RESERVED. 
Continuous Delivery is not just for Web Applications 
ING’s Core Product Engine
63 
© 2014 CA. ALL RIGHTS RESERVED. 
ING Core Bank 
Savings, Loans, Current Accounts 
12 million accounts 
10 DevOps teams
64 
© 2014 CA. ALL RIGHTS RESERVED. 
Continuous Delivery is not just for Web Applications 
One Branch 
One automated test set 
One CD pipeline
65 
© 2014 CA. ALL RIGHTS RESERVED. 
Time to market from >20 weeks 
To 4 days
66 
© 2014 CA. ALL RIGHTS RESERVED. 
Test coverage increased from 30% to 80% 
and throughput time from 4 weeks to 6 hours
67 
© 2014 CA. ALL RIGHTS RESERVED. 
From 30+ outages in 2013 to 0 in 2014 
While increasing releases from 4 per year to every 3 weeks
68 
© 2014 CA. ALL RIGHTS RESERVED. 
DR test from 4 hours to 12 minutes 
And 10 seconds by the end of next year
69 
© 2014 CA. ALL RIGHTS RESERVED. 
Infrastructure provisioning
70 
© 2014 CA. ALL RIGHTS RESERVED. 
How long does it take you to deploy your application? 
INCLUDING ROLE BASED ACCESS 
INCLUDING MONITORING 
INCLUDING CONNECTIVITY
71 
© 2014 CA. ALL RIGHTS RESERVED. 
Within ING it takes > 200 days
72 
© 2014 CA. ALL RIGHTS RESERVED.
73 
© 2014 CA. ALL RIGHTS RESERVED. 
Agenda 
INTRODUCTION 
CHANGING WORLD 
THE NEXT FRONTIERS: WHAT LIES AHEAD? 
CONTINUOUS DELIVERY: REDEFINING IT 
WHAT WE DID AT ING 
CHALLENGES 
1 
2 
3 
4 
5 
6
74 
© 2014 CA. ALL RIGHTS RESERVED. 
Biggest challenge is people 
Mindset & Behaviour 
Engineering culture 
Stakeholders 
Suppliers
75 
© 2014 CA. ALL RIGHTS RESERVED. 
CD will fail without the right mindset and behavior
76 
© 2014 CA. ALL RIGHTS RESERVED. 
Start where it hurts
77 
© 2014 CA. ALL RIGHTS RESERVED. 
Realize Improvements Every Three Months
78 
© 2014 CA. ALL RIGHTS RESERVED. 
Patience
79 
© 2014 CA. ALL RIGHTS RESERVED. 
How to transform your workforce?
80 
© 2014 CA. ALL RIGHTS RESERVED. 
Training
81 
© 2014 CA. ALL RIGHTS RESERVED. 
Attract the Best Talent in the World
82 
© 2014 CA. ALL RIGHTS RESERVED. 
CD talent is rare 
War on talent 
Engineers look for great engineering, not money
83 
© 2014 CA. ALL RIGHTS RESERVED. 
Be content leaders yourself
84 
© 2014 CA. ALL RIGHTS RESERVED. 
Business stakeholders 
BEFORE 
We cannot deliver on the agreed time lines 
That is not our fault 
We need a lot of money for things you do not understand
85 
© 2014 CA. ALL RIGHTS RESERVED. 
Business stakeholders 
AFTER 
Directly responsible for prioritization of backlog 
Define minimal viable product together
86 
© 2014 CA. ALL RIGHTS RESERVED. 
Suppliers 
BEFORE 
Large releases every 6 –12 months 
Service Level Agreements
87 
© 2014 CA. ALL RIGHTS RESERVED. 
AFTER 
Small and frequent releases 
100% availability 
Suppliers 
Co-sourcing
88 
© 2014 CA. ALL RIGHTS RESERVED. 
Your CD pipeline has to be 100% available 
Dependence on Technology:
91 
© 2014 CA. ALL RIGHTS RESERVED. 
Agenda 
INTRODUCTION 
CHANGING WORLD 
THE NEXT FRONTIERS: WHAT LIES AHEAD? 
CONTINUOUS DELIVERY: REDEFINING IT 
WHAT WE DID AT ING 
CHALLENGES 
1 
2 
3 
4 
5 
6
92 
© 2014 CA. ALL RIGHTS RESERVED. 
What if we’re only halfway there?
93 
© 2014 CA. ALL RIGHTS RESERVED. 
Role based access should be standardized 
Automated security 
Security settings deployed as part of the pipeline
94 
© 2014 CA. ALL RIGHTS RESERVED. 
CD pipeline as a service 
We want to build banking software, not automation
95 
© 2014 CA. ALL RIGHTS RESERVED. 
As many as 50 teams working on one release 
Chain
96 
© 2014 CA. ALL RIGHTS RESERVED. 
Where Does it Stop: Continuous Delivery in a Bank 
Secure financial service 
Managing a customer’s financial future is not like streaming video’s 
There is a danger of blindly following Google, Spotify and Netflix
97 
© 2014 CA. ALL RIGHTS RESERVED. 
For More Information 
To learn more about DevOps, please visit: 
http://bit.ly/1wbjjqX 
Insert appropriate screenshot and textoverlayfrom following“More Info Graphics” slide here; ensure it links to correct page 
DevOps

More Related Content

What's hot

The Buffer Culture (with a new 10th value)
The Buffer Culture (with a new 10th value)The Buffer Culture (with a new 10th value)
The Buffer Culture (with a new 10th value)Buffer
 
Culture (Original 2009 version)
Culture (Original 2009 version)Culture (Original 2009 version)
Culture (Original 2009 version)Reed Hastings
 
Culture Code: Creating A Lovable Company
Culture Code: Creating A Lovable CompanyCulture Code: Creating A Lovable Company
Culture Code: Creating A Lovable CompanyHubSpot
 
Code as Craft: Building a Strong Engineering Culture at Etsy
Code as Craft: Building a Strong Engineering Culture at EtsyCode as Craft: Building a Strong Engineering Culture at Etsy
Code as Craft: Building a Strong Engineering Culture at EtsyChad Dickerson
 
Buffer culture 0.6 (With a change to Be a No Ego Doer)
Buffer culture 0.6 (With a change to Be a No Ego Doer)Buffer culture 0.6 (With a change to Be a No Ego Doer)
Buffer culture 0.6 (With a change to Be a No Ego Doer)Buffer
 
Hootsuite's Manifesto: Building a Social Revolution
Hootsuite's Manifesto: Building a Social RevolutionHootsuite's Manifesto: Building a Social Revolution
Hootsuite's Manifesto: Building a Social RevolutionHootsuite
 
Project To Product: How we transitioned to product-aligned value streams
Project To Product: How we transitioned to product-aligned value streamsProject To Product: How we transitioned to product-aligned value streams
Project To Product: How we transitioned to product-aligned value streamsTasktop
 
Agile Transformation
Agile TransformationAgile Transformation
Agile TransformationMax Carlin
 
Front Series D Investor Deck
Front Series D Investor DeckFront Series D Investor Deck
Front Series D Investor DeckFront
 
Are You Being Agile or Doing Agile?
Are You Being Agile or Doing Agile?Are You Being Agile or Doing Agile?
Are You Being Agile or Doing Agile?Brad Appleton
 
Platform as a Product: How to Delight Your Developers and Deliver Value for Y...
Platform as a Product: How to Delight Your Developers and Deliver Value for Y...Platform as a Product: How to Delight Your Developers and Deliver Value for Y...
Platform as a Product: How to Delight Your Developers and Deliver Value for Y...VMware Tanzu
 
Prosci's "CMROI Calculator: Interactive Inside Look" Webinar
Prosci's "CMROI Calculator: Interactive Inside Look" WebinarProsci's "CMROI Calculator: Interactive Inside Look" Webinar
Prosci's "CMROI Calculator: Interactive Inside Look" WebinarTim Creasey
 
Foundr Magazine Culture Deck
Foundr Magazine Culture DeckFoundr Magazine Culture Deck
Foundr Magazine Culture Deckfoundr
 
GiveForward culture deck
GiveForward culture deckGiveForward culture deck
GiveForward culture deckethan austin
 
The Asana Culture Code
The Asana Culture CodeThe Asana Culture Code
The Asana Culture CodeAsana
 
U.S. Technology Funding -- What's Going On?
U.S. Technology Funding -- What's Going On? U.S. Technology Funding -- What's Going On?
U.S. Technology Funding -- What's Going On? a16z
 

What's hot (20)

The Buffer Culture (with a new 10th value)
The Buffer Culture (with a new 10th value)The Buffer Culture (with a new 10th value)
The Buffer Culture (with a new 10th value)
 
Culture (Original 2009 version)
Culture (Original 2009 version)Culture (Original 2009 version)
Culture (Original 2009 version)
 
Culture Code: Creating A Lovable Company
Culture Code: Creating A Lovable CompanyCulture Code: Creating A Lovable Company
Culture Code: Creating A Lovable Company
 
Code as Craft: Building a Strong Engineering Culture at Etsy
Code as Craft: Building a Strong Engineering Culture at EtsyCode as Craft: Building a Strong Engineering Culture at Etsy
Code as Craft: Building a Strong Engineering Culture at Etsy
 
Veritas Total Solutions Culture Code
Veritas Total Solutions Culture CodeVeritas Total Solutions Culture Code
Veritas Total Solutions Culture Code
 
Buffer culture 0.6 (With a change to Be a No Ego Doer)
Buffer culture 0.6 (With a change to Be a No Ego Doer)Buffer culture 0.6 (With a change to Be a No Ego Doer)
Buffer culture 0.6 (With a change to Be a No Ego Doer)
 
Hootsuite's Manifesto: Building a Social Revolution
Hootsuite's Manifesto: Building a Social RevolutionHootsuite's Manifesto: Building a Social Revolution
Hootsuite's Manifesto: Building a Social Revolution
 
Google culture deck
Google culture deckGoogle culture deck
Google culture deck
 
Project To Product: How we transitioned to product-aligned value streams
Project To Product: How we transitioned to product-aligned value streamsProject To Product: How we transitioned to product-aligned value streams
Project To Product: How we transitioned to product-aligned value streams
 
Agile Transformation
Agile TransformationAgile Transformation
Agile Transformation
 
Front Series D Investor Deck
Front Series D Investor DeckFront Series D Investor Deck
Front Series D Investor Deck
 
Are You Being Agile or Doing Agile?
Are You Being Agile or Doing Agile?Are You Being Agile or Doing Agile?
Are You Being Agile or Doing Agile?
 
Platform as a Product: How to Delight Your Developers and Deliver Value for Y...
Platform as a Product: How to Delight Your Developers and Deliver Value for Y...Platform as a Product: How to Delight Your Developers and Deliver Value for Y...
Platform as a Product: How to Delight Your Developers and Deliver Value for Y...
 
Prosci's "CMROI Calculator: Interactive Inside Look" Webinar
Prosci's "CMROI Calculator: Interactive Inside Look" WebinarProsci's "CMROI Calculator: Interactive Inside Look" Webinar
Prosci's "CMROI Calculator: Interactive Inside Look" Webinar
 
Culture
CultureCulture
Culture
 
Foundr Magazine Culture Deck
Foundr Magazine Culture DeckFoundr Magazine Culture Deck
Foundr Magazine Culture Deck
 
GiveForward culture deck
GiveForward culture deckGiveForward culture deck
GiveForward culture deck
 
The Asana Culture Code
The Asana Culture CodeThe Asana Culture Code
The Asana Culture Code
 
U.S. Technology Funding -- What's Going On?
U.S. Technology Funding -- What's Going On? U.S. Technology Funding -- What's Going On?
U.S. Technology Funding -- What's Going On?
 
Ideo culture deck
Ideo culture deckIdeo culture deck
Ideo culture deck
 

Similar to Continuous Delivery - The ING Story: Improving time to market with DevOps and Continuous Delivery

ICTO14 - Karel van der Poel, Producteigenaar BI & Analytics ServiceNow
ICTO14 - Karel van der Poel, Producteigenaar BI & Analytics ServiceNowICTO14 - Karel van der Poel, Producteigenaar BI & Analytics ServiceNow
ICTO14 - Karel van der Poel, Producteigenaar BI & Analytics ServiceNowICT Ondernemerschap
 
Freeing the World from Slow: How Service Virtualization and the Concept of S....
Freeing the World from Slow: How Service Virtualization and the Concept of S....Freeing the World from Slow: How Service Virtualization and the Concept of S....
Freeing the World from Slow: How Service Virtualization and the Concept of S....CA Technologies
 
Why DevOps Matters To The CIO
Why DevOps Matters To The CIOWhy DevOps Matters To The CIO
Why DevOps Matters To The CIObenjaminwootton
 
Vision and Roadmap: Learn How Application Release Solutions Help You Lead th...
Vision and Roadmap: Learn How Application Release Solutions Help You Lead th...Vision and Roadmap: Learn How Application Release Solutions Help You Lead th...
Vision and Roadmap: Learn How Application Release Solutions Help You Lead th...CA Technologies
 
Go to sleep DevOps networking forum 3-14-2016
Go to sleep DevOps networking forum 3-14-2016Go to sleep DevOps networking forum 3-14-2016
Go to sleep DevOps networking forum 3-14-2016Colin McNamara
 
A Week in the Life (of DevOps)
A Week in the Life (of DevOps)A Week in the Life (of DevOps)
A Week in the Life (of DevOps)CA Technologies
 
Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...
Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...
Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...CA Technologies
 
Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...
Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...
Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...CA Technologies
 
Continuous Delivery: the Strongest Link in Your Value Chain
Continuous Delivery: the Strongest Link in Your Value ChainContinuous Delivery: the Strongest Link in Your Value Chain
Continuous Delivery: the Strongest Link in Your Value ChainCA Technologies
 
How Expedia Improved Developer Productivity and Reduced MTTR by Over 90%
How Expedia Improved Developer Productivity and Reduced MTTR by Over 90%How Expedia Improved Developer Productivity and Reduced MTTR by Over 90%
How Expedia Improved Developer Productivity and Reduced MTTR by Over 90%DevOps.com
 
Velocity 2014 Tool Chain Choices
Velocity 2014 Tool Chain ChoicesVelocity 2014 Tool Chain Choices
Velocity 2014 Tool Chain ChoicesMark Sigler
 
Case Study: Worry Free Application Deployments...Really!
Case Study: Worry Free Application Deployments...Really!Case Study: Worry Free Application Deployments...Really!
Case Study: Worry Free Application Deployments...Really!CA Technologies
 
The Coupa Organic Platform from A to Z: Maximizing the Value
The Coupa Organic Platform from A to Z: Maximizing the ValueThe Coupa Organic Platform from A to Z: Maximizing the Value
The Coupa Organic Platform from A to Z: Maximizing the ValueCoupa Software
 
Appetite for Disruption: Realigning Digital Video Business Models
Appetite for Disruption: Realigning Digital Video Business ModelsAppetite for Disruption: Realigning Digital Video Business Models
Appetite for Disruption: Realigning Digital Video Business Modelsaccenture
 
The Service-Oriented Enterprise with ServiceNow
The Service-Oriented Enterprise with ServiceNowThe Service-Oriented Enterprise with ServiceNow
The Service-Oriented Enterprise with ServiceNowAspediens
 
Journey to The Cloud-Native Enterprise
Journey to The Cloud-Native Enterprise Journey to The Cloud-Native Enterprise
Journey to The Cloud-Native Enterprise dektlong
 
Bringing Partners, Teams & Systems Together through APIs
Bringing Partners, Teams & Systems Together through APIsBringing Partners, Teams & Systems Together through APIs
Bringing Partners, Teams & Systems Together through APIsApigee | Google Cloud
 
Case Study: ING Builds Highly Available Continuous Delivery Pipeline with Mic...
Case Study: ING Builds Highly Available Continuous Delivery Pipeline with Mic...Case Study: ING Builds Highly Available Continuous Delivery Pipeline with Mic...
Case Study: ING Builds Highly Available Continuous Delivery Pipeline with Mic...CA Technologies
 
Moving forward in your DevOps journey—What's your next step after CA World?
Moving forward in your DevOps journey—What's your next step after CA World?Moving forward in your DevOps journey—What's your next step after CA World?
Moving forward in your DevOps journey—What's your next step after CA World?CA Technologies
 

Similar to Continuous Delivery - The ING Story: Improving time to market with DevOps and Continuous Delivery (20)

Backup manager
Backup manager Backup manager
Backup manager
 
ICTO14 - Karel van der Poel, Producteigenaar BI & Analytics ServiceNow
ICTO14 - Karel van der Poel, Producteigenaar BI & Analytics ServiceNowICTO14 - Karel van der Poel, Producteigenaar BI & Analytics ServiceNow
ICTO14 - Karel van der Poel, Producteigenaar BI & Analytics ServiceNow
 
Freeing the World from Slow: How Service Virtualization and the Concept of S....
Freeing the World from Slow: How Service Virtualization and the Concept of S....Freeing the World from Slow: How Service Virtualization and the Concept of S....
Freeing the World from Slow: How Service Virtualization and the Concept of S....
 
Why DevOps Matters To The CIO
Why DevOps Matters To The CIOWhy DevOps Matters To The CIO
Why DevOps Matters To The CIO
 
Vision and Roadmap: Learn How Application Release Solutions Help You Lead th...
Vision and Roadmap: Learn How Application Release Solutions Help You Lead th...Vision and Roadmap: Learn How Application Release Solutions Help You Lead th...
Vision and Roadmap: Learn How Application Release Solutions Help You Lead th...
 
Go to sleep DevOps networking forum 3-14-2016
Go to sleep DevOps networking forum 3-14-2016Go to sleep DevOps networking forum 3-14-2016
Go to sleep DevOps networking forum 3-14-2016
 
A Week in the Life (of DevOps)
A Week in the Life (of DevOps)A Week in the Life (of DevOps)
A Week in the Life (of DevOps)
 
Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...
Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...
Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...
 
Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...
Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...
Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...
 
Continuous Delivery: the Strongest Link in Your Value Chain
Continuous Delivery: the Strongest Link in Your Value ChainContinuous Delivery: the Strongest Link in Your Value Chain
Continuous Delivery: the Strongest Link in Your Value Chain
 
How Expedia Improved Developer Productivity and Reduced MTTR by Over 90%
How Expedia Improved Developer Productivity and Reduced MTTR by Over 90%How Expedia Improved Developer Productivity and Reduced MTTR by Over 90%
How Expedia Improved Developer Productivity and Reduced MTTR by Over 90%
 
Velocity 2014 Tool Chain Choices
Velocity 2014 Tool Chain ChoicesVelocity 2014 Tool Chain Choices
Velocity 2014 Tool Chain Choices
 
Case Study: Worry Free Application Deployments...Really!
Case Study: Worry Free Application Deployments...Really!Case Study: Worry Free Application Deployments...Really!
Case Study: Worry Free Application Deployments...Really!
 
The Coupa Organic Platform from A to Z: Maximizing the Value
The Coupa Organic Platform from A to Z: Maximizing the ValueThe Coupa Organic Platform from A to Z: Maximizing the Value
The Coupa Organic Platform from A to Z: Maximizing the Value
 
Appetite for Disruption: Realigning Digital Video Business Models
Appetite for Disruption: Realigning Digital Video Business ModelsAppetite for Disruption: Realigning Digital Video Business Models
Appetite for Disruption: Realigning Digital Video Business Models
 
The Service-Oriented Enterprise with ServiceNow
The Service-Oriented Enterprise with ServiceNowThe Service-Oriented Enterprise with ServiceNow
The Service-Oriented Enterprise with ServiceNow
 
Journey to The Cloud-Native Enterprise
Journey to The Cloud-Native Enterprise Journey to The Cloud-Native Enterprise
Journey to The Cloud-Native Enterprise
 
Bringing Partners, Teams & Systems Together through APIs
Bringing Partners, Teams & Systems Together through APIsBringing Partners, Teams & Systems Together through APIs
Bringing Partners, Teams & Systems Together through APIs
 
Case Study: ING Builds Highly Available Continuous Delivery Pipeline with Mic...
Case Study: ING Builds Highly Available Continuous Delivery Pipeline with Mic...Case Study: ING Builds Highly Available Continuous Delivery Pipeline with Mic...
Case Study: ING Builds Highly Available Continuous Delivery Pipeline with Mic...
 
Moving forward in your DevOps journey—What's your next step after CA World?
Moving forward in your DevOps journey—What's your next step after CA World?Moving forward in your DevOps journey—What's your next step after CA World?
Moving forward in your DevOps journey—What's your next step after CA World?
 

More from CA Technologies

CA Mainframe Resource Intelligence
CA Mainframe Resource IntelligenceCA Mainframe Resource Intelligence
CA Mainframe Resource IntelligenceCA Technologies
 
Mainframe as a Service: Sample a Buffet of IBM z/OS® Platform Excellence
Mainframe as a Service: Sample a Buffet of IBM z/OS® Platform ExcellenceMainframe as a Service: Sample a Buffet of IBM z/OS® Platform Excellence
Mainframe as a Service: Sample a Buffet of IBM z/OS® Platform ExcellenceCA Technologies
 
Case Study: How CA Went From 40 Days to Three Days Building Crystal-Clear Tes...
Case Study: How CA Went From 40 Days to Three Days Building Crystal-Clear Tes...Case Study: How CA Went From 40 Days to Three Days Building Crystal-Clear Tes...
Case Study: How CA Went From 40 Days to Three Days Building Crystal-Clear Tes...CA Technologies
 
Case Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software DevelopmentCase Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software DevelopmentCA Technologies
 
Pre-Con Ed: Privileged Identity Governance: Are You Certifying Privileged Use...
Pre-Con Ed: Privileged Identity Governance: Are You Certifying Privileged Use...Pre-Con Ed: Privileged Identity Governance: Are You Certifying Privileged Use...
Pre-Con Ed: Privileged Identity Governance: Are You Certifying Privileged Use...CA Technologies
 
Case Study: Privileged Access in a World on Time
Case Study: Privileged Access in a World on TimeCase Study: Privileged Access in a World on Time
Case Study: Privileged Access in a World on TimeCA Technologies
 
Case Study: How SGN Used Attack Path Mapping to Control Privileged Access in ...
Case Study: How SGN Used Attack Path Mapping to Control Privileged Access in ...Case Study: How SGN Used Attack Path Mapping to Control Privileged Access in ...
Case Study: How SGN Used Attack Path Mapping to Control Privileged Access in ...CA Technologies
 
Case Study: Putting Citizens at The Center of Digital Government
Case Study: Putting Citizens at The Center of Digital GovernmentCase Study: Putting Citizens at The Center of Digital Government
Case Study: Putting Citizens at The Center of Digital GovernmentCA Technologies
 
Making Security Work—Implementing a Transformational Security Program
Making Security Work—Implementing a Transformational Security ProgramMaking Security Work—Implementing a Transformational Security Program
Making Security Work—Implementing a Transformational Security ProgramCA Technologies
 
Keynote: Making Security a Competitive Advantage
Keynote: Making Security a Competitive AdvantageKeynote: Making Security a Competitive Advantage
Keynote: Making Security a Competitive AdvantageCA Technologies
 
Emerging Managed Services Opportunities in Identity and Access Management
Emerging Managed Services Opportunities in Identity and Access ManagementEmerging Managed Services Opportunities in Identity and Access Management
Emerging Managed Services Opportunities in Identity and Access ManagementCA Technologies
 
The Unmet Demand for Premium Cloud Monitoring Services—and How Service Provid...
The Unmet Demand for Premium Cloud Monitoring Services—and How Service Provid...The Unmet Demand for Premium Cloud Monitoring Services—and How Service Provid...
The Unmet Demand for Premium Cloud Monitoring Services—and How Service Provid...CA Technologies
 
Leveraging Monitoring Governance: How Service Providers Can Boost Operational...
Leveraging Monitoring Governance: How Service Providers Can Boost Operational...Leveraging Monitoring Governance: How Service Providers Can Boost Operational...
Leveraging Monitoring Governance: How Service Providers Can Boost Operational...CA Technologies
 
The Next Big Service Provider Opportunity—Beyond Infrastructure: Architecting...
The Next Big Service Provider Opportunity—Beyond Infrastructure: Architecting...The Next Big Service Provider Opportunity—Beyond Infrastructure: Architecting...
The Next Big Service Provider Opportunity—Beyond Infrastructure: Architecting...CA Technologies
 
Application Experience Analytics Services: The Strategic Digital Transformati...
Application Experience Analytics Services: The Strategic Digital Transformati...Application Experience Analytics Services: The Strategic Digital Transformati...
Application Experience Analytics Services: The Strategic Digital Transformati...CA Technologies
 
Application Experience Analytics Services: The Strategic Digital Transformati...
Application Experience Analytics Services: The Strategic Digital Transformati...Application Experience Analytics Services: The Strategic Digital Transformati...
Application Experience Analytics Services: The Strategic Digital Transformati...CA Technologies
 
Strategic Direction Session: Deliver Next-Gen IT Ops with CA Mainframe Operat...
Strategic Direction Session: Deliver Next-Gen IT Ops with CA Mainframe Operat...Strategic Direction Session: Deliver Next-Gen IT Ops with CA Mainframe Operat...
Strategic Direction Session: Deliver Next-Gen IT Ops with CA Mainframe Operat...CA Technologies
 
Strategic Direction Session: Enhancing Data Privacy with Data-Centric Securit...
Strategic Direction Session: Enhancing Data Privacy with Data-Centric Securit...Strategic Direction Session: Enhancing Data Privacy with Data-Centric Securit...
Strategic Direction Session: Enhancing Data Privacy with Data-Centric Securit...CA Technologies
 
Blockchain: Strategies for Moving From Hype to Realities of Deployment
Blockchain: Strategies for Moving From Hype to Realities of DeploymentBlockchain: Strategies for Moving From Hype to Realities of Deployment
Blockchain: Strategies for Moving From Hype to Realities of DeploymentCA Technologies
 
Establish Digital Trust as the Currency of Digital Enterprise
Establish Digital Trust as the Currency of Digital EnterpriseEstablish Digital Trust as the Currency of Digital Enterprise
Establish Digital Trust as the Currency of Digital EnterpriseCA Technologies
 

More from CA Technologies (20)

CA Mainframe Resource Intelligence
CA Mainframe Resource IntelligenceCA Mainframe Resource Intelligence
CA Mainframe Resource Intelligence
 
Mainframe as a Service: Sample a Buffet of IBM z/OS® Platform Excellence
Mainframe as a Service: Sample a Buffet of IBM z/OS® Platform ExcellenceMainframe as a Service: Sample a Buffet of IBM z/OS® Platform Excellence
Mainframe as a Service: Sample a Buffet of IBM z/OS® Platform Excellence
 
Case Study: How CA Went From 40 Days to Three Days Building Crystal-Clear Tes...
Case Study: How CA Went From 40 Days to Three Days Building Crystal-Clear Tes...Case Study: How CA Went From 40 Days to Three Days Building Crystal-Clear Tes...
Case Study: How CA Went From 40 Days to Three Days Building Crystal-Clear Tes...
 
Case Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software DevelopmentCase Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software Development
 
Pre-Con Ed: Privileged Identity Governance: Are You Certifying Privileged Use...
Pre-Con Ed: Privileged Identity Governance: Are You Certifying Privileged Use...Pre-Con Ed: Privileged Identity Governance: Are You Certifying Privileged Use...
Pre-Con Ed: Privileged Identity Governance: Are You Certifying Privileged Use...
 
Case Study: Privileged Access in a World on Time
Case Study: Privileged Access in a World on TimeCase Study: Privileged Access in a World on Time
Case Study: Privileged Access in a World on Time
 
Case Study: How SGN Used Attack Path Mapping to Control Privileged Access in ...
Case Study: How SGN Used Attack Path Mapping to Control Privileged Access in ...Case Study: How SGN Used Attack Path Mapping to Control Privileged Access in ...
Case Study: How SGN Used Attack Path Mapping to Control Privileged Access in ...
 
Case Study: Putting Citizens at The Center of Digital Government
Case Study: Putting Citizens at The Center of Digital GovernmentCase Study: Putting Citizens at The Center of Digital Government
Case Study: Putting Citizens at The Center of Digital Government
 
Making Security Work—Implementing a Transformational Security Program
Making Security Work—Implementing a Transformational Security ProgramMaking Security Work—Implementing a Transformational Security Program
Making Security Work—Implementing a Transformational Security Program
 
Keynote: Making Security a Competitive Advantage
Keynote: Making Security a Competitive AdvantageKeynote: Making Security a Competitive Advantage
Keynote: Making Security a Competitive Advantage
 
Emerging Managed Services Opportunities in Identity and Access Management
Emerging Managed Services Opportunities in Identity and Access ManagementEmerging Managed Services Opportunities in Identity and Access Management
Emerging Managed Services Opportunities in Identity and Access Management
 
The Unmet Demand for Premium Cloud Monitoring Services—and How Service Provid...
The Unmet Demand for Premium Cloud Monitoring Services—and How Service Provid...The Unmet Demand for Premium Cloud Monitoring Services—and How Service Provid...
The Unmet Demand for Premium Cloud Monitoring Services—and How Service Provid...
 
Leveraging Monitoring Governance: How Service Providers Can Boost Operational...
Leveraging Monitoring Governance: How Service Providers Can Boost Operational...Leveraging Monitoring Governance: How Service Providers Can Boost Operational...
Leveraging Monitoring Governance: How Service Providers Can Boost Operational...
 
The Next Big Service Provider Opportunity—Beyond Infrastructure: Architecting...
The Next Big Service Provider Opportunity—Beyond Infrastructure: Architecting...The Next Big Service Provider Opportunity—Beyond Infrastructure: Architecting...
The Next Big Service Provider Opportunity—Beyond Infrastructure: Architecting...
 
Application Experience Analytics Services: The Strategic Digital Transformati...
Application Experience Analytics Services: The Strategic Digital Transformati...Application Experience Analytics Services: The Strategic Digital Transformati...
Application Experience Analytics Services: The Strategic Digital Transformati...
 
Application Experience Analytics Services: The Strategic Digital Transformati...
Application Experience Analytics Services: The Strategic Digital Transformati...Application Experience Analytics Services: The Strategic Digital Transformati...
Application Experience Analytics Services: The Strategic Digital Transformati...
 
Strategic Direction Session: Deliver Next-Gen IT Ops with CA Mainframe Operat...
Strategic Direction Session: Deliver Next-Gen IT Ops with CA Mainframe Operat...Strategic Direction Session: Deliver Next-Gen IT Ops with CA Mainframe Operat...
Strategic Direction Session: Deliver Next-Gen IT Ops with CA Mainframe Operat...
 
Strategic Direction Session: Enhancing Data Privacy with Data-Centric Securit...
Strategic Direction Session: Enhancing Data Privacy with Data-Centric Securit...Strategic Direction Session: Enhancing Data Privacy with Data-Centric Securit...
Strategic Direction Session: Enhancing Data Privacy with Data-Centric Securit...
 
Blockchain: Strategies for Moving From Hype to Realities of Deployment
Blockchain: Strategies for Moving From Hype to Realities of DeploymentBlockchain: Strategies for Moving From Hype to Realities of Deployment
Blockchain: Strategies for Moving From Hype to Realities of Deployment
 
Establish Digital Trust as the Currency of Digital Enterprise
Establish Digital Trust as the Currency of Digital EnterpriseEstablish Digital Trust as the Currency of Digital Enterprise
Establish Digital Trust as the Currency of Digital Enterprise
 

Recently uploaded

APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDGMarianaLemus7
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksSoftradix Technologies
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Neo4j
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraDeakin University
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang
 

Recently uploaded (20)

APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDG
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
The transition to renewables in India.pdf
The transition to renewables in India.pdfThe transition to renewables in India.pdf
The transition to renewables in India.pdf
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other Frameworks
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024
 
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort ServiceHot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning era
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
 

Continuous Delivery - The ING Story: Improving time to market with DevOps and Continuous Delivery

  • 1. Continuous Delivery - The ING Story Improving time to market with DevOps and Continuous Delivery Wouter Meijs DOT05S #CAWorld ING Bank Head of Delivery Center Core Bank DevOps
  • 2. 2 © 2014 CA. ALL RIGHTS RESERVED. Agenda INTRODUCTION CHANGING WORLD THE NEXT FRONTIERS: WHAT LIES AHEAD? CONTINUOUS DELIVERY: REDEFINING IT WHAT WE DID AT ING CHALLENGES 1 2 3 4 5 6
  • 3. 3 © 2014 CA. ALL RIGHTS RESERVED. ING: A global Financial Services Group Over 33 millionclients 40different countries 64,000employees of which15,000IT €15 bn annual revenue
  • 4. 4 © 2014 CA. ALL RIGHTS RESERVED. 160 million euro distributed each day in the Netherlands
  • 5. 5 © 2014 CA. ALL RIGHTS RESERVED. every 5 minutes, 100 million euro is turned over at the dealing room and our systems
  • 6. 6 © 2014 CA. ALL RIGHTS RESERVED. Agenda INTRODUCTION CHANGING WORLD THE NEXT FRONTIERS: WHAT LIES AHEAD? CONTINUOUS DELIVERY: REDEFINING IT WHAT WE DID AT ING CHALLENGES 1 2 3 4 5 6
  • 7. 7 © 2014 CA. ALL RIGHTS RESERVED. Technology is changing faster every year
  • 8. 8 © 2014 CA. ALL RIGHTS RESERVED. From 0 to 1 billion smart phones In less than 10 years
  • 9. 9 © 2014 CA. ALL RIGHTS RESERVED. People’s expectations grow along Both customers and employees
  • 10. 10 © 2014 CA. ALL RIGHTS RESERVED. Access anytime anywhere anyhow
  • 11. 11 © 2014 CA. ALL RIGHTS RESERVED. Zero tolerance for digital failure
  • 12. 12 © 2014 CA. ALL RIGHTS RESERVED. Be amazed by new features
  • 13. 13 © 2014 CA. ALL RIGHTS RESERVED.
  • 14. 14 © 2014 CA. ALL RIGHTS RESERVED. Complete industries are changing
  • 15. 15 © 2014 CA. ALL RIGHTS RESERVED. Spotifyand Netflix are obliterating video and record stores
  • 16. 16 © 2014 CA. ALL RIGHTS RESERVED. As a Bank We are not Immune
  • 17. 17 © 2014 CA. ALL RIGHTS RESERVED. Traditionally people deposited their money into banks
  • 18. 18 © 2014 CA. ALL RIGHTS RESERVED. It was kept in safes And accessed through checks
  • 19. 19 © 2014 CA. ALL RIGHTS RESERVED. You don’t need 150 years of tradition to start a bank anymore
  • 20. 20 © 2014 CA. ALL RIGHTS RESERVED. Technology opens the door to many more competitors …and perhaps takes banks out of the equation
  • 21. 21 © 2014 CA. ALL RIGHTS RESERVED. People Need Banking not banks
  • 22. 22 © 2014 CA. ALL RIGHTS RESERVED. Agenda INTRODUCTION CHANGING WORLD THE NEXT FRONTIERS: WHAT LIES AHEAD? CONTINUOUS DELIVERY: REDEFINING IT WHAT WE DID AT ING CHALLENGES 1 2 3 4 5 6
  • 23. 23 © 2014 CA. ALL RIGHTS RESERVED. Traditional Waterfall Projects Fail to Support this
  • 24. 24 © 2014 CA. ALL RIGHTS RESERVED. The OLDways
  • 25. 25 © 2014 CA. ALL RIGHTS RESERVED. The Dream
  • 26. 26 © 2014 CA. ALL RIGHTS RESERVED. The Design
  • 27. 27 © 2014 CA. ALL RIGHTS RESERVED. The Specs
  • 28. 28 © 2014 CA. ALL RIGHTS RESERVED. The PiD
  • 29. 29 © 2014 CA. ALL RIGHTS RESERVED. The Development CHANGING REQUIREMENTS DESIGN FAILS
  • 30. 30 © 2014 CA. ALL RIGHTS RESERVED. The Testing TEST FAILURES DEPLOYMENT ISSUES
  • 31. 31 © 2014 CA. ALL RIGHTS RESERVED. The Result
  • 32. 32 © 2014 CA. ALL RIGHTS RESERVED. The Result
  • 33. 33 © 2014 CA. ALL RIGHTS RESERVED. The Result
  • 34. 34 © 2014 CA. ALL RIGHTS RESERVED. To stop this … You have to speed up your delivery cycle
  • 35. 35 © 2014 CA. ALL RIGHTS RESERVED. Agile Scrum Made the First Move… …but the next bottleneck is deployment on production
  • 36. 36 © 2014 CA. ALL RIGHTS RESERVED. Continuous delivery Every change tested on production like environment
  • 37. 37 © 2014 CA. ALL RIGHTS RESERVED. Continuous delivery Multiple deploys on preproduction per day Releasing becomes business decision
  • 38. 38 © 2014 CA. ALL RIGHTS RESERVED. Everything is automated Configuration management Testing Deployments
  • 39. 39 © 2014 CA. ALL RIGHTS RESERVED. Bridge the gap between Devand Ops
  • 40. 40 © 2014 CA. ALL RIGHTS RESERVED.
  • 41. 41 © 2014 CA. ALL RIGHTS RESERVED.
  • 42. 42 © 2014 CA. ALL RIGHTS RESERVED. DevOps Devand Ops working together in one team with one backlog
  • 43. 43 © 2014 CA. ALL RIGHTS RESERVED. A NEWway of working
  • 44. 44 © 2014 CA. ALL RIGHTS RESERVED. The Dream
  • 45. 45 © 2014 CA. ALL RIGHTS RESERVED. The Demo
  • 46. 46 © 2014 CA. ALL RIGHTS RESERVED. The Minimal Viable Product
  • 47. 47 © 2014 CA. ALL RIGHTS RESERVED. The Second Release
  • 48. 48 © 2014 CA. ALL RIGHTS RESERVED. The Nth Release
  • 49. 49 © 2014 CA. ALL RIGHTS RESERVED. The Nth Release
  • 50. 50 © 2014 CA. ALL RIGHTS RESERVED. The Nth Release
  • 51. 51 © 2014 CA. ALL RIGHTS RESERVED. The Nth Release
  • 52. 52 © 2014 CA. ALL RIGHTS RESERVED. MAKE YOUR OWN EGGS! BUY OUR PAINT
  • 53. 53 © 2014 CA. ALL RIGHTS RESERVED. Agenda INTRODUCTION CHANGING WORLD THE NEXT FRONTIERS: WHAT LIES AHEAD? CONTINUOUS DELIVERY: REDEFINING IT WHAT WE DID AT ING CHALLENGES 1 2 3 4 5 6
  • 54. 54 © 2014 CA. ALL RIGHTS RESERVED. Mobile Banking App 0 2000 4000 6000 8000 10000 12000 14000 16000 18000 Total number of deployments per month
  • 55. 55 © 2014 CA. ALL RIGHTS RESERVED. Mobile Banking App
  • 56. 56 © 2014 CA. ALL RIGHTS RESERVED. Full Continuous Delivery Process with Nightly Builds
  • 57. 57 © 2014 CA. ALL RIGHTS RESERVED.
  • 58. 58 © 2014 CA. ALL RIGHTS RESERVED. Failed test results sent by WhatsAppto all developers
  • 59. 59 © 2014 CA. ALL RIGHTS RESERVED. 3-6 Weeks Releases, Priority Set by Customers in iStore
  • 60. 60 © 2014 CA. ALL RIGHTS RESERVED. From 1 Star to 4 Stars in the iStore
  • 61. 61 © 2014 CA. ALL RIGHTS RESERVED.
  • 62. 62 © 2014 CA. ALL RIGHTS RESERVED. Continuous Delivery is not just for Web Applications ING’s Core Product Engine
  • 63. 63 © 2014 CA. ALL RIGHTS RESERVED. ING Core Bank Savings, Loans, Current Accounts 12 million accounts 10 DevOps teams
  • 64. 64 © 2014 CA. ALL RIGHTS RESERVED. Continuous Delivery is not just for Web Applications One Branch One automated test set One CD pipeline
  • 65. 65 © 2014 CA. ALL RIGHTS RESERVED. Time to market from >20 weeks To 4 days
  • 66. 66 © 2014 CA. ALL RIGHTS RESERVED. Test coverage increased from 30% to 80% and throughput time from 4 weeks to 6 hours
  • 67. 67 © 2014 CA. ALL RIGHTS RESERVED. From 30+ outages in 2013 to 0 in 2014 While increasing releases from 4 per year to every 3 weeks
  • 68. 68 © 2014 CA. ALL RIGHTS RESERVED. DR test from 4 hours to 12 minutes And 10 seconds by the end of next year
  • 69. 69 © 2014 CA. ALL RIGHTS RESERVED. Infrastructure provisioning
  • 70. 70 © 2014 CA. ALL RIGHTS RESERVED. How long does it take you to deploy your application? INCLUDING ROLE BASED ACCESS INCLUDING MONITORING INCLUDING CONNECTIVITY
  • 71. 71 © 2014 CA. ALL RIGHTS RESERVED. Within ING it takes > 200 days
  • 72. 72 © 2014 CA. ALL RIGHTS RESERVED.
  • 73. 73 © 2014 CA. ALL RIGHTS RESERVED. Agenda INTRODUCTION CHANGING WORLD THE NEXT FRONTIERS: WHAT LIES AHEAD? CONTINUOUS DELIVERY: REDEFINING IT WHAT WE DID AT ING CHALLENGES 1 2 3 4 5 6
  • 74. 74 © 2014 CA. ALL RIGHTS RESERVED. Biggest challenge is people Mindset & Behaviour Engineering culture Stakeholders Suppliers
  • 75. 75 © 2014 CA. ALL RIGHTS RESERVED. CD will fail without the right mindset and behavior
  • 76. 76 © 2014 CA. ALL RIGHTS RESERVED. Start where it hurts
  • 77. 77 © 2014 CA. ALL RIGHTS RESERVED. Realize Improvements Every Three Months
  • 78. 78 © 2014 CA. ALL RIGHTS RESERVED. Patience
  • 79. 79 © 2014 CA. ALL RIGHTS RESERVED. How to transform your workforce?
  • 80. 80 © 2014 CA. ALL RIGHTS RESERVED. Training
  • 81. 81 © 2014 CA. ALL RIGHTS RESERVED. Attract the Best Talent in the World
  • 82. 82 © 2014 CA. ALL RIGHTS RESERVED. CD talent is rare War on talent Engineers look for great engineering, not money
  • 83. 83 © 2014 CA. ALL RIGHTS RESERVED. Be content leaders yourself
  • 84. 84 © 2014 CA. ALL RIGHTS RESERVED. Business stakeholders BEFORE We cannot deliver on the agreed time lines That is not our fault We need a lot of money for things you do not understand
  • 85. 85 © 2014 CA. ALL RIGHTS RESERVED. Business stakeholders AFTER Directly responsible for prioritization of backlog Define minimal viable product together
  • 86. 86 © 2014 CA. ALL RIGHTS RESERVED. Suppliers BEFORE Large releases every 6 –12 months Service Level Agreements
  • 87. 87 © 2014 CA. ALL RIGHTS RESERVED. AFTER Small and frequent releases 100% availability Suppliers Co-sourcing
  • 88. 88 © 2014 CA. ALL RIGHTS RESERVED. Your CD pipeline has to be 100% available Dependence on Technology:
  • 89. 91 © 2014 CA. ALL RIGHTS RESERVED. Agenda INTRODUCTION CHANGING WORLD THE NEXT FRONTIERS: WHAT LIES AHEAD? CONTINUOUS DELIVERY: REDEFINING IT WHAT WE DID AT ING CHALLENGES 1 2 3 4 5 6
  • 90. 92 © 2014 CA. ALL RIGHTS RESERVED. What if we’re only halfway there?
  • 91. 93 © 2014 CA. ALL RIGHTS RESERVED. Role based access should be standardized Automated security Security settings deployed as part of the pipeline
  • 92. 94 © 2014 CA. ALL RIGHTS RESERVED. CD pipeline as a service We want to build banking software, not automation
  • 93. 95 © 2014 CA. ALL RIGHTS RESERVED. As many as 50 teams working on one release Chain
  • 94. 96 © 2014 CA. ALL RIGHTS RESERVED. Where Does it Stop: Continuous Delivery in a Bank Secure financial service Managing a customer’s financial future is not like streaming video’s There is a danger of blindly following Google, Spotify and Netflix
  • 95. 97 © 2014 CA. ALL RIGHTS RESERVED. For More Information To learn more about DevOps, please visit: http://bit.ly/1wbjjqX Insert appropriate screenshot and textoverlayfrom following“More Info Graphics” slide here; ensure it links to correct page DevOps