The 2015 World Quality Report data reveals that 61% of respondent’s rate time-to-market as very important which is the key reason for the proliferation of DevOps. The biggest ingredient is speed based on efficiencies upstream and in operations. Technology leaders now need to wear a business hat and build their strategy based on cost to achieve desired velocity as opposed to cost savings.
Join MasterCard and Capgemini to learn about a real time to market driven DevOps business case calculator with technology, process and tool components.
Presented at HPE Discover Las Vegas 2016.
4. Our Business
1
2
4
3
5
Consumers want better ways to pay.
We invent them.
Checkout lines are too slow.
We help them move
faster.
Procurement is complicated.
We make it simple.
People want financial access.
We find ways to
serve them.
Commuters are busy.
We speed them on
their way.
6
5. * Excludes volume generated by Maestro and Cirrus cards.
All numbers as reported as of December 31, 2015.
Impact
11,300
employees
210
countries and
territories
48.3
billion
processed
transactions
US
$4.6
trillion*
gross dollar
volume
US
$9.7
billion
net revenue
7
6. Integrating to deliver
new capabilities
Delivering
faster;
becoming more nimble
Preserving trust via
security and
quality
Scaling for
growth
while managing costs
Technology Supporting Our Business
8
7. Continuous Testing is a strategic lever for DevOps – WQR 2015-2016.
Why: Transforming a financial organization to a technology
leader
Ask Financial Tech CPRD Telecom & Media
Percentage of IT leaders by sector who use
DevOps
50% 57% 50% 48%
Agile
Organization Transformation (SDET)
Right focus areas for testing
Pricing Models
Test Automation approach
Continuous testing
Environments and Data (Virtualization)
Distributed Agile
TDD and BDD
9
8. DevOps @ MasterCard
DevOps tears down
traditional silos to tightly
integrate business,
development and operations
to drive agility and service
delivery excellence across
the entire lifecycle
10
9. Dev Cloud – Self-service, automated infrastructure
− On-premise private cloud for
development
− Self Service Infrastructure
− Creation time decreased from
multiple weeks to less than 10
minutes
− ~3,000 active virtual machines
owned by over 900 unique users
− 70+ new virtual machines created
daily
11
11. Maturity Continuous Delivery Metrics
Base Continuous Integration
Introducing Automated Unit Tests
Emerging Continuous Quality
Advanced Zero Downtime Deployments
Perfecting Zero touch deployments to Production
Where are we in the DevOps maturity?
Already achieved
13
12. − Capgemini was asked perform an
assessment, encompassing Agile and
DevOps test processes, waterfall test
processes. organization structures,
environment, automation for their
digital platform, legacy and commercial
applications.
Background
Leading to an assessment for Continuous quality on our
DevOps journey
− Recommendations
− Roadmap
− Business Case
Objective Deliverable
− Benchmark current
state of testing activities
− Define
recommendations to
mature to a quality
engineering
organization
− Create a recommended
future state operating
model supported by
detailed DevOps
business cases.
14
13. What are continuous quality levers ?
Continuous quality with continuous delivery
>99%
Application availability
>30%
Throughput
improvement
98%
Prevention of
high severity defects
>30%
Time-to-Market
Success Levers
AdvancedIntermediateBasic
70+%
50+%
40+%
70+%
100%
100%
50+%
50+%
50%
30%
40%
30%
70%
50%
30%
70%
Lifecycle Automation
Continuous Test
Lean and Agile adoption
Test and services virtualization
Test optimization
Standardization
Continuous monitoring
Quality Engineer leverage
Functional, non functional, Data, UAT
Build, integrate and deliver
Kanban, Scrum, Safe, XP, SaFe
Services and Environment automation
Risk based testing and OA leverage
Model based work benches
Availability & sentiment analysis
TDD, BDD, Unit automation
15
14. What is the business case calculator
The DevOps business calculator helps in calculating time to
market reduction. It is based on release time line testing effort
and ten factors. It can be used in two ways :
− Quick calculation to understand approximate time to market
benefits
− Post an assessment in creating a business case
Input 1: Current release time line and effort spent in testing
Input 2: Current leverage of parameters
Output : Effort savings
16
15. Snapshot of Business Case calculator: Scenario 1
Levers Current Potential
Effort reduction
Y1
Effort reduction
Y2
Degree of Functional Automation Low Medium 1.00% 2.00%
Lean techniques adoption Medium High 1.00% 1.00%
Degree of BDD automation Low High 3.00% 4.00%
Degree of Services virtualization Low Medium 1.00% 3.00%
Degree of Server virtualization Low Medium 1.00% 3.00%
Degree of Test data automation Low Medium 2.00% 3.00%
Degree of Continuous testing Low Medium 1.00% 3.00%
Degree of optimization Low Medium 1.00% 2.00%
Consolidation of Feature and Integration Testing Low High 2.00% 3.00%
Effort reduction 13.00% 24.00%
Low = Less than 50%, Medium = 50% to 70%, High = Greater than 70%
17
16. Snapshot of Business Case calculator: Scenario 2
Levers Current Potential
Effort reduction
Y1
Effort reduction
Y2
Degree of Functional Automation Medium High 1.00% 1.00%
Lean techniques adoption Low High 3.00% 4.00%
Degree of BDD automation Medium High 1.00% 1.00%
Degree of Services virtualization Medium High 1.00% 1.00%
Degree of Server virtualization Low Low 0.00% 0.00%
Degree of Test data automation Medium Medium 0.00% 0.00%
Degree of Continuous testing Medium High 2.00% 1.00%
Consolidation of Scrum Team Medium Medium 1.00% 2.00%
Effort reduction 9.00% 10.00%
Low = Less than 50%, Medium = 50% to 70%, High = Greater than 70%
18
17. Role of tools to build business case
Plan Define Code Build Deploy Test Release Operate
HPE Predictive ALM
HPE Agile Manager
Quality
Management HPE ALM HPE Next Gen ALM
HPE PPM
Test
Automation:
HPE UFTHPE LeanFT HPE LoadRunner
HPE Storm RunnerHPE Mobile Center
HPE Service Virtualization HPE Network Virtualization
HPE SAW
HPE AppPulse
HPE uCMDB
MS Visual Studio
Eclipse
IntelliJ
Subversion
GIT
MS WDT
MS Build
Maven
HPE Codar
HPE OO
HPE SA
Chef/Puppet
Ansible
HPE Security
Selenium
JMeter
Specflow
FitNesse
Docker
Nexus
Jenkins, CircleCI, TravisCI, Bazel, etc.
Collaboration (Slack, Confluence, etc.)
Testing HP scope
HPE Software
3rd Party
19
18. Putting it all together
70%
28%
71%
47%
47%
56%
73%
31%
76%
50%
48%
59%
80%
33%
88%
57%
51%
66%
0% 20% 40% 60% 80%
Core Switching
BPMS
MDES
Commercial
MasterPass
Total
2016 Integrated Effort 2017 Integrated Effort 2018 Integrated Effort
Portfolio 1
Portfolio 2
Portfolio 3
Portfolio 4
Portfolio 5
− De-risked approach (10% effort reduction)
over 2 years, effort reduction from 66% to
56%
− Shift left - Reduce system integration
testing defects by 40% and early defect
detection in feature testing
− Reduce cost to fix a defect by a
minimum of 50% from $7,000 to $3,750.
− Reduction in time to market by at least 2
weeks through optimization of the Agile
Testing Delivery Techniques (Velocity
improvement, Technical Debt reduction)
Integrated Testing Effort (% of Development* Effort)
20
19. Session #BB8331 - Business Case Calculator for DevOps Initiatives –Leading Credit card
services provider
Date: Tuesday June 7 – 4:30pm - 5:30pm
Session #BB8404 - Emerging trends in testing – preliminary research findings from the World
Quality Report
Date: Wednesday June 8 – 1:00pm – 2:00pm
Session #10134 - - Failing and Failing fast in AppDev – how do we keep up in AppSec?
Date: Wednesday June 8 – 2:30pm – 3:30pm
Session #BB8468 - Get ready to Modernize the Core
Date: Thursday June 9 – 12:00pm – 1:00pm
Get more information
Attend these sessions:
www.capgemini.com
Twitter: @Capgmini
LinkedIn: Capgemini
Facebook:Capgemini
Follow us on Social Media:
21