Unlock the Power of Continuous Delivery With
End-to-End, Integrated Continuous Testing
Jeff Scheaffer
DO3T001S
DEVOPS – CONTINUOUS DELIVERY
General Manager – Continuous Delivery BU
CA Technologies
2 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
© 2017 CA. All rights reserved. All trademarks referenced herein belong to their respective companies.
The content provided in this CA World 2017 presentation is intended for informational purposes only and does not form any type
of warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA.
For Informational Purposes Only
Terms of this Presentation
3 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
Abstract
The modern software factory relies on the ability to deliver software faster, with higher
quality—while reducing risk and costs.
This is only possible when an organization can delivery software continuously.
Historically testing has been the major impediment to achieving continuous delivery, but
new tools from CA are eliminating the testing bottleneck and enabling true end-to-end
continuous testing.
Come to this Continuous Delivery Keynote session from Jeff Scheaffer, General
Manager for the Continuous Delivery Business Unit at CA.
Jeff
Scheaffer
CA Technologies
GM Continuous
Delivery
Racing to
Victory with
Continuous Testing
Competing to Win
in the Application
Economy
Jeff Scheaffer
Senior Vice President and General Manager
CA Technologies
5 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
DevOps: Continuous Testing
DevSecOpsContinuous Testing
Monitor & test performance
across app lifecycle
Continuous Delivery
BUILD BETTER
APPS FASTER
MAKE SECURITY A
COMPETITIVE ADVANTAGE
MAXIMIZE APPLICATION
PERFORMANCE
6 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
Every interaction in your apps is a battle to retain and win customers.
Everyone
Competes
in the
Application
Economy 60%
chance digital customers
are gone forever, once
they leave.
77%
of consumers abandon
loyalty more quickly than
they did three years ago.
7 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
Winning Depends on Consistency
Rapidly stay ahead of
market demands1SPEED
Consistent,
uncompromising reliability2QUALITY
Excite customers with
amazing experiences3EXPERIENCE
Do more with less and
maximize investment4COST
8 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
But … These Only Speed Dev Velocity
Agile improves success rate
of projects over Waterfall4x
Yet failure rate is still
statistically significant9%
Agile & DevOps Help You Compete
So the Need for
Speed
Continues…
63%
Say that QA is the
biggest bottleneck in
DevOps implementations
56%
Of critical dependencies
unavailable
70%
Of testing is still
manual
50%
Of time spent
looking for test data
10 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
TECHNOLOGY
PEOPLE
Empower developers with
testing capabilities.
PROCESS
Automate everything.
Leverage open source
and cloud.
The Ones
On the Podium
Do Something
Different:
Continuous
Testing
11 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
Developers Need the Right
Culture and Skills to Win
72%
Agree continuous
testing requires a
major shift in culture
24%
Have the culture
and skills to enable
continuous testing
YET ONLY…
Testers evolve
to automation
engineers
Shift testing
left to
developers
Democratize
testing tools
12 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
The Right Processes Help Keep You Running
Develop Test Release
Automated test creation and execution. Full in-sprint testing.
Model requirements & Auto-generate test cases
Automate
Physical &
Virtual Test
Environments
Store Test
Results
Analytics Throughout SDLC
Component
Functional
Performance
Security
Parallel Test Execution
Business
Decision
to Release
Constant Feedback From Operations
62%
of time spent
on un-planned/
routine work
70%
of all testing
is still manual
57%
Dissatisfaction
with deploy times
64%
of defect costs
originate in
planning
30% Improvement of testing
efficiency at Rabobank
99%
Reduction in testing
times at Autotrader
50%
fewer resources to deliver
fully tested apps to
production at Sprint
4x
Reduction in
over-testing at a
large financial
corp.
71%
Faster deployment times at
Charter
86% Faster time to identify
performance issues at NAB
13 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
Analytics Throughout SDLC
Analytics Throughout the SDLC Is Not a Pipe Dream
14 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
Testing
Technology
Needs to
Evolve Model-driven
to ensure
alignment
From the
cloud for
ease of use
Based on
open source
innovation
79%
Agree continuous
testing is easier
with the right tools
40%
Have the ability
to do in-sprint
test automation
YET
ONLY…
15 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
Built Right
Leveraging open source, and based in the cloud
Automatic
Generation
Test cases starting
from requirements
Virtualized
Environments
Tests as code is built to
avoid manual processes
Automated
Testing
Test cases, scenarios
and systems to
eliminate waiting
Orchestration and
Analytics
Across the SDLC
We Have the
Continuous
Testing Tools
That Keep
You in the
Lead
16 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
End-to-End Integrated Continuous Testing from CA
CA Continuous
Delivery
Director
Automatically generate
test automation scripts
from requirements
1
Simulate test
environment
2
Access test data
on-demand & ensure
GDPR compliance
3
Functional &
performance testing
for APIs, web &
mobile apps
4
Built-in
automated
application
security testing
5
Application
deployment
across hybrid
environments
6
Harness application
insight across the
SDLC to improve
user experience
7
Pipeline planning,
management and
optimization
8
17 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
We Have
More Than
Tools…
BenchmarkingCoaching
Current State
Workshops
18 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
Reducing QA Drag with
Continuous Testing
Manual testing
Lack of consistent automation
Disjointed knowledge management
BEFORE AFTER
Increased speed through the SDLC
Deliver the best product possible
Solidify reputation of organization
#1 GOAL: Make Sprint successful!
19 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
CA Drinking Our Own Champagne
BOOSTING TESTING EFFICIENCY
Dramatically improved velocity while providing
100% test coverage.
Crystal clear
TEST CASES
built. Maximum
TEST COVERAGE
achieved.
40 days to 3KEY CHALLENGES
Defects stemming from poor
requirements
Quality risks due to limited test coverage
Increasing test maintenance cost
200+ Person
Development Team
20 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
The Results Speak for
Themselves
“Continuous Testing
as a Digital Business
Enabler”, 2017
Continuous testing leaders thrive!
more confident in
speed of delivery
1.9x
more confident in
quality of output.
2.4x
Likely to meet customer
experience expectations.
2.8x
Higher revenue growth
50% Higher profit growth
70%
21 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
More Real Customers, Real Results stories are available at www.ca.com/cdresults
Why You Should Rely On Us In Pit Lane
$600M
Nearly $600 million annual R&D
spend
2000+
Patents & Pending Patents
$1B
Spent acquiring technology
Technology Leadership Customer Validated
100s
Of integrations
Open Ecosystem
22 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
Go to cdbu.io for Chance to Win a Guitar!
23 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
GSI Health
Delivering applications
faster with better quality
via shift-left testing.
• CA BlazeMeter
GM
Saved $2.4m and
onboarded 70% of their
Oracle apps.
• CA Continuous Delivery
Director
• CA Agile Requirements
Designer
• CA Test Data Manager
• CA Service Virtualization
Talk Talk
Payback with 9 months
and 3 year projected
savings of £5m.
• CA Agile Requirements
Designer
• CA Test Data Manager
• CA Application Test
Breaking Barriers in Continuous Testing
24 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
Thank you.
Our mission is making
you a champion in the
application economy.
Stay to hear
the great line up
of speakers.
Go see the great
demonstrations
in theater 3.
25 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
Stay connected at communities.ca.com
Thank you.
26 COPYRIGHT © 2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS
DevOps:
Continuous Delivery
For more information on DevOps: Continuous Delivery,
please visit: http://cainc.to/CAW17-CD

Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated Continuous Testing

  • 1.
    Unlock the Powerof Continuous Delivery With End-to-End, Integrated Continuous Testing Jeff Scheaffer DO3T001S DEVOPS – CONTINUOUS DELIVERY General Manager – Continuous Delivery BU CA Technologies
  • 2.
    2 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS © 2017 CA. All rights reserved. All trademarks referenced herein belong to their respective companies. The content provided in this CA World 2017 presentation is intended for informational purposes only and does not form any type of warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA. For Informational Purposes Only Terms of this Presentation
  • 3.
    3 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS Abstract The modern software factory relies on the ability to deliver software faster, with higher quality—while reducing risk and costs. This is only possible when an organization can delivery software continuously. Historically testing has been the major impediment to achieving continuous delivery, but new tools from CA are eliminating the testing bottleneck and enabling true end-to-end continuous testing. Come to this Continuous Delivery Keynote session from Jeff Scheaffer, General Manager for the Continuous Delivery Business Unit at CA. Jeff Scheaffer CA Technologies GM Continuous Delivery
  • 4.
    Racing to Victory with ContinuousTesting Competing to Win in the Application Economy Jeff Scheaffer Senior Vice President and General Manager CA Technologies
  • 5.
    5 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS DevOps: Continuous Testing DevSecOpsContinuous Testing Monitor & test performance across app lifecycle Continuous Delivery BUILD BETTER APPS FASTER MAKE SECURITY A COMPETITIVE ADVANTAGE MAXIMIZE APPLICATION PERFORMANCE
  • 6.
    6 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS Every interaction in your apps is a battle to retain and win customers. Everyone Competes in the Application Economy 60% chance digital customers are gone forever, once they leave. 77% of consumers abandon loyalty more quickly than they did three years ago.
  • 7.
    7 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS Winning Depends on Consistency Rapidly stay ahead of market demands1SPEED Consistent, uncompromising reliability2QUALITY Excite customers with amazing experiences3EXPERIENCE Do more with less and maximize investment4COST
  • 8.
    8 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS But … These Only Speed Dev Velocity Agile improves success rate of projects over Waterfall4x Yet failure rate is still statistically significant9% Agile & DevOps Help You Compete
  • 9.
    So the Needfor Speed Continues… 63% Say that QA is the biggest bottleneck in DevOps implementations 56% Of critical dependencies unavailable 70% Of testing is still manual 50% Of time spent looking for test data
  • 10.
    10 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS TECHNOLOGY PEOPLE Empower developers with testing capabilities. PROCESS Automate everything. Leverage open source and cloud. The Ones On the Podium Do Something Different: Continuous Testing
  • 11.
    11 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS Developers Need the Right Culture and Skills to Win 72% Agree continuous testing requires a major shift in culture 24% Have the culture and skills to enable continuous testing YET ONLY… Testers evolve to automation engineers Shift testing left to developers Democratize testing tools
  • 12.
    12 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS The Right Processes Help Keep You Running Develop Test Release Automated test creation and execution. Full in-sprint testing. Model requirements & Auto-generate test cases Automate Physical & Virtual Test Environments Store Test Results Analytics Throughout SDLC Component Functional Performance Security Parallel Test Execution Business Decision to Release Constant Feedback From Operations 62% of time spent on un-planned/ routine work 70% of all testing is still manual 57% Dissatisfaction with deploy times 64% of defect costs originate in planning 30% Improvement of testing efficiency at Rabobank 99% Reduction in testing times at Autotrader 50% fewer resources to deliver fully tested apps to production at Sprint 4x Reduction in over-testing at a large financial corp. 71% Faster deployment times at Charter 86% Faster time to identify performance issues at NAB
  • 13.
    13 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS Analytics Throughout SDLC Analytics Throughout the SDLC Is Not a Pipe Dream
  • 14.
    14 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS Testing Technology Needs to Evolve Model-driven to ensure alignment From the cloud for ease of use Based on open source innovation 79% Agree continuous testing is easier with the right tools 40% Have the ability to do in-sprint test automation YET ONLY…
  • 15.
    15 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS Built Right Leveraging open source, and based in the cloud Automatic Generation Test cases starting from requirements Virtualized Environments Tests as code is built to avoid manual processes Automated Testing Test cases, scenarios and systems to eliminate waiting Orchestration and Analytics Across the SDLC We Have the Continuous Testing Tools That Keep You in the Lead
  • 16.
    16 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS End-to-End Integrated Continuous Testing from CA CA Continuous Delivery Director Automatically generate test automation scripts from requirements 1 Simulate test environment 2 Access test data on-demand & ensure GDPR compliance 3 Functional & performance testing for APIs, web & mobile apps 4 Built-in automated application security testing 5 Application deployment across hybrid environments 6 Harness application insight across the SDLC to improve user experience 7 Pipeline planning, management and optimization 8
  • 17.
    17 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS We Have More Than Tools… BenchmarkingCoaching Current State Workshops
  • 18.
    18 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS Reducing QA Drag with Continuous Testing Manual testing Lack of consistent automation Disjointed knowledge management BEFORE AFTER Increased speed through the SDLC Deliver the best product possible Solidify reputation of organization #1 GOAL: Make Sprint successful!
  • 19.
    19 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS CA Drinking Our Own Champagne BOOSTING TESTING EFFICIENCY Dramatically improved velocity while providing 100% test coverage. Crystal clear TEST CASES built. Maximum TEST COVERAGE achieved. 40 days to 3KEY CHALLENGES Defects stemming from poor requirements Quality risks due to limited test coverage Increasing test maintenance cost 200+ Person Development Team
  • 20.
    20 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS The Results Speak for Themselves “Continuous Testing as a Digital Business Enabler”, 2017 Continuous testing leaders thrive! more confident in speed of delivery 1.9x more confident in quality of output. 2.4x Likely to meet customer experience expectations. 2.8x Higher revenue growth 50% Higher profit growth 70%
  • 21.
    21 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS More Real Customers, Real Results stories are available at www.ca.com/cdresults Why You Should Rely On Us In Pit Lane $600M Nearly $600 million annual R&D spend 2000+ Patents & Pending Patents $1B Spent acquiring technology Technology Leadership Customer Validated 100s Of integrations Open Ecosystem
  • 22.
    22 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS Go to cdbu.io for Chance to Win a Guitar!
  • 23.
    23 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS GSI Health Delivering applications faster with better quality via shift-left testing. • CA BlazeMeter GM Saved $2.4m and onboarded 70% of their Oracle apps. • CA Continuous Delivery Director • CA Agile Requirements Designer • CA Test Data Manager • CA Service Virtualization Talk Talk Payback with 9 months and 3 year projected savings of £5m. • CA Agile Requirements Designer • CA Test Data Manager • CA Application Test Breaking Barriers in Continuous Testing
  • 24.
    24 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS Thank you. Our mission is making you a champion in the application economy. Stay to hear the great line up of speakers. Go see the great demonstrations in theater 3.
  • 25.
    25 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS Stay connected at communities.ca.com Thank you.
  • 26.
    26 COPYRIGHT ©2017 CA. ALL RIGHTS RESERVED#CAWORLD #NOBARRIERS DevOps: Continuous Delivery For more information on DevOps: Continuous Delivery, please visit: http://cainc.to/CAW17-CD