This document discusses how companies can balance speed and risk through test automation. It provides an example of a successful automation journey where a company started with a small automation project and gradually expanded usage. The keys to success included executive support, strong metrics, and communication. The document emphasizes thinking strategically about automation and measuring the right business outcomes. Automation should be used to drive agility across the entire change management cycle. Success requires collaboration between IT, QA, and the business to prioritize the most important areas for the company.

1. Insurance for Your
Assurance Team
Automation Built for Change
Rick Goad
VP Solution Architect Team
Chris Kraus
Sr. Director Product Management

2. Agenda
• Speed and Risks: Key
Considerations
• What Successful Companies Are
Doing
• How to Succeed

3. Before We Get Started..

4. Meet Your Guides
5
Chris Kraus
Sr. Director Product Management
Rick Goad
VP Solution Architect Team

5. “If things seem under
control, you are just not
going fast enough.”
- Mario Andretti

6. www.worksoft.com
Digital Risk
It’s not just about security, hackers, and data theft

7. Balancing Speed and Risk is
Key to Leading in the New
Digital World!
8
FAIL FAST!
MTTR for high performers less than
one hour!

8. What Are You Testing Today?
Your Software or Your Business9

9. www.worksoft.com
Testing Your Business Requires
End-to-End Business Process Testing

10. Why Are End-to-
End Tests SO Hard
to Automate?
11
• Poor Documentation
• Complexity
• UI Driven
• Cross-Team
Collaboration
• Impact on
Upstream/Downstream
Systems
• No Time

11. It’s No Longer IF You are
Automating but How Much
“IDC believes that technology
leaders that recognize the
importance of utilizing
DevOps practices and
automation technologies
will gain a real advantage
over their competitors in the
race to the future of the
digitally enabled enterprise.”
- Stephen Elliot, IDC
IDC MaturityScape Benchmark: DevOps in
the United States, 2017
The Global test automation market
is forecasted to grow from $30.45
billion in 2016 $109 billion in 2025.2
Only 16% of end-to-end business
scenarios are executed with test tools.1
88% of companies have
used or experimented with
DevOps.1
1World Quality Report 2017-18
2 Article: https://www.isvinsights.com/doc/test-automation-interesting-survey-trends-for-the-haves-and-have-nots-0001

12. The First Key to
Success…
Get Off the Automation
Roller Coaster!

13. Example of a Successful Automation Journey

14. Committed to target of
60% automated tests on
next project.
Automation was used for a
CRM upgrade. Weekly test
execution scheduled for
Workday.
Automation extended
beyond regression to
ongoing quality control, and
system readiness.
Automation developed for
SAP compatibility testing
for Windows and Office
potential upgrade.
Continued to add to the
regression suite. Support
for performance testing.
Enables Continuous Change
with Worksoft Automation
START:
“Crawl, Walk, Run”
A small project was
targeted to start.
Keys to Success:
• Easy to Use Tool
• Executive Support
• Organizational Structure
• Strong Metrics
• Ongoing Communication
40% time savings for
technical upgrade2.
8,000 manual tests replaced1.
Sources:
1Worksoft 2016 Customer Conference Presentation.
2 SAP Insider Article Fall 2017.
90% of tests automated
for CRM project1.
$10,000 saved per refresh1.
9,000 manual steps replaced1.
500 hours of manual testing saved1.
$60,000+ saved1.
7,000 emails triggered
with Worksoft Certify1.

15. Worked with production
support teams to identify and
automate monthly process
reports with Worksoft BPP.
Centralized test organization
created. Biweekly meetings
with VP of IT to share
benchmarks.
Continued creation of
regression tests and
execution of automated test
suites.
NEXT: Expanded use of
automation. Support move to
single SAP ERP instance.
“The ability to demonstrate a consistent
financial return helped ensure exec
commitment and a directive that supports
investment in building and maintaining
automation.”
- Heather Whitifield, Applied Materials
98% of all system
refreshes and DR testing
done using automation2.
Source:
2 SAP Insider Article Fall 2017.
Formal Test Support Office
Standardized metrics, reporting, and
communications.
Production and Compliance Support
Tax-ware scenarios tested monthly.
Compliance reports generated.
Applied Materials is the
leader in materials
engineering solutions used
to produce virtually every
new chip and advanced
display in the world.

16. How to
Succeed with
Automation

17. Think Strategically About Automation
18
Keys to Success:
 Measuring the right business outcomes
 Communicating the right business outcomes
 Gaining executive sponsorship for your efforts
Automation is
critical to the
success of your
company not just
an individual
project
Automate all
parts of the
change
management
cycle not just
test execution
Automation drives
agility and new
ways to deliver
enterprise
applications

18. Build the right
org structure
to avoid the
“roller coaster”
effect
Prioritize
what is most
important to
the business
where can
you gain the
biggest ROI
Cultivate exec
sponsorship by
evangelizing
business
outcomes
early and often
Create a
framework for
MEASURING
the right
business
outcomes
Measure
Think
Automation
BEYOND
testing for
maximum
ROI
RETHINK
Enlist help
from the
business
by showing
them
results
Cultivate
Build
Prioritize
Enlist
Develop a Plan

19. Success Starts with the Business
“Quality and testing in today’s fast-moving
continuous delivery environment is quickly
becoming everyone’s responsibility, so
management needs to ensure their people are
properly enabled.”
- Freeform Dynamics, Continuous Testing as a Digital Business
Enabler Research Report, 2017
86%
Of testing leaders report they
need to work closer with
business leadership!1
1PAC Group, Digital Testing in Europe: Strategies, Challenges, & Measuring Success, 2015
Operations
Scale and Measure
QA
Easy to Use
Easy to Maintain
Application
Team (IT)
Build
Business
Cultivate, Prioritize,
Enlist

20. Measure The Right Outcomes
SPEED COSTS
• Manual labor savings
• Defect detection rate
• Reduction in service calls
VALUE
• Business value of
realizing faster ROI
• Institutional knowledge
capture
• Project delivery
acceleration
• Increase in number of
releases each year
Create a Baseline
Automate Reporting
Pain Free Testing & Compliance
- 80% Time Savings
- More time for Innovation vs. Maintenance
- “Tribal” Knowledge Captured
HANA Migration
- Business goals achieved
- Reduced maintenance
- Automation used beyond testing

21. Transferable Automation
1 + 1 = 4!
Automated Discovery Used to Capture a
End-to-End Business Process
Operations
• Documentation
• Scripts for robotic
process automation
QA
• Documentation
• Test Scripts
Application Team (IT)
• Documented requirements
• Work sized, resources allocated
• Stories created for sprints
• Integration with ALM & defect tracking
Business
• Visualization of process
• Detailed documentation
generated for training, IT, QA
and Ops
Reduction in manual hours
vs. test automation alone30%

22. Document
Generation
Data Loading
Configuration
Continue Your Automation Journey
Configuration
Robotic Process
Automation (RPA)
Document
Generation

23. Demonstration

24. Insurance for Your Assurance Team
05
Build easy to maintain end-to-end test beds that can be run on-demand at scale.
Continuous Testing
Ensure end-to-end tests are available for unit
and functional tests teams.
Continuous Integration/
Deployment
Eliminate delays and miscommunications. Easily capture
and document as-is end-to-end business processes.
Automated Discovery
Determine downstream/upstream impact on systems and existing test coverage.
Impact Analysis
Automate QA and compliance reports.
Reuse tests for DR validations.
Reporting and Compliance
06
04
03
02
01
Leverage automation in
development and production to
eliminate repetitive tasks.
Extend Automation

25. 26
Worksoft Automation Platform for Enterprise Application Teams
Partners
ALM & Defect
Management
Mobile
Labs
Automation Accelerators
Solution Platform

26. 27
Innovation in the Last 2 Years!
Partners
ALM & Defect
Management
Mobile
Labs
Automation Accelerators
Solution Platform

27. The Journey Starts Now!
Questions?28