SlideShare a Scribd company logo
1 of 20
There Has To Be a Better Way
To Fast Test Coverage
Mark Braemer - Sr. Principal Consultant - CA Technologies
DO5X28E
DEVOPS
3 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
© 2016 CA. All rights reserved. All trademarks referenced herein belong to their respective companies.
The content provided in this CA World 2016 presentation is intended for informational purposes only and does not form any type of
warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA.
For Informational Purposes Only
Terms of this Presentation
4 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Abstract
Are you tired of lousy test coverage?
This presentation will show you how to obtain high test coverage
without all the hassle most organizations encounter.
See in a demo how CA Test Data Manager and CA Agile Requirements
Designer work together to help you build better test cases with better
coverage using better data!
Mark
Braemer
CA Technologies
Sr. Principal Consultant
5 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Agenda
OVERVIEW OF CA TEST DATA MANAGER
OVERVIEW OF CA AGILE REQUIREMENTS DESIGNER
INTEGRATION OF TDM & ARD IN A BROADER DEVOPS USE CASE
DEMO OF USE CASES
Q&A
1
2
3
4
5
6 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Overview of CA Test Data Manager
7 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
CA Test Data Manager
Data
Discovery,
modeling,
visualization
and Profiling
Data
Subsetting,
Masking and
Synthetic
Data
Generation
Test Data on
Demand™
 Review data quality
and data errors
 Measure coverage
and identify gaps
 Discover relationships
 Identify sensitive data
across all systems
 Identify future trends
 Share data across
parallel teams
 Enable Self-Service
on demand access
 Provide multiple
outsources with
secure data
 Eliminate manual data
creation and masking
 Reduce costs and
improve quality with
short but rigorous test
cycles
 Improve test coverage
8 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Synthetic Test Data Generation
“Empty”
CA TDM
+
Required Data
Characteristics
Provision fit for purpose test data anytime and every time!
Provision data without access to production systems!
Reduce cost of creation and maintenance of Test Data.
Ready for Testing!
8
Find/n Demand
9 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Synthetic Generation of Flat Files
 Create high quality test
data to test applications
that rely on non-relational
database sources.
 Generate synthetic data in
various formats including
XSD/XML, WSDL, RR pair,
JSON etc.
 Publish RR Pairs to a virtual
service via integration with
CA Service Virtualization
10 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Overview of
CA Agile Requirements Designer
11 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
What is CA Agile Requirements Designer?
 Graphs sophisticated business processes
and path modeling.
 Defines and optimizes requirements and
test case designs
 Designs clear requirements, test cases,
and even data, in one flow charting tool
 Significantly improves the quality of
requirements and test cases.
 Reduces costs of testing by detecting the
smallest number of test cases that have
the maximum coverage, removes
duplicate or redundant test cases
12 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
CA Agile Requirements Design – Create perfect test cases
 Generate the smallest number of test
cases with maximum coverage
 Test more functionality in fewer tests
 Measure test coverage and know that
every requirement has been tested
The cost and complexity tool in CA Test Case Optimizer
With ARD Without ARD
No of Test Cases 450 318
Code Coverage 63 55
Functional Coverage 67% ~70% (Est)
Man Days to Create 3 40
13 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Integration of TDM & ARD in a Broader
DEVOPS Use Case
14 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Big Picture End to End Testing
 24 User Stories were identified in CA Agile
Central that describe the functional behavior
of flat file generation capability
 We modeled these stories using Agile
Requirements Designer, resulting in 1 Top Flow
and 6 Sub Flows
 ‘Full Coverage – All Paths’ option yielded
17,000 Test Cases. However, an optimal code
coverage of 70% was achieved using ‘Full
Coverage – All In/Out Edges ’ option resulting
in more manageable set of 450 Test Cases
 The Test Data was provided in context of each
model to drive the automation
 The Test Cases were automated by associating
a code snippet to each node on the flow so
that export of any path resulted in an end-end
automation
15 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Demo of Use Cases
16 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Today’s Demo
 Synthetically generate multiple XMLs using Test Data Manager
 Model the paths of the data generation use case using Agile
Requirements Designer
 Automate the data generation testing using the model from
Agile Requirements Designer
17 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Questions?
18 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Recommended Sessions
SESSION # TITLE DATE/TIME
DO5X06L
Pre-Con Lab: Test Data Manager - Masking, subsetting
and generating synthetic data
11/15/2016 at 9:00 am
DO5T06T
TechTalk: Sometimes Less is More –Visualization Can
Reduce your Test Data while Enhancing Quality!
11/16/2016 at 3:00 pm
DO5X38S
Case Study: GM Financial's Test Data Management and
Automated Testing Journey
11/17/2016 at 3:45 pm
19 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Must See Demos
Use Model
Based Testing
Continuous
Delivery
Continuous Delivery
Theater 5
Achieve Max
Test Coverage
CA ARD
Theatre 5
Deliver Test
Data Faster
CA TDM
Theater 5
CA ARD
Theatre 5
20 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Thank you.
Stay connected at communities.ca.com
@CAWORLD #CAWORLD © 2016 CA. All RIGHTS RESERVED.21 @CAWORLD #CAWORLD
DevOps – Continuous Delivery
For more information on DevOps – Continuous Delivery, please
visit: http://cainc.to/PiTFpu

More Related Content

What's hot

What's hot (20)

Hands-on Lab: Get the Most Out of CA Service Management Unified Self-service
Hands-on Lab: Get the Most Out of CA Service Management Unified Self-serviceHands-on Lab: Get the Most Out of CA Service Management Unified Self-service
Hands-on Lab: Get the Most Out of CA Service Management Unified Self-service
 
Pre-Con Ed: CA Workload Automation iDash for CA Workload Automation CA 7 r12 ...
Pre-Con Ed: CA Workload Automation iDash for CA Workload Automation CA 7 r12 ...Pre-Con Ed: CA Workload Automation iDash for CA Workload Automation CA 7 r12 ...
Pre-Con Ed: CA Workload Automation iDash for CA Workload Automation CA 7 r12 ...
 
DevOps: From Industry Buzzword to Real Implementation / Real Benefits
DevOps: From Industry Buzzword to Real Implementation / Real BenefitsDevOps: From Industry Buzzword to Real Implementation / Real Benefits
DevOps: From Industry Buzzword to Real Implementation / Real Benefits
 
CA Agile Requirements Designer 101 - an introduction to the general premise o...
CA Agile Requirements Designer 101 - an introduction to the general premise o...CA Agile Requirements Designer 101 - an introduction to the general premise o...
CA Agile Requirements Designer 101 - an introduction to the general premise o...
 
Apache JMeter from the Ground Up
Apache JMeter from the Ground UpApache JMeter from the Ground Up
Apache JMeter from the Ground Up
 
Pre-Con Ed: Operational Intelligence – Monitoring the Past to Better Understa...
Pre-Con Ed: Operational Intelligence – Monitoring the Past to Better Understa...Pre-Con Ed: Operational Intelligence – Monitoring the Past to Better Understa...
Pre-Con Ed: Operational Intelligence – Monitoring the Past to Better Understa...
 
Tech Talk: Agile 101: You've Got Scrum Teams. So What?
Tech Talk: Agile 101: You've Got Scrum Teams. So What?Tech Talk: Agile 101: You've Got Scrum Teams. So What?
Tech Talk: Agile 101: You've Got Scrum Teams. So What?
 
Pre-Con Ed: What's New in CA Service Management
Pre-Con Ed: What's New in CA Service ManagementPre-Con Ed: What's New in CA Service Management
Pre-Con Ed: What's New in CA Service Management
 
Pre-Con Ed: Your Voice Counts! Customer Driven Requirements for CA Workload A...
Pre-Con Ed: Your Voice Counts! Customer Driven Requirements for CA Workload A...Pre-Con Ed: Your Voice Counts! Customer Driven Requirements for CA Workload A...
Pre-Con Ed: Your Voice Counts! Customer Driven Requirements for CA Workload A...
 
What's New in CA Test Data Manager 4.0?
What's New in CA Test Data Manager 4.0?What's New in CA Test Data Manager 4.0?
What's New in CA Test Data Manager 4.0?
 
Pre-Con Ed: CA API Gateway: Managing and Migrating Policies with the Gateway ...
Pre-Con Ed: CA API Gateway: Managing and Migrating Policies with the Gateway ...Pre-Con Ed: CA API Gateway: Managing and Migrating Policies with the Gateway ...
Pre-Con Ed: CA API Gateway: Managing and Migrating Policies with the Gateway ...
 
Pre-Con Ed: Planning Disaster Recovery for CA Workload Automation AE
Pre-Con Ed: Planning Disaster Recovery for CA Workload Automation AEPre-Con Ed: Planning Disaster Recovery for CA Workload Automation AE
Pre-Con Ed: Planning Disaster Recovery for CA Workload Automation AE
 
Pre-Con Ed: CA Mobile App Services: Build the Powerful Mobile App Every Enter...
Pre-Con Ed: CA Mobile App Services: Build the Powerful Mobile App Every Enter...Pre-Con Ed: CA Mobile App Services: Build the Powerful Mobile App Every Enter...
Pre-Con Ed: CA Mobile App Services: Build the Powerful Mobile App Every Enter...
 
Pre-Con Ed: CA Workload Automation DE: Tips and Tricks
Pre-Con Ed: CA Workload Automation DE: Tips and TricksPre-Con Ed: CA Workload Automation DE: Tips and Tricks
Pre-Con Ed: CA Workload Automation DE: Tips and Tricks
 
Pre-Con Ed: Migrating to COBOL 5 and Beyond
Pre-Con Ed: Migrating to COBOL 5 and BeyondPre-Con Ed: Migrating to COBOL 5 and Beyond
Pre-Con Ed: Migrating to COBOL 5 and Beyond
 
Strategies for DevOps in the API and Microservices World
Strategies for DevOps in the API and Microservices WorldStrategies for DevOps in the API and Microservices World
Strategies for DevOps in the API and Microservices World
 
What's New in CA Agile Requirements Designer?
What's New in CA Agile Requirements Designer?What's New in CA Agile Requirements Designer?
What's New in CA Agile Requirements Designer?
 
Pre-Con Ed: Streamline Agile Workload Automation Processes for a Repeatable a...
Pre-Con Ed: Streamline Agile Workload Automation Processes for a Repeatable a...Pre-Con Ed: Streamline Agile Workload Automation Processes for a Repeatable a...
Pre-Con Ed: Streamline Agile Workload Automation Processes for a Repeatable a...
 
Tech Talk: Agile Product Management Playbook
Tech Talk: Agile Product Management PlaybookTech Talk: Agile Product Management Playbook
Tech Talk: Agile Product Management Playbook
 
Pre Con Ed: Optimize Cloud Services and Operations With CA Process Automation
Pre Con Ed: Optimize Cloud Services and Operations With CA Process AutomationPre Con Ed: Optimize Cloud Services and Operations With CA Process Automation
Pre Con Ed: Optimize Cloud Services and Operations With CA Process Automation
 

Viewers also liked

Test management in scrum
Test management in scrumTest management in scrum
Test management in scrum
QA Club Kiev
 

Viewers also liked (20)

What test coverage mean to us
What test coverage mean to usWhat test coverage mean to us
What test coverage mean to us
 
C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010
C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010
C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010
 
20161028 mindmaps- a killer way to increase your test coverage
20161028 mindmaps- a killer way to increase your test coverage 20161028 mindmaps- a killer way to increase your test coverage
20161028 mindmaps- a killer way to increase your test coverage
 
Agile code quality metrics
Agile code quality metricsAgile code quality metrics
Agile code quality metrics
 
Test management in scrum
Test management in scrumTest management in scrum
Test management in scrum
 
API World 2016 presentation
API World 2016 presentationAPI World 2016 presentation
API World 2016 presentation
 
Pre-Con Ed: Improving Your Response to Events – Performance First Responders
Pre-Con Ed: Improving Your Response to Events – Performance First RespondersPre-Con Ed: Improving Your Response to Events – Performance First Responders
Pre-Con Ed: Improving Your Response to Events – Performance First Responders
 
Pre-Con Ed: So You Implemented a Service Bus? How Ya' Gonna Test That Monster?
Pre-Con Ed: So You Implemented a Service Bus? How Ya' Gonna Test That Monster?Pre-Con Ed: So You Implemented a Service Bus? How Ya' Gonna Test That Monster?
Pre-Con Ed: So You Implemented a Service Bus? How Ya' Gonna Test That Monster?
 
Installation instruction of Testlink
Installation instruction of TestlinkInstallation instruction of Testlink
Installation instruction of Testlink
 
Pre-Con Education: Shift-Left Performance Testing for Shift-Forward Quality
Pre-Con Education: Shift-Left Performance Testing for Shift-Forward QualityPre-Con Education: Shift-Left Performance Testing for Shift-Forward Quality
Pre-Con Education: Shift-Left Performance Testing for Shift-Forward Quality
 
Pre-Con Education: Winning at Continuous Delivery with Service Virtualization
Pre-Con Education: Winning at Continuous Delivery with Service VirtualizationPre-Con Education: Winning at Continuous Delivery with Service Virtualization
Pre-Con Education: Winning at Continuous Delivery with Service Virtualization
 
API World 2016 - API Mashup - Combining for Fun and Profit
API World 2016 - API Mashup - Combining for Fun and ProfitAPI World 2016 - API Mashup - Combining for Fun and Profit
API World 2016 - API Mashup - Combining for Fun and Profit
 
Pre-Con Ed: Workshop on Policy Creation, Management and Support for OAuth and...
Pre-Con Ed: Workshop on Policy Creation, Management and Support for OAuth and...Pre-Con Ed: Workshop on Policy Creation, Management and Support for OAuth and...
Pre-Con Ed: Workshop on Policy Creation, Management and Support for OAuth and...
 
Pros, Cons, Pitfalls of common Docker container architectures (#dockitecture)
Pros, Cons, Pitfalls of common Docker container architectures (#dockitecture)Pros, Cons, Pitfalls of common Docker container architectures (#dockitecture)
Pros, Cons, Pitfalls of common Docker container architectures (#dockitecture)
 
Pre-Con Ed: CA API Developer Portal: Policy Writing for the Portal Using the ...
Pre-Con Ed: CA API Developer Portal: Policy Writing for the Portal Using the ...Pre-Con Ed: CA API Developer Portal: Policy Writing for the Portal Using the ...
Pre-Con Ed: CA API Developer Portal: Policy Writing for the Portal Using the ...
 
QA Club Kiev #18 - Test Management in Google Sheets
QA Club Kiev #18 - Test Management in Google SheetsQA Club Kiev #18 - Test Management in Google Sheets
QA Club Kiev #18 - Test Management in Google Sheets
 
Pre-Con Ed: Migrate to CA Release Automation 6.x to Exploit New Features
Pre-Con Ed: Migrate to CA Release Automation 6.x to Exploit New FeaturesPre-Con Ed: Migrate to CA Release Automation 6.x to Exploit New Features
Pre-Con Ed: Migrate to CA Release Automation 6.x to Exploit New Features
 
Pre-Con Education: Changing End Points Getting You Down While Trying to Creat...
Pre-Con Education: Changing End Points Getting You Down While Trying to Creat...Pre-Con Education: Changing End Points Getting You Down While Trying to Creat...
Pre-Con Education: Changing End Points Getting You Down While Trying to Creat...
 
Pre-Con Ed: How to Provide Mobile Users With a Convenient, Yet Secure, Sessio...
Pre-Con Ed: How to Provide Mobile Users With a Convenient, Yet Secure, Sessio...Pre-Con Ed: How to Provide Mobile Users With a Convenient, Yet Secure, Sessio...
Pre-Con Ed: How to Provide Mobile Users With a Convenient, Yet Secure, Sessio...
 
Pre-Con Ed: What's New in Service Virtualization V10.0?
Pre-Con Ed: What's New in Service Virtualization V10.0?Pre-Con Ed: What's New in Service Virtualization V10.0?
Pre-Con Ed: What's New in Service Virtualization V10.0?
 

Similar to Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

Similar to Pre-Con Ed: There has to be a Better Way to Fast Test Coverage! (20)

Case Study: How CA Went From 40 Days to Three Days Building Crystal-Clear Tes...
Case Study: How CA Went From 40 Days to Three Days Building Crystal-Clear Tes...Case Study: How CA Went From 40 Days to Three Days Building Crystal-Clear Tes...
Case Study: How CA Went From 40 Days to Three Days Building Crystal-Clear Tes...
 
Case Study: How CA Went From 40 Days to Three Days Building Crystal-Clear Tes...
Case Study: How CA Went From 40 Days to Three Days Building Crystal-Clear Tes...Case Study: How CA Went From 40 Days to Three Days Building Crystal-Clear Tes...
Case Study: How CA Went From 40 Days to Three Days Building Crystal-Clear Tes...
 
Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...
Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...
Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...
 
Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...
Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...
Keynote: Unlock the Power of Continuous Delivery with End-to-End, Integrated ...
 
Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...
Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...
Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...
 
Blazing Fast Testing for Blazing Fast Apps
Blazing Fast Testing for Blazing Fast AppsBlazing Fast Testing for Blazing Fast Apps
Blazing Fast Testing for Blazing Fast Apps
 
Reinventing Application Performance Testing with Service Virtualization
Reinventing Application Performance Testing with Service VirtualizationReinventing Application Performance Testing with Service Virtualization
Reinventing Application Performance Testing with Service Virtualization
 
Inawisdom MLOPS
Inawisdom MLOPSInawisdom MLOPS
Inawisdom MLOPS
 
Use Layered Model-Based Requirements to Achieve Continuous Testing
Use Layered Model-Based Requirements to Achieve Continuous TestingUse Layered Model-Based Requirements to Achieve Continuous Testing
Use Layered Model-Based Requirements to Achieve Continuous Testing
 
Virtual Sandbox for Data Scientists at Enterprise Scale
Virtual Sandbox for Data Scientists at Enterprise ScaleVirtual Sandbox for Data Scientists at Enterprise Scale
Virtual Sandbox for Data Scientists at Enterprise Scale
 
TechTalk: Going Full Circle - Linking Code to Tests to Requirements and Back ...
TechTalk: Going Full Circle - Linking Code to Tests to Requirements and Back ...TechTalk: Going Full Circle - Linking Code to Tests to Requirements and Back ...
TechTalk: Going Full Circle - Linking Code to Tests to Requirements and Back ...
 
Build Your Custom Performance Testing Framework
Build Your Custom Performance Testing FrameworkBuild Your Custom Performance Testing Framework
Build Your Custom Performance Testing Framework
 
End-to-End Continuous Delivery with CA Automic Release Automation and CA Serv...
End-to-End Continuous Delivery with CA Automic Release Automation and CA Serv...End-to-End Continuous Delivery with CA Automic Release Automation and CA Serv...
End-to-End Continuous Delivery with CA Automic Release Automation and CA Serv...
 
Pre-Con Ed: CA Software Asset Management - Key Customer Topics
Pre-Con Ed: CA Software Asset Management - Key Customer TopicsPre-Con Ed: CA Software Asset Management - Key Customer Topics
Pre-Con Ed: CA Software Asset Management - Key Customer Topics
 
Microservice Lifecycle Demo Presentation
Microservice Lifecycle Demo PresentationMicroservice Lifecycle Demo Presentation
Microservice Lifecycle Demo Presentation
 
Serverless is a win for businesses, not just developers
Serverless is a win for businesses, not just developersServerless is a win for businesses, not just developers
Serverless is a win for businesses, not just developers
 
How to Build the Right Automation
How to Build the Right AutomationHow to Build the Right Automation
How to Build the Right Automation
 
SAP on Azure - Deck
SAP on Azure - DeckSAP on Azure - Deck
SAP on Azure - Deck
 
Using Artificial Intelligence to power Service Virtualization
Using Artificial Intelligence to power Service VirtualizationUsing Artificial Intelligence to power Service Virtualization
Using Artificial Intelligence to power Service Virtualization
 
It's the 2010's. Why are you Still Manually Writing Tests?
It's the 2010's. Why are you Still Manually Writing Tests?It's the 2010's. Why are you Still Manually Writing Tests?
It's the 2010's. Why are you Still Manually Writing Tests?
 

More from CA Technologies

More from CA Technologies (20)

CA Mainframe Resource Intelligence
CA Mainframe Resource IntelligenceCA Mainframe Resource Intelligence
CA Mainframe Resource Intelligence
 
Mainframe as a Service: Sample a Buffet of IBM z/OS® Platform Excellence
Mainframe as a Service: Sample a Buffet of IBM z/OS® Platform ExcellenceMainframe as a Service: Sample a Buffet of IBM z/OS® Platform Excellence
Mainframe as a Service: Sample a Buffet of IBM z/OS® Platform Excellence
 
Case Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software DevelopmentCase Study: How The Home Depot Built Quality Into Software Development
Case Study: How The Home Depot Built Quality Into Software Development
 
Pre-Con Ed: Privileged Identity Governance: Are You Certifying Privileged Use...
Pre-Con Ed: Privileged Identity Governance: Are You Certifying Privileged Use...Pre-Con Ed: Privileged Identity Governance: Are You Certifying Privileged Use...
Pre-Con Ed: Privileged Identity Governance: Are You Certifying Privileged Use...
 
Case Study: Privileged Access in a World on Time
Case Study: Privileged Access in a World on TimeCase Study: Privileged Access in a World on Time
Case Study: Privileged Access in a World on Time
 
Case Study: How SGN Used Attack Path Mapping to Control Privileged Access in ...
Case Study: How SGN Used Attack Path Mapping to Control Privileged Access in ...Case Study: How SGN Used Attack Path Mapping to Control Privileged Access in ...
Case Study: How SGN Used Attack Path Mapping to Control Privileged Access in ...
 
Case Study: Putting Citizens at The Center of Digital Government
Case Study: Putting Citizens at The Center of Digital GovernmentCase Study: Putting Citizens at The Center of Digital Government
Case Study: Putting Citizens at The Center of Digital Government
 
Making Security Work—Implementing a Transformational Security Program
Making Security Work—Implementing a Transformational Security ProgramMaking Security Work—Implementing a Transformational Security Program
Making Security Work—Implementing a Transformational Security Program
 
Keynote: Making Security a Competitive Advantage
Keynote: Making Security a Competitive AdvantageKeynote: Making Security a Competitive Advantage
Keynote: Making Security a Competitive Advantage
 
Emerging Managed Services Opportunities in Identity and Access Management
Emerging Managed Services Opportunities in Identity and Access ManagementEmerging Managed Services Opportunities in Identity and Access Management
Emerging Managed Services Opportunities in Identity and Access Management
 
The Unmet Demand for Premium Cloud Monitoring Services—and How Service Provid...
The Unmet Demand for Premium Cloud Monitoring Services—and How Service Provid...The Unmet Demand for Premium Cloud Monitoring Services—and How Service Provid...
The Unmet Demand for Premium Cloud Monitoring Services—and How Service Provid...
 
Leveraging Monitoring Governance: How Service Providers Can Boost Operational...
Leveraging Monitoring Governance: How Service Providers Can Boost Operational...Leveraging Monitoring Governance: How Service Providers Can Boost Operational...
Leveraging Monitoring Governance: How Service Providers Can Boost Operational...
 
The Next Big Service Provider Opportunity—Beyond Infrastructure: Architecting...
The Next Big Service Provider Opportunity—Beyond Infrastructure: Architecting...The Next Big Service Provider Opportunity—Beyond Infrastructure: Architecting...
The Next Big Service Provider Opportunity—Beyond Infrastructure: Architecting...
 
Application Experience Analytics Services: The Strategic Digital Transformati...
Application Experience Analytics Services: The Strategic Digital Transformati...Application Experience Analytics Services: The Strategic Digital Transformati...
Application Experience Analytics Services: The Strategic Digital Transformati...
 
Application Experience Analytics Services: The Strategic Digital Transformati...
Application Experience Analytics Services: The Strategic Digital Transformati...Application Experience Analytics Services: The Strategic Digital Transformati...
Application Experience Analytics Services: The Strategic Digital Transformati...
 
Strategic Direction Session: Deliver Next-Gen IT Ops with CA Mainframe Operat...
Strategic Direction Session: Deliver Next-Gen IT Ops with CA Mainframe Operat...Strategic Direction Session: Deliver Next-Gen IT Ops with CA Mainframe Operat...
Strategic Direction Session: Deliver Next-Gen IT Ops with CA Mainframe Operat...
 
Strategic Direction Session: Enhancing Data Privacy with Data-Centric Securit...
Strategic Direction Session: Enhancing Data Privacy with Data-Centric Securit...Strategic Direction Session: Enhancing Data Privacy with Data-Centric Securit...
Strategic Direction Session: Enhancing Data Privacy with Data-Centric Securit...
 
Blockchain: Strategies for Moving From Hype to Realities of Deployment
Blockchain: Strategies for Moving From Hype to Realities of DeploymentBlockchain: Strategies for Moving From Hype to Realities of Deployment
Blockchain: Strategies for Moving From Hype to Realities of Deployment
 
Establish Digital Trust as the Currency of Digital Enterprise
Establish Digital Trust as the Currency of Digital EnterpriseEstablish Digital Trust as the Currency of Digital Enterprise
Establish Digital Trust as the Currency of Digital Enterprise
 
How Components Increase Speed and Risk
How Components Increase Speed and RiskHow Components Increase Speed and Risk
How Components Increase Speed and Risk
 

Recently uploaded

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Recently uploaded (20)

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 

Pre-Con Ed: There has to be a Better Way to Fast Test Coverage!

  • 1. There Has To Be a Better Way To Fast Test Coverage Mark Braemer - Sr. Principal Consultant - CA Technologies DO5X28E DEVOPS
  • 2. 3 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD © 2016 CA. All rights reserved. All trademarks referenced herein belong to their respective companies. The content provided in this CA World 2016 presentation is intended for informational purposes only and does not form any type of warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA. For Informational Purposes Only Terms of this Presentation
  • 3. 4 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Abstract Are you tired of lousy test coverage? This presentation will show you how to obtain high test coverage without all the hassle most organizations encounter. See in a demo how CA Test Data Manager and CA Agile Requirements Designer work together to help you build better test cases with better coverage using better data! Mark Braemer CA Technologies Sr. Principal Consultant
  • 4. 5 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Agenda OVERVIEW OF CA TEST DATA MANAGER OVERVIEW OF CA AGILE REQUIREMENTS DESIGNER INTEGRATION OF TDM & ARD IN A BROADER DEVOPS USE CASE DEMO OF USE CASES Q&A 1 2 3 4 5
  • 5. 6 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Overview of CA Test Data Manager
  • 6. 7 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD CA Test Data Manager Data Discovery, modeling, visualization and Profiling Data Subsetting, Masking and Synthetic Data Generation Test Data on Demand™  Review data quality and data errors  Measure coverage and identify gaps  Discover relationships  Identify sensitive data across all systems  Identify future trends  Share data across parallel teams  Enable Self-Service on demand access  Provide multiple outsources with secure data  Eliminate manual data creation and masking  Reduce costs and improve quality with short but rigorous test cycles  Improve test coverage
  • 7. 8 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Synthetic Test Data Generation “Empty” CA TDM + Required Data Characteristics Provision fit for purpose test data anytime and every time! Provision data without access to production systems! Reduce cost of creation and maintenance of Test Data. Ready for Testing! 8 Find/n Demand
  • 8. 9 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Synthetic Generation of Flat Files  Create high quality test data to test applications that rely on non-relational database sources.  Generate synthetic data in various formats including XSD/XML, WSDL, RR pair, JSON etc.  Publish RR Pairs to a virtual service via integration with CA Service Virtualization
  • 9. 10 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Overview of CA Agile Requirements Designer
  • 10. 11 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD What is CA Agile Requirements Designer?  Graphs sophisticated business processes and path modeling.  Defines and optimizes requirements and test case designs  Designs clear requirements, test cases, and even data, in one flow charting tool  Significantly improves the quality of requirements and test cases.  Reduces costs of testing by detecting the smallest number of test cases that have the maximum coverage, removes duplicate or redundant test cases
  • 11. 12 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD CA Agile Requirements Design – Create perfect test cases  Generate the smallest number of test cases with maximum coverage  Test more functionality in fewer tests  Measure test coverage and know that every requirement has been tested The cost and complexity tool in CA Test Case Optimizer With ARD Without ARD No of Test Cases 450 318 Code Coverage 63 55 Functional Coverage 67% ~70% (Est) Man Days to Create 3 40
  • 12. 13 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Integration of TDM & ARD in a Broader DEVOPS Use Case
  • 13. 14 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Big Picture End to End Testing  24 User Stories were identified in CA Agile Central that describe the functional behavior of flat file generation capability  We modeled these stories using Agile Requirements Designer, resulting in 1 Top Flow and 6 Sub Flows  ‘Full Coverage – All Paths’ option yielded 17,000 Test Cases. However, an optimal code coverage of 70% was achieved using ‘Full Coverage – All In/Out Edges ’ option resulting in more manageable set of 450 Test Cases  The Test Data was provided in context of each model to drive the automation  The Test Cases were automated by associating a code snippet to each node on the flow so that export of any path resulted in an end-end automation
  • 14. 15 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Demo of Use Cases
  • 15. 16 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Today’s Demo  Synthetically generate multiple XMLs using Test Data Manager  Model the paths of the data generation use case using Agile Requirements Designer  Automate the data generation testing using the model from Agile Requirements Designer
  • 16. 17 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Questions?
  • 17. 18 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Recommended Sessions SESSION # TITLE DATE/TIME DO5X06L Pre-Con Lab: Test Data Manager - Masking, subsetting and generating synthetic data 11/15/2016 at 9:00 am DO5T06T TechTalk: Sometimes Less is More –Visualization Can Reduce your Test Data while Enhancing Quality! 11/16/2016 at 3:00 pm DO5X38S Case Study: GM Financial's Test Data Management and Automated Testing Journey 11/17/2016 at 3:45 pm
  • 18. 19 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Must See Demos Use Model Based Testing Continuous Delivery Continuous Delivery Theater 5 Achieve Max Test Coverage CA ARD Theatre 5 Deliver Test Data Faster CA TDM Theater 5 CA ARD Theatre 5
  • 19. 20 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Thank you. Stay connected at communities.ca.com
  • 20. @CAWORLD #CAWORLD © 2016 CA. All RIGHTS RESERVED.21 @CAWORLD #CAWORLD DevOps – Continuous Delivery For more information on DevOps – Continuous Delivery, please visit: http://cainc.to/PiTFpu

Editor's Notes

  1. As you build out your presentation, here are a few dos and don’ts.
  2. This is where CA Test Data Management Solution comes into play. It simplifies the entire test process from test design to on-demand data access for testers. In June 2015 CA completed its acquisition of Grid Tools. Gets the data and/or defines the data that will be generated Automatically match fit for purpose data to the minimum number of tests, cover 100% of requirements in the smallest number of tests Visualize the test data, identifying the white spaces in test data and identify data that will need to be generated to fill the white space. Identify trends within your data, and assess the impact of future trends Data Masking we have two different masking options Fast Data Masking - Native Database Connections – fast, masked views and shadow tables Simple Data Masking - Generic Connectors Synthesizing Fill in data gaps Create sets of “bug” data Masking enables compliance, but synthetic data ensures it Enhance legacy data using synthetic data creation Test Data on Demand - Test Data on Demand is a self-service, web portal that sits on top of the Test Data Warehouse. Centralizing data requests and removing data dependencies lets you reduce the time to provision consistent, rich sets of intelligent data by 50%. Data can also be linked directly to test cases and re-used and shared across multiple teams, in parallel, to remove the constraints of cross-system dependencies on testing.
  3. Test Case Optimizer Is a business process modeling tool/Flowchart modeling tool. It allows us to take a business process and graphically formalize the requirements, test cases and even data in one tool. It makes requirements very clear and unambigious  it is hard to misinterpret the requirements. Here is a simple example This is a process of making a cup of tea  In this simple example you can see different decision points and different paths it can take. If you are doing this manually it is going to be very hard to tell the number of test cases you need to cover all the paths. That is where TCO comes and it can tell you exactly how many test cases you need to get optimum coverage. It really improves the quality of your requirements and test cases It allows us to analyze and optimize the test cases. Agile Designer™ will increase your functional coverage in minutes by detecting the smallest number of test cases that have the maximum coverage. Agile Designer™ will also remove any duplicate, invalid or redundant test cases to avoid test teams over testing the same functionality. Performing fewer test cases of a higher quality means that test cycles will be shortened and the cost of testing reduced, without compromising the quality of the software.
  4. Point One: generate the perfect set of test cases directly from the requirements From the requirements flowchart, Agile Designer will identify every possible path through the system. Where it gets clever is the path optimization. This uses “deep, dark maths” to identify the smallest number of paths needed to fully test a systems functionality – i.e., to fully test the requirements now that they are fully defined. Users can choose from multiple algorithms, to automatically generate the smallest number of test cases to cover: all possible paths; all edges (arrows in/out of the blocks); all nodes; all in/out edges; all pairs. Automatically generating test cases removes testing bottlenecks: Manually writing test cases and test scripts is slow and error-prone (i.e., it provides poor coverage) For example: 6 hours to produce 11 test cases with 16% coverage (internal) Testing currently takes up around 47% of the SDLC. Path explorer – Look at all possible paths through the functional logic of the flowchart Identify the smallest number of test cases needed to test maximum functionality Store/create your test cases (use cases) Store these test cases – push them out to automation engines, ALM/QC etc. In the path explorer: go to your test cases, and click ‘export special’. Select which folder you want to save them in. Update and add new test cases. Point two: maximum coverage means you can test more for less Agile Designer helps reduce testing time and costs by identifying the smallest number of tests needed. This means that you can systematically improve coverage, knowing that all requirements have been tested. This is in contrast to industry standard, where much testing is redundant, and much functionality goes untested: Over-testing of certain functions by 40 times Typically only 10-20% coverage – negative/unhappy paths go untested Up to 30% of testing time is wasted on duplicate, invalid or redundant tests Examples of optimization: A financial services company created 11 test cases in 6 hours with 16% requirement coverage Agile Designer automatically created 17 test cases in 2 hours with 100% coverage Another project relied on 3 test cases which provided just 5% coverage, this resulted in bugs making it into production which is expensive to fix Agile Designer generated 12 test cases with 100% coverage in 30 minutes In one project, the possible number of cases identified was 326; Agile Designer identified that only 17 were needed for 100% coverage Point Three: The same algorithms used to identify the test cases can be used assess how much functional coverage the stored test cases provide. The notion of perfect test cases is based on the concept of coverage, path modelling and risk-based testing.