TechVision: Test Data on Demand: Delivering the Right Data, to the Right Place, at the Right Time

World®
’16
TechVision: Test Data on
Demand: Delivering the Right
Data, to the Right Place, at the
Right Time
Arif Muhammad – Director Product Management – CA Technologies
Abhijit Mugali – Sr Principal Product Owner, CA Test Data Manager – CA Technologies
DO5X42S
DEVOPS

2 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
© 2016 CA. All rights reserved. All trademarks referenced herein belong to their respective companies.
The content provided in this CA World 2016 presentation is intended for informational purposes only and does not form any type of
warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA.
For Informational Purposes Only
Terms of this Presentation

Abstract
In order to deliver quality software on time, testers require on demand access to the exact data
needed to satisfy a given set of test cases. However, they are frequently left waiting idly for an
upstream team who are overwhelmed with requests to provision their data. Data is further
unavailable in parallel, and rare or interesting data is used up by another team. Often, the data
eventually provisioned is a large copy of production data, so that testers spend even more time
looking for the data they need for a given test, or have to create it manually when it doesn’t
exist.
This session will offer a different approach to data provisioning, which removes the dependency
of testers on an upstream team. Instead, “gold copy” data that contains all the possible
combinations needed for testing is created and is stored as re-usable assets in a central
repository. From there, the data sets are made accessible to testers on demand, using a self-
service web-portal. Dynamic form building allows data request forms to be constructed using
the exact criteria needed for specific test cases, using the language of the requirements and
tests themselves. The data is then delivered automatically and is cloned as it is provisioned. The
re-usable data sets can therefore be used in parallel, delivering quality software earlier, and at
less cost.
Arif
Mohammed
CA Technologies
Director Product
Management
Abhijit
Mugali
CA Technologies
Sr. Principal Product
Owner

Agenda
DATA PROVISIONING: WHAT DOES IT MEAN FOR TESTERS?
SELF-SERVICE, ON DEMAND PROVISIONING
CA TDM TEST DATA AS A DATA DELIVERY PLATFORM
SETTING UP THE SERVICES
COMPLETE, END-TO-END TEST DATA MANAGEMENT
Q & A
1
2
3
4
5
6

Data Provisioning: What Does It Mean
For Testers?

Testing Becomes the Blocker for Agile Adoption
Testers feel helpless
as they cannot find Test Data for the testing
scenarios they need to cover in the short
timeframe they have.

Test Data Mgmt
Team
Test Data Provisioning Process
How is it done today?
Upstream
dependency
Manual
provisioning
Data
constraints
Data Requests
Testers
6-8 weeks turnaround time
Composite Apps
Data is spread across Multiple DBs

Data
Provisioned
No Metrics, No Visibility and No Certainty
Data Request

What if there
was technology
to provide self-
service data
access to
testers, with
automatic
delivery?
Demo
World®
’16© 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD9

Gartner’s IT Service Management Maturity Model
Source: http://performancematters.blogspot.com/2005_11_01_archive.html

What Testing Teams Want?
§ A way for them to find/mine the Business Object across
environments for the scenarios they are about to Test.
§ Ability to copy/clone found Business Objects into their target
environments
§ Decouple Test Data From Test Cases so it can be executed in
any environment where data matching criteria exists
§ Optimally Allocate/Reserve data for specific test cases before
test case execution

Translating These Wants to a Service?
§ Look for repeated requests of same type of data with
variations
§ Once you know what is being requested again and again
decide fastest way to automate the data request
§ Choose from
– Fully synthetically generated
– Let the Tester find data from other environments and clone it to target
– Create a central copy of re-usable dataset patterns in the form of Gold
copy and keep augmenting the Gold copy with more patterns

Get Your Data to Serve – Golden Copy
§ Logical Concept of group of interrelated databases across multiple data
sources
§ Contains set of base data patterns interesting for the Testers
§ Data needs to be referentially correct across sources so that an end to end
business scenario across app component is testable
§ Generally the gold copy get replicated to Dev and Test environments
§ New Data into the Gold copy can come from production refresh or
Synthetic Data Generation

Step 1 – Acquire the Data – Traditional way
COPY PRODUCTION DATA SUBSET MASK
Production data does not provide the
data testers need to run their tests Data is masked and inserted into different
data stores for dev/test

Step 2 – Find Coverage Gaps
Production data is:
§ Drawn from past scenarios with users
behaving as expected
§ It therefore does not contain bad data,
outliers or future scenarios
Testers need:
§ Data to satisfy the full range of test cases
§ This includes negative testing, data for
boundary testing, etc.
Our audits have found that it typically covers just 10-20% of tests

Step 3 – Fill the Gaps Using Synthetic Data Generation
§ Profile data, model it, and accurately measure its coverage
§ Generate rich synthetic data which provides 100% coverage
§ Cover every outlier, unexpected result, boundary condition and negative path
Not Ready for Testing!
CA Test Data Manager + Required data characteristics
Provision fit for purpose data anytime and every time
Provision data with or without access to production systems
Ready for Testing!

Gold Copy is Not a Copy of Production Data
Production data is:
§ Drawn from past, scenarios with users
behaving as expected
§ It therefore does not contain bad data,
outliers or future scenarios
Testers need:
§ Data to satisfy the full range of test cases
§ This includes negative testing, data for
boundary testing, etc.
Our audits have found that it typically covers just 10-20% of tests

The New “Gold Standard”:
1. Provides a standard set of data to test with
2. Data is “production-like”, up-to-date and contains all previous data
3. It overs all possible tests that need to be run, including future and
negative scenarios
4. Contains enough data to test with repeatedly
5. Is up-to-date, Contains no sensitive data
6. New data can be easily and continuously added, with cloning,
reservation and locking
7. Data can be cloned without the need to duplicate
□
□
□
□
□
□
□

Create Self-Served Test Data Services
§ Based on specific requirement decide on
– Synthetic Data Generation service from scratch – more time consuming to
setup
– Clone
§ Let tester find specific data pattern from the one environment/Gold Copy and make a
clone into different or same environment with certain variations
– Hybrid service – set of business objects are cloned while transactional data is
Generated
§ Allow Tester to Reserve the Data for their specific test cases to avoid
overstepping using Test Data Criteria-Test Case Mapping

Complete, End-to-End Test Data
Management

Enterprise Wide TDM COE
Test Data
Warehouse
App2App 1
Enterprise Test Data Management as COE for Agile Teams
CA’s Vision
Ops Controlled Dev Controlled
Profile, Subset & Mask
Visualize and
Analyze Data
Quality
Copy, Clone,
Generate Data
to Target
Find Data across
environments
Configure
Create
Manage
Test Data
Engineer
Scrum teams
Deliver Data in
format user
needs
Large number of DB
& Data Sources
Supported
Across Mainframe
And Distributed
Production DB
App2App 1
Test Data Engineer
Data Services Catalog
Agile
Central Service Virtualization

Questions?

Must See Demos
Data
Compliance and
Testing
CA TDM
Theatre 5
Deliver Test
Data Faster
CA TDM
Theatre 5
Use Model
Based Testing
CA ARD
Theatre 5
Achieve
Maximum Test
Coverage
CA ARD
Theatre 5

Stay connected at communities.ca.com
Thank you.

DevOps – Continuous Delivery
For more information on DevOps – Continuous Delivery, please
visit: http://cainc.to/PiTFpu

TechVision: Test Data on Demand: Delivering the Right Data, to the Right Place, at the Right Time

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (9)

Similar to TechVision: Test Data on Demand: Delivering the Right Data, to the Right Place, at the Right Time

Similar to TechVision: Test Data on Demand: Delivering the Right Data, to the Right Place, at the Right Time (20)

More from CA Technologies

More from CA Technologies (20)

Recently uploaded

Recently uploaded (20)

TechVision: Test Data on Demand: Delivering the Right Data, to the Right Place, at the Right Time