G lobal T esting Retreat
#ATAGTR2023
T E S T D A T A T H E K E Y T O R O B U S T
T E S T C O V E R A G E
Global Testing Retreat
#ATAGTR2023
2, 3 & 8, 9 December 2023
G lobal T esting Retreat
#ATAGTR2023
About Me
Engineering Leader, Quality Assurance
Transunion
LinkedIn Top Voice, Blogger, Speaker
& Mentor
Test Strategy, Leadership, Automation,
Customer Advocacy
Global Testing Retreat
#ATAGTR2023
2, 3 & 8, 9 December 2023
G lobal T esting Retreat
#ATAGTR2023
NEED FOR TEST DATA
Increase
coverage of
testing
Unearth bugs Mimic user
actions on
system
Automation &
NFT
Global Testing Retreat
#ATAGTR2023
G lobal T esting Retreat
#ATAGTR2023
TYPES OF TEST DATA
01 Synthetic Test Data
Data that is generated algorithmically, includes valid and invalid
02 Production Test Data
Data refreshed from prod
Test Data Exists broadly in 2 formats
Global Testing Retreat
#ATAGTR2023
G lobal T esting Retreat
#ATAGTR2023
T E S T D ATA C H A L L E N G E S – A G I L E T E A M S
01
02
03
04
05
Huge Volume of data required in
short sprints
Duplication of test data across
distributed agile teams
Ring fence data for exclusive
access
Manual data creation
Third Party Data Sharing and
Usage
Global Testing Retreat
#ATAGTR2023
G lobal T esting Retreat
#ATAGTR2023
T E S T D ATA C H A L L E N G E S – A G I L E T E A M S
Third Party Data Sharing and
Usage
Third Party Data Sharing and Usage
01
02
03
04
05
Huge Volume of data required in short
sprints
Duplication of test data across
distributed agile teams
Ring fence data for exclusive access
Manual data creation
Third Party Data Sharing
and Usage
Global Testing Retreat
#ATAGTR2023
G lobal T esting Retreat
#ATAGTR2023
T E S T D ATA C H A L L E N G E S – A G I L E T E A M S
Third Party Data Sharing and
Usage
01
02
03
04
05
Huge Volume of data required in
short sprints
Duplication of test data across
distributed agile teams
Ring fence data for exclusive
access
Manual data creation
Global Testing Retreat
#ATAGTR2023
G lobal T esting Retreat
#ATAGTR2023
T E S T D ATA C H A L L E N G E S – A G I L E
T E A M S
01
02
03
04
05
Huge Volume of data required in
short sprints
Duplication of test data across
distributed agile teams
Ring fence data for exclusive
access
Manual data creation
Third Party Data Sharing and
Usage
Global Testing Retreat
#ATAGTR2023
G lobal T esting Retreat
#ATAGTR2023
T E S T D ATA C H A L L E N G E S – A G I L E
T E A M S
01
02
03
04
05
Huge Volume of data required in
short sprints
Duplication of test data across
distributed agile teams
Ring fence data for exclusive
access
Manual data creation
Third Party Data Sharing and
Usage
Global Testing Retreat
#ATAGTR2023
G lobal T esting Retreat
#ATAGTR2023
T E S T D ATA C H A L L E N G E S – A G I L E
T E A M S
01
02
03
04
05
Huge Volume of data required in
short sprints
Duplication of test data across
distributed agile teams
Ring fence data for exclusive
access
Manual data creation
Third Party Data Sharing and
Usage
Global Testing Retreat
#ATAGTR2023
G lobal T esting Retreat
#ATAGTR2023
O U R S U C C E S S S T O R Y – T U C K M A N ’ S T H E O R Y
• Test Data was
manually created
• Duplicates across
teams
• Error prone
• People dependent
• Breakdown in
Collaboration
• Rework across teams
• False positives in test
results
• TDM framework is
formulated
• Pilot teams launched
• Baseline velocity
measured before
implementation
• Velocity increase
tracked sprint on
sprint
• No duplication and
rework of test data
• Consistent test
results
Forming Storming Norming
Performing
Adjourning
• 30% increase in
velocity over time
• Happier teams -
lesser rework
• 3’rd party access to
data
Global Testing Retreat
#ATAGTR2023
G lobal T esting Retreat
#ATAGTR2023
O U R S U C C E S S S T O R Y – T U C K M A N ’ S T H E O R Y
• Test Data was
manually created
• Duplicates across
teams
• Error prone
• People dependent
Forming
Global Testing Retreat
#ATAGTR2023
G lobal T esting Retreat
#ATAGTR2023
O U R S U C C E S S S T O R Y – T U C K M A N ’ S T H E O R Y
• Breakdown in
Collaboration
• Rework across
teams
• False positives in
test results
Storming
• Test Data was
manually created
• Duplicates across
teams
• Error prone
• People dependent
Forming
Global Testing Retreat
#ATAGTR2023
G lobal T esting Retreat
#ATAGTR2023
O U R S U C C E S S S T O R Y – T U C K M A N ’ S T H E O R Y
• Breakdown in
Collaboration
• Rework across
teams
• False positives in
test results
Storming
• TDM framework is
formulated
• Pilot teams
launched
• Baseline velocity
measured before
implementation
Norming
Forming
• Test Data was
manually created
• Duplicates across
teams
• Error prone
• People dependent
Global Testing Retreat
#ATAGTR2023
G lobal T esting Retreat
#ATAGTR2023
O U R S U C C E S S S T O R Y – T U C K M A N ’ S T H E O R Y
• Velocity increase
tracked sprint on
sprint
• No duplication and
rework of test data
• Consistent test
results
• TDM framework is
formulated
• Pilot teams
launched
• Baseline velocity
measured before
implementation
Norming Performing
• Breakdown in
Collaboration
• Rework across
teams
• False positives in
test results
Storming
Forming
• Test Data was
manually created
• Duplicates across
teams
• Error prone
• People dependent
Global Testing Retreat
#ATAGTR2023
G lobal T esting Retreat
#ATAGTR2023
O U R S U C C E S S S T O R Y – T U C K M A N ’ S T H E O R Y
• Velocity increase
tracked sprint on
sprint
• No duplication and
rework of test data
• Consistent test
results
Performing Adjourning
• 30% increase in
velocity over time
• Happier teams -
lesser rework
• 3’rd party access to
data
• TDM framework is
formulated
• Pilot teams
launched
• Baseline velocity
measured before
implementation
Norming
• Breakdown in
Collaboration
• Rework across
teams
• False positives in
test results
Storming
Forming
• Test Data was
manually created
• Duplicates across
teams
• Error prone
• People dependent
Global Testing Retreat
#ATAGTR2023
G lobal T esting Retreat
#ATAGTR2023
R E F E R E N C E A R C H I T E C T U R E
Global Testing Retreat
#ATAGTR2023
G lobal T esting Retreat
#ATAGTR2023
B E N E F I T S
Centralized Mgmt. of test data
Consistent test results due to exclusive access to data
3’rd party access
Self Service Capability
Bulk data generation
Global Testing Retreat
#ATAGTR2023
G lobal T esting Retreat
#ATAGTR2023
It’s not the plane It’s the Pilot
Global Testing Retreat
#ATAGTR2023
G lobal T esting Retreat
#ATAGTR2023
G lobal T esting Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
2, 3 & 8, 9 December 2023

#Interactive Session by Ashok Kumar S, "Test Data the key to robust test coverage" at #ATAGTR2023.

  • 1.
    G lobal Testing Retreat #ATAGTR2023 T E S T D A T A T H E K E Y T O R O B U S T T E S T C O V E R A G E Global Testing Retreat #ATAGTR2023 2, 3 & 8, 9 December 2023
  • 2.
    G lobal Testing Retreat #ATAGTR2023 About Me Engineering Leader, Quality Assurance Transunion LinkedIn Top Voice, Blogger, Speaker & Mentor Test Strategy, Leadership, Automation, Customer Advocacy Global Testing Retreat #ATAGTR2023 2, 3 & 8, 9 December 2023
  • 3.
    G lobal Testing Retreat #ATAGTR2023 NEED FOR TEST DATA Increase coverage of testing Unearth bugs Mimic user actions on system Automation & NFT Global Testing Retreat #ATAGTR2023
  • 4.
    G lobal Testing Retreat #ATAGTR2023 TYPES OF TEST DATA 01 Synthetic Test Data Data that is generated algorithmically, includes valid and invalid 02 Production Test Data Data refreshed from prod Test Data Exists broadly in 2 formats Global Testing Retreat #ATAGTR2023
  • 5.
    G lobal Testing Retreat #ATAGTR2023 T E S T D ATA C H A L L E N G E S – A G I L E T E A M S 01 02 03 04 05 Huge Volume of data required in short sprints Duplication of test data across distributed agile teams Ring fence data for exclusive access Manual data creation Third Party Data Sharing and Usage Global Testing Retreat #ATAGTR2023
  • 6.
    G lobal Testing Retreat #ATAGTR2023 T E S T D ATA C H A L L E N G E S – A G I L E T E A M S Third Party Data Sharing and Usage Third Party Data Sharing and Usage 01 02 03 04 05 Huge Volume of data required in short sprints Duplication of test data across distributed agile teams Ring fence data for exclusive access Manual data creation Third Party Data Sharing and Usage Global Testing Retreat #ATAGTR2023
  • 7.
    G lobal Testing Retreat #ATAGTR2023 T E S T D ATA C H A L L E N G E S – A G I L E T E A M S Third Party Data Sharing and Usage 01 02 03 04 05 Huge Volume of data required in short sprints Duplication of test data across distributed agile teams Ring fence data for exclusive access Manual data creation Global Testing Retreat #ATAGTR2023
  • 8.
    G lobal Testing Retreat #ATAGTR2023 T E S T D ATA C H A L L E N G E S – A G I L E T E A M S 01 02 03 04 05 Huge Volume of data required in short sprints Duplication of test data across distributed agile teams Ring fence data for exclusive access Manual data creation Third Party Data Sharing and Usage Global Testing Retreat #ATAGTR2023
  • 9.
    G lobal Testing Retreat #ATAGTR2023 T E S T D ATA C H A L L E N G E S – A G I L E T E A M S 01 02 03 04 05 Huge Volume of data required in short sprints Duplication of test data across distributed agile teams Ring fence data for exclusive access Manual data creation Third Party Data Sharing and Usage Global Testing Retreat #ATAGTR2023
  • 10.
    G lobal Testing Retreat #ATAGTR2023 T E S T D ATA C H A L L E N G E S – A G I L E T E A M S 01 02 03 04 05 Huge Volume of data required in short sprints Duplication of test data across distributed agile teams Ring fence data for exclusive access Manual data creation Third Party Data Sharing and Usage Global Testing Retreat #ATAGTR2023
  • 11.
    G lobal Testing Retreat #ATAGTR2023 O U R S U C C E S S S T O R Y – T U C K M A N ’ S T H E O R Y • Test Data was manually created • Duplicates across teams • Error prone • People dependent • Breakdown in Collaboration • Rework across teams • False positives in test results • TDM framework is formulated • Pilot teams launched • Baseline velocity measured before implementation • Velocity increase tracked sprint on sprint • No duplication and rework of test data • Consistent test results Forming Storming Norming Performing Adjourning • 30% increase in velocity over time • Happier teams - lesser rework • 3’rd party access to data Global Testing Retreat #ATAGTR2023
  • 12.
    G lobal Testing Retreat #ATAGTR2023 O U R S U C C E S S S T O R Y – T U C K M A N ’ S T H E O R Y • Test Data was manually created • Duplicates across teams • Error prone • People dependent Forming Global Testing Retreat #ATAGTR2023
  • 13.
    G lobal Testing Retreat #ATAGTR2023 O U R S U C C E S S S T O R Y – T U C K M A N ’ S T H E O R Y • Breakdown in Collaboration • Rework across teams • False positives in test results Storming • Test Data was manually created • Duplicates across teams • Error prone • People dependent Forming Global Testing Retreat #ATAGTR2023
  • 14.
    G lobal Testing Retreat #ATAGTR2023 O U R S U C C E S S S T O R Y – T U C K M A N ’ S T H E O R Y • Breakdown in Collaboration • Rework across teams • False positives in test results Storming • TDM framework is formulated • Pilot teams launched • Baseline velocity measured before implementation Norming Forming • Test Data was manually created • Duplicates across teams • Error prone • People dependent Global Testing Retreat #ATAGTR2023
  • 15.
    G lobal Testing Retreat #ATAGTR2023 O U R S U C C E S S S T O R Y – T U C K M A N ’ S T H E O R Y • Velocity increase tracked sprint on sprint • No duplication and rework of test data • Consistent test results • TDM framework is formulated • Pilot teams launched • Baseline velocity measured before implementation Norming Performing • Breakdown in Collaboration • Rework across teams • False positives in test results Storming Forming • Test Data was manually created • Duplicates across teams • Error prone • People dependent Global Testing Retreat #ATAGTR2023
  • 16.
    G lobal Testing Retreat #ATAGTR2023 O U R S U C C E S S S T O R Y – T U C K M A N ’ S T H E O R Y • Velocity increase tracked sprint on sprint • No duplication and rework of test data • Consistent test results Performing Adjourning • 30% increase in velocity over time • Happier teams - lesser rework • 3’rd party access to data • TDM framework is formulated • Pilot teams launched • Baseline velocity measured before implementation Norming • Breakdown in Collaboration • Rework across teams • False positives in test results Storming Forming • Test Data was manually created • Duplicates across teams • Error prone • People dependent Global Testing Retreat #ATAGTR2023
  • 17.
    G lobal Testing Retreat #ATAGTR2023 R E F E R E N C E A R C H I T E C T U R E Global Testing Retreat #ATAGTR2023
  • 18.
    G lobal Testing Retreat #ATAGTR2023 B E N E F I T S Centralized Mgmt. of test data Consistent test results due to exclusive access to data 3’rd party access Self Service Capability Bulk data generation Global Testing Retreat #ATAGTR2023
  • 19.
    G lobal Testing Retreat #ATAGTR2023 It’s not the plane It’s the Pilot Global Testing Retreat #ATAGTR2023
  • 20.
    G lobal Testing Retreat #ATAGTR2023 G lobal T esting Retreat #ATAGTR2023 Global Testing Retreat #ATAGTR2023 2, 3 & 8, 9 December 2023