#Interactive Session by Ashok Kumar S, "Test Data the key to robust test coverage" at #ATAGTR2023. #ATAGTR2023 was the 8th Edition of Global Testing Retreat. To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/

1. G lobal T esting Retreat
#ATAGTR2023
T E S T D A T A T H E K E Y T O R O B U S T
T E S T C O V E R A G E
Global Testing Retreat
#ATAGTR2023
2, 3 & 8, 9 December 2023

2. G lobal T esting Retreat
#ATAGTR2023
About Me
Engineering Leader, Quality Assurance
Transunion
LinkedIn Top Voice, Blogger, Speaker
& Mentor
Test Strategy, Leadership, Automation,
Customer Advocacy
Global Testing Retreat
#ATAGTR2023
2, 3 & 8, 9 December 2023

3. G lobal T esting Retreat
#ATAGTR2023
NEED FOR TEST DATA
Increase
coverage of
testing
Unearth bugs Mimic user
actions on
system
Automation &
NFT
Global Testing Retreat
#ATAGTR2023

4. G lobal T esting Retreat
#ATAGTR2023
TYPES OF TEST DATA
01 Synthetic Test Data
Data that is generated algorithmically, includes valid and invalid
02 Production Test Data
Data refreshed from prod
Test Data Exists broadly in 2 formats
Global Testing Retreat
#ATAGTR2023

5. G lobal T esting Retreat
#ATAGTR2023
T E S T D ATA C H A L L E N G E S – A G I L E T E A M S
01
02
03
04
05
Huge Volume of data required in
short sprints
Duplication of test data across
distributed agile teams
Ring fence data for exclusive
access
Manual data creation
Third Party Data Sharing and
Usage
Global Testing Retreat
#ATAGTR2023

6. G lobal T esting Retreat
#ATAGTR2023
T E S T D ATA C H A L L E N G E S – A G I L E T E A M S
Third Party Data Sharing and
Usage
Third Party Data Sharing and Usage
01
02
03
04
05
Huge Volume of data required in short
sprints
Duplication of test data across
distributed agile teams
Ring fence data for exclusive access
Manual data creation
Third Party Data Sharing
and Usage
Global Testing Retreat
#ATAGTR2023

7. G lobal T esting Retreat
#ATAGTR2023
T E S T D ATA C H A L L E N G E S – A G I L E T E A M S
Third Party Data Sharing and
Usage
01
02
03
04
05
Huge Volume of data required in
short sprints
Duplication of test data across
distributed agile teams
Ring fence data for exclusive
access
Manual data creation
Global Testing Retreat
#ATAGTR2023

8. G lobal T esting Retreat
#ATAGTR2023
T E S T D ATA C H A L L E N G E S – A G I L E
T E A M S
01
02
03
04
05
Huge Volume of data required in
short sprints
Duplication of test data across
distributed agile teams
Ring fence data for exclusive
access
Manual data creation
Third Party Data Sharing and
Usage
Global Testing Retreat
#ATAGTR2023

9. G lobal T esting Retreat
#ATAGTR2023
T E S T D ATA C H A L L E N G E S – A G I L E
T E A M S
01
02
03
04
05
Huge Volume of data required in
short sprints
Duplication of test data across
distributed agile teams
Ring fence data for exclusive
access
Manual data creation
Third Party Data Sharing and
Usage
Global Testing Retreat
#ATAGTR2023

10. G lobal T esting Retreat
#ATAGTR2023
T E S T D ATA C H A L L E N G E S – A G I L E
T E A M S
01
02
03
04
05
Huge Volume of data required in
short sprints
Duplication of test data across
distributed agile teams
Ring fence data for exclusive
access
Manual data creation
Third Party Data Sharing and
Usage
Global Testing Retreat
#ATAGTR2023

11. G lobal T esting Retreat
#ATAGTR2023
O U R S U C C E S S S T O R Y – T U C K M A N ’ S T H E O R Y
• Test Data was
manually created
• Duplicates across
teams
• Error prone
• People dependent
• Breakdown in
Collaboration
• Rework across teams
• False positives in test
results
• TDM framework is
formulated
• Pilot teams launched
• Baseline velocity
measured before
implementation
• Velocity increase
tracked sprint on
sprint
• No duplication and
rework of test data
• Consistent test
results
Forming Storming Norming
Performing
Adjourning
• 30% increase in
velocity over time
• Happier teams -
lesser rework
• 3’rd party access to
data
Global Testing Retreat
#ATAGTR2023

12. G lobal T esting Retreat
#ATAGTR2023
O U R S U C C E S S S T O R Y – T U C K M A N ’ S T H E O R Y
• Test Data was
manually created
• Duplicates across
teams
• Error prone
• People dependent
Forming
Global Testing Retreat
#ATAGTR2023

13. G lobal T esting Retreat
#ATAGTR2023
O U R S U C C E S S S T O R Y – T U C K M A N ’ S T H E O R Y
• Breakdown in
Collaboration
• Rework across
teams
• False positives in
test results
Storming
• Test Data was
manually created
• Duplicates across
teams
• Error prone
• People dependent
Forming
Global Testing Retreat
#ATAGTR2023

14. G lobal T esting Retreat
#ATAGTR2023
O U R S U C C E S S S T O R Y – T U C K M A N ’ S T H E O R Y
• Breakdown in
Collaboration
• Rework across
teams
• False positives in
test results
Storming
• TDM framework is
formulated
• Pilot teams
launched
• Baseline velocity
measured before
implementation
Norming
Forming
• Test Data was
manually created
• Duplicates across
teams
• Error prone
• People dependent
Global Testing Retreat
#ATAGTR2023

15. G lobal T esting Retreat
#ATAGTR2023
O U R S U C C E S S S T O R Y – T U C K M A N ’ S T H E O R Y
• Velocity increase
tracked sprint on
sprint
• No duplication and
rework of test data
• Consistent test
results
• TDM framework is
formulated
• Pilot teams
launched
• Baseline velocity
measured before
implementation
Norming Performing
• Breakdown in
Collaboration
• Rework across
teams
• False positives in
test results
Storming
Forming
• Test Data was
manually created
• Duplicates across
teams
• Error prone
• People dependent
Global Testing Retreat
#ATAGTR2023

16. G lobal T esting Retreat
#ATAGTR2023
O U R S U C C E S S S T O R Y – T U C K M A N ’ S T H E O R Y
• Velocity increase
tracked sprint on
sprint
• No duplication and
rework of test data
• Consistent test
results
Performing Adjourning
• 30% increase in
velocity over time
• Happier teams -
lesser rework
• 3’rd party access to
data
• TDM framework is
formulated
• Pilot teams
launched
• Baseline velocity
measured before
implementation
Norming
• Breakdown in
Collaboration
• Rework across
teams
• False positives in
test results
Storming
Forming
• Test Data was
manually created
• Duplicates across
teams
• Error prone
• People dependent
Global Testing Retreat
#ATAGTR2023

17. G lobal T esting Retreat
#ATAGTR2023
R E F E R E N C E A R C H I T E C T U R E
Global Testing Retreat
#ATAGTR2023

18. G lobal T esting Retreat
#ATAGTR2023
B E N E F I T S
Centralized Mgmt. of test data
Consistent test results due to exclusive access to data
3’rd party access
Self Service Capability
Bulk data generation
Global Testing Retreat
#ATAGTR2023

19. G lobal T esting Retreat
#ATAGTR2023
It’s not the plane It’s the Pilot
Global Testing Retreat
#ATAGTR2023

20. G lobal T esting Retreat
#ATAGTR2023
G lobal T esting Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
2, 3 & 8, 9 December 2023