#Interactive Session by Ashwini Lalit, RRR of Test Automation Maintenance" at #ATAGTR2023. #ATAGTR2023 was the 8th Edition of Global Testing Retreat. To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/

1. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
R E D U C E R E U S E R E C Y C L E ( RRR)
O F
T E S T A U T O M A T I O N M A I N T E N A N C E
Ashwini Lalit
Global Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023

2. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
R E D U C E R E U S E R E C Y C L E ( RRR)
O F
T E S T A U T O M A T I O N M A I N T E N A N C E
Global Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
● Test Evangelist
● Speaker at community meet-ups
● Product Quality Engineering across product lines
@NimbleWork
● BDD Practitioner
● Training teams for continuous improvement,
continuous testing, Microservices Testing strategy,
building robust, reliable, and high-quality
software solutions
● Urban Farming enthusiast
Ashwini Lalit
Senior Manager - Product Quality
NimbleWork, Inc

3. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
R E D U C E R E U S E R E C Y C L E ( RRR)
O F
T E S T A U T O M A T I O N M A I N T E N A N C E
Global Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
N i m b l e W o r k , I n c
An AI-powered Adaptive Project and Work
Management product company.

4. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
Image Reference - https://www.indiatvnews.com/entertainment/regional-cinema/rrr-motion-poster-film-601302

5. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
VA L U E S
Friends with similar values and
initial distrust
They are two different but
complementary personalities who make a
formidable team and inspire many
people.
Image Reference - https://economictimes.indiatimes.com/news/new-updates/netizens-criticise-bafta-awards-on-twitter-for-not-
nominating-and-awarding-rrr-read-here/articleshow/98090880.cms

6. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
JOIN HANDS FOR COMMON
MISSION
Bhim and Raju plan their final attack on Scott’s fortress and sacrifice their lives for the
freedom of our country
Image Reference - https://www.imdb.com/title/tt8178634/mediaviewer/rm3319999233?ref_=ttmi_mi_all_sf_20nominating-and-awarding-
rrr-read-here/articleshow/98090880.cms

7. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
K EY
TAKEAWAYS
• Reduce-Reuse-Recycle tools and
techniques between development and
testing
• Key takeaways
1. Simple practical tips of clean coding
practices, checklists for environments
2. Tools and Techniques at grass root level
3. Agile upstream and downstream value
streams that help in-sprint automation.

8. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
A G E N DA
1
3
2
4
Analysis - Test Automation Strategy
Overall layering of test, objective wise,
ease debugging and fail fast system,
Design - Automation Framework Development
Helps develop software that can run
automated tests on CI/CD pipeline
Coding - Automation Script Development
Living documentation of system in production.
These need to be updated and maintained on an
ongoing basis
Testing - Test Environment & Playback
Playback system and configuration to develop a
fast feedback system on CI/CD pipeline

9. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
A G E N DA
1
Analysis - Test Automation Strategy
Overall layering of test, objective wise,
ease debugging and fail fast system,
Collaborate
CommonVisual Board
Collaborate for
Test Pyramid
Image Reference - https://wallpaperaccess.com/rrr
https://martinfowler.com/bliki/images/testPyramid/test-pyramid.png
https://www.pinclipart.com/downpngs/iTTbTm_kanban-board-kanban-png-clipart/

10. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
Dependencies
SUT
Tests/Scripts
Test
Framework
TEST SETUP
• Complexity of test setup
• Test Environment & Dependencies
• Initial investment in implementation
• Timespan of test execution
SUT
• Granularity of SUT
• Dependencies needed
T E S T AU T O M AT I O N S T R AT E G Y

11. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
Component Tests
Integration Tests
End to End
Contract Tests
UnitTests
Reference - https://martinfowler.com/articles/microservice-testing/
Number
of
Tests
Size
of
SUT
Test
Setup
Complexity
Key is to REDUCE no of UI/Functional TEST.

12. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
T E S T A U T O M A T I O N
S T R A T E G Y
REUSE AgileValue stream to collaborate
Single source of truth; make work visible

13. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
A G E N DA
1
2
Analysis - Test Automation Strategy
Overall layering of test, objective wise,
ease debugging and fail fast system,
Design - Automation Framework Development
Helps develop software that can run
automated tests on CI/CD pipeline
LAYERED ARCHITECTURE
Image Reference - https://filmcolossus.com/rrr-explained-10-shots/
https://miro.medium.com/v2/resize:fit:1191/1*jNx5bZR301i1gb4Dq
_qzMQ.png

14. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
REUSable Components/Keywords/Utilities
Business API
Domain Function
Library
Tool Layer
Using
Tool/SELENIUM
Built In API
Control
Library
Interface
Tool Layer
Make use of SELENIUM built in APIs to
interact with UI components in rendered
DOM
Control Layer
with enhanced reporting,logging and exception
handling of events
Business API (Keywords) /
POM (Selenium)
Scenario
Business case Script / Gherkin (Cucumber)
D E S I G N
A U T O M A T I O N F R A M E W O R K D E V E L O P M E N T
2

15. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
A G E N DA
1
3
2
4
Analysis - Test Automation Strategy
Overall layering of test, objective wise,
ease debugging and fail fast system,
Design - Automation Framework Development
Helps develop software that can run
automated tests on CI/CD pipeline
Coding - Automation Script Development
Living documentation of system in production.
These need to be updated and maintained on an
ongoing basis
Testing - Test Environment & Playback
Playback system and configuration to develop a
fast feedback system on CI/CD pipeline
SYSTEMATICWORKFLOW
Image Reference -https://wallpaperaccess.com/rrr
https://testsigma.com/tools/desktop-automation-tools/

16. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
S C R I P T
D E V E L O P M E N T
Reuse TDD – BDD
Reusable classes
Recycle test data (setup, tear down)
01 | Scenario/Test clarity in terms of functionality
02 | Clarity of Test Data
03 | New API/Keywords/Classes
04 | Plan for code-test-publish
https://learning-center.homesciencetools.com/wp-content/uploads/butterfly-life-cycle-thumbnail-1280x720.jpg

17. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
S C R I P T
D E V E L O P M E N T
Reuse TDD – BDD
Reusable classes
Recycle test data (setup, tear down)
Define Scenarios
Define Data Plan
Develop new Business API /
POM
Test the Script/Feature file
Push for Playback on
CI/CD
Define Script/Step
definitions
01 | Scenario/Test clarity in terms of functionality
02 | Clarity of Test Data
03 | New API/Keywords/Classes
04 | Plan for code-test-publish
https://learning-center.homesciencetools.com/wp-content/uploads/butterfly-life-cycle-thumbnail-1280x720.jpg

18. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
S C R I P T D E V E L O P M E N T

19. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
S C R I P T D E V E L O P M E N T C H E C K L I S T
Avoid Data Dependency
Small static, random,
REST, Prod copy, distinct
Avoid Lengthy Scripts
Single purpose, easy to
debug
Business Language
Self explanatory
scenarios, data,API, Class

20. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
A G E N DA
1
3
2
4
Analysis - Test Automation Strategy
Overall layering of test, objective wise,
ease debugging and fail fast system,
Design - Automation Framework Development
Helps develop software that can run
automated tests on CI/CD pipeline
Coding - Automation Script Development
Living documentation of system in production.
These need to be updated and maintained on an
ongoing basis
Testing - Test Environment & Playback
Playback system and configuration to develop a
fast feedback system on CI/CD pipeline
Image Reference - https://thecinemaholic.com/where-was-rrr-filmed/
https://previews.123rf.com/images/iqoncept/iqoncept1510/iqoncept1
51000068/46722299-sanity-check-mark-in-box-to-illustrate-

21. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
Bare Metal Machine
● Correct version of
software installed
● Startup, scheduled
events stopped
● Anti virus popup
stopped
● Auto Upgrade paused
EC2 Machine
● CPU, Mem , network
resource allocation
depending on suite size
● Logs and test results data
persistence post playback
to s3 or DB
Containerized
● Required
dependencies libraries
are mapped in docker
compose
● Mounting referenced
files
T E S T E N V I RO N M E N T
DEV QA UAT environments are replicas standardized and reused. Spawned and escalated if
previous stage succeeds. Unit, Service, functional Sequence runs parallel to perf and security.
Environment sanitization is key

22. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
A G E N D A
1
3
2
4
Analysis - Test Automation Strategy
Overall layering of test, objective wise,
ease debugging and fail fast system,
Design - Automation Framework Development
Helps develop software that can run
automated tests on CI/CD pipeline
Coding - Automation Script Development
Living documentation of system in production.
These need to be updated and maintained on an
ongoing basis
Testing - Test Environment & Playback
Playback system and configuration to develop a
fast feedback system on CI/CD pipeline
INSTITUTIONALIZE
BEST PRACTICES
Image Reference -https://filmcolossus.com/rrr-explained-10-shots/
https://cdn-icons-png.flaticon.com/512/8555/8555318.png.jpg

23. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
R R R O F D E V P R A C T I C E S
Lesser the better Earlier the better Be watchful throughout Continuously
Code Test Maintain Measure
• IDE Plugin for Coding
Conventions
• SONAR Scan
• DSL Layer publish to
nexus
• Version control -
snapshots
• Merge Request
Review process
• Follow layered
approach, test the test
script
• Do not put it in
mainline till it passes
locally
• Newly publish test
observe for a specified
time in mainline
• Track broken windows
• Tech Debt clearance
week
• Stop the pipeline if
failures more than cut-off
• Don't run DEFECTs
impacted scripts till fixed
• Separate out FLAKY test.
• Time per script
• SuiteTime`
• Pass-Fail %
• GenuineVs Non-Genuine
Failures
• Code/Module Coverage,
tools like Drill4J
• Trend Analysis –
ReportPortal.io
• Log Analytics using
Grafana-Prometheus

24. G lobal Testing Retreat #ATAGTR2023
2, 3 & 8, 9 December 2023
'Reduce' the redundancy of your test scripts
'Reuse' existing automation components
'Recycle' your knowledge for more efficient and sustainable testing
T H A N K YO U