TO DEPLOY, OR NOT TO
DEPLOY? DECIDE USING
TEST TREND ANALYZER
(TTA)
Anand Bagmar
Test Practice Lead
@BagmarAnand
about.me/anand.bagmar
ABOUT ME
WHAT DO YOU EXPECT FROM THIS SESSION?
Principles &
Practices
Test Automation
A PRACTICE THAT MAKES TEAMS SUCCESSFUL?
Test Automation
A PRACTICE THAT MAKES TEAMS UNSUCCESSFUL?
What is
Test Automation?
Automation
-
A Safety Net
TEST AUTOMATION PYRAMID
Unit
Manual / Exploratory
Integration
JavaScript
View
Web Service
UI
Cost
Impact
Time
Business-
facing
Tests
Technology-
facing
Tests
REALITY
ICE-CREAM CONE ANTI PATTERN
Manual / Exploratory
UI
Web Service
View
JavaScript
Integration
Unit
Web Service
View
JavaScript
Integration
Unit
Developers Test Pyramid QA Team Test Pyramid
DUAL TEST PYRAMID ANTI-PATTERN
Manual / Exploratory
UI
Web Service
CUP-CAKE ANTI-PATTERN
How does your Test
Automation Pyramid
look like?
OK… so that’s
Automation …
What’s Next?
CONTINUOUS INTEGRATION (CI)
”… is a software development practice where members of a team
integrate their work frequently, usually each person integrates at
least daily - leading to multiple integrations per day. Each
integration is verified by an automated build (including test)
to detect integration errors as quickly as possible…."
-  Martin Fowler, ThoughtWorks Chief Scientist
Ø  http://www.thoughtworks.com/continuous-integration
CONTINUOUS INTEGRATION (CI) PROCESS
DASHBOARD
SMALL TEAMS
1
HOW ARE YOUR TEAMS STRUCTURED ?
Product 1 Product 3
Product 2 Product 4
IS YOUR PRODUCT IS READY
TO GO TO THE NEXT LEVEL ?
HOW DO YOU KNOW ?
DOES ALL TESTS PASSING
MEAN NO DEFECTS?
TEST TREND ANALYZER
(TTA)
TTA DEMO
Trend Analysis
Failure Analysis
Admin
Upload Data Dashboards
Upload Data
Trend Analysis
TTA - TREND ANALYSIS
Pyramid View
Comparative Analysis
Test Execution Trends
TTA - FAILURE ANALYSIS
Compare Runs
Failure Analysis
External Dashboards
Failure Analysis
How does it work?
COLLECT TEST RUN DATA IN TTA
Manual Upload
Automatic Upload
Automatic test results
collection
Job(s) Triggered
Run Tests
Run Tests
Run Tests
CI INTEGRATION
Test Execution Machine
CI Job
Triggered
Clean Compile Setup Run Tests
Return to
CI
Test Execution Command
For TTA to work …
Test Execution Machine
Test Execution Command
CI Job
Triggered
Clean Compile Setup Run Tests
Return to
CI
Send Test
Results to TTA
The Power this brings
to the Teams
Test Execution Machine
Test Execution Command
Send Test
Results to TTA
Ant / Maven / Gradle /
Make / Rake …
xUnit / testNG
Java / C# / Perl / Python /
Ruby …
GO / Hudson /
Jenkins / Bamboo / ..
CI Job
Triggered
Clean Compile Setup Run Tests
Return to
CI
How to use TTA?
https://github.com/anandbagmar/tta
How can you help?
FEATURES
Use and Give Feedback
abagmar@gmail.com
Anand.Bagmar@thoughtworks.com
@BagmarAnand
about.me/anand.bagmar
THANK YOU

To Deploy or Not-To-Deploy - decide using TTA's Trend & Failure Analysis