To Deploy or Not-To-Deploy - decide using TTA's Trend & Failure Analysis

8,201 views

Published on

Here are the slides from my recent talks on "To Deploy or Not-To-Deploy - decide using TTA's Trend and Failure Analysis"

More information available from my blog:
http://essenceoftesting.blogspot.com/search/label/tta

Published in: Software, Technology, Business

To Deploy or Not-To-Deploy - decide using TTA's Trend & Failure Analysis

  1. 1. TO DEPLOY, OR NOT TO DEPLOY? DECIDE USING TEST TREND ANALYZER (TTA) Anand Bagmar Test Practice Lead
  2. 2. @BagmarAnand about.me/anand.bagmar ABOUT ME
  3. 3. WHAT DO YOU EXPECT FROM THIS SESSION?
  4. 4. Principles & Practices
  5. 5. Test Automation A PRACTICE THAT MAKES TEAMS SUCCESSFUL?
  6. 6. Test Automation A PRACTICE THAT MAKES TEAMS UNSUCCESSFUL?
  7. 7. What is Test Automation?
  8. 8. Automation - A Safety Net
  9. 9. TEST AUTOMATION PYRAMID Unit Manual / Exploratory Integration JavaScript View Web Service UI Cost Impact Time Business- facing Tests Technology- facing Tests
  10. 10. REALITY
  11. 11. ICE-CREAM CONE ANTI PATTERN Manual / Exploratory UI Web Service View JavaScript Integration Unit
  12. 12. Web Service View JavaScript Integration Unit Developers Test Pyramid QA Team Test Pyramid DUAL TEST PYRAMID ANTI-PATTERN Manual / Exploratory UI Web Service
  13. 13. CUP-CAKE ANTI-PATTERN
  14. 14. How does your Test Automation Pyramid look like?
  15. 15. OK… so that’s Automation … What’s Next?
  16. 16. CONTINUOUS INTEGRATION (CI) ”… is a software development practice where members of a team integrate their work frequently, usually each person integrates at least daily - leading to multiple integrations per day. Each integration is verified by an automated build (including test) to detect integration errors as quickly as possible…." -  Martin Fowler, ThoughtWorks Chief Scientist Ø  http://www.thoughtworks.com/continuous-integration
  17. 17. CONTINUOUS INTEGRATION (CI) PROCESS
  18. 18. DASHBOARD
  19. 19. SMALL TEAMS 1
  20. 20. HOW ARE YOUR TEAMS STRUCTURED ?
  21. 21. Product 1 Product 3 Product 2 Product 4
  22. 22. IS YOUR PRODUCT IS READY TO GO TO THE NEXT LEVEL ? HOW DO YOU KNOW ?
  23. 23. DOES ALL TESTS PASSING MEAN NO DEFECTS?
  24. 24. TEST TREND ANALYZER (TTA)
  25. 25. TTA DEMO Trend Analysis Failure Analysis Admin Upload Data Dashboards
  26. 26. Upload Data
  27. 27. Trend Analysis
  28. 28. TTA - TREND ANALYSIS Pyramid View Comparative Analysis Test Execution Trends
  29. 29. TTA - FAILURE ANALYSIS Compare Runs Failure Analysis External Dashboards
  30. 30. Failure Analysis
  31. 31. How does it work?
  32. 32. COLLECT TEST RUN DATA IN TTA Manual Upload Automatic Upload
  33. 33. Automatic test results collection
  34. 34. Job(s) Triggered Run Tests Run Tests Run Tests CI INTEGRATION
  35. 35. Test Execution Machine CI Job Triggered Clean Compile Setup Run Tests Return to CI Test Execution Command
  36. 36. For TTA to work …
  37. 37. Test Execution Machine Test Execution Command CI Job Triggered Clean Compile Setup Run Tests Return to CI Send Test Results to TTA
  38. 38. The Power this brings to the Teams
  39. 39. Test Execution Machine Test Execution Command Send Test Results to TTA Ant / Maven / Gradle / Make / Rake … xUnit / testNG Java / C# / Perl / Python / Ruby … GO / Hudson / Jenkins / Bamboo / .. CI Job Triggered Clean Compile Setup Run Tests Return to CI
  40. 40. How to use TTA? https://github.com/anandbagmar/tta
  41. 41. How can you help?
  42. 42. FEATURES
  43. 43. Use and Give Feedback
  44. 44. abagmar@gmail.com Anand.Bagmar@thoughtworks.com @BagmarAnand about.me/anand.bagmar THANK YOU

×