Downloaded 45 times
Uploaded byBlazeMeter
Continuous Testing in the Agile Age
The document discusses the rise of continuous delivery (CD) in agile software development, highlighting that approximately 80% of SaaS and 51% of non-SaaS companies have adopted this practice. It emphasizes the challenges of testing within continuous delivery, proposing a continuous testing process that promotes early and automated testing to improve time-to-release and overall quality. Additionally, it outlines the integration of various tools and the need for comprehensive testing to support the agile development lifecycle.
More Related Content
Similar to Continuous Testing in the Agile Age
![20260201 [FOSDEM] gomodjail - library sandboxing for Go modules.pdf](https://cdn.slidesharecdn.com/ss_thumbnails/20260201fosdemgomodjail-librarysandboxingforgomodules-260201225659-76609ec4-thumbnail.jpg?width=640&height=640&fit=bounds)
![谷歌留痕技术教程[ 𝙩𝙤𝙥 𝟮𝟯𝟯. 𝙘 𝙤𝙢 ]](https://cdn.slidesharecdn.com/ss_thumbnails/top233-260130173900-2eb784f9-thumbnail.jpg?width=640&height=640&fit=bounds)
Continuous Testing in the Agile Age
- 1. Continuous Testing inthe Agile Age Testing as part of the Continuous Delivery process 785 Castro Street, Mountain View, CA 94041 | 1.855.445.2285 | info@blazemeter.com BlazeMeter ITAY MENDEL Devop MICHAEL REDMAN Customer Success ANDREY POKHILKO Chief Scientist ALON GIRMONSKY Founder & CEO R
- 2. Waterfall Agile 2015 CURRENTSTATE OF AFFAIRS Moving from Waterfall to Agile
- 3. “Continuous Delivery (CD)is rapidly emerging as the ‘new normal’ in software development, with approximately 80% of SaaS companies and 51% of non-SaaS companies adopting this practice” Perforce Software Study
- 4. QA wasn’t invitedto the party THE TESTING BOTTLENECK
- 5.
- 6. Developers • Unit • Troubleshooting CI/DevOpsQA Operations • API • Functionality • Performance • Regression • Load • Soak • Regression • Acceptance • Load • Monitoring • Discrete VS continuous • Frequent code commits • Domain expertise required • Multiple test points ON THE VERGE OF CONTINUOUS DELIVERY Testing is a Challenge
- 7. TIMETORELEASE RELEASE NUMBER /TIME 20 40 60 80 100 120 140 160 180 200 220 240 2wks 1wks 3wks 4wks 5wks THE OUTCOME Any Agile Process is Most Likely to Fail
- 8. Test Early Test Often TestEverywhere Automate it CONTINUOUS TESTING PROCESS
- 9. Test Early Test Often TestEverywhere Automate it (and get everyone on the same toolset) CONTINUOUS TESTING PROCESS
- 10. CONTINUOUS TESTING REDUCED TIME-TO-TEST INCREASED # OF ITERATIONS AUTOMATION TIME-TO-RELEASEQUALITY TIMETORELEASE RELEASE NUMBER / TIME 20 40 60 80 100 120 140 160 180 200 220 240 2wks 1wks 3wks 4wks 5wks Before After CONTINUOUS TESTING FACILITATES AGILE
- 11. Developer Devops QA OPs OPs Commit Code + TestRepresentation Configure Test Acceptance Test Configure Version Control Repository Comprehensive Testing Post-Production Monitoring Continuous Deployment Continuous Integration PEOPLE Red Arrow = Test Failed Green Arrow = Test Succeeded Blue Arrow = Sent to Testing SYSTEMS TESTING ALERT CONTINUOUS TESTING FACILITATES AGILE LeveragePrevious TestRepresentation ContinuousTesting
- 12. IS POST-PROD MONITORINGA PART OF TESTING?
- 13. Developers CI/DevOps QAOperations • GitHub • JSON tests • Jenkins • JSON tests • + JMeter tests • + New Relic • JSON tests • JMeter tests • New Relic • Load & Soak • Deploy • Test • Monitor CD STACK What Toolset Will We Use?
- 14. Demo?We suggest youwatch this 7 minute movie to see BlazeMeter in action: https://www.youtube.com/watch?v=6Oih-v-LICE Please view in HD quality.
- 15. • Testing starts@ Dev • The module’s test configuration is maintained by the developer in a JSON format • Version control friendly • Devop configures CI • Tightly integrated with CI environments Alert on Failure + Artifacts✖ ENTERPRISE CONTINUOUS TESTING Use Case #1
- 16. PERFORMANCE LAB INTHE CLOUD Up to 1M users, multi-GEO, 100% Apache JMeter compatible
- 17. ON PREMISE +CLOUD TRAFFIC GENERATION Full hybrid model • Allocate as many on-premise servers as needed • Group them into clusters (e.g. R&D, QA, OPs) • Assign permissions • Have each cluster appear as yet another GEO location
- 18. ANY SCRIPT, ANYSCENARIO Comprehensive scripting at your fingertips JMeter is the most commonly used open source web, mobile and API backend testing solution. BlazeMeter is 100% compatible with JMeter HTTP / HTTPS Login / Signup Form POSTing / Credit card transactions Rest / Web services / JSON Parameters extraction ( JSON / RegEx / Xpath ) Mobile Mongo, MSSQL, Oracle SQL, MySQL Multiple user profiles
- 19. PRODUCT: JUST ATASTE On-Premise A JSON Test Representation VS GUI
- 20. On-Premise PRODUCT: JUST ATASTE A JSON Test Representation VS GUI
- 21. THRESHOLDS Setting global andper URL thresholds (Automation)
- 22. THRESHOLDS Setting global andper URL thresholds (UI)
- 23. CONTINUOUS INTEGRATION Connect withleading CI applications
- 24.
- 25. NEWRELIC INTEGRATION Capture MonitoringData Capture Load Testing Data Ask the Test Data any Question
- 26. AWS CLOUDWATCH Fetch CWrelated data associated with selected AWS resources
- 27. QUICKLY RECORD ANYSCENARIO • Easily Record: Web traffic Mobile web or apps HTTP/HTTPS APIs • No JMeter knowledge or installation required
- 28. REST API ANDDSL SCRIPTING Builds into any continuous delivery process
- 29. THANK YOU FORYOUR TIME! Q & A For more information: BlazeMeter.com/blog/ info@blazemeter.com @BlazeMeter