Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Accelerating Your Digital Agenda with Continuous Testing ft. Forrester

220 views

Published on

Presenting 2019 developer research, Diego Lo Giudice, Vice President, Principal Analyst at Forrester Research, will provide insight into how enterprise organizations are adopting and adapting for quality at great speed, while exploring:

- How this increasing emphasis on speed and quality has put testing in the eye of the Agile+DevOps hurricane
- What continuous testing means for testers, developers and business users today

Diego will also present findings on the trends and practices poised to shape the testing market in 2019 and beyond.

Published in: Technology
  • D0WNL0AD FULL ▶ ▶ ▶ ▶ http://1url.pw/YtCCQ ◀ ◀ ◀ ◀
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Accelerating Your Digital Agenda with Continuous Testing ft. Forrester

  1. 1. SAUCE LABS PRESENTS: ACCELERATING YOUR DIGITAL AGENDA WITH CONTINUOUS TESTING August 13, 2019
  2. 2. Diego Lo Guidice Vice President, Principal Analyst, Forrester Research © Sauce Labs, Inc. FEATURED SPEAKER
  3. 3. © 2019 FORRESTER. REPRODUCTION PROHIBITED. Accelerate Your Digital Agenda with Continuous Testing Diego Lo Giudice, VP & Principal Analyst serving AD&D August 2019
  4. 4. 4© 2019 FORRESTER. REPRODUCTION PROHIBITED. We need to test more, better and faster… ...continuously.
  5. 5. 5© 2019 Forrester Research, Inc. Reproduction Prohibited Why?
  6. 6. 6© 2016 Forrester Research, Inc. Reproduction Prohibited http://assets.bwbx.io/images/i0dwq8cFhDmE/v1/-1x-1.jpg Too much speed? Poor quality? Or both?
  7. 7. 7© 2019 FORRESTER. REPRODUCTION PROHIBITED. Poor Quality Software ?
  8. 8. 8© 2019 FORRESTER. REPRODUCTION PROHIBITED. 4 Seconds
  9. 9. 9© 2019 Forrester Research, Inc. Reproduction Prohibited 53% Base: 232 tech professionals at firms that have implemented or are implementing Agile. Source: Forrester’s Q3 2017 Global Agile Software Application Development Online Survey Expect Agile to improve technical quality
  10. 10. 10© 2019 Forrester Research, Inc. Reproduction Prohibited 63% Base: 232 tech professionals at firms that have implemented or are implementing Agile. Source: Forrester’s Q3 2017 Global Agile Software Application Development Online Survey Expect Agile to improve functional quality
  11. 11. 11© 2019 Forrester Research, Inc. Reproduction Prohibited 76% Base: 232 tech professionals at firms that have implemented or are implementing Agile. Source: Forrester’s Q3 2017 Global Agile Software Application Development Online Survey Expect Agile to improve customer experience
  12. 12. 12© 2019 Forrester Research, Inc. Reproduction Prohibited Expectations are not always met !
  13. 13. 13© 2019 FORRESTER. REPRODUCTION PROHIBITED. We need to test more, better and faster. Speed Can’t Come Without Quality! Quality@speed
  14. 14. 14© 2019 Forrester Research, Inc. Reproduction Prohibited What are the challenges?
  15. 15. 15© 2019 FORRESTER. REPRODUCTION PROHIBITED. Digital Transformation Is The Goal For Every Industry Base: 354 business and technology leaders Source: Forrester’s Q1 2018 Digital Process Automation Survey
  16. 16. 16© 2019 FORRESTER. REPRODUCTION PROHIBITED. But, most digital transformation initiatives are struggling Source: “The Sorry State Of Digital Transformation In 2018” Forrester report. Base: 1,559 business and technology decision makers
  17. 17. 17© 2019 FORRESTER. REPRODUCTION PROHIBITED. Many Enterprise Developers Aspire To Do DevOps Yes, our group actively embraces DevOps 24% Yes, our group actively embraces DevOps in conjunction with Agile 33% Some of our processes or tools resemble those used in DevOps, but we have not officially adopted DevOps 22% No, but adoption of DevOps is an internal priority 5% No, and we have no plans to adopt DevOps 11% Don't know 5% Would you characterize your group's current processes and structure as resembling DevOps? Base 3,203 Developers who work full time. Source: Forrester Analytics’ Business Technographics® Developer Survey, 2019. But only these really get it!
  18. 18. 18© 2019 FORRESTER. REPRODUCTION PROHIBITED. But Software Delivery Speed Seems Sluggish Base: 3,294 Global Developers, Source: Forrester Analytics’ Business Technographics® Global Developer Survey, 2019. 13% 24% 31% 30% More than once per month Once per month Once per quarter Twice per year or fewer How frequently do you release applications?
  19. 19. 19© 2019 FORRESTER. REPRODUCTION PROHIBITED. Teams Are Releasing Faster…Barely Base: 3,228 Developers (2018) and 3,294 Developers (2019) Source: Forrester Analytics’ Business Technographics Global Developer Survey, 2018 and 2019. 12% 12% 20% 26% 18% 7% 1% 1% 12% 19% 31% 24% 10% 2% 2% We time new releases to coincide with new versions of operating systems or middleware We average one release a year (or less frequently) We average two releases a year We average one release per quarter We average one release a month We average one release a week We average a release a day We release many times per day 2018 2019 Note! We did take out a category for 2019. So there’s 12% from 2018 relocated
  20. 20. 20© 2019 FORRESTER. REPRODUCTION PROHIBITED. Testing Is Part Of The Problem Base: 232 tech professionals at firms that have implemented or are implementing Agile. Source: Forrester’s Q3 2017 Global Agile Software Application Development Online Survey 20% 22% 25% 26% 26% 28% 30% 31% Lack of automation tools and/or infrastructure Scaling Agile at the enterprise level Connecting Agile with existing product portfolio management (PPM) Lack of dedicated cross functional teams Lack of Agile testing skills Lack of Agile skills in downstream or DevOps Lack of Agile executive leadership Lack of Agile skills in project management practices Which of the following are barriers to your organization’s Agile adoption? (Check all that apply) (not all answers shown)
  21. 21. 21© 2019 FORRESTER. REPRODUCTION PROHIBITED. Base: 3,228 (2018) and 3,294 (2019) Global Developers. Source: Forrester Analytics Global Business Technographics® Developer Survey, 2018 and 2019 If You Felt This Was Low….
  22. 22. 22© 2019 FORRESTER. REPRODUCTION PROHIBITED. Base: 2,279 manager and 924 non manager developers. Source: Forrester Analytics Global Business Technographics® Developer Survey, 2019 Get Ready Since It’s Probably lower… The “Managers- Developers” divide..
  23. 23. 23© 2019 FORRESTER. REPRODUCTION PROHIBITED. Test automation plateaus too, and manual testing resists to go away
  24. 24. 24© 2019 FORRESTER. REPRODUCTION PROHIBITED. As Continuous Delivery Matures Performance Testing Is The Next Blocker Performance done at the end is complex and costly Centralized performance testing isn’t scalable Completely disrupts continuous delivery
  25. 25. 25© 2019 Forrester Research, Inc. Reproduction Prohibited How can we address these challenges?
  26. 26. 26© 2019 FORRESTER. REPRODUCTION PROHIBITED. From Digital Business Excellence To SW Delivery Execution Excellence….Your new mantra…! Business Must Master Digital To Stay In Business Software Powers The Digital Experience Software Execution Excellence Equals Business Execution Excellence
  27. 27. 27© 2019 FORRESTER. REPRODUCTION PROHIBITED. Modernize Testing With Continuous Testing
  28. 28. 28© 2019 FORRESTER. REPRODUCTION PROHIBITED. Sprint definition of "done" includes your sprint testing goals (Done done, test data strategy, automation, cntrl. Gates…) Define Test Scenarios using a DSL (e.g: Gherkin) Include Performance Testing in Acceptance Criteria Feature toggles, AB Multivariate… Prioritize bugs on backlog PO, Testers and Developers
  29. 29. 29© 2019 FORRESTER. REPRODUCTION PROHIBITED. End to End Testing Integration Testing Functional Testing Non-Functional Testing Unit Testing Make Sure Its Clear Who Needs To Test What…. Only Developers Biz mostly manual, Mostly Technical Testers, Dev Testers (API testing, automation) Technical Testers (Specialized), Dev Testers (slowly catching up...shift left) Mostly Technical Testers, Dev Testers (SVT tools) Biz, Mostly Technical Testers
  30. 30. 30© 2019 FORRESTER. REPRODUCTION PROHIBITED. Design automation of functional tests (and test data) Build automation of functional tests (UI, API) Build automation for non functional (SVT, SL PT, Security) Scriptless, scripting, coding Exploratory testing (manual) Technical Testers, Dev-testers, Business testers
  31. 31. 31© 2019 FORRESTER. REPRODUCTION PROHIBITED. Source: See The Forrester report “Shift Performance Testing Left To Streamline App Delivery”.
  32. 32. 32© 2019 FORRESTER. REPRODUCTION PROHIBITED. Shift Left Performance Testing (SLPT) Developers profile code, smoke test, leverage baselines at unit/ component level Product Owners and Developers become stewards of Performance (With Testers) Overtime E2E Performance Testing Wanes As SLPT Becomes The Norm. A new set of lightweight agile SLPT tools provide developers what they need to get the job done
  33. 33. 33© 2019 FORRESTER. REPRODUCTION PROHIBITED. United Airlines experienced an 80% Performance Issues drop in production with SLPT
  34. 34. 34© 2019 FORRESTER. REPRODUCTION PROHIBITED. Version Control test assets with source code Integrate in CI/CD to automate all test execution (unit, functional, non- functional)
  35. 35. 35© 2019 FORRESTER. REPRODUCTION PROHIBITED. Automated integration testing (Service Virtualization) Automated governance for release automation or feature deployment
  36. 36. 36© 2019 FORRESTER. REPRODUCTION PROHIBITED. Production monitoring feeds your testing Machine Learning predicts what to test next Integrated AB testing in SDLC helps improve CX
  37. 37. 37© 2019 FORRESTER. REPRODUCTION PROHIBITED. Finally, Put Intelligence In Your Continuous Testing! Visual Testing (ubiquitous ) Test Automation & Generation Test Lifecycle Optimization Unit test code generation API Test generation Defect management (clustering, MTTR reduction..) Production User Experience Monitoring
  38. 38. 38© 2019 FORRESTER. REPRODUCTION PROHIBITED. We need to test more, We need to test faster, We need to test better, We need to test smarter!
  39. 39. FORRESTER.COM Thank you © 2019 FORRESTER. REPRODUCTION PROHIBITED. Diego Lo Giudice dlogiudice@forrester.com
  40. 40. Q&A
  41. 41. THANK YOU

×