Downloaded 51 times
Uploaded byCompuware APM
Testing Tools Landscape
The document discusses the importance of effective testing tools and strategies for online businesses to enhance quality and performance, emphasizing that poor testing can lead to significant losses. It outlines the challenges faced in testing, such as performance and data privacy, while recommending a collaborative approach and early testing to prevent defects. Additionally, it highlights the need for businesses to invest in quality, automation, and shared goals among team members for improved user experience and operational efficiency.
More Related Content
Similar to Testing Tools Landscape
Testing Tools Landscape
- 2. Testing Tools - How Teams Make It WorkMargo Visitacion, Vice PresidentFebruary 17, 2011
- 3. Don’t lose beforeyou get into the game……
- 4.
- 5. If you don’tplan your quality and build the right team, you lose before you get into the game…….
- 6. More business istransacted online….
- 7. But problems increaseyour risk and costs …Performance:It only takes a moment to lose customers74% of surveyed customers shop online….…. Yet 54% abandon shopping carts, a continuing plague for online vendors vendorsSecurityOnline banking: the future is now90.5 million Americans now bank online…..….Yet less than half of customers feel secure about their institutions’ securityScalability70% of auto policies renew in JanuaryThe global Internet population is now 1.6B and expects to grow another 42% by 2014Do you have the right team in place?
- 8. In 2010 moremoney was directed to toward growth and expansion – don’t let poor performance shift dollars away from innovationPoor quality diverts focus
- 9.
- 10. Siloed approach totesting won’t let you answer these questions
- 11. Companies are planningto spend more on securing their customer’s loyalty
- 12. How will youchange your behaviors to improve your approach to testing??How will you “Change your ways”?Challenges in testing are growing Performance, Data privacy, complianceTesting as usual won’t work todayEarly testing is imperativeTeams look different because testing approaches have to change IT budgets look better, but must bring valueCompanies want greater flexibility for their $$$Automation MUST bring value for the money invested Testing is ripe for SaaS21% are piloting SaaS for IT lifecycle components26% are planning to adopt within the next year
- 13. Taking a teamapproach
- 14. Testing can beginfrom day one to prevent defectsPost MortemDeploymentBusiness determinesobjectives, sets requirementsEnd to end testingUATBusiness stakeholders, BAs & test team set quality and performance requirements for functional and non functional requirementsDevelopment &testing continuesContinuous build and integrationContinuous testingmanual and automatedStatic and automated performance testing startsDesign and developmentbased upon requirementsSet test planning &Automation strategy
- 15. Use automation tokeep up with change Capital investments are scrutinized Infrastructure and environments are challenged Ramp up time takes too long Usability is a requirement Quick time to value is a necessity Performance testing is cyclical but non negotiableTesting is an enablerEnvironmentsansconstraints
- 16.
- 17. Costs: A drilldown
- 18. Why? Investing inquality can reduce risk, cost and raise value
- 19. Plan Today ForTomorrow’s Budget
- 20.
- 21. To win thegame, the business needs to be involvedRequirementsUserstories “Situational realities”Risks/opportunities
- 22. Bringing the teamtogether needs a repeatable, measurable process
- 23.
- 24. RecommendationsDon’t leave performancetesting to the end. Problems will grow as business options expand Anticipate the unexpectedLife is what happens while you’re busy making other plansLeverage automation and timingFlexible tools to performance-test, “just in time”
- 25. Thank youMargo Visitacion+1609.314.6745mvisitacion@forrester.comwww.forrester.com
- 26. Testing Tools Landscape-Load TestingMatt Poepsel, VP of Performance Strategies, Compuware Gomez
- 27. Customer Expectations AreRising For Web & Mobile Applications47% of consumers expect a Web page to load in 2 seconds or less 58% of mobile phone users expect websites to load almost as quickly or faster on their mobile phone than their PC
- 28. The Challenge OfDelivering Quality Web ExperiencesSystems management tools: “OK”…user is NOT happyThe Web Application Delivery ChainTest & monitor your site the way your customers use it:What they do (key pages and transactions)
- 29. Where they doit (geographic locations)
- 30. How they doit (browsers and mobile devices)
- 31. When they doit (normal and peak usage)Determine the impact on their behavior and your businessInconsistent geo performance
- 32.
- 33.
Editor's Notes
- #3 Delete second Name/Title if not needed, but be sure to keep the Month Day, Year information. For a teleconference, after the date, add a period and “Call in at XX:55 p.m. Eastern time” (change the time to five minutes prior to the start of the teleconference).
- #5 Don’t lose before you get into the gameWhy load testing can make the differencePlanning performance testing today can help budget planning tomorrowDeveloping your test game plan
- #6 Source: http://www.flickr.com/photos/elzey/3985788016/
- #8 Talk about rich internet apps, more media, very appealing, but
- #10 Don’t lose before you get into the gameWhy load testing can make the differencePlanning performance testing today can help budget planning tomorrowDeveloping your test game plan
- #16 Dial
- #17 Don’t lose before you get into the gameWhy load testing can make the differencePlanning performance testing today can help budget planning tomorrowDeveloping your test game plan
- #21 Don’t lose before you get into the gameWhy load testing can make the differencePlanning performance testing today can help budget planning tomorrowDeveloping your test game plan
- #24 Don’t lose before you get into the gameWhy load testing can make the differencePlanning performance testing today can help budget planning tomorrowDeveloping your test game plan
- #28 Not only are the usage of social and mobile increasing, but customer expectations about the performance are extremely high.
- #29 Matt tie into how they do it and when they do it… normal and peak usage!
- #30 When we talk about applications now, we are increasing talking about applications that are not isolated, and consist of a number of components delivered by a Number of hosts accessed directly by the browser, and assembled at the client end. This necessitates a different approach to testing and Load testing specifically.
- #31 Common Mistake:$ cost of marketing campaigns associated with driving peak traffic – driving priorityBusiness Objectives and KPIsvs the IT team’s ability to deliver.Impact on Business:Lost sales due to the site not being availableLessons Learned (case example):Nationwide – $1.5 Mill marketing to MicrositeBOA – Used microsite to generate leads – drove traffic to find breaking point (What can they support?)Informing Business of what the site can handle before they drive traffic to it
- #32 Common Mistake:Organizations think that performance management/testing is only an IT problemBusiness team is not asked to (or able to) provide key web metrics to inform the load test planBusiness team is not informing (or being asked to inform) IT of performance objectives to allow for business goals to be metBusiness team not informing IT of business/traffic growth projections for “next year”IT is not open to involving business inputIT has to be honest about their ability to deliver what they have to deliver with what they haveImpact on Business:“Successful” load test; unsuccessful peak traffic eventLessons Learned (case example):Retail Brand Alliance – regular testing with business involvement allows for confidence, sales success, and more effective planning for next year.???
- #34 Q & a session