• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Testing Tools Landscape
 

Testing Tools Landscape

on

  • 1,521 views

Quality must move beyond the purview of just the testing organization and must become an integrated part of the entire software development life cycle (SDLC) to reduce schedule-killing rework, improve ...

Quality must move beyond the purview of just the testing organization and must become an integrated part of the entire software development life cycle (SDLC) to reduce schedule-killing rework, improve user satisfaction, and reduce the risks of untested nonfunctional requirements such as security and performance. Vendors have taken note and look to provide tools that support every role in the organization, considerably broadening the testing tools landscape.

Join Margo Visitacion of Forrester and learn:

* Don't lose before you get into the game
* Why load testing can make the difference
* How planning performance testing today can help budget planning tomorrow
* How to develop your test game plan

Statistics

Views

Total Views
1,521
Views on SlideShare
1,521
Embed Views
0

Actions

Likes
0
Downloads
41
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • Delete second Name/Title if not needed, but be sure to keep the Month Day, Year information. For a teleconference, after the date, add a period and “Call in at XX:55 p.m. Eastern time” (change the time to five minutes prior to the start of the teleconference).
  • Don’t lose before you get into the gameWhy load testing can make the differencePlanning performance testing today can help budget planning tomorrowDeveloping your test game plan
  • Source: http://www.flickr.com/photos/elzey/3985788016/
  • Talk about rich internet apps, more media, very appealing, but
  • Don’t lose before you get into the gameWhy load testing can make the differencePlanning performance testing today can help budget planning tomorrowDeveloping your test game plan
  • Dial
  • Don’t lose before you get into the gameWhy load testing can make the differencePlanning performance testing today can help budget planning tomorrowDeveloping your test game plan
  • Don’t lose before you get into the gameWhy load testing can make the differencePlanning performance testing today can help budget planning tomorrowDeveloping your test game plan
  • Don’t lose before you get into the gameWhy load testing can make the differencePlanning performance testing today can help budget planning tomorrowDeveloping your test game plan
  • Not only are the usage of social and mobile increasing, but customer expectations about the performance are extremely high.
  • Matt tie into how they do it and when they do it… normal and peak usage!
  • When we talk about applications now, we are increasing talking about applications that are not isolated, and consist of a number of components delivered by a Number of hosts accessed directly by the browser, and assembled at the client end. This necessitates a different approach to testing and Load testing specifically.
  • Common Mistake:$ cost of marketing campaigns associated with driving peak traffic – driving priorityBusiness Objectives and KPIsvs the IT team’s ability to deliver.Impact on Business:Lost sales due to the site not being availableLessons Learned (case example):Nationwide – $1.5 Mill marketing to MicrositeBOA – Used microsite to generate leads – drove traffic to find breaking point (What can they support?)Informing Business of what the site can handle before they drive traffic to it
  • Common Mistake:Organizations think that performance management/testing is only an IT problemBusiness team is not asked to (or able to) provide key web metrics to inform the load test planBusiness team is not informing (or being asked to inform) IT of performance objectives to allow for business goals to be metBusiness team not informing IT of business/traffic growth projections for “next year”IT is not open to involving business inputIT has to be honest about their ability to deliver what they have to deliver with what they haveImpact on Business:“Successful” load test; unsuccessful peak traffic eventLessons Learned (case example):Retail Brand Alliance – regular testing with business involvement allows for confidence, sales success, and more effective planning for next year.???
  • Q & a session

Testing Tools Landscape Testing Tools Landscape Presentation Transcript

  • Testing Tools - How Teams Make It Work
    Margo Visitacion, Vice President
    February 17, 2011
  • Don’t lose before you get into the game……
  • Agenda
  • If you don’t plan your quality and build the right team, you lose before you get into the game…….
  • More business is transacted online….
  • But problems increase your risk and costs …
    Performance:
    It only takes a moment to lose customers
    74% of surveyed customers shop online….
    …. Yet 54% abandon shopping carts, a continuing plague for online vendors vendors
    Security
    Online banking: the future is now
    90.5 million Americans now bank online…..
    ….Yet less than half of customers feel secure about their institutions’ security
    Scalability
    70% of auto policies renew in January
    The global Internet population is now 1.6B and expects to grow another 42% by 2014
    Do you have the right team in place?
  • In 2010 more money was directed to toward growth and expansion – don’t let poor performance shift dollars away from innovation
    Poor quality diverts focus
  • Agenda
  • Siloed approach to testing won’t let you answer these questions
  • Companies are planning to spend more on securing their customer’s loyalty
  • How will you change your behaviors to improve your approach to testing??
    How will you “Change your ways”?
    Challenges in testing are growing
    Performance, Data privacy, compliance
    Testing as usual won’t work today
    Early testing is imperative
    Teams look different because testing approaches have to change
    IT budgets look better, but must bring value
    Companies want greater flexibility for their $$$
    Automation MUST bring value for the money invested
    Testing is ripe for SaaS
    21% are piloting SaaS for IT lifecycle components
    26% are planning to adopt within the next year
  • Taking a team approach
  • Testing can begin from day one to prevent defects
    Post
    Mortem
    Deployment
    Business determinesobjectives, sets requirements
    End to end testing
    UAT
    Business stakeholders, BAs & test team set quality and performance requirements for functional and non functional requirements
    Development &testing continues
    Continuous build and integrationContinuous testingmanual and automated
    Static and automated performance testing starts
    Design and developmentbased upon requirements
    Set test planning &
    Automation strategy
  • Use automation to keep up with change
    Capital investments are scrutinized
    Infrastructure and environments are challenged
    Ramp up time takes too long
    Usability is a requirement
    Quick time to value is a necessity
    Performance testing is cyclical but non negotiable
    Testing is an enabler
    Environment
    sans
    constraints
  • Agenda
  • Costs: A drill down
  • Why? Investing in quality can reduce risk, cost and raise value
  • Plan Today For Tomorrow’s Budget
  • Agenda
  • To win the game, the business needs to be involved
    Requirements
    Userstories
    “Situational realities”
    Risks/opportunities
  • Bringing the team together needs a repeatable, measurable process
  • Agenda
  • Recommendations
    Don’t leave performance testing to the end.
    Problems will grow as business options expand
    Anticipate the unexpected
    Life is what happens while you’re busy making other plans
    Leverage automation and timing
    Flexible tools to performance-test, “just in time”
  • Thank you
    Margo Visitacion
    +1 609.314.6745
    mvisitacion@forrester.com
    www.forrester.com
  • Testing Tools Landscape- Load Testing
    Matt Poepsel, VP of Performance Strategies, Compuware Gomez
  • Customer Expectations Are Rising For Web & Mobile Applications
    47% of consumers expect a Web page to load in 2 seconds or less
    58% of mobile phone users expect websites to load almost as quickly or faster on their mobile phone than their PC
  • The Challenge Of Delivering Quality Web Experiences
    Systems management tools: “OK”
    …user is NOT happy
    The Web Application Delivery Chain
    Test & monitor your site the way your customers use it:
    • What they do (key pages and transactions)
    • Where they do it (geographic locations)
    • How they do it (browsers and mobile devices)
    • When they do it (normal and peak usage)
    Determine the impact on their behavior and your business
    • Inconsistent geo performance
    • Bad performance under load
    • Blocking content delivery
    • Incorrect geo-targeted content
    • Poorly performing JavaScript
    • Inconsistent CSS rendering
    • Browser/device incompatibility
    • Page size too big
    • Conflicting HTML tag support
    • Too many objects
    • Content not optimized for device
    • Low cache hit rate
    • Network peering problems
    • Bandwidth throttling
    • Inconsistent connectivity
    • Configuration errors
    • Application design issues
    • Code defects
    • Insufficient infrastructure
    • Network peering problems
    • Outages
    “Outside-in” customer point of view
    • Network resource shortage
    • Faulty content transcoding
    • SMS routing / latency issues
    • Configuration issues
    • Oversubscribed POP
    • Poor routing optimization
    • Low cache hit rate
  • Applications are no longer what you build inside your firewall
    10.5
    Number of hosts accessed directly by the browser,
    per user transaction, averaged across 3,000 companies
  • Who Owns End-User Quality?
    Line of Business Managers
    Product Managers
    Marketers
    Interface Designers
    Application Developers
    Architects
    Quality Assurance Teams
    Infrastructure/Operations Teams
    Help Desk Staff
    Quality is a Collective Function.
    Everybody owns a piece of the puzzle.
    Avoid at all costs:
    Individual Success, Collective Failure
  • How can we work together?
  • Situational Assessment and Improvement
    Provide this 5-minute assessment to each of the End-User Quality contributors for your application:
    The results provide a baseline. Share the results across the team.
    Identify areas of improvement and execute a plan to get better.
    Re-administer the assessment after 90 days.
    On a scale of 1 (poor) to 10 (excellent),
    how well are we are doing in these areas:
    Shared Goals
    Shared Metrics
    Communications
    Solving problems as a team
    Celebrating as a team
  • Questions
    Increased conversions 10%
    Gomez Customers Enjoy Measurable Benefits
    Reduced homepage load time from 11.3 seconds to 3.4 seconds
    Improved page load times 23%
    Saved 50%+ in staff and fees
    Reduced seven-step transaction time by 50%
    Reduced downtime 45%
    Achieved under 3 second response time and 99%+ availability
    Validated decision to consolidate three data centers
    For more information visit Gomez.comorcontact us at +1 781.778.2700