Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
 
18 th  June 2008 Performance Testing   Helping IT Help The Business
Performance Failures = Lost Revenue <ul><li>Yahoo News: Fri Jun 6, 2008 4:50 PM ET </li></ul><ul><ul><li>Online retailer  ...
Performance Failures <ul><li>And Remember those high profile sites that failed to handle customer load during peak events:...
Reluctance for Requirements <ul><li>The reluctance to defining performance requirements usually comes from: </li></ul><ul>...
Performance Goals and their importance <ul><li>“ Projects without clear goals will not achieve their goals clearly ” </li>...
Achieving Performance Goals <ul><li>Today’s discussion is intended to address 3 main points: </li></ul><ul><ul><li>Describ...
Planning Performance Goals   <ul><li>When Planning for Performance Requirements: </li></ul><ul><ul><li>Consumer Requiremen...
Performance Requirements – Roles <ul><li>Planning Requirements Phases and Responsibilities: </li></ul><ul><ul><li>The busi...
Performance Requirements  <ul><li>Ingredients for Performance Requirements: </li></ul><ul><ul><li>Define requirements in o...
Inter-Team Communication  <ul><li>Objectives may have been set and requirements defined but sometimes the business needs c...
Anatomy of a Performance Test <ul><li>Requirements </li></ul><ul><li>Discovery </li></ul><ul><li>Test Planning </li></ul><...
Conclusion  <ul><li>Costs associated with lack of testing and understand application performance are evident </li></ul><ul...
 
Upcoming SlideShare
Loading in …5
×

Performance Testing Helping It Help The Business From AppLabs

983 views

Published on

Published in: Technology
  • Be the first to comment

Performance Testing Helping It Help The Business From AppLabs

  1. 2. 18 th June 2008 Performance Testing Helping IT Help The Business
  2. 3. Performance Failures = Lost Revenue <ul><li>Yahoo News: Fri Jun 6, 2008 4:50 PM ET </li></ul><ul><ul><li>Online retailer Amazon Inc said its U.S. website was down for about 2 hours on Friday and it was unclear when service would be restored in full… </li></ul></ul><ul><ul><ul><li>Amazon shares fell 4.59 percent to close at $80.63 </li></ul></ul></ul><ul><li>MSNBC News: Monday March 24 , 2008 </li></ul><ul><ul><li>NetFlix suffers 11 hour outage of its Retail as well as the shipping and distribution Websites… </li></ul></ul><ul><ul><ul><li>Affected customers compensated $5 each due to downtime </li></ul></ul></ul><ul><li>Internet Business News: July 27, 2006 </li></ul><ul><ul><li>Australia's Jetstar airline Website crashed yesterday (26 July) as travelers went online to take advantage of promotional fares for the carrier's new international services. </li></ul></ul>
  3. 4. Performance Failures <ul><li>And Remember those high profile sites that failed to handle customer load during peak events: </li></ul><ul><ul><li>Victoria Secret Fashion Show… </li></ul></ul><ul><ul><li>The FIFA World Cup Soccer website… </li></ul></ul><ul><li>CNET News.com: Jan 4 2001 </li></ul><ul><ul><li>After a day of lengthy 11 hour outages, eBay said Thursday that it has restored its auction system and intends to upgrade its hardware in the coming weeks to provide improved service. </li></ul></ul><ul><ul><li>Outages of eBay's Web site attract attention because the vendor is so popular, but the problem occurs industry-wide--and not just with consumer sites. </li></ul></ul><ul><ul><li>More hardware won't solve Web site outages -- Donna Scott, Gartner Analyst </li></ul></ul>
  4. 5. Reluctance for Requirements <ul><li>The reluctance to defining performance requirements usually comes from: </li></ul><ul><ul><li>A lack of understanding for the purpose of performance requirements </li></ul></ul><ul><ul><li>Time constraints due to tight and unrealistic deadlines – “market driven” and not “realism driven” </li></ul></ul><ul><ul><li>Limited budgets - We have so many other things to worry about – it will be fine </li></ul></ul><ul><ul><li>Ownership of systems is not understood – Key Stakeholders take a back seat when then they should be driving! </li></ul></ul>
  5. 6. Performance Goals and their importance <ul><li>“ Projects without clear goals will not achieve their goals clearly ” </li></ul><ul><li>Tom Gilb -- The Tom Gilb Principle </li></ul><ul><li>Recent studies have attributed many application’s poor performance to a lack of clear performance goals when the software was designed and developed. Further analysis has shown that much of this is caused by non-existent or incomplete performance specifications </li></ul>
  6. 7. Achieving Performance Goals <ul><li>Today’s discussion is intended to address 3 main points: </li></ul><ul><ul><li>Describe considerations for a systems performance </li></ul></ul><ul><ul><li>Break down performance goals into tasks </li></ul></ul><ul><ul><li>Emphasize the importance of making performance goals part of the IT software requirements definition </li></ul></ul>
  7. 8. Planning Performance Goals <ul><li>When Planning for Performance Requirements: </li></ul><ul><ul><li>Consumer Requirements: It is critical to understand who or what will be using the Application </li></ul></ul><ul><ul><li>Data: It is important to understand the types and amounts of data that are anticipated or required to meet business needs </li></ul></ul><ul><ul><li>Traffic: It is important to understand the rates at which the data will need to be transacted in order to meet business goals </li></ul></ul><ul><ul><li>Business: It is important to understand from a business perspective how much business needs conducting to make it a success – this will ultimately drive change </li></ul></ul>
  8. 9. Performance Requirements – Roles <ul><li>Planning Requirements Phases and Responsibilities: </li></ul><ul><ul><li>The business analysts and owners should be defining the performance requirements </li></ul></ul><ul><ul><li>The technologists and developers will be designing and developing the application to meet the requirements </li></ul></ul><ul><ul><li>The testers will be evaluating that the application does effectively meet the requirements </li></ul></ul><ul><ul><li>The business and its stakeholders MUST sign the application off as part of the implementation process </li></ul></ul>
  9. 10. Performance Requirements <ul><li>Ingredients for Performance Requirements: </li></ul><ul><ul><li>Define requirements in order of priority </li></ul></ul><ul><ul><li>Keep the performance requirements within the context of the organization's business </li></ul></ul><ul><ul><li>Align the performance goals with specific business goals </li></ul></ul><ul><ul><li>Create performance goals that can be measured </li></ul></ul><ul><ul><li>Create performance goals that are inline with industry standards </li></ul></ul><ul><ul><li>Determine goal achievement criteria </li></ul></ul><ul><ul><li>Decide which goals will have pass fail grades and which will have varying degrees of tolerance </li></ul></ul><ul><li>Keep in mind the business that needs to be conducted within the application to meet the consumer needs or meet the financial targets </li></ul>
  10. 11. Inter-Team Communication <ul><li>Objectives may have been set and requirements defined but sometimes the business needs change </li></ul><ul><li>The key to successfully implementing performance testing is continual communication among team members – manage change accordingly </li></ul><ul><li>An effective mechanism of communication and collaboration will allow the team to make good performance related decisions, whilst changes are easy to make </li></ul><ul><li>  </li></ul><ul><li>The methods you use to communicate plans, priorities and changes are not that important as long as you are able to adapt those changes without requiring significant re-work </li></ul>
  11. 12. Anatomy of a Performance Test <ul><li>Requirements </li></ul><ul><li>Discovery </li></ul><ul><li>Test Planning </li></ul><ul><li>Automation </li></ul><ul><li>Testing </li></ul><ul><li>Measurements </li></ul><ul><li>Analysis </li></ul><ul><li>Tuning and Re-Testing </li></ul>
  12. 13. Conclusion <ul><li>Costs associated with lack of testing and understand application performance are evident </li></ul><ul><li>Performance Requirements need to be oriented around business goals – its usually the business who wants and owns the system </li></ul><ul><li>The roles of performance testing </li></ul><ul><ul><li>Business </li></ul></ul><ul><ul><li>Development </li></ul></ul><ul><ul><li>Testing </li></ul></ul><ul><li>“ If all these are successful, you can be sure that IT really can help the Business&quot; </li></ul>

×