Quick, Easy, Cheap & Valuable Performance Testing for Every Member of the Team
Upcoming SlideShare
Loading in...5
×
 

Quick, Easy, Cheap & Valuable Performance Testing for Every Member of the Team

on

  • 1,272 views

Not all Performance Testing is hard. Some is crazy simple... like "takes under 30 seconds per week" simple... and those simple things can often resolve 75% or more of your performance concerns before ...

Not all Performance Testing is hard. Some is crazy simple... like "takes under 30 seconds per week" simple... and those simple things can often resolve 75% or more of your performance concerns before the app is even ready for the first "hard" test.

Statistics

Views

Total Views
1,272
Views on SlideShare
1,270
Embed Views
2

Actions

Likes
0
Downloads
16
Comments
0

2 Embeds 2

http://us-w1.rockmelt.com 1
http://tweetedtimes.com 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Quick, Easy, Cheap & Valuable Performance Testing for Every Member of the Team Quick, Easy, Cheap & Valuable Performance Testing for Every Member of the Team Presentation Transcript

  • Quick, Easy, Cheap & Valuable Performance Testing… …for Every Member of the Team Created for: STANZ 2010 The Duxton Hotel The Swissotel Sydney Wellington City, NZ Sydney, AU 23 August, 2010 26 August, 2010 Scott Barber Chief Technologist PerfTestPlus, Inc. www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 1© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • Scott Barber CTO, PerfTestPlus, Inc. sbarber@perftestplus.com www.perftestplus.com Co-Founder: Workshop On Performance and Reliability www.performance-workshop.orgCo-Author: Performance Testing Guidance Beautiful Testing for Web Applications www.codeplex.com/PerfTestingGuide oreilly.com/catalog/9780596159825 www.amazon.com/gp/product/0735625700 www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 2© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • What is Performance Testing (Part 1)Performance Testing: An empirical, technical investigation conductedto provide stakeholders with information about the quality of the product orservice under test with regard to speed, scalability and/or stabilitycharacteristics with the purpose of assessing value or mitigating risk.Performance Investigation: A deliberate data-collection and data-interpretation activity typically focused on data related to speed, scalability,and/or stability of the product under test. The collected data are primarilyused to assess hypotheses about the root cause of one or more observedperformance issues.Performance Validation: A deliberate activity that compares speed,scalability and/or stability characteristics of the product under test to theexpectations of representative users of the product. www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 3© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • What is Performance Testing (Part 2)What mom tells people: I help people make websites go fast.What I tell people: I help and/or teach individuals and organizations to optimize software systems by balancing: • Cost • Time to market • Capacity while remaining focused on the quality of service to system users. www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 4© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • What is Performance Testing (Part 3)In effect: Performance testing helps stakeholders make decisions regarding product value and project risk; Specifically value and risk related to speed, scalability, and stability attributes of a system and it’s components throughout the product life-cycle. www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 5© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • “Let‟s face the truth, performance testing *IS* rocket science.” --Dawn Haynes … but even rocket science involves *SOME* easy stuff. --Addendum added by: Scott Barber www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 6© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • Quick, Easy, Cheap & Valuable Item #1 Make Performance a: www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 7© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • Thoughts on Priority• Focusing on performance adds value and mitigates risk from “bar napkin to delete key”.• Get performance in the dev, test, & delivery plans.• Don’t let performance fall off the plate.• Be the advocate, even if it makes you “annoying”. Goals: Soft Boundaries (User Satisfaction) Requirements: Firm Boundaries (Business or Legal) Thresholds: Hard Boundaries (Laws of Physics) Constraints: Arbitrary Boundaries (Budget or Timeline) www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 8© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • Quick, Easy, Cheap & Valuable Item #2 Ask lots of: www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 9© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • Thoughts on Questions• How is the performance today?• How will this [change] effect performance?• Go to dev, test, & management meetings – and ask those questions.• Advocate performance through questions.• Earning the “annoying” label for asking questions is ok, but becoming “annoying” via your response to their answers isn’t. www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 10© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • “Ok, that stuff is „quick‟, „easy‟ & „cheap‟ and I can see the value, but what about the *testing*?! www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 11 © 2006-10 PerfTestPlus, Inc. All rights reserved.
  • Quick, Easy, Cheap & Valuable Item #3 Am I annoyed? www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 12© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • Thoughts on Annoyance• Why am I annoyed?• How annoyed am I?• Does this annoy me all the time, or just sometimes?• What impact is this likely to have on product value?• Advocate something better. www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 13© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • Quick, Easy, Cheap & Valuable Item #4 Who else is annoyed? www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 14© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • More Thoughts on Annoyance• Who matters?• How do I get their feedback?• Are they annoyed with performance, or workflow, or, or, or…?• Advocate something better. www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 15© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • Quick, Easy, Cheap & Valuable Item #5 Determine: www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 16© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • Speedy Speed Collection• http://www.websiteoptimization.com/services/analyze/• http://www.websitepulse.com/help/tools.php• http://webwait.com/ If you don’t have speed targets, don’t fret... Trends are trendy! www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 17© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • Speedy Speed Collection (and more)• Microsoft Visual Round Trip Analyzer• IBM Page Detailer Basic www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 18© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • Quick, Easy, Cheap & Valuable Item #6 Research the www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 19© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • How are “leaders” doing?• Keynote Systems• Gomez Benchmarks• WebMetrics• The eService Index www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 20© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • Quick, Easy, Cheap & Valuable Item #7 Test the Front-End with www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 21© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • What is SCORN, anyway? Media, HTML, styles & scripts – compress & minify. The end-user’s browser cache can be your best friend, or your worst nightmare, use it wisely. Get the load order of your scripts and styles wrong, and you’ll lose your users every time – even though response time hasn’t changed! 3, 4, & 5xx series response codes on individual objects are bad things. When it comes to performance, less is more (usually). www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 22© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • SCORN References• High Performance Web Sites: Essential Knowledge for Front-End Engineers, by Steve Souders, O’Reilly, 2007. High Performance Web• Yahoo! YSlow for Firebug Sites: Essential Knowledge for Front-End Engineers• Page Speed• Right Click -> View Source and other Tips for Performance Testing the Front End, by Scott Barber, www.amazon.com/dp/0596529309 for AST Update, 2007. www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 23© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • Quick, Easy, Cheap & Valuable Item #8 Proceed with caution, the following is only easy for hard-core www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 24© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • Easy Stuff for Geeks• Firefox Performance Tester’s Pack• Web Site Test Tools and Site Management Tools• Fiddler• Web Development Helper www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 25© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • ReCap• Make performance a priority.• Ask lots of questions.• Am I annoyed?• Who else is annoyed?• Determine how fast.• Research the competition.• Test the front-end with SCORN.• Embrace your inner geek. www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 26© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • Questions www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 27© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • Performance Testing Principles Project context is central to successful performance testing. Business, project, system, & user success criteria. Identify system usage, and key metrics; plan and design tests. Install and prepare environment, tools, & resource monitors. Script the performance tests as designed. Run and monitor tests. Validate tests, test data, and results. Analyze the data individually and as a cross-functional team. Consolidate and share results, customized by audience. "Lather, rinse, repeat" as necessary. www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 28© 2006-10 PerfTestPlus, Inc. All rights reserved.
  • CreditsSome of the material in this presentation was inspired by High Performance Web Sites: Essential Knowledge for Front-End Engineers, by Steve Souders, O’Reilly, 2007.Some of this material was developed for, or inspired by, Performance Testing Guidance for Web Applications, a Microsoft patterns & practices book by J.D. Meier, Scott Barber, Carlos Farre, Prashant Bansode, and Dennis Rea.Many ideas in this presentation were inspired or enhanced by colleagues including Alberto Savoia, Roland Stens, Richard Leeke, Mike Kelly, Nate White, Rob Sabourin, Chris Loosley, Ross Collard, Jon Bach, James Bach, Jerry Weinberg, Cem Kaner, Dawn Haynes, Karen Johnson, and the entire WOPR community.Most of the concepts in this presentation are derived from publications, presentations, and research written and/or conducted by Scott Barber.Many ideas were improved by students of various courses taught by Scott Barber, back to 2001. www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 29 © 2006-10 PerfTestPlus, Inc. All rights reserved.
  • Contact Info Scott Barber Chief Technologist PerfTestPlus, IncE-mail: Web Site:sbarber@perftestplus.com www.PerfTestPlus.com www.PerfTestPlus.com Quick, Cheap, Easy & Valuable Performance Testing Page 30© 2006-10 PerfTestPlus, Inc. All rights reserved.