I one aolpage-test-2010


Published on

Overview and demonstration of AOL's PageTest tool, delivered to the NYC Web Performance Meetup by Nicholas Tang on April 15, 2010.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

I one aolpage-test-2010

  1. 1. AOL PageTest April 2010 – Nicholas Tang NYC Web Performance Meetup
  2. 2. Table of Contents <ul><li>Introduction </li></ul><ul><li>WebPageTest.org </li></ul><ul><li>PageTest – Desktop </li></ul><ul><li>Scripting PageTest </li></ul><ul><li>Q&A </li></ul>
  3. 3. Introduction (I think this slide signifies that I'm going to blow your mind . Or that this presentation is going to blow up in my face. One of those, anyways.)
  4. 4. Who is this guy? <ul><li>Nicholas Tang VP, Technical Operations Interactive One </li></ul><ul><ul><li>[email_address] </li></ul></ul><ul><li>Obsessed with website performance (in a good way... I think) </li></ul><ul><li>Core non-contributor on AOL's PageTest </li></ul><ul><li>Once posted to the WebPageTest forums </li></ul><ul><li>Expert PowerPoint presenter (obviously) </li></ul>
  5. 5. What is Page Test? <ul><li>Set of website performance testing tools, written inside AOL, later open sourced </li></ul><ul><li>Online test: http:// www.webpagetest.org / </li></ul><ul><li>Internet Explorer plugin: http:// pagetest.sourceforge.net / </li></ul><ul><li>WebPageTest can also be run as a self-hosted tool. </li></ul>
  6. 6. WebPageTest.org <ul><li>One of my favorite sites! </li></ul><ul><li>Runs as IE7/IE8 browser </li></ul><ul><li>Page load timing </li></ul><ul><li>Waterfall graphs </li></ul><ul><li>Optimization checklists </li></ul><ul><li>Content and domain details </li></ul><ul><li>Screenshots/ screencast of load </li></ul><ul><li>Scripted tests </li></ul><ul><li>And much, much more! </li></ul>
  7. 7. WebPageTest.org
  8. 8. WebPageTest.org <ul><li>Here's where I attempt a LIVE DEMO. </li></ul><ul><li>While this DEMO is in fact LIVE, it is using saved tests I ran before. If I have time at the end and people are interested, I’ll run a new test live. BlackPlanet.com front page test: http://www.webpagetest.org/result/100331_6DEC/ </li></ul><ul><li>HelloBeautiful comparison: http://www.webpagetest.org/video/compare.php?tests=100415_7CYS,100411_6TXM,100411_6TXN,100411_6TXP </li></ul><ul><li>Comparison video: http://www.webpagetest.org/video/view.php?id=100415_7f3ef0be0275e18396bd0e247b24e429aab7f051.slow </li></ul>
  9. 9. WebPageTest.org automation <ul><li>Requests can be automated via a GET/POST request. </li></ul><ul><li>Example: </li></ul><ul><ul><li>http:// www.webpagetest.org/runtest.php?url = www.blackplanet.com </li></ul></ul><ul><ul><li>Result: http://www.webpagetest.org/result/100411_6TR8/ </li></ul></ul><ul><li>Add f=xml to get xml data: </li></ul><ul><ul><li>http:// www.webpagetest.org/runtest.php?url = www.blackplanet.com&f =xml </li></ul></ul><ul><li>More info: </li></ul><ul><ul><li>http:// sourceforge.net/apps/mediawiki/pagetest/index.php?title = Automating_Pagetest </li></ul></ul>
  10. 10. PageTest <ul><li>PageTest is an open-source tool you download and can run under Windows / IE. </li></ul><ul><li>Run tests locally </li></ul><ul><li>Script & automate tests </li></ul><ul><li>Run multi-step tests </li></ul><ul><li>Available here: http://pagetest.sourceforge.net/ </li></ul><ul><li>Quick Start Guide: http://sourceforge.net/apps/mediawiki/pagetest/index.php?title=Quick_Start_Guide </li></ul>
  11. 11. PageTest <ul><li>Here's yet another live demo. </li></ul><ul><ul><li>(Note: may just have been my machine, but the latest build of PageTest (217) didn't work properly under Win7/64bit, or WinXP/IE6… but your mileage may vary.) </li></ul></ul>
  12. 12. Scripting <ul><li>Tests can be scripted in both the local and web version, but the local version has fewer restrictions: </li></ul><ul><ul><li>Multi-page tests (sort of) </li></ul></ul><ul><ul><li>Can use external files (read in lists of variables, do upload testing, etc.) </li></ul></ul><ul><ul><li>Gives debugging/ error feedback (sort of – it’s not very detailed) </li></ul></ul><ul><li>Language reference: </li></ul><ul><ul><li>http:// sourceforge.net/apps/mediawiki/pagetest/index.php?title =Scripting </li></ul></ul><ul><li>NOTE: you must use tabs, not spaces, to separate elements when scripting! </li></ul>
  13. 13. PageTest Scripting <ul><li>Sample testing scenarios: </li></ul><ul><li>Form submissions (post blog entry, add to cart, etc.) </li></ul><ul><li>Multi-page tests (including multi-step transactions, ex: log in, go to inbox, send message, log out) </li></ul><ul><li>Automated data collection (via scheduled jobs) </li></ul><ul><li>Performance “smoke tests” </li></ul><ul><ul><li>Create scripts for major actions/ scenarios on your site </li></ul></ul><ul><ul><li>Run these scripts against each release/ day/ etc. </li></ul></ul><ul><ul><li>Capture and compare results (set performance thresholds for qa) </li></ul></ul><ul><ul><li>Profit! </li></ul></ul>
  14. 14. PageTest Scripting Example <ul><li>Check the performance of the third page of Craigslist job posts </li></ul><ul><ul><li>logData 0 </li></ul></ul><ul><ul><li>navigate http://newyork.craigslist.org/search/jjj?query=developer&catAbbreviation=jjj </li></ul></ul><ul><ul><li>navigate http://newyork.craigslist.org/search/jjj?query=developer&catAbbreviation=jjj&s=100 </li></ul></ul><ul><ul><li>logData 1 </li></ul></ul><ul><ul><li>navigate http://newyork.craigslist.org/search/jjj?query=developer&catAbbreviation=jjj&s=200 </li></ul></ul><ul><li>Result page: </li></ul><ul><ul><li>http://www.webpagetest.org/result/100411_6TT3/ </li></ul></ul>
  15. 15. PageTest Scripting Example <ul><li>Run a Twitter Search: </li></ul><ul><ul><li>logData 0 </li></ul></ul><ul><ul><li>navigate http://search.twitter.com/ </li></ul></ul><ul><ul><li>logData 1 </li></ul></ul><ul><ul><li>setValue id=searchBox web performance </li></ul></ul><ul><ul><li>submitForm id=searchForm </li></ul></ul><ul><li>Result page: </li></ul><ul><ul><li>http://www.webpagetest.org/result/100411_6TVK/ </li></ul></ul>
  16. 16. Self-Hosted WebPageTest <ul><li>If you want to run a private instance of WebPageTest, the code is available here: http://www.webpagetest.org/software/WebPagetest_1_8_1.zip </li></ul><ul><li>Note: I have not tried this myself! Read about it on the forums. </li></ul>
  17. 17. Finding out more <ul><li>If you want to know more about PageTest, check out these sources: </li></ul><ul><ul><li>PageTest Wiki </li></ul></ul><ul><ul><li>http:// sourceforge.net/apps/mediawiki/pagetest/index.php?title = Main_Page </li></ul></ul><ul><ul><li>PageTest Forums </li></ul></ul><ul><ul><li>http:// www.webpagetest.org/forums/index.php </li></ul></ul><ul><ul><li>Patrick Meenan’s Blog – Performance Matters </li></ul></ul><ul><ul><li>http://blog.patrickmeenan.com/ </li></ul></ul>
  18. 18. Q&A <ul><li>(I didn’t design this template.) </li></ul>