Presents Real User Measurement Past, Present & FutureWebinar            © 2012 SOASTA. All rights reserved.   1
Real user measurement – then and now…and….TODAY’S PRESENTERSAaron Kulick: – Speed Freak @WalmartLabs - @GoFastWebBuddy Bre...
Cliff Crocker     Buddy Brewer        Philip Tellis      Aaron Kulick• VP Product      • VP Engineering   • Chief Architec...
Internet Explorer 6    © 2012 SOASTA. All rights reserved.   October 30, 2012   4
Internet Explorer 7, 8                                       Chrome 1, 2, 3Firefox 2, 3                           iPhone 1...
Chrome 4, 5, 6, 7, 8, 9, 10,                               11, 12, 13, 14, 15, 16, 17,18, 19Internet Explorer 9           ...
• When we speak about performance, were really talking about  latency• Humans have measured latency for as long as weve kn...
• “How long does it take to get a package from NY to SF?”• “How fast can a man run 100 metres?”• “Whats the fastest laptim...
In general, fast things excite us and slow things frustrate us.                                        © 2012 SOASTA. All ...
So what should we measure, and how should we measure it?                                   © 2012 SOASTA. All rights reser...
• The traditional way is to use robots• This is good to tell us about infrastructure - but what we really care  about is u...
Thats akin to asking a Robot to drive Route 66 and tell you if it wasexciting or boring… and you have to do this with 374 ...
So lets bring out the RUM!                              © 2012 SOASTA. All rights reserved.   October 30, 2012   13
• Measure the real experience of a real user• How fast was their experience?• Were they engaged, did they take out their c...
A Brief History of RUM …                           © 2012 SOASTA. All rights reserved.   October 30, 2012   15
At a Yahoo! internal hack day, Steve Souders built aJavaScript tool to measure page load time within the browser.         ...
Several Improvements were made:•   Bandwidth measurements added•   Creation of Yslow•   100s of billions of datapoints wer...
Steve Souders open sources Episodes•   http://stevesouders.com/episodes/paper.phpWhitePages.com published jiffy•   http://...
Yahoo! open sourced the JavaScript library, calledboomerang, under the BSD license•   http://lognormal.github.com/boomeran...
Lets talk a bit about NavTiming•   Exposes network level timing details to JavaScript•   DNS lookup, TCP connect, SSL hand...
The level of detail available in NavTiming made RUM performancedata comparable to what youd get from a bot.boomerang integ...
Buddy and I started LogNormal to pull in data from boomerang,analyze it, and present it back to site owners in a useful wa...
In 2012, the area has exploded with many new companies getting in tothe playing fieldLogNormal is now part of SOASTA and t...
At SOASTA, wed like mPulse to look deeper into the human aspect ofweb and mobile performance                              ...
© 2012 SOASTA. All rights reserved.   October 30, 2012   26
Real User Measurement and the ‘Tribe’                    http://sfwebperf.org                    @SFWebPerf               ...
Thinking beyond the current horizon, where do you see real usermeasurement over the next 10 years?                        ...
Q&A                       Source: Flickr –                       jamescridlandListen to Your Users
Thank You!        Next Webinar: Nov. 15, 2010 - 10 a.m. PST  “Automated Testing & Continuous Integration in the Cloud”   *...
Real User Measurement Expert Panel by SOASTA
Real User Measurement Expert Panel by SOASTA
Upcoming SlideShare
Loading in...5
×

Real User Measurement Expert Panel by SOASTA

1,201

Published on

RUM experts share their perspectives!

On the heels of SOASTA’s acquisition of LogNormal and mPulse product announcement at Velocity in London, we’re introducing our team and hosting a discussion with the experts on real user measurement.

While RUM offerings have driven a lot of buzz lately, this preferred method of measurement for web — and now mobile — performance got its start early in this decade’s performance movement. Join us for a round table discussion on the importance that RUM has played and continues to play for development, test, operations and marketing professionals.

This panel will be moderated by Cliff Crocker, SOASTA VP of Product Management.

Panelists:

Buddy Brewer – Former CEO of LogNormal, now SOASTA VP of Engineering
Philip Tellis – Former CIO of LogNormal, now SOASTA Chief Architect
Aaron Kulick – Founder of the SF WebPerf group and current guerrilla engineer on the Big Fast Data team @WalmartLabs

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,201
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
28
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Real User Measurement Expert Panel by SOASTA

  1. 1. Presents Real User Measurement Past, Present & FutureWebinar © 2012 SOASTA. All rights reserved. 1
  2. 2. Real user measurement – then and now…and….TODAY’S PRESENTERSAaron Kulick: – Speed Freak @WalmartLabs - @GoFastWebBuddy Brewer: VP Engineering, SOASTA - @bbrewerPhillip Tellis: Chief Architect, SOASTA - @bluesmoonCliff Crocker: VP Product Management, SOASTA mPulse - @cliffcrockerAgenda:• Roundtable discussion• Moderated QA with PanelistsQuestions:Submit in the question box during event © 2012 SOASTA. All rights reserved. October 30, 2012 2
  3. 3. Cliff Crocker Buddy Brewer Philip Tellis Aaron Kulick• VP Product • VP Engineering • Chief Architect • Guerilla Engineer SOASTA SOASTA SOASTA @WalmartLabs• Real User • Co-founder of • Co-founder of • Founder SF Web Measurement LogNormal LogNormal Perf Meetup and (mPulse) • @bbrewer • @bluesmoon Web Perf Days• @cliffcrocker • @GoFastWeb
  4. 4. Internet Explorer 6 © 2012 SOASTA. All rights reserved. October 30, 2012 4
  5. 5. Internet Explorer 7, 8 Chrome 1, 2, 3Firefox 2, 3 iPhone 1st Gen, 3G © 2012 SOASTA. All rights reserved. October 30, 2012 5
  6. 6. Chrome 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17,18, 19Internet Explorer 9 iPhone 3GS, 4, 4S, 5 Firefox 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16 Android Cupcake, Donut, Éclair, Froyo, Gingerbread, Honeycomb, Jelly Bean iPad 1, 2, 3, 4, Mini © 2012 SOASTA. All rights reserved. October 30, 2012 6
  7. 7. • When we speak about performance, were really talking about latency• Humans have measured latency for as long as weve known large distances © 2012 SOASTA. All rights reserved. October 30, 2012 7
  8. 8. • “How long does it take to get a package from NY to SF?”• “How fast can a man run 100 metres?”• “Whats the fastest laptime at the Indy 500?” © 2012 SOASTA. All rights reserved. October 30, 2012 8
  9. 9. In general, fast things excite us and slow things frustrate us. © 2012 SOASTA. All rights reserved. October 30, 2012 9
  10. 10. So what should we measure, and how should we measure it? © 2012 SOASTA. All rights reserved. October 30, 2012 10
  11. 11. • The traditional way is to use robots• This is good to tell us about infrastructure - but what we really care about is user experience © 2012 SOASTA. All rights reserved. October 30, 2012 11
  12. 12. Thats akin to asking a Robot to drive Route 66 and tell you if it wasexciting or boring… and you have to do this with 374 different cars! © 2012 SOASTA. All rights reserved. October 30, 2012 12
  13. 13. So lets bring out the RUM! © 2012 SOASTA. All rights reserved. October 30, 2012 13
  14. 14. • Measure the real experience of a real user• How fast was their experience?• Were they engaged, did they take out their credit cards, do they stick around? © 2012 SOASTA. All rights reserved. October 30, 2012 14
  15. 15. A Brief History of RUM … © 2012 SOASTA. All rights reserved. October 30, 2012 15
  16. 16. At a Yahoo! internal hack day, Steve Souders built aJavaScript tool to measure page load time within the browser. © 2012 SOASTA. All rights reserved. October 30, 2012 16
  17. 17. Several Improvements were made:• Bandwidth measurements added• Creation of Yslow• 100s of billions of datapoints were analysed (a tiny sample of Yahoo!’s traffic at the time) © 2012 SOASTA. All rights reserved. October 30, 2012 17
  18. 18. Steve Souders open sources Episodes• http://stevesouders.com/episodes/paper.phpWhitePages.com published jiffy• http://code.google.com/p/jiffy-web/ © 2012 SOASTA. All rights reserved. October 30, 2012 18
  19. 19. Yahoo! open sourced the JavaScript library, calledboomerang, under the BSD license• http://lognormal.github.com/boomerang/doc/At the same time (on the same day actually), Internet Explorer 9beta announced support for the Navigation Timing API.• http://www.w3.org/TR/navigation-timing/ © 2012 SOASTA. All rights reserved. October 30, 2012 19
  20. 20. Lets talk a bit about NavTiming• Exposes network level timing details to JavaScript• DNS lookup, TCP connect, SSL handshake, First Byte time, and more• For a given web request, you can tell exactly where the time was spent• Supported by IE >= 9, Chrome >=6, Firefox >=7• No exposure into rendering times © 2012 SOASTA. All rights reserved. October 30, 2012 20
  21. 21. The level of detail available in NavTiming made RUM performancedata comparable to what youd get from a bot.boomerang integrates well with it, and works around browser bugswhen needed © 2012 SOASTA. All rights reserved. October 30, 2012 22
  22. 22. Buddy and I started LogNormal to pull in data from boomerang,analyze it, and present it back to site owners in a useful way. © 2012 SOASTA. All rights reserved. October 30, 2012 23
  23. 23. In 2012, the area has exploded with many new companies getting in tothe playing fieldLogNormal is now part of SOASTA and the product is called mPulse © 2012 SOASTA. All rights reserved. October 30, 2012 24
  24. 24. At SOASTA, wed like mPulse to look deeper into the human aspect ofweb and mobile performance © 2012 SOASTA. All rights reserved. October 30, 2012 25
  25. 25. © 2012 SOASTA. All rights reserved. October 30, 2012 26
  26. 26. Real User Measurement and the ‘Tribe’ http://sfwebperf.org @SFWebPerf http://webperfdays.org @WebPerfDays
  27. 27. Thinking beyond the current horizon, where do you see real usermeasurement over the next 10 years? © 2012 SOASTA. All rights reserved. October 30, 2012 29
  28. 28. Q&A Source: Flickr – jamescridlandListen to Your Users
  29. 29. Thank You! Next Webinar: Nov. 15, 2010 - 10 a.m. PST “Automated Testing & Continuous Integration in the Cloud” * Kohsuke Kawaguchi – Jenkins CI creator & SOASTA TouchTest mobile CI demo * Register at www.soasta.com/knowledge-center/webinars Contact Us: mPulse@soasta.com Contact SOASTA: www.soasta.com info@soasta.com 866.344.8766 Follow us: twitter.com/cloudtest facebook.com/cloudtest © 2012 SOASTA. All rights reserved. October 30, 2012 31
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×