Real User Measurement Expert Panel by SOASTA

1© 2012 SOASTA. All rights reserved.Webinar
Presents
Real User
Measurement
Past, Present &
Future

2© 2012 SOASTA. All rights reserved. October 30, 2012
Real user measurement – then and now…and….
TODAY’S PRESENTERS
Aaron Kulick: – Speed Freak @WalmartLabs - @GoFastWeb
Buddy Brewer: VP Engineering, SOASTA - @bbrewer
Phillip Tellis: Chief Architect, SOASTA - @bluesmoon
Cliff Crocker: VP Product Management, SOASTA mPulse - @cliffcrocker
Agenda:
• Roundtable discussion
• Moderated QA with Panelists
Questions:
Submit in the question box during event

• VP Product
SOASTA
• Real User
Measurement
(mPulse)
• @cliffcrocker
Cliff Crocker
• VP Engineering
SOASTA
• Co-founder of
LogNormal
• @bbrewer
Buddy Brewer
• Chief Architect
SOASTA
• Co-founder of
LogNormal
• @bluesmoon
Philip Tellis
• Guerilla Engineer
@WalmartLabs
• Founder SF Web
Perf Meetup and
Web Perf Days
• @GoFastWeb
Aaron Kulick

Internet Explorer 6

Internet Explorer 7, 8
Firefox 2, 3
iPhone 1st Gen, 3G
Chrome 1, 2, 3

Internet Explorer 9
Chrome 4, 5, 6, 7, 8, 9, 10,
11, 12, 13, 14, 15, 16, 17,18, 19
Firefox 4, 5, 6, 7, 8, 9, 10,
11, 12, 13, 14, 15, 16
Android Cupcake, Donut, Éclair, Froyo,
Gingerbread, Honeycomb, Jelly Bean
iPhone 3GS,
4, 4S, 5
iPad 1, 2, 3, 4, Mini

• When we speak about performance, we're really talking about
latency
• Humans have measured latency for as long as we've known large
distances

• “How long does it take to get a package from NY to SF?”
• “How fast can a man run 100 metres?”
• “What's the fastest laptime at the Indy 500?”

In general, fast things excite us and slow things frustrate us.

So what should we measure, and how should we measure it?

• The traditional way is to use robots
• This is good to tell us about infrastructure - but what we really care
about is user experience

That's akin to asking a Robot to drive Route 66 and tell you if it was
exciting or boring
… and you have to do this with 374 different cars!

So let's bring out the RUM!

• Measure the real experience of a real user
• How fast was their experience?
• Were they engaged, did they take out their credit cards, do they
stick around?

A Brief History of RUM …

At a Yahoo! internal hack day, Steve Souders built a
JavaScript tool to measure page load time within the browser.

Several Improvements were made:
• Bandwidth measurements added
• Creation of Yslow
• 100s of billions of datapoints were analysed (a tiny sample of Yahoo!’s
traffic at the time)

Steve Souders open sources Episodes
• http://stevesouders.com/episodes/paper.php
WhitePages.com published jiffy
• http://code.google.com/p/jiffy-web/

Yahoo! open sourced the JavaScript library, called
boomerang, under the BSD license
• http://lognormal.github.com/boomerang/doc/
At the same time (on the same day actually), Internet Explorer 9
beta announced support for the Navigation Timing API.
• http://www.w3.org/TR/navigation-timing/

Let's talk a bit about NavTiming
• Exposes network level timing details to JavaScript
• DNS lookup, TCP connect, SSL handshake, First Byte time, and more
• For a given web request, you can tell exactly where the time was spent
• Supported by IE >= 9, Chrome >=6, Firefox >=7
• No exposure into rendering times

The level of detail available in NavTiming made RUM performance
data comparable to what you'd get from a bot.
boomerang integrates well with it, and works around browser bugs
when needed

Buddy and I started LogNormal to pull in data from boomerang,
analyze it, and present it back to site owners in a useful way.

In 2012, the area has exploded with many new companies getting in to
the playing field
LogNormal is now part of SOASTA and the product is called mPulse

At SOASTA, we'd like mPulse to look deeper into the human aspect of
web and mobile performance

Real User Measurement and the ‘Tribe’
http://sfwebperf.org
@SFWebPerf
http://webperfdays.org
@WebPerfDays

Thinking beyond the current horizon, where do you see real user
measurement over the next 10 years?

Listen to Your Users
Source: Flickr –
jamescridland
Q&A

Thank You!
Contact SOASTA:
www.soasta.com
info@soasta.com
866.344.8766
Follow us:
twitter.com/cloudtest
facebook.com/cloudtest
Next Webinar: Nov. 15, 2010 - 10 a.m. PST
“Automated Testing & Continuous Integration in the Cloud”
* Kohsuke Kawaguchi – Jenkins CI creator & SOASTA TouchTest mobile CI demo *
Register at www.soasta.com/knowledge-center/webinars
Contact Us: mPulse@soasta.com

Real User Measurement Expert Panel by SOASTA

More Related Content

Similar to Real User Measurement Expert Panel by SOASTA

More from SOASTA

Recently uploaded

Real User Measurement Expert Panel by SOASTA