SlideShare a Scribd company logo
Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   1
The 3.5s dash for attention and other stuff we
               found in RUM

                    Buddy Brewer, Philip Tellis



                 Velocity EU 2012 / 2012-10-03




     Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   2
Jean-Antoine Nollet




           Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   3
Mr. Souders




          Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   4
https://github.com/lognormal/boomerang/




Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   5
Never underestimate the bandwidth of a mail horse




           Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   6
World-wide bandwidth




          Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   7
What do users expect?




          Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   8
Gold or Bronze?




          Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   9
What delighted users a few years ago is now an expected
    baseline, the absence of which will frustrate.




     Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   10
Should you delight?




           Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   11
Or frustrate?




           Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   12
Delighting changes the baseline




Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   13
Delighting changes the baseline
(Frustrating does too, but we don’t want to go there)




    Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   13
So where’s the web today?




Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   14
Log-Normal Distribution




          Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   15
Log-Normal Distribution




     The logarithm of the x-axis follows a Normal distribution




           Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   15
Log-Normal Distribution




   Performance data does not always follow a "pure" Log-Normal
                          distribution




           Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   16
Look at the entire spread

                                ...




Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   17
Look at the entire spread

   which often approaches an infinite width




Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   17
• 0.8% of hits are fake/abusive
• 0.2-0.5% of hits are from a stale cache
• 0.1% of hits are absurd
• Timestamps in the future (or past depending on how you
  interpret it)
• Bots ignore robots.txt across domains
• "Interesting" caches/copies




        Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   18
Even with beacons, you need to sanitize your input




  Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   19
Once you get past the cruft, you can really measure users




      Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   20
How does performance
                impact human behavior?


Wednesday, October 3, 12
8 million pages

                       1.5 million visits

                       50 different dimensions

Wednesday, October 3, 12
very fast sessions had high bounce rates
   70.00%




   52.50%




   35.00%




   17.50%




       0%
            0        2      4   6   8   10   12   14   16   18   20   22   24   26   28   30


Wednesday, October 3, 12
bounce rate vs. load time
70.00%




52.50%




35.00%




17.50%




    0%
         1         3       5   7    9   11   13   15   17   19   21   23   25   27   29

Wednesday, October 3, 12
bounce rate vs. DOM interactive
 70.00%




 52.50%




 35.00%




 17.50%




    0%
          1    1.5    2    2.5   3    3.5   4   4.5   5   5.5   6   6.5   7   7.5   8   8.5   9   9.5   10   10.5   11   11.5   12   12.5


Wednesday, October 3, 12
bounce rate vs. front end time
 80.00%




 60.00%




 40.00%




 20.00%




    0%
          0.5    2         3.5   5   6.5   8   9.5   11   12.5   14   15.5   17   18.5   20   21.5   23   24.5   26   27.5   29

Wednesday, October 3, 12
is my web site performance toxic to my
                    users?

http://www.flickr.com/photos/21560098@N06/3796822070
Wednesday, October 3, 12
LD50 - when do half the users bounce?




http://www.flickr.com/photos/thecosmopolitan/6117530924
Wednesday, October 3, 12
Bounce rate >=50%
                            Back end time    1.7 sec

                            DOM Loading      1.8 sec

                           DOM Interactive   2.75 sec

                           Front end time    3.5 sec

                           DOM Complete      4.75 sec

                             Load event      5.5 sec

Wednesday, October 3, 12
Browsers by Load Time

     70.00%




     52.50%




     35.00%                                                                                                 LD50

                                                                                                            IE: 3.6 sec
     17.50%
                                                                                                            Firefox: 5.6 sec
                                                                                                            Chrome: 6.5 sec
         0%
              1   1.4 1.8 2.2 2.6   3   3.4 3.8 4.2 4.6   5   5.4 5.8 6.2 6.6   7   7.4 7.8 8.2 8.6   9    9.4 9.8 10.2 10.6 11 11.4 11.8 12.2 12.6 13 13.4 13.8 14.2 14.6 15


                                                                                       IE                 Chrome               Firefox


Wednesday, October 3, 12
Browsers by DOM Interactive
            90.00%




            67.50%




            45.00%
                                                                                                                                         LD50

            22.50%
                                                                                                                                         IE: 1.8 sec
                                                                                                                                         Firefox: 3.1 sec
                                                                                                                                         Chrome: 4.4 sec
               0%
                     0.5 0.7 0.9 1.1 1.3 1.5 1.7 1.9 2.1 2.3 2.5 2.7 2.9 3.1 3.3 3.5 3.7 3.9 4.1 4.3 4.5 4.7 4.9 5.1 5.3 5.5 5.7 5.9 6.1 6.3 6.5 6.7 6.9 7.1 7.3 7.5 7.7 7.9 8.1 8.3 8.5 8.7 8.9 9.1 9.3 9.5 9.7 9.9


                                                                        IE                    Chrome                        Firefox




Wednesday, October 3, 12
Countries by Load Time
    90.00%




    67.50%
                                                                                                                                                   LD50

                                                                                                                                                   DE: ? sec
    45.00%                                                                                                                                         US: 5.0 sec
                                                                                                                                                   GB: 11.5 sec
                                                                                                                                                   CA: 13.5 sec
                                                                                                                                                   AU: ? sec
    22.50%




        0%
             1   1.5   2   2.5   3   3.5   4   4.5   5   5.5   6   6.5   7   7.5   8   8.5   9    9.5 10 10.5 11 11.5 12 12.5 13 13.5 14 14.5 15



                                                                             US              CA          DE         AU          GB




Wednesday, October 3, 12
Available Bandwidth

                           GB          AU             World




Wednesday, October 3, 12
Future directions
                           What is the LD50 for your site?

                           Other bounce rates? 40%? 30%?

                           Other variables? (critical content
                           visible, etc)

                           Other behaviors? Conversions,
                           revenue, pages per session, actions,
                           when do people make tea?
Wednesday, October 3, 12
Questions?



                           Buddy Brewer @bbrewer
                           Philip Tellis @bluesmoon

Wednesday, October 3, 12
Credits




     • Usain Bolt – Sum_of_Mark on flickr
     • Douglas Mail Carrier – Svadilfari on flickr
     • Angel Delight – Auntie P on flickr
     • Frustrated – Kevin Lawver on flickr
     • Jean-Antoine Nollet – (Public Domain) Wikipedia
     • 100 metre dash – on NY Times




              Velocity EU 2012 / 2012-10-03   The 3.5s dash for attention and other stuff we found in RUM   21

More Related Content

Viewers also liked

Puppet Development Workflow
Puppet Development WorkflowPuppet Development Workflow
Puppet Development Workflow
Jeffery Smith
 
Continuous Delivery antipatterns from the wild - Matthew Skelton - Continuous...
Continuous Delivery antipatterns from the wild - Matthew Skelton - Continuous...Continuous Delivery antipatterns from the wild - Matthew Skelton - Continuous...
Continuous Delivery antipatterns from the wild - Matthew Skelton - Continuous...
Skelton Thatcher Consulting Ltd
 
Who Does What? Mapping Cloud Foundry Activities and Entitlements to IT Roles
Who Does What? Mapping Cloud Foundry Activities and Entitlements to IT RolesWho Does What? Mapping Cloud Foundry Activities and Entitlements to IT Roles
Who Does What? Mapping Cloud Foundry Activities and Entitlements to IT Roles
VMware Tanzu
 
Beaker: Automated, Cloud-Based Acceptance Testing - PuppetConf 2014
Beaker: Automated, Cloud-Based Acceptance Testing - PuppetConf 2014Beaker: Automated, Cloud-Based Acceptance Testing - PuppetConf 2014
Beaker: Automated, Cloud-Based Acceptance Testing - PuppetConf 2014
Puppet
 
Production testing through monitoring
Production testing through monitoringProduction testing through monitoring
Production testing through monitoring
Leon Fayer
 
Developing Good Operations Tools
Developing Good Operations ToolsDeveloping Good Operations Tools
Developing Good Operations Tools
James Turnbull
 
ELK: Moose-ively scaling your log system
ELK: Moose-ively scaling your log systemELK: Moose-ively scaling your log system
ELK: Moose-ively scaling your log system
Avleen Vig
 
BsidesMCR_2016-what-can-infosec-learn-from-devops
BsidesMCR_2016-what-can-infosec-learn-from-devopsBsidesMCR_2016-what-can-infosec-learn-from-devops
BsidesMCR_2016-what-can-infosec-learn-from-devops
James '​-- Mckinlay
 
Inspec, or how to translate compliance spreadsheets into code
Inspec, or how to translate compliance spreadsheets into codeInspec, or how to translate compliance spreadsheets into code
Inspec, or how to translate compliance spreadsheets into code
Michael Goetz
 
DevSecCon KeyNote London 2015
DevSecCon KeyNote London 2015DevSecCon KeyNote London 2015
DevSecCon KeyNote London 2015
Shannon Lietz
 
Monitorama 2015 Netflix Instance Analysis
Monitorama 2015 Netflix Instance AnalysisMonitorama 2015 Netflix Instance Analysis
Monitorama 2015 Netflix Instance Analysis
Brendan Gregg
 
Scaling Operations At Spotify
Scaling Operations At SpotifyScaling Operations At Spotify
Scaling Operations At Spotify
David Poblador i Garcia
 
Linux Profiling at Netflix
Linux Profiling at NetflixLinux Profiling at Netflix
Linux Profiling at Netflix
Brendan Gregg
 
Operational Software Design
Operational Software DesignOperational Software Design
Operational Software Design
Theo Schlossnagle
 

Viewers also liked (14)

Puppet Development Workflow
Puppet Development WorkflowPuppet Development Workflow
Puppet Development Workflow
 
Continuous Delivery antipatterns from the wild - Matthew Skelton - Continuous...
Continuous Delivery antipatterns from the wild - Matthew Skelton - Continuous...Continuous Delivery antipatterns from the wild - Matthew Skelton - Continuous...
Continuous Delivery antipatterns from the wild - Matthew Skelton - Continuous...
 
Who Does What? Mapping Cloud Foundry Activities and Entitlements to IT Roles
Who Does What? Mapping Cloud Foundry Activities and Entitlements to IT RolesWho Does What? Mapping Cloud Foundry Activities and Entitlements to IT Roles
Who Does What? Mapping Cloud Foundry Activities and Entitlements to IT Roles
 
Beaker: Automated, Cloud-Based Acceptance Testing - PuppetConf 2014
Beaker: Automated, Cloud-Based Acceptance Testing - PuppetConf 2014Beaker: Automated, Cloud-Based Acceptance Testing - PuppetConf 2014
Beaker: Automated, Cloud-Based Acceptance Testing - PuppetConf 2014
 
Production testing through monitoring
Production testing through monitoringProduction testing through monitoring
Production testing through monitoring
 
Developing Good Operations Tools
Developing Good Operations ToolsDeveloping Good Operations Tools
Developing Good Operations Tools
 
ELK: Moose-ively scaling your log system
ELK: Moose-ively scaling your log systemELK: Moose-ively scaling your log system
ELK: Moose-ively scaling your log system
 
BsidesMCR_2016-what-can-infosec-learn-from-devops
BsidesMCR_2016-what-can-infosec-learn-from-devopsBsidesMCR_2016-what-can-infosec-learn-from-devops
BsidesMCR_2016-what-can-infosec-learn-from-devops
 
Inspec, or how to translate compliance spreadsheets into code
Inspec, or how to translate compliance spreadsheets into codeInspec, or how to translate compliance spreadsheets into code
Inspec, or how to translate compliance spreadsheets into code
 
DevSecCon KeyNote London 2015
DevSecCon KeyNote London 2015DevSecCon KeyNote London 2015
DevSecCon KeyNote London 2015
 
Monitorama 2015 Netflix Instance Analysis
Monitorama 2015 Netflix Instance AnalysisMonitorama 2015 Netflix Instance Analysis
Monitorama 2015 Netflix Instance Analysis
 
Scaling Operations At Spotify
Scaling Operations At SpotifyScaling Operations At Spotify
Scaling Operations At Spotify
 
Linux Profiling at Netflix
Linux Profiling at NetflixLinux Profiling at Netflix
Linux Profiling at Netflix
 
Operational Software Design
Operational Software DesignOperational Software Design
Operational Software Design
 

Similar to The 3.5s Dash for Attention and Other Stuff We Found in RUM

Tying web performance data to human behavior
Tying web performance data to human behaviorTying web performance data to human behavior
Tying web performance data to human behavior
Buddy Brewer
 
Speed is Essential for a Great Web Experience
Speed is Essential for a Great Web ExperienceSpeed is Essential for a Great Web Experience
Speed is Essential for a Great Web Experience
Digicure ApS
 
Why Performance Matters
Why Performance MattersWhy Performance Matters
Why Performance Matters
Ben Daniel
 
Speed is Essential for a Great Web Experience (Canvas Conf Version)
Speed is Essential for a Great Web Experience (Canvas Conf Version)Speed is Essential for a Great Web Experience (Canvas Conf Version)
Speed is Essential for a Great Web Experience (Canvas Conf Version)
Andy Davies
 
Speed is Essential for a Great Web Experience (Digicure - Copenhagen)
Speed is Essential for a Great Web Experience (Digicure - Copenhagen)Speed is Essential for a Great Web Experience (Digicure - Copenhagen)
Speed is Essential for a Great Web Experience (Digicure - Copenhagen)
Andy Davies
 
Speed is Essential for a Great Web Experience
Speed is Essential for a Great Web ExperienceSpeed is Essential for a Great Web Experience
Speed is Essential for a Great Web Experience
Andy Davies
 
eCommerce performance, what is it costing you and what can you do about it?
eCommerce performance, what is it costing you and what can you do about it?eCommerce performance, what is it costing you and what can you do about it?
eCommerce performance, what is it costing you and what can you do about it?
Peter Holditch
 
Performance in business terms
Performance in business termsPerformance in business terms
Performance in business terms
Strangeloop
 
London Web Performance Meetup: Performance for mortal companies
London Web Performance Meetup: Performance for mortal companiesLondon Web Performance Meetup: Performance for mortal companies
London Web Performance Meetup: Performance for mortal companies
Strangeloop
 
StreamRoot Meetup WebRTC
StreamRoot Meetup WebRTCStreamRoot Meetup WebRTC
StreamRoot Meetup WebRTC
Pierre-Louis Théron
 
CS5229 09/10 Lecture 6: Simulation
CS5229 09/10 Lecture 6: SimulationCS5229 09/10 Lecture 6: Simulation
CS5229 09/10 Lecture 6: SimulationWei Tsang Ooi
 
Firefox 3.5 Overview
Firefox 3.5 OverviewFirefox 3.5 Overview
Firefox 3.5 Overview
Wichai Termwuttipreecha
 
Web Performance Automation - NY Web Performance Meetup
Web Performance Automation - NY Web Performance MeetupWeb Performance Automation - NY Web Performance Meetup
Web Performance Automation - NY Web Performance Meetup
Strangeloop
 
Cast a wider net
Cast a wider netCast a wider net
Cast a wider net
jlembeck
 
Flyweight jquery select_presentation
Flyweight jquery select_presentationFlyweight jquery select_presentation
Flyweight jquery select_presentation
Ray Brooks
 
eCommerce Performance: What is it costing you, and what can you do about it? ...
eCommerce Performance: What is it costing you, and what can you do about it? ...eCommerce Performance: What is it costing you, and what can you do about it? ...
eCommerce Performance: What is it costing you, and what can you do about it? ...Internet World
 
MW2010: Nate Solas, Hiding our Collections in Plain Site: Interface Strategie...
MW2010: Nate Solas, Hiding our Collections in Plain Site: Interface Strategie...MW2010: Nate Solas, Hiding our Collections in Plain Site: Interface Strategie...
MW2010: Nate Solas, Hiding our Collections in Plain Site: Interface Strategie...
museums and the web
 
Netflix Webkit-Based UI for TV Devices
Netflix Webkit-Based UI for TV DevicesNetflix Webkit-Based UI for TV Devices
Netflix Webkit-Based UI for TV Devices
Matt McCarthy
 
Visualizing Messages in Apache Kafka
Visualizing Messages in Apache KafkaVisualizing Messages in Apache Kafka
Visualizing Messages in Apache Kafka
confluent
 
Stop Stalling: Video Delivery Best Practices
Stop Stalling: Video Delivery Best PracticesStop Stalling: Video Delivery Best Practices
Stop Stalling: Video Delivery Best Practices
Doug Sillars
 

Similar to The 3.5s Dash for Attention and Other Stuff We Found in RUM (20)

Tying web performance data to human behavior
Tying web performance data to human behaviorTying web performance data to human behavior
Tying web performance data to human behavior
 
Speed is Essential for a Great Web Experience
Speed is Essential for a Great Web ExperienceSpeed is Essential for a Great Web Experience
Speed is Essential for a Great Web Experience
 
Why Performance Matters
Why Performance MattersWhy Performance Matters
Why Performance Matters
 
Speed is Essential for a Great Web Experience (Canvas Conf Version)
Speed is Essential for a Great Web Experience (Canvas Conf Version)Speed is Essential for a Great Web Experience (Canvas Conf Version)
Speed is Essential for a Great Web Experience (Canvas Conf Version)
 
Speed is Essential for a Great Web Experience (Digicure - Copenhagen)
Speed is Essential for a Great Web Experience (Digicure - Copenhagen)Speed is Essential for a Great Web Experience (Digicure - Copenhagen)
Speed is Essential for a Great Web Experience (Digicure - Copenhagen)
 
Speed is Essential for a Great Web Experience
Speed is Essential for a Great Web ExperienceSpeed is Essential for a Great Web Experience
Speed is Essential for a Great Web Experience
 
eCommerce performance, what is it costing you and what can you do about it?
eCommerce performance, what is it costing you and what can you do about it?eCommerce performance, what is it costing you and what can you do about it?
eCommerce performance, what is it costing you and what can you do about it?
 
Performance in business terms
Performance in business termsPerformance in business terms
Performance in business terms
 
London Web Performance Meetup: Performance for mortal companies
London Web Performance Meetup: Performance for mortal companiesLondon Web Performance Meetup: Performance for mortal companies
London Web Performance Meetup: Performance for mortal companies
 
StreamRoot Meetup WebRTC
StreamRoot Meetup WebRTCStreamRoot Meetup WebRTC
StreamRoot Meetup WebRTC
 
CS5229 09/10 Lecture 6: Simulation
CS5229 09/10 Lecture 6: SimulationCS5229 09/10 Lecture 6: Simulation
CS5229 09/10 Lecture 6: Simulation
 
Firefox 3.5 Overview
Firefox 3.5 OverviewFirefox 3.5 Overview
Firefox 3.5 Overview
 
Web Performance Automation - NY Web Performance Meetup
Web Performance Automation - NY Web Performance MeetupWeb Performance Automation - NY Web Performance Meetup
Web Performance Automation - NY Web Performance Meetup
 
Cast a wider net
Cast a wider netCast a wider net
Cast a wider net
 
Flyweight jquery select_presentation
Flyweight jquery select_presentationFlyweight jquery select_presentation
Flyweight jquery select_presentation
 
eCommerce Performance: What is it costing you, and what can you do about it? ...
eCommerce Performance: What is it costing you, and what can you do about it? ...eCommerce Performance: What is it costing you, and what can you do about it? ...
eCommerce Performance: What is it costing you, and what can you do about it? ...
 
MW2010: Nate Solas, Hiding our Collections in Plain Site: Interface Strategie...
MW2010: Nate Solas, Hiding our Collections in Plain Site: Interface Strategie...MW2010: Nate Solas, Hiding our Collections in Plain Site: Interface Strategie...
MW2010: Nate Solas, Hiding our Collections in Plain Site: Interface Strategie...
 
Netflix Webkit-Based UI for TV Devices
Netflix Webkit-Based UI for TV DevicesNetflix Webkit-Based UI for TV Devices
Netflix Webkit-Based UI for TV Devices
 
Visualizing Messages in Apache Kafka
Visualizing Messages in Apache KafkaVisualizing Messages in Apache Kafka
Visualizing Messages in Apache Kafka
 
Stop Stalling: Video Delivery Best Practices
Stop Stalling: Video Delivery Best PracticesStop Stalling: Video Delivery Best Practices
Stop Stalling: Video Delivery Best Practices
 

More from Buddy Brewer

Taking the Guesswork Out of Performance Budgets
Taking the Guesswork Out of Performance BudgetsTaking the Guesswork Out of Performance Budgets
Taking the Guesswork Out of Performance Budgets
Buddy Brewer
 
2015 02-19 eTail West Chairmans Remarks
2015 02-19 eTail West Chairmans Remarks2015 02-19 eTail West Chairmans Remarks
2015 02-19 eTail West Chairmans Remarks
Buddy Brewer
 
2014 11-18 rip onload
2014 11-18 rip onload2014 11-18 rip onload
2014 11-18 rip onload
Buddy Brewer
 
2014 06-25 velocity sc natives are getting restless
2014 06-25 velocity sc natives are getting restless2014 06-25 velocity sc natives are getting restless
2014 06-25 velocity sc natives are getting restlessBuddy Brewer
 
2014 06-23 velocity sc beyond page metrics
2014 06-23 velocity sc beyond page metrics2014 06-23 velocity sc beyond page metrics
2014 06-23 velocity sc beyond page metricsBuddy Brewer
 
RUM for Breakfast - distilling insights from the noise
RUM for Breakfast - distilling insights from the noiseRUM for Breakfast - distilling insights from the noise
RUM for Breakfast - distilling insights from the noise
Buddy Brewer
 
High Speed Web Sites At Scale
High Speed Web Sites At ScaleHigh Speed Web Sites At Scale
High Speed Web Sites At ScaleBuddy Brewer
 

More from Buddy Brewer (7)

Taking the Guesswork Out of Performance Budgets
Taking the Guesswork Out of Performance BudgetsTaking the Guesswork Out of Performance Budgets
Taking the Guesswork Out of Performance Budgets
 
2015 02-19 eTail West Chairmans Remarks
2015 02-19 eTail West Chairmans Remarks2015 02-19 eTail West Chairmans Remarks
2015 02-19 eTail West Chairmans Remarks
 
2014 11-18 rip onload
2014 11-18 rip onload2014 11-18 rip onload
2014 11-18 rip onload
 
2014 06-25 velocity sc natives are getting restless
2014 06-25 velocity sc natives are getting restless2014 06-25 velocity sc natives are getting restless
2014 06-25 velocity sc natives are getting restless
 
2014 06-23 velocity sc beyond page metrics
2014 06-23 velocity sc beyond page metrics2014 06-23 velocity sc beyond page metrics
2014 06-23 velocity sc beyond page metrics
 
RUM for Breakfast - distilling insights from the noise
RUM for Breakfast - distilling insights from the noiseRUM for Breakfast - distilling insights from the noise
RUM for Breakfast - distilling insights from the noise
 
High Speed Web Sites At Scale
High Speed Web Sites At ScaleHigh Speed Web Sites At Scale
High Speed Web Sites At Scale
 

The 3.5s Dash for Attention and Other Stuff We Found in RUM

  • 1. Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 1
  • 2. The 3.5s dash for attention and other stuff we found in RUM Buddy Brewer, Philip Tellis Velocity EU 2012 / 2012-10-03 Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 2
  • 3. Jean-Antoine Nollet Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 3
  • 4. Mr. Souders Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 4
  • 5. https://github.com/lognormal/boomerang/ Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 5
  • 6. Never underestimate the bandwidth of a mail horse Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 6
  • 7. World-wide bandwidth Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 7
  • 8. What do users expect? Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 8
  • 9. Gold or Bronze? Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 9
  • 10. What delighted users a few years ago is now an expected baseline, the absence of which will frustrate. Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 10
  • 11. Should you delight? Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 11
  • 12. Or frustrate? Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 12
  • 13. Delighting changes the baseline Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 13
  • 14. Delighting changes the baseline (Frustrating does too, but we don’t want to go there) Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 13
  • 15. So where’s the web today? Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 14
  • 16. Log-Normal Distribution Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 15
  • 17. Log-Normal Distribution The logarithm of the x-axis follows a Normal distribution Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 15
  • 18. Log-Normal Distribution Performance data does not always follow a "pure" Log-Normal distribution Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 16
  • 19. Look at the entire spread ... Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 17
  • 20. Look at the entire spread which often approaches an infinite width Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 17
  • 21. • 0.8% of hits are fake/abusive • 0.2-0.5% of hits are from a stale cache • 0.1% of hits are absurd • Timestamps in the future (or past depending on how you interpret it) • Bots ignore robots.txt across domains • "Interesting" caches/copies Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 18
  • 22. Even with beacons, you need to sanitize your input Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 19
  • 23. Once you get past the cruft, you can really measure users Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 20
  • 24. How does performance impact human behavior? Wednesday, October 3, 12
  • 25. 8 million pages 1.5 million visits 50 different dimensions Wednesday, October 3, 12
  • 26. very fast sessions had high bounce rates 70.00% 52.50% 35.00% 17.50% 0% 0 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 Wednesday, October 3, 12
  • 27. bounce rate vs. load time 70.00% 52.50% 35.00% 17.50% 0% 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 Wednesday, October 3, 12
  • 28. bounce rate vs. DOM interactive 70.00% 52.50% 35.00% 17.50% 0% 1 1.5 2 2.5 3 3.5 4 4.5 5 5.5 6 6.5 7 7.5 8 8.5 9 9.5 10 10.5 11 11.5 12 12.5 Wednesday, October 3, 12
  • 29. bounce rate vs. front end time 80.00% 60.00% 40.00% 20.00% 0% 0.5 2 3.5 5 6.5 8 9.5 11 12.5 14 15.5 17 18.5 20 21.5 23 24.5 26 27.5 29 Wednesday, October 3, 12
  • 30. is my web site performance toxic to my users? http://www.flickr.com/photos/21560098@N06/3796822070 Wednesday, October 3, 12
  • 31. LD50 - when do half the users bounce? http://www.flickr.com/photos/thecosmopolitan/6117530924 Wednesday, October 3, 12
  • 32. Bounce rate >=50% Back end time 1.7 sec DOM Loading 1.8 sec DOM Interactive 2.75 sec Front end time 3.5 sec DOM Complete 4.75 sec Load event 5.5 sec Wednesday, October 3, 12
  • 33. Browsers by Load Time 70.00% 52.50% 35.00% LD50 IE: 3.6 sec 17.50% Firefox: 5.6 sec Chrome: 6.5 sec 0% 1 1.4 1.8 2.2 2.6 3 3.4 3.8 4.2 4.6 5 5.4 5.8 6.2 6.6 7 7.4 7.8 8.2 8.6 9 9.4 9.8 10.2 10.6 11 11.4 11.8 12.2 12.6 13 13.4 13.8 14.2 14.6 15 IE Chrome Firefox Wednesday, October 3, 12
  • 34. Browsers by DOM Interactive 90.00% 67.50% 45.00% LD50 22.50% IE: 1.8 sec Firefox: 3.1 sec Chrome: 4.4 sec 0% 0.5 0.7 0.9 1.1 1.3 1.5 1.7 1.9 2.1 2.3 2.5 2.7 2.9 3.1 3.3 3.5 3.7 3.9 4.1 4.3 4.5 4.7 4.9 5.1 5.3 5.5 5.7 5.9 6.1 6.3 6.5 6.7 6.9 7.1 7.3 7.5 7.7 7.9 8.1 8.3 8.5 8.7 8.9 9.1 9.3 9.5 9.7 9.9 IE Chrome Firefox Wednesday, October 3, 12
  • 35. Countries by Load Time 90.00% 67.50% LD50 DE: ? sec 45.00% US: 5.0 sec GB: 11.5 sec CA: 13.5 sec AU: ? sec 22.50% 0% 1 1.5 2 2.5 3 3.5 4 4.5 5 5.5 6 6.5 7 7.5 8 8.5 9 9.5 10 10.5 11 11.5 12 12.5 13 13.5 14 14.5 15 US CA DE AU GB Wednesday, October 3, 12
  • 36. Available Bandwidth GB AU World Wednesday, October 3, 12
  • 37. Future directions What is the LD50 for your site? Other bounce rates? 40%? 30%? Other variables? (critical content visible, etc) Other behaviors? Conversions, revenue, pages per session, actions, when do people make tea? Wednesday, October 3, 12
  • 38. Questions? Buddy Brewer @bbrewer Philip Tellis @bluesmoon Wednesday, October 3, 12
  • 39. Credits • Usain Bolt – Sum_of_Mark on flickr • Douglas Mail Carrier – Svadilfari on flickr • Angel Delight – Auntie P on flickr • Frustrated – Kevin Lawver on flickr • Jean-Antoine Nollet – (Public Domain) Wikipedia • 100 metre dash – on NY Times Velocity EU 2012 / 2012-10-03 The 3.5s dash for attention and other stuff we found in RUM 21