Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
©2018 AKAMAI
Real User
Measurement
Insights
Paul Calvano
Principal Web Performance Architect
pacalvan@akamai.com
@paulcalv...
©2018 AKAMAI
Synthetic
Real User (RUM)
©2018 AKAMAI3 ©2018 AKAMAI
What Is Real User Measurement?
● Performance data
collected from real
users accessing
your site...
4 ©2018 AKAMAI
Implementing RUM Without Impacting Performance
Source: https://gist.github.com/bluesmoon/351ea5b2815606863a...
©2018 AKAMAI
6 ©2018 AKAMAI
What’s In an mPulse Beacon?
● Device and Browser Information
● Geographic Information
● Performance Timing ...
7 ©2018 AKAMAI
Device Types
©2018 AKAMAI
©2018 AKAMAI
©2018 AKAMAI
©2018 AKAMAI
43%
51%
56%
80%
Distribution of mobile traffic by country
©2018 AKAMAI
Distribution of mobile traffic by country
©2018 AKAMAI
Distribution of tablet traffic by country
8%
15%
1%
3%
10%
©2018 AKAMAI
Source: https://meyerweb.com/eric/thoughts/2018/08/07/securing-sites-made-them-less-
accessible/
Akamai mPuls...
©2018 AKAMAI
©2018 AKAMAI
Time to Interactive
https://calendar.perfplanet.com/2017/time-to-interactive-measuring-more-of-the-user-exper...
©2018 AKAMAI
How mPulse Measures Time to Interactive: https://blogs.akamai.com/2018/04/perception-matters-measure-perceive...
©2018 AKAMAI
©2018 AKAMAI
iPhone Device Identification
Mozilla/5.0 (iPhone; CPU iPhone OS 11_4_1 like Mac OS X)
AppleWebKit/605.1.15 (K...
©2018 AKAMAI
©2018 AKAMAI
Identifying Android Model Numbers
©2018 AKAMAI
Android Device Fragmentation: ~ 12,200 devices!
©2018 AKAMAI
Long Tasks Per Android Device
● LongTasks API - implemented in
Chrome browsers:
○ https://www.w3.org/TR/longt...
©2018 AKAMAI
Comparing Two Popular Android Phones
Source: https://www.sammobile.com
©2018 AKAMAI
Galaxy J3 is Much Slower Compared to S7
©2018 AKAMAI
Popular Devices per Geo
● iPhone: Most Popular
● Samsung Galaxy S8:
○ Most popular Android device
in most but...
27 ©2018 AKAMAI
Web Browsers
©2018 AKAMAI
Browser Distributions
©2018 AKAMAI
Analyzing Browser Performance - Firefox Quantum
Source: https://developer.akamai.com/blog/2017/11/29/measurin...
©2018 AKAMAI
Firefox: 7-10 Days to Reach 70% After Release
Controlled Deployment Details https://wiki.mozilla.org/Balrog
V...
©2018 AKAMAI
Chrome: ~3 Weeks to Reach 85% After Release
Controlled Deployment Details - https://chromium.googlesource.com...
©2018 AKAMAI
Chrome 68 Update…
v67
v68
©2018 AKAMAI
Chrome 70 Distrusts Legacy Symantec Certificates
v69
v70
https://security.googleblog.com/2018/03/distrust-of-...
©2018 AKAMAI
Edge Accounts for Almost 40% of Microsoft Browser Traffic
IE7
IE11
Edge 15 Edge 16 Edge 17
Edge 14
©2018 AKAMAI
Weekly Fluctuations: Enterprise Users on IE11
©2018 AKAMAI
60% of Safari traffic is from version 12
v9
v10 v11 v12
©2018 AKAMAI
iOS Safari - v12 is almost 70%
v9
v10 v11 v12
©2018 AKAMAI
v9
v10
v11 v12
©2018 AKAMAI
20% of Chrome Mobile Users Are One Year Behind Stable
Samsung Browser uses Chromium v59 rendering engine - ht...
40 ©2018 AKAMAI
Additional Insights
©2018 AKAMAI
©2018 AKAMAI
©2018 AKAMAI
Outages = Sudden Drop of Real Users
https://blogs.oracle.com/internetintelligence/power-failure-leaves-brazil...
©2018 AKAMAI
Performance by US Mobile Network
Based on US Traffic from mPulse, July 2018
©2018 AKAMAI
Mobile Networks in GB
Based on % Page Views from mPulse, October 2018
©2018 AKAMAI
How’s that InFlight Wifi?
©2018 AKAMAI
Performance by Battery Level
Source: https://developer.akamai.com/blog/2018/05/29/does-androids-battery-saver...
©2018 AKAMAI
Long Task Time Impacted by Battery Level
Source: https://developer.akamai.com/blog/2018/05/29/does-androids-b...
©2018 AKAMAI
Analyzing the Long Tail…
Median - 3.7 seconds
75th Percentile - 7.7 seconds
95th Percentile - 27.7 seconds
Lo...
©2018 AKAMAI
Dissecting the Slowest 3% of Page Views in GB
©2018 AKAMAI
What Did We Learn?
● Mobile now exceeds desktop, especially during weekends
● Tablet usage varies by Geo, but...
©2018 AKAMAI
mPulse Lite = Free RUM
Akamai Customers - Sign up via the Akamai MarketPlace
Not Using Akamai? - Sign up for ...
©2018 AKAMAI
Akamai - State of the Internet Reboot!
● Akamai State of the Internet Report
originally published between 200...
54 ©2018 AKAMAI
Q&A
pacalvan@akamai.com
@paulcalvano
Upcoming SlideShare
Loading in …5
×

of

Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 1 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 2 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 3 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 4 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 5 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 6 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 7 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 8 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 9 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 10 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 11 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 12 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 13 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 14 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 15 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 16 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 17 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 18 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 19 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 20 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 21 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 22 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 23 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 24 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 25 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 26 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 27 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 28 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 29 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 30 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 31 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 32 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 33 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 34 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 35 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 36 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 37 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 38 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 39 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 40 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 41 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 42 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 43 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 44 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 45 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 46 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 47 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 48 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 49 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 50 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 51 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 52 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 53 Real User Measurement Insights, London WebPerf 2018-Nov-06 Slide 54
Upcoming SlideShare
What to Upload to SlideShare
Next
Download to read offline and view in fullscreen.

3 Likes

Share

Download to read offline

Real User Measurement Insights, London WebPerf 2018-Nov-06

Download to read offline

Many websites use real user measurement (RUM) data to analyze their performance, as well as to validate the impact of optimizations. During this session, we’ll discuss how RUM is used and then explore some of the fascinating insights into the web that we can learn from it.

Video: https://youtu.be/VOyEU9o1wL4

Related Books

Free with a 30 day trial from Scribd

See all

Related Audiobooks

Free with a 30 day trial from Scribd

See all

Real User Measurement Insights, London WebPerf 2018-Nov-06

  1. 1. ©2018 AKAMAI Real User Measurement Insights Paul Calvano Principal Web Performance Architect pacalvan@akamai.com @paulcalvano
  2. 2. ©2018 AKAMAI Synthetic Real User (RUM)
  3. 3. ©2018 AKAMAI3 ©2018 AKAMAI What Is Real User Measurement? ● Performance data collected from real users accessing your site ● Uses web timing APIs to collect stats: ○ Navigation Timing ○ Resource Timing ○ Paint Timing ○ Server Timing
  4. 4. 4 ©2018 AKAMAI Implementing RUM Without Impacting Performance Source: https://gist.github.com/bluesmoon/351ea5b2815606863a2de2c4889e8016/ https://calendar.perfplanet.com/2017/an-audit-of-boomerangs-performance/
  5. 5. ©2018 AKAMAI
  6. 6. 6 ©2018 AKAMAI What’s In an mPulse Beacon? ● Device and Browser Information ● Geographic Information ● Performance Timing Information ● Feature Flags ● Custom Metrics and Timers Source: https://developer.akamai.com/mpulse/whats-in-a-beacon
  7. 7. 7 ©2018 AKAMAI Device Types
  8. 8. ©2018 AKAMAI
  9. 9. ©2018 AKAMAI
  10. 10. ©2018 AKAMAI
  11. 11. ©2018 AKAMAI 43% 51% 56% 80% Distribution of mobile traffic by country
  12. 12. ©2018 AKAMAI Distribution of mobile traffic by country
  13. 13. ©2018 AKAMAI Distribution of tablet traffic by country 8% 15% 1% 3% 10%
  14. 14. ©2018 AKAMAI Source: https://meyerweb.com/eric/thoughts/2018/08/07/securing-sites-made-them-less- accessible/ Akamai mPulse data from August 7th, 2018 Median: US: 3.7 seconds UG: 7.8 seconds 75th Percentile: US: 6.5 seconds UG: 25.4 seconds 95th Percentile: US: 20 seconds UG: 98 seconds
  15. 15. ©2018 AKAMAI
  16. 16. ©2018 AKAMAI Time to Interactive https://calendar.perfplanet.com/2017/time-to-interactive-measuring-more-of-the-user-experience/ https://developer.akamai.com/blog/2017/04/12/gauge-user-experience-time-interactive/
  17. 17. ©2018 AKAMAI How mPulse Measures Time to Interactive: https://blogs.akamai.com/2018/04/perception-matters-measure-perceived- performance.html
  18. 18. ©2018 AKAMAI
  19. 19. ©2018 AKAMAI iPhone Device Identification Mozilla/5.0 (iPhone; CPU iPhone OS 11_4_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15G77 https://www.paintcodeapp.com/news/ultimate-guide-to-iphone-resolutions
  20. 20. ©2018 AKAMAI
  21. 21. ©2018 AKAMAI Identifying Android Model Numbers
  22. 22. ©2018 AKAMAI Android Device Fragmentation: ~ 12,200 devices!
  23. 23. ©2018 AKAMAI Long Tasks Per Android Device ● LongTasks API - implemented in Chrome browsers: ○ https://www.w3.org/TR/longtasks/ ● Whenever a task takes longer than 50ms it is considered a long task. ● mPulse is collecting the total durations of all long tasks during a page load.
  24. 24. ©2018 AKAMAI Comparing Two Popular Android Phones Source: https://www.sammobile.com
  25. 25. ©2018 AKAMAI Galaxy J3 is Much Slower Compared to S7
  26. 26. ©2018 AKAMAI Popular Devices per Geo ● iPhone: Most Popular ● Samsung Galaxy S8: ○ Most popular Android device in most but not all countries. ● Other Popular Phones ○ Redmi Note 4 in India and Russia ○ Huawei in Italy ○ Xperia in Japan ● Device Fragmentation is global ○ Most popular Android phones account for 2-6% of traffic
  27. 27. 27 ©2018 AKAMAI Web Browsers
  28. 28. ©2018 AKAMAI Browser Distributions
  29. 29. ©2018 AKAMAI Analyzing Browser Performance - Firefox Quantum Source: https://developer.akamai.com/blog/2017/11/29/measuring-performance-firefox-quantum-rum/
  30. 30. ©2018 AKAMAI Firefox: 7-10 Days to Reach 70% After Release Controlled Deployment Details https://wiki.mozilla.org/Balrog V54 v55 v56 v57 v58 v59 v60 v61 v62 v63 v52 v45
  31. 31. ©2018 AKAMAI Chrome: ~3 Weeks to Reach 85% After Release Controlled Deployment Details - https://chromium.googlesource.com/chromium/src/+/lkcr/docs/process/release_cycle.md#stable-release v59 v60 v61 v62 v63 v64 v65 v66 v67 v68 v69 v70 v49
  32. 32. ©2018 AKAMAI Chrome 68 Update… v67 v68
  33. 33. ©2018 AKAMAI Chrome 70 Distrusts Legacy Symantec Certificates v69 v70 https://security.googleblog.com/2018/03/distrust-of-symantec-pki-immediate.html
  34. 34. ©2018 AKAMAI Edge Accounts for Almost 40% of Microsoft Browser Traffic IE7 IE11 Edge 15 Edge 16 Edge 17 Edge 14
  35. 35. ©2018 AKAMAI Weekly Fluctuations: Enterprise Users on IE11
  36. 36. ©2018 AKAMAI 60% of Safari traffic is from version 12 v9 v10 v11 v12
  37. 37. ©2018 AKAMAI iOS Safari - v12 is almost 70% v9 v10 v11 v12
  38. 38. ©2018 AKAMAI v9 v10 v11 v12
  39. 39. ©2018 AKAMAI 20% of Chrome Mobile Users Are One Year Behind Stable Samsung Browser uses Chromium v59 rendering engine - https://developer.samsung.com/internet v59 v60 v61 v62 v63 v64 v65 v66 v67 v68 v69 v70 V51 v56 v59
  40. 40. 40 ©2018 AKAMAI Additional Insights
  41. 41. ©2018 AKAMAI
  42. 42. ©2018 AKAMAI
  43. 43. ©2018 AKAMAI Outages = Sudden Drop of Real Users https://blogs.oracle.com/internetintelligence/power-failure-leaves-brazilian-internet-in-the-dark
  44. 44. ©2018 AKAMAI Performance by US Mobile Network Based on US Traffic from mPulse, July 2018
  45. 45. ©2018 AKAMAI Mobile Networks in GB Based on % Page Views from mPulse, October 2018
  46. 46. ©2018 AKAMAI How’s that InFlight Wifi?
  47. 47. ©2018 AKAMAI Performance by Battery Level Source: https://developer.akamai.com/blog/2018/05/29/does-androids-battery-saver-degrade-the-mobile-web-experience/
  48. 48. ©2018 AKAMAI Long Task Time Impacted by Battery Level Source: https://developer.akamai.com/blog/2018/05/29/does-androids-battery-saver-degrade-the-mobile-web-experience/
  49. 49. ©2018 AKAMAI Analyzing the Long Tail… Median - 3.7 seconds 75th Percentile - 7.7 seconds 95th Percentile - 27.7 seconds Loooooooooooooooooong Tail! (3% = 10s of millions of pages)
  50. 50. ©2018 AKAMAI Dissecting the Slowest 3% of Page Views in GB
  51. 51. ©2018 AKAMAI What Did We Learn? ● Mobile now exceeds desktop, especially during weekends ● Tablet usage varies by Geo, but is consistently slower than desktop and mobile ● Android Device Fragmentation continues to be a very large performance problem ● Most browsers are carefully deployed to users in a multi-stage process ● Safari, Edge and IE browsers are closely aligned to OS Upgrades ● The performance impact of new browser features are limited by end-user upgrades ● Battery life may impact your performance ● Analyze the long tail of your performance and you may be surprised what you find!
  52. 52. ©2018 AKAMAI mPulse Lite = Free RUM Akamai Customers - Sign up via the Akamai MarketPlace Not Using Akamai? - Sign up for free at http://www.akamai.com/trympulse
  53. 53. ©2018 AKAMAI Akamai - State of the Internet Reboot! ● Akamai State of the Internet Report originally published between 2008 - 2017 ● Currently on hiatus, but coming back soon! ● Will include mPulse stats and trends ● We’re open to suggestions on what you would like to see included! ○ stateoftheinternet@akamai.com ○ pacalvan@akamai.com
  54. 54. 54 ©2018 AKAMAI Q&A pacalvan@akamai.com @paulcalvano
  • HenriHelvetica

    Dec. 1, 2019
  • vvagodny

    Dec. 7, 2018
  • StefanSteurenthaler

    Nov. 9, 2018

Many websites use real user measurement (RUM) data to analyze their performance, as well as to validate the impact of optimizations. During this session, we’ll discuss how RUM is used and then explore some of the fascinating insights into the web that we can learn from it. Video: https://youtu.be/VOyEU9o1wL4

Views

Total views

1,293

On Slideshare

0

From embeds

0

Number of embeds

453

Actions

Downloads

7

Shares

0

Comments

0

Likes

3

×