Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
©2018 AKAMAI Real User Measurement Insights Paul Calvano Principal Web Performance Architect pacalvan@akamai.com @paulcalv...
©2018 AKAMAI Synthetic Real User (RUM)
©2018 AKAMAI3 ©2018 AKAMAI What Is Real User Measurement? ● Performance data collected from real users accessing your site...
4 ©2018 AKAMAI Implementing RUM Without Impacting Performance Source: https://gist.github.com/bluesmoon/351ea5b2815606863a...
©2018 AKAMAI
6 ©2018 AKAMAI What’s In an mPulse Beacon? ● Device and Browser Information ● Geographic Information ● Performance Timing ...
7 ©2018 AKAMAI Device Types
©2018 AKAMAI
©2018 AKAMAI
©2018 AKAMAI
©2018 AKAMAI 43% 51% 56% 80% Distribution of mobile traffic by country
©2018 AKAMAI Distribution of mobile traffic by country
©2018 AKAMAI Distribution of tablet traffic by country 8% 15% 1% 3% 10%
©2018 AKAMAI Source: https://meyerweb.com/eric/thoughts/2018/08/07/securing-sites-made-them-less- accessible/ Akamai mPuls...
©2018 AKAMAI
©2018 AKAMAI Time to Interactive https://calendar.perfplanet.com/2017/time-to-interactive-measuring-more-of-the-user-exper...
©2018 AKAMAI How mPulse Measures Time to Interactive: https://blogs.akamai.com/2018/04/perception-matters-measure-perceive...
©2018 AKAMAI
©2018 AKAMAI iPhone Device Identification Mozilla/5.0 (iPhone; CPU iPhone OS 11_4_1 like Mac OS X) AppleWebKit/605.1.15 (K...
©2018 AKAMAI
©2018 AKAMAI Identifying Android Model Numbers
©2018 AKAMAI Android Device Fragmentation: ~ 12,200 devices!
©2018 AKAMAI Long Tasks Per Android Device ● LongTasks API - implemented in Chrome browsers: ○ https://www.w3.org/TR/longt...
©2018 AKAMAI Comparing Two Popular Android Phones Source: https://www.sammobile.com
©2018 AKAMAI Galaxy J3 is Much Slower Compared to S7
©2018 AKAMAI Popular Devices per Geo ● iPhone: Most Popular ● Samsung Galaxy S8: ○ Most popular Android device in most but...
27 ©2018 AKAMAI Web Browsers
©2018 AKAMAI Browser Distributions
©2018 AKAMAI Analyzing Browser Performance - Firefox Quantum Source: https://developer.akamai.com/blog/2017/11/29/measurin...
©2018 AKAMAI Firefox: 7-10 Days to Reach 70% After Release Controlled Deployment Details https://wiki.mozilla.org/Balrog V...
©2018 AKAMAI Chrome: ~3 Weeks to Reach 85% After Release Controlled Deployment Details - https://chromium.googlesource.com...
©2018 AKAMAI Chrome 68 Update… v67 v68
©2018 AKAMAI Chrome 70 Distrusts Legacy Symantec Certificates v69 v70 https://security.googleblog.com/2018/03/distrust-of-...
©2018 AKAMAI Edge Accounts for Almost 40% of Microsoft Browser Traffic IE7 IE11 Edge 15 Edge 16 Edge 17 Edge 14
©2018 AKAMAI Weekly Fluctuations: Enterprise Users on IE11
©2018 AKAMAI 60% of Safari traffic is from version 12 v9 v10 v11 v12
©2018 AKAMAI iOS Safari - v12 is almost 70% v9 v10 v11 v12
©2018 AKAMAI v9 v10 v11 v12
©2018 AKAMAI 20% of Chrome Mobile Users Are One Year Behind Stable Samsung Browser uses Chromium v59 rendering engine - ht...
40 ©2018 AKAMAI Additional Insights
©2018 AKAMAI
©2018 AKAMAI
©2018 AKAMAI Outages = Sudden Drop of Real Users https://blogs.oracle.com/internetintelligence/power-failure-leaves-brazil...
©2018 AKAMAI Performance by US Mobile Network Based on US Traffic from mPulse, July 2018
©2018 AKAMAI Mobile Networks in GB Based on % Page Views from mPulse, October 2018
©2018 AKAMAI How’s that InFlight Wifi?
©2018 AKAMAI Performance by Battery Level Source: https://developer.akamai.com/blog/2018/05/29/does-androids-battery-saver...
©2018 AKAMAI Long Task Time Impacted by Battery Level Source: https://developer.akamai.com/blog/2018/05/29/does-androids-b...
©2018 AKAMAI Analyzing the Long Tail… Median - 3.7 seconds 75th Percentile - 7.7 seconds 95th Percentile - 27.7 seconds Lo...
©2018 AKAMAI Dissecting the Slowest 3% of Page Views in GB
©2018 AKAMAI What Did We Learn? ● Mobile now exceeds desktop, especially during weekends ● Tablet usage varies by Geo, but...
©2018 AKAMAI mPulse Lite = Free RUM Akamai Customers - Sign up via the Akamai MarketPlace Not Using Akamai? - Sign up for ...
©2018 AKAMAI Akamai - State of the Internet Reboot! ● Akamai State of the Internet Report originally published between 200...
54 ©2018 AKAMAI Q&A pacalvan@akamai.com @paulcalvano
Upcoming SlideShare
Loading in …5
×

Real User Measurement Insights, London WebPerf 2018-Nov-06

952 views

Published on

Many websites use real user measurement (RUM) data to analyze their performance, as well as to validate the impact of optimizations. During this session, we’ll discuss how RUM is used and then explore some of the fascinating insights into the web that we can learn from it.

Video: https://youtu.be/VOyEU9o1wL4

Published in: Internet
no profile picture user

  • Login to see the comments

Real User Measurement Insights, London WebPerf 2018-Nov-06

  1. 1. ©2018 AKAMAI Real User Measurement Insights Paul Calvano Principal Web Performance Architect pacalvan@akamai.com @paulcalvano
  2. 2. ©2018 AKAMAI Synthetic Real User (RUM)
  3. 3. ©2018 AKAMAI3 ©2018 AKAMAI What Is Real User Measurement? ● Performance data collected from real users accessing your site ● Uses web timing APIs to collect stats: ○ Navigation Timing ○ Resource Timing ○ Paint Timing ○ Server Timing
  4. 4. 4 ©2018 AKAMAI Implementing RUM Without Impacting Performance Source: https://gist.github.com/bluesmoon/351ea5b2815606863a2de2c4889e8016/ https://calendar.perfplanet.com/2017/an-audit-of-boomerangs-performance/
  5. 5. ©2018 AKAMAI
  6. 6. 6 ©2018 AKAMAI What’s In an mPulse Beacon? ● Device and Browser Information ● Geographic Information ● Performance Timing Information ● Feature Flags ● Custom Metrics and Timers Source: https://developer.akamai.com/mpulse/whats-in-a-beacon
  7. 7. 7 ©2018 AKAMAI Device Types
  8. 8. ©2018 AKAMAI
  9. 9. ©2018 AKAMAI
  10. 10. ©2018 AKAMAI
  11. 11. ©2018 AKAMAI 43% 51% 56% 80% Distribution of mobile traffic by country
  12. 12. ©2018 AKAMAI Distribution of mobile traffic by country
  13. 13. ©2018 AKAMAI Distribution of tablet traffic by country 8% 15% 1% 3% 10%
  14. 14. ©2018 AKAMAI Source: https://meyerweb.com/eric/thoughts/2018/08/07/securing-sites-made-them-less- accessible/ Akamai mPulse data from August 7th, 2018 Median: US: 3.7 seconds UG: 7.8 seconds 75th Percentile: US: 6.5 seconds UG: 25.4 seconds 95th Percentile: US: 20 seconds UG: 98 seconds
  15. 15. ©2018 AKAMAI
  16. 16. ©2018 AKAMAI Time to Interactive https://calendar.perfplanet.com/2017/time-to-interactive-measuring-more-of-the-user-experience/ https://developer.akamai.com/blog/2017/04/12/gauge-user-experience-time-interactive/
  17. 17. ©2018 AKAMAI How mPulse Measures Time to Interactive: https://blogs.akamai.com/2018/04/perception-matters-measure-perceived- performance.html
  18. 18. ©2018 AKAMAI
  19. 19. ©2018 AKAMAI iPhone Device Identification Mozilla/5.0 (iPhone; CPU iPhone OS 11_4_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15G77 https://www.paintcodeapp.com/news/ultimate-guide-to-iphone-resolutions
  20. 20. ©2018 AKAMAI
  21. 21. ©2018 AKAMAI Identifying Android Model Numbers
  22. 22. ©2018 AKAMAI Android Device Fragmentation: ~ 12,200 devices!
  23. 23. ©2018 AKAMAI Long Tasks Per Android Device ● LongTasks API - implemented in Chrome browsers: ○ https://www.w3.org/TR/longtasks/ ● Whenever a task takes longer than 50ms it is considered a long task. ● mPulse is collecting the total durations of all long tasks during a page load.
  24. 24. ©2018 AKAMAI Comparing Two Popular Android Phones Source: https://www.sammobile.com
  25. 25. ©2018 AKAMAI Galaxy J3 is Much Slower Compared to S7
  26. 26. ©2018 AKAMAI Popular Devices per Geo ● iPhone: Most Popular ● Samsung Galaxy S8: ○ Most popular Android device in most but not all countries. ● Other Popular Phones ○ Redmi Note 4 in India and Russia ○ Huawei in Italy ○ Xperia in Japan ● Device Fragmentation is global ○ Most popular Android phones account for 2-6% of traffic
  27. 27. 27 ©2018 AKAMAI Web Browsers
  28. 28. ©2018 AKAMAI Browser Distributions
  29. 29. ©2018 AKAMAI Analyzing Browser Performance - Firefox Quantum Source: https://developer.akamai.com/blog/2017/11/29/measuring-performance-firefox-quantum-rum/
  30. 30. ©2018 AKAMAI Firefox: 7-10 Days to Reach 70% After Release Controlled Deployment Details https://wiki.mozilla.org/Balrog V54 v55 v56 v57 v58 v59 v60 v61 v62 v63 v52 v45
  31. 31. ©2018 AKAMAI Chrome: ~3 Weeks to Reach 85% After Release Controlled Deployment Details - https://chromium.googlesource.com/chromium/src/+/lkcr/docs/process/release_cycle.md#stable-release v59 v60 v61 v62 v63 v64 v65 v66 v67 v68 v69 v70 v49
  32. 32. ©2018 AKAMAI Chrome 68 Update… v67 v68
  33. 33. ©2018 AKAMAI Chrome 70 Distrusts Legacy Symantec Certificates v69 v70 https://security.googleblog.com/2018/03/distrust-of-symantec-pki-immediate.html
  34. 34. ©2018 AKAMAI Edge Accounts for Almost 40% of Microsoft Browser Traffic IE7 IE11 Edge 15 Edge 16 Edge 17 Edge 14
  35. 35. ©2018 AKAMAI Weekly Fluctuations: Enterprise Users on IE11
  36. 36. ©2018 AKAMAI 60% of Safari traffic is from version 12 v9 v10 v11 v12
  37. 37. ©2018 AKAMAI iOS Safari - v12 is almost 70% v9 v10 v11 v12
  38. 38. ©2018 AKAMAI v9 v10 v11 v12
  39. 39. ©2018 AKAMAI 20% of Chrome Mobile Users Are One Year Behind Stable Samsung Browser uses Chromium v59 rendering engine - https://developer.samsung.com/internet v59 v60 v61 v62 v63 v64 v65 v66 v67 v68 v69 v70 V51 v56 v59
  40. 40. 40 ©2018 AKAMAI Additional Insights
  41. 41. ©2018 AKAMAI
  42. 42. ©2018 AKAMAI
  43. 43. ©2018 AKAMAI Outages = Sudden Drop of Real Users https://blogs.oracle.com/internetintelligence/power-failure-leaves-brazilian-internet-in-the-dark
  44. 44. ©2018 AKAMAI Performance by US Mobile Network Based on US Traffic from mPulse, July 2018
  45. 45. ©2018 AKAMAI Mobile Networks in GB Based on % Page Views from mPulse, October 2018
  46. 46. ©2018 AKAMAI How’s that InFlight Wifi?
  47. 47. ©2018 AKAMAI Performance by Battery Level Source: https://developer.akamai.com/blog/2018/05/29/does-androids-battery-saver-degrade-the-mobile-web-experience/
  48. 48. ©2018 AKAMAI Long Task Time Impacted by Battery Level Source: https://developer.akamai.com/blog/2018/05/29/does-androids-battery-saver-degrade-the-mobile-web-experience/
  49. 49. ©2018 AKAMAI Analyzing the Long Tail… Median - 3.7 seconds 75th Percentile - 7.7 seconds 95th Percentile - 27.7 seconds Loooooooooooooooooong Tail! (3% = 10s of millions of pages)
  50. 50. ©2018 AKAMAI Dissecting the Slowest 3% of Page Views in GB
  51. 51. ©2018 AKAMAI What Did We Learn? ● Mobile now exceeds desktop, especially during weekends ● Tablet usage varies by Geo, but is consistently slower than desktop and mobile ● Android Device Fragmentation continues to be a very large performance problem ● Most browsers are carefully deployed to users in a multi-stage process ● Safari, Edge and IE browsers are closely aligned to OS Upgrades ● The performance impact of new browser features are limited by end-user upgrades ● Battery life may impact your performance ● Analyze the long tail of your performance and you may be surprised what you find!
  52. 52. ©2018 AKAMAI mPulse Lite = Free RUM Akamai Customers - Sign up via the Akamai MarketPlace Not Using Akamai? - Sign up for free at http://www.akamai.com/trympulse
  53. 53. ©2018 AKAMAI Akamai - State of the Internet Reboot! ● Akamai State of the Internet Report originally published between 2008 - 2017 ● Currently on hiatus, but coming back soon! ● Will include mPulse stats and trends ● We’re open to suggestions on what you would like to see included! ○ stateoftheinternet@akamai.com ○ pacalvan@akamai.com
  54. 54. 54 ©2018 AKAMAI Q&A pacalvan@akamai.com @paulcalvano

×