Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Not my RUM: Benchmarking the web for fun and profit with the Chrome UX Report

1,239 views

Published on

Presented to the New York Web Performance Meetup Group on March 13, 2018

Published in: Internet
  • Be the first to comment

Not my RUM: Benchmarking the web for fun and profit with the Chrome UX Report

  1. 1. Not my RUM Benchmarking the web for fun and profit with the Chrome UX Report New York Web Performance Meetup Group March 13, 2018
  2. 2. 2 Oh, hello ● Developer Programs Engineer at Google ● Web transparency advocate ● Made YouTube fast ™ ● Cowrote Using WebPageTest Rick Viscomi @rick_viscomi
  3. 3. 3Competitive Analysis // OBJECTIVES: 1. Is my competitor faster than me? 2. Am I getting faster? 3. Profit.
  4. 4. 4bit.ly/2DksmNeSynthetic competitive analysis with WebPageTest
  5. 5. 5 “ QED Reddit is slower than Hacker News. ✨ Fin. ✨
  6. 6. 6webpagetest.org/video/WebPageTest visual comparison config
  7. 7. 7bit.ly/2HpH4oHPatrick Meenan, Creator of WebPageTest "One of the big issues with synthetic testing is that you are measuring exactly one configuration and it may or may not be representative of your users visiting your site."
  8. 8. 8bit.ly/2HpH4oHUsing RUM to Calibrate your Synthetic Testing
  9. 9. 9How do we calibrate a test of our competitor's site if we have no idea what their demographics are? ⚠ BUT WAIT ⚠ What about our competitor?
  10. 10. 10 Lab Field Mine Ours WebPageTest RUM Analytics Chrome UX ReportHTTP Archive
  11. 11. 11Personal Objectives // OBJECTIVES: 1. Is my competitor faster than me? 2. Am I getting faster? 3. Profit.
  12. 12. 12Public Objectives // OBJECTIVES: 1. Is my competitor faster than me? How fast is the web at large? 2. Am I getting faster? Is the web getting faster? 3. Profit.
  13. 13. 13Pictured: alphabet soup CrUX is RUM for the web
  14. 14. 14bit.ly/2p1QAHyCrUX announced at Chrome Developer Summit, October 2017
  15. 15. 15The CrUX Pipeline Analyze ● Raw data on BigQuery ● URL resolution on PageSpeed Insights ● Mobile Speed Scorecard ● HTTP Archive integration Aggregate ● Form factor ● Effective connection type ● Geography ● UX performance Anonymize ● Publicly indexable ● Origin rollup ● Unique user threshold ● Normalized to 100%
  16. 16. 16bit.ly/2p5fdDxFCP histogram generated by CrUX data
  17. 17. 17CrUX Cookbook: Recipes for a well-balanced data mining experience. LIVE DEMO github.com/rviscomi/crux-cookbook
  18. 18. 18bit.ly/2pawES2Querying for device/connection usage
  19. 19. 19bit.ly/2pawES2Hacker news is more popular on phone than desktop
  20. 20. 20bit.ly/2IpoqhKVisualizing Device and Connection Types
  21. 21. 21bit.ly/2p59a1CPageSpeed Insights speed data and optimization suggestions
  22. 22. 22bit.ly/2tKmMnIThink with Google: Mobile Speed Scorecard
  23. 23. 23bit.ly/2tKmMnIThink with Google: Revenue Impact Calculator
  24. 24. 24bit.ly/2DlCuoXHTTP Archive Beta
  25. 25. 25bit.ly/2HjmjdUMalte Ubl, TL of AMP "Objective metrics collected through public data sets like the Chrome User Experience Report can provide for objective performance and UX data independent of technology."
  26. 26. 26 ● 10 TB research grant (?!) bit.ly/crux-50 ● Contribute to the cookbook! github.com/rviscomi/crux-cookbook/ ● "The State of the Web" video series! ● Get help on Google Group or find me on Twitter! bit.ly/crux-group @rick_viscomi Additional Resources

×