Presented to the New York Web Performance Meetup Group on March 13, 2018

1. Not my RUM
Benchmarking the web for fun and
profit with the Chrome UX Report
New York Web Performance Meetup Group
March 13, 2018

2. 2
Oh, hello
● Developer Programs Engineer at Google
● Web transparency advocate
● Made YouTube fast ™
● Cowrote Using WebPageTest
Rick Viscomi
@rick_viscomi

3. 3Competitive Analysis
// OBJECTIVES:
1. Is my competitor faster than me?
2. Am I getting faster?
3. Profit.

4. 4bit.ly/2DksmNeSynthetic competitive analysis with WebPageTest

5. 5
“
QED
Reddit is slower than
Hacker News.
✨ Fin. ✨

6. 6webpagetest.org/video/WebPageTest visual comparison config

7. 7bit.ly/2HpH4oHPatrick Meenan, Creator of WebPageTest
"One of the big issues with synthetic testing is that you are
measuring exactly one configuration and it may or
may not be representative of your users visiting your site."

8. 8bit.ly/2HpH4oHUsing RUM to Calibrate your Synthetic Testing

9. 9How do we calibrate a test of our competitor's site if we have no idea what their demographics are?
⚠ BUT WAIT ⚠
What about
our competitor?

10. 10
Lab Field
Mine
Ours
WebPageTest RUM Analytics
Chrome UX ReportHTTP Archive

11. 11Personal Objectives
// OBJECTIVES:
1. Is my competitor faster than me?
2. Am I getting faster?
3. Profit.

12. 12Public Objectives
// OBJECTIVES:
1. Is my competitor faster than me?
How fast is the web at large?
2. Am I getting faster?
Is the web getting faster?
3. Profit.

13. 13Pictured: alphabet soup
CrUX is RUM for the web

14. 14bit.ly/2p1QAHyCrUX announced at Chrome Developer Summit, October 2017

15. 15The CrUX Pipeline
Analyze
● Raw data on BigQuery
● URL resolution on
PageSpeed Insights
● Mobile Speed
Scorecard
● HTTP Archive
integration
Aggregate
● Form factor
● Effective connection type
● Geography
● UX performance
Anonymize
● Publicly indexable
● Origin rollup
● Unique user threshold
● Normalized to 100%

16. 16bit.ly/2p5fdDxFCP histogram generated by CrUX data

17. 17CrUX Cookbook: Recipes for a well-balanced data mining experience.
LIVE DEMO
github.com/rviscomi/crux-cookbook

18. 18bit.ly/2pawES2Querying for device/connection usage

19. 19bit.ly/2pawES2Hacker news is more popular on phone than desktop

20. 20bit.ly/2IpoqhKVisualizing Device and Connection Types

21. 21bit.ly/2p59a1CPageSpeed Insights speed data and optimization suggestions

22. 22bit.ly/2tKmMnIThink with Google: Mobile Speed Scorecard

23. 23bit.ly/2tKmMnIThink with Google: Revenue Impact Calculator

24. 24bit.ly/2DlCuoXHTTP Archive Beta

25. 25bit.ly/2HjmjdUMalte Ubl, TL of AMP
"Objective metrics
collected through
public data sets like the
Chrome User
Experience Report
can provide for
objective performance
and UX data
independent of
technology."

26. 26
● 10 TB research grant (?!)
bit.ly/crux-50
● Contribute to the cookbook!
github.com/rviscomi/crux-cookbook/
● "The State of the Web" video series!
● Get help on Google Group or find me on Twitter!
bit.ly/crux-group @rick_viscomi
Additional Resources