Downloaded 16 times
Uploaded bySergeyChernyshev
What we can learn from CDNs about Web Development, Deployment, and Performance
The document by Hooman Behesh discusses key lessons learned from working at a CDN company regarding web development, deployment, and performance. It highlights issues such as caching inefficiencies, configuration challenges, the use of dynamic content, and the importance of measurement in CDN performance. The document emphasizes the need for better integration, programmability, and real-time control over content to enhance web performance and user experience.
More Related Content
Similar to What we can learn from CDNs about Web Development, Deployment, and Performance
![Caching the Uncacheable [Long Version]](https://cdn.slidesharecdn.com/ss_thumbnails/surge2014-cachingtheuncacheable-140929110542-phpapp01-thumbnail.jpg?width=640&height=640&fit=bounds)
![Vibe Coding vs. Spec-Driven Development [Free Meetup]](https://cdn.slidesharecdn.com/ss_thumbnails/vibecodingvsspecdrivendevelopment-251209105622-43f455e7-thumbnail.jpg?width=640&height=640&fit=bounds)
![Coded Agents – with UiPath SDK + LangGraph [Virtual Hands-on Workshop]](https://cdn.slidesharecdn.com/ss_thumbnails/codedagentsdeck-251215155422-5497c599-thumbnail.jpg?width=640&height=640&fit=bounds)
What we can learn from CDNs about Web Development, Deployment, and Performance
- 1. What we can learn from CDNs about Web Development, Deployment, and Performance Hooman Behesh+, VP Technology WebPerf Meetup, NYC, May 13, 2014
- 2. Who am I? • Early Load Balancing Vendors – Radware – Crescendo Networks • Front End Op+miza+on – Strangeloop Networks • Off the grid for a year! • Joined Fastly 6 weeks ago
- 3.
- 4. What I’ve Learned From Working at a CDN Company for 6 Weeks!!
- 5. Lesson: CDNs Are Not Solved!
- 6. We Don’t Cache As Much As We Should! • HTML and other dynamic content • Worse cache hit rate than we think – Especially for long tail content • Mobile Apps, APIs, etc
- 7. Making Changes SUCKS!! • Configura+on changes take way too long – People are used to making changes real-‐+me – CDNs aren’t classically good at this – Phone?? • Purging is a real problem – Slow – Difficult – Not granular enough
- 8. Lots of Room • New Demands from Customers • Plenty of room for differen+a+on • Can’t take some things for granted: – DNS – Rou+ng – TCP – SCALE! • Plus: lots of room to be crea+ve at the edge!
- 9. Lesson: There’s More to the Web Than the Web!
- 10. Non “web” Traffic • Video – HLS (HTTP Live Streaming) – HTTP-‐based small video chunks – Unique by URL • APIs – Instant purging can let API calls be cacheable – Another example of dynamic content cached at the edge • Mobile Apps
- 11. Lesson: People Use Their CDNs Wrong
- 12. CDNs offer a toolset • The black box approach isn’t always good • Configura+on isn’t trivial – And a lot s+ll depends on configura+on • Can’t depend on the CDN to solve all your problems • Don’t exacerbate your problems!
- 13.
- 14. Gzipping Images • Not a very good thing for performance – Extra bytes – Extra work for the browser • But was this the Surrogate’s fault?
- 15. More Examples • Bad caching headers – max-‐age, s-‐maxage have a lot of power! • Bad TCP connec+on management at origin • Not Gzipping (actual, compressible content) for origin fetches
- 16.
- 17. Lesson: Dynamic Content Is Really InteresVng!
- 18. What Is Dynamic Content? • Stuff that’s not sta+c! • With web traffic, generally the base HTML – Big deal because it’s blocking – And some+mes the largest object; longer download • Some AJAX • More…
- 20.
- 23. Classically, with dynamic content… Caching
- 24. Caching vs. InvalidaVon
- 28.
- 29. Dynamic Content Caching Problems • Serving stale pages – Lack of good invalida+on framework • Visibility • Logging
- 30. CDNs and Dynamic Content • Generally, handling dynamic content has been a maber of transport – Middle mile op+miza+ons – TCP tweaks • Some edge micro caching, but not easy • ESI
- 31. Actually… • Dynamic content is more cacheable than we think • Sta+c for short periods of +me • Unpredictable invalida+on – Standard HTTP caching rules aren’t good enough
- 32. So Many Benefits! • Performance – Faster +me to first byte – Faster start render – Happy users! • Offload – Less work for our servers – Less bandwidth at origin
- 33. What Would Make It BeZer? • Programma+c Invalida+on – Granular – Instantaneous • Control at the edge, and not just for web pages – Real-‐+me log files – Imagine termina+ng beacons at the edge!
- 34. Lesson: IntegraVng is Awesome!
- 35. The Influence of Clouds • DevOps people like programmability and integra+on • The CDN is no longer a black box mechanism, necessarily • Cliché Alert: Content as a Service!
- 36. Real Time IntegraVon • Tap in to the CDN: – Instantaneous configura+on changes – Instantaneous cache purge and invalida+on – Real +me stats and logs • Infrastructure as code – Expect extensive APIs – Apps need to naturally extend to the CDN – Your content => you need control
- 37.
- 38. Lesson: Measurement is SVll Hard
- 39. “SVll” • In the world of FEO – Webpagetest.org – RUM – Synthe+c tes+ng vendors • In the world of CDNs – Same as far as client performance goes – Some new things…
- 40. Client-‐side Measurement in CDNs • Cache hit ra+o – How do you test and measure? • Long tail content? • DNS and edge node selec+on • TTFB out of datacenter – Memory hit vs disk hit vs mid-‐+er hit vs miss • RUM and synthe+c (Cedexis, Catchpoint, etc) • There’s s+ll gaming going on!
- 41. Let’s Test It! • 3 Objects on the same CDN (anonymous) – Cedexis object – Small image from Alexa 5000 site – Long tail object: ~40 +mes every 3-‐4 hours • Use Catchpoint last mile clients in US – Test every 15 minutes – ~11,500 total tests across all test nodes • Focus measurement on: – Connect +me (TCP) – Wait +me (TTFB)
- 42. Cedexis Object Connect (median) Wait (median) Cedexis 14ms 19ms
- 43. Cedexis Object Alexa 5000 Connect (median) Wait (median) Cedexis 14ms 19ms Alexa 5000 14ms 24ms
- 44. Cedexis Object Alexa 5000 Connect (median) Wait (median) Cedexis 14ms 19ms Alexa 5000 14ms 24ms 26%
- 45. Cedexis Object Long Tail Alexa 5000 Connect (median) Wait (median) Cedexis 14ms 19ms Alexa 5000 14ms 24ms Long Tail 15ms 29ms
- 46. Cedexis Object Long Tail Alexa 5000 Connect (median) Wait (median) Cedexis 14ms 19ms Alexa 5000 14ms 24ms Long Tail 15ms 29ms 20%
- 47. Cedexis Object Count TCP TTFB Count TCP TTFB Count TCP TTFB Mem 11,074 14ms 19ms 481 14ms 19ms 6741 14ms 20ms Disk 428 12ms 24ms 9626 15ms 28ms 4692 14ms 31ms Miss 1 6ms 38ms 1355 16ms 51ms 28 13ms 45ms
- 48. Cedexis Object Alexa 5000 Count TCP TTFB Count TCP TTFB Count TCP TTFB Mem 11,074 14ms 19ms 6741 14ms 20ms 481 14ms 19ms Disk 428 12ms 24ms 4692 14ms 31ms 9626 15ms 28ms Miss 1 6ms 38ms 28 13ms 45ms 1355 16ms 51ms
- 49. Cedexis Object Long Tail Alexa 5000 Count TCP TTFB Count TCP TTFB Count TCP TTFB Mem 11,074 14ms 19ms 6741 14ms 20ms 481 14ms 19ms Disk 428 12ms 24ms 4692 14ms 31ms 9626 15ms 28ms Miss 1 6ms 38ms 28 13ms 45ms 1355 16ms 51ms
- 50. Cedexis Object Long Tail Alexa 5000 Count TCP TTFB Count TCP TTFB Count TCP TTFB Mem 11,074 14ms 19ms 6741 14ms 20ms 481 14ms 19ms Disk 428 12ms 24ms 4692 14ms 31ms 9626 15ms 28ms Miss 1 6ms 38ms 28 13ms 45ms 1355 16ms 51ms 99.99% Mem: 96.27% Disk: 3.72%
- 51. Cedexis Object Long Tail Alexa 5000 Count TCP TTFB Count TCP TTFB Count TCP TTFB Mem 11,074 14ms 19ms 6741 14ms 20ms 481 14ms 19ms Disk 428 12ms 24ms 4692 14ms 31ms 9626 15ms 28ms Miss 1 6ms 38ms 28 13ms 45ms 1355 16ms 51ms 99.99% Mem: 96.27% Disk: 3.72% 99.76% Mem: 58.82% Disk: 40.94%
- 52. Cedexis Object Long Tail Alexa 5000 Count TCP TTFB Count TCP TTFB Count TCP TTFB Mem 11,074 14ms 19ms 6741 14ms 20ms 481 14ms 19ms Disk 428 12ms 24ms 4692 14ms 31ms 9626 15ms 28ms Miss 1 6ms 38ms 28 13ms 45ms 1355 16ms 51ms 99.99% Mem: 96.27% Disk: 3.72% 99.76% 88.17% Mem: 58.82% Disk: 40.94% Mem: 4.19% Disk: 83.98%
- 53. Measurement! • Not only do I care about: – Cache hit rate – Long tail – Measuring the right thing • Fetching from disk could suck! – SSDs! • Caching ≠ Caching
- 54. Lesson: It’s Not Only About…
- 55.
- 56. Security • Cer+ficate management • Perimeter security • DDoS protec+on <-‐ benefit of scale!
- 57. Flexibility, Visibility, and Control • Integra+on • Programmability • APIs • Instant purging • Real +me logs
- 58. Fun at the Edge! • Synthe+c responses – Example: node ID for Cedexis measurements • Cookie manipula+on – Remove/inject/replace/recall • Beacon termina+on – 204 responses – Real +me logs – Awesome!
- 59. PERFORMANCE!! It’s s+ll preby damn important!
- 60.