Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Atmosphere 2016 - Albert Lacki, Jaroslaw Bloch - Real user monitoring at scale - dream lab

239 views

Published on

A pretty detailed story of how we built a real-time user monitoring platform, gathering data of millions of users. Using the joint forces of CDN, Cloud and BigData, we created a tool for developers and product owners to guide them towards right (and data-driven) product decisions.

Published in: Technology
  • Be the first to comment

Atmosphere 2016 - Albert Lacki, Jaroslaw Bloch - Real user monitoring at scale - dream lab

  1. 1. Real User Monitoring at scale Jarosław Bloch Albert Łącki
  2. 2. PL SK HU RS CH
  3. 3. 20 mln real users 7 mln requests every minute 150 mln PV daily
  4. 4. 3 data centers 3 000 servers and devices 130 Gbps traffic
  5. 5. 40 teams > 250 deployments daily 300 specialists
  6. 6. Speed search +0,4s PV/UU -0,5% load +35% Revenue -5% load +250ms PV/UU -1,8% Revenue/UU -4,3%
  7. 7. Component monitoring
  8. 8. Service monitoring
  9. 9. User experience Our responsibility Under our control
  10. 10. External monitoring
  11. 11. Real User Monitoring
  12. 12. ?
  13. 13. Real User Monitoring ? ? ? collection ingestion processing presentation
  14. 14. Data collection
  15. 15. <script> var data = collect(); data.send(); </script> Data collection
  16. 16. Navigation Timing API onLoad DOM Processing ResponseRequestTCP, DNSRedirects navigationStart fetchStart requestStart responseStart domLoading responseEnd domInteractive domComplete
  17. 17. Resource Timing API
  18. 18. JS Errors try { … } catch (ex) { collect(ex); }
  19. 19. Data collection data
  20. 20. DC-1 Accelerator DC-2 GET
  21. 21. HTTP 202 Data collection data
  22. 22. DC-1 Script injection <js> Accelerator
  23. 23. Data ingestion 5 min
  24. 24. Data ingestion
  25. 25. Kafka Partition 1 Partition 2 Partition 3
  26. 26. Data replication DC-2DC-1
  27. 27. DATA DATA EVERYWHERE
  28. 28. METRICS METRICS EVERYWHERE
  29. 29. Storm Topology metrics data
  30. 30. Presentation
  31. 31. Graphite sum(metric1, metric2) highestMax(services.*, 10) …
  32. 32. Graphite 3 millions metrics
  33. 33. Custom alerts
  34. 34. Druid
  35. 35. Real User Monitoring
  36. 36. Deployments
  37. 37. Instant feedback
  38. 38. Thank you!

×