Uploaded bySangeeta Narayanan
Operational Visibility at Global Scale
The document outlines Netflix's approach to operational visibility and stream processing, highlighting the importance of real-time insights and anomaly detection for maintaining subscription satisfaction. It discusses the development of the Mantis platform for efficient data processing and the integration of various data sources for enhanced metrics. Additionally, it emphasizes the need for precise debugging and rapid feedback loops to cultivate over 81 million delighted subscribers.
More Related Content
Similar to Operational Visibility at Global Scale
![Getting Started with Apache Spark: Big Data Made Simple [Free Meetup]](https://cdn.slidesharecdn.com/ss_thumbnails/apachesparkgettingstarted-260203175547-8361bcc3-thumbnail.jpg?width=640&height=640&fit=bounds)
Operational Visibility at Global Scale
- 1. Sangeeta Narayanan Edge DeveloperExperience @Netflix @sangeetan Operational Visibility at Global Scale Velocity Conf Santa Clara 2016
- 2. A Determined Subscriberand a Passion-filled Telenovela
- 3.
- 4. Subscribers/year in millionsValueAxis 20 40 60 80 20072009 2011 2013 2015
- 5. Subscribers/year in millionsValueAxis 20 40 60 80 20072009 2011 2013 2015 2016 ??
- 6.
- 7. > 81M DELIGHTEDSubscribers and counting…
- 8. How do youmeasure delight?
- 12.
- 13.
- 14.
- 15.
- 18.
- 21.
- 22.
- 23.
- 24.
- 25.
- 26. What we havebuilt http://bit.ly/1ZYO5Qx
- 27. Fine-grained event stream querying Realtime InsightsApplications Stream Processing Platform Aggregate Health Dashboards Anomaly detection Alerting Correlations
- 28. Fine-grained event stream querying Realtime InsightsApplications Aggregate Health Dashboards Anomaly detection Alerting Correlations Stream Processing Platform
- 29. Mantis High Throughput Low latency CostEfficient Stream Processing Platform http://techblog.netflix.com/2016/03/stream-processing-with-mantis.html
- 30. • Cloud Native- Elastic worker jobs & Elastic clusters • Mixed workload on same cluster • Data filtering at source • Built-in backpressure • Deep integration with Netflix ecosystem
- 31. Realtime Insights Applications StreamProcessing Platform Aggregate Health Dashboards Anomaly detection Alerting Correlations Fine-grained event stream querying
- 35.
- 37. Filtered down to5 events
- 38. On-Demand Metric Definition Rapiditerations Recipes Persistence for later use
- 39. Fine-grained event stream querying Realtime InsightsApplications Stream Processing Platform Anomaly detection Alerting Correlations Aggregate Health Dashboards
- 43.
- 44. Highly responsive, interactiveUI Dynamic data visualizations Dimensions/Facets Integration with multiple data sources
- 45. Fine-grained event stream querying Realtime InsightsApplications Stream Processing Platform Aggregate Health Dashboards Anomaly detection Alerting Correlations
- 46.
- 48.
- 50.
- 51. Event Streams Time series Data Device Telemetry Dist sys& per node traces Infra Changes Aggregate Health Dashboards Fine grained event stream querying Anomaly detection & Alerting App Session Profiling Request Profiling Instance level profiling Cassandra, ES, …
- 54.
- 55. Anomaly Detection +Alerting —> Rapid detection Event Stream Querying —> Precise debugging Dynamic Metrics —> Short feedback loop Profiling —> ‘Shift left’ Insights
- 56. > 81M DELIGHTEDCustomers and counting…
- 58. Thank You Stream Processingwith Mantis Atlas: Netflix Telemetry Platform http://netflix.github.io/