SlideShare a Scribd company logo
1 of 24
Download to read offline
1
Building a Centralized
Observability Platform
Christine Komander
Senior Solutions Architect
Role of Centralized Observability Platform Team
Builds and maintains solutions that make
getting insights from this data turnkey
and efficient
Standardize observability across
engineering teams, drive designs for high
performing services and foster great
observability practices.
Give our internal customers a simple and
reliable set of tools to process, store and
ship logs.
Builds the tools and systems that every
engineering team uses to develop, scale,
understand & monitor their systems. These
systems are absolutely critical to Uber.
3
Self Service observability to
Dev and SREs in minutes
Helping drive MTTR/D
towards zero
Productivity
Simplify operations
(upgrades, security, etc)
Standardize practices and
processes to achieve
software reliability goals
Standardization
Reduce license, deployment,
and operations costs
Smaller platform team
supports observability needs
for entire org
Consolidation
Benefits of a Centralized Observability Platform
Centralized Observability Platform Needs
5
Centralized Observability
with Elastic
Built for scale
(and speed)
Powered by Elasticsearch that is
highly available, distributed by design,
and scales with ease
5M
metrics/sec
1.73M
events/min
3M
events/min
2 PB
events/day
Operational Ease
Single observability platform
One platform to deploy & manage for all your
observability needs
Observe the observability platform
Rich monitoring features enable you to provide a
reliable and performant observability platform
Multi-hybrid platform lifecycle made easy
Simplify orchestration with Elastic Cloud, Elastic
Cloud Enterprise, and Elastic Cloud on Kubernetes
Stack monitoring
ECE -
Operational Ease
Single observability platform
One platform to deploy & manage for all your
observability needs
Observe the observability platform
Rich monitoring features enable you to provide a
reliable and performant observability platform
Multi-hybrid platform lifecycle made easy
Simplify orchestration with Elastic Cloud, Elastic
Cloud Enterprise, and Elastic Cloud on Kubernetes
Operational Ease
Single observability platform
One platform to deploy & manage for all your
observability needs
Observe the observability platform
Rich monitoring features enable you to provide a
reliable and performant observability platform
Multi-hybrid platform lifecycle made easy
Simplify orchestration with Elastic Cloud, Elastic
Cloud Enterprise, and Elastic Cloud on Kubernetes
Operational Ease
Single observability platform
One platform to deploy & manage for all your
observability needs
Observe the observability platform
Rich monitoring features enable you to provide a
reliable and performant observability platform
Multi-hybrid platform lifecycle made easy
Simplify orchestration with Elastic Cloud, Elastic
Cloud Enterprise, and Elastic Cloud on Kubernetes
Multitenancy
Cluster per tenant made easy
Easily isolate teams without increasing admin
load with ECE / ECK / Elastic Cloud
Tenants in a single cluster simplified
Handle multiple users on a single cluster with
Kibana Spaces, RBAC, background jobs, etc
Deliver on mixed needs
Balance speed vs. cost with flexible data tiering
and lifecycle management policy
Multitenancy
Cluster per tenant made easy
Easily isolate teams without increasing admin
load with ECE / ECK / Elastic Cloud
Tenants in a single cluster simplified
Handle multiple users on a single cluster with
Kibana Spaces, RBAC, background jobs, etc
Deliver on mixed needs
Balance speed vs. cost with flexible data tiering
and lifecycle management policy
Multitenancy
Cluster per tenant made easy
Easily isolate teams without increasing admin
load with ECE / ECK / Elastic Cloud
Tenants in a single cluster simplified
Handle multiple users on a single cluster with
Kibana Spaces, RBAC, background jobs, etc
Deliver on mixed needs
Balance speed vs. cost with flexible data tiering
and lifecycle management policy
Multitenancy
Cluster per tenant made easy
Easily isolate teams without increasing admin
load with ECE / ECK / Elastic Cloud
Tenants in a single cluster simplified
Handle multiple users on a single cluster with
Kibana Spaces, RBAC, background jobs, etc
Deliver on mixed needs
Balance speed vs. cost with flexible data tiering
and lifecycle management policy
Async/Background searches
Multitenancy
Cluster per tenant made easy
Easily isolate teams without increasing admin
load with ECE / ECK / Elastic Cloud
Tenants in a single cluster simplified
Handle multiple users on a single cluster with
Kibana Spaces, RBAC, background jobs, etc
Deliver on mixed needs
Balance speed vs. cost with flexible data tiering
and lifecycle management policy
Cost Management
Don’t wait to buy to prove value
Start (or expand) with the forever free (and open)
tier, and validate value — when budgets are tight
Scale and evolve, without exploding costs
Control spend without compromising visibility or
engineering goals with resource-based pricing
Optimize resource utilization
Provide low latency and low network egress costs
through local data clusters and a central analysis
cluster
Measure usage and chargeback
Telemetry to understand usage across all use cases
to identify growing or underused areas and also for
chargeback purposes
GOLD PLATINUM ENTERPRISE
Logs app
APM app
Metrics app
Integrations / Beats
APM agents
Distributed tracing
OpenTelemetry/Jaeger
Alerting
Machine learning
Service maps
FREE & OPEN
Uptime app
Cost Management
Don’t wait to buy to prove value
Start (or expand) with the forever free (and open)
tier, and validate value — when budgets are tight
Scale and evolve, without exploding costs
Control spend without compromising visibility or
engineering goals with resource-based pricing
Optimize resource utilization
Provide low latency and low network egress costs
through local data clusters and a central analysis
cluster
Measure usage and chargeback
Telemetry to understand usage across all use cases
to identify growing or underused areas and also for
chargeback purposes
hosts
agents
functions
containers
metrics
logs ingested
No pricing per
Our resource-based pricing is based only
on the underlying infrastructure
resources used by any given deployment
— across all data types and use cases.
Cost Management
Don’t wait to buy to prove value
Start (or expand) with the forever free (and open)
tier, and validate value — when budgets are tight
Scale and evolve, without exploding costs
Control spend without compromising visibility or
engineering goals with resource-based pricing
Optimize resource utilization
Provide low latency and low network egress costs
through local data clusters and a central analysis
cluster
Measure usage and chargeback
Telemetry to understand usage across all use cases
to identify growing or underused areas and also for
chargeback purposes
DC1 DC2
logs /
metrics
Azure
logs /
metrics
logs /
metrics
App / Infra App / Infra App / Infra
Central Cluster
Cost Management
Don’t wait to buy to prove value
Start (or expand) with the forever free (and open)
tier, and validate value — when budgets are tight
Scale and evolve, without exploding costs
Control spend without compromising visibility or
engineering goals with resource-based pricing
Optimize resource utilization
Provide low latency and low network egress costs
through local data clusters and a central analysis
cluster
Measure usage and chargeback
Telemetry to understand usage across all use cases
to identify growing or underused areas and also for
chargeback purposes
Self-Served Onboarding
Self-service enablement for Devs
Create self service mechanism teams to
create clusters, log parsing pipelines,
enable APM
Self-service enablement for SREs
OOTB integrations that include dashboards
and built-in alerts and anomaly detection jobs
Education
SRE training, observability engineer, SRE
practices enablement
Self-Served Onboarding
Self-service enablement for Devs
Create self service mechanism teams to
create clusters, log parsing pipelines,
enable APM
Self-service enablement for SREs
OOTB integrations that include dashboards
and built-in alerts and anomaly detection jobs
Education
SRE training, observability engineer, SRE
practices enablement
Self-Served Onboarding
Self-service enablement for Devs
Create self service mechanism teams to
create clusters, log parsing pipelines,
enable APM
Self-service enablement for SREs
OOTB integrations that include dashboards
and built-in alerts and anomaly detection jobs
Education
SRE training, observability engineer, SRE
practices enablement
23
Self Service observability to
Dev and SREs in minutes
Helping drive MTTR/D
towards zero
Productivity
Simplify operations
(upgrades, security, etc)
Standardize practices and
processes to achieve
software reliability goals
Standardization
Reduce license, deployment,
and operations costs
Smaller platform team
supports observability needs
for entire org
Consolidation
Centralized Observability Platform with Elastic
Thank you!

More Related Content

What's hot

Observability For Modern Applications
Observability For Modern ApplicationsObservability For Modern Applications
Observability For Modern ApplicationsAmazon Web Services
 
Monitoring and observability
Monitoring and observabilityMonitoring and observability
Monitoring and observabilityDanylenko Max
 
Keynote: Elastic Observability evolution and vision
Keynote: Elastic Observability evolution and visionKeynote: Elastic Observability evolution and vision
Keynote: Elastic Observability evolution and visionElasticsearch
 
Observability at Scale
Observability at Scale Observability at Scale
Observability at Scale Knoldus Inc.
 
Cloud-Native Observability
Cloud-Native ObservabilityCloud-Native Observability
Cloud-Native ObservabilityTyler Treat
 
Observability – the good, the bad, and the ugly
Observability – the good, the bad, and the uglyObservability – the good, the bad, and the ugly
Observability – the good, the bad, and the uglyTimetrix
 
Observability, Distributed Tracing, and Open Source: The Missing Primer
Observability, Distributed Tracing, and Open Source: The Missing PrimerObservability, Distributed Tracing, and Open Source: The Missing Primer
Observability, Distributed Tracing, and Open Source: The Missing PrimerVMware Tanzu
 
Do You Really Need to Evolve From Monitoring to Observability?
Do You Really Need to Evolve From Monitoring to Observability?Do You Really Need to Evolve From Monitoring to Observability?
Do You Really Need to Evolve From Monitoring to Observability?Splunk
 
Combining logs, metrics, and traces for unified observability
Combining logs, metrics, and traces for unified observabilityCombining logs, metrics, and traces for unified observability
Combining logs, metrics, and traces for unified observabilityElasticsearch
 
Google Cloud Fundamentals by CloudZone
Google Cloud Fundamentals by CloudZoneGoogle Cloud Fundamentals by CloudZone
Google Cloud Fundamentals by CloudZoneIdan Tohami
 
Combining logs, metrics, and traces for unified observability
Combining logs, metrics, and traces for unified observabilityCombining logs, metrics, and traces for unified observability
Combining logs, metrics, and traces for unified observabilityElasticsearch
 
Observability vs APM vs Monitoring Comparison
Observability vs APM vs  Monitoring ComparisonObservability vs APM vs  Monitoring Comparison
Observability vs APM vs Monitoring Comparisonjeetendra mandal
 

What's hot (20)

Observability For Modern Applications
Observability For Modern ApplicationsObservability For Modern Applications
Observability For Modern Applications
 
Monitoring and observability
Monitoring and observabilityMonitoring and observability
Monitoring and observability
 
Keynote: Elastic Observability evolution and vision
Keynote: Elastic Observability evolution and visionKeynote: Elastic Observability evolution and vision
Keynote: Elastic Observability evolution and vision
 
Observability at Scale
Observability at Scale Observability at Scale
Observability at Scale
 
Cloud-Native Observability
Cloud-Native ObservabilityCloud-Native Observability
Cloud-Native Observability
 
Observability – the good, the bad, and the ugly
Observability – the good, the bad, and the uglyObservability – the good, the bad, and the ugly
Observability – the good, the bad, and the ugly
 
Observability, Distributed Tracing, and Open Source: The Missing Primer
Observability, Distributed Tracing, and Open Source: The Missing PrimerObservability, Distributed Tracing, and Open Source: The Missing Primer
Observability, Distributed Tracing, and Open Source: The Missing Primer
 
Observability
ObservabilityObservability
Observability
 
Observability
ObservabilityObservability
Observability
 
Do You Really Need to Evolve From Monitoring to Observability?
Do You Really Need to Evolve From Monitoring to Observability?Do You Really Need to Evolve From Monitoring to Observability?
Do You Really Need to Evolve From Monitoring to Observability?
 
Observability
ObservabilityObservability
Observability
 
Combining logs, metrics, and traces for unified observability
Combining logs, metrics, and traces for unified observabilityCombining logs, metrics, and traces for unified observability
Combining logs, metrics, and traces for unified observability
 
Soluciones Dynatrace
Soluciones DynatraceSoluciones Dynatrace
Soluciones Dynatrace
 
Observability & Datadog
Observability & DatadogObservability & Datadog
Observability & Datadog
 
Google Cloud Fundamentals by CloudZone
Google Cloud Fundamentals by CloudZoneGoogle Cloud Fundamentals by CloudZone
Google Cloud Fundamentals by CloudZone
 
Api observability
Api observability Api observability
Api observability
 
Combining logs, metrics, and traces for unified observability
Combining logs, metrics, and traces for unified observabilityCombining logs, metrics, and traces for unified observability
Combining logs, metrics, and traces for unified observability
 
Observability driven development
Observability driven developmentObservability driven development
Observability driven development
 
Observability vs APM vs Monitoring Comparison
Observability vs APM vs  Monitoring ComparisonObservability vs APM vs  Monitoring Comparison
Observability vs APM vs Monitoring Comparison
 
FinOps introduction
FinOps introductionFinOps introduction
FinOps introduction
 

Similar to Building a centralized observability platform

Creación de una plataforma de observabilidad centralizada
Creación de una plataforma de observabilidad centralizadaCreación de una plataforma de observabilidad centralizada
Creación de una plataforma de observabilidad centralizadaElasticsearch
 
Construire une plateforme d'observabilité centralisée
Construire une plateforme d'observabilité centraliséeConstruire une plateforme d'observabilité centralisée
Construire une plateforme d'observabilité centraliséeElasticsearch
 
Desarrollo de una plataforma de observabilidad centralizada
Desarrollo de una plataforma de observabilidad centralizadaDesarrollo de una plataforma de observabilidad centralizada
Desarrollo de una plataforma de observabilidad centralizadaElasticsearch
 
Construção de uma plataforma de observabilidade centralizada
Construção de uma plataforma de observabilidade centralizadaConstrução de uma plataforma de observabilidade centralizada
Construção de uma plataforma de observabilidade centralizadaElasticsearch
 
Tour de France Azure PaaS 2/7 Exécuter une application
Tour de France Azure PaaS 2/7 Exécuter une applicationTour de France Azure PaaS 2/7 Exécuter une application
Tour de France Azure PaaS 2/7 Exécuter une applicationAlex Danvy
 
Transform Your Organization with Real Real-Time Monitoring
Transform Your Organization with Real Real-Time MonitoringTransform Your Organization with Real Real-Time Monitoring
Transform Your Organization with Real Real-Time MonitoringAmazon Web Services
 
Microservices for Application Modernisation
Microservices for Application ModernisationMicroservices for Application Modernisation
Microservices for Application ModernisationAjay Kumar Uppal
 
CSC AWS re:Invent Enterprise DevOps session
CSC AWS re:Invent Enterprise DevOps sessionCSC AWS re:Invent Enterprise DevOps session
CSC AWS re:Invent Enterprise DevOps sessionTom Laszewski
 
Trellis DCIM Platform
Trellis DCIM PlatformTrellis DCIM Platform
Trellis DCIM PlatformGreg Stover
 
Elastic APM: Amping up your logs and metrics for the full picture
Elastic APM: Amping up your logs and metrics for the full pictureElastic APM: Amping up your logs and metrics for the full picture
Elastic APM: Amping up your logs and metrics for the full pictureElasticsearch
 
Grid Economics for the Next Generation Data Center
Grid  Economics for the Next Generation Data CenterGrid  Economics for the Next Generation Data Center
Grid Economics for the Next Generation Data CenterGeorge Demarest
 
Exploring Opportunities in Crisis by Ramco
Exploring Opportunities in Crisis by RamcoExploring Opportunities in Crisis by Ramco
Exploring Opportunities in Crisis by RamcoIndiaMART InterMESH Ltd
 
IBM: Inteligentný manažment testovacích a vývojových prostredí
IBM: Inteligentný manažment testovacích a vývojových prostredí IBM: Inteligentný manažment testovacích a vývojových prostredí
IBM: Inteligentný manažment testovacích a vývojových prostredí ASBIS SK
 
Webinar series part 2 recipe for a successful saa s company - migrating sing...
Webinar series part 2  recipe for a successful saa s company - migrating sing...Webinar series part 2  recipe for a successful saa s company - migrating sing...
Webinar series part 2 recipe for a successful saa s company - migrating sing...kanimozhin
 
(ENT210) Accelerating Business Innovation with DevOps on AWS | AWS re:Invent ...
(ENT210) Accelerating Business Innovation with DevOps on AWS | AWS re:Invent ...(ENT210) Accelerating Business Innovation with DevOps on AWS | AWS re:Invent ...
(ENT210) Accelerating Business Innovation with DevOps on AWS | AWS re:Invent ...Amazon Web Services
 
Elastic APM: Combinalo con tus logs y métricas para una visibilidad completa
Elastic APM: Combinalo con tus logs y métricas para una visibilidad completaElastic APM: Combinalo con tus logs y métricas para una visibilidad completa
Elastic APM: Combinalo con tus logs y métricas para una visibilidad completaElasticsearch
 
M.S. Dissertation in Salesforce on Force.com
M.S. Dissertation in Salesforce on Force.comM.S. Dissertation in Salesforce on Force.com
M.S. Dissertation in Salesforce on Force.comArun Somu Panneerselvam
 
Which Application Modernization Pattern Is Right For You?
Which Application Modernization Pattern Is Right For You?Which Application Modernization Pattern Is Right For You?
Which Application Modernization Pattern Is Right For You?Apigee | Google Cloud
 

Similar to Building a centralized observability platform (20)

Creación de una plataforma de observabilidad centralizada
Creación de una plataforma de observabilidad centralizadaCreación de una plataforma de observabilidad centralizada
Creación de una plataforma de observabilidad centralizada
 
Construire une plateforme d'observabilité centralisée
Construire une plateforme d'observabilité centraliséeConstruire une plateforme d'observabilité centralisée
Construire une plateforme d'observabilité centralisée
 
Desarrollo de una plataforma de observabilidad centralizada
Desarrollo de una plataforma de observabilidad centralizadaDesarrollo de una plataforma de observabilidad centralizada
Desarrollo de una plataforma de observabilidad centralizada
 
Construção de uma plataforma de observabilidade centralizada
Construção de uma plataforma de observabilidade centralizadaConstrução de uma plataforma de observabilidade centralizada
Construção de uma plataforma de observabilidade centralizada
 
Tour de France Azure PaaS 2/7 Exécuter une application
Tour de France Azure PaaS 2/7 Exécuter une applicationTour de France Azure PaaS 2/7 Exécuter une application
Tour de France Azure PaaS 2/7 Exécuter une application
 
Transform Your Organization with Real Real-Time Monitoring
Transform Your Organization with Real Real-Time MonitoringTransform Your Organization with Real Real-Time Monitoring
Transform Your Organization with Real Real-Time Monitoring
 
Microservices for Application Modernisation
Microservices for Application ModernisationMicroservices for Application Modernisation
Microservices for Application Modernisation
 
CSC AWS re:Invent Enterprise DevOps session
CSC AWS re:Invent Enterprise DevOps sessionCSC AWS re:Invent Enterprise DevOps session
CSC AWS re:Invent Enterprise DevOps session
 
Trellis DCIM Platform
Trellis DCIM PlatformTrellis DCIM Platform
Trellis DCIM Platform
 
Elastic APM: Amping up your logs and metrics for the full picture
Elastic APM: Amping up your logs and metrics for the full pictureElastic APM: Amping up your logs and metrics for the full picture
Elastic APM: Amping up your logs and metrics for the full picture
 
Grid Economics for the Next Generation Data Center
Grid  Economics for the Next Generation Data CenterGrid  Economics for the Next Generation Data Center
Grid Economics for the Next Generation Data Center
 
Exploring Opportunities in Crisis by Ramco
Exploring Opportunities in Crisis by RamcoExploring Opportunities in Crisis by Ramco
Exploring Opportunities in Crisis by Ramco
 
IBM: Inteligentný manažment testovacích a vývojových prostredí
IBM: Inteligentný manažment testovacích a vývojových prostredí IBM: Inteligentný manažment testovacích a vývojových prostredí
IBM: Inteligentný manažment testovacích a vývojových prostredí
 
Webinar series part 2 recipe for a successful saa s company - migrating sing...
Webinar series part 2  recipe for a successful saa s company - migrating sing...Webinar series part 2  recipe for a successful saa s company - migrating sing...
Webinar series part 2 recipe for a successful saa s company - migrating sing...
 
(ENT210) Accelerating Business Innovation with DevOps on AWS | AWS re:Invent ...
(ENT210) Accelerating Business Innovation with DevOps on AWS | AWS re:Invent ...(ENT210) Accelerating Business Innovation with DevOps on AWS | AWS re:Invent ...
(ENT210) Accelerating Business Innovation with DevOps on AWS | AWS re:Invent ...
 
Adopting the Cloud
Adopting the CloudAdopting the Cloud
Adopting the Cloud
 
Elastic APM: Combinalo con tus logs y métricas para una visibilidad completa
Elastic APM: Combinalo con tus logs y métricas para una visibilidad completaElastic APM: Combinalo con tus logs y métricas para una visibilidad completa
Elastic APM: Combinalo con tus logs y métricas para una visibilidad completa
 
Application Migrations at Scale
Application Migrations at ScaleApplication Migrations at Scale
Application Migrations at Scale
 
M.S. Dissertation in Salesforce on Force.com
M.S. Dissertation in Salesforce on Force.comM.S. Dissertation in Salesforce on Force.com
M.S. Dissertation in Salesforce on Force.com
 
Which Application Modernization Pattern Is Right For You?
Which Application Modernization Pattern Is Right For You?Which Application Modernization Pattern Is Right For You?
Which Application Modernization Pattern Is Right For You?
 

More from Elasticsearch

An introduction to Elasticsearch's advanced relevance ranking toolbox
An introduction to Elasticsearch's advanced relevance ranking toolboxAn introduction to Elasticsearch's advanced relevance ranking toolbox
An introduction to Elasticsearch's advanced relevance ranking toolboxElasticsearch
 
From MSP to MSSP using Elastic
From MSP to MSSP using ElasticFrom MSP to MSSP using Elastic
From MSP to MSSP using ElasticElasticsearch
 
Cómo crear excelentes experiencias de búsqueda en sitios web
Cómo crear excelentes experiencias de búsqueda en sitios webCómo crear excelentes experiencias de búsqueda en sitios web
Cómo crear excelentes experiencias de búsqueda en sitios webElasticsearch
 
Te damos la bienvenida a una nueva forma de realizar búsquedas
Te damos la bienvenida a una nueva forma de realizar búsquedas Te damos la bienvenida a una nueva forma de realizar búsquedas
Te damos la bienvenida a una nueva forma de realizar búsquedas Elasticsearch
 
Tirez pleinement parti d'Elastic grâce à Elastic Cloud
Tirez pleinement parti d'Elastic grâce à Elastic CloudTirez pleinement parti d'Elastic grâce à Elastic Cloud
Tirez pleinement parti d'Elastic grâce à Elastic CloudElasticsearch
 
Comment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitablesComment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitablesElasticsearch
 
Plongez au cœur de la recherche dans tous ses états.
Plongez au cœur de la recherche dans tous ses états.Plongez au cœur de la recherche dans tous ses états.
Plongez au cœur de la recherche dans tous ses états.Elasticsearch
 
Modernising One Legal Se@rch with Elastic Enterprise Search [Customer Story]
Modernising One Legal Se@rch with Elastic Enterprise Search [Customer Story]Modernising One Legal Se@rch with Elastic Enterprise Search [Customer Story]
Modernising One Legal Se@rch with Elastic Enterprise Search [Customer Story]Elasticsearch
 
An introduction to Elasticsearch's advanced relevance ranking toolbox
An introduction to Elasticsearch's advanced relevance ranking toolboxAn introduction to Elasticsearch's advanced relevance ranking toolbox
An introduction to Elasticsearch's advanced relevance ranking toolboxElasticsearch
 
Welcome to a new state of find
Welcome to a new state of findWelcome to a new state of find
Welcome to a new state of findElasticsearch
 
Building great website search experiences
Building great website search experiencesBuilding great website search experiences
Building great website search experiencesElasticsearch
 
Keynote: Harnessing the power of Elasticsearch for simplified search
Keynote: Harnessing the power of Elasticsearch for simplified searchKeynote: Harnessing the power of Elasticsearch for simplified search
Keynote: Harnessing the power of Elasticsearch for simplified searchElasticsearch
 
Cómo transformar los datos en análisis con los que tomar decisiones
Cómo transformar los datos en análisis con los que tomar decisionesCómo transformar los datos en análisis con los que tomar decisiones
Cómo transformar los datos en análisis con los que tomar decisionesElasticsearch
 
Explore relève les défis Big Data avec Elastic Cloud
Explore relève les défis Big Data avec Elastic Cloud Explore relève les défis Big Data avec Elastic Cloud
Explore relève les défis Big Data avec Elastic Cloud Elasticsearch
 
Comment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitablesComment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitablesElasticsearch
 
Transforming data into actionable insights
Transforming data into actionable insightsTransforming data into actionable insights
Transforming data into actionable insightsElasticsearch
 
Opening Keynote: Why Elastic?
Opening Keynote: Why Elastic?Opening Keynote: Why Elastic?
Opening Keynote: Why Elastic?Elasticsearch
 
Empowering agencies using Elastic as a Service inside Government
Empowering agencies using Elastic as a Service inside GovernmentEmpowering agencies using Elastic as a Service inside Government
Empowering agencies using Elastic as a Service inside GovernmentElasticsearch
 
The opportunities and challenges of data for public good
The opportunities and challenges of data for public goodThe opportunities and challenges of data for public good
The opportunities and challenges of data for public goodElasticsearch
 
Enterprise search and unstructured data with CGI and Elastic
Enterprise search and unstructured data with CGI and ElasticEnterprise search and unstructured data with CGI and Elastic
Enterprise search and unstructured data with CGI and ElasticElasticsearch
 

More from Elasticsearch (20)

An introduction to Elasticsearch's advanced relevance ranking toolbox
An introduction to Elasticsearch's advanced relevance ranking toolboxAn introduction to Elasticsearch's advanced relevance ranking toolbox
An introduction to Elasticsearch's advanced relevance ranking toolbox
 
From MSP to MSSP using Elastic
From MSP to MSSP using ElasticFrom MSP to MSSP using Elastic
From MSP to MSSP using Elastic
 
Cómo crear excelentes experiencias de búsqueda en sitios web
Cómo crear excelentes experiencias de búsqueda en sitios webCómo crear excelentes experiencias de búsqueda en sitios web
Cómo crear excelentes experiencias de búsqueda en sitios web
 
Te damos la bienvenida a una nueva forma de realizar búsquedas
Te damos la bienvenida a una nueva forma de realizar búsquedas Te damos la bienvenida a una nueva forma de realizar búsquedas
Te damos la bienvenida a una nueva forma de realizar búsquedas
 
Tirez pleinement parti d'Elastic grâce à Elastic Cloud
Tirez pleinement parti d'Elastic grâce à Elastic CloudTirez pleinement parti d'Elastic grâce à Elastic Cloud
Tirez pleinement parti d'Elastic grâce à Elastic Cloud
 
Comment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitablesComment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitables
 
Plongez au cœur de la recherche dans tous ses états.
Plongez au cœur de la recherche dans tous ses états.Plongez au cœur de la recherche dans tous ses états.
Plongez au cœur de la recherche dans tous ses états.
 
Modernising One Legal Se@rch with Elastic Enterprise Search [Customer Story]
Modernising One Legal Se@rch with Elastic Enterprise Search [Customer Story]Modernising One Legal Se@rch with Elastic Enterprise Search [Customer Story]
Modernising One Legal Se@rch with Elastic Enterprise Search [Customer Story]
 
An introduction to Elasticsearch's advanced relevance ranking toolbox
An introduction to Elasticsearch's advanced relevance ranking toolboxAn introduction to Elasticsearch's advanced relevance ranking toolbox
An introduction to Elasticsearch's advanced relevance ranking toolbox
 
Welcome to a new state of find
Welcome to a new state of findWelcome to a new state of find
Welcome to a new state of find
 
Building great website search experiences
Building great website search experiencesBuilding great website search experiences
Building great website search experiences
 
Keynote: Harnessing the power of Elasticsearch for simplified search
Keynote: Harnessing the power of Elasticsearch for simplified searchKeynote: Harnessing the power of Elasticsearch for simplified search
Keynote: Harnessing the power of Elasticsearch for simplified search
 
Cómo transformar los datos en análisis con los que tomar decisiones
Cómo transformar los datos en análisis con los que tomar decisionesCómo transformar los datos en análisis con los que tomar decisiones
Cómo transformar los datos en análisis con los que tomar decisiones
 
Explore relève les défis Big Data avec Elastic Cloud
Explore relève les défis Big Data avec Elastic Cloud Explore relève les défis Big Data avec Elastic Cloud
Explore relève les défis Big Data avec Elastic Cloud
 
Comment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitablesComment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitables
 
Transforming data into actionable insights
Transforming data into actionable insightsTransforming data into actionable insights
Transforming data into actionable insights
 
Opening Keynote: Why Elastic?
Opening Keynote: Why Elastic?Opening Keynote: Why Elastic?
Opening Keynote: Why Elastic?
 
Empowering agencies using Elastic as a Service inside Government
Empowering agencies using Elastic as a Service inside GovernmentEmpowering agencies using Elastic as a Service inside Government
Empowering agencies using Elastic as a Service inside Government
 
The opportunities and challenges of data for public good
The opportunities and challenges of data for public goodThe opportunities and challenges of data for public good
The opportunities and challenges of data for public good
 
Enterprise search and unstructured data with CGI and Elastic
Enterprise search and unstructured data with CGI and ElasticEnterprise search and unstructured data with CGI and Elastic
Enterprise search and unstructured data with CGI and Elastic
 

Recently uploaded

Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGSujit Pal
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 

Recently uploaded (20)

Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAG
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 

Building a centralized observability platform

  • 1. 1 Building a Centralized Observability Platform Christine Komander Senior Solutions Architect
  • 2. Role of Centralized Observability Platform Team Builds and maintains solutions that make getting insights from this data turnkey and efficient Standardize observability across engineering teams, drive designs for high performing services and foster great observability practices. Give our internal customers a simple and reliable set of tools to process, store and ship logs. Builds the tools and systems that every engineering team uses to develop, scale, understand & monitor their systems. These systems are absolutely critical to Uber.
  • 3. 3 Self Service observability to Dev and SREs in minutes Helping drive MTTR/D towards zero Productivity Simplify operations (upgrades, security, etc) Standardize practices and processes to achieve software reliability goals Standardization Reduce license, deployment, and operations costs Smaller platform team supports observability needs for entire org Consolidation Benefits of a Centralized Observability Platform
  • 6. Built for scale (and speed) Powered by Elasticsearch that is highly available, distributed by design, and scales with ease 5M metrics/sec 1.73M events/min 3M events/min 2 PB events/day
  • 7. Operational Ease Single observability platform One platform to deploy & manage for all your observability needs Observe the observability platform Rich monitoring features enable you to provide a reliable and performant observability platform Multi-hybrid platform lifecycle made easy Simplify orchestration with Elastic Cloud, Elastic Cloud Enterprise, and Elastic Cloud on Kubernetes Stack monitoring ECE -
  • 8. Operational Ease Single observability platform One platform to deploy & manage for all your observability needs Observe the observability platform Rich monitoring features enable you to provide a reliable and performant observability platform Multi-hybrid platform lifecycle made easy Simplify orchestration with Elastic Cloud, Elastic Cloud Enterprise, and Elastic Cloud on Kubernetes
  • 9. Operational Ease Single observability platform One platform to deploy & manage for all your observability needs Observe the observability platform Rich monitoring features enable you to provide a reliable and performant observability platform Multi-hybrid platform lifecycle made easy Simplify orchestration with Elastic Cloud, Elastic Cloud Enterprise, and Elastic Cloud on Kubernetes
  • 10. Operational Ease Single observability platform One platform to deploy & manage for all your observability needs Observe the observability platform Rich monitoring features enable you to provide a reliable and performant observability platform Multi-hybrid platform lifecycle made easy Simplify orchestration with Elastic Cloud, Elastic Cloud Enterprise, and Elastic Cloud on Kubernetes
  • 11. Multitenancy Cluster per tenant made easy Easily isolate teams without increasing admin load with ECE / ECK / Elastic Cloud Tenants in a single cluster simplified Handle multiple users on a single cluster with Kibana Spaces, RBAC, background jobs, etc Deliver on mixed needs Balance speed vs. cost with flexible data tiering and lifecycle management policy
  • 12. Multitenancy Cluster per tenant made easy Easily isolate teams without increasing admin load with ECE / ECK / Elastic Cloud Tenants in a single cluster simplified Handle multiple users on a single cluster with Kibana Spaces, RBAC, background jobs, etc Deliver on mixed needs Balance speed vs. cost with flexible data tiering and lifecycle management policy
  • 13. Multitenancy Cluster per tenant made easy Easily isolate teams without increasing admin load with ECE / ECK / Elastic Cloud Tenants in a single cluster simplified Handle multiple users on a single cluster with Kibana Spaces, RBAC, background jobs, etc Deliver on mixed needs Balance speed vs. cost with flexible data tiering and lifecycle management policy
  • 14. Multitenancy Cluster per tenant made easy Easily isolate teams without increasing admin load with ECE / ECK / Elastic Cloud Tenants in a single cluster simplified Handle multiple users on a single cluster with Kibana Spaces, RBAC, background jobs, etc Deliver on mixed needs Balance speed vs. cost with flexible data tiering and lifecycle management policy Async/Background searches
  • 15. Multitenancy Cluster per tenant made easy Easily isolate teams without increasing admin load with ECE / ECK / Elastic Cloud Tenants in a single cluster simplified Handle multiple users on a single cluster with Kibana Spaces, RBAC, background jobs, etc Deliver on mixed needs Balance speed vs. cost with flexible data tiering and lifecycle management policy
  • 16. Cost Management Don’t wait to buy to prove value Start (or expand) with the forever free (and open) tier, and validate value — when budgets are tight Scale and evolve, without exploding costs Control spend without compromising visibility or engineering goals with resource-based pricing Optimize resource utilization Provide low latency and low network egress costs through local data clusters and a central analysis cluster Measure usage and chargeback Telemetry to understand usage across all use cases to identify growing or underused areas and also for chargeback purposes GOLD PLATINUM ENTERPRISE Logs app APM app Metrics app Integrations / Beats APM agents Distributed tracing OpenTelemetry/Jaeger Alerting Machine learning Service maps FREE & OPEN Uptime app
  • 17. Cost Management Don’t wait to buy to prove value Start (or expand) with the forever free (and open) tier, and validate value — when budgets are tight Scale and evolve, without exploding costs Control spend without compromising visibility or engineering goals with resource-based pricing Optimize resource utilization Provide low latency and low network egress costs through local data clusters and a central analysis cluster Measure usage and chargeback Telemetry to understand usage across all use cases to identify growing or underused areas and also for chargeback purposes hosts agents functions containers metrics logs ingested No pricing per Our resource-based pricing is based only on the underlying infrastructure resources used by any given deployment — across all data types and use cases.
  • 18. Cost Management Don’t wait to buy to prove value Start (or expand) with the forever free (and open) tier, and validate value — when budgets are tight Scale and evolve, without exploding costs Control spend without compromising visibility or engineering goals with resource-based pricing Optimize resource utilization Provide low latency and low network egress costs through local data clusters and a central analysis cluster Measure usage and chargeback Telemetry to understand usage across all use cases to identify growing or underused areas and also for chargeback purposes DC1 DC2 logs / metrics Azure logs / metrics logs / metrics App / Infra App / Infra App / Infra Central Cluster
  • 19. Cost Management Don’t wait to buy to prove value Start (or expand) with the forever free (and open) tier, and validate value — when budgets are tight Scale and evolve, without exploding costs Control spend without compromising visibility or engineering goals with resource-based pricing Optimize resource utilization Provide low latency and low network egress costs through local data clusters and a central analysis cluster Measure usage and chargeback Telemetry to understand usage across all use cases to identify growing or underused areas and also for chargeback purposes
  • 20. Self-Served Onboarding Self-service enablement for Devs Create self service mechanism teams to create clusters, log parsing pipelines, enable APM Self-service enablement for SREs OOTB integrations that include dashboards and built-in alerts and anomaly detection jobs Education SRE training, observability engineer, SRE practices enablement
  • 21. Self-Served Onboarding Self-service enablement for Devs Create self service mechanism teams to create clusters, log parsing pipelines, enable APM Self-service enablement for SREs OOTB integrations that include dashboards and built-in alerts and anomaly detection jobs Education SRE training, observability engineer, SRE practices enablement
  • 22. Self-Served Onboarding Self-service enablement for Devs Create self service mechanism teams to create clusters, log parsing pipelines, enable APM Self-service enablement for SREs OOTB integrations that include dashboards and built-in alerts and anomaly detection jobs Education SRE training, observability engineer, SRE practices enablement
  • 23. 23 Self Service observability to Dev and SREs in minutes Helping drive MTTR/D towards zero Productivity Simplify operations (upgrades, security, etc) Standardize practices and processes to achieve software reliability goals Standardization Reduce license, deployment, and operations costs Smaller platform team supports observability needs for entire org Consolidation Centralized Observability Platform with Elastic