Session on building observable infrastructure and code by Aravind Putrevu at GDG Cloud Bengaluru

1. Building Observable
Infrastructure & Code
@aravindputrevu

2. @aravindputrevu
Hello
Aravind Putrevu
Developer Advocate
aravind.dev | @aravindputrevu

3. @aravindputrevu
Upcoming Sessions
● Ingesting Jaeger Traces from Python Flask App - 27th Jun
● Powering a Community Platform using Elasticsearch - 11th July
**community.elastic.co**

4. @aravindputrevu
Problem
You are a who loves coding but wants less bugs.
You are a who wants all systems to function well.
You are a who wants to secure & protect data.
You are a product owner looking after product perf.

5. @aravindputrevu
How?
**Collect all data**

6. @aravindputrevu
Usual Scenario
Web Logs
App Logs
Database Logs
Container Logs
Container Metrics
Host Metrics
Database Metics
Network Metrics
Storage Metrics
Uptime
Response Time
Real User Monitoring
Txn Perf Monitoring
Code Tracing
Errors
APM SLA Metrics Logs

7. @aravindputrevu
Usual Scenario
Web Logs
App Logs
Database Logs
Container Logs
Container Metrics
Host Metrics
Database Metics
Network Metrics
Storage Metrics
Uptime
Response Time
Real User Monitoring
Txn Perf Monitoring
Code Tracing
Errors
APM Tool SLA Tool Metrics Platform Logs Platform
{HH:MM:SS}

8. @aravindputrevu
Best Approach
Web Logs
App Logs
Database Logs
Container Logs
Container Metrics
Host Metrics
Database Metics
Network Metrics
Storage Metrics
Uptime
Response Time
Real User Monitoring
Txn Perf Monitoring
Code Tracing
Errors
APM SLA Metrics Logs
{HH:MM:SS}

9. @aravindputrevu
Best Approach
Web Logs
App Logs
Database Logs
Container Logs
Container Metrics
Host Metrics
Database Metics
Network Metrics
Storage Metrics
Uptime
Response Time
Real User Monitoring
Txn Perf Monitoring
Code Tracing
Errors
APM SLA Metrics Logs
{HH:MM:SS}

10. @aravindputrevu
Frameworks & Tools

11. @aravindputrevu
But then, each tool ships/stores data in
different schema?

12. @aravindputrevu
Common Data Schema

13. @aravindputrevu
Correlatable
Common Data Schema
github.com/elastic/ecs

14. @aravindputrevu
Common Data Schema
github.com/elastic/ecs
● Defines a common set of
fields for ingesting data
into Elasticsearch.
● Helps you correlate data
from different source types
Logs, Metrics and Traces
● Designed to be extensible
and reusable

15. @aravindputrevu*Prometheus ships to ES via metricbeat module
ECS
ECS

16. @aravindputrevu
Demo - 1
Logs
Metrics
Traces
Observability
Platform
Uptime

17. @aravindputrevu
Demo - 2
Logs
Metrics
Traces
Observability
Platform
Uptime

18. @aravindputrevu
Demo - 2

19. @aravindputrevu
Demo - 2

20. @aravindputrevu
community.elastic.co
ela.st/observe

21. Thank you
Questions?
@aravindputrevu