Download to read offline
Uploaded byChris Markou
Python + OpenTelemetry = ❤️ Where Python meets observability and open standards.pdf
Python + OpenTelemetry = ❤️ Where Python meets observability and open standards.pdf
![Jacob Marble [InfluxData] | Observability with InfluxDB IOx and OpenTelemetry...](https://cdn.slidesharecdn.com/ss_thumbnails/influxdbioxandopentelemetry-27-oct-2021jmarble-211022195239-thumbnail.jpg?width=640&height=640&fit=bounds)
Python + OpenTelemetry = ❤️ Where Python meets observability and open standards.pdf
- 1. Python + OpenTelemetry= ❤ Where Python meets observability and open standards PyCon Greece, 2025 Christos Markou | Software Engineer @ Elastic
- 2. - Principal SoftwareEngineer I @ Elastic - OpenTelemetry contributor - Approver and/or code-owner for various OpenTelemetry projects - CNCF Ambassador > whoami
- 4. An open-source observabilityframework A set of specifications and implementations for observability OTel
- 5.
- 6. Signals ● Traces ● Metrics ●Logs ● Profiles API SDK Agent / Auto Inst. SDK Semantic Conventions Collector Receivers Exporters Processors OTLP … Observability Backends Collector Receivers Exporters Processors
- 7. ResourceLogs OTLP - Signals- Semantic Conventions Resource LogRecord severity_text body Attributes host.name: my-host.xyz service.name: my-service Attributes http.request.method: GET http.route: /users/:userID client.address: 11.12.13.14 OTLP data format Semantic Conventions (simplified) OpenTelemetry Protocol Specification ● Protocol Buffers schema that is used for the payloads ● implemented over gRPC and HTTP
- 8.
- 9. OpenTelemetry for Python API:provides an interface to generate telemetry data SDK: implements the API, replacing no-ops with actual implementation
- 10. OpenTelemetry for Python SignalStability Level Traces ✅ Stable Metrics ✅ Stable Logs Experimental https://opentelemetry.io/docs/specs/otel/versioning-and-stability/#signal-lifecycle
- 11. - Manual instrumentation -Traces, Metrics, Logs - Auto-instrumentation - Auto-instrumentation on K8s - Resilience for log collection at scale - OpenTelemetry Demo application - Live Demo Agenda
- 12.
- 13. Tracing instrumentation initialize providerwith resource attrs add processor+exporter create trace and span
- 14.
- 15. Logs instrumentation trace provider logprovider set OTLP exporter log+trace set logging handler https://github.com/open-telemetry/opentelemetry-python/tree/main/docs/examples/logs
- 16.
- 17. Metrics instrumentation initialize provider create+increasecounter create+handle updowncounter
- 18.
- 19. Auto-instrumentation utilizes monkey-patching tomodify library functions at runtime, allowing for the capture of telemetry data from many popular libraries and frameworks.
- 20.
- 21.
- 22.
- 23. Resilience for Logs API SDKOTLP … Observability Backends ● Logs can contain crucial information and hence SHOULD always be captured ● Sending Logs through OTLP over the network might not provide the best reliability ● Writing OTLP Logs into local files (i.e. through stdout) and then collecting them independently can enhance resilience.
- 24.
- 25. Resilience for Logs ●https://github.com/open-telemetry/opentelemetry-python/issues/4661 ● https://gist.github.com/ChrsMark/dc36896f0e5755e7bbaab7c49b5aa5a8 The above output can be parsed back into OTLP by the following Opentelemetry Collector components: ● otlpjsonfilereceiver ● filelogreceiver+otlpjsonconnector
- 26.
- 27. OpenTelemetry Demo https://opentelemetry.io/docs/demo/ Otel HelmCharts Sending to Prometheus and Jaeger
- 28. OpenTelemetry Demo API SDK Collector Receivers Exporters Processors … OTLP Sendingto Prometheus and Jaeger
- 29. OpenTelemetry Demo Sending toElasticSearch
- 30.
- 31. Questions / Keepin touch CNCF Slack #otel-python #opentelemetry #otel-collector OTel Python SIG Meetings Thursday at 19:00 pm (Eastern European Time) @ChrsMark