OSMC 2019 | Improved Observability Using Automated, OpenCensus-based Application Monitoring Solutions by Tobias Angerstein
Today’s complexity of enterprise software systems increases the importance of observability and monitoring solutions. DevOps teams or the developers and operators in the “classical world”, respectively, need clear transparency about the performance, availability and reliability behavior of their software-systems to be able to manage an appropriate level of service quality. Besides the big, commercial Application Performance Management (APM) solutions the open-source market provides a huge variety of different tools targeting different aspects of APM. Combining these tools opens great potential for building flexible, tailored APM solutions. Open standards, such as OpenTracing, OpenCensus or OpenMetrics are supporting the vendor-independent collection of data. However, most of the open tools that are based on these standards still require manual adoption of code to instrument applications for data collection. Often, such code changes are not desired or simply just not possible. In this talk, we will present an open, OpenCensus-based approach that provides a simple, yet flexible, configuration-based way of collecting monitoring and business data. Data can be collected without the need for manual code changes. As OpenCensus is used under the hood, this approach allows creating tailored APM solutions, as monitoring backends can be exchanged without any additional overhead. In this talk, we give insights into the OpenCensus standard and show how OpenCensus instrumentation can be automated. Through practical examples using different open tools, we demonstrate the flexibility of the presented approach.
Recommended
Recommended
More Related Content
Recently uploaded
Recently uploaded (20)
Featured
Featured (20)
OSMC 2019 | Improved Observability Using Automated, OpenCensus-based Application Monitoring Solutions by Tobias Angerstein
- 1. Improved Observability Using Automated, OpenCensus-based Application Monitoring Solutions Tobias Angerstein
- 2. About myself
- 4. The Open Source Ecosystem for APM https://openapm.io
- 5. The Open Source Ecosystem for APM https://openapm.io
- 7. 2005 2008 2010 2015 2018 Starting Devloping “NovaSpy” First Version of inspectIT 1.0 Release of inspectIT inspectIT goes OpenSource
- 8. Old World - InspectIT Java Agent • Dynamic Instrumentation • Tracing • JVM Metrics Central Management Repository • Agent Management • Aggregation/ Storage • Traces API • Alerting InspectIT Rich Client • Configuration • Analysis • Visualization EUM Agent .Net Agent Android Agent IOS Agent
- 9. InspectIT | Challenges Java Agent Central Management Repository InspectIT Rich Client No open Standard Not performant, inflexible Bad Scalability
- 11. But what about … … the increasing maintenance effort of monitoring code
- 12. But what about … … if the application is a black box
- 13. But what about … … typical APM features?
- 14. The answer: inspectIT Ocelot inspectIT Ocelot Simplify and automate data collection Distributed Tracing Context-sensitive Metrics Dependency Discovery Interoperability Dynamic Instrumentation Runtime Attachment
- 16. Distributed Tracing Distributed Tracing Context-sensitive Metrics Dependency Discovery Interoperability Dynamic Instrumentation Runtime Attachment • Common Trace Properties • TraceID • SpanID • Start-/ Stop- Time • Attributes • Span Kind • SpanID Propagation • X-B3-TraceId • X-B3-SpanId • X-B3-Sampled OpenCensus
- 23. Dynamic Instrumentation Distributed Tracing Context-sensitive Metrics Dependency Discovery Interoperability Dynamic Instrumentation Runtime Attachment • Asynchronous • Overhead is configurable • Instrumentation can be dynamically changed
- 26. End User Monitoring Website Web Server Monitoring Services (InfluxDB, Zipkin, ...) Boomerang Ocelot EUM Server Auslieferung der Website und deren Kommunikation Metriken / Traces Metriken EUM Metriken (Navigation-Timings, ...) (Backend) (EUM) Auslieferung des JS-Agents Web Server
- 27. Configuration • Default Configuration • File-based / Server-based • Dynamic Configuration RulesScopes Actions
- 28. Configuration Server & UI Configuration UI Service 1 Service 2 Configuration Server
- 29. Configuration Server & UI
- 30. Configuration Server & UI
- 31. Configuration - Metrics • CPU (usage and number of cores) • Disk Space (used and total) • Memory (used and available for various regions) • Threads (counts and states) • Garbage Collection (Pause times and collection statistics) • Class Loading (loaded and unloaded counts)
- 32. Configuration - Scopes Scope Name Attributes Matcher Matcher Mode Annotation Matcher
- 33. Configuration - Actions Action Name Input Java Code
- 34. Configuration - Rules Action Invocation Variable Name Metrics Definition
- 35. Configuration – Metric Exposition Views Aggregation
- 36. Configuration - Propagation • Down- Propagation • Up- Propagation
- 37. Configuration - Tracing Condition Tracing Flag Sampling Rate
- 40. DEMO TIME
- 41. Roadmap • Anomaly Detection (in-progress) • Kubernetes Support • OpenCensus -> OpenTelemetry OpenCensus inspectIT Ocelot