This document discusses using the Elastic Stack, which is an open source analytics stack for log analytics, system metrics analytics, and application metrics analytics. It includes Elasticsearch for indexing and searching data, Kibana for visualizing data, Beats for collecting and shipping data to Elasticsearch, and Logstash for processing pipelines. The document provides an overview of these tools and includes a demo.

1. Open Source Operations Analytics with Elastic
Arthur Gimpel
GM, DataZone

2. DataZone - Data is Our Business
Troubleshooting
& Tuning
Technological
Evaluation
Training
Services
Architecture Review
Cost
Management
End-to-End
Implementations
Leading trusted advisor and integrator for data and search applications
Infrastructure
Support / DevOps

3. Operations Analytics
• Log Analytics
• System Metrics Analytics
• Application Metrics Analytics
• Application Performance Monitoring

4. Logs logs logs…

5. Metrics? Who needs it?

6. Metrics Matter
Facebook on early days:
150k users, little revenue
Many Competitors
What would indicate their success?

7. Metrics Matter
75% of the users visit Facebook more than once per
day
Within one month from launch on a new Campus,
more than 90% of the students are registered

8. Elastic Stack
100% open source
No enterprise edition
All new versions with 5.0

10. Elasticsearch
0p 2r 1p 0r 2p 1r
Index A
JSON

11. Kibana

12. Kibana

13. Beats
Lightweight data shippers
Ship data from the source Ship and centralize in
Elasticsearch
Ship to Logstash for
transformation and parsing
Ship to Elastic Cloud Libbeat: API framework to
build custom beats 30+ community Beats
Beats

14. Beats
FILEBEAT
Log Files
METRICBEAT
Metrics
PACKETBEAT
Network Data
WINGLOGBEAT
Window Events
More than 30 community Beats
and growing …
Apachebeat, dockbeat, httpbeat,
mysqlbeat, nginxbeat, redis beats,
twitterbeat, and more

15. Logstash
Logstash
Data processing pipeline
Ingest data of all shapes,
sizes, and sources
Parse and dynamically
transform data
Transport data to any
output
Secure and encrypt data
inputs
Build your own pipeline More than 200+ plugins

16. • NEST Client - Fully typed .NET
client exposing all Elasticsearch
APIs
• Windows Installers for all
elastic products
Elastic :heart: Microsoft

17. • Microsoft Azure -
Marketplace Template
Elastic :heart: Microsoft

18. DEMO

19. Thank You!Stay in touch: contact@datazone.io