The document discusses logs, metrics, real-time data analytics, and tools used for collecting and analyzing such data. It defines what logs and metrics are, and names several tools for collecting and visualizing metrics as well as analyzing real-time data, including the ELK stack. The ELK stack consists of Elasticsearch for storage, Logstash for parsing, and Kibana for analytics and visualization. The document also provides examples of how the ELK stack works and how Terragon has applied it to various applications.

1. Logs, Metrics and Real-
time Data Analytics
By DIAGBOYA EWERE

2. Contents
- What are Metrics
- Real-time Data
- Tools for Metrics
- Tools for Real-time
Analytics
- ELK Stack
- What we have done
- Conclusion

3. What is a Log ?
“a log file is a file that records either events that occur in an operating system or other
software runs, or messages between different users of a communication software”

4. What is a Metric ?
“a system or standard of
measurement”
2014 2015 2016 2017

5. Metric Tools
- Kibana
- Graphana
- Graphite
- AWS Quicksight
- AWS Kinesis Firehose

6. ELK Stack
- Elasticsearch - lucene based search engine database
- Logstash - parse any type of file and stash to a database
- Kibana - analytics and visualization

7. Elasticsearch
Elasticsearch is a search engine based on Lucene. It
provides a distributed, multitenant-capable full-text search
engine with an HTTP web interface and schema-free JSON
documents.

8. Logstash
Logstash is an open source, server-side data processing
pipeline that ingests data from a multitude of sources
simultaneously, transforms it, and then sends it to your
favorite “stash.” (Ours is Elasticsearch, naturally.)

9. Kibana
Kibana is an open source data visualization plugin for
Elasticsearch. It provides visualization capabilities on top of
the content indexed on an Elasticsearch cluster.

10. ELK
=
Data Insight/Intelligence

11. How it works
Step 1
Write Logstash config
to read data from
source (log file,
database) start
Logstash
Step 2
Data is written to
Elasticsearch with
specified index
Step 3
Profile the Index in
Kibana and
Visualization and
Analytics

12. Applications in Terragon
- Coollikethat Campaign
- Mobilezone and Soccerchamp
- Kannel Logs

13. Demo

14. Thank you