This document provides an introduction to exploring data using the Elastic stack, which includes Logstash, Beats, Elasticsearch, and Kibana. It outlines the basic steps to get data into Elasticsearch, explore it, clean and transform the data, and then productionize the data exploration process. A demo example is also presented that uses a cars.csv file to demonstrate exploring used car offerings data in the Elastic stack. The document concludes by noting how the general setup scales well for large data sets and recommends moving data transformation upstream and creating clean dashboards for end users.

1. 1
Data exploration using
Elastic stack for beginners
Joe Reuter, October 2020

2. 2
The Elastic stack
Logstash
Beats
Elasticsearch Kibana

3. 3
Exploration using the stack
● Steps
○ Get your data into Elasticsearch
○ Explore
○ Clean up / transform
○ Productionize
● Continuous data streaming
○ Set up once, continue to ingest data

4. 4
Demo example:
Used car offerings

5. 5
Demo example
cars.csv

6. 6
Demo

7. 7
Productionize
You are almost there

8. 8
Productionize your data exploration
● The general setup scales nicely to very large data sets - no need to change
much
● Move data transformation and cleanup upstream (e.g. Logstash) - this
improves performance
● Create clean dashboards for end users not interested in inner workings
○ Filter controls
○ Report generation

9. 9
elastic.co
demo.elastic.co
cloud.elastic.co