Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Growing with elastic search

Draft slides for RootConf 2018

Related Books

Free with a 30 day trial from Scribd

See all
  • Be the first to comment

  • Be the first to like this

Growing with elastic search

  1. 1. Growing with ElasticSearch
  2. 2. The Journey - 2014 - Postgres full text search - only for admins - 5K users - 2 devs - 2015 - ElasticSearch (v1.4) powered search - for 25 K users - 3 devs - 2016 - Recommendations to users, search algorithms - Log monitoring for devs with Filebeat + Logstash - 1 lac users - 7 devs - 2017 - Kibana based analytics - Filebeat + Logstash - Powerful searches to give the users what they are looking for
  3. 3. - 2018 - ElasticSearch (v5.5) for recommendations and powerful searches, log monitoring solution for dev team, business analytics for higher management - 1M users - 22M docs - 5 devs - 2018 Roadmap - Machine learning and anomaly detection with v6.2 - Monitoring ES cluster and securing within ElasticStack The Journey Contd...
  4. 4. Search for a search engine - Postgres full text search wasn’t enough - Why ElasticSearch and not Solr or Sphinx ?
  5. 5. The goodness of ElasticSearch - Flexible Query DSL and REST APIs - ES queries are artistic creations :) - Scaling comes for free - Data aggregations are way to analytics - The stack around - suitable for data pipelines and analytics - Useful plugins - Up-to-date documentation and client libraries even with a very fast paced release cycle - Helpful community
  6. 6. Log monitoring: (would-be-)paid solution to Elastic based
  7. 7. Kibana - best pal to visualize - Any data - time series, geo data etc - Any chart - histograms, line graphs, pie charts, sunbursts, and more - Usability - non techies also can use it - Export and share the dashboards - [share screenshots]
  8. 8. Architecture [Architecture Diagram of our data pipelines involving Elastic Stack, few micro services and dozens of servers]
  9. 9. Performance tuning - very slow queries and how we solved them - Things to look into when the performance is not optimal
  10. 10. Monitoring and Securing the cluster - how we deal with the cluster - How v6.2 is going to change this landscape
  11. 11. Questions

    Be the first to comment

Draft slides for RootConf 2018

Views

Total views

120

On Slideshare

0

From embeds

0

Number of embeds

0

Actions

Downloads

1

Shares

0

Comments

0

Likes

0

×