Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
1
Elastic 5.0
…so much awesomeness!
Matias Cascallares, Solutions Architect
matias@elastic.co
• Made in Argentina, living in Singapore
• Java / Python / NodeJS
• Working with/in open source for the last 8 years
• Usi...
3
The Elastic Stack
4
It’s Complicated
5
5.0
6
5.0
7
8
Store, Index & Analyze
• Resilient; designed for
scale-out
• High availability;
multitenancy
• Structured & unstructured...
• Lower memory usage & improved cluster stability
(new keyword type)
• Better scoring, faster, reduced hardware demand
(Ok...
• Half the disk space
• Twice as fast to ingest
• 25% faster to search
• For numeric and geospatial fields only
• Scaled f...
Some Benchmarks
Some Benchmarks
New Scripting Language: Painless
• Aggregation and suggestion results are
cached on shard level for instant returns
after the first query.
• Combined with ...
Rollover API
• Indices not based on time, but on size of the data.
• Even if your data sizes are not consistent per day, E...
Shrink API
• Reduce resources on immutable data
• Easily reduce the number of shards to free up resources
• Indices can be...
• Low-level client
• Allows communication through HTTP/S
• Sync and Async semantics
• Connection handling
• Node discovery...
• Define processing pipelines right in the Elasticsearch cluster.
• Depending on use case, can simplify the architecture
•...
Bootstrap Checks
Bootstrap Checks
Bootstrap Checks
• Detects if it’s running in production or development mode
• When running in production, it will now ref...
More Goodies…
• Dots in field names was supported in 1.x, and was removed in 2.x. 5.0
support dots in field names again!
More Goodies…
• New lock method increases small document indexing up to 15-20%
• New fsync method for increased ingestion ...
Version Compatibility
IDX_v1x IDX_v2x IDX_v5x
ES 1.X
ES 2.X
ES 5.X
Website: www.elastic.co
Products: https://www.elastic.co/products
Forums: https://discuss.elastic.co/
Community: https://w...
Elasticsearch 5.0
Elasticsearch 5.0
Upcoming SlideShare
Loading in …5
×

Elasticsearch 5.0

What's new in Elasticsearch 5.0? Take a look at all the new cool features we introduced in version 5.

  • Be the first to comment

Elasticsearch 5.0

  1. 1. 1 Elastic 5.0 …so much awesomeness! Matias Cascallares, Solutions Architect matias@elastic.co
  2. 2. • Made in Argentina, living in Singapore • Java / Python / NodeJS • Working with/in open source for the last 8 years • Using Elasticsearch since 2014, working for Elastic since 2015 • Meme lover > whoami
  3. 3. 3 The Elastic Stack
  4. 4. 4 It’s Complicated
  5. 5. 5 5.0
  6. 6. 6 5.0
  7. 7. 7
  8. 8. 8 Store, Index & Analyze • Resilient; designed for scale-out • High availability; multitenancy • Structured & unstructured data Distributed & Scalable Developer Friendly Search & Analytics • Schemaless • Native JSON • Client libraries • Apache Lucene • Real-time • Full-text search • Aggregations • Geospatial • Multilingual
  9. 9. • Lower memory usage & improved cluster stability (new keyword type) • Better scoring, faster, reduced hardware demand (Okapi BM25) • IPv6 type support Update To Lucene 6
  10. 10. • Half the disk space • Twice as fast to ingest • 25% faster to search • For numeric and geospatial fields only • Scaled floats • Technically a BKD Tree implementation Lucene Demensional Fields
  11. 11. Some Benchmarks
  12. 12. Some Benchmarks
  13. 13. New Scripting Language: Painless
  14. 14. • Aggregation and suggestion results are cached on shard level for instant returns after the first query. • Combined with a new query rewrite, typical Kibana dashboards that use “last X days” type of queries will improve dramatically. Shard Request Cache
  15. 15. Rollover API • Indices not based on time, but on size of the data. • Even if your data sizes are not consistent per day, Elasticsearch will use constant index/shard sizes. • Set up rules around automatic rollover to a new index, with aliases.
  16. 16. Shrink API • Reduce resources on immutable data • Easily reduce the number of shards to free up resources • Indices can be shrunk to a factor of its original number of shards
  17. 17. • Low-level client • Allows communication through HTTP/S • Sync and Async semantics • Connection handling • Node discovery (sniffer module) Java REST Client
  18. 18. • Define processing pipelines right in the Elasticsearch cluster. • Depending on use case, can simplify the architecture • Has Processors for the most common actions. • Combine it with Logstash when needed for power & flexibility. Ingest Node
  19. 19. Bootstrap Checks
  20. 20. Bootstrap Checks
  21. 21. Bootstrap Checks • Detects if it’s running in production or development mode • When running in production, it will now refuse to start under certain conditions that could seriously impact performance, stability, or data integrity ‒ Heap size (initial vs max) ‒ Memory lock (mlockall) ‒ Virtual memory size ‒ File descriptors ‒ Threads ‒ JVM in server mode
  22. 22. More Goodies… • Dots in field names was supported in 1.x, and was removed in 2.x. 5.0 support dots in field names again!
  23. 23. More Goodies… • New lock method increases small document indexing up to 15-20% • New fsync method for increased ingestion speed • refresh=[true|wait_for] for index, update, delete and bulk APIs • Migration Helper ‒ Cluster checkup before upgrading ‒ Reindex helper for 1.x indices ‒ Deprecation logging
  24. 24. Version Compatibility IDX_v1x IDX_v2x IDX_v5x ES 1.X ES 2.X ES 5.X
  25. 25. Website: www.elastic.co Products: https://www.elastic.co/products Forums: https://discuss.elastic.co/ Community: https://www.elastic.co/community/meetups Twitter: @elastic Thank You.

×