ElasticSearch is very powerful. It can do many things and amongst those, full-text searching and aggregations. Getting aggregations is one thing but getting them fast is another.

1. From >40s to <100ms
aggregations
Cédric Fabianski
CTO & Co-Founder @ Bearer.sh

2. Consume APIs. Stay in control.
Monitor, track performance, detect anomalies and fix issues on
your critical API usage.

4. What issue did we encounter?
Very slow aggregations
when we started having more than 10M records per customers
Some of our customers reach this limit in one day only!

6. Time to load the aggregation > 40s 💥

7. How did we overcome this? 🤓

8. Migration from 7.2 to 7.6 ⬆️
https://github.com/elastic/elasticsearch/issues/45702

9. Use Rollup 🔄
https://www.elastic.co/guide/en/elasticsearch/reference/master/rollup-apis.html

10. What is a Rollup?
Summarizes old, high-granularity data into
reduced granularity format for long term storage

11. Use Rollup
Create the rollup job
In Kibana > Management > Rollup Jobs

15. Use Rollup
Perform aggregations using Rollup Index

18. Use Rollup (in Ruby)

19. Let’s talk 🐻
Twitter: @cfabianski @bearersh
email: cedric@bearer.sh