Do you want to know how to upgrade the elastic stack on v7.7? Join Melvyn from the Education team and Camilo Sierra from Support to get more details about the upgrade order, strategies and common issues

1. Upgrade the Elastic Stack
to v7.8
By Melvyn Peignon & Camilo Sierra
June 2020

2. CamiloSierraxPeignonmel

3. Elastic Enterprise Search Elastic SecurityElastic Observability
Kibana
Elasticsearch
Beats Logstash
3 solutions powered by 1 stack
Elastic Stack

4. Unified visibility
across your entire
ecosystem
Bring your logs, metrics, and
traces together into a single
stack so you can monitor, detect,
and react to events with speed.
ELASTIC OBSERVABILITY

5. Security how it
should be: open
Elastic Security integrates
endpoint security and SIEM to
give you prevention, collection,
detection, and response
capabilities for unified protection
across your infrastructure.
ELASTIC SECURITY

6. Search everything,
anywhere
Easily implement powerful,
modern search experiences
across your website, app, or
digital workplace. Search it
all, simply.
ELASTIC ENTERPRISE SEARCH

7. Deploy anywhere.
SaaS Orchestration
Elastic Cloud
on Kubernetes
Elastic Cloud Elastic Cloud
Enterprise
Elastic Enterprise Search Elastic SecurityElastic Observability
Kibana
Elasticsearch
Beats Logstash
Powered by
the stack
3 solutions
Deployed
anywhere

8. Upgrade Explained

9. You can not roll back
Upgrade Elasticsearch
Full cluster restart Rolling upgrade
Check
breaking
changes first!
Security is a
Free feature
● Upgrade to the latest minor version
available,
● Check breaking changes,
● Run the Kibana upgrade assistant.
5.05.5 to 6.x Enable Security 5.6.16 to 6.8.8
Reindex (API)
This is a great Option, but it’s
expensive and hard to scale!
x.x >> v7.7.1
You have two environments!
6.0/6.7 to 6.8.8
6.8 to 7.7.1
Then

10. Rolling upgrade

11. It’s better if you turn off all
the Kibana nodes during the
upgrade.
And If you have more
than one Kibana, restart
one kibana first (wait until
it’s working), then start
the others.

12. Q & A!

13. Upgrading the Stack

14. Stack Upgrade Path
Stack Upgrade Path
Elasticsearch
Hadoop
Elasticsearch Kibana Logstash Beats APM Server Plugins
https://www.elastic.co/guide/en/elastic-stack/current/upgrading-elastic-stack.html

15. Upgrade Assistant

16. 7.0 Upgrade Assistant
• Deprecation warning tool
• Reindexing tool for indices created in 5.x
• Available in Kibana 6.6+
‒ Must upgrade to 6.7+ for latest warnings + reindexing tool
• Free with the Basic License
Upgrading your Elastic Stack to 7.x

17. 7.0 Upgrade Assistant

18. Demo

19. Upgrading Good Practices

20. How to prepare an
Upgrade?
& Best practices!

21. Snapshot and restore API !
Repository backends that are available:
● [included] Shared file system repository,
● [included] Source repository (source-only
snapshots that take up to 50% less space on
disk),
● [toInstall] repository-s3 for S3 repositories,
● [toInstall] repository-hdfs for HDFS repository
support in Hadoop environments,
● [toInstall] repository-azure for Azure storage
repositories,
● [toInstall] repository-gcs for Google Cloud
Storage repositories.

22. A new era for cluster
coordination in
Elasticsearch (from v7

23. Reality (Production cluster)
Testing the upgrade (with
one node cluster)

24. “master not
discovered or elected
yet, an election
requires a node with
id”
When Rolling
upgrade you can not
turn off two of three
master-eligible
nodes!

25. The closed indices
created in older
versions of
Elasticsearch (v2 or
v5, need to be
reindexed to ensure
compatibility with
Elasticsearch v6.8 &
v7.7.

26. When rolling
upgrade, I will not
ask you to deploy on
Friday...
But try to deploy
when the load in
the servers is low.

27. Demonstration

28. Support: Tips and Tricks

29. When you upgrade Kibana
sometimes it will try to load
previous asset versions
leading to different errors in
browser console.
Please remove the
proxy server cache and
the browser cache.

30. If you have forked
the templates
provided by
default in Beats,
you will need to
update your fork with
the new v7.7 beats
templates.

31. When rolling
upgrade, this
ain't a race in
who upgrades
faster the
cluster.

32. What to do when
everything goes wrong?
These commands enable you
to perform certain unsafe
operations, to save your
cluster life!

33. 7.8 Features!

34. Lens (New charts)
Dashboard-to-dashboard
drilldown.

35. Not anymore with v7.8
● asynchronous search !!!!
● We’ve reduced aggregation memory
consumption by maintaining serialized results
for as long as possible,
● Since Elasticsearch 7.7 we’ve dramatically
reduced heap memory consumption for these
time-series use cases by moving the terms
index of the _id off heap.
● Improve the performance of queries that were
sorted by dates or numbers.
● Faster results when querying time-based indices
by filtering out entire shards if the shard doesn't
contain any documents with competitive
timestamps.

36. Q & A!