Open Distro for Elasticsearch is a 100% open-source distribution of Elasticsearch, the popular search and analytics engine. In this session, you explore its many new advanced features, previously available only in commercial software, including encryption in-transit, role-based access control (RBAC), event monitoring and alerting, SQL support, cluster diagnostics, and more. Open Distro for Elasticsearch is licensed under Apache 2.0, so you can view, use, modify, and distribute the code without any restrictions. We also show you how you can join the Open Distro for Elasticsearch community to accelerate open innovation for Elasticsearch.

1. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Introducing Open Distro for
Elasticsearch
Carl Meadows
Principal Product Manager
AWS – Search Services
A D B 2 0 1

2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Source: TechCrunch survey of popular open source software from April’17
What is Elasticsearch
• Sometimes referred to as the “ELK
Stack” – Elasticsearch, Logstash &
Kibana
• Distributed search and analytics
engine built on Apache Lucene
• Easy ingestion and visualization
• Developed in Java

3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Machine data driving Elasticsearch growth
Machine-generated data is growing 10x faster than business data… Logs, logs, and more logs
IT & DevOps: Databases,
servers, storage,
networking
Increase in IoT and mobile
devices: Gaming, sensors, web
content
Cloud-based
architectures
Source: insideBigData, “The Exponential Growth of Data,” February 16, 2017

4. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
An Apache 2.0-licensed distribution
of Elasticsearch enhanced with
enterprise-grade security, alerting,
SQL, and more

5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
How we think about OSS licensing
and distribution?
Base OSS
free of
proprietary code
Keep commercial
software on top
of OSS separate
Allow anyone
to innovate
on OSS
Don’t change licensing
or distribution
midstream

6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Benefits of Open Distro for Elasticsearch
Enterprise-grade
Delivering security
and advanced capabilities such
as alerting, SQL,
and cluster diagnostics
100% open source Providing
you the
freedoms so you can
freely view, use, change, and
distribute the code
Community-driven
Providing individuals
and organizations the freedom
to easily contribute changes to
the distro

7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Open Distro for Elasticsearch – Features
Security Alerting SQL Performance Analyzer
Achieve encryption in flight,
fine-grained access control,
audit logging, and compliance
Monitor your data and send
automatic alerts on any
changes in your data
Easily interact with your
Elasticsearch cluster and
extract insights using the
familiar SQL query syntax
Get deep visibility into system
bottlenecks even when your
Elasticsearch cluster is under
duress.

8. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Security
Keep your data secure
Encryption
Keep your data secure when in transit
Authentication
Leverage your existing authentication infrastructure
RBAC
Granular access control over user actions on your cluster
Audit logging
Track and record all user actions and meet HIPAA and PCI
compliance

9. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Request with
credentials
Access control flow for RBAC
Authc – Via basic HTTP auth, LDAP, AD, SAML, web tokens, SSL
Authz – Backend identities mapped to Open Distro roles
Permissions – Allow a role to perform an action against a
cluster/index/document/field
Action groups – Groups of permissions
Authc provider
Authc
Request with
user/backend
roles
Roles and
permissions
Authz
Response

10. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Kibana multi-tenancy
Group A Group B
Group B permissionsGroup A permissions
Index
1
Index
2

11. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Alerting
Receivealerts on your data
Create monitors
Query the data you want to and receive alerts on it
Customize alert conditions
Define alerting threshold and severity for multiple trigger
conditions
Get notifications
Built-in integrations for webhook and Slack to get
notified on the channels you use
View alerts
All alert executions are indexed for easy tracking and
visualization

12. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
SQL Support
Query data with SQL
Comprehensive SQL support
Supports over 40 functions, data types, and
commands, including join support
Translate SQL to JSON
Create JSON using SQL to configure sophisticated
access control policies
Use existing tools
Provides a JDBC driver so you can use a variety of
business intelligence, analytics, and ETL tools

13. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Performance Analyzer
Get deep diagnostic insights into your cluster
Identify bottlenecks across the stack
Provides a powerful REST API for querying Elasticsearch
metrics to diagnose issues across stack
Runs independent of your cluster
Perform diagnostics even if the cluster is under duress
Analyze hundreds of data points
Supports over 60 metrics across 10 dimensions for
instrumentation of your cluster health

14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
PerfTop CLI
• Provides pre-configured
dashboards for analyzing
cluster, node, and shard
performance
• Custom JSON templates to
create the dashboards to
diagnose your cluster
performance

15. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Flexible deployment options
• Docker
• RPM
• Debian

16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Simple to get started
Visit the
website
Download the
Elasticsearch and
Kibana packages
Load and query
data
1 2 3

17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Community and contributions
Open Distro for Elasticsearch’s success is driven by the community’s
participation, contributions, and innovation to the project.
You can follow project discussions, engage with fellow community members,
contribute PRs, file bugs, or request a feature at:
Discussion forums
https://discuss.opendistrocommunity.dev/
Community
https://github.com/opendistro-for-elasticsearch/community/issues

18. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Useful links
Project website and technical documentation
https://opendistro.github.io/for-elasticsearch/
Source Code
https://github.com/opendistro-for-elasticsearch

19. Thank you!
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Carl Meadows
carlmead@amazon.com