Enterprises are adopting multi-cloud or hybrid infrastructures to avoid vendor lock-in, reduce latencies, maximize ROI, and add redundancy. While these new deployment patterns have many benefits, centrally monitoring such a mixed system is challenging. Learn how the Elastic Stack can provide a single pane of glass to monitor applications and services deployed across multiple public clouds such as Azure, AWS, and Google Cloud.

1. 1
Gaining Full Visibility Into
Multi-cloud Deployments
Kaiyan Sheng
Software Engineer, Observability

2. 2
This presentation and the accompanying oral presentation contain forward-looking statements, including statements
concerning plans for future offerings; the expected strength, performance or benefits of our offerings; and our future
operations and expected performance. These forward-looking statements are subject to the safe harbor provisions
under the Private Securities Litigation Reform Act of 1995. Our expectations and beliefs in light of currently
available information regarding these matters may not materialize. Actual outcomes and results may differ materially
from those contemplated by these forward-looking statements due to uncertainties, risks, and changes in
circumstances, including, but not limited to those related to: the impact of the COVID-19 pandemic on our business
and our customers and partners; our ability to continue to deliver and improve our offerings and successfully
develop new offerings, including security-related product offerings and SaaS offerings; customer acceptance and
purchase of our existing offerings and new offerings, including the expansion and adoption of our SaaS offerings;
our ability to realize value from investments in the business, including R&D investments; our ability to maintain and
expand our user and customer base; our international expansion strategy; our ability to successfully execute our
go-to-market strategy and expand in our existing markets and into new markets, and our ability to forecast customer
retention and expansion; and general market, political, economic and business conditions.
Additional risks and uncertainties that could cause actual outcomes and results to differ materially are included in
our filings with the Securities and Exchange Commission (the “SEC”), including our Annual Report on Form 10-K for
the most recent fiscal year, our quarterly report on Form 10-Q for the most recent fiscal quarter, and any
subsequent reports filed with the SEC. SEC filings are available on the Investor Relations section of Elastic’s
website at ir.elastic.co and the SEC’s website at www.sec.gov.
Any features or functions of services or products referenced in this presentation, or in any presentations, press
releases or public statements, which are not currently available or not currently available as a general availability
release, may not be delivered on time or at all. The development, release, and timing of any features or functionality
described for our products remains at our sole discretion. Customers who purchase our products and services
should make the purchase decisions based upon services and product features and functions that are currently
available.
All statements are made only as of the date of the presentation, and Elastic assumes no obligation to, and does not
currently intend to, update any forward-looking statements or statements relating to features or functions of services
or products, except as required by law.
Forward-Looking Statements

3. 3
You don’t choose multi-cloud; multi-cloud chooses you.
Enterprise Cloud Strategy
More than 1000 employees
Multiple public
N554
Single public
Single private
Multi-cloud
93%
Source: Flexera 2020 State of the Cloud Report
Hybrid cloud87%
6%
6%
1%

4. 4
Multi-Cloud Advantages:
• Avoid vendor lock-in
• Flexibility
• Resilience
• Cost efficiency
Challenges of Managing Multi-cloud:
• Siloed cloud vendor tools
• Multi-platform monitoring
• Expensive data egress
• Managing costs

5. 5
winlogbeatheartbeatpacketbeatmetricbeat functionbeatfilebeat auditbeat
Beats: Open Source Collectors

6. 6
On-Premises
alerting
User group A User group B
Observability With Multi-Cloud

7. 7
APM
Logs&Metrics
API
API
Azure
Monitor
Event
Hub
APM
GCP
Stackdriver
Logs&Metrics
API
APM
Logs&Metrics
API
AWS
CloudWatch
CCS
CCS
CCS
Future: Multi-Cloud and Cross Cluster

8. 8
Monitoring Metrics

9. 9
Method 1
Metrics
AWS
Services
Azure
Services
GCP
Services
Stackdriver
Monitoring
Monitor
CloudWatch
Method 2

10. 10
Configuration Example with OOTB Metricset
– module: aws
period: 5m
metricsets:
– ec2
credential_profile_name: elastic
– module: googlecloud
period: 1m
metricsets:
– compute
region: "us-"
project_id: "elastic-observability"
credentials_file_path: "/Desktop/gcp_creds.json"
exclude_labels: false
– module: azure
period: 300s
metricsets:
– compute_vm
client_id: '$AZURE_CLIENT_ID""}'
client_secret: '$AZURE_CLIENT_SECRET""}'
tenant_id: '$AZURE_TENANT_ID""}'
subscription_id: '$AZURE_SUBSCRIPTION_ID""}'
refresh_list_interval: 600s

11. 11
Configuration Example with Generic Metricset
– module: aws
period: 5m
metricsets:
– cloudwatch
credential_profile_name: elastic
metrics:
– namespace: AWS/EC2
– module: googlecloud
period: 1m
metricsets:
– metrics
credentials_file_path: "/Desktop/gcp_creds.json"
project_id: "elastic-observability"
metrics:
– aligner: ALIGN_NONE
service: compute
metric_types:
– "instance"
– module: azure
period: 5m
metricsets:
– monitor
client_id: '$CLIENT_ID""}'
client_secret: '$CLIENT_SECRET""}'
tenant_id: '$TENANT_ID""}'
subscription_id: '$SUBSCRIPTION_ID""}'
refresh_list_interval: 10m
resources:
– resource_query: "resourceType eq
'Microsoft.Compute/virtualMachines'"
metrics:
– name: "*"
namespace: "Microsoft.Compute/virtualMachines"
timegrain: "PT5M"

12. 12
demo

13. 13
Billing Metrics

14. 14
GCP
BigQuery
AWS Cost
Explorer
AWS
CloudWatch
Azure Cost
Management
Billing

15. 15
– module: azure
period: 24h
client_id: '$AZURE_CLIENT_ID""}'
client_secret: '$AZURE_CLIENT_SECRET""}'
tenant_id: '$AZURE_TENANT_ID""}'
subscription_id: '$AZURE_SUBSCRIPTION_ID""}'
metricsets:
– billing
– module: googlecloud
period: 24h
credentials_file_path: "/Desktop/gcp_creds.json"
metricsets:
– billing
project_id: "elastic-observability"
dataset_id: "master_gcp"
table_pattern: "gcp_billing_export_v1"
Configuration Example
– module: aws
period: 24h
credential_profile_name: elastic
metricsets:
– billing
cost_explorer_config:
group_by_dimension_keys:
– AZ
– INSTANCE_TYPE
– SERVICE
group_by_tag_keys:
– aws:createdBy

16. 16
demo

17. 17
Logs

18. 18
AWS
Services
Azure
Services
GCP
Services
SQS
S3
CloudWatch
Event Hub
PubSub
Logs

19. 19
filebeat.inputs:
– type: awscloudwatch
credential_profile_name: elastic-beats
log_group_arn: arn:aws:logs:us-east-1123:log-group:test:*
region: us-east-1
scan_frequency: 30s
start_position: beginning
api_timeout: 5m
filebeat.inputs:
– type: s3
credential_profile_name: elastic-beats
queue_url: https://sqs.us-east-1.amazonaws.com/123/test-fb-ks
credential_profile_name: elastic-beats
json.message_key: Records
Configuration Example Using Inputs

20. 20
– module: aws
cloudtrail:
enabled: true
var.credential_profile_name: elastic
var.queue_url: https://sqs.us-east-1.amazonaws.com/123/test-fb-ks
cloudwatch:
enabled: false
ec2
enabled: false
elb:
enabled: false
s3access:
enabled: false
vpcflow:
enabled: false
Configuration Example Using Fileset

21. 21
demo

22. 22
Thank You!
• Elastic Cloud: https://www.elastic.co/cloud
• Elastic Beats: https://www.elastic.co/beats
• Discuss Forum: https://discuss.elastic.co
• Github Repo: https://github.com/elastic/beats