Can (and should) we deliver dashboards, searches and alerting as code? Yes! Learn about the lifecycle of traditional telemetry artifacts and dig into the problems encountered when maintaining them by hand. Then see a demo of how Ellie Mae is implementing “Telemetry as Code” using the power of Kibana and its APIs with Terraform.

1. © 2018 Ellie Mae. All rights reserved.
TM
Telemetry as Code
Anthony Johnson
Principal Engineer, Cloud

2. © 2018 Ellie Mae. All rights reserved.
Me

3. © 2018 Ellie Mae. All rights reserved.
Typical Company Background
Too many technologies,
Too many directions Human touchExpensive

4. © 2018 Ellie Mae. All rights reserved.
Results
4
Lots of data! Still can’t see!

5. © 2018 Ellie Mae. All rights reserved.
Elastic Stack
5
- Another tool …

6. © 2018 Ellie Mae. All rights reserved.
Thinking as a Service!
6
Centralized Team Service Team

7. © 2018 Ellie Mae. All rights reserved.
“____________ as Code”
7
•Declarative
•Spec-driven
•Enforcement
•Checked-in (SCM)
Infrastructur
e
Telemetry

8. © 2018 Ellie Mae. All rights reserved.
Declarative vs Imperative
8

9. © 2018 Ellie Mae. All rights reserved.
Spec can be Continuously Deployed
9
Nobody cares more about the well-being of a system more than the person who
wrote it.

10. © 2018 Ellie Mae. All rights reserved.
10
Enabling Elastic as Code – What do we
need
I created one!
An API
A tool to orchestrate the API
A plugin for the tool
Kibana saved_objects API
Terraform for us today

11. © 2018 Ellie Mae. All rights reserved.
Using Terraform for Telemetry Code…
11https://github.com/ansoni/terraform-provider-elastic
provider "elastic" {
kibana_url = "http://127.0.0.1:5601"
elasticsearch_url = "http://127.0.0.1:9200"
}
resource "elastic_elasticsearch_index_data" "shakespeare"
{
index_name = "shakespeare",
file_url = "https://download.elastic.co/
somefile.json"
}

12. © 2018 Ellie Mae. All rights reserved.
Continuous Telemetry – My Solution
12
Demo time!

13. © 2018 Ellie Mae. All rights reserved.
13

14. © 2018 Ellie Mae. All rights reserved.
14

15. © 2018 Ellie Mae. All rights reserved.
15

16. © 2018 Ellie Mae. All rights reserved.
16

17. © 2018 Ellie Mae. All rights reserved.
17

18. © 2018 Ellie Mae. All rights reserved.
18

19. © 2018 Ellie Mae. All rights reserved.
19

20. © 2018 Ellie Mae. All rights reserved.
20

21. © 2018 Ellie Mae. All rights reserved.
21

22. © 2018 Ellie Mae. All rights reserved.
22

23. © 2018 Ellie Mae. All rights reserved.
Learn more and Engage
23
Anthony Johnson
Twitter
@ansonium
LinkedIn
https://www.linkedin.com/in/ansonium/
Terraform Provider
https://github.com/ansoni/terraform-provider-elastic