This document discusses automated monitoring using Grafana. It provides an overview of Grafana and how it can be used with InfluxDB for time series data collection, storage and visualization. It also describes how the Grafana API and Ansible can be used to automate dashboard creation and configuration management for monitoring.

1. Automated Monitoring
using
Grafana
Kittipun Khantitrirat (Tae)
Eakkapan Sinlapachipwilai (Oat)

2. DevOps stacks
Physical Infrastructure
Host OS Host OS Host OS
Network Storage
Orchestration
DevOps Tools:
Build Automation, Version Control, Configuration Management
Monitor/Logging
Container Container Container

3. What is
monitoring?

4. What is monitoring?
ALERT!!!
Fine.
Fixed it

5. Monitoring Stacks
Network
Physical
Devices
OS and
Application
Development
Application
Business

6. Network
● Bandwidth In/Out
● Connection
● Error/Loss
● Load on devices
● Traffic breakdown
● Latency

7. Physical devices
● Hardware
● Temperature
● Fans
● Voltages
● Power Consumption

8. OS and application
Operating System
● CPU
● Memory
● Hard Disk
● Network
● Load
Application
● Process
● Memory/Network footprint
● Logging
● Connection
● Specific value

9. Development application
● Response time
○ Function
○ API
● Connection
○ Database
○ Other services
● Success/Error
● Counting
● Logging
● Application Specific

10. Business

11. Type of monitoring data
Log
Metric
Check

12. Log

13. Metric

14. Check

15. Traditional monitoring tools

16. Modern monitoring tools

17. Modern monitoring features
● Dashboard
● Scaling
● Alert
● High Availability
● API
● Monitor as a Code
● Automated
● Developer Self Service

18. Monitor components
Database
Analysis
Alert
Visualize
Collector
Sensor

19. Monitor components

20. Grafana + InfluxDB

21. Automation with Grafana
● Grafana API (http://docs.grafana.org/http_api)

22. Automation with Grafana
● Dashboard creation via API
$ curl -X POST -H "Authorization: Bearer xxx" -H "Content-Type: application/json"
-d '{
"dashboard": {
"id": null,
"title": "Production Overview",
"tags": [ "templated" ],
"timezone": "browser",
"rows": [
{
}
],
"schemaVersion": 6,
"version": 0
},
"overwrite": false
}' http://localhost:3000/api/dashboards/db

23. Automation with Grafana & Ansible
+

24. Automation with Grafana & Ansible
● Ansible uri modules
● (https://docs.ansible.com/ansible/2.6/modules/uri_mod
ule.html)
- name: Dashboard | Import new dashboard
uri:
url: https://localhost:3000/api/dashboards/db
method: POST
force_basic_auth: yes
body: "{{ lookup('file','dashboard.json', errors='strict')|from_json
}}"
body_format: "json"
status_code: 200
headers:
Authorization: "Bearer XXXX"
Content-Type: application/json
return_content: yes
validate_certs: no

25. Automated IaaS monitoring
ServerTrigger
Deploy
Dashboard
Server
Deploy
Collector
Send
Stats

26. Demo

27. QA