Monitor your Atlassian stack like the NSA
•
15 likes•11,910 views
Tom Moors gave a presentation on monitoring an Atlassian stack at the Atlassian User Group Belgium conference. He discussed the importance of monitoring for detecting issues, reducing costs, and improving service. He covered different levels of monitoring including availability, infrastructure, processes, applications, business metrics, and logs. He provided examples of tools that can be used for each level like Icinga, StatsD, Graphite, Logstash, and Kibana. He emphasized building a complete monitoring toolchain and using dashboards for visibility.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Monitor your Atlassian stack like the NSA
Similar to Monitor your Atlassian stack like the NSA (20)
More from ACA IT-Solutions
More from ACA IT-Solutions (20)
Recently uploaded
Recently uploaded (20)
Monitor your Atlassian stack like the NSA
- 1. Monitor your Atlassian stack like the NSA Tom Moors January 16th 2014 Atlassian User Group Belgium aca-it.be - 2014 http://www.flickr.com/photos/zigazou76/7670889680
- 2. @tommoors Who is Tom Moors? ✓ Atlassian Expert @ ACA IT-Solutions ✓ Poor drawer ✓ @tommoors ✓ t.moors@aca-it.be aca-it.be - 2014
- 4. @tommoors Costs money Why monitoring? Needs extra time aca-it.be - 2014
- 5. @tommoors Detect fraud Reduce costs Improve service Why monitoring? Save time Offer insights Opportunities aca-it.be - 2014 …
- 6. “If you can not measure it, you can not improve it.” –Lord Kelvin aca-it.be - 2014
- 8. @tommoors Agenda • Introduction • Building blocks • Monitoring levels • Conclusion aca-it.be - 2014
- 9. @tommoors What is monitoring? Observe and check the progress or quality of (something) over a period of time; keep under systematic review http://www.oxforddictionaries.com/definition/english/monitor aca-it.be - 2014
- 10. @tommoors What is monitoring? Super Monitoring aca-it.be - 2014
- 11. @tommoors Approach to monitoring? • Ride on the DevOps/Infrastructure as Code wave • Build a toolchain aca-it.be - 2014
- 12. @tommoors Goal Alerts ... when things go wrong ... before disaster strikes ... no spamming / false metrics User Interface • Context for post-mortem • Trends • Current state aca-it.be - 2014
- 13. @tommoors Monitoring basics • Gather data • Transport data • Process and store data • Present data • Alerts • Trends • History / Future aca-it.be - 2014
- 14. @tommoors Monitoring basics Metric Event ✓ ✓ Time Fields ✓ ✓ ✓ Time Name Value can be converted to aca-it.be - 2014 http://www.slideshare.net/roidelapluie/devops-andmonitoringowf13
- 16. @tommoors Availability • Built-in checks: ping • Service Delivery? aca-it.be - 2014
- 18. @tommoors Infrastructure System Services • CPU usage/min/max/average • Network • Memory usage/min/max/ average • Database • • Disk space • • Query timing LDAP / Active Directory IO Wait Other • Process load • SSL/TLS Certificates aca-it.be - 2014
- 19. @tommoors Infrastructure • Do-It-Yourself (Not Invented Here Syndrome) • CollectD • StatsD • Cacti • Ganglia • Hyperic • Nagios, Icinga • Zabbix aca-it.be - 2014
- 20. @tommoors Infrastructure google.com results Cacti Nagios 1,690,000 StatsD 1,470,000 Ganglia 1,150,000 Zabbix 922,000 Icinga 730,000 Hyperic 524,000 CollectD aca-it.be - 2014 1,740,000 225,000
- 23. @tommoors Icinga: Alerts Extensible with plugins • Mail • JIRA issue • Jabber/XMPP • HipChat • SMS • PagerDuty • … aca-it.be - 2014
- 24. @tommoors StatsD • UDP Network daemon • Aggregates data • Buckets with values • Type • • Timer • • Counter Gauge Backend: eg Graphite aca-it.be - 2014
- 25. @tommoors Graphite • Stores numeric time-series • Render graph of this data on demand ! Architecture • carbon: daemon • whisper: data storage • graphite webapp: frontend aca-it.be - 2014
- 28. @tommoors Process • Is the service/process still running? • Watchdog to (repair and) restart eg upstart, Monit, jsvc ! Potential problem ➞ send event aca-it.be - 2014
- 30. @tommoors JavaMelody • Plugin for JIRA, Confluence, Bamboo • Lightweight • Statistics and charts aca-it.be - 2014
- 31. @tommoors Java Applications: JMX Java Management eXtensions • MBeans representing device, application, resource • Set of readable (writable) attributes • Set of operations aca-it.be - 2014
- 32. @tommoors Java Applications: JMX aca-it.be - 2014
- 33. @tommoors Java Applications: JMX aca-it.be - 2014
- 34. @tommoors Working with JMX • Well-supported in tools (plugins) • Jolokia • jmxtrans aca-it.be - 2014
- 37. @tommoors Business Value How many… • new spaces? • issues created? • users active? • popular pages? • … Very specific metrics aca-it.be - 2014
- 38. @tommoors Business Value • Google Analytics • Piwik • (Hummingbird) • JIRA: reporting • Custom development aca-it.be - 2014
- 40. @tommoors Logs • Most up-to-date information • Best insights, eg why a HTTP 500? • Unstructured data • Massive amount from multiple sources aca-it.be - 2014
- 41. @tommoors Working with Logs Scribe Logstash free and open source commercial aca-it.be - 2014
- 43. @tommoors LogStash: design Input aca-it.be - 2014 Filter Output
- 44. @tommoors LogStash: design Input Filter Output 2013-10-29 12:48:43,663 Thread-67 ERROR [jira.issue.managers.DefaultCustomFieldManager] Could not load custom field type plugin with key 'com.pyxis.greenhopper.jira:gh-epic-label'. Is the plugin present and enabled? aca-it.be - 2014
- 45. @tommoors LogStash: design Input Filter Output 2013-10-29 12:48:43,663 Thread-67 ERROR [jira.issue.managers.DefaultCustomFieldManager] Could not load custom field type plugin with key 'com.pyxis.greenhopper.jira:gh-epic-label'. Is the plugin present and enabled? aca-it.be - 2014
- 49. @tommoors LogStash: architecture Shipper Shipper Shipper aca-it.be - 2014 Broker Indexer Search & Storage Web Interface
- 51. @tommoors One more thing… aca-it.be - 2014
- 52. @tommoors Dashboards • Buy a big TV for the office • Combine the most important metrics • SLA • Builds • Work done • Deployments • … aca-it.be - 2014
- 59. @tommoors Conclusion • Monitoring is a must • Great tools support great responsibility • There is no one-fits-all • Iterate over your configuration • Get close(r) with logs • Dashboards are a great reason to buy a big TV aca-it.be - 2014