Download as PDF, PPTX
![@tommoors
LogStash: design
Input
Filter
Output
2013-10-29 12:48:43,663 Thread-67 ERROR
[jira.issue.managers.DefaultCustomFieldManager] Could not load custom field type
plugin with key 'com.pyxis.greenhopper.jira:gh-epic-label'. Is the plugin present and
enabled?
aca-it.be - 2014](https://image.slidesharecdn.com/monitoryourstacklikethensa-140120073642-phpapp02/75/Monitor-your-Atlassian-stack-like-the-NSA-44-2048.jpg)
![@tommoors
LogStash: design
Input
Filter
Output
2013-10-29 12:48:43,663 Thread-67 ERROR
[jira.issue.managers.DefaultCustomFieldManager] Could not load custom field type
plugin with key 'com.pyxis.greenhopper.jira:gh-epic-label'. Is the plugin present and
enabled?
aca-it.be - 2014](https://image.slidesharecdn.com/monitoryourstacklikethensa-140120073642-phpapp02/75/Monitor-your-Atlassian-stack-like-the-NSA-45-2048.jpg)
Uploaded byACA IT-Solutions
Monitor your Atlassian stack like the NSA
Tom Moors gave a presentation on monitoring an Atlassian stack at the Atlassian User Group Belgium conference. He discussed the importance of monitoring for detecting issues, reducing costs, and improving service. He covered different levels of monitoring including availability, infrastructure, processes, applications, business metrics, and logs. He provided examples of tools that can be used for each level like Icinga, StatsD, Graphite, Logstash, and Kibana. He emphasized building a complete monitoring toolchain and using dashboards for visibility.
More Related Content
Similar to Monitor your Atlassian stack like the NSA
Monitor your Atlassian stack like the NSA
- 1. Monitor your Atlassianstack like the NSA Tom Moors January 16th 2014 Atlassian User Group Belgium aca-it.be - 2014 http://www.flickr.com/photos/zigazou76/7670889680
- 2. @tommoors Who is TomMoors? ✓ Atlassian Expert @ ACA IT-Solutions ✓ Poor drawer ✓ @tommoors ✓ t.moors@aca-it.be aca-it.be - 2014
- 3.
- 4. @tommoors Costs money Why monitoring? Needsextra time aca-it.be - 2014
- 5. @tommoors Detect fraud Reduce costs Improveservice Why monitoring? Save time Offer insights Opportunities aca-it.be - 2014 …
- 6. “If you cannot measure it, you can not improve it.” –Lord Kelvin aca-it.be - 2014
- 7.
- 8.
- 9. @tommoors What is monitoring? Observeand check the progress or quality of (something) over a period of time; keep under systematic review http://www.oxforddictionaries.com/definition/english/monitor aca-it.be - 2014
- 10. @tommoors What is monitoring? SuperMonitoring aca-it.be - 2014
- 11. @tommoors Approach to monitoring? • Rideon the DevOps/Infrastructure as Code wave • Build a toolchain aca-it.be - 2014
- 12. @tommoors Goal Alerts ... when thingsgo wrong ... before disaster strikes ... no spamming / false metrics User Interface • Context for post-mortem • Trends • Current state aca-it.be - 2014
- 13. @tommoors Monitoring basics • Gather data • Transportdata • Process and store data • Present data • Alerts • Trends • History / Future aca-it.be - 2014
- 14. @tommoors Monitoring basics Metric Event ✓ ✓ Time Fields ✓ ✓ ✓ Time Name Value can beconverted to aca-it.be - 2014 http://www.slideshare.net/roidelapluie/devops-andmonitoringowf13
- 15.
- 16. @tommoors Availability • Built-in checks: ping • ServiceDelivery? aca-it.be - 2014
- 17.
- 18. @tommoors Infrastructure System Services • CPU usage/min/max/average • Network • Memory usage/min/max/ average • Database • • Diskspace • • Query timing LDAP / Active Directory IO Wait Other • Process load • SSL/TLS Certificates aca-it.be - 2014
- 19. @tommoors Infrastructure • Do-It-Yourself (Not InventedHere Syndrome) • CollectD • StatsD • Cacti • Ganglia • Hyperic • Nagios, Icinga • Zabbix aca-it.be - 2014
- 20.
- 21.
- 22.
- 23. @tommoors Icinga: Alerts Extensible withplugins • Mail • JIRA issue • Jabber/XMPP • HipChat • SMS • PagerDuty • … aca-it.be - 2014
- 24. @tommoors StatsD • UDP Network daemon • Aggregatesdata • Buckets with values • Type • • Timer • • Counter Gauge Backend: eg Graphite aca-it.be - 2014
- 25. @tommoors Graphite • Stores numeric time-series • Rendergraph of this data on demand ! Architecture • carbon: daemon • whisper: data storage • graphite webapp: frontend aca-it.be - 2014
- 26.
- 27.
- 28. @tommoors Process • Is the service/processstill running? • Watchdog to (repair and) restart eg upstart, Monit, jsvc ! Potential problem ➞ send event aca-it.be - 2014
- 29.
- 30. @tommoors JavaMelody • Plugin for JIRA,Confluence, Bamboo • Lightweight • Statistics and charts aca-it.be - 2014
- 31. @tommoors Java Applications: JMX JavaManagement eXtensions • MBeans representing device, application, resource • Set of readable (writable) attributes • Set of operations aca-it.be - 2014
- 32.
- 33.
- 34. @tommoors Working with JMX • Well-supportedin tools (plugins) • Jolokia • jmxtrans aca-it.be - 2014
- 35.
- 36.
- 37. @tommoors Business Value How many… • newspaces? • issues created? • users active? • popular pages? • … Very specific metrics aca-it.be - 2014
- 38. @tommoors Business Value • Google Analytics • Piwik • (Hummingbird) • JIRA:reporting • Custom development aca-it.be - 2014
- 39.
- 40. @tommoors Logs • Most up-to-date information • Bestinsights, eg why a HTTP 500? • Unstructured data • Massive amount from multiple sources aca-it.be - 2014
- 41. @tommoors Working with Logs Scribe Logstash freeand open source commercial aca-it.be - 2014
- 42.
- 43. @tommoors LogStash: design Input aca-it.be -2014 Filter Output
- 44. @tommoors LogStash: design Input Filter Output 2013-10-29 12:48:43,663Thread-67 ERROR [jira.issue.managers.DefaultCustomFieldManager] Could not load custom field type plugin with key 'com.pyxis.greenhopper.jira:gh-epic-label'. Is the plugin present and enabled? aca-it.be - 2014
- 45. @tommoors LogStash: design Input Filter Output 2013-10-29 12:48:43,663Thread-67 ERROR [jira.issue.managers.DefaultCustomFieldManager] Could not load custom field type plugin with key 'com.pyxis.greenhopper.jira:gh-epic-label'. Is the plugin present and enabled? aca-it.be - 2014
- 46.
- 47.
- 48.
- 49. @tommoors LogStash: architecture Shipper Shipper Shipper aca-it.be -2014 Broker Indexer Search & Storage Web Interface
- 50.
- 51.
- 52. @tommoors Dashboards • Buy a bigTV for the office • Combine the most important metrics • SLA • Builds • Work done • Deployments • … aca-it.be - 2014
- 53.
- 54.
- 55.
- 56.
- 57.
- 58.
- 59. @tommoors Conclusion • Monitoring is amust • Great tools support great responsibility • There is no one-fits-all • Iterate over your configuration • Get close(r) with logs • Dashboards are a great reason to buy a big TV aca-it.be - 2014
- 60.
- 61.