OSMC 2018 | Scaling Icinga2 with many heterogeneous projects – and still preserving configurability by Max Rosin

NETWAYS
NETWAYSNETWAYS
Scaling Icinga2 with
many heterogeneous projects
and still preserving configurability
Max Rosin - Systems Engineer Monitoring
06.11.2018
SysEleven
2
• Managed Hosting
• SysEleven Stack
• MetaKube
• Internet Service Provider
• 100+ Employees
Max Rosin
Twitter, GitHub, etc: @ekeih
Why am I here?
3
Infrastructure
4
• 2 datacenters
• 3.000 hosts
• 60.000 services
• Several hundred different setups
Technical Debt
5
Technical Debt
6
Technical Debt
7
Requirements
8
• 100% automated
• High available
• Stage setup
• Maintainable
• Full state migration
Icinga2 Configuration
9
• Puppet modules
• https://github.com/Icinga/puppet-icinga2
• https://github.com/Icinga/puppet-icingaweb2
• Icinga2 server: sys11icinga2 module
• All clients: sys11monitoring module
• Settings: Hiera (Puppet)
Icinga2 Configuration
10
Other Puppet Modules
11
Hiera - Override Defaults
12
Hiera - HTTP-Check
13
Hiera - NRPE-Check
14
Host
15
Apply Services
16
OSMC 2018 | Scaling Icinga2 with many heterogeneous projects – and still preserving configurability by Max Rosin
OSMC 2018 | Scaling Icinga2 with many heterogeneous projects – and still preserving configurability by Max Rosin
NRPE?
19
Migrating is harder
than building from scratch!
20
icinga2-migration-utils
21
• Compare running Icinga1 and Icinga2 instances
• Migrate acknowledgements, downtimes and comments
• MIT license
https://github.com/syseleven/icinga2-migration-utils
22
23
24
25
26
Tips After One Year
27
• Build a stage setup
• Automate everything
• Track all related issues
• Build a stage setup
Is it perfect?
28
Talk about your Setups!
29
Thanks for listening!
E-Mail: m.rosin@syseleven.de
Twitter: @ekeih - GitHub: ekeih
Questions?
1 of 30

Recommended

OSMC 2018 | Current State of Icinga by Bernd Erk by
OSMC 2018 | Current State of Icinga by Bernd ErkOSMC 2018 | Current State of Icinga by Bernd Erk
OSMC 2018 | Current State of Icinga by Bernd ErkNETWAYS
293 views53 slides
CDK Meetup: Rule the World through IaC by
CDK Meetup: Rule the World through IaCCDK Meetup: Rule the World through IaC
CDK Meetup: Rule the World through IaCsmalltown
771 views39 slides
[OpenStack Day in Korea 2015] Track 2-6 - Apache Tajo on Swift by
[OpenStack Day in Korea 2015] Track 2-6 - Apache Tajo on Swift[OpenStack Day in Korea 2015] Track 2-6 - Apache Tajo on Swift
[OpenStack Day in Korea 2015] Track 2-6 - Apache Tajo on SwiftOpenStack Korea Community
848 views23 slides
Secrets management vault cncf meetup by
Secrets management vault cncf meetupSecrets management vault cncf meetup
Secrets management vault cncf meetupJuraj Hantak
154 views21 slides
Security threats with Kubernetes - Igor Khoroshchenko by
 Security threats with Kubernetes - Igor Khoroshchenko Security threats with Kubernetes - Igor Khoroshchenko
Security threats with Kubernetes - Igor KhoroshchenkoKuberton
340 views33 slides
AWS re:Invent re:Cap 2019: My ElasticSearch Journey on AWS by
AWS re:Invent re:Cap 2019: My ElasticSearch Journey on AWSAWS re:Invent re:Cap 2019: My ElasticSearch Journey on AWS
AWS re:Invent re:Cap 2019: My ElasticSearch Journey on AWSsmalltown
575 views26 slides

More Related Content

What's hot

Tokyo meetup 20160224 by
Tokyo meetup 20160224Tokyo meetup 20160224
Tokyo meetup 20160224Takao Setaka
1.2K views9 slides
Cncf k8s_network_03 (Ingress introduction) by
Cncf k8s_network_03 (Ingress introduction)Cncf k8s_network_03 (Ingress introduction)
Cncf k8s_network_03 (Ingress introduction)Erhwen Kuo
1.1K views32 slides
Mirantis OpenStack-DC-Meetup 17 Sept 2014 by
Mirantis OpenStack-DC-Meetup 17 Sept 2014Mirantis OpenStack-DC-Meetup 17 Sept 2014
Mirantis OpenStack-DC-Meetup 17 Sept 2014Mirantis
6.8K views69 slides
OSDC 2015: Bernd Erk | Why favour Icinga over Nagios by
OSDC 2015: Bernd Erk | Why favour Icinga over NagiosOSDC 2015: Bernd Erk | Why favour Icinga over Nagios
OSDC 2015: Bernd Erk | Why favour Icinga over NagiosNETWAYS
384 views62 slides
Lukáš Malý - Log management ELISA controlled by Zabbix | ZabConf2016 by
Lukáš Malý - Log management ELISA controlled by Zabbix | ZabConf2016Lukáš Malý - Log management ELISA controlled by Zabbix | ZabConf2016
Lukáš Malý - Log management ELISA controlled by Zabbix | ZabConf2016Zabbix
837 views29 slides
What You Missed: OpenStack Summit Austin by
What You Missed: OpenStack Summit AustinWhat You Missed: OpenStack Summit Austin
What You Missed: OpenStack Summit AustinNetApp
82 views18 slides

What's hot(20)

Tokyo meetup 20160224 by Takao Setaka
Tokyo meetup 20160224Tokyo meetup 20160224
Tokyo meetup 20160224
Takao Setaka1.2K views
Cncf k8s_network_03 (Ingress introduction) by Erhwen Kuo
Cncf k8s_network_03 (Ingress introduction)Cncf k8s_network_03 (Ingress introduction)
Cncf k8s_network_03 (Ingress introduction)
Erhwen Kuo1.1K views
Mirantis OpenStack-DC-Meetup 17 Sept 2014 by Mirantis
Mirantis OpenStack-DC-Meetup 17 Sept 2014Mirantis OpenStack-DC-Meetup 17 Sept 2014
Mirantis OpenStack-DC-Meetup 17 Sept 2014
Mirantis6.8K views
OSDC 2015: Bernd Erk | Why favour Icinga over Nagios by NETWAYS
OSDC 2015: Bernd Erk | Why favour Icinga over NagiosOSDC 2015: Bernd Erk | Why favour Icinga over Nagios
OSDC 2015: Bernd Erk | Why favour Icinga over Nagios
NETWAYS384 views
Lukáš Malý - Log management ELISA controlled by Zabbix | ZabConf2016 by Zabbix
Lukáš Malý - Log management ELISA controlled by Zabbix | ZabConf2016Lukáš Malý - Log management ELISA controlled by Zabbix | ZabConf2016
Lukáš Malý - Log management ELISA controlled by Zabbix | ZabConf2016
Zabbix837 views
What You Missed: OpenStack Summit Austin by NetApp
What You Missed: OpenStack Summit AustinWhat You Missed: OpenStack Summit Austin
What You Missed: OpenStack Summit Austin
NetApp82 views
Mirantis OpenStack 5.0 Overview by Mirantis
Mirantis OpenStack 5.0 OverviewMirantis OpenStack 5.0 Overview
Mirantis OpenStack 5.0 Overview
Mirantis2.5K views
ModSecurity and NGINX: Tuning the OWASP Core Rule Set (Updated) by NGINX, Inc.
ModSecurity and NGINX: Tuning the OWASP Core Rule Set (Updated)ModSecurity and NGINX: Tuning the OWASP Core Rule Set (Updated)
ModSecurity and NGINX: Tuning the OWASP Core Rule Set (Updated)
NGINX, Inc.2.1K views
NGINX Basics: Ask Me Anything – EMEA by NGINX, Inc.
NGINX Basics: Ask Me Anything – EMEANGINX Basics: Ask Me Anything – EMEA
NGINX Basics: Ask Me Anything – EMEA
NGINX, Inc.327 views
Cncf k8s_network_part1 by Erhwen Kuo
Cncf k8s_network_part1Cncf k8s_network_part1
Cncf k8s_network_part1
Erhwen Kuo880 views
Hug #9 who's keeping your secrets by Cameron More
Hug #9 who's keeping your secretsHug #9 who's keeping your secrets
Hug #9 who's keeping your secrets
Cameron More148 views
Open stack architecture overview-meetup-6-6_2013 by Mirantis
Open stack architecture overview-meetup-6-6_2013Open stack architecture overview-meetup-6-6_2013
Open stack architecture overview-meetup-6-6_2013
Mirantis30.7K views
Architecture Openstack for the Enterprise by Keith Tobin
Architecture Openstack for the EnterpriseArchitecture Openstack for the Enterprise
Architecture Openstack for the Enterprise
Keith Tobin2.1K views
A Million ways of Deploying a Kubernetes Cluster by Jimmy Lu
A Million ways of Deploying a Kubernetes ClusterA Million ways of Deploying a Kubernetes Cluster
A Million ways of Deploying a Kubernetes Cluster
Jimmy Lu1.5K views
The Challenges of Becoming Cloud Native by Ben Hall
The Challenges of Becoming Cloud NativeThe Challenges of Becoming Cloud Native
The Challenges of Becoming Cloud Native
Ben Hall345 views
Nagios World Conference 2015 - Scott Wilkerson Opening by Nagios
Nagios World Conference 2015 - Scott Wilkerson OpeningNagios World Conference 2015 - Scott Wilkerson Opening
Nagios World Conference 2015 - Scott Wilkerson Opening
Nagios1K views
Openstack Architecture by SrbIT
Openstack ArchitectureOpenstack Architecture
Openstack Architecture
SrbIT693 views

Similar to OSMC 2018 | Scaling Icinga2 with many heterogeneous projects – and still preserving configurability by Max Rosin

Icinga Camp Bangalore - Icinga integrations by
Icinga Camp Bangalore - Icinga integrationsIcinga Camp Bangalore - Icinga integrations
Icinga Camp Bangalore - Icinga integrationsIcinga
1.6K views67 slides
Experiences from Running Masterless Puppet - PuppetConf 2014 by
Experiences from Running Masterless Puppet - PuppetConf 2014Experiences from Running Masterless Puppet - PuppetConf 2014
Experiences from Running Masterless Puppet - PuppetConf 2014Puppet
7.8K views18 slides
Securing Hadoop @eBay by
Securing Hadoop @eBaySecuring Hadoop @eBay
Securing Hadoop @eBayDataWorks Summit
1.8K views22 slides
Icinga Camp Berlin 2018 - Dev and Ops Stories - Integrations++ by
Icinga Camp Berlin 2018 - Dev and Ops Stories - Integrations++Icinga Camp Berlin 2018 - Dev and Ops Stories - Integrations++
Icinga Camp Berlin 2018 - Dev and Ops Stories - Integrations++Icinga
1.7K views61 slides
Code lifecycle on the Acquia Cloud Platform by
Code lifecycle on the Acquia Cloud PlatformCode lifecycle on the Acquia Cloud Platform
Code lifecycle on the Acquia Cloud PlatformTimothy Hilliard
316 views13 slides
Openstack Ops Meetup Palo Alto LT by
Openstack Ops Meetup Palo Alto LTOpenstack Ops Meetup Palo Alto LT
Openstack Ops Meetup Palo Alto LTToshikazu Ichikawa
1.1K views11 slides

Similar to OSMC 2018 | Scaling Icinga2 with many heterogeneous projects – and still preserving configurability by Max Rosin(20)

Icinga Camp Bangalore - Icinga integrations by Icinga
Icinga Camp Bangalore - Icinga integrationsIcinga Camp Bangalore - Icinga integrations
Icinga Camp Bangalore - Icinga integrations
Icinga1.6K views
Experiences from Running Masterless Puppet - PuppetConf 2014 by Puppet
Experiences from Running Masterless Puppet - PuppetConf 2014Experiences from Running Masterless Puppet - PuppetConf 2014
Experiences from Running Masterless Puppet - PuppetConf 2014
Puppet7.8K views
Icinga Camp Berlin 2018 - Dev and Ops Stories - Integrations++ by Icinga
Icinga Camp Berlin 2018 - Dev and Ops Stories - Integrations++Icinga Camp Berlin 2018 - Dev and Ops Stories - Integrations++
Icinga Camp Berlin 2018 - Dev and Ops Stories - Integrations++
Icinga1.7K views
Code lifecycle on the Acquia Cloud Platform by Timothy Hilliard
Code lifecycle on the Acquia Cloud PlatformCode lifecycle on the Acquia Cloud Platform
Code lifecycle on the Acquia Cloud Platform
Timothy Hilliard316 views
Icinga Camp Berlin 2017 - Integrations all the way by Icinga
Icinga Camp Berlin 2017 - Integrations all the wayIcinga Camp Berlin 2017 - Integrations all the way
Icinga Camp Berlin 2017 - Integrations all the way
Icinga7.7K views
Icinga Web 2 is more by Icinga
Icinga Web 2 is moreIcinga Web 2 is more
Icinga Web 2 is more
Icinga17.7K views
Using Vault to decouple MySQL Secrets by Derek Downey
Using Vault to decouple MySQL SecretsUsing Vault to decouple MySQL Secrets
Using Vault to decouple MySQL Secrets
Derek Downey2K views
Managing multi tenant resource toward Hive 2.0 by Kai Sasaki
Managing multi tenant resource toward Hive 2.0Managing multi tenant resource toward Hive 2.0
Managing multi tenant resource toward Hive 2.0
Kai Sasaki2.2K views
Icinga 2 @ SIG-NOC Meeting by Icinga
Icinga 2 @ SIG-NOC MeetingIcinga 2 @ SIG-NOC Meeting
Icinga 2 @ SIG-NOC Meeting
Icinga31.2K views
Why favour Icinga over Nagios @ OSDC 2015 by Icinga
Why favour Icinga over Nagios @ OSDC 2015Why favour Icinga over Nagios @ OSDC 2015
Why favour Icinga over Nagios @ OSDC 2015
Icinga22.1K views
Intro to HPC by Wendi Sapp
Intro to HPCIntro to HPC
Intro to HPC
Wendi Sapp142 views
OpenNebulaConf 2016 - Icinga2 - APIFY them all by Achim Ledermüller, Netways ... by OpenNebula Project
OpenNebulaConf 2016 - Icinga2 - APIFY them all by Achim Ledermüller, Netways ...OpenNebulaConf 2016 - Icinga2 - APIFY them all by Achim Ledermüller, Netways ...
OpenNebulaConf 2016 - Icinga2 - APIFY them all by Achim Ledermüller, Netways ...
OpenNebula Project372 views
Architecture of Cisco Container Platform: A new Enterprise Multi-Cloud Kubern... by Sanjeev Rampal
Architecture of Cisco Container Platform: A new Enterprise Multi-Cloud Kubern...Architecture of Cisco Container Platform: A new Enterprise Multi-Cloud Kubern...
Architecture of Cisco Container Platform: A new Enterprise Multi-Cloud Kubern...
Sanjeev Rampal2.5K views
MesosCon EU 2017 - Criteo - Operating Mesos-based Infrastructures by pierrecdn -
MesosCon EU 2017 - Criteo - Operating Mesos-based InfrastructuresMesosCon EU 2017 - Criteo - Operating Mesos-based Infrastructures
MesosCon EU 2017 - Criteo - Operating Mesos-based Infrastructures
pierrecdn -586 views
State of Icinga - Linux Stammtisch München by Icinga
State of Icinga - Linux Stammtisch MünchenState of Icinga - Linux Stammtisch München
State of Icinga - Linux Stammtisch München
Icinga25.1K views
Icinga lsm 2015 copy by NETWAYS
Icinga lsm 2015 copyIcinga lsm 2015 copy
Icinga lsm 2015 copy
NETWAYS386 views
DevOps at Tradeshift - AWS community day nordics by JesperTerkelsen1
DevOps at Tradeshift - AWS community day nordicsDevOps at Tradeshift - AWS community day nordics
DevOps at Tradeshift - AWS community day nordics
JesperTerkelsen1272 views
Icinga Camp San Francisco 2017 - Current State of Icinga by Icinga
Icinga Camp San Francisco 2017 - Current State of IcingaIcinga Camp San Francisco 2017 - Current State of Icinga
Icinga Camp San Francisco 2017 - Current State of Icinga
Icinga2.9K views

Recently uploaded

"Mastering Social Media Marketing: A Guide to Fremont's Local Influence and C... by
"Mastering Social Media Marketing: A Guide to Fremont's Local Influence and C..."Mastering Social Media Marketing: A Guide to Fremont's Local Influence and C...
"Mastering Social Media Marketing: A Guide to Fremont's Local Influence and C...Embtel Solutions
13 views19 slides
PDF.pdf by
PDF.pdfPDF.pdf
PDF.pdfoliverumr
6 views1 slide
The Playing cards.pptx by
The Playing cards.pptxThe Playing cards.pptx
The Playing cards.pptxdivyabhana2
21 views5 slides
Unlock the Power of Viral Marketing 7 Proven Strategies to Amplify Your Brand... by
Unlock the Power of Viral Marketing 7 Proven Strategies to Amplify Your Brand...Unlock the Power of Viral Marketing 7 Proven Strategies to Amplify Your Brand...
Unlock the Power of Viral Marketing 7 Proven Strategies to Amplify Your Brand...Sarah Boyer
6 views9 slides
Soco 7.pdf by
Soco 7.pdfSoco 7.pdf
Soco 7.pdfSocioCosmos
6 views1 slide
SOCO 9.pdf by
SOCO 9.pdfSOCO 9.pdf
SOCO 9.pdfSocioCosmos
6 views1 slide

Recently uploaded(6)

"Mastering Social Media Marketing: A Guide to Fremont's Local Influence and C... by Embtel Solutions
"Mastering Social Media Marketing: A Guide to Fremont's Local Influence and C..."Mastering Social Media Marketing: A Guide to Fremont's Local Influence and C...
"Mastering Social Media Marketing: A Guide to Fremont's Local Influence and C...
Embtel Solutions13 views
The Playing cards.pptx by divyabhana2
The Playing cards.pptxThe Playing cards.pptx
The Playing cards.pptx
divyabhana221 views
Unlock the Power of Viral Marketing 7 Proven Strategies to Amplify Your Brand... by Sarah Boyer
Unlock the Power of Viral Marketing 7 Proven Strategies to Amplify Your Brand...Unlock the Power of Viral Marketing 7 Proven Strategies to Amplify Your Brand...
Unlock the Power of Viral Marketing 7 Proven Strategies to Amplify Your Brand...
Sarah Boyer6 views

OSMC 2018 | Scaling Icinga2 with many heterogeneous projects – and still preserving configurability by Max Rosin