Osmius 9.07: Professional Monitoring

Osmius 9.07 The OpenSource Monitoring Tool José Luis Marina :: 2009 Osmius 9.07 You can't manage what you can't see.

Osmius 9.07: Professional Monitoring What is Osmius? Osmius allows you to monitor and keep track of everything connected to a network

What is Osmius?

We've designed Osmius to monitor:

Computers and Network devices
Applications and Databases
User transactions...

But also:

Industrial sensors.
Energy consumptions.
Pollution levels in the neighbour.
Stock shares.
Any idea?

Osmius 9.07: Professional Monitoring

Osmius 9.07: Professional Monitoring Why choose Osmius? Briefly, with Osmius you can:

Monitor thousands of devices in Real Time.
Align IT with the Business (SLA Management).
Data Mining and Business Intelligence.
Use the power of GIS to see/analyze data.
Monitor new “things” in minutes.
Send automatic notifications to the staff.
Predict Capacity shortages (ITIL).
Access ALL the code and documentation .

Osmius 9.07: Professional Monitoring Who is behind Osmius? With Osmius you can:

Access ALL the code and documentation.

Peopleware :

Created in 2000

~ 30 people
~ 2,000,000 € Last year billing

Services:

Administration, Tuning and IT Operations
Software Development. Performance Demanding.
Free Open Source Software.
Information Security.
R&D in collaboration with several Universities.

More:

UNE-EN-ISO/9001:2000 in IT Consultancy & Operations

Osmius 9.07: Professional Monitoring Who is behind Osmius? Peopleware :

Created in 2000

~ 30 people
~ 2,000,000 € Last year billing

Services:

Administration, Tuning and IT Operations
Software Development. Performance Demanding.
Free Open Source Software.
Information Security.
R&D in collaboration with several Universities.

More:

UNE-EN-ISO/9001:2000 in IT Consultancy & Operations

Peopleware Funds to Help R&D Investments Technological Partners Geographic Systems Business Intelligence Osmius Partners Installation Administration Support Training Deployment Development Multiplatform Installers

Osmius 9.07: Professional Monitoring Who is behind Osmius? Community

In Osmius everything is Open... not just the “core” !!

First Stable version released in July 2008
More than 4.000 downloads
SourceForgeRanking : ~ Top 50/100

Osmius 9.07: Professional Monitoring Architecture & Tecnology With Osmius you can:

Access ALL the code and documentation.

SSL MA AG1 AGn MA AG1 AGn Master Agent Point from wich you want to monitor and deploy Agents. You can use 1 to N MA AG1 AGn CS Central Server Process to receive and correlate events and to manage all the agents MySql DataBase Open and documented DataModel. Events, SLA, etc TomCat J2EE WebConsole J2EE connecting to the DBase. Instances Something you want to monitor (Web, DB, Temp) Agent Specialized on monitoring specific instances like MySQL, Web sites...

Osmius 9.07: Professional Monitoring SSL Architecture & Tecnology MA AG1 AGn MA AG1 AGn Master Agent C++ & ACE Multiplatform Persistent Queues Fault Tolerant MA AG1 AGn CS Central Server C++ & ACE & MySql API Fast insert and Correlation Secure Comms MySql DataBase Normalized Explain everything Stored Procs TomCat J2EE WebConsole Java J2EE Springs – Hibernate OpenLayers Instances Use API Reuse Connections Agent C++ & ACE API (MySql, Curl,etc) Only new code

How to install Osmius 9.07: Professional Monitoring The Hard Way

Download last source from Subversion.
Access to Osmius Wiki
Compile it in your preferred platforms.

The Easy Way

Download the installer for your platform.
Run the graphical or text wizard.

--------------------------------------------------- Press [Enter] to continue : Do you accept this license? [y/n]: y --------------------------------------------------- Installation folder Please, choose a folder to install Osmius Select a folder [/home/jlmarina/osmius]:

Osmius 9.07: Professional Monitoring Concepts: Easy to understand Instance: Everything you want to monitor. Instance Type or Class: Defines the kind of questions you can make to the instance MySQL Database | Windows Server | Exchange Instance Events: Depending on its type an Instance can receive certain events MySQL Database: # Users, Free Space, Kbytes Out,... Parameters: Every 10 seconds – Customized Warning & Critical Threshold Event 1 :: Database Connections is: 250 Event 2 :: Uptime is : 8h 30' Event 1 :: Time to load Web is : 15 s Event 1 :: CPU Load is : 80%

Osmius 9.07: Professional Monitoring Concepts: Easy to understand Correlation Engine I: T he Active Events view should be as clean as possible:

Show only 1 row for repeated events.
Automaticaly clean “bad” events when arrives a “good” one.
If Temperature is OK clean previous CRITICAL events.

Correlation Engine II (*) Identify dependendies between Instances:

If this servers fails -> DataBase and WebServer also fail.
Manual and automatic identification.

Active and Historical Views Accumulate Only 1 row

Concepts: Easy to understand Service: A group of instances joined to offer a service to some users Normally represents some functional group into your business The Intranet... Will be down this afternoon from 15:00 to 17:00 due to the upgrade of the Oracle Database from 9i to 10g Don't take this unavailability into account in the SLAs SLA – Service Level Agreement: Defines objetives to your services. The Intranet cannot be down more than 99.999 of its time Service Working Time Are we using the Intranet 24x7? Services must acomplish SLAs within their Working Time Osmius also implements: Planned DownTimes Osmius 9.07: Professional Monitoring

Concepts: Easy to understand SLA – Service Level Agreement: Defines objetives to your services. The Intranet cannot be down more than 99.999 of its time Service Working Time Are we using the Intranet 24x7? Services must acomplish SLAs within their Working Time Osmius also implements: Planned DownTimes 99.999 Up 99.900 Ok 99.999 Up 99.900 Ok Osmius 9.07: Professional Monitoring 24x7 24x7 24x7 ... From M to F From 9 to 17 SLA Management Service Level Instance & Technical Level Events sent by the agents Firewall Intranet DB Intranet Gold Silver e-Com eMail CRM Host Moon Exchange Server Exch. FrontE Win Host Weight Propagation

Concepts: Easy to Manage Osmius 9.07: Professional Monitoring Manage the Configuration:

Distribute changes from the console to the distributed agents
Distribute or upgrade agents with one click.

Create your own...

Events using your cutomized scripts and distribute them.
Agents: Calling Peopleware or building them yourself using the Osmius Development Framework.

Concepts: Easy to Manage Osmius 9.07: Professional Monitoring Templates:

Manage all the configuration from a Central Point.
Osmius provides you with default templates for every Instance Type

Active/Inactive Events
Recommended Interval and Thresholds...

Sharing Templates (*)

Donwload and Share them in the Osmius Template Site.
Search a “production” configuration for Cisco Router C4500.
Access user opinions and reviews.

% CPU Load Look every 5 mins || Warning: > 90 || Critical: > 95 # Users Inactive Net KBytes Out Look every 5 mins || Warning: > 100 || Critical: > 150 | Silent % CPU Load Look every 30 secs || Warning: > 80 || Critical: > 85 Look every 30 secs || Warning: > 10 || Critical: > 15 Net KBytes Out Look every 60 secs || Warning: > 30 || Critical: > 40 # Users Template “ Default” Template “ Secure”

Data Storage and Mining Data Storage – Data Warehouse – Business Intelligence: Osmius keeps track of how many seconds every Instance and every Service have stayed Available or in every State. SLA – Service Level Agreement: Defines objetives to your services. The Intranet cannot be down more than 99.999 of its time Service Working Time Are we using the Intranet 24x7? Services must acomplish SLAs within their Working Time Osmius also implements: Planned DownTimes Osmius 9.07: Professional Monitoring Global Mark Based on states of the different Services and their SLA. Offers an instant overall view And store the real data from any event in any Intance CPU Load S1 SLA Sn

Data Storage and Mining How to deal with millions of events?

Round Robin Database for the individual events .

You don't need to know wich was the exact CPU load on 01-01-2008 at 8:00. The older the data the lesser the detail you need . Osmius 9.07: Professional Monitoring

Integrated Data Warehouse

Specific Osmius processes to aggregate daily info (seconds in each state, etc)

Silent Mode

Events in “silent mode” are only sent when there are changes in the Severity. “ Send me the Temperature only when it raises 30 C” Prevents network and storage resources starvation.

Integration How to deal with millions of events?

Round Robin Database for the individual events .

You don't need to know wich was the exact CPU load on 01-01-2008 at 8:00. The older the data the lesser the detail you need . Osmius 9.07: Professional Monitoring

Integrated Data Warehouse

Specific Osmius processes to aggregate daily info (seconds in each state, etc)

Silent Mode

Events in “silent mode” are only sent when there are changes in the Severity. “ Send me the Temperature only when it raises 30 C” Prevents network and storage resources starvation. User Notificacions & Subscriptions Let Osmius inform you about changes. e-mail SMS .... Service Availability Changes Instance State Change Subscribe to Reports Working time Not Working time Out of office Jabber Global Mark Sending Osmius Event to others

Standalone Agents: Integrate the agents directly with e-mail, Nagios, …
Open Tickets automatically using notifications.
Send Exchange Critical Events to another Monitoring system.

Receiving Events from others

Command Line Interface
Proxy agent and Traps receiver (*)

when using Intranet eComm

Extracting Knowledge Osmius 9.07: Professional Monitoring ITIL: “ Best practices to align IT with Business”

Availability Management:
Choose which events impacts on Availability.

IF Ping milliseconds > 5000 ms -> Instance is Down

Capacity Planning:
Choose which events measure capacity.

Servers -> CPU Load Databases -> Used MBytes

Data warehouse capabilities:
Nightly processes calculate and aggregate data.

Each Day:

Event -> How many, count, group by instance, mean deviations...
Instance -> Seconds Up, Down, Ok
Service -> Seconds Up, Down, Ok, Second to Break SLA.
SLA -> Most problematic Services,...

Extracting Knowledge Osmius 9.07: Professional Monitoring Business Intelligence and Data Mining:

Control Panel (*) to measure and track SLA accomplishment
From Aggregate Data to specific event values (CPU Load).
Reports designed to be the ones you needed.
Osmius DataModel is well documented -> build your own reports.

Extracting Knowledge Osmius 9.07: Professional Monitoring Business Intelligence and Data Mining:

Control Panel (*) to measure and track SLA accomplishment
From Aggregate Data to specific event values (CPU Load).
Reports designed to be the ones you needed.
Osmius DataModel is well documented -> build your own reports.

Semantic Web and Osmius?

Instructions (*):
Help the operator to find the best solution to a problem.
Search and maintain a local Knowledge Database.
Why not combine local and external web knowledge

Problem solving
Share solutions
Automatic recommendations based on real local data
...

Osmius Development Model Osmius 9.07: Professional Monitoring

Deal with thousands of Instances and millions of events.
Integrates SLA management and ITIL best practices.
Manage everything from a Central Point .
Business Intelligence mining tool.
Leverage the power of GIS .
Real Open : There is no community downgraded version.
Well documented . We care about documentation.

SCRUM Agile Methodology Version and demo every month Stable release: Twice a year Progress updated every day. Visibility (c) Softhouse

Osmius Business Model Osmius 9.07: Professional Monitoring

Know before your users that a problem has occurred...

...before they call you.

Foresee problems before they arise....

...so you can prevent them from occur.

Capacity planning ....

... review historic data to analyze trends

Improve Quality ...

Monitoring is an increasing Market

... there are more and more systems connected, true?

Osmius Business Model Osmius 9.07: Professional Monitoring Yes... but why Monitoring? Save costs!! Reduce non-availabilities into your business. Use resources where they are supposed to be. Foresee problems and save hours spent dealing with them. Use that hours to improve or develop new areas . Avoid false alarms and the “always running” symptom . Learn from your systems your users behavior .

Osmius Business Model Osmius 9.07: Professional Monitoring Services

Software support - Peopleware:

Upgrades of agents and console
Patches and technical alerts

Consultancy – Partnership Network:

Installation and configuration
Deployment and stability process
Specific developments

Training:

Administration
Development

Osmius Business Model Osmius 9.07: Professional Monitoring Is there a Business Model with Free/Open Source? Osmius is FLOSS because selfish reasons Openness help us with distribution and more... Osmius is a professional monitoring tool which compete with the “Big Ones”. Openness help us selling Osmius Why buy something that makes me slave when I can use an open alternative? Customers aren't blind anymore. Osmius doesn't maintain double tricky distributions. Customers put Osmius under the Real FLOSS Tools and they choose us: 1.- Because Osmius is good software (functionality & robustness) 2.- Because Osmius is good software (services & freedom)

Osmius Advantages Osmius 9.07: Professional Monitoring