This talk will introduce a flexible accounting framework with data visualization capabilities called MICHAL, that we at CESNET developed for our infrastructure. Framework is able to gather data from multiple sources, OpenNebula being one of them, process it and present the result in a form of charts. MICHAL isn't bind to only one platform and can be easily extended to support accounting of multiple parts of the infrastructure. As part of the presentation, we will discuss our data gathering techniques, MICHAL's design and functionality, currently available data processing modules for IaaS cloud and plans for the future development.

1. MICHAL
Flexible Infrastructure Accounting Framework
Michal Kimle
CESNET
25 October 2016

2. Motivation
Resource usage data rather than just reservation data
Load prediction
Overcommit strategies assessment
Comparability of multiple HPC approaches
Unified view of infrastructure usage
Custom annual usage reports (institute specific)
MK (CESNET) MICHAL 25 October 2016 2 / 9

3. Accounting Framework
MICHAL – Multi-Input Cloud Hardware Accounting Layer
Features
accounting data unification across multiple platforms
OpenNebula cloud, Hadoop cluster, . . .
computation of selected statistics
statistics visualization & export (charts)
Under the hood
modular design
asynchronous jobs
MK (CESNET) MICHAL 25 October 2016 3 / 9

4. Architecture1
MICHAL
Document database
Data sources
Job processing
1Logos obtained from http://opentsdb.net, http://opennebula.org, http://sidekiq.org and
https://commons.wikimedia.org
MK (CESNET) MICHAL 25 October 2016 4 / 9

5. Accounting Modules
In Time
progress of a metric in time
area chart
Overall
overall usage of a resource by individual users/user groups
pie chart
New Virtual Machine Count
number of newly started virtual machines within a time period
line chart
MK (CESNET) MICHAL 25 October 2016 5 / 9

6. Screenshots
MK (CESNET) MICHAL 25 October 2016 6 / 9

7. Roadmap
bugfixes
new accounting modules
first big test → MetaCentrum annual usage report
accounting of the rest of the infrastructure
MK (CESNET) MICHAL 25 October 2016 7 / 9

8. The End
– That’s All Folks! –
. . .
MK (CESNET) MICHAL 25 October 2016 8 / 9

9. Contact Info
Do you have any questions?
ask NOW!
ask me directly at kimle@cesnet.cz
send your questions to cloud@metacentrum.cz
Something to explore:
https://github.com/CESNET/michal
https://github.com/Misenko/tcollector
MK (CESNET) MICHAL 25 October 2016 9 / 9