Recommended
More Related Content
What's hot
What's hot (20)
Similar to CloudHealth: A Model-Driven Approach to Watch the Health of Cloud Services
Similar to CloudHealth: A Model-Driven Approach to Watch the Health of Cloud Services (20)
Recently uploaded
Recently uploaded (20)
CloudHealth: A Model-Driven Approach to Watch the Health of Cloud Services
- 1. CloudHealth A Model-Driven Approach to Watch the Health of Cloud Services by Anas Shatnawi, Ph.D. University of Milan-Bicocca Milan, Italy Matteo Orru, Ph.D. Marco Mobilio, Ph.D. Prof. Leonardo Mariani, Ph.D.Oliviero Riganelli, Ph.D. CloudHealth International Workshop on Software Health 2018
- 2. C loudHealth Problem and Motivation Primitive KPIs: • CPU utilization • Mem consumption • Network • … Ship Monitoring goals: • Performance • Efficiency • Reliability • … How to map primitive KPIs into monitoring goals Monitoring goals: • Availability • Adaptability • Reliability • … Different operators with different interest, thus different monitoring goals
- 3. C loudHealth The Main Idea of CloudHealth Primitive KPIs: • CPU utilization • Mem consumption • Network • … Ship Monitoring goals: • Performance • Efficiency • Reliability • … From monitoring goals to probes to collect primitive KPIs to be collected From primitive KPIs to dashboard based on monitoring goals Model Reliability Efficiency Performance … … CPU Memory Network
- 4. C loudHealth CloudHealth Monitoring Model (CHMM) ISO/IEC 25010:2011 and 25011:2017 • IT service quality • Product quality • Quality in use model • Quality attributes that could be adapted for cloud services • Definition offered by the ISO standards ReliabilityResponsivenessAdaptabilityEffectivenessEfficiencyCompatibilityPerformance Continuity Recoverability Availability Reactiveness Timeliness Customizability Initiative Accuracy Completeness Positive resource consumption Nigative resource consumption Co-existence Timebehaviour Resource utilization Capacity Timebetweenfailures Timetorecovera failure Consistencyofreplicas Numberoffailures Durationoffailures Waitingtimetoaccept requests Waitingtimetoreceive response Scalabilityofresources Timetoperform adaptation Successfullyprovided services Faultyservices Resourceconsumption forsuccessfully providedservices Resourceconsumption forfaultyprovided services Resourceconflict Responsetime Latency Throughput Resourcesconsumed perservice Sizeofworkload comparetoavailable infrastructure Quality models Monitoring goals Monitoring subgoals Cloud service proprieties Probes to collect KPIs Level of consistency and stability of service outcomes. Level to which a system can restore services (including functions and data) and making them available, in the event of interruptions, failures or disasters.
- 5. C loudHealth The Process of CloudHealth Selecting monitoring goals Cloud operators Configure Deploy Operate CHMM Monitoring goals
- 6. C loudHealth Selecting Monitoring Goals and Services ReliabilityResponsivenessAdaptabilityEffectivenessEfficiencyCompatibilityPerformance Continuity Recoverability Availability Reactiveness Timeliness Customizability Initiative Accuracy Completeness Positive resource consumption Nigative resource consumption Co-existence Timebehaviour Resource utilization Capacity Timebetweenfailures Timetorecovera failure Consistencyof replicas Numberoffailures Durationoffailures Waitingtimeto acceptrequests Waitingtimeto receiveresponse Scalabilityof resources Timetoperform adaptation Successfullyprovided services Faultyservices Resource consumptionfor successfullyprovided services Resource consumptionfor faultyprovided services Resourceconflict Responsetime Latency Throughput Resourcesconsumed perservice Sizeofworkload comparetoavailable infrastructure CHMM
- 7. C loudHealth The Process of CloudHealth Selecting monitoring goals Mapping monitoring goals to Probes Cloud operators Monitoring goals Probes Configure Deploy Operate CHMM
- 8. C loudHealth Mapping Monitoring Goals to Probes ReliabilityResponsivenessAdaptabilityEffectivenessEfficiencyCompatibilityPerformance Continuity Recoverability Availability Reactiveness Timeliness Customizability Initiative Accuracy Completeness Positive resource consumption Nigative resource consumption Co-existence Timebehaviour Resource utilization Capacity Timebetweenfailures Timetorecovera failure Consistencyof replicas Numberoffailures Durationoffailures Waitingtimeto acceptrequests Waitingtimeto receiveresponse Scalabilityof resources Timetoperform adaptation Successfullyprovided services Faultyservices Resource consumptionfor successfullyprovided services Resource consumptionfor faultyprovided services Resourceconflict Responsetime Latency Throughput Resourcesconsumed perservice Sizeofworkload comparetoavailable infrastructure CHMM
- 9. C loudHealth The Process of CloudHealth Selecting monitoring goals Mapping monitoring goals to Probes Cloud operators Monitoring goals Attaching probes to services Probes Cloud services Probes attached to services Configure Deploy Operate Probes catalog Cloud architecture CHMM
- 10. C loudHealth Probing Approaches Target service Ship Service host Database host Another service Target service API Query KPIs ShipKPIs Service host Probe host Database host 1) Inside the host 2) Outside the host Rest or SNMP APIs
- 11. C loudHealth ELK Stack (Elasticsearch, Logstash, Kibana) Service 1 Service 2 Service N Ship Logstash Elasticsearch Parse, filter and transform Kibana Query KPIs • Pulling data from various sources • Execute different transformations • Exports the data to various targets • Indexes and stores the information in a NoSQL database • Visualization layer that works on top of Elasticsearch KPIs
- 12. C loudHealth ELK Probes • Lightweight agents • Monitoring service and system levels • Deployable on Linux, Windows, and Mac hosts • Connectable to ELK stack Metricbeat Filebeat Packetbeat
- 13. C loudHealth Metricbeat Host VM Apache VM VM KPIs Apache-specific KPIs Host KPIs KPIs: - CPU usage - Memory - File system - Disk IO - Network IO If some of your services are not, build your own Metricbeat module Apache Module configuration
- 14. C loudHealth The Process of CloudHealth Selecting monitoring goals Mapping monitoring goals to Probes Cloud operators Monitoring goals Attaching probes to services Probes Cloud services Probes attached to services Customizing the dashboard Dashboard Configure Deploy Operate Probes catalog Cloud architecture CHMMCHMM
- 15. C loudHealth Customizing the Dashboard Kibana Kibana APIs Vega APIs Monitoring goals CHMM Elasticsearch Query KPIs KPIs Visualize Calculating monitoring goals values from KPIs
- 16. C loudHealth Related Work • There are not approaches that use models to automatically configure, deploy and operate a complete monitoring solution • Existing work concentrates on some aspects of this process only
- 17. C loudHealth Related Work • There are not approaches that use models to automatically configure, deploy and operate a complete monitoring solution • Existing work concentrates on some aspects of this process only
- 21. C loudHealth Thank you… Questions?