SlideShare a Scribd company logo
1 of 20
#CASCON2018
Adaptation as a
Service
• Hamzeh Khazaei, University of Alberta
• Alireza Ghanbari, Khatam University
• Marin Litoiu, York University
ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018
2
#CASCON2018
• Current and emerging complex systems of many types have increasingly distributed and
dynamic architecture
• provides unprecedented flexibility in creating and supporting applications
• however end-to-end management will be a challenge.
• The only solution is to let these system self-manage while compliant to end-users’
objectives
• In this talk, I argue that building autonomic management systems is a challenging task and
requires its own set of expertise and knowledge.
• Therefore, in light of current challenges, available enablers and recent successful stories,
we proposed & evaluated the idea of moving from self-adaptation to ADaptation-as-a-
Service (ADaaS)
Motivation
ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018
3
#CASCON2018
• Software engineers are responsible to develop the autonomic management system (i.e.,
managing system) in addition to the real software system.
• Design and implementation of AMSs gets complicated particularly when the managed
application is highly distributed and heterogeneous in nature such as big data and IoT
systems.
• In other words, efficient AMSs can be built for each software system only if we have access
to the right set of software engineers with proper skills to realize the MAPE-K loop
efficiently.
Self-Adaptive Systems
ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018
4
#CASCON2018
1. Shared-nothing architecture and horizontal scalability
2. Cloud elasticity and availability
3. Infrastructure as Code and Software-defined Infrastructure
4. Microservice architecture
5. Application isolation provided by containers
6. Software-defined sensors or probes
7. Advancement in machine learning techniques
8. Big data analytics capabilities
9. More?
Why do we think ADaaS is feasible?  enablers:
ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018
5
#CASCON2018
Enablers and their impacts on MAPE-K loop building blocks
Table
1.
ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018
6
#CASCON2018
Successful stories and directions of research
ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018
7
#CASCON2018
1. SecaaS provide protection for applications, data, and operations that run in the
cloud
2. By 2020, 85% of large enterprises will use a cloud access security broker solution
for their cloud services according to MarketsandMarkets
3. Currently there exist many SecaaS providers such as Pallera, Proofpoint, White Hat
Security, and Juniper, to name a few
4. Examples: email encryption, security information and event management, identity
and access management, endpoint protection, intrusion detection systems, data
loss prevention, network security and disaster recovery as a service
5. Drawback: treat the managed software system as a black box and doesn’t change
(i.e., adapt) the topology or components of the underlaying application.
6. By leveraging enablers 2, 3, 5, 6 and 7 in table 1, we can address drawbacks and
take SecaaS to next level.
Security as a Service (SecaaS)
ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018
8
#CASCON2018
1. Proper configurations is hard to achieve at start up with one attempt.
2. The Default Configurations is good enough for “hello-world” applications.
3. The first step for ConfaaS could be designing and implementation of smart deployers.
4. One step further is to let the smart deployer choose the right infrastructure, i.e.,
flavor, size and number of VMs, for the managed application.
5. Reinforcement learning is a good candidate to build the brain of such smart
deployers.
6. All enablers in Table 1 will play important roles in the realization of ConfaaS in
nowadays cloud computing data centers.
7. Providing ConfaaS is in its infancy and needs more attention.
Configuration as a Service (ConfaaS)
ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018
9
#CASCON2018
1. The goal of self-healing is to make fault-tolerant and responsive system capable of
responding to changes on demand and recuperation from failures.
2. Self-healing systems can be divided into three levels, depending on size and type of
resources we are monitoring, and acting upon:
• application level, platform level and infrastructure level.
3. Application level healing will be implemented by programmers and software engineers
during SDLC.
4. Unlike the application level healing, platform level self-healing can be generalized and be
applied to all services and applications, regardless of their internals.
5. This is the type of self-healing that can be provided by cloud service providers as-a-
service.
6. The real meaning of healing at infrastructure level is redeployment of services from an
unhealthy node to a healthy one.
7. In fact, most of infrastructure failures are addressed at the platform level.
Healing as a Service (HaaS)
ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018
10
#CASCON2018
1. Primary objectives of optimization are performance, operation cost, availability and
maintainability.
2. Cloud service providers have already provided some basic services to help their customers to
optimize cost, performance or balance them; e.g., auto scalability for EC2.
3. IBM Bluemix auto-scalability for microservices (i.e., PaaS).
4. One fundamental limitation with above approaches is that they stay at platform level and have
no sense of the inside applications.
5. To this end, software-defined sensors/probes such as Elastic beats may be leveraged to
instrument cloud applications and measures the high order performance indicators in a
transparent manner.
6. Provided that a cloud service provider now could monitor the whole stack and perform
corrective actions to optimize the application at all levels.
Optimization as a Service (OaaS)
ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018
11
#CASCON2018
• Autoscalability is a must and now is fully feasible
• Required: Highly distributed architecture and sheer complexity
• Feasible: Elasticity, Software-Defined environments and microservices
• It’s a data centric process
• Whole data life cycle, large-scale systems, big data characteristics in application data
• Needs to be at both application and infrastructure levels
• A compelling combination of VM and Containers: security + availability of IaaS cloud + flexibility of microservices
+ negligible performance overhead
• How about Auto-scalability as a Service then?
Proof of Concept – a case study in optimization
ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018
12
#CASCON2018
• A clipped combination of Elasticsearch and Scale
• Is to provide auto-scalability and self-healing as-a-service
• Dockerized applications on OpenStack
• Extendibility by design
• To be a De facto platform for evaluating/comparison scalability algorithms
• Our definition:
• Microservices
• Macroservices
• Implemented in Python and open source
Elascale
ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018
13
#CASCON2018
High Level Architecture
Cluster
Workers
Macroservice
Manager
Application Containers Microservice
Manager
Virtual Resources
Cloud
Interface
Physical Resources
Cluster Manager
…
Cluster
Workers Scaling
Engine
Visualization
Scaling
Algorithms
MonitoringManagement
ElascaleApplicationCloud
Provider
Plugins
ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018
14
#CASCON2018
High Level Architecture
Cluster
Workers
Macroservice
Manager
Application Containers Microservice
Manager
Virtual Resources
Cloud
Interface
Physical Resources
Cluster Manager
…
Cluster
Workers Scaling
Engine
Visualization
Scaling
Algorithms
MonitoringManagement
ElascaleApplicationCloud
Provider
Plugins
ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018
15
#CASCON2018
Elascale
in
Action
….
VM
ElascaleApplication
VM
VM
A A
AA
A A
AA
b
b
b
b
LS
ES
K
EC
b
b
A
b ES
Application Container
Beat Container
Elasticsearch
Container
Logstash
Container
Kibana
Container
Elascale Core
ContainerEC
LS K
Data Flow Command FlowVM Virtual Machine
ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018
16
#CASCON2018
Elascale
in
Action
….
VM
ElascaleApplication
VM
VM
A A
AA
A A
AA
b
b
b
b
LS
ES
K
EC
b
b
A
b ES
Application Container
Beat Container
Elasticsearch
Container
Logstash
Container
Kibana
Container
Elascale Core
ContainerEC
LS K
Data Flow Command FlowVM Virtual Machine
ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018
17
#CASCON2018
Experiment:
IoT
Application
Core-Cloud
Cassandra
Visualization
Dockbeat
Kafka
IoT-Edge-Processor
Edge-Cloud
Virtual-Sensor-Containers
Swarm Manager
Metricbeat
Dockbeat
Metricbeat
Elascale
Core
Zookeeper
Dockbeat
Metricbeat
Kibana
Elasticsearch
Logstash
Elascale
Component
Application
Component
ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018
18
#CASCON2018
Highly configurable
ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018
19
#CASCON2018
Results
ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018
20
#CASCON2018
1. Recorded Video: https://goo.gl/4pVK6w
Demo

More Related Content

What's hot

Moving to the cloud: cloud strategies and roadmaps
Moving to the cloud: cloud strategies and roadmapsMoving to the cloud: cloud strategies and roadmaps
Moving to the cloud: cloud strategies and roadmapsJisc
 
Five keys to successful cloud migration
Five keys to successful cloud migrationFive keys to successful cloud migration
Five keys to successful cloud migrationIBM
 
Insurtech, Cloud and Cybersecurity - Chartered Insurance Institute
Insurtech, Cloud and Cybersecurity -  Chartered Insurance InstituteInsurtech, Cloud and Cybersecurity -  Chartered Insurance Institute
Insurtech, Cloud and Cybersecurity - Chartered Insurance InstituteHenrique Centieiro
 
Integrated Cloud Framework: Security, Governance, Compliance, Content Applica...
Integrated Cloud Framework: Security, Governance, Compliance, Content Applica...Integrated Cloud Framework: Security, Governance, Compliance, Content Applica...
Integrated Cloud Framework: Security, Governance, Compliance, Content Applica...Chad Lawler
 
Cloud strategy briefing 101
Cloud strategy briefing 101 Cloud strategy briefing 101
Cloud strategy briefing 101 Predrag Mitrovic
 
CRM Trilogix; Migrating Legacy Systems to the Cloud
CRM Trilogix; Migrating Legacy Systems to the CloudCRM Trilogix; Migrating Legacy Systems to the Cloud
CRM Trilogix; Migrating Legacy Systems to the CloudCraig F.R Read
 
Software Association of Oregon Cloud Computing Presentation
Software Association of Oregon Cloud Computing PresentationSoftware Association of Oregon Cloud Computing Presentation
Software Association of Oregon Cloud Computing Presentationddcarr
 
Capgemini Cloud Assessment - A Pathway to Enterprise Cloud Migration
Capgemini Cloud Assessment - A Pathway to Enterprise Cloud MigrationCapgemini Cloud Assessment - A Pathway to Enterprise Cloud Migration
Capgemini Cloud Assessment - A Pathway to Enterprise Cloud MigrationFloyd DCosta
 
Cloud migration
Cloud migration Cloud migration
Cloud migration deszal
 
Disaster Recovery and IT Resilience Solution
Disaster Recovery and IT Resilience SolutionDisaster Recovery and IT Resilience Solution
Disaster Recovery and IT Resilience SolutionNick Smirnov
 
Cloud migration
Cloud migrationCloud migration
Cloud migrationMark Swick
 
Cloud fundamentals, with Kevin Ashby and Brett Samuel
Cloud fundamentals, with Kevin Ashby and Brett SamuelCloud fundamentals, with Kevin Ashby and Brett Samuel
Cloud fundamentals, with Kevin Ashby and Brett SamuelVeritas Technologies LLC
 
Accelerating Digital Transformation with Better Data Management
Accelerating Digital Transformation with Better Data ManagementAccelerating Digital Transformation with Better Data Management
Accelerating Digital Transformation with Better Data ManagementVeritas Technologies LLC
 
Sam Charrington Of Appistry Gives Lighting Talk
Sam Charrington Of Appistry Gives Lighting TalkSam Charrington Of Appistry Gives Lighting Talk
Sam Charrington Of Appistry Gives Lighting TalkBigDataCamp
 
Five key themes in enterprise cloud computing migration
Five key themes in enterprise cloud computing migrationFive key themes in enterprise cloud computing migration
Five key themes in enterprise cloud computing migrationWinn Technology Group
 

What's hot (20)

Moving to the cloud: cloud strategies and roadmaps
Moving to the cloud: cloud strategies and roadmapsMoving to the cloud: cloud strategies and roadmaps
Moving to the cloud: cloud strategies and roadmaps
 
Five keys to successful cloud migration
Five keys to successful cloud migrationFive keys to successful cloud migration
Five keys to successful cloud migration
 
Cloud Migration Strategy Framework
Cloud Migration Strategy FrameworkCloud Migration Strategy Framework
Cloud Migration Strategy Framework
 
Multi Cloud Architecture Approach
Multi Cloud Architecture ApproachMulti Cloud Architecture Approach
Multi Cloud Architecture Approach
 
Insurtech, Cloud and Cybersecurity - Chartered Insurance Institute
Insurtech, Cloud and Cybersecurity -  Chartered Insurance InstituteInsurtech, Cloud and Cybersecurity -  Chartered Insurance Institute
Insurtech, Cloud and Cybersecurity - Chartered Insurance Institute
 
Integrated Cloud Framework: Security, Governance, Compliance, Content Applica...
Integrated Cloud Framework: Security, Governance, Compliance, Content Applica...Integrated Cloud Framework: Security, Governance, Compliance, Content Applica...
Integrated Cloud Framework: Security, Governance, Compliance, Content Applica...
 
Cloud Foundations
Cloud FoundationsCloud Foundations
Cloud Foundations
 
Cloud strategy briefing 101
Cloud strategy briefing 101 Cloud strategy briefing 101
Cloud strategy briefing 101
 
CRM Trilogix; Migrating Legacy Systems to the Cloud
CRM Trilogix; Migrating Legacy Systems to the CloudCRM Trilogix; Migrating Legacy Systems to the Cloud
CRM Trilogix; Migrating Legacy Systems to the Cloud
 
Software Association of Oregon Cloud Computing Presentation
Software Association of Oregon Cloud Computing PresentationSoftware Association of Oregon Cloud Computing Presentation
Software Association of Oregon Cloud Computing Presentation
 
Capgemini Cloud Assessment - A Pathway to Enterprise Cloud Migration
Capgemini Cloud Assessment - A Pathway to Enterprise Cloud MigrationCapgemini Cloud Assessment - A Pathway to Enterprise Cloud Migration
Capgemini Cloud Assessment - A Pathway to Enterprise Cloud Migration
 
Cloud migration
Cloud migration Cloud migration
Cloud migration
 
Disaster Recovery and IT Resilience Solution
Disaster Recovery and IT Resilience SolutionDisaster Recovery and IT Resilience Solution
Disaster Recovery and IT Resilience Solution
 
Cloud migration
Cloud migrationCloud migration
Cloud migration
 
Why build sap on cloud
Why build sap on cloudWhy build sap on cloud
Why build sap on cloud
 
Multi cloud PaaS
Multi cloud PaaSMulti cloud PaaS
Multi cloud PaaS
 
Cloud fundamentals, with Kevin Ashby and Brett Samuel
Cloud fundamentals, with Kevin Ashby and Brett SamuelCloud fundamentals, with Kevin Ashby and Brett Samuel
Cloud fundamentals, with Kevin Ashby and Brett Samuel
 
Accelerating Digital Transformation with Better Data Management
Accelerating Digital Transformation with Better Data ManagementAccelerating Digital Transformation with Better Data Management
Accelerating Digital Transformation with Better Data Management
 
Sam Charrington Of Appistry Gives Lighting Talk
Sam Charrington Of Appistry Gives Lighting TalkSam Charrington Of Appistry Gives Lighting Talk
Sam Charrington Of Appistry Gives Lighting Talk
 
Five key themes in enterprise cloud computing migration
Five key themes in enterprise cloud computing migrationFive key themes in enterprise cloud computing migration
Five key themes in enterprise cloud computing migration
 

Similar to Adaptation as a Service

Leveraging Hybid IT for More Robust Business Services
Leveraging Hybid IT for More Robust Business ServicesLeveraging Hybid IT for More Robust Business Services
Leveraging Hybid IT for More Robust Business ServicesAmazon Web Services
 
7 Essential Steps to Cloud Adoption.pdf
7 Essential Steps to Cloud Adoption.pdf7 Essential Steps to Cloud Adoption.pdf
7 Essential Steps to Cloud Adoption.pdfAnil
 
Richard Knight: Real world stories from the frontline of enterprise Cloud
Richard Knight: Real world stories from the frontline of enterprise CloudRichard Knight: Real world stories from the frontline of enterprise Cloud
Richard Knight: Real world stories from the frontline of enterprise CloudDe Novo
 
Rise of the Hybrid Cloud
Rise of the Hybrid CloudRise of the Hybrid Cloud
Rise of the Hybrid CloudIQBG, Inc.
 
How to develop a multi cloud strategy to accelerate digital transformation - ...
How to develop a multi cloud strategy to accelerate digital transformation - ...How to develop a multi cloud strategy to accelerate digital transformation - ...
How to develop a multi cloud strategy to accelerate digital transformation - ...Senaka Ariyasinghe
 
Microservices for Application Modernisation
Microservices for Application ModernisationMicroservices for Application Modernisation
Microservices for Application ModernisationAjay Kumar Uppal
 
Mythbusting the Federal Cloud Journey
Mythbusting the Federal Cloud JourneyMythbusting the Federal Cloud Journey
Mythbusting the Federal Cloud JourneyAmazon Web Services
 
Digital Transformation: Empowering People to Adapt to the Cloud
Digital Transformation: Empowering People to Adapt to the CloudDigital Transformation: Empowering People to Adapt to the Cloud
Digital Transformation: Empowering People to Adapt to the CloudAmazon Web Services
 
End User Computing at CloudHesive.pptx
End User Computing at CloudHesive.pptxEnd User Computing at CloudHesive.pptx
End User Computing at CloudHesive.pptxCloudHesive
 
Moving to the cloud in regulated environments
Moving to the cloud in regulated environmentsMoving to the cloud in regulated environments
Moving to the cloud in regulated environmentsKev Miller
 
Making the Journey_ 7 Essential Steps to Cloud Adoption.pdf
Making the Journey_ 7 Essential Steps to Cloud Adoption.pdfMaking the Journey_ 7 Essential Steps to Cloud Adoption.pdf
Making the Journey_ 7 Essential Steps to Cloud Adoption.pdfAnil
 
Embracing Containers and Microservices for Future Proof Application Moderniza...
Embracing Containers and Microservices for Future Proof Application Moderniza...Embracing Containers and Microservices for Future Proof Application Moderniza...
Embracing Containers and Microservices for Future Proof Application Moderniza...Marlabs
 
Cloud and Utility Computing
Cloud and Utility ComputingCloud and Utility Computing
Cloud and Utility ComputingIvan_datasynapse
 
cloud services and providers
cloud services and providerscloud services and providers
cloud services and providersKalai Selvi
 
7 habits of highly effective private cloud architects
7 habits of highly effective private cloud architects7 habits of highly effective private cloud architects
7 habits of highly effective private cloud architectsHARMAN Services
 
Addressing the 8 Key Pain Points of Kubernetes Cluster Management
Addressing the 8 Key Pain Points of Kubernetes Cluster ManagementAddressing the 8 Key Pain Points of Kubernetes Cluster Management
Addressing the 8 Key Pain Points of Kubernetes Cluster ManagementEnterprise Management Associates
 
Get Started Today with Cloud-Ready Contracts | AWS Public Sector Summit 2017
Get Started Today with Cloud-Ready Contracts | AWS Public Sector Summit 2017Get Started Today with Cloud-Ready Contracts | AWS Public Sector Summit 2017
Get Started Today with Cloud-Ready Contracts | AWS Public Sector Summit 2017Amazon Web Services
 
Understanding The Cloud For Enterprise Businesses, an eBook from Triaxil!
Understanding The Cloud For Enterprise Businesses, an eBook from Triaxil!Understanding The Cloud For Enterprise Businesses, an eBook from Triaxil!
Understanding The Cloud For Enterprise Businesses, an eBook from Triaxil!Ezhilarasan Natarajan
 

Similar to Adaptation as a Service (20)

Leveraging Hybid IT for More Robust Business Services
Leveraging Hybid IT for More Robust Business ServicesLeveraging Hybid IT for More Robust Business Services
Leveraging Hybid IT for More Robust Business Services
 
7 Essential Steps to Cloud Adoption.pdf
7 Essential Steps to Cloud Adoption.pdf7 Essential Steps to Cloud Adoption.pdf
7 Essential Steps to Cloud Adoption.pdf
 
Richard Knight: Real world stories from the frontline of enterprise Cloud
Richard Knight: Real world stories from the frontline of enterprise CloudRichard Knight: Real world stories from the frontline of enterprise Cloud
Richard Knight: Real world stories from the frontline of enterprise Cloud
 
Rise of the Hybrid Cloud
Rise of the Hybrid CloudRise of the Hybrid Cloud
Rise of the Hybrid Cloud
 
How to develop a multi cloud strategy to accelerate digital transformation - ...
How to develop a multi cloud strategy to accelerate digital transformation - ...How to develop a multi cloud strategy to accelerate digital transformation - ...
How to develop a multi cloud strategy to accelerate digital transformation - ...
 
Microservices for Application Modernisation
Microservices for Application ModernisationMicroservices for Application Modernisation
Microservices for Application Modernisation
 
Mythbusting the Federal Cloud Journey
Mythbusting the Federal Cloud JourneyMythbusting the Federal Cloud Journey
Mythbusting the Federal Cloud Journey
 
Digital Transformation: Empowering People to Adapt to the Cloud
Digital Transformation: Empowering People to Adapt to the CloudDigital Transformation: Empowering People to Adapt to the Cloud
Digital Transformation: Empowering People to Adapt to the Cloud
 
End User Computing at CloudHesive.pptx
End User Computing at CloudHesive.pptxEnd User Computing at CloudHesive.pptx
End User Computing at CloudHesive.pptx
 
Moving to the cloud in regulated environments
Moving to the cloud in regulated environmentsMoving to the cloud in regulated environments
Moving to the cloud in regulated environments
 
Making the Journey_ 7 Essential Steps to Cloud Adoption.pdf
Making the Journey_ 7 Essential Steps to Cloud Adoption.pdfMaking the Journey_ 7 Essential Steps to Cloud Adoption.pdf
Making the Journey_ 7 Essential Steps to Cloud Adoption.pdf
 
Embracing Containers and Microservices for Future Proof Application Moderniza...
Embracing Containers and Microservices for Future Proof Application Moderniza...Embracing Containers and Microservices for Future Proof Application Moderniza...
Embracing Containers and Microservices for Future Proof Application Moderniza...
 
internship paper
internship paperinternship paper
internship paper
 
Cloud and Utility Computing
Cloud and Utility ComputingCloud and Utility Computing
Cloud and Utility Computing
 
cloud services and providers
cloud services and providerscloud services and providers
cloud services and providers
 
7 habits of highly effective private cloud architects
7 habits of highly effective private cloud architects7 habits of highly effective private cloud architects
7 habits of highly effective private cloud architects
 
Addressing the 8 Key Pain Points of Kubernetes Cluster Management
Addressing the 8 Key Pain Points of Kubernetes Cluster ManagementAddressing the 8 Key Pain Points of Kubernetes Cluster Management
Addressing the 8 Key Pain Points of Kubernetes Cluster Management
 
AWS Services 7 Transformation Media
AWS Services 7 Transformation MediaAWS Services 7 Transformation Media
AWS Services 7 Transformation Media
 
Get Started Today with Cloud-Ready Contracts | AWS Public Sector Summit 2017
Get Started Today with Cloud-Ready Contracts | AWS Public Sector Summit 2017Get Started Today with Cloud-Ready Contracts | AWS Public Sector Summit 2017
Get Started Today with Cloud-Ready Contracts | AWS Public Sector Summit 2017
 
Understanding The Cloud For Enterprise Businesses, an eBook from Triaxil!
Understanding The Cloud For Enterprise Businesses, an eBook from Triaxil!Understanding The Cloud For Enterprise Businesses, an eBook from Triaxil!
Understanding The Cloud For Enterprise Businesses, an eBook from Triaxil!
 

More from York University

SAVI-IoT: A Self-managing Containerized IoT Platform
SAVI-IoT: A Self-managing Containerized IoT PlatformSAVI-IoT: A Self-managing Containerized IoT Platform
SAVI-IoT: A Self-managing Containerized IoT PlatformYork University
 
Realtime Big Data Analytics for Event Detection in Highways
Realtime Big Data Analytics for Event Detection in HighwaysRealtime Big Data Analytics for Event Detection in Highways
Realtime Big Data Analytics for Event Detection in HighwaysYork University
 
Provisioning Performance of Cloud Microservice Platforms
Provisioning Performance of Cloud Microservice PlatformsProvisioning Performance of Cloud Microservice Platforms
Provisioning Performance of Cloud Microservice PlatformsYork University
 
MSc Thesis: Fingerprint Detection and Classification using Computational Geom...
MSc Thesis: Fingerprint Detection and Classification using Computational Geom...MSc Thesis: Fingerprint Detection and Classification using Computational Geom...
MSc Thesis: Fingerprint Detection and Classification using Computational Geom...York University
 
PhD Thesis: Performance Modeling of Cloud Computing Centers
PhD Thesis: Performance Modeling of Cloud Computing CentersPhD Thesis: Performance Modeling of Cloud Computing Centers
PhD Thesis: Performance Modeling of Cloud Computing CentersYork University
 

More from York University (7)

Elascale Poster
Elascale PosterElascale Poster
Elascale Poster
 
SAVI-IoT: A Self-managing Containerized IoT Platform
SAVI-IoT: A Self-managing Containerized IoT PlatformSAVI-IoT: A Self-managing Containerized IoT Platform
SAVI-IoT: A Self-managing Containerized IoT Platform
 
Realtime Big Data Analytics for Event Detection in Highways
Realtime Big Data Analytics for Event Detection in HighwaysRealtime Big Data Analytics for Event Detection in Highways
Realtime Big Data Analytics for Event Detection in Highways
 
Introduction to Hadoop
Introduction to HadoopIntroduction to Hadoop
Introduction to Hadoop
 
Provisioning Performance of Cloud Microservice Platforms
Provisioning Performance of Cloud Microservice PlatformsProvisioning Performance of Cloud Microservice Platforms
Provisioning Performance of Cloud Microservice Platforms
 
MSc Thesis: Fingerprint Detection and Classification using Computational Geom...
MSc Thesis: Fingerprint Detection and Classification using Computational Geom...MSc Thesis: Fingerprint Detection and Classification using Computational Geom...
MSc Thesis: Fingerprint Detection and Classification using Computational Geom...
 
PhD Thesis: Performance Modeling of Cloud Computing Centers
PhD Thesis: Performance Modeling of Cloud Computing CentersPhD Thesis: Performance Modeling of Cloud Computing Centers
PhD Thesis: Performance Modeling of Cloud Computing Centers
 

Recently uploaded

Team Lead Succeed – Helping you and your team achieve high-performance teamwo...
Team Lead Succeed – Helping you and your team achieve high-performance teamwo...Team Lead Succeed – Helping you and your team achieve high-performance teamwo...
Team Lead Succeed – Helping you and your team achieve high-performance teamwo...Association for Project Management
 
Tree View Decoration Attribute in the Odoo 17
Tree View Decoration Attribute in the Odoo 17Tree View Decoration Attribute in the Odoo 17
Tree View Decoration Attribute in the Odoo 17Celine George
 
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...DhatriParmar
 
Transaction Management in Database Management System
Transaction Management in Database Management SystemTransaction Management in Database Management System
Transaction Management in Database Management SystemChristalin Nelson
 
Mythology Quiz-4th April 2024, Quiz Club NITW
Mythology Quiz-4th April 2024, Quiz Club NITWMythology Quiz-4th April 2024, Quiz Club NITW
Mythology Quiz-4th April 2024, Quiz Club NITWQuiz Club NITW
 
MS4 level being good citizen -imperative- (1) (1).pdf
MS4 level   being good citizen -imperative- (1) (1).pdfMS4 level   being good citizen -imperative- (1) (1).pdf
MS4 level being good citizen -imperative- (1) (1).pdfMr Bounab Samir
 
Indexing Structures in Database Management system.pdf
Indexing Structures in Database Management system.pdfIndexing Structures in Database Management system.pdf
Indexing Structures in Database Management system.pdfChristalin Nelson
 
Daily Lesson Plan in Mathematics Quarter 4
Daily Lesson Plan in Mathematics Quarter 4Daily Lesson Plan in Mathematics Quarter 4
Daily Lesson Plan in Mathematics Quarter 4JOYLYNSAMANIEGO
 
4.9.24 School Desegregation in Boston.pptx
4.9.24 School Desegregation in Boston.pptx4.9.24 School Desegregation in Boston.pptx
4.9.24 School Desegregation in Boston.pptxmary850239
 
Unraveling Hypertext_ Analyzing Postmodern Elements in Literature.pptx
Unraveling Hypertext_ Analyzing  Postmodern Elements in  Literature.pptxUnraveling Hypertext_ Analyzing  Postmodern Elements in  Literature.pptx
Unraveling Hypertext_ Analyzing Postmodern Elements in Literature.pptxDhatriParmar
 
ARTERIAL BLOOD GAS ANALYSIS........pptx
ARTERIAL BLOOD  GAS ANALYSIS........pptxARTERIAL BLOOD  GAS ANALYSIS........pptx
ARTERIAL BLOOD GAS ANALYSIS........pptxAneriPatwari
 
Grade Three -ELLNA-REVIEWER-ENGLISH.pptx
Grade Three -ELLNA-REVIEWER-ENGLISH.pptxGrade Three -ELLNA-REVIEWER-ENGLISH.pptx
Grade Three -ELLNA-REVIEWER-ENGLISH.pptxkarenfajardo43
 
4.11.24 Mass Incarceration and the New Jim Crow.pptx
4.11.24 Mass Incarceration and the New Jim Crow.pptx4.11.24 Mass Incarceration and the New Jim Crow.pptx
4.11.24 Mass Incarceration and the New Jim Crow.pptxmary850239
 
Sulphonamides, mechanisms and their uses
Sulphonamides, mechanisms and their usesSulphonamides, mechanisms and their uses
Sulphonamides, mechanisms and their usesVijayaLaxmi84
 
Oppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmOppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmStan Meyer
 
ICS 2208 Lecture Slide Notes for Topic 6
ICS 2208 Lecture Slide Notes for Topic 6ICS 2208 Lecture Slide Notes for Topic 6
ICS 2208 Lecture Slide Notes for Topic 6Vanessa Camilleri
 
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxQ4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxlancelewisportillo
 
Scientific Writing :Research Discourse
Scientific  Writing :Research  DiscourseScientific  Writing :Research  Discourse
Scientific Writing :Research DiscourseAnita GoswamiGiri
 

Recently uploaded (20)

Team Lead Succeed – Helping you and your team achieve high-performance teamwo...
Team Lead Succeed – Helping you and your team achieve high-performance teamwo...Team Lead Succeed – Helping you and your team achieve high-performance teamwo...
Team Lead Succeed – Helping you and your team achieve high-performance teamwo...
 
Tree View Decoration Attribute in the Odoo 17
Tree View Decoration Attribute in the Odoo 17Tree View Decoration Attribute in the Odoo 17
Tree View Decoration Attribute in the Odoo 17
 
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...
 
Transaction Management in Database Management System
Transaction Management in Database Management SystemTransaction Management in Database Management System
Transaction Management in Database Management System
 
Mythology Quiz-4th April 2024, Quiz Club NITW
Mythology Quiz-4th April 2024, Quiz Club NITWMythology Quiz-4th April 2024, Quiz Club NITW
Mythology Quiz-4th April 2024, Quiz Club NITW
 
Mattingly "AI & Prompt Design: Large Language Models"
Mattingly "AI & Prompt Design: Large Language Models"Mattingly "AI & Prompt Design: Large Language Models"
Mattingly "AI & Prompt Design: Large Language Models"
 
MS4 level being good citizen -imperative- (1) (1).pdf
MS4 level   being good citizen -imperative- (1) (1).pdfMS4 level   being good citizen -imperative- (1) (1).pdf
MS4 level being good citizen -imperative- (1) (1).pdf
 
prashanth updated resume 2024 for Teaching Profession
prashanth updated resume 2024 for Teaching Professionprashanth updated resume 2024 for Teaching Profession
prashanth updated resume 2024 for Teaching Profession
 
Indexing Structures in Database Management system.pdf
Indexing Structures in Database Management system.pdfIndexing Structures in Database Management system.pdf
Indexing Structures in Database Management system.pdf
 
Daily Lesson Plan in Mathematics Quarter 4
Daily Lesson Plan in Mathematics Quarter 4Daily Lesson Plan in Mathematics Quarter 4
Daily Lesson Plan in Mathematics Quarter 4
 
4.9.24 School Desegregation in Boston.pptx
4.9.24 School Desegregation in Boston.pptx4.9.24 School Desegregation in Boston.pptx
4.9.24 School Desegregation in Boston.pptx
 
Unraveling Hypertext_ Analyzing Postmodern Elements in Literature.pptx
Unraveling Hypertext_ Analyzing  Postmodern Elements in  Literature.pptxUnraveling Hypertext_ Analyzing  Postmodern Elements in  Literature.pptx
Unraveling Hypertext_ Analyzing Postmodern Elements in Literature.pptx
 
ARTERIAL BLOOD GAS ANALYSIS........pptx
ARTERIAL BLOOD  GAS ANALYSIS........pptxARTERIAL BLOOD  GAS ANALYSIS........pptx
ARTERIAL BLOOD GAS ANALYSIS........pptx
 
Grade Three -ELLNA-REVIEWER-ENGLISH.pptx
Grade Three -ELLNA-REVIEWER-ENGLISH.pptxGrade Three -ELLNA-REVIEWER-ENGLISH.pptx
Grade Three -ELLNA-REVIEWER-ENGLISH.pptx
 
4.11.24 Mass Incarceration and the New Jim Crow.pptx
4.11.24 Mass Incarceration and the New Jim Crow.pptx4.11.24 Mass Incarceration and the New Jim Crow.pptx
4.11.24 Mass Incarceration and the New Jim Crow.pptx
 
Sulphonamides, mechanisms and their uses
Sulphonamides, mechanisms and their usesSulphonamides, mechanisms and their uses
Sulphonamides, mechanisms and their uses
 
Oppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmOppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and Film
 
ICS 2208 Lecture Slide Notes for Topic 6
ICS 2208 Lecture Slide Notes for Topic 6ICS 2208 Lecture Slide Notes for Topic 6
ICS 2208 Lecture Slide Notes for Topic 6
 
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxQ4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
 
Scientific Writing :Research Discourse
Scientific  Writing :Research  DiscourseScientific  Writing :Research  Discourse
Scientific Writing :Research Discourse
 

Adaptation as a Service

  • 1. #CASCON2018 Adaptation as a Service • Hamzeh Khazaei, University of Alberta • Alireza Ghanbari, Khatam University • Marin Litoiu, York University
  • 2. ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018 2 #CASCON2018 • Current and emerging complex systems of many types have increasingly distributed and dynamic architecture • provides unprecedented flexibility in creating and supporting applications • however end-to-end management will be a challenge. • The only solution is to let these system self-manage while compliant to end-users’ objectives • In this talk, I argue that building autonomic management systems is a challenging task and requires its own set of expertise and knowledge. • Therefore, in light of current challenges, available enablers and recent successful stories, we proposed & evaluated the idea of moving from self-adaptation to ADaptation-as-a- Service (ADaaS) Motivation
  • 3. ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018 3 #CASCON2018 • Software engineers are responsible to develop the autonomic management system (i.e., managing system) in addition to the real software system. • Design and implementation of AMSs gets complicated particularly when the managed application is highly distributed and heterogeneous in nature such as big data and IoT systems. • In other words, efficient AMSs can be built for each software system only if we have access to the right set of software engineers with proper skills to realize the MAPE-K loop efficiently. Self-Adaptive Systems
  • 4. ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018 4 #CASCON2018 1. Shared-nothing architecture and horizontal scalability 2. Cloud elasticity and availability 3. Infrastructure as Code and Software-defined Infrastructure 4. Microservice architecture 5. Application isolation provided by containers 6. Software-defined sensors or probes 7. Advancement in machine learning techniques 8. Big data analytics capabilities 9. More? Why do we think ADaaS is feasible?  enablers:
  • 5. ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018 5 #CASCON2018 Enablers and their impacts on MAPE-K loop building blocks Table 1.
  • 6. ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018 6 #CASCON2018 Successful stories and directions of research
  • 7. ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018 7 #CASCON2018 1. SecaaS provide protection for applications, data, and operations that run in the cloud 2. By 2020, 85% of large enterprises will use a cloud access security broker solution for their cloud services according to MarketsandMarkets 3. Currently there exist many SecaaS providers such as Pallera, Proofpoint, White Hat Security, and Juniper, to name a few 4. Examples: email encryption, security information and event management, identity and access management, endpoint protection, intrusion detection systems, data loss prevention, network security and disaster recovery as a service 5. Drawback: treat the managed software system as a black box and doesn’t change (i.e., adapt) the topology or components of the underlaying application. 6. By leveraging enablers 2, 3, 5, 6 and 7 in table 1, we can address drawbacks and take SecaaS to next level. Security as a Service (SecaaS)
  • 8. ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018 8 #CASCON2018 1. Proper configurations is hard to achieve at start up with one attempt. 2. The Default Configurations is good enough for “hello-world” applications. 3. The first step for ConfaaS could be designing and implementation of smart deployers. 4. One step further is to let the smart deployer choose the right infrastructure, i.e., flavor, size and number of VMs, for the managed application. 5. Reinforcement learning is a good candidate to build the brain of such smart deployers. 6. All enablers in Table 1 will play important roles in the realization of ConfaaS in nowadays cloud computing data centers. 7. Providing ConfaaS is in its infancy and needs more attention. Configuration as a Service (ConfaaS)
  • 9. ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018 9 #CASCON2018 1. The goal of self-healing is to make fault-tolerant and responsive system capable of responding to changes on demand and recuperation from failures. 2. Self-healing systems can be divided into three levels, depending on size and type of resources we are monitoring, and acting upon: • application level, platform level and infrastructure level. 3. Application level healing will be implemented by programmers and software engineers during SDLC. 4. Unlike the application level healing, platform level self-healing can be generalized and be applied to all services and applications, regardless of their internals. 5. This is the type of self-healing that can be provided by cloud service providers as-a- service. 6. The real meaning of healing at infrastructure level is redeployment of services from an unhealthy node to a healthy one. 7. In fact, most of infrastructure failures are addressed at the platform level. Healing as a Service (HaaS)
  • 10. ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018 10 #CASCON2018 1. Primary objectives of optimization are performance, operation cost, availability and maintainability. 2. Cloud service providers have already provided some basic services to help their customers to optimize cost, performance or balance them; e.g., auto scalability for EC2. 3. IBM Bluemix auto-scalability for microservices (i.e., PaaS). 4. One fundamental limitation with above approaches is that they stay at platform level and have no sense of the inside applications. 5. To this end, software-defined sensors/probes such as Elastic beats may be leveraged to instrument cloud applications and measures the high order performance indicators in a transparent manner. 6. Provided that a cloud service provider now could monitor the whole stack and perform corrective actions to optimize the application at all levels. Optimization as a Service (OaaS)
  • 11. ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018 11 #CASCON2018 • Autoscalability is a must and now is fully feasible • Required: Highly distributed architecture and sheer complexity • Feasible: Elasticity, Software-Defined environments and microservices • It’s a data centric process • Whole data life cycle, large-scale systems, big data characteristics in application data • Needs to be at both application and infrastructure levels • A compelling combination of VM and Containers: security + availability of IaaS cloud + flexibility of microservices + negligible performance overhead • How about Auto-scalability as a Service then? Proof of Concept – a case study in optimization
  • 12. ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018 12 #CASCON2018 • A clipped combination of Elasticsearch and Scale • Is to provide auto-scalability and self-healing as-a-service • Dockerized applications on OpenStack • Extendibility by design • To be a De facto platform for evaluating/comparison scalability algorithms • Our definition: • Microservices • Macroservices • Implemented in Python and open source Elascale
  • 13. ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018 13 #CASCON2018 High Level Architecture Cluster Workers Macroservice Manager Application Containers Microservice Manager Virtual Resources Cloud Interface Physical Resources Cluster Manager … Cluster Workers Scaling Engine Visualization Scaling Algorithms MonitoringManagement ElascaleApplicationCloud Provider Plugins
  • 14. ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018 14 #CASCON2018 High Level Architecture Cluster Workers Macroservice Manager Application Containers Microservice Manager Virtual Resources Cloud Interface Physical Resources Cluster Manager … Cluster Workers Scaling Engine Visualization Scaling Algorithms MonitoringManagement ElascaleApplicationCloud Provider Plugins
  • 15. ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018 15 #CASCON2018 Elascale in Action …. VM ElascaleApplication VM VM A A AA A A AA b b b b LS ES K EC b b A b ES Application Container Beat Container Elasticsearch Container Logstash Container Kibana Container Elascale Core ContainerEC LS K Data Flow Command FlowVM Virtual Machine
  • 16. ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018 16 #CASCON2018 Elascale in Action …. VM ElascaleApplication VM VM A A AA A A AA b b b b LS ES K EC b b A b ES Application Container Beat Container Elasticsearch Container Logstash Container Kibana Container Elascale Core ContainerEC LS K Data Flow Command FlowVM Virtual Machine
  • 17. ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018 17 #CASCON2018 Experiment: IoT Application Core-Cloud Cassandra Visualization Dockbeat Kafka IoT-Edge-Processor Edge-Cloud Virtual-Sensor-Containers Swarm Manager Metricbeat Dockbeat Metricbeat Elascale Core Zookeeper Dockbeat Metricbeat Kibana Elasticsearch Logstash Elascale Component Application Component
  • 18. ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018 18 #CASCON2018 Highly configurable
  • 19. ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018 19 #CASCON2018 Results
  • 20. ADaptation as a Service (ADaaS) – Hamzeh Khazaei – Oct 29, 2018 20 #CASCON2018 1. Recorded Video: https://goo.gl/4pVK6w Demo

Editor's Notes

  1. BaaS service.
  2. As cloud software systems have been more and more distributed and heterogeneous, the proper configuration (ie, acceptable performance, security, reliability, availability, fault-tolerance, etc) is challenging to achieve.
  3. For examples Docker, Consul Watches, and Jenkins automatically monitor both underlying infrastructure and deployed services in order to provide self-healing at system level oblivious to the internal code and logic of the application. If a physical node is not working correctly, chances are that the service will fail, and thus will be fixed by platform-level healing such as VM migration or container redeployment. As can be seen, enablers number 2, 3, 4 and 5 in Table 1 empower cloud service providers to provide HaaS at infrastructure and platform levels.
  4. The conceptual model of self-adaptive systems comprises four basic elements: environment, managed system, adaptation goals, and autonomic manager. The managed system comprises the application code that realizes the system’s domain functionality. The adaptation goals are concerns of the autonomic manager over the managed system. Four high-level adaptations goals: self-configuration (i.e., systems that configure themselves automatically), self-optimization (systems that continually seek ways to improve their performance and/or cost), self-healing (systems that detect, diagnose, and repair problems resulting from bugs or failures), and self-protection (systems that defend themselves from malicious attacks or cascading failures). The managing system (AMS) comprises the adaptation logic that deals with one or more adaption goals. The four elements: Monitor, Analyze, Plan, and Execute realize the basic functions of any self-adaptive system. These elements share com- mon Knowledge hence the model is often referred to as the MAPE-K model. One well-known approach to engineer adaptive software systems is architecture-based self-adaptation. The core of architecture-based self-adaptation is the use of a feedback loop accompanied by a runtime analytical/experimental model to monitor the software application behavior during execution, evaluate the model for requirements compliance, and if needed, perform adaptations, either at system, module, or parameter settings.