CoMoT – a Platform-as-a-Service for
Elasticity in the Cloud
Future of PaaS@IC2E 2014
Hong-Linh Truong, Schahram Dustdar, Georgiana Copil,
Alessio Gambi, Waldemar Hummer, Duc-Hung Le, Daniel
Moldovan
Distributed Systems Group
Vienna University of Technology
truong@dsg.tuwien.ac.at
Future of PaaS@IC2E 2014, 11 Mar
2014, Boston, USA
1
Outline
 Motivation
 Programming, deploying, controlling,
monitoring and testing elasticity
 CoMoT architecture
 Illustrating example
 Conclusions and future work
Future of PaaS@IC2E 2014,
11 Mar 2014, Boston, USA
2
Motivation (1)
 Multi-dimensional elasticity is the fundamental
requirement for native cloud services
 resource elasticity, cost elasticity and quality
elasticity
 But fragmented support on engineering
elasticity requirements, execution, monitoring
and testing, e.g.,
 Only at resource elasticity at the IaaS level
 Lack of elasticity monitoring for applications
 Testing is not integrated with other phases
Future of PaaS@IC2E 2014,
11 Mar 2014, Boston, USA
3
Service
Developer
Infrastructure
Provider
Service
Owner
Service
Developer
Designing and
programming software-
defined elastic services
Designing and
programming software-
defined elastic services
Automatic service
deployment
Automatic service
deployment
Elasticity monitoring and
analysis
Elasticity monitoring and
analysis
Elasticity ControlElasticity Control
Service
Owner
Infrastructure
Provider
Service
Owner
Easy to
program
elasticity
requirements
Reduced time to
market
+
Easy to understand
service’s elasticity
boundaries
+
Maintains service’s
performance while
reducing cost
Reduces
resources
overprovisioning
+
Motivation (2)
Future of PaaS@IC2E 2014,
11 Mar 2014, Boston, USA
4
Native cloud service engineering
Elasticity
Metrics
Elasticity
Requirements
Elasticity capabilities
(e.g. scale IN/OUT)
So what need to be done? A simple
view
Future of PaaS@IC2E 2014,
11 Mar 2014, Boston, USA
5
Programming services
Fundamental building blocks for
the elasticity
 Conceptualizing and modeling elastic objects and
execution environments
 So we can manage diverse types of artifacts and their runtime
in a similar manner
 Defining elasticity primitive operations associated with
elastic objects and environments
 Programming elastic objects
 a software-defined elastic service (SES) is built from elastic
objects
 Runtime deploying, control, monitoring and testing
techniques for elastic objects
Future of PaaS@IC2E 2014,
11 Mar 2014, Boston, USA
6
Elastic objects and execution
environments
Future of PaaS@IC2E 2014,
11 Mar 2014, Boston, USA
7
Modeling type of units (e.g.,
computation, data,
monitoring,) and their
dependencies
Consumption,
ownership, provisioning,
price, etc.
Elastic
Service
Unit
Service
model
Unit
Dependency
Elastic
Capability
Function
The functional
capability of the unit
and interface to
access the function Capabilities to be elastic
under different
requirements
Elasticity primitive operations
Future of PaaS@IC2E 2014,
11 Mar 2014, Boston, USA
8
Programming software-defined
elastic services (SESs)
 Enriching OCCI with elasticity requirements
 Describing SES in TOSCA
Future of PaaS@IC2E 2014,
11 Mar 2014, Boston, USA
9
Deploying, Control, Monitoring and
Testing
 Runtime deployment
 Complex services at multiple software stacks (IaaS,
PaaS and application)
 Using and enriching TOSCA for describing
deployment topology
 Different interactions between deploying and control
and monitoring components
 Control elasticity
 Using a high-level specification for specifying
elasticity requirements, constraints and strategies
 Based on SYBL/rSYBL ([CCGrid 2013])
Future of PaaS@IC2E 2014,
11 Mar 2014, Boston, USA
10
Deploying, Control, Monitoring and
Testing
 Elasticity monitoring and analysis
 Utilize low-level metrics to build „Elasticity Space“
and analyze the elasticity based on such spaces
(based on MELA – [CloudCom 2013])
 Monitoring/analysis at multiple levels level (single
unit, topology/group, and the whole service
 Testing elasticity
 Using clouds to test cloud applications as well as to
test elasticity properties of cloud applications
[ASE2013, IC2014]
Future of PaaS@IC2E 2014,
11 Mar 2014, Boston, USA
11
Software-defined
Elastic System
Programming
Software-defined
Elastic System
Programming
Tooling – Elasticity
Programming in
Cloud Systems
Elastic Service
Ecosystem and
Recommendation
Elastic Service
Ecosystem and
Recommendation
DeploymentDeployment
Deployment
Service
Deployment
Service
Test Generating
and Execution
Test Generating
and Execution
Elastic Test
Service
Elastic Test
Service
deploy SDS/
service units
deploy elasticity
controller and monitor
Elasticity
Analysis
Elasticity
Analysis
deploy
test cases
ElasticizingElasticizing
Elasticity
Monitoring
and Analysis
Elasticity
Monitoring
and Analysis
Elasticity
Control
Elasticity
Control
test
control
monitor
CoMoT PaaS
Core Services
Multi-Cloud
Environments
Service
Ecosystems
Service Artifact
Repository
Service units
CoMoT (1)
CoMoT is built atop: rSYBL, MELA, SALSA, AutoCles
GIT: https://github.com/tuwiendsg and https://github.com/whummer/AUToCLES
Note: CoMoT code is not there yet but other packages
CoMoT is built atop: rSYBL, MELA, SALSA, AutoCles
GIT: https://github.com/tuwiendsg and https://github.com/whummer/AUToCLES
Note: CoMoT code is not there yet but other packages
Future of PaaS@IC2E 2014,
11 Mar 2014, Boston, USA
12
13
Elastic Software
Defined Service
Description
Deployment
Multi-Level Elasticity Control
CoMoT (2)
Future of PaaS@IC2E 2014,
11 Mar 2014, Boston, USA
Illustrating Example (1)
Future of PaaS@IC2E 2014,
11 Mar 2014, Boston, USA
14
Illustrating Example (2)
Future of PaaS@IC2E 2014,
11 Mar 2014, Boston, USA
15
Illustrating example (3)
Future of PaaS@IC2E 2014,
11 Mar 2014, Boston, USA
16
Video
Video
Conclusions and future work
 Native cloud applications need novel PaaSs
 Design, deployment, control, monitoring and testing
of elasticity in interwoven engineering phases
 CoMoT introduces concepts of elastic objects and
fundamental building blocks for engineering an end-
to-end elasticity for cloud services
 Future works
 Programming languages for elastic objects
 Further work on hot deployment and configuration
under elasticity control
 Testing elasticity dependencies
Future of PaaS@IC2E 2014,
11 Mar 2014, Boston, USA
17
Thanks for your attention!
Hong-Linh Truong
Distributed Systems Group
TU Wien
truong@dsg.tuwien.ac.at
dsg.tuwien.ac.at/research/viecom
Future of PaaS@IC2E 2014,
11 Mar 2014, Boston, USA
18

CoMoT – A Platform-as-a-Service for Elasticity in the Cloud

  • 1.
    CoMoT – aPlatform-as-a-Service for Elasticity in the Cloud Future of PaaS@IC2E 2014 Hong-Linh Truong, Schahram Dustdar, Georgiana Copil, Alessio Gambi, Waldemar Hummer, Duc-Hung Le, Daniel Moldovan Distributed Systems Group Vienna University of Technology truong@dsg.tuwien.ac.at Future of PaaS@IC2E 2014, 11 Mar 2014, Boston, USA 1
  • 2.
    Outline  Motivation  Programming,deploying, controlling, monitoring and testing elasticity  CoMoT architecture  Illustrating example  Conclusions and future work Future of PaaS@IC2E 2014, 11 Mar 2014, Boston, USA 2
  • 3.
    Motivation (1)  Multi-dimensionalelasticity is the fundamental requirement for native cloud services  resource elasticity, cost elasticity and quality elasticity  But fragmented support on engineering elasticity requirements, execution, monitoring and testing, e.g.,  Only at resource elasticity at the IaaS level  Lack of elasticity monitoring for applications  Testing is not integrated with other phases Future of PaaS@IC2E 2014, 11 Mar 2014, Boston, USA 3
  • 4.
    Service Developer Infrastructure Provider Service Owner Service Developer Designing and programming software- definedelastic services Designing and programming software- defined elastic services Automatic service deployment Automatic service deployment Elasticity monitoring and analysis Elasticity monitoring and analysis Elasticity ControlElasticity Control Service Owner Infrastructure Provider Service Owner Easy to program elasticity requirements Reduced time to market + Easy to understand service’s elasticity boundaries + Maintains service’s performance while reducing cost Reduces resources overprovisioning + Motivation (2) Future of PaaS@IC2E 2014, 11 Mar 2014, Boston, USA 4 Native cloud service engineering
  • 5.
    Elasticity Metrics Elasticity Requirements Elasticity capabilities (e.g. scaleIN/OUT) So what need to be done? A simple view Future of PaaS@IC2E 2014, 11 Mar 2014, Boston, USA 5 Programming services
  • 6.
    Fundamental building blocksfor the elasticity  Conceptualizing and modeling elastic objects and execution environments  So we can manage diverse types of artifacts and their runtime in a similar manner  Defining elasticity primitive operations associated with elastic objects and environments  Programming elastic objects  a software-defined elastic service (SES) is built from elastic objects  Runtime deploying, control, monitoring and testing techniques for elastic objects Future of PaaS@IC2E 2014, 11 Mar 2014, Boston, USA 6
  • 7.
    Elastic objects andexecution environments Future of PaaS@IC2E 2014, 11 Mar 2014, Boston, USA 7 Modeling type of units (e.g., computation, data, monitoring,) and their dependencies Consumption, ownership, provisioning, price, etc. Elastic Service Unit Service model Unit Dependency Elastic Capability Function The functional capability of the unit and interface to access the function Capabilities to be elastic under different requirements
  • 8.
    Elasticity primitive operations Futureof PaaS@IC2E 2014, 11 Mar 2014, Boston, USA 8
  • 9.
    Programming software-defined elastic services(SESs)  Enriching OCCI with elasticity requirements  Describing SES in TOSCA Future of PaaS@IC2E 2014, 11 Mar 2014, Boston, USA 9
  • 10.
    Deploying, Control, Monitoringand Testing  Runtime deployment  Complex services at multiple software stacks (IaaS, PaaS and application)  Using and enriching TOSCA for describing deployment topology  Different interactions between deploying and control and monitoring components  Control elasticity  Using a high-level specification for specifying elasticity requirements, constraints and strategies  Based on SYBL/rSYBL ([CCGrid 2013]) Future of PaaS@IC2E 2014, 11 Mar 2014, Boston, USA 10
  • 11.
    Deploying, Control, Monitoringand Testing  Elasticity monitoring and analysis  Utilize low-level metrics to build „Elasticity Space“ and analyze the elasticity based on such spaces (based on MELA – [CloudCom 2013])  Monitoring/analysis at multiple levels level (single unit, topology/group, and the whole service  Testing elasticity  Using clouds to test cloud applications as well as to test elasticity properties of cloud applications [ASE2013, IC2014] Future of PaaS@IC2E 2014, 11 Mar 2014, Boston, USA 11
  • 12.
    Software-defined Elastic System Programming Software-defined Elastic System Programming Tooling– Elasticity Programming in Cloud Systems Elastic Service Ecosystem and Recommendation Elastic Service Ecosystem and Recommendation DeploymentDeployment Deployment Service Deployment Service Test Generating and Execution Test Generating and Execution Elastic Test Service Elastic Test Service deploy SDS/ service units deploy elasticity controller and monitor Elasticity Analysis Elasticity Analysis deploy test cases ElasticizingElasticizing Elasticity Monitoring and Analysis Elasticity Monitoring and Analysis Elasticity Control Elasticity Control test control monitor CoMoT PaaS Core Services Multi-Cloud Environments Service Ecosystems Service Artifact Repository Service units CoMoT (1) CoMoT is built atop: rSYBL, MELA, SALSA, AutoCles GIT: https://github.com/tuwiendsg and https://github.com/whummer/AUToCLES Note: CoMoT code is not there yet but other packages CoMoT is built atop: rSYBL, MELA, SALSA, AutoCles GIT: https://github.com/tuwiendsg and https://github.com/whummer/AUToCLES Note: CoMoT code is not there yet but other packages Future of PaaS@IC2E 2014, 11 Mar 2014, Boston, USA 12
  • 13.
    13 Elastic Software Defined Service Description Deployment Multi-LevelElasticity Control CoMoT (2) Future of PaaS@IC2E 2014, 11 Mar 2014, Boston, USA
  • 14.
    Illustrating Example (1) Futureof PaaS@IC2E 2014, 11 Mar 2014, Boston, USA 14
  • 15.
    Illustrating Example (2) Futureof PaaS@IC2E 2014, 11 Mar 2014, Boston, USA 15
  • 16.
    Illustrating example (3) Futureof PaaS@IC2E 2014, 11 Mar 2014, Boston, USA 16 Video Video
  • 17.
    Conclusions and futurework  Native cloud applications need novel PaaSs  Design, deployment, control, monitoring and testing of elasticity in interwoven engineering phases  CoMoT introduces concepts of elastic objects and fundamental building blocks for engineering an end- to-end elasticity for cloud services  Future works  Programming languages for elastic objects  Further work on hot deployment and configuration under elasticity control  Testing elasticity dependencies Future of PaaS@IC2E 2014, 11 Mar 2014, Boston, USA 17
  • 18.
    Thanks for yourattention! Hong-Linh Truong Distributed Systems Group TU Wien truong@dsg.tuwien.ac.at dsg.tuwien.ac.at/research/viecom Future of PaaS@IC2E 2014, 11 Mar 2014, Boston, USA 18