Elastic Processes on Clouds of HybridServices: Principles, Enabling Techniques             and Approaches                 ...
Acknowledgement: some results from joint  works with:  Kamal Bhattacharya, Schahram Dustdar, Muhammad Zuhri Catur  Candra,...
An example of elastic processesRecap: Schahram‘s presentation yesterdaySummerSOC 12, 3 Jul 2012   3
Hybrid services in the cloudSummerSOC   12, 3 Jul 2012   4
How to realize elasticity in hybrid       systems?Attention: ongoing work  not everything iswell tested !SummerSOC   12, ...
Outline Vienna Elastic Computing Model Incorporating humans into programming  paradigms Programming hybrid services in ...
VIENNA ELASTIC COMPUTING  MODELSummerSOC   12, 3 Jul 2012   7
Multi-dimensional Elasticity                                   Units can be                                   networks, mi...
Vienna Elastic Computing Modelmulti-dimensional elasticity, service computing modelsand cloud provisioning models Schahram...
INCORPORATING HUMANS   INTO PROGRAMMING   PARADIGMSummerSOC 12, 3 Jul 2012   10
Incorporate humans into a         programming paradigm                    • Abstracting human compute units as program ele...
Incorporate humans into a               programming paradigm                                      program human actions   ...
Existing technologies are not            adequateSummerSOC 12, 3 Jul 2012   13
PROGRAMMING HYBRID   SERVICES IN THE CLOUDHong-Linh Truong, Schahram Dustdar, Kamal Bhattacharya, Programming Hybrid Servi...
HBS Communication Interface Based on well known technologies for  integrating human requests/responses into SBS     Emai...
Human Power Unit (HPU) Humans are determined via skills/skill levels A particular HBS cloud can define its own sets of  ...
Human Power Unit (HPU) – our             starting pointHPU for a particular (skill,skill level)HPU for a set of (skill, sk...
HBS Instances Provisioning     Types of               • Individual Compute Unit (ICU)     services               • Social ...
Cloud APIs for Provisioning Hybrid              Services    APIs hide low-level platforms and utilize low level HBS    com...
Prototype (simulated environment)Combined with Jcloud/boto for real SBSSummerSOC 12, 3 Jul 2012   20
Framework for Utilizing Hybrid            ServicesIT ManagementSmart City ManagementSummerSOC 12, 3 Jul 2012   21
Modeling HPU-aware Task            Dependency GraphsLink management skills and compliance constraints to tasks   required ...
Programming a combination of            HBS and SBSe.g., preparing/managing inputs/outputs for HBS using SBSSummerSOC 12, ...
Forming iSCUs Done by consumers or cloud providers                                           Business As                 ...
Configuring iSCU Establish „connectedness“ based on compliance  constraints and network topology     Addional cost might...
Selecting HBS: Some algorithms Several algorithms can be built based on existing team  formation algorithms which do not ...
Forming iSCU by minimizing cost            and considering no directionSummerSOC 12, 3 Jul 2012   27
Example of star-based iSCU using            Dropbox as a communication hubSummerSOC 12, 3 Jul 2012   28
Change Model for Task Graph’s            Human Power UnitSummerSOC 12, 3 Jul 2012   29
MODELING ELASTICITY  CONSTRAINTSummerSOC 12, 3 Jul 2012   30
Elasticitiy modeling• Beyond traditional QoS metrics and for only  services• Modeling elasticity constraints• Attaching el...
Beyond QoS metrics (1)                                And many more metrics!SummerSOC 12, 3 Jul 2012   32
Beyond QoS metrics (2)                                                                           Elastic dynamic propertie...
Elastic Profile Using Rules    process    process   fragment    activitySummerSOC 12, 3 Jul 2012   34
Declarative constraints based first-          order logic and set theory                                Lam-Son Le, Hong-L...
REASON THE ELASTICITY   CONSTRAINTSSummerSOC 12, 3 Jul 2012   36
Runtime quality, cost and benefits                evaluation and reasoning                principles  Runtime:  Elastic  p...
Composable cost evaluation                                                                                  Tran Vu Pham, ...
Runtime evaluation of quality of                       data in workflowsMichael Reiter, Uwe Breitenbuecher, Schahram Dustd...
Incentive MonitoringOgnjen Scekic, Hong-Linh Truong, Schahram Dustdar, "Modeling Rewards and Incentive Mechanisms for Soci...
Put things together -- IDE for            elastic processesSummerSOC 12, 3 Jul 2012   41
Put things together – from high-level            languages to programmable units Statelet: a declarative coordination lan...
Conclusions and Future Work Novel models and APIs are needed for integrating  humans into program paradigms We need to a...
Thanks for                      your attention                           Hong-Linh Truong                           Distri...
Upcoming SlideShare
Loading in …5
×

Elastic Processes on Clouds of Hybrid Services: Principles, Enabling Techniques and Approaches

490 views
388 views

Published on

The emerging cloud computing and socially-enhanced services computing concepts o
ffer several service models, including software-based and human-based
services, for programming elastic composite applications utilizing
human and software capabilities. However, the current view of elasticity still
is centered on the elasticity of software resources. In this talk, we will
systematically conceptualize principles for
supporting multi-dimensional elasticity, covering resources (software
and humans), quality (e.g., quality of service and quality of data), and
costs and benefits (e.g., price, rewards and incentives). We then discuss
enabling techniques for supporting multi-dimensional elasticity in
data-, compute- and human-intensive processes. Finally, we will discuss
some initial results and approaches on modeling multi-dimensional elasticity,
programming software and human services, and elasticity reasoning.

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
490
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Elastic Processes on Clouds of Hybrid Services: Principles, Enabling Techniques and Approaches

  1. 1. Elastic Processes on Clouds of HybridServices: Principles, Enabling Techniques and Approaches Hong-Linh Truong Distributed Systems Group, Vienna University of Technology truong@infosys.tuwien.ac.at http://www.infosys.tuwien.ac.at/staff/truongSummerSOC 12, 3 Jul 2012 1
  2. 2. Acknowledgement: some results from joint works with: Kamal Bhattacharya, Schahram Dustdar, Muhammad Zuhri Catur Candra, Aditya Ghose, Lam-Son Le, Frank Leymann, Vitaliy Liptchinsky, Tran-Vu Pham, Michael Reiter, Mirela Riveni, Ognjen Scekic, Quang-Hieu Vu, and Rostyslav ZaboloznyiSummerSOC 12, 3 Jul 2012 2
  3. 3. An example of elastic processesRecap: Schahram‘s presentation yesterdaySummerSOC 12, 3 Jul 2012 3
  4. 4. Hybrid services in the cloudSummerSOC 12, 3 Jul 2012 4
  5. 5. How to realize elasticity in hybrid systems?Attention: ongoing work  not everything iswell tested !SummerSOC 12, 3 Jul 2012 5
  6. 6. Outline Vienna Elastic Computing Model Incorporating humans into programming paradigms Programming hybrid services in the cloud Modeling elasticity constraints Reasoning elasticity constraints Conclusions and future workSummerSOC 12, 3 Jul 2012 6
  7. 7. VIENNA ELASTIC COMPUTING MODELSummerSOC 12, 3 Jul 2012 7
  8. 8. Multi-dimensional Elasticity Units can be networks, middleware, Sa aS, PaaSSummerSOC 12, 3 Jul 2012 8
  9. 9. Vienna Elastic Computing Modelmulti-dimensional elasticity, service computing modelsand cloud provisioning models Schahram Dustdar, Hong-Linh Truong, "Virtualizing Software and Humans for Elastic Processes in Multiple Clouds - a Service Management Perspective" International Journal of Next-Generation Computing, To appear, 2012 SummerSOC 12, 3 Jul 2012 9
  10. 10. INCORPORATING HUMANS INTO PROGRAMMING PARADIGMSummerSOC 12, 3 Jul 2012 10
  11. 11. Incorporate humans into a programming paradigm • Abstracting human compute units as program elementsProgramming • Extending programming languages to support human languages compute units • Data/control flows via extensible APIs • Shared memory (e.g., human –software – Multiple human), message passing (human-to-human), artifact-programming centric, etc., via APIs working atop the compute unit models abstraction layer • Computing capability /profile management: human computing power, reputation and incentive models Execution • Monitoring: monitoring and enforcing environment incentives/rewards, quality of results, availability • Communication: between human-middleware, among ICU/SCU , within SCU for exchanging artifacts and comprehensing social tasksSummerSOC 12, 3 Jul 2012 11
  12. 12. Incorporate humans into a programming paradigm program human actions and dependencies program incentive condition Program elements and rewarding action program result evaluation method Program languages and programming models Provisioning/Negotiation/Execution API IC IC SC U U U ICU SCU Abstraction of Human Compute Units Communication Capability/Profile Software Human-to-middleware Monitoring Management Compute interfaces: Service-based Middleware Units •visualization of collective tasks •embedding of common forms •mobile app Volunteers Professionals Individual Team 12SummerSOC 12, 3 Jul 2012
  13. 13. Existing technologies are not adequateSummerSOC 12, 3 Jul 2012 13
  14. 14. PROGRAMMING HYBRID SERVICES IN THE CLOUDHong-Linh Truong, Schahram Dustdar, Kamal Bhattacharya, Programming Hybrid Services in the Cloud,Working paper,2012SummerSOC 12, 3 Jul 2012 14
  15. 15. HBS Communication Interface Based on well known technologies for integrating human requests/responses into SBS  Emails, web interfaces, Web services, etc. Some special characteristics  The same protocol can be used for multiple layers (middleware, application, OS) -- unlike in SBS  Only asyschronous communication and unknown upper-bound delay Can support message passing and shared memory models  hbsi  hbsj or hbsi  sbs  hbsjSummerSOC 12, 3 Jul 2012 15
  16. 16. Human Power Unit (HPU) Humans are determined via skills/skill levels A particular HBS cloud can define its own sets of skills (CS) and skill levels (SK)  Similar to Amazon defines its own EC unit  Different ways to make sure skill and skill levels declared in a cloud consistent (e.g., via testing and monitoring).HPU Definition: HPU is a value describing the computingpower of an HBS measured in an abstract unit. A cloud ofHBS has a pre-defined basic powerunit, hpuθ, corresponding to the baseline skill bsθ of thecloud.”SummerSOC 12, 3 Jul 2012 16
  17. 17. Human Power Unit (HPU) – our starting pointHPU for a particular (skill,skill level)HPU for a set of (skill, skilllevel), no weighted factorsDecomposition/composition of HPU for a sharedHBS Given an HBS, its theoretical HPU can be larger or smaller than its real HPU – unlike SBS SummerSOC 12, 3 Jul 2012 17
  18. 18. HBS Instances Provisioning Types of • Individual Compute Unit (ICU) services • Social Compute Unit (SCU • iICU(CS, HPU, price, utilization,loc Instances ation, APIs) Description • iSCU(CS,HPU, price, utilization,co s nnectedness, location, APIs) • Other (traditional) NFPs • utilization Pricing • offering communication APIs factors • connectednessSummerSOC 12, 3 Jul 2012 18
  19. 19. Cloud APIs for Provisioning Hybrid Services APIs hide low-level platforms and utilize low level HBS communication interfaces APIs for HBS information and APIs for HBS execution and management communication• listSkills();listSkillLevels();• listICU();listSCU() • runRequestOnHBS ()• negotiateHBS() • receiveResultFromHBS()• startHBS() • sendMessageToHBS()• suspendHBS () • receiveMessageFromHBS()• resumeHBS ()• stopHBS()• reduceHBS()• expandHBS() 2012 SummerSOC 12, 3 Jul 19
  20. 20. Prototype (simulated environment)Combined with Jcloud/boto for real SBSSummerSOC 12, 3 Jul 2012 20
  21. 21. Framework for Utilizing Hybrid ServicesIT ManagementSmart City ManagementSummerSOC 12, 3 Jul 2012 21
  22. 22. Modeling HPU-aware Task Dependency GraphsLink management skills and compliance constraints to tasks required HBS Can be specified in TOSCA! Modeled in dependency graphs 22SummerSOC 12, 3 Jul 2012
  23. 23. Programming a combination of HBS and SBSe.g., preparing/managing inputs/outputs for HBS using SBSSummerSOC 12, 3 Jul 2012 23
  24. 24. Forming iSCUs Done by consumers or cloud providers Business As Usual Corrective Action HBS Constraints SCU Formation AlgorithmsSummerSOC 12, 3 Jul 2012 24
  25. 25. Configuring iSCU Establish „connectedness“ based on compliance constraints and network topology  Addional cost might occur! Program SBS and HBS for the iSCU to have a complete working environment. Different connectedness  E.g., Ring-based, star-based, and master-slave topologiesSummerSOC 12, 3 Jul 2012 25
  26. 26. Selecting HBS: Some algorithms Several algorithms can be built based on existing team formation algorithms which do not consider dependency graphs Different weighted factors can be consideredSummerSOC 12, 3 Jul 2012 26
  27. 27. Forming iSCU by minimizing cost and considering no directionSummerSOC 12, 3 Jul 2012 27
  28. 28. Example of star-based iSCU using Dropbox as a communication hubSummerSOC 12, 3 Jul 2012 28
  29. 29. Change Model for Task Graph’s Human Power UnitSummerSOC 12, 3 Jul 2012 29
  30. 30. MODELING ELASTICITY CONSTRAINTSummerSOC 12, 3 Jul 2012 30
  31. 31. Elasticitiy modeling• Beyond traditional QoS metrics and for only services• Modeling elasticity constraints• Attaching elasticity constraints to processes at the design time for composition and runtime elasticitySummerSOC 12, 3 Jul 2012 31
  32. 32. Beyond QoS metrics (1) And many more metrics!SummerSOC 12, 3 Jul 2012 32
  33. 33. Beyond QoS metrics (2) Elastic dynamic properties associated with: Data marketplaces and DaaS Service APIs, data APIs and data assetsQuang Hieu Vu, Tran Vu Pham, Hong-Linh Truong, Schahram Dustdar, RasoolAsal, DEMODS: A Description Model for Data-as-a-Service, The 26th IEEEInternational Conference on Advanced Information Networking and Applications(AINA-2012) SummerSOC 12, 3 Jul 2012 33
  34. 34. Elastic Profile Using Rules process process fragment activitySummerSOC 12, 3 Jul 2012 34
  35. 35. Declarative constraints based first- order logic and set theory Lam-Son Le, Hong-Linh Truong, Adytia Ghose, Schahram Dustdar, On Elasticity and Constrainedness of Business Services Provisioning, 9th International Conference on Services Computing (SCC 2012)SummerSOC 12, 3 Jul 2012 35
  36. 36. REASON THE ELASTICITY CONSTRAINTSSummerSOC 12, 3 Jul 2012 36
  37. 37. Runtime quality, cost and benefits evaluation and reasoning principles Runtime: Elastic processes Part A Part B Part CQuality, cost model i model j model kand benefits SummerSOC 12, 3 Jul 2012 37
  38. 38. Composable cost evaluation Tran Vu Pham, Hong-Linh Truong, Schahram Dustdar "Elastic High Performance Applications - A Composition Framework", The 2011 Asia-Pacific Services Computing Conference (IEEE APSCC 2011), (c) IEEE Computer Society, December 12 - 15, 2011, Jeju, KoreaHong Linh Truong, Schahram Dustdar: Composable cost estimation and monitoring for computational applications in cloudcomputing environments. Procedia CS 1(1): 2175-2184 (2010) 38SummerSOC 12, 3 Jul 2012
  39. 39. Runtime evaluation of quality of data in workflowsMichael Reiter, Uwe Breitenbuecher, Schahram Dustdar, Dimka Karastoyanova, Frank Leymann, Hong-Linh Truong, A Novel Framework for Monitoringand Analyzing Quality of Data in Simulation Workflows, (c)IEEE Computer Society, The 7th IEEE International Conference on e-Science, 5-8 December,2011, Stockholm, Sweden 3 Jul 2012 SummerSOC 12, 39Michael Reiter, Hong-Linh Truong, Schahram Dustdar, Dimka Karastoyanova, Robert Krause, Frank Leymann, Dieter Pahr, On Analyzing Quality ofData Infuences on Performance of Finite Elements driven Computational Simulations, EuroPar 2012
  40. 40. Incentive MonitoringOgnjen Scekic, Hong-Linh Truong, Schahram Dustdar, "Modeling Rewards and Incentive Mechanisms for Social BPM",, Short paper, 10th InternationalConference on Business Process Management (BPM2012), (c)Springer-Verlag, September 3-6, 2012, Tallinn, Estonia SummerSOC 12, 3 Jul 2012 40
  41. 41. Put things together -- IDE for elastic processesSummerSOC 12, 3 Jul 2012 41
  42. 42. Put things together – from high-level languages to programmable units Statelet: a declarative coordination language for collaboration processes Statelet statements can be mapped to APIs for programmable units Vitaliy Liptchinsky, Roman Khazankin, Hong Linh Truong, Schahram Dustdar: Statelets: Coordination of Social Collaboration Processes. COORDINATION 2012 Provisioning/Negotiation/Execution API ICU ICU SCU ICU SCU 42 Abstraction of Human Compute UnitsSummerSOC 12, 3 Jul 2012
  43. 43. Conclusions and Future Work Novel models and APIs are needed for integrating humans into program paradigms We need to address the whole stack  Elasticity modeling, monitoring and reasoning  Mapping high level languages to APIs of hybrid services Future works  Several issues mentioned here are ongoing work  Declarative languages for specifying elasticity  Methods for evaluation and experiments Some open questions will be addressed in FP7 CELAR SummerSOC 12, 3 Jul 2012 43
  44. 44. Thanks for your attention Hong-Linh Truong Distributed Systems Group Vienna University of Technology truong@infosys.tuwien.ac.at http://www.infosys.tuwien.ac.at/staff/truongSummerSOC 12, 3 Jul 2012 44

×