OW2 Open Source
                  Cloudware Initiative
                 Initiative Bedrock: Elasticity for
                       Green Java EE PaaS*


                    System@tic GTLL Open Source Cloud Conf.
                    Paris, 20 Mai 2010


* This research is supported by the French Agence Nationale de la Recherche with the ANR-08-SEGI-017 (SelfXL)
OW2 in top-4 global open source
organizations with diversified code
Diversified-code organizations



Product line organizations



Technology-oriented communities



Legal ressources organizations



Standards organizations



Advocacy and lobbying organizations


© O W2 Consortium 2010                www.ow2.org   2
Cloud computing is a long-term
   business opportunity

                                       Worldwide IT Cloud Revenue
                                                                                            A disruptive innovation driven by
                                            by Product/Service Type
                                                                                             two key industry trends
                      50,0   Servers
                             Storage
                      40,0
                             Infrastructure SW                                                     Commoditized enterprise IT:
    billion dollars




                      30,0   App Dev/Deploy
                             Applications                                                           hardware, software and
                      20,0
                                                                                                    networks and standardized
                      10,0                                                                          enterprise usage
                       0,0
                               2009           2010       2011         2012   2013
                                            Source IDC, September 2009                             New Internet-based IT usage:
                       Five-year annual growth rate of 26
                                                                                                    new economic models to
                       percent--over six times the rate of                                          absorb fluctuating or peak
                             traditional IT offerings.                                              demands




Source: http://news.cnet.com/business-tech/?keyword=IDC
   © O W2 Consortium 2010                                                           www.ow2.org                                  3
Open source software is critical
for cloud computing openness
 While openness seems still a              OSS Cloud momentum
  distant reality...                           Virtualization technologies:
    Different meanings                             Xen, KV, OpenVZ, VirtualBox, etc.
    Proprietary core business                     Infrastructure management:
                                                    OpenNebula, Eucalyptus, Libcloud,
    Few consensus on standards                     etc.
                                                   Platform environment:
 ...Open Source Software is now                    Heroku, etc.
  critical for Cloud Computing ...
     General consensus on                  OSS a unique proposition for
       reduction of costs and barriers
       to adoption                             Interoperability
     Open APIs for pragmatic                  Sovereignty
       reasons                                 Transparency / Privacy /
     OSS and open standards                    Security

 … but Cloud Computing is also a                  De facto open standards
  risk for OSS
                                                   Sustainable ecosystems
    Openness not dependant on
      software exclusively
© O W2 Consortium 2010              www.ow2.org                                         4
An industry empowerment
    strategy
                                                         Furthermore, most consortia
                                                          managing open source
                                                          development and marketing are
                                                          based in the United States and
                                                          funded by US IT companies.                   The OW2
                                                         If the cloud computing research aims         opportunity...
                                                          at realizing a sustainable European
                                                          economic opportunity as envisioned
                                                          in 2010, this imbalance needs to be
                                                          addressed.
                                                                           (...)
                                                         The EC should promote the
                                                          European leadership position in
                                                          software through commercially
                                                          relevant open source approaches.             OW2 to foster
                                                         Maintaining an open source                   Cloud projects
                                                          approach for research results and            to be funded
                                                          cloud infrastructure support tools           within EU "Future
                                                          ensures uptake and simplifies                of Internet"
                                                                                                       programmes and
                                                          adaptation to different environments.        PPP mechanisms
                                                          The European open source
                                                          movement should thereby work
                                                          strongly together with industry to
                                                          support commercial cloud based
                                                          service provisioning.
Source, European Commission, Information Society and Media,
The Future Of Cloud Computing: Opportunities for European Cloud Computing Beyond 2010, page 42 and 4
     © O W2 Consortium 2010                                       www.ow2.org                                           5
Starting with a real-life business
case: Orange

Context:
       Large-scale datacenters (+40,000 x86 servers)
       JavaEE JOnAS middleware stack: +250 applications,
        +1,000 application server instances
       Static server consolidation (12/1) through virtualization:
         • Utilization level increased from 20% to 75%
Next step: migration to a Cloud model
       On-demand JavaEE server provisioning according to
        demand fluctuations
       Automation of the management of virtualized JavaEE
        clusters: deployment, update, auto-scaling etc.
       Open (source) cloud management stacks alternatives
        to proprietary solutions (IaaS/PaaS)

© O W2 Consortium 2010         www.ow2.org                       6
The need addressed by the Initiative bedrock:
Self-sizing for Java EE PaaS

Goal : improve the platform efficiency
       Performance
       Energy cost

Challenges
       Cluster growth/shrink capabilities according to
        workload
       Datacenter multi-tenancy with limited capacities
        requires arbitration policies
       Datacenter placement for minimizing the energy
        consumption


© O W2 Consortium 2010      www.ow2.org                    7
OW2 Initiative bedrock technologies
 JOnAS (http://www.ow2.org/xwiki/bin/view/ActivitiesDashboard/JOnAS)
    Enterprise OSGi & Java EE 5 certified server
 JASMINe (http://jasmine.ow2.org)
    Management tools for SOA platform
    Monitoring module (probe, mediation, graphs)
    Decision module (rules engine based)
    Virtual Machine Management (Xen, VMware, ...)
 CLIF (http://clif.ow2.org)
    Load testing
    Selfbenchmarking
 ProActive (http://www.ow2.org/xwiki/bin/view/ActivitiesDashboard/ProActive)
    Scheduling
    Resource management
    Parallel library
 Entropy (in progress)
    Dynamic VM placement
 © O W2 Consortium 2010                    www.ow2.org                          8
Architecture for self-sizing
                                        Scale up/down



PaaS
IaaS                                    VM provisioning




                                        VM placement




 © O W2 Consortium 2010   www.ow2.org                 9
ProActive

"Infinite" ressources management
        Provisionning of new ressources in case of capacity
         overflow

Java EE PaaS as a virtual ressource
        Java applications deployment
         and services execution (EJBs, WS, OSGi, …)

Java EE PaaS performance optimization
        EJB3.1 and asynchronous methods support
        Proactive Parallel library deployed as an OSGI service



© O W2 Consortium 2010               www.ow2.org               10
ProActive




© O W2 Consortium 2010               www.ow2.org   11
25% Energy Savings

                          Before                 After

Server 1                       Task 1



Server 2                       Task 2




Server 3                       Task 3



Server 4                       Task 4


 © O W2 Consortium 2010            www.ow2.org           12
OW2 OSCi: developing the OW2
open source cloudware stack

                                OW2 projects



                         3rd party projects




                          Collaborative projects            OW2 Cloud Stack




                                                            Initiative bedrock




© O W2 Consortium 2010                        www.ow2.org
A business ecosystem at work


VISION & GOALS                   OW2 projects                       STAKEHOLDERS
OW2 Technology                                                      •Software Vendors
Vision                    3rd party projects
                                                                    •Systems Integrators
JetStream
discussion                                                          •Academia
From Middleware                                                     •Enterprises
                           Collaborative projects
to Cloudware                                                        •Telcos
Open Cloud                                                          •SMEs
Computing                                                           •Public Entities
Open Source
Empowerment


                                               Initiative bedrock




 © O W2 Consortium 2010                        www.ow2.org
OW2 OSC Initiative: Outlook

 Priorities                               International contributions
                                              University of Fortaleza
1. Build awareness for the OW2                     • Cloud APIs in JASMINe (EC2,
Cloudware Stack and attractiveness                   OpenNebula, Eucalyptus, …)
for new components, both OW2 and
non-OW2 .                                      Beijing University of
                                                Aeronautics & Astronautics
2. Foster evolution of OW2 projects so         Peking University
as to make open source cloud
computing the backbone of the OW2     Collaborative projects
code base.
                                         COMPATIBLE ONE
                                          (System@tic)
3. Position OW2 as a key player:
- help define open cloud computing       4Caast (FP7)
- partner with existing stakeholders     CHOReOS (FP7)
- contribute to advocacy campaigns
- participate in collaborative projects


© O W2 Consortium 2010               www.ow2.org                              15
OW2 OSC Initiative: Join Us!


         May 2010: Initiative launch and participant recruitment drive

         Sept 2010: Workshops, seminars

         Dec 2010: Technology roadmap

         Mid 2011: First OSC implementations

         Dec 2011: OW2 OSC Summit




© O W2 Consortium 2010              www.ow2.org                           16
www.ow2.org
                                         For more information
                                            Please contact
                                        Cedric Thomas (CEO)
                                       cedric thomas @ ow2 org




© O W2 Consortium 2010   www.ow2.org                             17

OW2 - OSCi (Open Source Cloudware Initiative)

  • 1.
    OW2 Open Source Cloudware Initiative Initiative Bedrock: Elasticity for Green Java EE PaaS* System@tic GTLL Open Source Cloud Conf. Paris, 20 Mai 2010 * This research is supported by the French Agence Nationale de la Recherche with the ANR-08-SEGI-017 (SelfXL)
  • 2.
    OW2 in top-4global open source organizations with diversified code Diversified-code organizations Product line organizations Technology-oriented communities Legal ressources organizations Standards organizations Advocacy and lobbying organizations © O W2 Consortium 2010 www.ow2.org 2
  • 3.
    Cloud computing isa long-term business opportunity Worldwide IT Cloud Revenue  A disruptive innovation driven by by Product/Service Type two key industry trends 50,0 Servers Storage 40,0 Infrastructure SW  Commoditized enterprise IT: billion dollars 30,0 App Dev/Deploy Applications hardware, software and 20,0 networks and standardized 10,0 enterprise usage 0,0 2009 2010 2011 2012 2013 Source IDC, September 2009  New Internet-based IT usage: Five-year annual growth rate of 26 new economic models to percent--over six times the rate of absorb fluctuating or peak traditional IT offerings. demands Source: http://news.cnet.com/business-tech/?keyword=IDC © O W2 Consortium 2010 www.ow2.org 3
  • 4.
    Open source softwareis critical for cloud computing openness  While openness seems still a  OSS Cloud momentum distant reality...  Virtualization technologies:  Different meanings Xen, KV, OpenVZ, VirtualBox, etc.  Proprietary core business  Infrastructure management: OpenNebula, Eucalyptus, Libcloud,  Few consensus on standards etc.  Platform environment:  ...Open Source Software is now Heroku, etc. critical for Cloud Computing ...  General consensus on  OSS a unique proposition for reduction of costs and barriers to adoption  Interoperability  Open APIs for pragmatic  Sovereignty reasons  Transparency / Privacy /  OSS and open standards Security  … but Cloud Computing is also a  De facto open standards risk for OSS  Sustainable ecosystems  Openness not dependant on software exclusively © O W2 Consortium 2010 www.ow2.org 4
  • 5.
    An industry empowerment strategy  Furthermore, most consortia managing open source development and marketing are based in the United States and funded by US IT companies. The OW2  If the cloud computing research aims opportunity... at realizing a sustainable European economic opportunity as envisioned in 2010, this imbalance needs to be addressed. (...)  The EC should promote the European leadership position in software through commercially relevant open source approaches. OW2 to foster  Maintaining an open source Cloud projects approach for research results and to be funded cloud infrastructure support tools within EU "Future ensures uptake and simplifies of Internet" programmes and adaptation to different environments. PPP mechanisms The European open source movement should thereby work strongly together with industry to support commercial cloud based service provisioning. Source, European Commission, Information Society and Media, The Future Of Cloud Computing: Opportunities for European Cloud Computing Beyond 2010, page 42 and 4 © O W2 Consortium 2010 www.ow2.org 5
  • 6.
    Starting with areal-life business case: Orange Context:  Large-scale datacenters (+40,000 x86 servers)  JavaEE JOnAS middleware stack: +250 applications, +1,000 application server instances  Static server consolidation (12/1) through virtualization: • Utilization level increased from 20% to 75% Next step: migration to a Cloud model  On-demand JavaEE server provisioning according to demand fluctuations  Automation of the management of virtualized JavaEE clusters: deployment, update, auto-scaling etc.  Open (source) cloud management stacks alternatives to proprietary solutions (IaaS/PaaS) © O W2 Consortium 2010 www.ow2.org 6
  • 7.
    The need addressedby the Initiative bedrock: Self-sizing for Java EE PaaS Goal : improve the platform efficiency  Performance  Energy cost Challenges  Cluster growth/shrink capabilities according to workload  Datacenter multi-tenancy with limited capacities requires arbitration policies  Datacenter placement for minimizing the energy consumption © O W2 Consortium 2010 www.ow2.org 7
  • 8.
    OW2 Initiative bedrocktechnologies  JOnAS (http://www.ow2.org/xwiki/bin/view/ActivitiesDashboard/JOnAS)  Enterprise OSGi & Java EE 5 certified server  JASMINe (http://jasmine.ow2.org)  Management tools for SOA platform  Monitoring module (probe, mediation, graphs)  Decision module (rules engine based)  Virtual Machine Management (Xen, VMware, ...)  CLIF (http://clif.ow2.org)  Load testing  Selfbenchmarking  ProActive (http://www.ow2.org/xwiki/bin/view/ActivitiesDashboard/ProActive)  Scheduling  Resource management  Parallel library  Entropy (in progress)  Dynamic VM placement © O W2 Consortium 2010 www.ow2.org 8
  • 9.
    Architecture for self-sizing Scale up/down PaaS IaaS VM provisioning VM placement © O W2 Consortium 2010 www.ow2.org 9
  • 10.
    ProActive "Infinite" ressources management  Provisionning of new ressources in case of capacity overflow Java EE PaaS as a virtual ressource  Java applications deployment and services execution (EJBs, WS, OSGi, …) Java EE PaaS performance optimization  EJB3.1 and asynchronous methods support  Proactive Parallel library deployed as an OSGI service © O W2 Consortium 2010 www.ow2.org 10
  • 11.
    ProActive © O W2Consortium 2010 www.ow2.org 11
  • 12.
    25% Energy Savings Before After Server 1 Task 1 Server 2 Task 2 Server 3 Task 3 Server 4 Task 4 © O W2 Consortium 2010 www.ow2.org 12
  • 13.
    OW2 OSCi: developingthe OW2 open source cloudware stack OW2 projects 3rd party projects Collaborative projects OW2 Cloud Stack Initiative bedrock © O W2 Consortium 2010 www.ow2.org
  • 14.
    A business ecosystemat work VISION & GOALS OW2 projects STAKEHOLDERS OW2 Technology •Software Vendors Vision 3rd party projects •Systems Integrators JetStream discussion •Academia From Middleware •Enterprises Collaborative projects to Cloudware •Telcos Open Cloud •SMEs Computing •Public Entities Open Source Empowerment Initiative bedrock © O W2 Consortium 2010 www.ow2.org
  • 15.
    OW2 OSC Initiative:Outlook  Priorities  International contributions  University of Fortaleza 1. Build awareness for the OW2 • Cloud APIs in JASMINe (EC2, Cloudware Stack and attractiveness OpenNebula, Eucalyptus, …) for new components, both OW2 and non-OW2 .  Beijing University of Aeronautics & Astronautics 2. Foster evolution of OW2 projects so  Peking University as to make open source cloud computing the backbone of the OW2  Collaborative projects code base.  COMPATIBLE ONE (System@tic) 3. Position OW2 as a key player: - help define open cloud computing  4Caast (FP7) - partner with existing stakeholders  CHOReOS (FP7) - contribute to advocacy campaigns - participate in collaborative projects © O W2 Consortium 2010 www.ow2.org 15
  • 16.
    OW2 OSC Initiative:Join Us!  May 2010: Initiative launch and participant recruitment drive  Sept 2010: Workshops, seminars  Dec 2010: Technology roadmap  Mid 2011: First OSC implementations  Dec 2011: OW2 OSC Summit © O W2 Consortium 2010 www.ow2.org 16
  • 17.
    www.ow2.org For more information Please contact Cedric Thomas (CEO) cedric thomas @ ow2 org © O W2 Consortium 2010 www.ow2.org 17