The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing               ...
2
AcknowledgementsVoldria aprofitar aquestes línies per donar els meus sincers agraïments a totes les persones que mhanajuda...
Table of Contents1     Abstract .............................................................................................
4.5.3        API OCCI in EMOTIVE.............................................................................................
1      AbstractIn recent years, projects and researches about Cloud and Green Computing are growing. A newComputational ge...
2      Introduction2.1 MotivationThe use of Cloud Computing and Virtualization is increasing. It is evident with the large...
complex management in Cloud providers. For instance, offering resources in the Cloud is no longerabout offering raw virtua...
aspect is that we can use hybrid computer architectures between Xeon and Atom servers together.(Goal #5). Having achieved ...
3      Background and Related WorkFirst of all it is necessary to understand the basic ideas of Virtualization and Cloud C...
virtual-machines.- Hardware and Software flexibility (CPU, memory, disk, net, OS, etc)- Agility: Instant server- Portabili...
There are alternatives how VMWare ESX, Parallels and KVM.      Paravirtualization is similar it to full virtualization. I...
3.1.2 Libvirt: The virtualization APIIntroductionLibvirt (7) is a generic virtualization API to interact with the virtuali...
3.2 Cloud ComputingCloud Computing is composed by three layers: IaaS (Infrastructure as a Service), PaaS (Platform as aSer...
Service providers feel the urgent need to make the transition from their network architectures,computer, software, etc and...
OpenNebula manages storage, network andvirtualization technologies to enable the dynamicplacement on distributed infrastru...
Eucalyptus Architecture: Web Service CloudEucalyptus Components:      Cloud Controller (CLC) - The CLC is       responsib...
3.4 Interoperability in the CloudThis chapter talks about the state of the art to create an open standard for Cloud Comput...
Since RedHat recently submitted the library to Apache it might gain popularity.Another interesting thing is that OpenNebul...
search and CRUD operations (Create, Retrieve, Update and Delete resources) using existing standardsincluding HTTP (Plain T...
POOL RESOURCE      References a URI for the ER.           Example:                <COMPUTES>                    <COMPUTE ...
and large.      STATE, the state of the COMPUTE. T      DISKS, the block devices attached to the virtual machine (DISK, ...
interoperability and standardization. This releasing is good for telecommunications companies ingeneral, as it proves that...
Other aspects to considerate that it is important to understand the impact of Virtualization on DataCenter Physical Infras...
In conclusion, it is necessary to analyze the CapEx/OpEx balance and the consumption depending oneach own case. As we have...
4      Contribution4.1 EMOTIVE ORIGINALEMOTIVE (Elastic Management of Tasks in Virtualized Environments) (25) is the Barce...
The Virtualization Fabrics layer comprises the physical resources where the VM will run. This layerwraps the virtualized r...
checkpoint upon hardware failure, etc.). As a rule of thumb, the Scheduler tries to consolidate the VMsin the provider‟s p...
 New EMOTIVE functionalities                VLAN Network management                Easy management and creation of Virt...
With the new RESTful architecture we need to adapt every EMOTIVE module [Figure 13]: the GUImodule, Scheduler modules and ...
Now we describe how API Libvirt is integrated in the EMOTIVE Cloud platform. The starting point isthe actual Xen monitorin...
VirtMonitor.java (API Libvirt)                                            XenMonitor.java (API Xen)Compute Method Summary ...
int   setCPUCapacity(String name, int nvcpus)                          int   setCPUCapacity(int id, int capacity)         ...
1 - Necessary information to create Network.java (Java object) it is a EMOTIVE class    name, id, uuid, ip address, gatewa...
and ($vpn …) for VPN management. localhost:~$ help Help    server:             change server to connect    create:        ...
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing
Upcoming SlideShare
Loading in...5
×

The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing

4,317

Published on

Alexandre Vaqué Brull.

Master in Computer Architecture, Network and Systems.

Universitat Politècnica de Catalunya.

Advisors: Jordi Torres and Jordi Guitart.

September 2011

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
4,317
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
34
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing

  1. 1. The Green Evolution of EMOTIVE Cloud EMOTIVE Cloud: The BSC’s IaaS open-source solution for Cloud Computing Alexandre Vaqué Brull Master in Computer Architecture, Network and Systems Department of Computer Architecture Universitat Politècnica de Catalunya Advisors: Jordi Torres and Jordi Guitart September 2011
  2. 2. 2
  3. 3. AcknowledgementsVoldria aprofitar aquestes línies per donar els meus sincers agraïments a totes les persones que mhanajudat a realitzar aquest projecte:Voldria mostrar la meva plena gratitud als Drs. Jordi Torres i Jordi Guitart per la confiança dipositadaen mi, per brindar-me loportunitat de formar part daquest magnífic equip i per la seva constant i granajuda. D‟ells he aprés molt tant en l‟àmbit professional, com també personal.Volia agrair també al Dr. Iñigo Goiri la seva constant ajuda i la seva paciència. I pels seus coneixe-ments compartits.He après molt de tots tres i han sigut un pilars bàsics per l‟elaboració d‟aquesta màster tesis. Sensel‟ajuda d‟aquestes persones no ho hagués pogut aconseguir. Sempre els tindré molt present per tot loque han fet per mi.També volia agrair el suport de la meva parella Sara Serra en aquest projecte i a la meva família laconstant ajuda que m‟han ofert sempre. Moltes gràcies a tots els companys de feina, professors (endestacat el Dr. David Carrera), amics i familiars que mhan recolzat i shan preocupat en tot moment,que encara que no els mencioni de forma explícita, no els hi puc negar el meu sincer agraïment. 3
  4. 4. Table of Contents1 Abstract ............................................................................................................................................. 12 Introduction ....................................................................................................................................... 2 2.1 Motivation .................................................................................................................................. 2 2.2 Goals ........................................................................................................................................... 3 2.3 Document Structure .................................................................................................................... 43 Background and Related Work ......................................................................................................... 5 3.1 Virtualization .............................................................................................................................. 5 3.1.1 Virtualization technologies ................................................................................................. 7 3.1.2 Libvirt: The virtualization API ............................................................................................ 8 3.2 Cloud Computing ....................................................................................................................... 9 3.2.1 Virtualization Unlocks Cloud Computing........................................................................... 9 3.3 Cloud Middleware .................................................................................................................... 10 3.3.1 OpenNebula ...................................................................................................................... 10 3.3.2 Eucalyptus ..........................................................................................................................11 3.3.3 Open Stack ........................................................................................................................ 12 3.4 Interoperability in the Cloud .................................................................................................... 13 3.4.1 API OCCI.......................................................................................................................... 14 3.4.2 TCloud .............................................................................................................................. 17 3.5 Green Computing ..................................................................................................................... 18 3.5.1 The greening of the Cloud ................................................................................................ 194 Contribution .................................................................................................................................... 21 4.1 EMOTIVE ORIGINAL ............................................................................................................ 21 4.2 The Evolution of EMOTIVE .................................................................................................... 23 4.2.1 Introduction ....................................................................................................................... 23 4.2.2 New Modular Architecture................................................................................................ 24 4.2.3 Green IT evolution ............................................................................................................ 25 4.3 Extended Virtualization support in EMOTIVE ........................................................................ 25 4.4 EMOTIVE Networks ............................................................................................................... 28 4.4.1 VLAN................................................................................................................................ 28 4.4.2 VPN ................................................................................................................................... 31 4.4.3 Networks by Software are Green ...................................................................................... 32 4.5 EMOTIVE Interoperability ...................................................................................................... 34 4.5.1 API OCCI and Web Services ............................................................................................ 34 4.5.2 REST vs. SOAP ................................................................................................................ 35 4
  5. 5. 4.5.3 API OCCI in EMOTIVE................................................................................................... 35 4.6 EMOTIVE for Green Computing............................................................................................. 39 4.6.1 Green Hypervisor Comparison ......................................................................................... 39 4.6.2 Architecture comparison (Atom-Xeon-Hybrid)................................................................ 42 4.6.3 Middleware scheduling comparison (OpenNebula and EMOTIVE) ................................ 46 4.6.4 Middlewares qualitative comparison ................................................................................ 505 Conclusions ..................................................................................................................................... 52 5.1 Summary .................................................................................................................................. 52 5.2 Publications .............................................................................................................................. 52 5.3 Suggestions for future work ..................................................................................................... 526 References ....................................................................................................................................... 55 5
  6. 6. 1 AbstractIn recent years, projects and researches about Cloud and Green Computing are growing. A newComputational generation is emerging where ecological concerns have strengthened. Technologicalgrowth leads to increased energy consumption, and thus this new Computational Generation is emittingmuch CO2 in the atmosphere.Cloud Computing has achieved to move centralized physical resources to shared virtual resources,reducing costs and maintenance while increasing efficiency. Virtualization plays an important role inCloud Computing (especially IaaS) because it allows to create environments "on demand" within theextensive Cloud platforms. This way, we can accommodate more than one virtual machine in the samehost, avoiding the expense traditional physical machine for only one service.In this sense, we can say that virtualization environments together with Cloud Computing platformsprovide the IT market of extraordinary flexibility, a wide range of possible configurations and virtuallyunlimited resources.In the BarcelonaTech (UPC) and BSC (Barcelona Supercomputing Center), we have a Cloud Platformbased on virtualizated environments that is called EMOTIVE Cloud (Elastic Management of Tasks inVirtualized Environments). So EMOTIVE middleware provides virtualized environments to the usersand allows executing tasks.This project main aim is to expand and evolve the capabilities of EMOTIVE platform to improvecertain limitations. This includes enabling easy interoperability with other Cloud providers thanks to anew architecture and adding new functionalities such as new hypervisors and networks management. Inaddition, we perform new studies to evaluate these new features and extend the research andinvestigations related to EMOTIVE and Cloud Computing.In addition, we will also provide a qualitative comparison of EMOTIVE running over differenthypervisors (e.g. XEN, KVM and Virtual Box), with respect to other IaaS open-source solutions (e.g.OpenNebula) and different kinds of computer architectures (XEON, ATOM and Hybrids solutions).This will help users to find the best solution according to their needs: performance, green, agility,usability, etc.Keywords: Virtualization, Service provider, Cloud, Resource management, Green-computing,Scheduling, consolidation, EMOTIVE Cloud, IaaS, Virtualization, Open source. 1
  7. 7. 2 Introduction2.1 MotivationThe use of Cloud Computing and Virtualization is increasing. It is evident with the large current offerof Cloud Computing services. If we focus on Cloud infrastructure providers we can find a wide varietyof services and products. Cloud will be attractive to companies, whether small or large, because Cloudcomputing will replace many internal IT traditional services, for example many internal IT resourceswill be externalized in the Cloud. But keep in mind that the IT and Cloud Computing sector isconstantly growing, thus increasing energy consumption. It is an important problem that affects CO2world emissions. According to Greenpeace information, the datacenters that store Cloud Computingservices will triplicate their emissions to the atmosphere in 2020. There is currently some research totry to improve the consumption/performance ratio, especially for datacenters and supercomputers.BSC and UPC are researching about Cloud and Green Computing. The middleware EMOTIVE Cloud(Elastic Management Of Tasks In Virtualized Environments) is being used by BSC to do research inCloud Computing (thanks to its Infrastructure as a Service (IaaS) capabilities), as well as in some re-search projects such as BREIN (1), OPTIMIS (2), VENUS-C (3), NUBA (4) and others. EMOTIVEenables the smart management of virtual environments using different scheduling policies. Additional-ly, it is very easy to extend thanks to its modular Web Service architecture evolved in this project. Inthis master thesis, we research to improve this middleware and its green features.Similarly to EMOTIVE, there are many other Cloud providers like Amazon EC2 Cloud (5) and Cloudmiddleware such as OpenNebula (6). These new technologies allow the creation of virtual machines ofdemand, and they even allow outsourcing virtual machines from external Clouds and migrating thesemachines between Clouds. These are powerful features that can help to improve service availability andenhance resource management and power consumption. However, currently the problem is that there isno preset standards to use these new features homogenously between providers. In general, mostproviders only offer their own proprietary interface or support only a given virtualization technology(which conditionates what kind of virtual machine images they can use).For this reason, new research is emerging to define possible standards, which allow providers to offer acommon interface and thus to interoperate among them and above all to create big Cloud communities.Additionally, Cloud middleware are evolving to support different virtualization technologies, or at leastdifferent image formats, to enable real interoperability.As commented, providers must be also conscious of their energy impact, and try to reduce their energyusage. For this reason, they are currently incorporating more complex management policies that allowthem to use the energy in an efficient way, or to consider the ecological impact when taking decisions.In this sense, building providers based on heterogeneous architectures, with different energyconsumption profiles, is a powerful tool for these policies to really achieve their energy-related goals.This is one of the reasons that justify why an efficient management of Cloud providers is mandatorytoday. There is an important tradeoff to be solved between the performance of the applications runningin the provider and its power consumption. The goal is to fulfill the performance requirements of theapplications while minimizing power consumption. Apart from this, there are other aspects that require 2
  8. 8. complex management in Cloud providers. For instance, offering resources in the Cloud is no longerabout offering raw virtual machines. Clients require virtual machines to come prepared to be used todeploy distributed services without painful configuration steps. In this sense, support for the creationand management of virtual networks among virtual machines is a must.2.2 GoalsIn this section, we describe this thesis‟ goals, which aim to resolve some limitations presented in themotivation section.The main goal of the project is to extend the capabilities of the EMOTIVE Cloud platform and partly toexpand our research focused to be greener. Wherefore the new features added in EMOTIVE will try tofind a green feature.The main project goals are:1. To add new features to expand EMOTIVE with new functionalities, easy management, and a green approach. We will add new hypervisors and virtual networks management.2. To redesign the architecture and interfaces of EMOTIVE Cloud. We will go from Web Services SOAP to RESTful.3. Add a new OCCI interface to have interoperability with other Cloud providers and middlewares.4. Be able to use hybrid computer architectures to exploit Green factor in EMOTIVE.5. To study, compare and evaluate EMOTIVE: - Running with different computer architectures (XEON, ATOM and Hybrid solutions). - Running with different hypervisors (KVM, XEN and Virtual Box). - With other Middlewares such as OpenNebula, Eucalyptus and also OpenStack.Next we will proceed to detail the goals commented:(Goal #1) The most important new feature added in EMOTIVE is the API Xen substitution to addLibvirt API. Initially, EMOTIVE could only use Xen hypervisor with XEN API. Libvirt API allows toexpand the number of hypervisor inside EMOTIVE. So now we can use Xen, KVM, and VirtualBoxhypervisors. In addition, Libvirt can be used to manage virtual networks within virtual machines. Inthis way, we add also network management in EMOTIVE Cloud. And also we developed VPNscreation. To sum up we will be able to create, destroy, list and edit VLANs and VPN (point to point andmultipoint to point).(Goal #2) Another important new feature is the EMOTIVE architecture restructuration by adaptingWeb Services SOAP to Web Services RESTful.(Goal #3) Having the new REST architecture, we adapt the RESTful methods to have compatibilitywith API OCCI, which makes possible to have Interoperability between Clouds. With this new featurealso we have to keep in mind the EMOTIVE compatibility with Amazon EC2. So now EMOTIVEallows the interoperability thanks to API OCCI and Amazon EC2 interfaces.(Goal #4) After adding these features, we have developed the EMOTIVE middleware in order to havemore green aspects. So we tried to improve and adapt EMOTIVE in this sense. An interesting green 3
  9. 9. aspect is that we can use hybrid computer architectures between Xeon and Atom servers together.(Goal #5). Having achieved these goals, to test new features we made some comparisons betweenEMOTIVE and different computer architectures, hypervisors and middlewares. These comparisonsallow to see the new EMOTIVE power, explore the new possibilities, and study the green approach.We expect the research in this project to be useful for future research and to be used in other researchprojects. For example, with these new functionalities we can adapt EMOTIVE to the requirements ofNUBA national research project, or the VENUS-C European project.2.3 Document StructureThis document is organized as follows. Chapter 2 explains the goals and main motivations of thismaster thesis. Chapter 3 presents some background and related work about basic concepts, includingalso the state of the art.Chapter 4 is the most important because describes the actual work completed as part of this MasterThesis. On the one hand, introduces the technical aspects of EMOTIVE, describes and analyzes theimplementation, describe its new architecture, how it is implemented and the new features added in themiddleware. The subchapter 4.6 explains the evaluation results, describing how EMOTIVE has beentested and comparing and summarizing the results.Finally, Chapter 5 presents the conclusions and proposes possible future work related to this project. 4
  10. 10. 3 Background and Related WorkFirst of all it is necessary to understand the basic ideas of Virtualization and Cloud Computing tounderstand this master thesis. In this chapter, we present Virtualization concepts and technologies,Cloud Computing Infrastructure ideas, Middleware products similar to EMOTIVE, Interoperability todo federation and hybrid Clouds and Green Computing state of the art.These topics are very important and useful to know better the puzzle of the Cloud Computing. It isimportant to know that Cloud Computing without Virtualization cannot offer any of the new kind ofservices that offers nowadays.We will talk about the middleware layer and the infrastructure-as-a-service (IaaS) system. CloudProviders use Middlewares to offer their Services. Service Providers in the Cloud offer complexservices ready to be used. And the customers would pay depending on the volume of consumedservices, as we do with electricity or water.This middleware is a set of resources. These resources can form Private Clouds, Public Clouds andHybrid Clouds. These days, one of the challenges we face is to manage better the wide range ofClouds. In this sense, nowadays the number of companies that need more than one cloud is increasing.Moreover, they can migrate VM from one Cloud to another and exploit new advantages. Thisrepresents a challenge and we will show a new approach for future researchNew technologies go mainly in this direction. The most well-known and useful to help to organize theinfrastructure of Cloud Computing and Virtualization are: VMWare, Xen, KVM, OpenNebula,Eucalyptus, Libvirt and others. In the next chapters we will talk about them. They are all goodtechnologies to virtualize environments, manage, create some abstraction layer, etc.With this new technology and its new possibilities, we can both contribute to improve the greencomputing and we can achieve other new challenges as Manageability and Self -*, Federation &Interoperability, Virtualization, Elasticity and Adaptability.3.1 VirtualizationA virtual machine is an implementation of a machine (i.e. a computer) that executes programs like aphysical machine. The main idea of Virtualization is simulate machines into machines.There are a lot of advantages to virtualize. A person who has not experienced the benefits ofvirtualization often asks what the big deal is. The often repeated argument about consolidation isflawed: after all, instead of running 10 VMs, each serving a single application, you can have one multi-purpose server. To have to maintain a single system means less work. True? Not quite. There arereasons for separating applications in either physical or virtual computers. The first option is clearly tooexpensive in so many ways (not only initial costs, but also power, cooling, space, maintenance) andVMs even have some advantages over real computers.Listed below there are a number of advantages:- Isolation: Virtual machines are independent- Security: Each machine has privileged independent access and is very easy to backup and restore 5
  11. 11. virtual-machines.- Hardware and Software flexibility (CPU, memory, disk, net, OS, etc)- Agility: Instant server- Portability: (file) easy to clone or to be transported to another server- Services Consolidation, CPD cost savings, high availability and other similar features.- Lab environments. For example, in order to test new software.- Cloud Computing environments. They help to deal with increased load.Hypervisor is a supervising master program that manages Virtual Machines. A computing layer whichallows multiple operating systems to run on a host computer at the same time. The role of theHypervisor is to support Guest Operating Systems on a single machine. It was originally developed inthe 1970s as part of the IBM S/360.Many modern variants have been done by different developers. Figure 1- Hypervisor architectureVirtualization types:Computer systems introduce a division into levels of abstraction separated by well defined interfaces.There are several ways to achieve Virtualization with different levels of abstraction obtaining differentadvantages and disadvantages.Virtualization introduces an abstraction layer to show to higher layers a different overlayed system.Virtualization can be classified by abstracts system layer interface. These types are HardwareEmulation, Full virtualization, and Paravirtualization. Hardware Emulation simulates a complete hardwareallowing an unmodified OS to be run. Every instruction issimulated on the underlying hardware. It is a problem becausethis means that high performance is lost. It is emulator; this kindof VM can even run multiple virtual machines. It is slower thanfull virtualization and paravirtualization. Figure 2 - Hardware EmulationMany techniques are used to implement emulation. Some examples of emulation are Virtual Box,Bochs and QEMU. Full virtualization uses a virtual machine that mediatesbetween guest operating system and the native hardware. It isslower than native hardware because there is another layer, thehypervisor. The hypervisor do the mediations between hardwareand OS. Figure 3 - Full virtualizationOne of the biggest advantages of full virtualization is that guest OS can run unmodified. Certainmachine instructions must be trapped and handled within the hypervisor because the underlyinghardware is not owned by an operating system but instead, it is shared by it through the hypervisor. 6
  12. 12. There are alternatives how VMWare ESX, Parallels and KVM. Paravirtualization is similar it to full virtualization. Ituses a hypervisor for shared access to the underlying hardwarebut integrates some virtualization parts into the operatingsystem. The guest system needs to be modified for thehypervisor. Figure 4 - ParavirtualizationTo implement this method, hypervisor offers an API to be used by theguest OS. This call is called hypercall. This issue increases the performance with regard tofullvirtualization.A disadvantage is that guest OS needs to be modified. But the advantages is: It can run multipledifferent operating systems concurrently. Xen is an example of paravirtualization.3.1.1 Virtualization technologiesXEN: Xen is a virtual-machine monitor for x86, x86-64, Itanium and PowerPC. It allows several guestoperating systems to execute on the same computer hardware concurrently. Xen is GNU, providesparavirtualization and supports x86 and x64 processors. It allows several guest operating systems toexecute on one physical machine simultaneously. The first guest OS is known as Domain-0 in Xenterminology. Domain-0 automatically boots whenever Xen software boots. Users need to login onDomain-0 to execute other guest OS.KVM: Kernel-based Virtual Machine is a Linux kernel virtualization infrastructure. KVM currentlysupports native virtualization using Intel VT or AMD-V. Limited support for paravirtualization is alsoavailable for Linux guests and Windows in the form of a paravirtual network driver, a balloon driver toaffect operation of the guest virtual memory manager, and CPU optimization for Linux guests.VMWare: is commercial virtualization software that provides full virtualization. VMWare has manyflavors such as VMWare Workstation, VMWare Server and VMWare ESX that provide different levelsof flexibility and functionality. VMWare is highly portable as it is independent of the underlyingphysical hardware, making it possible to create one instance of a guest OS using VMWare and copy itto many physical systems.VirtualBox: a newcomer to the ranks of virtualization market, Sun Microsystems VirtualBox is asoftware package that provides paravirtualization. It was initially developed by a German company,Innotek, but now it is under the control of Sun Microsystems as part of the Sun xVM virtualizationplatforms. It supports Linux, Mac, Solaris, and Windows platforms as the host OS.Amazon EC2: Amazon Elastic Compute Cloud (Amazon EC2) (5) is a web service that providesresizable compute capacity in the Cloud. It is designed to make web-scale computing easier fordevelopers. This technology allows having virtual-machines in the Cloud. So EC2 is more IaaSsolution than Virtualization technology. 7
  13. 13. 3.1.2 Libvirt: The virtualization APIIntroductionLibvirt (7) is a generic virtualization API to interact with the virtualization capabilities that supportsmany different hypervisors Xen, QEMU, KVM, ESX, VirtualBox, etc.) and can be used in User ModeLinux... This has a common layer of abstraction and control for virtual machines. Also it can managevirtual networks and virtual storage. The main components of Libvirt are a control daemon a stable Clanguage API and a shell environment. Libvirt has a long term stable C API and a JAVA API used inEMOTIVE Cloud.There are a number of open-source projects that use Libvirt how: virt-manager, virt-install and virtualmachine control mechanism. It is important to know that Libvirt stores information configuration in anXML (independent to hypervisor).‫‏‬In conclusion Libvirt is a toolkit to interact with the virtualization capabilities of recent versions ofLinux and OSes. It is a free software available under the GNU Lesser General Public License. And nowhas a set of bindings for common languages.Libvirt is a virtualization technology that is used in a lot of Cloud Computing Infrastructure products.This technology helps to unlock virtualization in the Cloud, similar to Amazon EC2 and other Cloudtechnologies.Libvirt API:C and Java API have these main methods:· initialize · destroy · getNodeCPUNum· getDomain · pause / unpause · getNodeCPUSpeed· getDomainID · save · getCPUNum· getDomainNameList · restore · setCPU· create · migrate · updateCacheLibvirt (Virsh)‫‏‬Virsh is a user Mode Linux to easy managementabout Virtual Machines.  List domains: virsh list --all  Boot a domain: virsh create /etc/xen/machine1.xml  Connect to domain console: virsh console machine1  Reboot domain: virsh reboot machine1  Shutdown domain: virsh undefine machine1  Kill domain: virsh shutdown machine1  All virsh options: virsh help Figure 5 - Libvirt 8
  14. 14. 3.2 Cloud ComputingCloud Computing is composed by three layers: IaaS (Infrastructure as a Service), PaaS (Platform as aService) and SaaS (Software as a Service). In this master thesis we focus in the lower layer of CloudComputing so we talk about Infrastructure as a Service (8) (9) (10).Within the Cloud Computing IaaS there are three types: Public, Private, and Hybrid Cloud. PublicCloud is a totally outsourced payment service and it does not depend on the company. A good exampleis Googles services products, Salesforce.com and LotusLive iNotes, which are open to any userthrough a subscription. Other example is pay-as-you-go compute capacity like Amazon EC2 andgoGrid. Private Cloud is the kind of Cloud that is created specifically for a company, maximizingexisting resources and acquiring new ones. This is achieved through virtualization. These clouds areonly for internal use of the company. This is a new model, but with a wide scope and range. Forexample we can find eucalyptus, OpenNebula, IBM Smart Business Storage Cloud. And the HybridCloud is a fusion of the two previous types. There may occasionally need more resources than thoseoffered by the Private Cloud. Thus, when needed they can be extended from private to public, givingthe company an optimal environment for their production processes and projects.Hybrid Clouds will be very used in the next future, because then can improve and profit private existentresources. And if needed, they can extend themselves using Public Cloud resources. To sum up, hybridclouds take advantage of both public cloud and private features and also contribute with new ones.There are a growing number of providers offering IaaS solutions for elastic capacity, whereby serverinstances are executed in their own infrastructure and billed on a utility computing basis (typicallyvirtual machines on a per instance per hour basis). There are also a number of commercial and open-source products which seek to replicate this functionality in-house while exposing compatibleinterfaces so as hybrid cloud operating environments can be created.3.2.1 Virtualization Unlocks Cloud ComputingThe use of Cloud Computing and Virtualization is increasing (11) (12), as is evident with the largecurrent offer of Cloud Computing services. If we focus on Cloud infrastructure providers we findvarious services and content. Furthermore these technologies have the support of big companies.As the possibilities of Cloud Computing and services offered through it are improving and expanded,the companies will be increasingly attracted to this technology for its intrinsic value and simplicity.Cloud computing will eliminate many aspects of IT that traditionally required to have internal ITresources, which will be attractive to companies, whether small or large. To open a business in theCloud it is not necessary to spend initial capital (Capex) and only pay for its use (Opex).In traditional IT researchers found that about 80% of local computing resources of a company areunderutilized (eg, it is possible that at some point we are only running two or three applications in ourcomputer software, and so we lose much of its computational potential), certainly would make sense toincorporate many of these applications to the Cloud. These advantages are encouraging, not onlybecause of the cost reduction in software licensing, but also by reduced IT spending and the obviousadvantages that provides standardization. Moreover, the outsourcing of these functions allowscompanies to focus on their core competencies, leaving the management of their servers, applicationsand manage their data in the hands of companies specializing in this environment can offer acontinuous service. 9
  15. 15. Service providers feel the urgent need to make the transition from their network architectures,computer, software, etc and their service delivery models to better adaptation to this new environment.This is only possible if resources can be dynamically reconfigured to meet new service requests withminimal human intervention.Service providers should also be able to allocate dynamically increase or decrease the capacity ofresources with the least effort possible thanks to its programmability and to respond to unpredictabledemand curves, and nobody can predict which device application or service will be the next big driverof bandwidth in the cloud. Moreover, there are other critical issues, such as latency, security and speedof service, which entails the need for a network that will prioritize and manage traffic reliably.It is becoming increasingly clear that the traditional approach to service delivery cannot long resist theemerging innovations and their related applications. In this new era, service providers need to adopt aperspective and a totally different approach to replace the current access to intelligent services,automated service-oriented. Those who assume that their services should evolve to become a wellcapable of adapting quickly to innovation initiated by virtualization and cloud computing to exploit andtransform new benefits services will succeed. Those who do not will face a number of difficulties."Virtualization Unlocks Cloud Computing" (13) is a phrase that defines, what is virtualization forCloud Computing. So virtualization unlocks Cloud Computing and the power of virtualization is thekey to enable the technology to cloud computing environments. In summary virtualization is a steptoward internal Cloud Computing. It must be clear that Virtualization is not part of Cloud Computing.Virtualization is a technology that enables Cloud Computing.Cloud means "outsourcing of IT technology". It is a model based on elastic infrastructure that can scaleup or down according to demand. Here the virtualization plays an important role.There are at least five things that virtualization opens the door to cloud computing, and push fasterorganizations that address:- Enables economies of scale.- Decouples users from implementation.- Speed, flexibility, agility.- Breaks software pricing and licensing.- Enables, motivates chargeback.So the evolution is first virtualization, later Private Cloud and now it is beginning the Cloud Computingera.3.3 Cloud MiddlewareThis section describes some Cloud Middleware whose functionalities are comparable to EMOTIVE.3.3.1 OpenNebulaOpenNebula is a middleware to easily build any type of Cloud and has been designed to be integratedwith any networking and storage solution. OpenNebula has a big open-source community led by UCM,fully open-source cloud software, and not open core.OpenNebula can transform any data center into a flexible and agile virtual infrastructure whichdynamically adapts to the changing demands of the service workload. 10
  16. 16. OpenNebula manages storage, network andvirtualization technologies to enable the dynamicplacement on distributed infrastructures, combiningboth data center resources and remote cloudresources, according to allocation policies.It is a flexible, extensible and with excellentperformance and scalability to manage a lot of VirtualMachines. Figure 6 shows the architecture ofOpenNebula. Figure 6 – ONE ArchitectureIt can manage private, public or hybrid Cloud solutions. Private Cloud with Xen, KVM and VMware,Public Cloud supporting EC2 Query, OGF OCCI, Sunstone and vCloud APIs,… and Hybrid Cloudwith Amazon EC2, and other providers through Deltacloud.3.3.2 EucalyptusEucalyptus (Elastic Utility Computing Architecture for Linking Your Programs To Useful Systems) isan open-source solution that originates from an NSF funded research project at University ofCalifornia, Santa Barbara, primarily as a tool for cloud-computing research. Eucalyptus Cloud (14) (15)is an infrastructure software that enables enterprises and government agencies to establish their ownprivate cloud environments on clusters.Eucalyptus can make a more efficient use of their computing capacity, thus increasing productivity andinnovation.The main feature about Eucalyptus is the compatibility with Amazon‟s EC2 interface, but theinfrastructure is designed to support multiple client-side interfaces. Eucalyptus is implemented usingcommonly available Linux tools and basic Web-service technologies making it easy to install andmaintain.The feature highlights is: Interface compatibility with EC2 (both Web service and Query interfaces) Manage environments with multiple hypervisors (Xen, KVM, vSphere, ESX, ESXi) under onemanagement console Stand-alone RPMs for non-Rocks RPM based systems Secure internal communication using SOAP with WS-security Overlay functionality requiring no modification to the target Linux environment Basic “Cloud Administrator” tools for system management and user accounting Advanced storage integration (iSCSI, SAN, NAS) enables you to easily connect and manage yourexisting storage systems from within the Eucalyptus cloud The ability to configure multiple clusters, each with private internal network addresses, into a singleCloud. Sophisticated user, group, and role management allows precise control of resources within a privateCloud 11
  17. 17. Eucalyptus Architecture: Web Service CloudEucalyptus Components:  Cloud Controller (CLC) - The CLC is responsible for exposing and managing the underlying virtualized resources (servers machines, network, and storage) via user- facing APIs. The CLC uses an Amazon EC2 API and a Web-based user interface.  Cluster Controller (CC) - The CC controls the execution of virtual machines (VMs) running on the nodes and manages the virtual networking between VMs and between VMs and external users. Figure 7 – Eucalyptus Architecture  Node Controller (NC) - The NC (through the functionality of a hypervisor) controls VM activities, including the execution, inspection, and termination of VM instances.3.3.3 Open StackAt present time, people are talking about a new middleware developed by a large number of importantcompanies. To create an innovative and open-source Cloud Computing software for building reliablecloud infrastructure.This is called OpenStack, is a collaborative software project among several big important players in theCloud Computing space, designed to create freely available code, badly needed standards, and commonground for the benefit of both Cloud providers and Cloud customers. The open source software modelhas been proven to promote the standards and interoperability critical to the success of our industry.The explosive growth of the internet can be attributed to open, universal standards like HTTP andHTML.OpenStack is an initiative for the definition of an open architecture for IaaS Cloud Computing and anopen-source project that is currently three:  Openstack compute: for large-scale deployments of automatically provisioned virtual compute instances.  Openstack object storage: for large-scale, redundant storage of static objects.  Openstack Image Service: provides discovery, registration, and delivery services for virtual disk images.Openstack has alpha version and is immature at the moment in comparation to OpenNebula andEucalypthus. For example, OpenNebula is maturing, proven, and works pretty well. AlthoughOpenStack has a big community with a big number of developers and companies so I have no doubt itwill be a very nice piece of software in the future. But if you want to put it into production today, it istoo hard because it is alpha version and not even close to feature-complete. 12
  18. 18. 3.4 Interoperability in the CloudThis chapter talks about the state of the art to create an open standard for Cloud Computing.Many people in the industry believe it is critically important for the Cloud to be open and shareconcerns about the private nature of the leading Cloud platforms. In fact, there are already a fewprojects focused on the goal of a truly open source Cloud with mass adoption.However the present Cloud offers have followed this trend and are largely private. No one benefitsfrom a fractured landscape of closed and incompatible Clouds where migration is difficult to do andtrue Cloud transparency is impossible.Nowadays the solution to interoperate between Clouds is using Web Services. For example, AmazonEC2 has a web service interface to manage his own virtual-machines, VMware has a vCloud interfaceand other products have their own web services interface. But the problem is that these interfaces areprivate and based on their own Clouds Computing. Eucalyptus Systems considers API AWS (AmazonWeb Services) the default standard for the industry because of its popularity. Eucalyptus Cloud is anopen-source virtualization middleware but it uses an Amazon EC2 interface.On the other hand, OpenNebula propose an open source interface called OCCI very easy to use and toextend. OCCI was originally initiated by UCM (Complutense University of Madrid) and now the OpenCloud Computing interface comprises a set of open community-lead specifications delivered throughthe Open Grid Forum.TID (Telefonica I+D), as well, proposed tCloud. It is based on vCloud API specification 0.8.δ-cloud RedHat‟s project defines a web service API for interacting with Cloud service providers andresources in those Clouds in a unified manner. Libcloud is a pure python client library for interactingwith many of the popular Cloud server providers.Usually the APIs wars have been a crucial strategic plan to control the technology platforms and theirassociated markets. I don‟t know if δ-cloud or OCCI will be an API reference of the next years. But Ihave a clear idea. An open standard API should emerge. Now both have very good fundamentals andare present in many discussion forums.During the development of this project, we chose to use API OCCI. Now we see that the δ-cloud istaking a lot of relevance. So we will keep an eye on the evolution of δ-Cloud and Libcloud.We would like to highlight that our OCCI API is used in the project NUBA, VENUS-C, OPTIMIS andour own project EMOTIVE. We presented our experience to adopt the OCCI API in the 2010 OGF30OCCI conference in Belgium Chapter 5 .The δ-cloud domain is not yet as rich as OCCIs, because it cannot manage storage and network yet.But meanwhile it puts strong emphasis on virtual machine templates (or in δ-cloud terms: hardwareprofiles).Architecturally it follows a slightly different approach. Unlike OCCI which focuses on thecommunication layer, δ-cloud seems to support a 2-layered approach and focuses on the API layer builton top of the communication layer. Meanwhile it is not yet language-agnostic: currently it onlysupports Ruby. The whole thing (the architectural concept) remembers me Libvirt (another RedHat lib). 13
  19. 19. Since RedHat recently submitted the library to Apache it might gain popularity.Another interesting thing is that OpenNebulas δ-cloud driver is built on top of OCCI.In conclusion, OCCI is supported by Open Grid Forum (OGF). There is so much duplicate work goingon in Cloud standards as: Cloud Computing Interoperability Forum, Open Grid Forum (OGF), OpenCloud Computing, Interface Working Group, DMTF Open Cloud Standards Incubator, GoGrid API(CC licensed), Sun Cloud API (CC licensed), Amazon Web Services as “de-facto” (i.e. as Eucalyptusand Nimbus have proceeded).I believe that the next step is creating anotherstandard working group that sits on top of them all.OCCI and δ-cloud are in the first-line.3.4.1 API OCCIThe initial goal of the API OCCI is to provide anextensible interface to Cloud InfrastructureServices (IaaS). The OCCI API is a RESTfulservice, allowing for the development ofinteroperable tools for common tasks includingdeployment (create, control), autonomic scalingand monitoring Cloud resources. Figure 8 - OCCI interactionThis API allow for: Consumers to interact with Cloud computing infrastructure on an ad-hoc basis (e.g. deploy,start, stop, restart) Integrators to offer advanced management services Aggregators to offer a single common interface to multiple providers Providers to offer a standard interface that is compatible with available tools Vendors of grids/Clouds to offer standard interfaces for dynamically scalable service deliveryin their products Figure 9 – OCCI schemaOCCI have been as modular as possible to facilitate future extension.The core protocol is completely generic, describing how to connect to a single entry point, authenticate, 14
  20. 20. search and CRUD operations (Create, Retrieve, Update and Delete resources) using existing standardsincluding HTTP (Plain Text), TLS, Oauth, JSON and Atom/Pub. State control (start, stop, restart),billing, performance, etc. The scope of the specification will be all high level functionality required forthe life-cycle management of virtual machines (or workloads) running on virtualization technologies(or containers) supporting service elasticity. Using a simplified service lifecycle model, it supports themost common life cycle states offered by Cloud providers.Simply by standardizing at this level OCCI may well become the HTTP of Cloud Computing. There isa good article that compares OCCI API with HTML. Is OCCI the HTTP of Cloud Computing? (16) Figure 10 OCCI Simple Life CycleRESTful web servicesA RESTful Web Service offers these HTTP methods: GET, PUT, POST and DELETE. OCCI API is aRESTful service and has methods associated with each resource type: Pool Resources (collection ofelements owned by a given user) and Entry Resources (single entry within a given collection). Figure 11 – OCCI (Compute, Network and Storage) GET PUT POST DELETEPool Resources (PR) to list all the entry x to create a new entry x resources in that pool resource resource owned by the userEntry Resources to list the information to update the resource x to delete the resource(ER) associated with that (only supported by the resource COMPUTE resource)XML format is used to represent COMPUTE, NETWORK and DISK resources; as well as thecollection of them (Pool Resources, PRs). 15
  21. 21. POOL RESOURCE  References a URI for the ER. Example: <COMPUTES> <COMPUTE href="http://www.opennebula.org/compute/234"> <COMPUTE href="http://www.opennebula.org/compute/432"> <COMPUTE href="http://www.opennebula.org/compute/123"> </COMPUTES>NETWORK ID, the uuid of the network NAME, describing the network ADDRESS, of the network SIZE, of the network, defaults to C Example: <NETWORK> <ID> 123 </ID> <NAME> Blue Network </NAME> <ADDRESS> 192.168.0.1 </ADDRESS> <SIZE> C </SIZE> </NETWORK>STORAGE ID, the uuid of the image NAME, describing the image SIZE, of the image in MBs URL, pointer to the original image Example: <DISK> <ID> 123 </ID> <NAME> Ubuntu 9.04 LAMP </NAME> <SIZE> 2048 </SIZE> <URL> file:///images/ub untu/jaunty.img </URL> </DISK>COMPUTE RESOURCE The compute element defines a virtual machine by specifying the configuration attributes. It ismore complex than previous resources commented:  ID, the uuid of the virtual machine. NAME, describing the virtual machine. TYPE, a COMPUTE type specifies a CPU and memory capacity, valid types are small, medium 16
  22. 22. and large. STATE, the state of the COMPUTE. T DISKS, the block devices attached to the virtual machine (DISK, SWAP, FS) NICS, the network interfaces, defined with a list of NIC elements. (UUID, IP...) Example: <COMPUTE> <ID>123AF</ID> <NAME>Web Server</NAME> <TYPE>small</TYPE> <STATE>running</STATE> <DISKS> <DISK image=234 dev=sda1/> <SWAP size=1024 dev=sda2/> <FS size=1024 format=ext3 dev=sda3/> </DISKS> <NICS> <NIC network=4567f ip="19.12.1.1"/> <NIC network=0/> </NICS> </COMPUTE>Return CodesThe OCCI Cloud API uses the following subset of HTTP Status codes.200 OK: The request has succeeded. GET: an entity corresponding to the requested resource is sent inthe response.POST: an entity containing the result of the action. 201 Created, 202 Accepted, 204 NoContent.The 4xx class of status code is intended for cases in which the client seems to have erred (400 BadRequest, 401 Unauthorized, 403 Forbidden, 404 Not Found...).And 5xx, the server failed to fulfill an apparently valid request. (500 Internal Server Error, 501 NotImplemented ...)AuthenticationAuthentication follows REST philosophy. It is recommended that the server-client communication isperformed over HTTPS to avoid sending user authentication information in plain text.3.4.2 TCloudTCloud API is based on vCloud API specification 0.8. In essence, compatibility for the main operationsand data types defined in vCloud is maintained by TCloud. TCloud provides extensions on advancedCloud Computing management capabilities including additional shared storage for service data,network element provisioning, monitoring, snapshot management, and so on. TCloud API is focused onadding network intelligence, reliability and security features to Cloud Computing. The goal of theinitiative is to provide the power of Cloud computing with the flexibility allowed by virtualizationTelefónica has released the TCloud API for Cloud Computing interoperability and submitted it to theDistributed Management Task Force (DMTF). This shows Telefónica commitment to promote Cloud 17
  23. 23. interoperability and standardization. This releasing is good for telecommunications companies ingeneral, as it proves that telecommunications are skilled to define the technology in which its servicesare based.3.5 Green ComputingNowadays the concept of Green Computing (or Green IT) (17) (18) is taking some relevance due to thewidespread concerns about issues such as climate change, recycling, biodegradability, etc. In thischapter, we present the Green Computing focused on Cloud computing and virtualization. So we talkabout energy consumption that implies a certain level of CO2 emissions.It is estimated that the IT sector causes 2% of global CO2 emissions and in some articles it is said thatthe IT sector produces more carbon emissions than the world of aviation. For example someinformation published in Daily Telegraph (19) talk about two Google searches produce the same CO2as boiling a kettle.Another important fact to keep in mind is that the IT sector is growing constantly, so this implies thatenergetic consumption is growing. It is an important data that produces more CO2 emissions.According to Greenpeace, world data centers to store Cloud computing services will triple emissions tothe atmosphere in 2020 (20). Currently there are several European researches to improve theconsumption-performance ratio, especially for datacenters and supercomputers. This master thesismakes research about this subject.The most part of the pollution produced by Cloud computing is caused by world datacenters. Powerusage effectiveness (PUE) is a measure of how efficiently is a computer datacenter using its power;specifically, how much of the power is actually used by the computing equipment (in contrast tocooling and other overhead). The overall average is 2, which means that for every watt used in runningthe equipment, has spent other one to keep cooled this.Virtualization technology enables the consolidation of multiple workloads and always increasesefficiency and most of them save energy on IT equipment, for example, using a smaller number ofmachines. Nevertheless, virtualization also produces some additional overheads and as a result the restof the datacenter may be running less efficient. VM creation and VM migration is the most stand outoverhead in Virtualization moreover, Virtualization technology use a new layer called hypervisor thismeans that a little high performance is lost. But virtualization overhead is insignificant in contrast to itsadvantages.BSC and UPC use EMOTIVE to research about green virtualization. Virtualization requires highdensity datacenters. Remaining servers are running at higher power consumption levels but there aredifferent ways to deal with this. Energy-aware Scheduling in Virtualized Data Centers (21) is oneexample. This presents a Scheduler that uses a mathematical algorithm to manage Virtual Machines.Basically, the Scheduler makes a virtual machine consolidation in the minimum number of physicalmachines and the unused machines will be shutdowned. Scheduler manages the Virtual Machinesmigrating this to some physical machines to use the maximum possible performance of physicalmachines. And if there are some physical machines without any virtual machine and in idle mode,scheduler shutdown this server to consume less energy.There are other solutions presented by others researches but the main idea is the same, the changes arein the idea of the scheduler algorithm. Nowadays commercial middlewares use a generic scheduler asbackfilling that pack the VMs in the cluster nodes to reduce VM fragmentation and use the minimumnumber of physical servers. 18
  24. 24. Other aspects to considerate that it is important to understand the impact of Virtualization on DataCenter Physical Infrastructure (22). The virtualization power savings can produce unexpected resultsand probably you need to upgrade power and cooling infrastructure to take advantage of the savingsopportunity that virtualization offers. You need to worry about power and cooling when it isvirtualizing. You may need additional cooling in some physical areas to improve the power efficiency.For example, it cools some areas dynamically depending on the load. Care should be taken to examinethe impact on power and cooling because each data center virtualization is different.3.5.1 The greening of the CloudTraditional On-Premise vs Cloud Computing:The Cloud computing business motivation is that the resources solutions on demand promise greaterflexibility, dynamic, timely and green solution than traditional on-premise computing.Therefore, we must bear in mind that migrate certain parts or all of a classic on-premise IT to Cloudcan provide scalability, can reduce the costs of physical growth, reduce costs and reduce energy use (8).On-premise computing needs an initial capital investment, maintenance and the costs of future updates.In contrast Cloud does not need an important initial cost so it has a lower initial investment becauseCloud offer elasticity and pay-as-you go cost model.It is interesting to find which solution is better. But it is more interesting the utilization into bothsolutions together to keep the best features of each.In the paper (23) there is an interesting analysis of cost and performance between “Traditional On-Premise” with Cloud Computing classifying the various types of costs CapEX (CAPitalEXpenditures)and OpEX (OPerationalEXpenditures) depending on the attribute to be analyzed (Infrastructure,Business, Physical Resources, Network, Performance, Energy, budget, etc.). In short we can discussthat in Cloud Computing there are more OpEx and in the traditional on-premise there are more CapEx.Nowadays generally on-premise infrastructure run with low utilization, sometimes it goes down up to 5to 10 percent of average utilization. Data centers that utilize Cloud technologies are more efficient thantraditional data centers. Energy is usually lost through server under utilization, because most of thetime these servers are just in idle mode. But in a Cloud environment the system is managed to run atthe highest efficiency. In addition, data center planning allows better power utilization. In traditionaldata centers, they can have cooling problems and you can run out of space for more servers. There isalso a consortium of Cloud providers, who assure that its members optimize their data centers to mi-nimize power consumption.On-premise solution can be better, whenever if we have a constant full utilization of the ITinfrastructure. This often happens in large companies that offers constant services around the world.For example, in their start Facebook was using Amazon services but finally due to their large increasein business, Facebook built his own data center, adapted to their business needs.Cloud solutions are highly recommended in most areas. But an important factor to consider is thatnetwork latency influences negatively in the response time of the Cloud solutions. Traditional On-Premise Computing usually have better network latency and therefore the response time gives betterresults for the solution.And also a lot of companies prefer to use on-premise infrastructure for its data privacy and protection.In this project, however, we do not focus on Cloud security. 19
  25. 25. In conclusion, it is necessary to analyze the CapEx/OpEx balance and the consumption depending oneach own case. As we have said, what we study is the energy consumption and in the next chapter, wewould like to show our structure solution of hybrid architectures and how they are a solution to reduceenergy consumption, without losing too much performance.Global vision in Green Computing:We should have a global vision of both sides of the coin, Cloud computing and Green Computing.Basically it is known the relationship between the Cloud and eco-efficient IT (24).The end-user adoption of Cloud implies that there will be a turning point in 2011, Cloud Computingutilization is increasing. Therefore, more power consumption in the Cloud.There are several things to consider having good eco-efficiency in IT.  Each year the number of datacenters is growing and also the power consumption.  New legislation penalizes the excessive consumption of energy. New measures should be taken into account.  Expensive equipment uses more energy than what they truly need.So the Cloud computing alleviates these things:  This allows better management of internal uses of resources (sharing resources or virtualizing).  Reduce peakload using schedulers to manage a rapid provisioning and deprovisioning.  Reduce unnecessary use of resources in some points.  When there is hardware (compute or storage) limits use outsourcing.Green Clouds? Not all Cloud Computing cases are greener compared to in-house IT:  Energy efficiency. Providers aim to have efficient operations.  Sometimes Cloud Providers overlooked reporting metrics consumption of server resources.  Recycling. Service providers would have to detail IT recycling policies.Key points in the adoption and incentives: In 2008 many companies such as Yahoo, Google, Microsoftand others, struggled to be in a good position as the greener operators of datacenters. But the thing isthat is not that easy to measure which data center is more efficient. In fact, several studies (commercialand non commercial) have emerged to try to find a common standard measurement.Follow the Moon:Before finishing this chapter, we present an example of a very interesting technique. Follow the moonconcept means to reduce energy consumption and expenditure taking advantage of nighttime tempera-tures and lower electricity rates, and so have their computing resources chase in day/night boundary.i.e., migrate to data centers where it is night time. After all, always it is night somewhere in the world.Although, these techniques have certain limitations because it is necessary to have similar settings, re-quires visibility among others and the bandwidth latency presented increase. Well, this theory must becarefully studied as many companies have done.The Key technologies that can follow the moon are: virtualization, modularization, consolidation andoutsourcing appropriate. These are key strategies to achieve eco-efficient IT. 20
  26. 26. 4 Contribution4.1 EMOTIVE ORIGINALEMOTIVE (Elastic Management of Tasks in Virtualized Environments) (25) is the BarcelonaSupercomputing Center (BSC)‟s and Barcelona Tech (UPC) IaaS open-source solution for CloudComputing, which results from BSC‟s previous experience in European projects such as BREIN (1)and SORMA (26). EMOTIVE provides users with elastic fully customized virtual environments(supporting Xen hypervisor) in which to execute services. Further, it simplifies the development of newmiddleware services for Cloud systems by supporting resource allocation and monitoring, datamanagement, live migration, and checkpoints.EMOTIVE middleware can be categorized as an IaaS solution, since it provides the users withvirtualized environments where they can execute their tasks without any extra effort. These VMs,which aim to fulfill the user requirements in terms of software and system capabilities, aretransparently managed by EMOTIVE in order to exploit the provider‟s resources. EMOTIVE caneasily be extended with multiple scheduling policies in order to manage the VMs using differentcriteria. Figure 12 - EMOTIVE Cloud architectureFigure 12 illustrates the EMOTIVE Cloud architecture, which is mainly composed by three differentand modular layers: the fabrics infrastructure, the node management (VRMM), and the globalScheduler. VRMM component is responsible for managing the life cycle of the virtual machines(creation, destruction, submit tasks, etc.). Scheduler layer is responsible for distributing the tasks andvirtual machines between physical nodes. The Scheduler includes support for efficient virtual machinesmigration, managing checkpoints, and system configuration and organization between different virtualenvironments. 21
  27. 27. The Virtualization Fabrics layer comprises the physical resources where the VM will run. This layerwraps the virtualized resources and offers them to the upper layers. EMOTIVE makes use of the XenAPI which makes it able to use Xen virtualization technologies. Furthermore, it implements a distributedshared file system (DFS) that supports efficient VM creation, migration (to move VMs across provider‟s hostswithout stopping the execution), and checkpointing (to resume VM execution upon hardware failure). This filesystem also supports a global repository where users can upload the input files needed by the applications (i.e.data stage-in) and retrieve the resulting ones (i.e. data stage-out).The data infrastructure offers a distributed storage for supporting virtualization capabilities such asmigration and checkpoint support, and it can use differents kinds of storage. It distributes the dataamong the cluster nodes. It uses NFS in order to make the data of every node available from the othernodes. Thanks to this technique, VMs can be moved between nodes without losing connection. Thiscapability allows new approaches such as consolidating the global system or giving more resources to agiven application if the node is not able to do this locally.In addition, this data infrastructure allows each VM accessing data required by the user by using ashared repository also distributed among the nodes. It also allows storing data in the system in order tobe reused later from other VMs.The Virtual Machine Manager layer is implemented by means of the Virtualized ResourceManagement and Monitoring (VRMM). This layer comprises all the local resource managementdecisions (i.e. in a single node) and it is in charge of managing the physical resources of a node anddistributing these resources among all the VMs running on that node. In addition, it continuouslymonitors the resource usage of these services and the fulfillment of their SLAs. If any SLA violation isdetected, an adaptation process for requesting more resources to the provider is started, first locally ineach node, then globally in the provider, and finally with other providers. This layer is also in charge ofcreating and maintaining the whole virtual machine life cycle (create, destroy, migrate, etc.) andexecuting tasks described by means of a JSDL file (27).In addition, the VtM comprises all the local resource management decisions (i.e. in a single host): it isin charge of managing the physical resources of a host and dynamically distributing these resourcesamong all the VMs running on that host in order to fulfill their respective Service Level Agreements(SLAs). EMOTIVE allows specifying fine-grain resource-level guarantees in the SLA (e.g. amount ofcomputing power allocated to a given VM over time), which are clearly superior to the availabilityguarantees supported by common providers such as Amazon EC2 (5).Furthermore, EMOTIVE also has, by means of the VtME component, the capability to use externalresources, like the ones in public Cloud providers (i.e. Amazon EC2). This feature allows anEMOTIVE-enabled provider to be involved in a Cloud federation (insourcing/outsourcing) and createpublic, private, and hybrid clouds.On the other side, the Resource Monitor (RM) component continuously monitors the status of tasks andresources. This status is stored in a historical database, but it can be also used to assess the fulfillmentof the SLAs of the applications. If any SLA violation is detected, an adaptation process for requestingmore resources to the provider is started, first locally in each host, then globally in the provider, andfinally with other providers.Finally, the Virtual Machine Scheduler layer comprises all the global VM placement decisions, bothamong different providers in a Cloud federation and different hosts in a single provider. This layer is incharge of deciding where a VM will be executed and managing its location during the execution (e.g.migration of VMs across provider‟s hosts, cancellation of VMs, resumption of VM execution from a 22
  28. 28. checkpoint upon hardware failure, etc.). As a rule of thumb, the Scheduler tries to consolidate the VMsin the provider‟s physical resources to optimize their use, while allocating enough resources to fulfillthe agreed SLAs.Moreover, this framework allows multiple schedulers with different policies and capabilities such asmachine learning, prediction, economic, fault tolerance, semantic description, or SLA enforcement. Inthis sense, it can use a simplistic Round Robin, or a consolidation-aware scheduling like Backfilling.This is achieved thanks to the usage of a common interface (Web Service SOAP) that allowsdeveloping new schedulers with different features and policies.In conclusion, the main capabilities supported by EMOTIVE are summarized herewith:· VMs creation on demand, according to application requirements.· Monitoring of task and resource status, including historical information.· Consolidation of VMs in the provider‟s physical resources to optimize their use.· VM placement and fine-grain dynamic resource distribution based on Service Level Agreements(SLAs).· Efficient live migration of VMs across provider nodes.· A checkpoint/recovery system to resume task execution upon hardware failure (thus achievingfault tolerance).· Ability to create additional VMs on external clouds when the local provider is overloaded.· Data management services for supporting VM creation and the migration and checkpointmechanisms, and also to allow users to provide input (i.e. data stage-in) and retrieve output (i.e. datastage-out).4.2 The Evolution of EMOTIVE4.2.1 IntroductionIn this chapter, we will describe the main new functionalities added to EMOTIVE in this master thesisand how they are implemented.We can summarize these new features for EMOTIVE in the next schema:  New support through Libvirt API.  Replace Xen Api with Virsh API  Support for KVM and Virtual Box hypervisors.  Contextualization and easy installation. Virtual image management and creation from the scratch.  New modular architecture with Web Services RESTful. This makes EMOTIVE easier to be extended.  Compatibility with API OCCI thanks to new RESTful architecture. This allows achieving interoperability in the Cloud.  GUI adaption to new RESTful architecture.  Initializing OVF support (alpha version) 23
  29. 29.  New EMOTIVE functionalities  VLAN Network management  Easy management and creation of Virtual Networks (VPN support).  EMOTIVE evolution to be Greener  EMOTIVE in new hybrid architectures.  EMOTIVE adaption to NUBA National project.4.2.2 New Modular ArchitectureOne of the main features of EMOTIVE is its modular and distributed architecture. EMOTIVE wasoriginally designed using a distributed SOAP architecture but now it uses Web Services RESTfularchitecture. This architecture allows to use only some parts of EMOTIVE and supports agile anddynamic construction of new Cloud environments.Its Web Service REST interface makes EMOTIVE highly interoperable with other Cloud solutions. Inparticular, we encourage using the Open Cloud Computing Interface (OCCI) (16), which allowsEMOTIVE to be interoperable with other Cloud middleware supporting this interface.In addition to API OCCI compatibility, EMOTIVE can use the external Cloud Amazon EC2 via theWeb Service EC2 API and also it could interpret OVF files (28). The capability to use externalresources from Amazon EC2 allows to be involved in a Cloud federation (insourcing/outsourcing) andcreate public, private, and hybrid clouds. Hybrid possibility allows to dynamically increase or decreasethe capacity of resources with the least effort possible thanks to its scheduler and to respond tounpredictable demand curves. Figure 13 - Internal EMOTIVE Architecture 24
  30. 30. With the new RESTful architecture we need to adapt every EMOTIVE module [Figure 13]: the GUImodule, Scheduler modules and VtM modules. In the chapter 4.5.2 we can see the full details of thenew architecture and the new interfaces used in EMOTIVE and in the chapter 4.3 we can see the evo-lution of EMOTIVE API as we replaced XEN API to use Libvirt with API.EMOTIVE is able to support different schedulers. All EMOTIVE Schedulers use Web Servicescommunications to receive an external client request or send requests to the Virtual Management (VtM)component to manage virtual machines, submit jobs or other functionalities. A client request is a WebService RESTful with standard operations (like GET, POST, PUT, DELETE for HTTP). The client forScheduler uses this RESTful interface to request some work. This RESTful interface is very easy toextend, being a powerful functionality.4.2.3 Green IT evolutionIn this master thesis, we analyze the energy impact of running virtualized environments using differentkind of computer architectures such as Xeon, Atom and hybrid approaches. Also we analyze thedifferent kind of hypervisors that now EMOTIVE can run thanks to new features added.Additionally we exploit the EMOTIVE capability of supporting multiple scheduling policies in order tocompare the energy impact of some of them. These include a simplistic Scheduler that uses RoundRobin to balance VMs among nodes and a backfilling-alike Scheduler that does VM consolidation tosave energy. The latter is described in a previous work (29) (21). It basically uses a backfillingscheduler to consolidate VMs in data center nodes according to multiple facets while optimizing theprovider‟s profit. In particular, it considers energy efficiency, virtualization overheads, fault tolerance,and SLA violation penalties, while adding the ability to outsource resources to external providers. Thisscheduler saves energy by shutting down the machines that are idle. In addition, we also compare thepower consumption of this EMOTIVE Scheduler with generic Schedulers solutions presented in othermiddlewares solution such as OpenNebula.We also added new features to simplify the process of virtual machines preparation and creation. Forinstance, we can create Virtual Networks (VLAN) and VPNs (with SSL and PPTP protocol). With thissimple and dynamic network management we can set up dynamic Cloud environments on demand. Wecan create VLANs or VPNs on demand at a certain instant of time, without the need of extend thephysical network infrastructure because it is not necessary to buy and put new hardware in theinfrastructure. In this sense, we can say that this feature has some ecological value.4.3 Extended Virtualization support in EMOTIVEWe see that the EMOTIVE platform needs to expand and not depend only on Xen hypervisor. We wantit to be as generic as possible. Therefore we have redefined the architecture, rewritten the API andmade it compatible with Libvirt [Figure 13]. With this compatibility we have more possibilities to ex-pand the virtualization architecture to use other hypervisors. So a part of XEN we extend to use EMO-TIVE with KVM and Virtual Box virtualization thanks to the new API used (Libvirt), abandoning theold API (Xen API). So now we replace Xen API by Libvirt API, therefore we create a new API plat-form that uses Libvirt. To support the new hypervisors also we need to deploy the operating systemenvironment with the hypervisor and Libvirt installation and its configuration (25).Apart from extending the number of hypervisors supported, Libvirt has other features, such as VLANmanagement. We will talk about this in the next chapters. 25
  31. 31. Now we describe how API Libvirt is integrated in the EMOTIVE Cloud platform. The starting point isthe actual Xen monitoring API (XenMonitor.java). This API has been completely rewritten to beadapted to Libvirt. (VirtMonitor.java). This represents a significant step forward in monitoring the plat-form, as it extends the possibilities of the platform making it compatible with most existing virtualiza-tion systems like Xen, KVM, VirtualBox, etc. Figure 14 summarizes the mapping between the methodsused in XenMonitor and VirtMonitor.java.We choose JAVA language to develop the new monitoring API, because EMOTIVE is fully developedin JAVA and bash shell. In the project we use the famous software development environment calledEclipse. We use another tools and plugins such us Maven and Subversion. Maven dynamically down-loads Java libraries and Maven plug-ins from one or more repositories. And Subversion (SVN) is a toolused by EMOTIVE software developers to manage changes within their source code tree.It is necessary to know that EMOTIVE Cloud uses important Linux bash scripts in the low level of itsarchitecture to do the virtual machines contextualization (for dynamically creating VMs disk imagesfrom scratch and configuring some values, on demand). Libvirt can be used as API C, API Java and inconsole mode. It is a great API.EMOTIVE has been evolving together with API Libvirt. EMOTIVE started using Libvirt version 0.4.0and now it is using Libvirt 0.8.3.It is important to know that Libvirt Project and most technology used in the project (eg. KVM, OCCI),is under development and some methods that the library offers are in beta version and have some bugs.This technology is evolving and new functionalities are appearing. The new architecture has beenrefined and is evolving. This has been an extensive period of development and testing on the platform.Also you can see that in VirtMonitor there are absences of some methods that XenMonitor has [Figure14]. But EMOTIVE only uses some basic methods therefore not noticed a difference in the EMOTIVEusability with the API replacement. Equally EMOTIVE could extend new functionalities using all Javamethods presented.In conclusion we see that before EMOTIVE virtualized only with XEN hypervisor. Now we canvirtualize with XEN, KVM, and Virtual Box. Therefore we needed to change the architecture and Javacode and also we needed to change the bash scripts due to the virtual machines contextualization sothat three hypervisors are 100 % compatible with the middleware. It is interesting to know that is veryhard to use VMware ESX in EMOTIVE although Libvirt is compatible with VMWARE ESX. VMwareuses a private architecture and it is necessary to do a lot of changes in EMOTIVE architecture. Libvirtuses a remote communication with VMware in contrast with the others hypervisors. The othershypervisors use local petitions and it is easier to be used in EMOTIVE. Full support for VMware is partof our future work.We will provide a quantitative and qualitative comparison of EMOTIVE running over different hyper-visors (e.g. XEN, KVM and Virtual Box) in the section 4.6.1 . You could find the best solution forevery type of needs: performance, green, agility, usability, etc. 26
  32. 32. VirtMonitor.java (API Libvirt) XenMonitor.java (API Xen)Compute Method Summary Compute Method Summary int availableMemory() int availableMemory() void checkAll() void checkAll() int resume(java.lang.String name) int resume(java.lang.String name) int save(java.lang.String name) int save(java.lang.String name) int restore(java.lang.String name) int restore(java.lang.String name) int start(java.lang.String name) int start(java.lang.String name) int shutdown(java.lang.String name) int shutdown(java.lang.String name) void unpause(java.lang.String name) void unpause(java.lang.String name) void pause(java.lang.String name) void pause(java.lang.String name) int pauseDomain(java.lang.String name) int defineXML(java.lang.String name) int availableCPUs() int availableCPUs() void dummy() void dummy() float getCPUAmount(java.lang.String name) float getCPUAmount(java.lang.String name) int getCPUCapacity(java.lang.String name) int getCPUCapacity(java.lang.String name) int getCPUFreq() int getCPUFreq() int getCPUPriority(java.lang.String name) int getCPUPriority(java.lang.String name) int getCPUSpeed() int getCPUSpeed() int setCPUCapacity(java.lang.String name, int capacity) int setCPUPriority(int id, int priority) int setCPUPriority(java.lang.String name, int priority) int getDiskRD(int vm) int getDiskRD(int vm, int vbd) int getDisksRD(int vm) int getDisksRD(int vm) int getDisksRW(int vm) int getDisksRW(int vm) int getDiskWR(int vm) int getDiskRW(int vm, int vbd) int getDomainId(java.lang.String name) int getDomainId(java.lang.String name) String getDomainName(int domain) String getDomainName(int domain) List<String> getDomains() List<String> getDomains() String getIP(int vm) String getIP(int vm) int getMemory(int vm) int getMemory(int vm) int getMemory(java.lang.String name) int getMemory(java.lang.String name) float getMemoryAmount(int vm) float getMemoryAmount(int vm) float getMemoryAmount(java.lang.String name) float getMemoryAmount(java.lang.String name) int getMemoryMax(java.lang.String name) int getMemoryMax(java.lang.String name) int getMemoryStaticMax(java.lang.String name) int getMemoryStaticMin(java.lang.String name) int getMemoryDynamicMax(java.lang.String name) int getMemoryDynamicMin(java.lang.String name) int getMemoryDomU(int vm) int freeMemory() int getNetRX(int vm) int getNetRX(int vm) int getNetTX(int vm) int getNetTX(int vm) int getNumCPU(java.lang.String name) int getNumCPU(java.lang.String name) int getNumDisks(int vm) int getNumDisks(int vm) int getNumDomains() int getNumDomains() String getState(java.lang.String name) String getState(java.lang.String name) boolean migrate(java.lang.String name, ja- boolean migrate(java.lang.String name, ja- va.lang.String destHost) va.lang.String destHost) int pinCPU(java.lang.String name, int vcpu, int[] cpumap) int pinCPU(int vm, int vcpu, int cpu) 27
  33. 33. int setCPUCapacity(String name, int nvcpus) int setCPUCapacity(int id, int capacity) int setHostMemoryDynamicMax(String name, int mem) void setMemory(int id, int mem) setMemory(int id, int mem) void setMemory(java.lang.String name, int mem) void setMemoryFixed(int id, int mem) void setMemoryFixed(int id, int mem) void setMemoryFixed(java.lang.String name, int mem) int setMemoryMax(java.lang.String name, int mem) void setNumCPU(java.lang.String name, int cpu) void showMemory(java.lang.String name) void showMemory(java.lang.String name) VirtMonitor.java (API Libvirt) XenMonitor.java (API Xen) Network Method Summary Network Method Summary XML defineNetwork(String name, String uuid, String bridge, String address, String netmask, String dev, String mode, String start, String end) int createNetwork(XML) int deleteNetwork(String network) int listNetworks() List<String> showNetwork(String network) Figure 14- Mapping methods between VirtMonitor and XenMonitor4.4 EMOTIVE Networks4.4.1 VLANThe acronym VLAN expands to Virtual Local Area Network. A VLAN is a logical local area network(LAN) that extends beyond a single traditional LAN to a group of LAN segments, given specific confi-gurations. Because a VLAN is a logical entity, its creation and configuration is done completely insoftware.Libvirt is the technology used to create VLANs in EMOTIVE. Libvirt allows virtual machines creationand easy management but also virtual networks creation and easy management.Libvirt allows using console mode to create and manage the VLANs or using the Java/C API. InEMOTIVE we use the Java API (30). First of all, to create VLAN with Libvirt, it is necessary to createthe XML manually with the VLAN description and later we need to pass this XML information in thespecific Libvirt call function. We show in a XML description as example: <network> <name>private</name> <bridge name="virbr2" /> <ip address="192.168.152.1" netmask="255.255.255.0"> <dhcp> <range start="192.168.152.2" end="192.168.152.254" /> </dhcp> </ip> <ip family="ipv6" address="2001:db8:ca2:3::1" prefix="64" /> </network>So in EMOTIVE we have automatized the XML parsing and creation to have better VLANmanagement and creation. The steps to create VLAN with EMOTIVE are the next: 28
  34. 34. 1 - Necessary information to create Network.java (Java object) it is a EMOTIVE class name, id, uuid, ip address, gateway, netmask, dev, mode (route, nat, isolated, private), bridge name, ip_start, ip_end2 - EMOTIVE Parser to create XML file with the last information (object Network) String xml = parsing.CreateXML(Network.java) or String xml = parsing.CreateXML(name, uuid, bridge, address, netmask, dev, mode, start, end);3 - Libvirt function to create Network with the XML created file conn.networkCreateXML(xml);Libvirt has a set of elements control how a virtual network is provided connectivity to the physicalLAN, these are: bridge, domain, forward (nat, route, bridge, private, vepa, passthrough). NowEMOTIVE only uses route, nat, isolated and private but in a future we could evolve to use more… Figure15 - EMOTIVE Cloud example with Virtual-machines with VLANsThe API OCCI is used to offer these network services to the upper layers. API OCCI is used to have acommon language interface with other Clouds such as OpenNebula. OCCI is very useful to manage,create and remove network resources (in the Cloud). Basically OCCI allows to create, list, show, anddelete networks, similarly to virtual machines (OCCI compute).OCCI (occi-network):NETWORK Example: ID, the uuid of the network <NETWORK> NAME, describing the network <ID>123</ID> ADDRESS, of the network <NAME>Blue Network</NAME> SIZE, of the network, defaults to C <ADDRESS>192.168.0.1</ADDRESS> <SIZE>C</SIZE>FUNCTIONS: </NETWORK>create, list, show, deleteThe EMOTIVE Scheduler can use these functionalities via an OCCI web services restful call to create,list, show … a VLAN. Later on, Scheduler communicates with VtM and VtM uses the networksmethods located in VirtMonitor.java to invoke the Libvirt network facilities.The next screen [Figure 16] shows the help menu of EMOTIVE console. You can see the new networksfunctionalities to network management. Functions as ($net-* …) are used for VLAN management 29
  35. 35. and ($vpn …) for VPN management. localhost:~$ help Help server: change server to connect create: create a VM with generic name name: create a VM with specific name set: set a property of the domain + (vmid/memory/cpu/home/exten/ip/name/taskid) + (id) new: create a new domain run [CMD]: run a task in a VM status [TASKID]: show status of a task pause [VMID]: pause VM unpause [VMID]: unpause VM destroy [VMID]: destroy VM cancel [TASKID]: cancel a task show domain: domain in the system task: tasks in the system vm: VMs in the system vmall: all VMs in the system nodes: nodes in the system vmothers: extern VM in the system (no EMOTIVE VM) net-list: show network net-create: create a new network net-occi: create a new network + (id/name/ip/size(A,B,C) net-destroy: destroy network + (name) net-show show network net-set: set a property of the Network + (name/ip/netmask/mode/start/end) + (quick [name-bridge] + [gateway+ip_range]) net-edit: In construction vpn: create a vpn multi + server + localip (openvpn) multi + addclient + server + localip (openvpn) ptp + server + localip (openvpn) pptp + server + localip + user + password + tunnelname (pptp) exit: quit this interactive terminal Figure 16 - EMOTIVE help menuThe next screen [Figure 17] shows a demonstration to create a VLAN with EMOTIVE.localhost:~$ net-show Network: Name: vlan01 Ip: 132.168.163.1 Mode: private Netmask: 255.255.255.0 Bridge: vlan01 Range IP start: 132.168.163.2 IP end : 132.168.163.254 Quickmode Example: >>net-set quick vlan00 192.168.1 name=vlan00 bridge=vlan00 ip=192.168.1.1 ip range [start192.168.1.2 , end 192.168.1.254 30

×