• Like
  • Save
UnaCloud: Opportunistic Cloud Computing Infrastructure as a Service
Upcoming SlideShare
Loading in...5
×
 

UnaCloud: Opportunistic Cloud Computing Infrastructure as a Service

on

  • 1,287 views

UnaCloud: an opportunistic cloud computing Infrastructure as a Service (IaaS) model implementation, which provides at lower cost, fundamental computing resources (processing, storage and networking) ...

UnaCloud: an opportunistic cloud computing Infrastructure as a Service (IaaS) model implementation, which provides at lower cost, fundamental computing resources (processing, storage and networking) to run arbitrary software, including operating systems and applications.

Statistics

Views

Total Views
1,287
Views on SlideShare
1,284
Embed Views
3

Actions

Likes
0
Downloads
26
Comments
0

1 Embed 3

http://www.linkedin.com 3

Accessibility

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    UnaCloud: Opportunistic Cloud Computing Infrastructure as a Service UnaCloud: Opportunistic Cloud Computing Infrastructure as a Service Presentation Transcript

    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011)UnaCloud: Opportunistic Cloud Computing Infrastructure as a Service IaaS Model Type II Hypervisor UnaCloud Clients Operating System Desktop Computers UnaCloud Server IaaS user Grid user Administrator IaaS-Grid user Eduardo Rosales, Harold Castro, Mario Villamizar Department of Systems and Computing Engineering Universidad de los Andes Bogotá, Colombia
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) THE PROBLEM THE DESIRED SOLUTION UNACLOUD ARCHITECTURE UNACLOUD IMPLEMENTATIONUNACLOUD TESTING AND RESULTSCONCLUSIONS AND FUTURE WORK
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) THE PROBLEMThe development of e-Science projects requires large processing capabilities.These capabilities are regularly provided by dedicated cluster, grid and cloud computing infrastructures.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) THE PROBLEMIn the research environment of our university campus we find that each research grouphas its own dedicated clusters and some computer labs for students, so: Researchers use and have some experience with specific cluster/grid middlewares to distribute load among the nodes of dedicated clusters (OGE, Condor, etc.). Computer labs have many commodity desktops with different operating systems: Windows (mainly), MAC and Linux, which are idle most of the time. Most e-Science applications are run on Linux.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) THE PROBLEMResearchers require large HPC/HTP computing during some peak periods (a projectneeds to be delivered, the call for paper will finish, etc.).Additionally, there are a lot of general or public campus computer labs used bystudents and these labs are also idle most of the time.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) THE PROBLEMMore than 2000 CPU cores
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) THE CONTEXTAn alternative are Desktop Grids and Volunteer Computing Systems (DGVCS’s): Offer large scale computing infrastructures at low cost. Use inexpensive resources, most of them underutilized desktop computers. Interconnect thousands of computing resources available through Internet or Intranet environments. Are based on resources that are non-dedicated, distributed, highly heterogeneous, and part of independent administrative domains.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) THE PROBLEMWhen a research group wants to use a DGVCS it regularly find that: They will need to recode, modify or adapt every application that is going to be executed on the DGVCS, for several research groups and tens of existing applications it is a complex process. The installation, configuration, maintaining and use of most DGVCSs require of people with some/advanced skills in applications and IT infrastructures. For using the idle processing capabilities of hundreds of commodity desktops, they will need to configure manually every desktop computer with the DGVCS software.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) THE PROBLEMWhen a research group wants to use a DGVCS it regularly find that: Administrators of different computer labs do not want that external people modify the configurations of the physical machines. Most of the physical desktops (99%) machines available in computer labs have Windows operating systems. They would like to share easily with other research groups the idle capabilities available in computer labs using a shared model.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011)THE DESIRED SOLUTION
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011)THE DESIRED SOLUTION
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011)THE DESIRED SOLUTION Ubuntu with OGE
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011)THE DESIRED SOLUTION Ubuntu with OGE VMs begin to process jobs of the bioinformatics cluster
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011)THE DESIRED SOLUTION
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011)THE DESIRED SOLUTION Debian with PBS
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011)THE DESIRED SOLUTION Ubuntu Debian with OGE with PBS Both clusters are being executed on the same physical/shared commodity infrastructure.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011)THE DESIRED SOLUTION UNACLOUDResearch groups can deploy on- demand Computing Services, sharing the same commodityinfrastructure. This is achieved using an Opportunistic Infrastructure as a Service Strategy.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) SOLUTION REQUIREMENTSOur designs have specific requirements: On demand computing services customization and infrastructure assignment to meet specific requirements related to e-Science applications (native executing environments). High usability user interfaces based on a self-service model to intuitive creation, deployment and management of large computing infrastructures to support e- Science projects. Strategies to allow the use of idle computing resources in a non-intrusive manner to provide large scale computing capabilities at low cost. Measured service to record and report the infrastructure user-level consumption. Delegated administration of the underlying infrastructure complexity used to provide customized computing services to researchers, professors and students. Solutions based on ubiquitous, interoperability, loose coupling, extensibility and information security principles.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) DGVCS’s / CLOUD COMPUTING STRATEGY CLOUD COMPUTING DGVCS’s -Broad network access -Opportunistic strategies -Measured service -High -Distributed systems usability -On demand services -Highly heterogeneous customization -Interoperability -Self-service UnaCloud systems -Resource optimization and loose coupling -Scalability -Non-dedicated -Low cost infrastructures -Virtualization -Multi tenancy -High scalability -Extensibility -Best effort -Delegated approach -Non-intrusive -Security administration designIn this work we analyze the prospect and performance of using anopportunistic underlying infrastructure to support a Cloud Computing IaaSmodel. This is the main motivation and contribution of this research work.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) UNACLOUD ARCHITECTUREVirtualization technologies allow UnaCloud IaaS ModelUnaCloud to access the following Type II Hypervisoradvantages: resource optimization, Operating Systemexecution environments isolation, ondemand deployment and highportability to build a cloud computing CPU Memory Storage NetworkIaaS model over type II hypervisor HARDWAREservices.VMs are executed in Virtual Machinebackground and as low IaaS (background and low priority Model process)priority processes, allowingthat UnaCloud can provide Type II Hypervisor Virtualization Technologythe following advantages: Main Operating Main Operating System Systemvirtual and physicalenvironments isolation and Opportunisticnon-intrusive idle resources CPU Memory Storage Network Infrastructureuse.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) UNACLOUD ARCHITECTUREEND USER ROLE IaaS Model Non-located IaaS Type II Hypervisor IaaS customization and/or UnaCloud Clients deployment Operating System Located Grid Desktop Grid customization and/or Computers deployment UnaCloud Server IaaS-Grid Any of the above roles Administrative andAdministrator monitoring exclusive IaaS user services Grid user Administrator IaaS-Grid userUnaCloud architecture is based on the integration of a Web information system with an underlying computing and communication infrastructureA Web portal (UnaCloud Server) articulated (through UnaCloud Clients) with a non- dedicated infrastructure provides an opportunistic cloud computing IaaS model
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) UNACLOUD IMPLEMENTATION Data Center The UnaCloud server was developed using J2EE and Administrators MySQL, and it was installed on a dedicated machine.Remote Access Mechanism UnaCloud Grid IaaS users Server Masters The UnaCloud client is a J2SE GigE application. The UnaCloud client was Grid users deployed in 3 computer labs using 105 desktops computers. Alan Turing Waira I Waira II Desktops have an Intel Core 2 0 IaaS Cluster Duo (1.86GHz) processor, 4GB of virtual Slaves RAM and Windows XP. machines All nodes were interconnected Computer laboratories with UnaCloud Client using a GigE LAN.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) UNACLOUD IMPLEMENTATION Data Center A Web user interface was used, providing a self-service model. Administrators Deployments on differentRemote Access Mechanism UnaCloud Grid Server Masters networks and administrative IaaS users GigE domains were performed. Secure mechanisms were used Grid users in message passing. Monitoring reports and Alan Turing Waira I Waira II statistics were generated for 0 IaaS Cluster UnaCloud users. virtual Slaves machines VMware workstation was used Computer laboratories with UnaCloud Client as type II hypervisor.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) UNACLOUD IMPLEMENTATION • Customizable Virtual Clusters (CVCs) IAAS through 5 settings: software,CUSTOMIZATION hardware, quantity, location (optional) and execution time. • On demand CVC deployment and IAAS provision of necessary data to DEPLOYMENT secure remote access. • VM operations such as: start, stop, IAASADMINISTRATION restart, change execution time and monitoring. IAAS • IaaS model traceability at user level TRACEABILITY with basic reports and statistics. PHYSICAL • Physical machine operations suchINFRASTRUCTURE as: turn off, restart, logout and near-ADMINISTRATION real time monitoring.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011)UNACLOUD IMPLEMENTATION • Customizable Virtual Clusters (CVCs) through 5 IAAS settings: software, hardware, quantity, locationCUSTOMIZATION (optional) and execution time.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011)UNACLOUD IMPLEMENTATION • Customizable Virtual Clusters (CVCs) through 5 IAAS settings: software, hardware, quantity, locationCUSTOMIZATION (optional) and execution time.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011)UNACLOUD IMPLEMENTATION IAAS • On demand CVC deployment and provision ofDEPLOYMENT necessary data to secure remote access.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011)UNACLOUD IMPLEMENTATION IAAS • VM operations such as: start, stop, restart,ADMINISTRATION change execution time and monitoring.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011)UNACLOUD IMPLEMENTATION IAAS • IaaS model traceability at user level with basicTRACEABILITY reports and statistics.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011)UNACLOUD IMPLEMENTATION PHYSICAL • Physical machine operations such as: turn off,INFRASTRUCTURE restart, logout and near-real time monitoring.ADMINISTRATION
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) UNACLOUD TESTING AND RESULTS IAAS USERS VIRTUAL MACHINES 70 academic VMs DEPLOYMENT MODE Non-located deployment DEPLOYMENT TIME 13 seconds GRID USERS 70 bioinformatics 35 chemical VIRTUAL MACHINES VMs engineering VMs DEPLOYMENT MODE Located deployment DEPLOYMENT TIME 15 seconds 7 secondsThe average time to load the guest operating systems is 4-5 minutes.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) UNACLOUD TESTING AND RESULTS CPU JOB TIME BY JOB EXECUTIONAPPLICATION NAME INFRASTRUCTURE USED NUMBER NUMBER (SEC) TIME (DAYS) BSGrid PC 2 150000 35 30,38 Model A Chemical Eng. CVC 70 150000 85 2,11 BSGrid PC 2 150000 63 54,69 Model B Chemical Eng. CVC 70 150000 111 2,75 PC 2 4200 11700 284,40 HMMER Biological Science CVC 140 4200 12900 4,50 Performance degradation perceived by owner users (students or administrative personal) is less than 3%. The maximum overload of grid jobs executed on UnaCloud virtual machines is of 17%. To avoid resource competition among virtual machines only one virtual machine is executed on each desktop.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) UNACLOUD OPPORTUNITIES AND LIMITATIONS REQUIRED FEATURES UNACLOUDUSABILITY High usability Web user interfaces, which operation is almost intuitive, requiring basic IT knowledgeSELF-SERVICE Unilaterally computing service provisionBROAD NETWORK ACCESS Web portal available over Intranet and InternetON DEMAND SERVICES CUSTOMIZATION On demand computing services customization, even to meet large scale computational requirementsHARDWARE MULTI TENANCY Opportunistic use of idle computing resourcesVIRTUALIZATION On demand VM deployment through virtualizationSCALABILITY Horizontal scaling model based on private cloudsINTEROPERABILITY AND LOOSE COUPLING Web and service oriented architectureEXTENSIBILITY Use of open source tools, broadly diffusedDELEGATED ADMINISTRATION Services to support common administration tasksSECURITY Authentication, authorization, confidentiality and non- repudiation mechanisms to secure the deploymentsMEASURED SERVICE Infrastructure traceability at user level with basic reportsQOS AND SLAs Best effort approach due to the infrastructure availability x
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) CONCLUSIONSUnaCloud validates the convergence of cloud computing and DGVCS’s,offering promising opportunities to meet customized computationalrequirements thought the use of an open source, low cost, extensible,interoperable, efficient, scalable, secure and opportunistic IaaS model.UnaCloud provides a multipurpose cloud computing experimental platformto deploy Customizable Virtual Clusters that support new specificcomputational requirements of academic and research projects.UnaCloud represents an economically attractive solution for building anddeploying large scale computing infrastructures.UnaCloud cloud computing features are promising to reduce thedevelopment cycle and the generation of results time of projects dependingon the agile and flexible provisioning and sharing of low cost computingresources.
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) FUTURE WORK RELATED TO CLOUD COMPUTING RELATED TO DGVCS’s QUALITY OFSERVICE MODELS: PaaS and SaaS Statistic QoS approach SERVICE (QoS):DEPLOYMENT Public, community and TESTS AND Comprehensive testingMODELS: hybrid VALIDATIONS: and model validationsINTEROPERABILITY: Amazon, Eucalyptus, etc. RELATED TO ADMINISTRATION On demand networking Secure command lineIAAS MODEL: INTERFACES: customization interfaces Compatibility with type I and INITIAL First deployment andHYPERVISORS: other type II hypervisors DEPLOYMENT: VM copy automationSTORAGE: Decoupled and persistent Based on computing, storage,PAY-PER-USE MODEL: backup and networking resources consumption Stronger information securitySECURITY: architecture …
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011)THANKS FOR YOUR ATTENTION!
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) CONTACT INFORMATIONmj.villamizar24@uniandes.edu.co mjvc007@hotmail.com http://twitter.com/mjvc007 http://linkedin.com/in/mariojosevillamizarcano Mario José Villamizar Cano
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011)THE DESIRED SOLUTION Ubuntu with OGS
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011)THE DESIRED SOLUTION Debian with PBS
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011)cmp UnaCloud Serv er Architecture IaaS Administration UNACLOUD SERVER ARCHITECTURE IaaS Customization IaaS Deployment IaaS Traceability IaaS Monitoring Administration Monitoring Physical Physical UNACLOUD SERVER The UnaCloud server architecture INTERFACE LAYER is based on three layers: WI CORE LAYER Layer 1 - Interface Layer CEM PIM VMM PM Layer 2 - Core layer EXTERNAL LAYER SCM <<uses>> Layer 3 - External layer SSM UnaCloud Client Serv ices
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) UNACLOUD SERVER ARCHITECTURE cmp UnaCloud Serv er Architecture IaaS Administration IaaS Customization IaaS Deployment IaaS Traceability IaaS Monitoring Administration Monitoring Physical Physical UNACLOUD SERVER INTERFACE LAYER WILayer 1 - Interface Layer: A Web Interface (WI) used by users (IaaS, Grid and CORE LAYERAdmin) for accessing and consuming the services through authentication and CEM PIMauthorization mechanisms. VMM PM
    • IaaS Mon Phy Phy Iaa Iaa Iaa Iaa Ad The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) UNACLOUD SERVER UNACLOUD SERVER ARCHITECTURE INTERFACE LAYER WI CORE LAYER CEM PIM VMM PMLayer 2 - Core layer: it is responsible for processing all user requirements anddelivering the solutions desired. EXTERNAL LAYER components: It has four mainCustomized Environment Manager (CEM): it prepares user orders SCMPersistence Manager (PM): information databaseVirtual Machine Manager (VMM): it prepares hypervisor orders <<uses>>Physical Infrastructure Manager (PIM): desktops computers of physical labs
    • CORE LAYER The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) CEM PIM VMM PM UNACLOUD SERVER ARCHITECTURE EXTERNAL LAYER SCM <<uses>> SSM UnaCloud Client Serv icesLayer 3 - External layer: it is responsible of providing secure communications withthe UnaCloud clients. It has two main components:Server Communication Manager (SCM): connection, disconnection and messagepassing between UnaCloud Server and UnaCloud ClientsServer Security Manager (SSM): it provides security in communications
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011)cmp UnaCloud Client Architecture UNACLOUD CLIENT ARCHITECTURE IaaS Administration IaaS Customization IaaS Deployment IaaS Monitoring Administration The Client architecture is based on Monitoring Physical Physical two layers: UNACLOUD CLIENT Layer 1 - External Layer EXTERNAL LAYER Layer 2 - Core layer CSM <<uses>> It is a lightweight, highly portable CCM and easy to install client which is installed and run directly on each desktop. CORE LAYER CM MM It is responsible for receiving and LEM HM processing all of UnaCloud Server orders to provide a dynamic and on- demand IaaS model. Operating System Hyperv isor Serv ices Serv ices
    • The Second International Conference on Cloud Computing, GRIDs, and Virtualization (CLOUD COMPUTING 2011) UNACLOUD CLIENT ARCHITECTURE cmp UnaCloud Client Architecture IaaS Administration IaaS Customization IaaS Deployment IaaS Monitoring Administration Monitoring Physical Physical UNACLOUD CLIENT EXTERNAL LAYER CSM <<uses>> CCMLayer 1 – External Layer: it is responsible for managing secure communication CORE LAYERservices on the client side. It has two main components: CM MM LEM HMClient Communication Manager (CCM): message passing with the serverClient Security Manager (CSM): it provides security in communications
    • The Second International Conference on Cloud Computing, GRIDs, <<uses>> and Virtualization (CLOUD COMPUTING 2011) CCM UNACLOUD CLIENT ARCHITECTURE CORE LAYER CM MM LEM HM Operating System Hyperv isor Serv ices Serv icesLayer 2 - Core layer: it is responsible for attending and meeting UnaCloud Serverorders through local operating system and hypervisor invocations. It has for maincomponents:Context Manager (CM): adapt the virtual machine execution contextLocal Executor Manager (LEM): command execution on the local operating systemHypervisor Manager (HM): commands to invocate the local hypervisorMonitoring Manager (MM): monitoring the physical and virtual machine