Overview: Building Open Source Cloud Computing Environments

C R A S H CO U RS E O NO P E N S O U RC E C LO U D CO M P U T I N G Mark R. Hinkle Director, Cloud Computing Community CloudStack.org

AG E N DA1. Introduction2. Quick Cloud Computing Overview3. Open Source Building Blocks for Cloud Computing4. Open Source Tools for Cloud Management5. Questions

% W H OA M I•••••••••

Q U I C K C LO U D CO M P U T I N G OV E RV I E W :O R T H E O B L I G ATO RY “ W H AT I S T H EC LO U D ? ” S L I D ES

F I V E C H A R AC T E R I ST I C S O F C LO U D S

C LO U D CO M P U T I N G S E RV I C E M O D E L S USER CLOUD a.k.a. SOFTWARE AS A SERVICE Single application, multi-tenancy, network-based, one-to-many delivery of applications, all users have same access to features. Examples: Salesforce.com, Google Docs, Red Hat Network/RHEL DEVELOPMENT CLOUD a.k.a. PLATFORM-AS-A-SERVICE Application developer model, Application deployed to an elastic service that autoscales, low administrative overhead. No concept of virtual machines or operating system. Code it and deploy it. Examples: Google AppEngine, Windows Azure, Rackspace Site, Red Hat Makara SYSTEMS CLOUD a.k.a INFRASTRUCTURE-AS-A-SERVICE Servers and storage are made available in a scalable way over a network. Examples: EC2,Rackspace CloudFiles, OpenStack, CloudStack, Eucalyptus, Ubuntu Enterprise Cloud, OpenNebula

D E P LOY M E N T M O D E L SP U B L I C , P R I VAT E & H Y B R I D C LO U D S

C LO U D ST I L L R EQ U I R ESA RC H I T EC T U R A L D ES I G N Cloud Computing isn’t a magical solution apps need to be able to scale out Design your architecture with the end in mind Make your infrastructure easily replicable

B U I L D I N G CO M P U T E C LO U D SW I T H O P E N S O U RC E S O F T WA R E

W H Y O P E N S O U RC E ? User-Driven Solutions to Real Problems Lower barrier to participation Larger user base, users helping users Aggressive release cycles stay current with the state-of- the-art Open data, Open standards, Open APIs

O P E N V I RT UA L M AC H I N E FO R M AT SOpen Virtualization Format (OVF) is an openstandard for packaging and distributing virtualappliances or more generally software to be run invirtual machines. Formats for hypervisors/cloud technologies: • Amazon - AMI • KVM – QCOW2 • VMware – VMDK • Xen – IMG • VHD – Virtual Hard Disk - Hyper-V

S O U RC I N G O S SV M S A N D C LO U D A P P L I A N C ES

O P E N S O U RC E H Y P E RV I S O RSOpen Source Xen, Xen Cloud Platform (XCP) KVM – Kernel-based Virtualization VirtualBox* - Oracle supported Virtualization Solutions OpenVZ* - Container-based, Similar to Solaris Containers or BSD Zones LXC – User Space chrooted installsProprietary VMware Citrix Xenserver Microsoft Hyper-V OracleVM (Based on OS Xen)

O P E N S O U RC E CO M P U T E C LO U D S Year Started License Hypervisors Supported 2008 GPL Xenserver, Xen Cloud Platform, KVM, VMware 2006 GPL Xen, KVM, VMware 2010 Apache VMware ESX and ESXi, (Developed by Microsoft Hyper-V, Xen, NASA by Anso KVM and Virtual Box Labs previously)

SCALE-UP OR SCALE-OUT Vertical Scaling (Scale-Up) – Allocate additional resources to VMs, requires a reboot, no need for distributed app logic, single-point of OS failure Horizontal Scaling (Scale-Out) – Application needs logic to work in distributed fashion (e.g. HA-Proxy and Apache, Hadoop)

O P E N S O U RC EP L AT FO R M - A S - A - S E RV I C E Year Started Sponsors Hypervisors Supported 2011 VMware Spring, Rails, Node.js 2011 Joyent Node.js 2011 Red Hat Express – Ruby, Php and Python Flex – Jboss, Java EE6 2010 WSO2 Jboss, Java EE6

O P E N S O U RC EC LO U D CO M P U T I N G STO R AG E GlusterFS – Scale Out NAS system aggregating storage over Ethernet or Infiniband Ceph – Distributed file storage system developed by DreamHost OpenStack Object Storage (SWIFT) – Long-term storage object storage system Sheepdog – Distributed storage for KVM hypervisors NFS – Old standby, tried and true, not designed for cloud scale or performance

C LO U D A P I S A R E N ’ T C R EAT E D EQ UA LO P E N S O U RC E A B ST R AC T I O N S jclouds libcloud deltacloud fog

P R I VAT E C LO U D A RC H I T EC T U R E API Abstractions

M A N AG I N G C LO U D S W I T HO P E N S O U RC E TO O L S

AU TO M AT I O N U N LO C KST H E P OT E N T I A L O F T H E C LO U D••••

T H E M Y T H O F T H E N I N ESAvailability % Downtime per Downtime per Downtime per Year Month Week99.9% (three nines) 8.76 hours 43.2 minutes 10.1 minutes99.95% 4.38 hours 21.56 minutes 5.04 minutes99.99% (four nines) 52.6 minutes 4.32 minutes 1.01 minutes99.999% (five nines) 5.26 minutes 25.9 seconds 6.05 seconds99.9999% (six nines) 31.5 seconds 2.59 seconds .0605 seconds

4 T Y P ES O F M A N AG E M E N T TO O L S Provisioning Installation of operating systems and other softwareConfiguration ManagementSets the parameters for servers, can specifyinstallation parameters Orchestration/Automation Automate tasks across systemsMonitoringRecords errors and health of IT infrastructure

M A N AG E M E N T TO O LC H A I N S Monitoring Patching and Provisioning Configuration

O P E N S O U RC EP ROV I S I O N I N G TO O L S Year Started License Installation TargetsKickstart ? GPL Most .dep and RPM based Linux distrosCobbler (Plus koan 2007 GPL Red Hat, OpenSUSEfor PXE boot of Fedora, Debian,VMs) UbuntuSpacewalk 2008 GPL Fedora, CentosCrowbar 2011 Apache (Bare metal provisioning)

OPEN SOURCEC O N F I G U R AT I O N M A N A G E M E N T TO O L S Year Started Language License Client/Server Cfengine 1993 C Apache Yes Chef 2009 Ruby Apache Chef Solo – No Chef Server - Yes Puppet 2004 Ruby GPL yes Salt 2011 Python Apache yes

O P E N S O U RC EM O N I TO R I N G TO O L S License Type of Monitoring Collection MethodsCacti / RRDTool GPL Performance SNMP, syslogNagios GPL Availability SNMP,TCP, ICMP, IPMI, syslogZabbix GPL Availability/ SNMP, TCP/ICMP, Performance and IPMI, Synthetic more TransactionsZenoss GPL Availability, SNMP, ICMP, SSH, Performance, Event syslog, WMI Management

O P E N S O U RC EAU TO M AT I O N / O RC H EST R AT I O N TO O L S Year Started Language License Client/Server Support OrganizationCapistrano 2006 Ruby MIT Yes NoneRunDeck 2010 Java Apache Yes DTO SolutionsFunc 2007 Python GPL Yes Fedora ProjectMCollective 2009 Ruby Apache Yes PuppetLabsSalt 2011 Python Apache Yes SaltStack Inc. ?

CO N C E P T UA L AU TO M AT E D TO O LC H A I NGenerate Images BootStrapped Image Provision Configuration SUSE Studio CloudStack Cobbler Puppet BoxGrinder OpenStack Kickstart Chef Monitoring Nagios Start/Stop Services Zenoss RunDeck Cacti Capistrano MCollective

Questions? SLIDES CAN BE VIEWED AND DOWNLOADED AT: H T T P : / / W W W. S L I D E S H A R E . N E T/ S O C I A L I Z E D S O F T WA R E /

CO N TAC T M E

A D D I T I O N A L R ES O U RC ES Devops Toolchains Group DevOps Wikipedia Page Open Cloud Initiative NIST Cloud Computing Platform Open Virtualization Format Specs Clouderati Twitter Account Planet DevOps

C R A S H CO U RS E I N O P E N S O U RC E C LO U D CO M P U T I N GB Y M A R K R . H I N K L E I S L I C E N S E D U N D E R A C R E AT I V E C O M M O N S AT T R I B U T I O N - S H A R E A L I K E 3 . 0 U N I T E D S TAT E S L I C E N S E .

http://cloudstack.org	24
http://www.cloudstack.org	20
http://storify.com	1

Overview: Building Open Source Cloud Computing Environments

by Mark Hinkle on Feb 10, 2012

Accessibility

Categories

Upload Details

Usage Rights

3 Embeds 45

Statistics

Overview: Building Open Source Cloud Computing Environments Presentation Transcript