CloudStack Background• A proven IaaS Cloud Platform – Developed since 2008 by Cloud.com – Cloud.com development center in Hyderabad since 2009 – Cloud.com acquired by Citrix in 2011 – Donated to the Apache Software Foundation (ASF) in April 2012, where it is now an Incubator project – First ASF community release in October 2012 – Powering some of the world’s largest clouds today
Enterprises are embracing CloudService Providers Web 2.0 Enterprise
I’ve already virtualized my data center,why do I need a cloud?
How is cloud really different fromserver virtualization?
Virtualization does not make a cloud Server Virtualization++ CloudBuilt for traditional enterprise Designed around big data,apps & client-server compute massive scale & next-gen apps •Enterprise arch for 100s of hosts • Cloud arch for 1000s of hosts •Scale-up (pool-based resourcing) • Scale-out (horizontal resourcing) •IT management-centric • Autonomic management •1 administrator for Dozens of servers • 1 administrator for 1,000’s of servers •Apps assume reliability • Apps assume failure •Proprietary vendor stack • Open, value-added stack
Essentials of Cloud • On-Demand and Self Serve • Resource pooling, Multi-tenancy • Massive Scale • Rapid Elasticity • APIs and Extreme Automation • Total Homogeneous
How did Amazon build its Cloud? Amazon eCommerce Platform Amazon eCommerce Platform AWS API (EC2, S3, …) AWS API (EC2, S3, …) Amazon Proprietary Orchestration Software Amazon Proprietary Orchestration Software Open Source Xen Hypervisor Open Source Xen Hypervisor Networking Networking Commodity Commodity Commodity Commodity (NetScaler) (NetScaler) Servers Servers Storage Storage
Apache CloudStack Portal and End User Experience Amazon eCommerce Platform Portal and End User Experience Amazon eCommerce Platform AWS API (EC2, S3, …) AWS Cloud APIS3, …) API (EC2, Cloud APIAmazon Proprietary CloudStack SoftwareAmazon Proprietary Orchestration Software Apache CloudStack Apache Orchestration vSphere XenServerXen Hypervisor Open Source KVM OVM Hyper-V vSphere XenServerXen Hypervisor Open Source KVM OVM Hyper-VAny NetworkingAny Networking Any Servers Any Servers Any Storage Any Storage
Key Highlights• Broad Hypervisor support —XenServer, KVM, VMware, OracleVM. Baremetal support.• Scalable architecture —Support thousands of hosts and VMs• Flexible and extensible architecture —Plugins and Adapters• Rich networking capability • Firewall, LoadB, VPN, NAT, DNS, DHCP, VLAN/L3 isolation, physical devices• Storage options • Local, Shared, Snapshots and backupᵒ Fine-Grained Service Offerings (compute, network, storage, HA, affinity)• Choice of interfaces — RESTful API, Web UI, command line, AWS Compatibility
Looking Closer at an IaaS Cloud built on CloudStack
Multiple levels of Scaling Availability Zone VMOps VMOps Pod VMOps CloudStack Pod CloudStack Pod CloudStack Pod Pod CloudStack Pod Pod
Cloud Scalability Must Span Datacenters CloudStack Management Cluster San Jose Barcelona Miami Private Dehli Tokyo Private Rio
CloudStack Management Server Cluster MySQL Internet Router Availability Zone Load Balancer L3 Core SwitchTop of Rack Switch Servers … … … … … Pod 1 Pod 2 Pod 3 Pod N
Object store is critical for Amazon-style cloud Availability Zone 1 Storage Cloud ELB/GSLB ? Users Availability Zone 2
Amazon-style workload Amazon-Style Availability Zone Software Defined Networks Software Defined Networks Hypervisor (e.g., Security Groups, EIP, ELB,...) (e.g., Security Groups, EIP, ELB,...) Server Server Server Server Server Server Server Server Racks Racks Racks Racks Storage Racks Racks Racks Racks Server Server Server Server Server Server Server Server Racks Racks Racks Racks Racks Racks Racks Racks Networking Server Server Server Server Server Server Server Server Racks Racks Racks Racks Racks Racks Racks Racks Network Services Elastic Block Storage Elastic Block Storage Multi-tier Apps
Amazon-Style Cloud Amazon-Style Availability Zone CloudStack Mgmt CloudStack Mgmt vCloud Director Software Defined Networks vCloud Director Software Defined Networks Server Server (e.g., Security Groups, VPC,...) (e.g., Security Groups, VPC,...) Server Server Server Server vSphere Server vSphere Server Server Server Racks Racks Racks Racks Racks Racks Racks Racks Enterprise Networking (e.g., VLAN) Enterprise Networking (e.g., VLAN) Server Server Server Server Server Server Server ServerAvailabilityAvailability Availability Availability Availability Availability Racks Racks Racks Racks Zone Racks Racks Racks Racks Zone Zone Zone Zone Zone ESXi ESXi ESXi ESXi ESXi ESXi Server Cluster Server Server Cluster Server Server Cluster Server Cluster Server Cluster Server Cluster Racks Racks Racks Racks Racks Racks Racks Racks Object Storage Object Storage Elastic BlockStorage (e.g., SAN) Enterprise Storage Elastic BlockStorage (e.g., SAN) Enterprise Storage
Architecture to embrace Server Virtualization Workloads Amazon-Style Cloud Server Virtualization++ CloudStack Mgmt CloudStack Mgmt Server Server Server Virtualization Availability Zone vSphere vSphere Enterprise Networking (e.g., VLAN) Enterprise Networking (e.g., VLAN)AvailabilityAvailability Availability Availability Availability Availability Zone Zone Zone Zone Zone Zone ESXi ESXi ESXi ESXi ESXi ESXi Cluster Cluster Cluster Cluster Cluster Cluster Object Storage Object Storage Enterprise Storage (e.g., SAN) Enterprise Storage (e.g., SAN)
Hadoop and CloudStack
Common interest•Apache Foundation project•Written in Java•Runs on Linux, Mac OS/X, Windows, and Solaris•Cloud-scale workloads•Optimized for commodity hardware•Hadoop Core includes: ᵒ HDFS - Distributed file system derived from Google File System ᵒ Map/Reduce – Distributed compute engine
Opportunities•HDFS as Object Store solution for CloudStack cloud•Hadoop on CloudStack • Implement services similar to Amazon’s Elastic MapReduce (EMR) • Big Data workload readily moved to IaaS clouds•CloudStack’s baremetal provisioning capabilities to build highperformance Hadoop clusters•Feedback?
ASF Community Status• In Incubation since April 2012• PPMC and Mentors setup in April• Code migrated to Apache git• Migration underway from cloudstack.org: – Jira (Bugs), wiki, forums• New committers, partners, developers every week• Apache CloudStack 4.0: First ASF community release coming in October 2012
Join the community!• Why not? ᵒ Interested in learning the coolest technologies shaping the next decade. ᵒ Being part of a young, passionate community working at ground breaking speed. ᵒ Interested in solving cool real-world problems. ᵒ For the love of open source. ᵒ If you want to rise and shine.• Still don’t believe us – Let the numbers speak ᵒ 30k active community members in 8 months, ~100 IRC users ᵒ Exponentially growing dev/user community discussions ᵒ Apache is the industry standard for 10+ years in OSS foundations, 100+ projects, 800 developers ᵒ Well known projects: Apache webserver, Tomcat, Hadoop, Cassandra
So lets get started ….• Check us out @ ᵒ cwiki.apache.org/confluence/display/CLOUDSTACK/Index ᵒ http://cloudstack.org• IRC: #CloudStack on irc.freenode.net• Forums: http://cloudstack.org/forum/• Subscribe to Mailing Lists @ firstname.lastname@example.org email@example.com• Join CloudStack Hyderabad Meetup Group @ http://www.meetup.com/CloudStack-Hyderabad-Group/