This document discusses how to build an open source cloud using tools like OpenStack. It recommends a three step process: 1) Build a resource pool with virtualization and automation tools. 2) Automate across domains like networking, storage, and service management. 3) Integrate service management by automating provisioning, configuration, monitoring, and deprovisioning. It provides examples of tools that can be used at each step like OpenStack, Chef, Puppet, Nagios, and RunDeck. It also discusses how to set up billing and a services catalog to offer resources via a portal. The overall goal is to build a scalable, automated open source cloud using commodity hardware.

1. Make Your Cloud
Raphaël Ferreira - CoFounder
@ enovance
September 21, 2011
1

2. 2

3. Best User
Cloud Services Managed Services OpenSource
Experience
Dedicated Platforms 24x7x365 Managed High Performance Open Source
Private Cloud ProActive Run Web Optimization Web oriented
Single Servers Performance Run Acceleration Infrastructures
Hybrid Content Caching
Cloud Platforms Advanced Services High Availability Open Cloud
Cloud Servers Multi-Cloud Mngt Clusters Cloud Mngt
Cloud Storage Infrastructures Design Multi-homing Automation
AppStore NoSQL
Make Your Cloud Labs
http://testerprogram.enovance.com www.enovance.com
3

4. Cloud ?
IaaS
Public Cloud
PaaS SaaS
Private Cloud
Cloud Burst
Hybrid Cloud
Don’t care - we talk about Services
4

5. Cloud is about : On-Demand Self Service
Broad Network Access
Ressource Pooling
Rapid Elasticity
Measured Service
5

6. Destination ?
Cloud !
«If you don’t know where you’re
going, any road will get you there.»
Lewis Caroll
«Companies that took a disciplined approach to
adopting cloud computing reduced costs by an
average of 18% and data center power
consumption by 16%.
Companies that adopted cloud computing
haphazardly increased IT costs by 2-3%.»
Aberdeen Group
6

7. Define your objectives
Working on real uses cases !
Rented services eCommerce Automation
Multi-tenancy Information system Dedicated security
Self-service Big Data Custom design
... Dev/Test ...
Scalable website
Gaming
Legacy apps
Public Private
Hybrid
7

8. Cloud is about business
Stop thinking about technology
How can 10 days to 5 minutes
change how you innovate ?
What happens when you can get 10 servers to test a new idea
and your total costs is 500€ ?
If you don’t have to wait, will you get more done ?
8

9. Cost basis of infrastructure Cloud
Exercise: What is the cost basis of infrastructure cloud hardware?
Building a business case :
• Need margin for: technical operations, HR, administration costs
• You can sell a 10 GB RAM virtual machine for 40-cents an hour (288 € / month)
• You can buy 40 GB RAM machines
• The practical life of the machines is 5 years
How much can you spend on hardware/software to build the infrastructure to give a reasonable
margin 70% to the rest of the business?
➡ 288€ / month x 4 VM per server x 60 months x 30% = 20 736 € for machine, software
and tenancy costs (rack, power, cooling....)
9

10. Cloud Management VM Automation, Physical Provisioning, APIs, Self-service portal, Monitoring...
But most of the cloud effort is hidden
ITIL / ITSM Service Catalog, Configuration management, Service level management
Network
Vlan planning, Capacity planning, Manageability
Engineering
Storage Backup & Archive, Disaster recovery, Access control, Policy management
Support Services Help Desk operations, Diagnostic tools
Financials Policies CapEx vs OpEx, Shared services, Entry/Exit, IT Chargeback, ROI
10

11. You need to be competitive
You need to be agile
You need to build an Open Source Cloud
11

12. Why Open Source ?
• Typically user-driven solutions to real problems
• Larger user base, users helping users
• Lower barrier to participation
• Aggressive release cycles can stay current with the state-of-the-art
• Try before you “buy”, no brochureware, no “PowerPoint software
• Open data, Open standards, Open APIs
12

13. Financial Approach
Remember : our business case
• You want to sell a 10 Gb ram virtual machine for 40-cent an hour (288 € / month)
• You target a margin of 70% for the rest of the costs (operations, HR, dev, administration...)
• For five years your budget per machine is 20 736 € for machine, software and tenancy costs
• Annual budget per server = 4147 €
• Price of the machine = 6000 € / 5 = 1200 €
• Rack / Network= 1500 €
• Rest 1447 € for all the software & cloud stack
13

14. The 3 Steps
14

15. Forget what you know about IT admin
Not same services as traditional DC / Hosting
Networking different
Storage different
Design for Failure
Reliance on Configuration Management
1 admin for hundreds physical machines vs. 1 admin for thousands of VMs
15

16. Step 1 : Build a ressource pool with
virtualization and management
Unified Automation
Applications Provision
Scripts
Databases Schedule Configure
Templates
Virtualization Manual Patch
OS Troubleshoot
Hardware Deploy
16

17. Step 2 typical scenario accross domains
2. automate across domains –
: Automate
Typical Scenario
SERVICE DELIVERED
2 REQUIRED FORMS 11
SERVICE 1 BUSINESS
MANAGER NEW SERVICE REQUEST MANAGER
CUSTOMER
3 REQUEST FOR 10 REQUEST FULFILLED
IT RESOURCES AND APPROVED
REQUEST PROVISION
9
FOR SUPPORT 4 APPLICATIONS
IT
OPERATIONS
APPLICATIONS
REQUEST FOR
7 5 ACCESS
USER ID CREATED
DATABASE 8 ROLES ESTABLISHED ACCESS APPROVAL 6
SECURITY
17

18. Step 2–:automated scenario
2. automate across domains
Automate accross domains
Automated Scenario
BUSINESS
MANAGER
CUSTOMER
18

19. Specify OS & Select Reserve
Applications Resources Systems
Step 3 : Integrate Service Management
Specify OS &
Select Ressources Reserve System
Applications
Place Order /
Reserve
Automatically
Configure
Requirements Optimally
Cost utiliized
assets
Time to value Deprovision
19

20. How to Start ?
The Tools
20

21. Openstack part of the solution
Ecosystem
Billing Portal
Authentification
Installer Front-End
Network Ops
Hardware
Datacenter
21

22. OpenStack Compute: Commodity Hardware
Openstack Compute
Build your cloud with commodity
hardware
Multiple hypervisors support
Provides APIs & Portal
Several network configurations
Monday, April 11, 2011
- Image: Keith in the KT Data Center
- There are other drop-in solutions for infrastructure clouds from Cisco/EMC/VMWare.
not one of them.
- It's designed around off-the-shelf, lower-price point components
- We're22using Arista for our networking layer.
- Nasa uses off-the-shelf AoE hardware for storage.

23. Cloud Storage
• VM-Backing Storage
• Block Storage
Cloud Storage
• Object Storage
VM Backing Storage
Block Storage
Object Storage
Monday, April 11, 2011
- Image: Hitachi 2TB desktop drive we use in our Object Storage Cluster
23

24. VM Backing Storage
• 'laying-down' OS Image
• A place for the running VM
• Local Disk vs SAN
• Ephemeral vs persistent
24

25. Open Stack Object Storage
OpenStack Object Storage
API
Data Storage
25

26. OpenStack Object Storage
216 To Utiles
75 000 €
5 5 Object Stores
Object Stores Newish Xeon
5 Object Stores 48 Go of ram
5 Object Stores 36 x 2 To Sata - No Raid
5 Object Stores
4 Proxy Servers Newish Xeon
24 Go of ram
10 Gbps Ethernet
26

27. OpenStack Object Storage
Networking
Aggregation Aggregation
Access Access
7kW
10GbE 10GbE
Access Access
1GbE Switch Switch 1GbE
Monday, April 11, 2011
The Networking
We took a 2-tier approach.
It starts out with a pair of redundant aggregation switches.
A single switch would be a single point of failure.
11 All requests go through the “Access Layer” that connect directly to the aggregation switches
Center at 10GbE.
- The access layer contains proxy servers, authentication, load balancers, etc.
e 1st things to note is power density -or- space requirements of the system
cal things tend to draw a lot of power. 27 Each rack has a single as we plan on connected via handle single rack failures.layer.
single switch that is 10GbE to the aggregation
- We went with being able to

28. ToolChain (n) :
Monitoring
A set of tools where the output of
one tool becomes the input of
another tool Patching and
Provisioning
Con guration
28

29. Provisioning Tools Chef, PXE, Crowbar
Configuration
Cfengine, Chef, Puppet
Management
Monitoring Tools Nagios, Zabbix, Zenoss (automate agent instal)
Automation /
Capistrano, RunDeck, MCollective (replace rather than repair)
Orchestration
29

30. Example of ToolChain
Launch BootStrap
Image
Monitor Provisioning
(Nagios, Zenoss) (Cobbler, Spacewalk)
Start/Stop Services
Con guration
(RunDeck,
(Puppet, Chef )
Capistrano)
30

31. Services Catalog & Apps
Infrastructures ressources PaaS ressources End-Users ressources
VM Tee-Shirts Building Apps SaaS
Storage Types Publish Apps
Bandwith Maintain Apps
Service Portal - AppStore - Cloud Library
31

32. What about billing ?
Define your criteria :
Ram hours
Storage usage
Request
Collect and store metrics
32

33. Q&R
http://www.enovance.com Raphaël Ferreira
http://testerprogram.enovance.com T./ +33 1 49 70 99 72
http://twitter.com/enovance M./ r.ferreira@enovance.com
33