Building a Dev/Test cloud withApache CloudStackDavid NalleyPMC Member Apache CloudStackMember, Apache Software Foundationk...
#whoami• Apache Software Foundation Member• Apache CloudStack PMC Member• Recovering Sysadmin• Fedora Project Contributor•...
Why use cloud?From a dev point of view the process looks like:• Start new project• File ticket for resources....wait....wa...
Why use cloud?• What IT Ops provides is not what developers want.
Get rid of the waiting!●Remove constraints - developers empowered to getthings done.●Agility●Enforce automated process ins...
What does a dev/test cloud look like?●Self-service - developers can provision their ownenvironments●Usage measurement - we...
Self service●Provisioning manually doesnt add value●Can be completely automated●Do they need full control or just pushing ...
Self service●UI●API●Some external tool
API or Command-line� cloudmonkey> deploy virtualmachineserviceofferingid=d8611d07-acf5-4cd4-a630-5c4d937ef043templateid=08...
Config Management deployment
{"name": "hadoop_cluster_a","description": "A small hadoop cluster with hbase","version": "1.0","environment": "production...
Use a tool
Usage● Jevons Paradox● Plenty of waste possible as well - will developers alwaysdestroy a machine when they are done with ...
Commodity Storage● Commodity storage - this is dev/test environment - highperformance, resilient storage isnt needed.● Loc...
Commodity Networking● Layer 3 isolation - (aka Security Groups)● VLANs - (not as commodity, but still relatively cheap ona...
Commodity Hypervisor● KVM is my personal choice in this space.● Easiest to consume - completely open source
Limiting Resources● Limit the number of VMs, snapshots, IP addresses, etc.● Use projects to share resources● This means mo...
Questions
Resources●http://cloudstack.apache.org●#cloudstack on irc.freenode.net●http://cloudstack.apache.org/docs
Building a Dev/Test Cloud with Apache CloudStack
Upcoming SlideShare
Loading in...5
×

Building a Dev/Test Cloud with Apache CloudStack

448

Published on

Slides from my talk at the South East Linux Fest about building an IaaS dev/test cloud with Apache CloudStack

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
448
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Building a Dev/Test Cloud with Apache CloudStack"

  1. 1. Building a Dev/Test cloud withApache CloudStackDavid NalleyPMC Member Apache CloudStackMember, Apache Software Foundationke4qqq@apache.orgTwitter: @ke4qqq
  2. 2. #whoami• Apache Software Foundation Member• Apache CloudStack PMC Member• Recovering Sysadmin• Fedora Project Contributor• Zenoss contributor• Employed by Citrix in the Open Source Business Office
  3. 3. Why use cloud?From a dev point of view the process looks like:• Start new project• File ticket for resources....wait....wait....wait• Get resources, that arent configured....wait...• Get network access.....get permission....wait• Get things done.
  4. 4. Why use cloud?• What IT Ops provides is not what developers want.
  5. 5. Get rid of the waiting!●Remove constraints - developers empowered to getthings done.●Agility●Enforce automated process instead of manual ones
  6. 6. What does a dev/test cloud look like?●Self-service - developers can provision their ownenvironments●Usage measurement - we worry about VM sprawl●Isolated networks - must not let dev/test interfere withthe real world.●Commodity - as cheap as practical●May also house production workloads
  7. 7. Self service●Provisioning manually doesnt add value●Can be completely automated●Do they need full control or just pushing pre-configuredenvironments?
  8. 8. Self service●UI●API●Some external tool
  9. 9. API or Command-line� cloudmonkey> deploy virtualmachineserviceofferingid=d8611d07-acf5-4cd4-a630-5c4d937ef043templateid=081358ff-2427-44f8-adcc-1bb002fab361zoneid=d06193b2-7980-4ad1-bd8-7b2f2eda63c3curl http://localhost:8096/client/api?command=listUsers
  10. 10. Config Management deployment
  11. 11. {"name": "hadoop_cluster_a","description": "A small hadoop cluster with hbase","version": "1.0","environment": "production","servers": [{"name": "zookeeper-a, zookeeper-b, zookeeper-c","description": "Zookeeper nodes","template": "rhel-5.6-base","service": "small","port_rules": "2181","run_list": "role[cluster_a], role[zookeeper_server]","actions": [{ "knife_ssh": ["role:zookeeper_server", "sudo chef-client"] }]},{"name": "hadoop-master","description": "Hadoop master node","template": "rhel-5.6-base","service": "large","networks": "app-net, storage-net","port_rules": "50070, 50030, 60010","run_list": "role[cluster_a], role[hadoop_master], role[hbase_master]"},{"name": "hadoop-worker-a hadoop-worker-b hadoop-worker-c","description": "Hadoop worker nodes","template": "rhel-5.6-base","service": "medium","port_rules": "50075, 50060, 60030","run_list": "role[cluster_a], role[hadoop_worker], role[hbase_regionserver]","actions": [{ "knife_ssh": ["role:hadoop_master", "sudo chef-client"] },{ "http_request": "http://${hadoop-master}:50070/index.jsp" }]}}
  12. 12. Use a tool
  13. 13. Usage● Jevons Paradox● Plenty of waste possible as well - will developers alwaysdestroy a machine when they are done with it?● Important to show what projects and groups areconsuming resources as well as how they are usingthose resources
  14. 14. Commodity Storage● Commodity storage - this is dev/test environment - highperformance, resilient storage isnt needed.● Local storage tends to be the best mix of cheap andperformant● No failover, but its dev/test - do you need it?
  15. 15. Commodity Networking● Layer 3 isolation - (aka Security Groups)● VLANs - (not as commodity, but still relatively cheap ona small scale, but not at a large scale)● Virtual routers (provide DHCP, DNS, LB, Firewall, PF,NAT, etc)
  16. 16. Commodity Hypervisor● KVM is my personal choice in this space.● Easiest to consume - completely open source
  17. 17. Limiting Resources● Limit the number of VMs, snapshots, IP addresses, etc.● Use projects to share resources● This means most folks will never have problems, butheaviest users will not be able to interrupt service forothers.
  18. 18. Questions
  19. 19. Resources●http://cloudstack.apache.org●#cloudstack on irc.freenode.net●http://cloudstack.apache.org/docs

×