Your SlideShare is downloading. ×
0
Building a Test/Dev Cloud withApache CloudStackDavid Nalleyke4qqq@apache.org@ke4qqq
#whoami● Sysadmin of a decade● Apache Software Foundation Member● Apache CloudStack Committer & PMC Member● Fedora Project...
Why use cloud?From a dev POV the process normally looks like:● Start new project● File ticket for resources....wait....wai...
Why use cloud?● What IT Operations provides is not what a developer wants.
Get rid of the waiting● Remove the constraints - developers empowered to get thingsdone.● Agility● Enforce automated proce...
What does a dev/test cloud look like?● Self-service - developers can provision their own environments● Usage measurement -...
Self service● Provisioning manually doesnt add value● Can be completely automated● Do they need full control or just pushi...
Self-service● UI?● API?● Some external tool?
API or Commandline?� cloudmonkey> deploy virtualmachineserviceofferingid=d8611d07-acf5-4cd4-a630-5c4d937ef043templateid=08...
Config-mgmt based deployment
{"name": "hadoop_cluster_a","description": "A small hadoop cluster with hbase","version": "1.0","environment": "production...
Use a tool
Usage● Jevons Paradox● Plenty of waste possible as well - will developers alwaysdestroy a machine when they are done with ...
Commodity - Storage● Commodity storage - this is dev/test environment - highperformance, resilient storage isnt needed.● L...
Commodity - Networking● Layer 3 isolation - (aka Security Groups)● VLANs - (not as commodity, but still relatively cheap o...
Commodity Hypervisor● KVM is my personal choice in this space.● Easiest to consume - completely open source
Limiting resources● Limit the number of VMs, snapshots, IP addresses, etc.● Use projects to share resources● This means mo...
Questions?
Resources● http://cloudstack.apache.org● http://cloudstack.jp● #cloudstack on irc.freenode.net● Mailing lists/google group
Building a Dev/Test Cloud with Apache CloudStack
Building a Dev/Test Cloud with Apache CloudStack
Upcoming SlideShare
Loading in...5
×

Building a Dev/Test Cloud with Apache CloudStack

451

Published on

Presentation I gave at LinuxCon/CloudOpen Japan 2013 on building a dev/test cloud with Apache CloudStack

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
451
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
8
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Dev wants to work - IT has process, and tickets, etc.
  • Talk a lot about the general architecture of CloudStack
  • What does self service really mean?
  • IS this really your idea of enabling developers? It might be nice to have, but it shouldn't be the real interface - even with defaults this takes 6 clicks.....which is better than filing a ticket, but doesn't scale.
  • Elasticity is only imagined - look at default limits placed on AWS users.
  • Transcript of "Building a Dev/Test Cloud with Apache CloudStack"

    1. 1. Building a Test/Dev Cloud withApache CloudStackDavid Nalleyke4qqq@apache.org@ke4qqq
    2. 2. #whoami● Sysadmin of a decade● Apache Software Foundation Member● Apache CloudStack Committer & PMC Member● Fedora Project Contributor● Employed by Citrix in the Open Source Business Office
    3. 3. Why use cloud?From a dev POV the process normally looks like:● Start new project● File ticket for resources....wait....wait....wait● Get resources, that arent configured....wait...● Get network access.....get permission....wait● Get things done.
    4. 4. Why use cloud?● What IT Operations provides is not what a developer wants.
    5. 5. Get rid of the waiting● Remove the constraints - developers empowered to get thingsdone.● Agility● Enforce automated process instead of manual ones
    6. 6. What does a dev/test cloud look like?● Self-service - developers can provision their own environments● Usage measurement - we worry about VM sprawl● Isolated networks - must not let dev/test interfere with the realworld.● Commodity - as cheap as practical● May also house production workloads
    7. 7. Self service● Provisioning manually doesnt add value● Can be completely automated● Do they need full control or just pushing pre-configuredenvironments?
    8. 8. Self-service● UI?● API?● Some external tool?
    9. 9. API or Commandline?� cloudmonkey> deploy virtualmachineserviceofferingid=d8611d07-acf5-4cd4-a630-5c4d937ef043templateid=081358ff-2427-44f8-adcc-1bb002fab361zoneid=d06193b2-7980-4ad1-bd8-7b2f2eda63c3curl http://localhost:8096/client/api?command=listUsers
    10. 10. Config-mgmt based deployment
    11. 11. {"name": "hadoop_cluster_a","description": "A small hadoop cluster with hbase","version": "1.0","environment": "production","servers": [{"name": "zookeeper-a, zookeeper-b, zookeeper-c","description": "Zookeeper nodes","template": "rhel-5.6-base","service": "small","port_rules": "2181","run_list": "role[cluster_a], role[zookeeper_server]","actions": [{ "knife_ssh": ["role:zookeeper_server", "sudo chef-client"] }]},{"name": "hadoop-master","description": "Hadoop master node","template": "rhel-5.6-base","service": "large","networks": "app-net, storage-net","port_rules": "50070, 50030, 60010","run_list": "role[cluster_a], role[hadoop_master], role[hbase_master]"},{"name": "hadoop-worker-a hadoop-worker-b hadoop-worker-c","description": "Hadoop worker nodes","template": "rhel-5.6-base","service": "medium","port_rules": "50075, 50060, 60030","run_list": "role[cluster_a], role[hadoop_worker], role[hbase_regionserver]","actions": [{ "knife_ssh": ["role:hadoop_master", "sudo chef-client"] },{ "http_request": "http://${hadoop-master}:50070/index.jsp" }]}}
    12. 12. Use a tool
    13. 13. Usage● Jevons Paradox● Plenty of waste possible as well - will developers alwaysdestroy a machine when they are done with it?● Important to show what projects and groups are consumingresources as well as how they are using those resources
    14. 14. Commodity - Storage● Commodity storage - this is dev/test environment - highperformance, resilient storage isnt needed.● Local storage tends to be the best mix of cheap and performant● No failover, but its dev/test - do you need it?
    15. 15. Commodity - Networking● Layer 3 isolation - (aka Security Groups)● VLANs - (not as commodity, but still relatively cheap on a smallscale, but not at scale)● Virtual routers (provide DHCP, DNS, LB, Firewall, PF, NAT, etc)
    16. 16. Commodity Hypervisor● KVM is my personal choice in this space.● Easiest to consume - completely open source
    17. 17. Limiting resources● Limit the number of VMs, snapshots, IP addresses, etc.● Use projects to share resources● This means most folks will never have problems, but heaviestusers will not be able to interrupt service for others.
    18. 18. Questions?
    19. 19. Resources● http://cloudstack.apache.org● http://cloudstack.jp● #cloudstack on irc.freenode.net● Mailing lists/google group
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×