Recommended
More Related Content
What's hot
What's hot (17)
Similar to Bangalore cloudstack user group
Similar to Bangalore cloudstack user group (20)
More from ShapeBlue
More from ShapeBlue (20)
Recently uploaded
Recently uploaded (20)
Bangalore cloudstack user group
- 1. Stories of a cloudstack cloudbuilder Bangalore CloudStack User group Giles Sirett CEO & Managing Consultant ShapeBlue Giles.sirett@shapeblue.com Twitter: @ShapeBlue www.shapeblue.com
- 2. Who am I ? CEO of ShapeBlue “ShapeBlue are expert builders of public & private clouds. They are the leading global CloudStack / CloudPlatform integrator & consultancy” Involved in Apache Community, ran roadmap session at Collab Chairman of European CloudStack user group Technical enough to be dangerous
- 3. Why ShapeBlue back CloudStack Q4, CY2012 analysis by Qingye Jiang Openstack, Cloudstack, OpenNebula, Eucalyptus
- 4. Enterprises Service Providers
- 5. Our group in Europe Collaborative environment for: all things CloudStack/ CloudPlatform Related tech: CloudPortal BM, CloudBridge, ecosystem products, hypervisors, storage, etc Technical deep-dives, issues & best practice Case studies & ideas To showcase complementary technologies To give a strong voice for feedback to vendor/community No pitching !
- 6. I love the Apache way, but... Too developer focussed Would like to see more users/operators/integrators in the community Maybe two communities could develop? Mailing lists are cumbersome The forums are like wild west towns The mailing lists can be intimidating
- 7. Real world / real scale deployments
- 8. A Simple CloudStack Architecture Horizontal Scale Primary Primary Primary Load Balancer Storage Storage Storage CloudStack CloudStack Host Host Host & MySQL & MySQL Host Host Host Host Host Host Hosts Hosts Hosts Secondary Storage
- 9. Typical Production CloudStack Architecture vCenter MS SQL Horizontal Scale vCenter MS SQL Monitor Backup Pri Pri Pri Pri Pri Pri Host Host DNS DNS Stor Stor Stor Stor Stor Stor Pri Pri Pri Pri Pri Pri Load Balancer Host Host Stor Stor Stor Stor Stor Stor CS Man CS Man MySQL MySQL Host Host Host Host Host Host Host Host Host Host Host Host Host Host Host Host Sec Sec Sec Hosts Hosts Hosts Host Hosts Host Hosts Host Hosts Host Hosts Hosts Hosts Hosts Hosts Hosts Hosts Hosts Hosts Hosts Hosts Hosts Hosts Stor Stor Stor Hosts Hosts Hosts Hosts Hosts Hosts Hosts Hosts Hosts Hosts Hosts Host Host Sec Sec Sec Stor Stor Stor
- 10. How to build an “AWS style” cloud Billing/ LOB CloudPortal Business Manager eCommerce Platform Management systems orchestration API CloudStack API CloudStackOrchestration layer CMP - Orchestration Software CloudBridge 2 CloudBridge 2 (CMP) Corporate centre Data Choice of Hypervisor Hypervisor (VMWare, Xen, KVM, OVM) Others Commodity Networking Storage Storage Servers compute
- 11. The Design Phase Get everyone in the room MUST be end to end
- 12. The Design Phase Know the fine print
- 13. The Design Phase Understand your work loads
- 14. Design Phase Understand your bottlenecks
- 15. Design Phase POC if possible
- 16. Redundancy & Resilience CloudStack Management Server MySQL Servers Virtualised Management Farm
- 17. Automation for deployment Work smarter, not harder
- 18. Automation Tools: Chef, Puppet KickStart, Python CloudStack API Shell scripting CloudMonkey Microsoft Excel
- 19. Example Automation – Host Deployment Deployment server (VM) The script downloads, builds and configures: DHCP PXE (TFTP) HTTP server Script writes the scripts needed to for PXE boot of XenServer & ESXi hosts Script also writes the answer files and post installation scripts to configure XenServer and ESXi hosts
- 20. Automation Utilising the API when building the infrastructure
- 21. Automation – The API What is the API The API is the real engine of CloudStack The web GUI is simply making API calls Port 8096 by default
- 22. Deployment via API Global Settings & Service Offerings Zone Secondary Storage (multiple entries) Physical Networks (multiple entries) Traffic Types – Management, Guest, Public, Storage PODs (multiple entries) Clusters (multiple entries) Hosts (multiple entries) Primary Storage (multiple entries)
- 23. Automation – The API Using the API CloudStack GUI Browser Word, Excel Using Firebug/IE Developer Tools with CloudStack Now Cloudmonkey
- 24. Security Considerations WARNING: no best practice currently, no published assessments API Port Random and internal only System VMs system.vm.random.password Password Changes Track all passwords during build-out Change on a regular basis
- 25. Documentation Dull, boring, tedious, slow – Crucial. Write what you’re going to do Follow what you wrote Update it With redundant servers; follow it again With scripts ‘snapshot’ and start again
- 26. Real world gotchas If you deploy the CS GUI, there’s no password reset ! Cisco firewalls cause large IPv4 DNS lookup delays in a number of Linux OSes by making DNS client wait for IPv6 to timeout (when not being used). ACLs between network layers – quickest to start with all open, then lockdown.
- 27. More gotchas By design, a [CloudStack] XenServer will reboot itself if it loses its primary storage If you’ve deployed CloudStack with multiple primary storage luns attached (to each XenServer), loss of one primary storage lun will still cause a reboot. Edit /opt/xensource/bin/xenheartbeat.sh to stop reboot. When choosing OS Type for a template bear in mind the Hypervisor it will be running on. KVM may not recognise ‘Other - CentOS 64bit’ but be quite happy with ‘Other Linux – 64bit’, XenServer might be the other way round. By default you cannot use ‘local’ http servers (local = ones in the management CIDR) to stage your templates. You must configure ‘secstorage.allowed.internal.sites’ in the global settings.
- 28. Cloudbuilder skills – whats really required? Cloudstack & “the cloud way” Storage & Networking Integration UI Deocumetn Virtualisatio ation n Project Manageme nt
- 29. What's in store for 2013? Giles sees the future
- 30. In 2013, first I see….. REAL enterprise Top > down: adoption Cost / op-ex Agility / speed No longer just AWS (more to follow) Bottom > up Dev-ops Dev agility Barriers disappearing….
- 31. In 2013 I see….. More specifically, enterprise Alignment Technology alignment Process alignment Standards alignment = embracing cloud technologies
- 32. In 2013, second I see….. AWS not winning the enterprise space “Failure happens”? – no thanks I have two types of workload Whatever you tell me, my IT is complex I need a service wrapper Are there any alternatives?
- 33. In 2013, third I see….. the key role of orchestration being understood Cloud orchestration>>> Cloud Management Platform >>> Cloud OS Key technology choice Defines alignment with public cloud
- 34. In 2013, fourth I see….. Orchestration battles being won Orchestration is a KEY component of enterprise adoption Will need to be open CloudStack & Openstack will win and co-exist
- 35. In 2013, fifth I see……….SDN everywhere We *think* this will become mainstream in 2013 Highly relevant in cloud infrastructures Nicira Cloudstack integration complete
- 36. In 2013, fifth Cloud 2011/12 2010/11 I see… ..one aSS big aSS IT SaaS, IaaS, PaaS, STaas, B aaS 2013 ITaaS
- 37. In 2013/14 Cloud 2011/12 I see… 2010/11 ..dropping my aSS IT aSS! SaaS, IaaS, PaaS, Staas, B aaS 2013/14 2013 ITaaS
- 38. Any Questions ?
- 39. SSVM Optimisations Default settings are often insufficient secstorage.capacity.standby secstorage.session.max secstorage.service.offering secstorage.vm.mtu.size
- 41. Other Automation PXE Deployment of Hosts Scripted build of CentOS DHCP/PXE/HTTP Server PXE Deploy XenServer, ESXi, KVM Virtualised Management VMs Deployment via VM Templates Cloning at key stages ‘Copy and Paste’ of tried and tested commands
- 42. Avalon Merlin…
- 43. CloudStack Collab - LV 300 Delegates Developers, operators & integrators <30 from Citrix 70 sessions MOST sessions on DIYCloudComputing Channel on Youtube
- 44. CloudStack Collab LV Main themes Storage PaaS players SDN players Real world stories Apache / community stuff A little fun…
- 45. Next speaker.. Sebastien Goasguen Devcloud & Cloudmonkey
- 46. In 2013, first I see….. REAL enterprise Top > down: adoption Cost / op-ex Agility / speed No longer just AWS (more to follow) Bottom > up Dev-ops Dev agility Barriers disappearing….
- 47. In 2013 I see….. More specifically, enterprise Alignment Technology alignment Process alignment Standards alignment = embracing cloud technologies
- 48. In 2013, second I see….. AWS not winning the enterprise space “Failure happens”? – no thanks I have two types of workload Whatever you tell me, my IT is complex I need a service wrapper Are there any alternatives?
- 49. In 2013, third I see….. the key role of orchestration being understood Cloud orchestration>>> Cloud Management Platform >>> Cloud OS Key technology choice Defines alignment with public cloud
- 50. In 2013, fourth I see….. Orchestration battles being won Orchestration is a KEY component of enterprise adoption Will need to be open CloudStack & Openstack will win and co-exist
- 51. In 2013, fifth Cloud 2011/12 2010/11 I see… ..one aSS big aSS IT SaaS, IaaS, PaaS, STaas, B aaS 2013 ITaaS
- 52. In 2013/14 Cloud 2011/12 I see… 2010/11 ..dropping my aSS IT aSS! SaaS, IaaS, PaaS, Staas, B aaS 2013/14 2013 ITaaS
- 53. Questions? Giles.Sirett@shapeblue.com @ShapeBlue
Editor's Notes
- End of day So we’ll start gentlyHopefully something for everyonePlease bear with me if seems obvious to you.Bear with my english accent and phrases/terminologyBasics and more advanced ideasPaul AngusEngineering and Science degreesCloudStack 2.13
- Simple Architecture exampleFollowed by a Not so Simple exampleHorizontal Scale, but still a long way from a Production System
- Multiple CloudStack Servers – same or remote locationsMySQL Servers – Master Slave, or ClusteredSecondary Storage – Lots and Lots of it, at least 2x Zones Primary CapacityXen, KVM Clusters + Pri Storage – 8TB max so Multiple VolumesvSphere Clusters with vCenterBare Metal or Local Storage HyperVisors for High I/O workloadsHorizontal Scale
- Storage, networking, overall architects technical and managerialEverything is interconnected and feels like everything relies on everything elseSomeone chipping in can be invaluable – particularly if they have past experience.
- One that gets everyone:Switchsupports 4096 VLANs - but not at the same time.Gotchas…[add more]
- Private clouds – you have your current usage to judgePublic clouds harder to predict – is guided by offerings.
- Performance and / or capacityStorageNetworkNetwork (to storage) is often the limiting factor as jump to 10 Gbe is large(Although LACP in XenServer 6.1 and ESXi 5.1 will help to mitigate this)Not much point being able to run VMs per host if only 1Gb/s link Not much point to 256GB RAM with a single quad core processor unless a specific workload.
- Lack of reference architectures currently
- I’ll look at the major CloudStack management elements – CSMan MySQLAnd then look at considerations if you’ve virtualised your management farm
- How do we achieve that…>
- Automation can come in multiple formsChef & Puppet – enterprise grade automation – works for in-house use (required infrastructure makes it less useful for SIs)KickStart and Python – enables to learn one language and stick to it, requires the interpreter to be installed, but Python is Shell scripts don’t have to be fancy – have to learn awk & sed – have to learn the different languages.API calls
- Write configuration file. Conscious decision to limit the number of files required.Self contained (requires hypervisor installation files)Look at some elements of the file >
- 19-20
- 17-18
- Take your pickOnly way to remember what you did,only way for others to replicateRun scripts from scratch impossible to update code and separately make changes
- Storage, networking, overall architects technical and managerialEverything is interconnected and feels like everything relies on everything elseSomeone chipping in can be invaluable – particularly if they have past experience.
- 16
- 21-22
- 23-25
- Storage, networking, overall architects technical and managerialEverything is interconnected and feels like everything relies on everything elseSomeone chipping in can be invaluable – particularly if they have past experience.