Stories of a cloudstack     cloudbuilder  Bangalore CloudStack User group                 Giles Sirett  CEO & Managing Con...
Who am I ?CEO of ShapeBlue  “ShapeBlue are expert builders of public & private clouds. They  are the leading global CloudS...
Why ShapeBlue back CloudStack                Q4, CY2012 analysis by                Qingye Jiang                Openstack, ...
Enterprises   Service Providers
Our group in EuropeCollaborative environment for:  all things CloudStack/ CloudPlatform  Related tech: CloudPortal BM, Clo...
I love the Apache way, but...Too developer focussed  Would like to see more users/operators/integrators in the  community ...
Real world / real scale deployments
A Simple CloudStack                          Architecture                                           Horizontal Scale      ...
Typical Production                           CloudStack ArchitecturevCenter          MS SQL                               ...
How to build an “AWS style” cloud   Billing/ LOB                            CloudPortal Business Manager                  ...
The Design PhaseGet everyone in the roomMUST be end to end
The Design PhaseKnow the fine print
The Design PhaseUnderstand your work loads
Design PhaseUnderstand your bottlenecks
Design PhasePOC if possible
Redundancy & ResilienceCloudStack Management ServerMySQL ServersVirtualised Management Farm
Automation for deploymentWork smarter, not harder
AutomationTools:  Chef, Puppet  KickStart, Python  CloudStack API  Shell scripting  CloudMonkey  Microsoft Excel 
Example Automation – Host              DeploymentDeployment server (VM)  The script downloads, builds and configures:    D...
AutomationUtilising the API when building        the infrastructure
Automation – The APIWhat is the API  The API is the real engine of CloudStack  The web GUI is simply making API calls  Por...
Deployment via APIGlobal Settings & Service OfferingsZoneSecondary Storage (multiple entries)Physical Networks (multiple e...
Automation – The APIUsing the API  CloudStack GUI  Browser  Word, Excel  Using Firebug/IE Developer Tools with CloudStack ...
Security ConsiderationsWARNING: no best practice currently, no publishedassessmentsAPI Port  Random and internal onlySyste...
DocumentationDull, boring, tedious, slow – Crucial.  Write what you’re going to do  Follow what you wrote  Update it  With...
Real world gotchasIf you deploy the CS GUI, there’s no password reset !Cisco firewalls cause large IPv4 DNS lookup delays ...
More gotchasBy design, a [CloudStack] XenServer will reboot itself if it loses its primarystorageIf you’ve deployed CloudS...
Cloudbuilder skills – whats reallyrequired?                          Cloudstack                             & “the        ...
Whats in store  for 2013?   Giles sees the future
In 2013, first I see….. REAL enterprise Top > down:                 adoption   Cost / op-ex   Agility / speed   No longer ...
In 2013 I see….. Morespecifically, enterprise Alignment                     Technology alignment                     Proce...
In 2013, second I see….. AWS not   winning the enterprise space“Failure happens”? – no thanks  I have two types of workloa...
In 2013, third I see….. the key role of   orchestration being understoodCloud orchestration>>>  Cloud Management  Platform...
In 2013, fourth I see….. Orchestration           battles being won Orchestration is a KEY component of enterprise adoption...
In 2013, fifth I see……….SDN              everywhereWe *think* this will become mainstream in 2013Highly relevant in cloud ...
In 2013, fifth             Cloud          2011/12                 2010/11I see… ..one                                     ...
In 2013/14             Cloud         2011/12    I see…      2010/11..dropping my                             aSS          ...
Any Questions ?
SSVM OptimisationsDefault settings are often insufficient  secstorage.capacity.standby  secstorage.session.max  secstorage...
API Command Structurehttp://URL:PORT/client/api?command=createZone&dns1=8.8.8.8&Internaldns1=192.168.20.11&name=Zone1&netw...
Other AutomationPXE Deployment of Hosts Scripted build of CentOS DHCP/PXE/HTTP Server PXE Deploy XenServer, ESXi, KVMVirtu...
Avalon Merlin…
CloudStack Collab - LV300 Delegates  Developers, operators &  integrators<30 from Citrix70 sessionsMOST sessions onDIYClou...
CloudStack Collab LVMain themes    Storage    PaaS players    SDN players    Real world stories    Apache / community    s...
Next speaker..Sebastien GoasguenDevcloud & Cloudmonkey
In 2013, first I see….. REAL enterprise Top > down:                 adoption   Cost / op-ex   Agility / speed   No longer ...
In 2013 I see….. Morespecifically, enterprise Alignment                     Technology alignment                     Proce...
In 2013, second I see….. AWS not   winning the enterprise space“Failure happens”? – no thanks  I have two types of workloa...
In 2013, third I see….. the key role of   orchestration being understoodCloud orchestration>>>  Cloud Management  Platform...
In 2013, fourth I see….. Orchestration           battles being won Orchestration is a KEY component of enterprise adoption...
In 2013, fifth             Cloud          2011/12                 2010/11I see… ..one                                     ...
In 2013/14             Cloud         2011/12    I see…      2010/11..dropping my                             aSS          ...
Questions?Giles.Sirett@shapeblue.com       @ShapeBlue
Upcoming SlideShare
Loading in …5
×

Bangalore cloudstack user group

1,772 views

Published on

Talk given by ShapeBlue CEO, Giles Sirett, to Bangalore Cloudstack meetup

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,772
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • End of day So we’ll start gentlyHopefully something for everyonePlease bear with me if seems obvious to you.Bear with my english accent and phrases/terminologyBasics and more advanced ideasPaul AngusEngineering and Science degreesCloudStack 2.13
  • Simple Architecture exampleFollowed by a Not so Simple exampleHorizontal Scale, but still a long way from a Production System
  • Multiple CloudStack Servers – same or remote locationsMySQL Servers – Master Slave, or ClusteredSecondary Storage – Lots and Lots of it, at least 2x Zones Primary CapacityXen, KVM Clusters + Pri Storage – 8TB max so Multiple VolumesvSphere Clusters with vCenterBare Metal or Local Storage HyperVisors for High I/O workloadsHorizontal Scale
  • Storage, networking, overall architects technical and managerialEverything is interconnected and feels like everything relies on everything elseSomeone chipping in can be invaluable – particularly if they have past experience.
  • One that gets everyone:Switchsupports 4096 VLANs - but not at the same time.Gotchas…[add more]
  • Private clouds – you have your current usage to judgePublic clouds harder to predict – is guided by offerings.
  • Performance and / or capacityStorageNetworkNetwork (to storage) is often the limiting factor as jump to 10 Gbe is large(Although LACP in XenServer 6.1 and ESXi 5.1 will help to mitigate this)Not much point being able to run VMs per host if only 1Gb/s link Not much point to 256GB RAM with a single quad core processor unless a specific workload.
  • Lack of reference architectures currently
  • I’ll look at the major CloudStack management elements – CSMan MySQLAnd then look at considerations if you’ve virtualised your management farm
  • How do we achieve that…&gt;
  • Automation can come in multiple formsChef &amp; Puppet – enterprise grade automation – works for in-house use (required infrastructure makes it less useful for SIs)KickStart and Python – enables to learn one language and stick to it, requires the interpreter to be installed, but Python is Shell scripts don’t have to be fancy – have to learn awk &amp; sed – have to learn the different languages.API calls
  • Write configuration file. Conscious decision to limit the number of files required.Self contained (requires hypervisor installation files)Look at some elements of the file &gt;
  • 19-20
  • 17-18
  • Take your pickOnly way to remember what you did,only way for others to replicateRun scripts from scratch impossible to update code and separately make changes
  • Storage, networking, overall architects technical and managerialEverything is interconnected and feels like everything relies on everything elseSomeone chipping in can be invaluable – particularly if they have past experience.
  • 16
  • 21-22
  • 23-25
  • Storage, networking, overall architects technical and managerialEverything is interconnected and feels like everything relies on everything elseSomeone chipping in can be invaluable – particularly if they have past experience.
  • Bangalore cloudstack user group

    1. 1. Stories of a cloudstack cloudbuilder Bangalore CloudStack User group Giles Sirett CEO & Managing Consultant ShapeBlue Giles.sirett@shapeblue.com Twitter: @ShapeBlue www.shapeblue.com
    2. 2. Who am I ?CEO of ShapeBlue “ShapeBlue are expert builders of public & private clouds. They are the leading global CloudStack / CloudPlatform integrator & consultancy” Involved in Apache Community, ran roadmap session at CollabChairman of European CloudStack user groupTechnical enough to be dangerous
    3. 3. Why ShapeBlue back CloudStack Q4, CY2012 analysis by Qingye Jiang Openstack, Cloudstack, OpenNebula, Eucalyptus
    4. 4. Enterprises Service Providers
    5. 5. Our group in EuropeCollaborative environment for: all things CloudStack/ CloudPlatform Related tech: CloudPortal BM, CloudBridge, ecosystem products, hypervisors, storage, etcTechnical deep-dives, issues & best practiceCase studies & ideasTo showcase complementary technologiesTo give a strong voice for feedback tovendor/communityNo pitching !
    6. 6. I love the Apache way, but...Too developer focussed Would like to see more users/operators/integrators in the community Maybe two communities could develop?Mailing lists are cumbersome The forums are like wild west towns The mailing lists can be intimidating
    7. 7. Real world / real scale deployments
    8. 8. A Simple CloudStack Architecture Horizontal Scale Primary Primary Primary Load Balancer Storage Storage StorageCloudStack CloudStack Host Host Host & MySQL & MySQL Host Host Host Host Host Host Hosts Hosts Hosts Secondary Storage
    9. 9. Typical Production CloudStack ArchitecturevCenter MS SQL Horizontal Scale vCenter MS SQLMonitor Backup Pri Pri Pri Pri Pri Pri Host Host DNS DNS Stor Stor Stor Stor Stor Stor Pri Pri Pri Pri Pri Pri Load Balancer Host Host Stor Stor Stor Stor Stor StorCS Man CS ManMySQL MySQL Host Host Host Host Host Host Host Host Host Host Host Host Host Host Host HostSec Sec Sec Hosts Hosts Hosts Host Hosts Host Hosts Host Hosts Host Hosts Hosts Hosts Hosts Hosts Hosts Hosts Hosts Hosts Hosts Hosts Hosts HostsStor Stor Stor Hosts Hosts Hosts Hosts Hosts Hosts Hosts Hosts Hosts Hosts Hosts Host HostSec Sec SecStor Stor Stor
    10. 10. How to build an “AWS style” cloud Billing/ LOB CloudPortal Business Manager eCommerce Platform Management systems orchestration API CloudStack API CloudStackOrchestration layer CMP - Orchestration Software CloudBridge 2 CloudBridge 2 (CMP) Corporate centre Data Choice of Hypervisor Hypervisor (VMWare, Xen, KVM, OVM)Others Commodity Networking Storage Storage Servers compute
    11. 11. The Design PhaseGet everyone in the roomMUST be end to end
    12. 12. The Design PhaseKnow the fine print
    13. 13. The Design PhaseUnderstand your work loads
    14. 14. Design PhaseUnderstand your bottlenecks
    15. 15. Design PhasePOC if possible
    16. 16. Redundancy & ResilienceCloudStack Management ServerMySQL ServersVirtualised Management Farm
    17. 17. Automation for deploymentWork smarter, not harder
    18. 18. AutomationTools: Chef, Puppet KickStart, Python CloudStack API Shell scripting CloudMonkey Microsoft Excel 
    19. 19. Example Automation – Host DeploymentDeployment server (VM) The script downloads, builds and configures: DHCP PXE (TFTP) HTTP server Script writes the scripts needed to for PXE boot of XenServer & ESXi hosts Script also writes the answer files and post installation scripts to configure XenServer and ESXi hosts
    20. 20. AutomationUtilising the API when building the infrastructure
    21. 21. Automation – The APIWhat is the API The API is the real engine of CloudStack The web GUI is simply making API calls Port 8096 by default
    22. 22. Deployment via APIGlobal Settings & Service OfferingsZoneSecondary Storage (multiple entries)Physical Networks (multiple entries)Traffic Types – Management, Guest, Public, StoragePODs (multiple entries)Clusters (multiple entries)Hosts (multiple entries)Primary Storage (multiple entries)
    23. 23. Automation – The APIUsing the API CloudStack GUI Browser Word, Excel Using Firebug/IE Developer Tools with CloudStack Now Cloudmonkey
    24. 24. Security ConsiderationsWARNING: no best practice currently, no publishedassessmentsAPI Port Random and internal onlySystem VMs system.vm.random.passwordPassword Changes Track all passwords during build-out Change on a regular basis
    25. 25. DocumentationDull, boring, tedious, slow – Crucial. Write what you’re going to do Follow what you wrote Update it With redundant servers; follow it again With scripts ‘snapshot’ and start again
    26. 26. Real world gotchasIf you deploy the CS GUI, there’s no password reset !Cisco firewalls cause large IPv4 DNS lookup delays in anumber of Linux OSes by making DNS client wait for IPv6 totimeout (when not being used). ACLs between network layers – quickest to start with allopen, then lockdown.
    27. 27. More gotchasBy design, a [CloudStack] XenServer will reboot itself if it loses its primarystorageIf you’ve deployed CloudStack with multiple primary storage luns attached(to each XenServer), loss of one primary storage lun will still cause a reboot.Edit /opt/xensource/bin/xenheartbeat.sh to stop reboot.When choosing OS Type for a template bear in mind the Hypervisor it willbe running on. KVM may not recognise ‘Other - CentOS 64bit’ but be quitehappy with ‘Other Linux – 64bit’, XenServer might be the other way round.By default you cannot use ‘local’ http servers (local = ones in themanagement CIDR) to stage your templates. You must configure‘secstorage.allowed.internal.sites’ in the global settings.
    28. 28. Cloudbuilder skills – whats reallyrequired? Cloudstack & “the cloud way” Storage & Networking Integration UI Deocumetn Virtualisatio ation n Project Manageme nt
    29. 29. Whats in store for 2013? Giles sees the future
    30. 30. In 2013, first I see….. REAL enterprise Top > down: adoption Cost / op-ex Agility / speed No longer just AWS (more to follow) Bottom > up Dev-ops Dev agility Barriers disappearing….
    31. 31. In 2013 I see….. Morespecifically, enterprise Alignment Technology alignment Process alignment Standards alignment = embracing cloud technologies
    32. 32. In 2013, second I see….. AWS not winning the enterprise space“Failure happens”? – no thanks I have two types of workloadWhatever you tell me, my IT is complexI need a service wrapperAre there any alternatives?
    33. 33. In 2013, third I see….. the key role of orchestration being understoodCloud orchestration>>> Cloud Management Platform >>> Cloud OSKey technology choiceDefines alignment withpublic cloud
    34. 34. In 2013, fourth I see….. Orchestration battles being won Orchestration is a KEY component of enterprise adoption Will need to be open CloudStack & Openstack will win and co-exist
    35. 35. In 2013, fifth I see……….SDN everywhereWe *think* this will become mainstream in 2013Highly relevant in cloud infrastructuresNicira Cloudstack integration complete
    36. 36. In 2013, fifth Cloud 2011/12 2010/11I see… ..one aSS big aSS IT SaaS, IaaS, PaaS, STaas, B aaS 2013 ITaaS
    37. 37. In 2013/14 Cloud 2011/12 I see… 2010/11..dropping my aSS IT aSS! SaaS, IaaS, PaaS, Staas, B aaS 2013/14 2013 ITaaS
    38. 38. Any Questions ?
    39. 39. SSVM OptimisationsDefault settings are often insufficient secstorage.capacity.standby secstorage.session.max secstorage.service.offering secstorage.vm.mtu.size
    40. 40. API Command Structurehttp://URL:PORT/client/api?command=createZone&dns1=8.8.8.8&Internaldns1=192.168.20.11&name=Zone1&networktype=Advanced&guestcidr=10.10.1.1&domain=cloud.local
    41. 41. Other AutomationPXE Deployment of Hosts Scripted build of CentOS DHCP/PXE/HTTP Server PXE Deploy XenServer, ESXi, KVMVirtualised Management VMs Deployment via VM Templates Cloning at key stages‘Copy and Paste’ of tried and tested commands
    42. 42. Avalon Merlin…
    43. 43. CloudStack Collab - LV300 Delegates Developers, operators & integrators<30 from Citrix70 sessionsMOST sessions onDIYCloudComputingChannel on Youtube
    44. 44. CloudStack Collab LVMain themes Storage PaaS players SDN players Real world stories Apache / community stuff A little fun…
    45. 45. Next speaker..Sebastien GoasguenDevcloud & Cloudmonkey
    46. 46. In 2013, first I see….. REAL enterprise Top > down: adoption Cost / op-ex Agility / speed No longer just AWS (more to follow) Bottom > up Dev-ops Dev agility Barriers disappearing….
    47. 47. In 2013 I see….. Morespecifically, enterprise Alignment Technology alignment Process alignment Standards alignment = embracing cloud technologies
    48. 48. In 2013, second I see….. AWS not winning the enterprise space“Failure happens”? – no thanks I have two types of workloadWhatever you tell me, my IT is complexI need a service wrapperAre there any alternatives?
    49. 49. In 2013, third I see….. the key role of orchestration being understoodCloud orchestration>>> Cloud Management Platform >>> Cloud OSKey technology choiceDefines alignment withpublic cloud
    50. 50. In 2013, fourth I see….. Orchestration battles being won Orchestration is a KEY component of enterprise adoption Will need to be open CloudStack & Openstack will win and co-exist
    51. 51. In 2013, fifth Cloud 2011/12 2010/11I see… ..one aSS big aSS IT SaaS, IaaS, PaaS, STaas, B aaS 2013 ITaaS
    52. 52. In 2013/14 Cloud 2011/12 I see… 2010/11..dropping my aSS IT aSS! SaaS, IaaS, PaaS, Staas, B aaS 2013/14 2013 ITaaS
    53. 53. Questions?Giles.Sirett@shapeblue.com @ShapeBlue

    ×