Considerations for building your private cloud folsom update 041513

536 views

Published on

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
536
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
16
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Considerations for building your private cloud folsom update 041513

  1. 1. Considerations  for  Building   a  Private  Cloud Folsom  Update   Ryan  Richard,  RHCA OpenStack  Architect  -­‐  Private  Cloud ryan.richard@rackspace.com @rackninja April 2013Monday, April 15, 13
  2. 2. Why  Folsom? RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  3. 3. What  is  a  Private  Cloud? Elastic  or  Traditional  Virtualization  (hint:  Pick  One!) Multi-­‐tenant  (Multi-­‐Application) Size Private  API  endpoints Limited  inbound  connectivity Customized  for  specific  workloads RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  4. 4. Build  with  the  End  in  Mind  #  of  instances  on  this  physical  host? vCPU Ram Disk ?Flavor: m1.tiny Ram: 512MiB Total instances: vCPU: 1 48 Disk: 0 (size of image) RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  5. 5. Build  with  the  End  in  Mind  #  of  instances  on  this  physical  host? vCPU Ram DiskFlavor: m1.medium Ram: 4096MiB Total instances: vCPU: 2 24 Disk: 10GiB + 40GiB RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  6. 6. Build  with  the  End  in  Mind  #  of  instances  on  this  physical  host? vCPU Ram DiskFlavor: ram heavy Ram: 64GiB Total instances: vCPU: 8 2 Disk: 100GiB RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  7. 7. Capacity  ThoughtsDon’t allow disk size of 0Public Cloud: Limit flavors to image sizePrivate Cloud: Can add flavors for specificapplication profilesNetwork Utilization RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  8. 8. Capacity  ThoughtsI can always add more machines....But you can’t change or modify the fixednetwork once instances are running RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  9. 9. Capacity  ThoughtsI can always add more machines....But you can’t change or modify the fixednetwork once instances are running (resource  /  resource  in  smallest  flavor)  =  maximum  #  of   instances  per  machine Fixed  Network  -­‐  Double  or  quadruple  number  of  expected   instances RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  10. 10. Build  with  the  End  in  Mind nova-network 2  networks  (3  w/  floating  IPs) 1)  Host  Network 2)  Fixed  Network 3)  Floating  network RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  11. 11. Build  with  the  End  in  Mind nova-network 2  networks  (3  w/  floating  IPs) 1)  Host  Network 2)  Fixed  Network 3)  Floating  network RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  12. 12. Build  with  the  End  in  Mind nova-network 2  networks  (3  w/  floating  IPs) Easy  to  add  physical  nodes  and/or   1)  Host  Network networks 2)  Fixed  Network 3)  Floating  network RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  13. 13. Build  with  the  End  in  Mind nova-network 2  networks  (3  w/  floating  IPs) Easy  to  add  physical  nodes  and/or   1)  Host  Network networks 2)  Fixed  Network 3)  Floating  network RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  14. 14. Build  with  the  End  in  Mind nova-network 2  networks  (3  w/  floating  IPs) Easy  to  add  physical  nodes  and/or   1)  Host  Network networks Don’t  try  to  change  the  fixed   2)  Fixed  Network network  once  in  production 3)  Floating  network RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  15. 15. Build  with  the  End  in  Mind nova-network 2  networks  (3  w/  floating  IPs) Easy  to  add  physical  nodes  and/or   1)  Host  Network networks Don’t  try  to  change  the  fixed   2)  Fixed  Network network  once  in  production 3)  Floating  network RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  16. 16. Build  with  the  End  in  Mind nova-network 2  networks  (3  w/  floating  IPs) Easy  to  add  physical  nodes  and/or   1)  Host  Network networks Don’t  try  to  change  the  fixed   2)  Fixed  Network network  once  in  production Easy  to  add  additional  floating   3)  Floating  network networks RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  17. 17. Images  and  Storage Images Drivers: virtio vhost_net xen ... Format: raw qcow2 vdi ... Container: bare ami bundle ... Cloud tech: cloud-init none Partitioning: fixed dynamic Building images talk tomorrow @1:50 in room C123 RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  18. 18. Images  and  Storage Glance File  backed  (local)   Alternatives:  Swift,  CloudFiles,  NFS  (locally  mounted) Snapshots? qcow2  format:  “snapshot_image_format=qcow2“ RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  19. 19. Images  and  Storage Glance  Performance Network  Throughput:  1Gbps  =  125MBps  (expect  ~112MB/s) RAID  5  -­‐  large  sequential  read/writes Disk  Bandwidth  >  IOPS Improve  cache  -­‐  Reduce  #  of  images   RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  20. 20. Images  and  Storage Glance  Performance Network  Throughput:  1Gbps  =  125MBps  (expect  ~112MB/s) RAID  5  -­‐  large  sequential  read/writes Disk  Bandwidth  >  IOPS Improve  cache  -­‐  Reduce  #  of  images   Image  Size Not  Cached Cached 1.4GB 20secs 1sec 16.4GB 2min  21secs 1sec RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  21. 21. Images  and  Storage Glance  Performance Network  Throughput:  1Gbps  =  125MBps  (expect  ~112MB/s) RAID  5  -­‐  large  sequential  read/writes Disk  Bandwidth  >  IOPS Improve  cache  -­‐  Reduce  #  of  images   Image  Size Not  Cached Cached *times  from  “creating   1.4GB 20secs 1sec image”  to    “qemu-­‐img   create” 16.4GB 2min  21secs 1sec RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  22. 22. Images  and  Storage Storage 4  focus  points:  Glance,  Compute  (local),  Cinder,  Swift Glance  -­‐  Space,  Sequential  read/write Compute  -­‐  random  IO Cinder  -­‐  Performance,  Density Swift  -­‐  JBOD,  density RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  23. 23. Architecture  Examples  and  Thoughts 1  -­‐  20  physical  servers Single  controller Single  API   Single  network  (1Gbps  or  2Gbps) RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  24. 24. Architecture  Examples  and  Thoughts20-­‐100  servers HA  controllers  and  load  balanced   APIs Swift/CloudFiles  for  Glance Availability  Zones Consider  “frontend”  and  “backend”   networks Compute  Node  metrics  -­‐  Dedicated   Machine(s) RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  25. 25. Performance  Considerations  and  Bottlenecks IO Random  IO Reduce  IO  per  instance Block  Storage! Review  Hypervisor  best  practices   RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  26. 26. Performance  Considerations  and  Bottlenecks Async&Random&IO& rs/speed/test12"(cfq,"host"deadline,"cache=none)" Rs/speed/test13"(noop,"cache=writeback)" rs/speed/test13"(cfq,"cache=writeback)" IO Rs/speed/test12"(noop"cache=none)" randW"(direct)" Rs/speed/test12"(cfq"cache=none)" randR"(direct)" randW" Rs/speed/test13"(cfq,"cache=none,"no"ht)" Random  IO Rs/speed/test13"(deadline"cache=none)" randR" compute/host"(deadline)" compute/host"(no"ht)" Reduce  IO  per  instance compute/host" 0" 200" 400" 600" 800" 1000" 1200" 1400" 1600" Host&vs.&Instance& Block  Storage! 14000" 12000" 10000" Review  Hypervisor  best  practices   8000" compute/host" 6000" Rs/speed/test12"(cfq"cache=none)" 4000" 2000" 0" randR" randW" randR" randW" seqR" seqW"RACKSPACE® HOSTING seqR" seqw" | WWW.RACKSPACE.COM (direct)" (direct)" (direct)" (direct)"Monday, April 15, 13
  27. 27. Lessons  Learned Lessons  learned Floating  IPs  MUST  be  associated  with  the  “public_interface” Each  piece  of  OpenStack  has  its  own  architecture Folsom  is  stable   Migration  (live,  block)  works  but  scenarios  exist  where  it   doesn’t OpenStack  is  still  changing  often,  keep  up  to  date  with   current  state  of  the  projects Don’t  do  Heterogeneous  Nodes RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  28. 28. Operational  Updates nova  hypervisor*  calls Image  types  in  Glance policy.json Coming  in  Grizzly: Cells   Quantum   Better  LDAP/AD  support RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  29. 29. But.... But  this  is  a  design  summit  also Open  to  discussions/thoughts/ questions RACKSPACE® HOSTING | WWW.RACKSPACE.COMMonday, April 15, 13
  30. 30. Rackspace  is  hiring www.rackertalent.com RACKSPACE® HOSTING | 5000 WALZEM ROAD | SAN ANTONIO, TX 78218 US SALES: 1-800-961-2888 | US SUPPORT: 1-800-961-4454 | WWW.RACKSPACE.COM RACKSPACE® HOSTING | © RACKSPACE US, INC. | RACKSPACE® AND FANATICAL SUPPORT® ARE SERVICE MARKS OF RACKSPACE US, INC. REGISTERED IN THE UNITED STATES AND OTHER COUNTRIES. | WWW.RACKSPACE.COMMonday, April 15, 13

×