Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
07-09.10.2011<br />OpenStack in AllegroGroup<br />1<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />2<br />PiotrSiwczak / Tomasz ‘Zen’ Napierała<br />Systems Architecture E...
07-09.10.2011<br />OpenStack in AllegroGroup<br />3<br />Cloudcomputingis not… <br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />4<br />…overclockingyour CPU (untilitstartsburnin’)<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />5<br />…a way to socializearoundyourcomputer<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />6<br />Imagine your website gets high traffic<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />7<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />8<br />„Captain - there’s no chance we can get the site back online with...
07-09.10.2011<br />OpenStack in AllegroGroup<br />9<br />Facepalm one<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />10<br />Facepalmtwo<br />We need addional 500k for servers…<br />The bos...
07-09.10.2011<br />OpenStack in AllegroGroup<br />11<br />
The sysadmin<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />12<br />
Facepalmthree<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />13<br />Looking at the clock<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />14<br />+<br />=<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />15<br />Double facepalm!!!<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />16<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />17<br />It’s simple as hell! Next time, when your traffic goes up, use T...
It’s all about…<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />18<br />
…scalability<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />19<br />
The service<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />20<br />VM<br />API<br />OS <br />
Pay only for what you actually use<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />21<br />10 USD/day<br />Free<br />
Infrastructure as a Service (IaaS)<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />22<br />
Platform as a Service (PaaS)<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />23<br />
Software as a Service (SaaS)<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />24<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />25<br />
Cloud architecture (IaaS)<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />26<br />H-visor<br />VM<br />data<br />St...
20gb hdd
2 cpus
Ubuntu</li></ul>H-visor<br />VM<br />Imagerepo<br />VM<br />
VM lifecycle<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />27<br />Bootstrap<br />Poweroff<br />Start<br />(just ...
But….<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />28<br />
…what about the data???<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />29<br />
All local data is lost when a VM is terminated<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />30<br />
Use persistent data storage on the cloud!<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />31<br />
VM Authentication (injected pubkey)<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />32<br />
Be agile<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />33<br />
Be fast<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />34<br />
We’ve got it all for ya!!!!<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />35<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />36<br />Your own private cloud!<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />37<br /><ul><li>Get your account
Run VMs
Use VM templates
Mount persistent storage</li></li></ul><li>07-09.10.2011<br />OpenStack in AllegroGroup<br />38<br />And even….!<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />39<br />…scale seamlessly to Amazon EC2 !!!!<br /><ul><li>Use the same API
Use the same VM img</li></li></ul><li>07-09.10.2011<br />OpenStack in AllegroGroup<br />40<br />„That’samazing! We’re gonn...
07-09.10.2011<br />OpenStack in AllegroGroup<br />41<br />But guys…Remember to tell the application folks first !<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />42<br />WHY ? ….<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />43<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />44<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />45<br />why we do it<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />46<br />4<br />5<br />5<br />6<br />Data gathered on 2011-09-19<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />47<br />0  (WTF)<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />48<br />  (WTF)<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />49<br />DO IT!<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />50<br />AWESOME !<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />51<br />The “compute” service deploys and runs VM-s on your physical ser...
07-09.10.2011<br />OpenStack in AllegroGroup<br />52<br />Long-term, replicable and scalable storage. Data can go up to pe...
07-09.10.2011<br />OpenStack in AllegroGroup<br />53<br />Delivers and keeps track of VM images across the Compute infrast...
07-09.10.2011<br />OpenStack in AllegroGroup<br />54<br />You could do a bit better guys`…<br />This is where we are.<br /...
07-09.10.2011<br />OpenStack in AllegroGroup<br />55<br />…? Go to hell you little monster. These guys have done a great j...
07-09.10.2011<br />OpenStack in AllegroGroup<br />56<br />Now I really insist you watch a short demo of it!<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />57<br />The compute<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />58<br />Hybridfox<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />59<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />60<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />61<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />62<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />63<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />64<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />65<br />Availability Zone<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />66<br />Building reliable services with availability zones<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />67<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />68<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />69<br />Availability-Zone 1<br />Cloud Controller/API<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />70<br />Availability-Zone 1<br />Cloud Controller/API<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />71<br />Availability-Zone 1<br />Cloud Controller/API<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />72<br />Availability-Zone 1<br />Cloud Controller/API<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />73<br />A-Z1<br />A-Z2<br />A-Z3<br />Cloud Controller/API<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />74<br />Dealing with large data using block storage<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />75<br />live example here ;-)<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />76<br />euca-create-volume<br />Cloud controller<br />Volume controller<...
07-09.10.2011<br />OpenStack in AllegroGroup<br />77<br />euca-attach-volume<br />Cloud controller<br />/dev/vdc<br />ISCS...
07-09.10.2011<br />OpenStack in AllegroGroup<br />78<br />Hangling external traffic with fixed IPs<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />79<br />Compute nodes<br />192.168.20.21<br />Network controller<br />19...
07-09.10.2011<br />OpenStack in AllegroGroup<br />80<br />Compute nodes<br />192.168.20.21(i-0000036c)<br />Network contro...
07-09.10.2011<br />OpenStack in AllegroGroup<br />81<br />Our gear<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />82<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />83<br />1000VMsperrack<br />
07-09.10.2011<br />OpenStack in AllegroGroup<br />84<br />Efficiency per rack<br /><ul><li>100 physical servers
Around 1000 vm-s in a single rack
Upcoming SlideShare
Loading in …5
×

Building Openstack in AllegroGroup

2,195 views

Published on

Sharing our expertise building OpenStack infrastructure in AllegroGroup.
Original author of the presentation: Piotr Siwczak, Systems Architecture Engineer @ AllegroGroup

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

Building Openstack in AllegroGroup

  1. 1. 07-09.10.2011<br />OpenStack in AllegroGroup<br />1<br />
  2. 2. 07-09.10.2011<br />OpenStack in AllegroGroup<br />2<br />PiotrSiwczak / Tomasz ‘Zen’ Napierała<br />Systems Architecture Engineers<br />Infrastructure Department<br />OpenStack in AllegroGroup<br />
  3. 3. 07-09.10.2011<br />OpenStack in AllegroGroup<br />3<br />Cloudcomputingis not… <br />
  4. 4. 07-09.10.2011<br />OpenStack in AllegroGroup<br />4<br />…overclockingyour CPU (untilitstartsburnin’)<br />
  5. 5. 07-09.10.2011<br />OpenStack in AllegroGroup<br />5<br />…a way to socializearoundyourcomputer<br />
  6. 6. 07-09.10.2011<br />OpenStack in AllegroGroup<br />6<br />Imagine your website gets high traffic<br />
  7. 7. 07-09.10.2011<br />OpenStack in AllegroGroup<br />7<br />
  8. 8. 07-09.10.2011<br />OpenStack in AllegroGroup<br />8<br />„Captain - there’s no chance we can get the site back online with so few servers… Too many users are hogging us out there!”<br />
  9. 9. 07-09.10.2011<br />OpenStack in AllegroGroup<br />9<br />Facepalm one<br />
  10. 10. 07-09.10.2011<br />OpenStack in AllegroGroup<br />10<br />Facepalmtwo<br />We need addional 500k for servers…<br />The boss<br />Just to stand a 7-day marketing campaign???<br />
  11. 11. 07-09.10.2011<br />OpenStack in AllegroGroup<br />11<br />
  12. 12. The sysadmin<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />12<br />
  13. 13. Facepalmthree<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />13<br />Looking at the clock<br />
  14. 14. 07-09.10.2011<br />OpenStack in AllegroGroup<br />14<br />+<br />=<br />
  15. 15. 07-09.10.2011<br />OpenStack in AllegroGroup<br />15<br />Double facepalm!!!<br />
  16. 16. 07-09.10.2011<br />OpenStack in AllegroGroup<br />16<br />
  17. 17. 07-09.10.2011<br />OpenStack in AllegroGroup<br />17<br />It’s simple as hell! Next time, when your traffic goes up, use The Cloud.<br />
  18. 18. It’s all about…<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />18<br />
  19. 19. …scalability<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />19<br />
  20. 20. The service<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />20<br />VM<br />API<br />OS <br />
  21. 21. Pay only for what you actually use<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />21<br />10 USD/day<br />Free<br />
  22. 22. Infrastructure as a Service (IaaS)<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />22<br />
  23. 23. Platform as a Service (PaaS)<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />23<br />
  24. 24. Software as a Service (SaaS)<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />24<br />
  25. 25. 07-09.10.2011<br />OpenStack in AllegroGroup<br />25<br />
  26. 26. Cloud architecture (IaaS)<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />26<br />H-visor<br />VM<br />data<br />Storage<br />Run 4 vm-s<br />VM<br />Cloud Controller<br /><ul><li>4 gigs of ram
  27. 27. 20gb hdd
  28. 28. 2 cpus
  29. 29. Ubuntu</li></ul>H-visor<br />VM<br />Imagerepo<br />VM<br />
  30. 30. VM lifecycle<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />27<br />Bootstrap<br />Poweroff<br />Start<br />(just a plain OS with random IP and hostname)<br />Serve<br />Terminate(all is lost here)<br />
  31. 31. But….<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />28<br />
  32. 32. …what about the data???<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />29<br />
  33. 33. All local data is lost when a VM is terminated<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />30<br />
  34. 34. Use persistent data storage on the cloud!<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />31<br />
  35. 35. VM Authentication (injected pubkey)<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />32<br />
  36. 36. Be agile<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />33<br />
  37. 37. Be fast<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />34<br />
  38. 38. We’ve got it all for ya!!!!<br />07-09.10.2011<br />OpenStack in AllegroGroup<br />35<br />
  39. 39. 07-09.10.2011<br />OpenStack in AllegroGroup<br />36<br />Your own private cloud!<br />
  40. 40. 07-09.10.2011<br />OpenStack in AllegroGroup<br />37<br /><ul><li>Get your account
  41. 41. Run VMs
  42. 42. Use VM templates
  43. 43. Mount persistent storage</li></li></ul><li>07-09.10.2011<br />OpenStack in AllegroGroup<br />38<br />And even….!<br />
  44. 44. 07-09.10.2011<br />OpenStack in AllegroGroup<br />39<br />…scale seamlessly to Amazon EC2 !!!!<br /><ul><li>Use the same API
  45. 45. Use the same VM img</li></li></ul><li>07-09.10.2011<br />OpenStack in AllegroGroup<br />40<br />„That’samazing! We’re gonna handle warp-10 trafficeasily.”<br />
  46. 46. 07-09.10.2011<br />OpenStack in AllegroGroup<br />41<br />But guys…Remember to tell the application folks first !<br />
  47. 47. 07-09.10.2011<br />OpenStack in AllegroGroup<br />42<br />WHY ? ….<br />
  48. 48. 07-09.10.2011<br />OpenStack in AllegroGroup<br />43<br />
  49. 49. 07-09.10.2011<br />OpenStack in AllegroGroup<br />44<br />
  50. 50. 07-09.10.2011<br />OpenStack in AllegroGroup<br />45<br />why we do it<br />
  51. 51. 07-09.10.2011<br />OpenStack in AllegroGroup<br />46<br />4<br />5<br />5<br />6<br />Data gathered on 2011-09-19<br />
  52. 52. 07-09.10.2011<br />OpenStack in AllegroGroup<br />47<br />0 (WTF)<br />
  53. 53. 07-09.10.2011<br />OpenStack in AllegroGroup<br />48<br /> (WTF)<br />
  54. 54. 07-09.10.2011<br />OpenStack in AllegroGroup<br />49<br />DO IT!<br />
  55. 55. 07-09.10.2011<br />OpenStack in AllegroGroup<br />50<br />AWESOME !<br />
  56. 56. 07-09.10.2011<br />OpenStack in AllegroGroup<br />51<br />The “compute” service deploys and runs VM-s on your physical servers. It also takes care that none of the servers is overloaded by VM-s. It’s a huge speed boost for your infrastructure. You can deploy hundreds of VM-s in minutes via a management console or an API.<br />
  57. 57. 07-09.10.2011<br />OpenStack in AllegroGroup<br />52<br />Long-term, replicable and scalable storage. Data can go up to petabytes. Accessible via RESTful API. Suitalbe for backups, email archiving, storing VM images<br />
  58. 58. 07-09.10.2011<br />OpenStack in AllegroGroup<br />53<br />Delivers and keeps track of VM images across the Compute infrastructure.<br />
  59. 59. 07-09.10.2011<br />OpenStack in AllegroGroup<br />54<br />You could do a bit better guys`…<br />This is where we are.<br />@AllegroGroup<br />
  60. 60. 07-09.10.2011<br />OpenStack in AllegroGroup<br />55<br />…? Go to hell you little monster. These guys have done a great job.Openstack is still in research phase. It’s got lots of bugs. Keep that in mind!We’ve made our testbed stable enough for production use. We’ve even hacked some bugfixes and keep helping newbies on IRC. <br />
  61. 61. 07-09.10.2011<br />OpenStack in AllegroGroup<br />56<br />Now I really insist you watch a short demo of it!<br />
  62. 62. 07-09.10.2011<br />OpenStack in AllegroGroup<br />57<br />The compute<br />
  63. 63. 07-09.10.2011<br />OpenStack in AllegroGroup<br />58<br />Hybridfox<br />
  64. 64. 07-09.10.2011<br />OpenStack in AllegroGroup<br />59<br />
  65. 65. 07-09.10.2011<br />OpenStack in AllegroGroup<br />60<br />
  66. 66. 07-09.10.2011<br />OpenStack in AllegroGroup<br />61<br />
  67. 67. 07-09.10.2011<br />OpenStack in AllegroGroup<br />62<br />
  68. 68. 07-09.10.2011<br />OpenStack in AllegroGroup<br />63<br />
  69. 69. 07-09.10.2011<br />OpenStack in AllegroGroup<br />64<br />
  70. 70. 07-09.10.2011<br />OpenStack in AllegroGroup<br />65<br />Availability Zone<br />
  71. 71. 07-09.10.2011<br />OpenStack in AllegroGroup<br />66<br />Building reliable services with availability zones<br />
  72. 72. 07-09.10.2011<br />OpenStack in AllegroGroup<br />67<br />
  73. 73. 07-09.10.2011<br />OpenStack in AllegroGroup<br />68<br />
  74. 74. 07-09.10.2011<br />OpenStack in AllegroGroup<br />69<br />Availability-Zone 1<br />Cloud Controller/API<br />
  75. 75. 07-09.10.2011<br />OpenStack in AllegroGroup<br />70<br />Availability-Zone 1<br />Cloud Controller/API<br />
  76. 76. 07-09.10.2011<br />OpenStack in AllegroGroup<br />71<br />Availability-Zone 1<br />Cloud Controller/API<br />
  77. 77. 07-09.10.2011<br />OpenStack in AllegroGroup<br />72<br />Availability-Zone 1<br />Cloud Controller/API<br />
  78. 78. 07-09.10.2011<br />OpenStack in AllegroGroup<br />73<br />A-Z1<br />A-Z2<br />A-Z3<br />Cloud Controller/API<br />
  79. 79. 07-09.10.2011<br />OpenStack in AllegroGroup<br />74<br />Dealing with large data using block storage<br />
  80. 80. 07-09.10.2011<br />OpenStack in AllegroGroup<br />75<br />live example here ;-)<br />
  81. 81. 07-09.10.2011<br />OpenStack in AllegroGroup<br />76<br />euca-create-volume<br />Cloud controller<br />Volume controller<br />LV Name: /dev/nova-volumes/volume-<vol_id><br />
  82. 82. 07-09.10.2011<br />OpenStack in AllegroGroup<br />77<br />euca-attach-volume<br />Cloud controller<br />/dev/vdc<br />ISCSI<br />Volume controller<br />LV Name: /dev/nova-volumes/volume-<vol_id><br />
  83. 83. 07-09.10.2011<br />OpenStack in AllegroGroup<br />78<br />Hangling external traffic with fixed IPs<br />
  84. 84. 07-09.10.2011<br />OpenStack in AllegroGroup<br />79<br />Compute nodes<br />192.168.20.21<br />Network controller<br />192.168.0.1<br />
  85. 85. 07-09.10.2011<br />OpenStack in AllegroGroup<br />80<br />Compute nodes<br />192.168.20.21(i-0000036c)<br />Network controller<br />192.168.0.1<br />209.85.148.106<br />NAT<br />
  86. 86. 07-09.10.2011<br />OpenStack in AllegroGroup<br />81<br />Our gear<br />
  87. 87. 07-09.10.2011<br />OpenStack in AllegroGroup<br />82<br />
  88. 88. 07-09.10.2011<br />OpenStack in AllegroGroup<br />83<br />1000VMsperrack<br />
  89. 89. 07-09.10.2011<br />OpenStack in AllegroGroup<br />84<br />Efficiency per rack<br /><ul><li>100 physical servers
  90. 90. Around 1000 vm-s in a single rack
  91. 91. 5tb of raw block storage</li></li></ul><li>07-09.10.2011<br />OpenStack in AllegroGroup<br />85<br />Features to come soon<br /><ul><li>built-in load balancer
  92. 92. autoscaling service
  93. 93. infrastructure deployment language (Ubuntu Orchestra/Ensemble)</li></li></ul><li>07-09.10.2011<br />OpenStack in AllegroGroup<br />86<br />What we’ve learned<br /><ul><li>I/O is the first boundary you hit with virtualization. SSDs give you a great improvement here.
  94. 94. iSCSI is not that bad provided it runs on a dedicated network (jumbo frames, etc.)
  95. 95. Small building blocks scale better than large ones (large Dell servers vs small HP blades).
  96. 96. IRC is still alive and helpful ;-)</li></li></ul><li>07-09.10.2011<br />OpenStack in AllegroGroup<br />87<br />Just check out our testbed!<br /><ul><li>1 cloud gateway (API)
  97. 97. 1 cloud authentication service
  98. 98. 1 cloud scheduler
  99. 99. 3 computing nodes (KVM-based h-vis.)
  100. 100. 1 block storage vol.</li></li></ul><li>07-09.10.2011<br />OpenStack in AllegroGroup<br />88<br />And wait – there’s even more!<br /><ul><li>1 image repository to store your own VM templates
  101. 101. A preconfigured VM image (Ubuntu)
  102. 102. A bootstrap and configuration server (Puppet)</li></li></ul><li>07-09.10.2011<br />OpenStack in AllegroGroup<br />89<br />Coming soon…<br /><ul><li>Load balancer service (Atlas)
  103. 103. Autoscale service (Scalr)
  104. 104. Billing</li></li></ul><li>07-09.10.2011<br />OpenStack in AllegroGroup<br />90<br />Thank you<br />http://kariera.allegro.pl<br />

×