Practical Lessons from Building a Highly
Available Openstack Private Cloud
!

Sebastian Kachel, Florian Haas

Fall 2013, O...
!

This presentation is licensed under the Creative
Commons Attribution-ShareAlike 3.0 Unported License.

© pixelpark

|

...
Who are we?

|
Sebastian Kachel
IT-Cloud-Manager & IT-Operator

Unix / Linux & SysAdmin / DevOps guy
involved in OpenStack in 2012
Based ...
What was our challenge to solve?

|
Ensure high availability for all services that we
want use for our customers in a private cloud

© pixelpark

|

!6
What’s this about?

|
Pixelpark AG
!

Full service agency for multimedia communications & ebusiness solutions
departments: concepts, project man...
Solution from pixelpark’s high availability private cloud

© pixelpark

|

!9
Why OpenStack?

|
Why OpenStack?
Benefits of cloud computing like on-demand, scalable & elastic
Fixed, time based release cycles
Open source...
Why High Availability?

|
We provide service level agreements with high
availability up to 99,99%.

© pixelpark

|

!13
How did we do it?

|
Storage

|
HA Storage
Highly available storage as base data store to make it scale

© pixelpark

|

!16
Why Ceph ?
Distributed storage platform designed to provide excellent performance, reliability
and scalability
Guarantees ...
How did we build our Ceph store?

Working with 3 copies
1 Disk per OSD
XFS filesystem
Journaling on separate SSD
Every sto...
© pixelpark

|

!19
OpenStack Block Storage

|
HA Block Storage
cinder-volume, cinder-api & cinder-schedule over two nodes
Pacemaker to monitor & control services

cinde...
© pixelpark

|

!22
Network

|
HA Network
quantum-dhcp-agent & quantum-l3-agent scalable over two nodes
Pacemaker to monitor & control network services

...
© pixelpark

|

!25
Services & APIs

|
HA OpenStack services and APIs

© pixelpark

|

!27
HA OpenStack services and APIs
Pacemaker cluster with two controller nodes to keep



horizon, 

keystone, 

glance, 

nov...
© pixelpark

|

!29
Compute

|
HA Nova guests
rbd mount under /var/lib/nova/
instances
own pool in ceph-cluster
6 x 1GBit/s Ports on every
compute

© pix...
© pixelpark

|

!32
How did this affect our organization?

|
Lessons learned
Implementing an OpenStack environment is a challenge
Getting training and support is a good idea
Ensure qu...
Get in touch!
!

Sebastian Kachel
Pixelpark AG
www.pixelpark.com
sebastian.kachel@pixelpark.com
!
!

Florian Haas
hastexo
...
Thank you !
Upcoming SlideShare
Loading in …5
×

Practical Lessons from Building a Highly Available Openstack Private Cloud - Pixelpark & hastexo

822
-1

Published on

Published in: Technology, Business
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
822
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
22
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Practical Lessons from Building a Highly Available Openstack Private Cloud - Pixelpark & hastexo

  1. 1. Practical Lessons from Building a Highly Available Openstack Private Cloud ! Sebastian Kachel, Florian Haas Fall 2013, OpenStack Summit Hong Kong, November 5 2013
  2. 2. ! This presentation is licensed under the Creative Commons Attribution-ShareAlike 3.0 Unported License. © pixelpark | !2
  3. 3. Who are we? |
  4. 4. Sebastian Kachel IT-Cloud-Manager & IT-Operator Unix / Linux & SysAdmin / DevOps guy involved in OpenStack in 2012 Based in Berlin, Germany One of the organizer from OpenStack-Meetup-Berlin Florian Haas CEO & Principal Consultant ! HA/Storage/Cloud guy, consultant, instructor hastexo co-founder & CEO Based in seat 10C, Economy Class Occasionally returns to home base near Vienna, Austria © pixelpark | !4
  5. 5. What was our challenge to solve? |
  6. 6. Ensure high availability for all services that we want use for our customers in a private cloud © pixelpark | !6
  7. 7. What’s this about? |
  8. 8. Pixelpark AG ! Full service agency for multimedia communications & ebusiness solutions departments: concepts, project management, editorial, design, development & hosting © pixelpark | !8
  9. 9. Solution from pixelpark’s high availability private cloud © pixelpark | !9
  10. 10. Why OpenStack? |
  11. 11. Why OpenStack? Benefits of cloud computing like on-demand, scalable & elastic Fixed, time based release cycles Open source Support Rapid development Cloud software that goes beyond IaaS ! make it highly available © pixelpark | !11
  12. 12. Why High Availability? |
  13. 13. We provide service level agreements with high availability up to 99,99%. © pixelpark | !13
  14. 14. How did we do it? |
  15. 15. Storage |
  16. 16. HA Storage Highly available storage as base data store to make it scale © pixelpark | !16
  17. 17. Why Ceph ? Distributed storage platform designed to provide excellent performance, reliability and scalability Guarantees reliable storage with no data loss Stores: Cinder volumes, Glance images, static data (S3) over radosgw & instances ! Ceph is an excellent, reliable basis for cloud storage © pixelpark | !17
  18. 18. How did we build our Ceph store? Working with 3 copies 1 Disk per OSD XFS filesystem Journaling on separate SSD Every storage node has 8x Gbit ports in trunk mode © pixelpark | !18
  19. 19. © pixelpark | !19
  20. 20. OpenStack Block Storage |
  21. 21. HA Block Storage cinder-volume, cinder-api & cinder-schedule over two nodes Pacemaker to monitor & control services cinder services in active/backup mode © pixelpark | !21
  22. 22. © pixelpark | !22
  23. 23. Network |
  24. 24. HA Network quantum-dhcp-agent & quantum-l3-agent scalable over two nodes Pacemaker to monitor & control network services quantum-dhcp-agents active/active over two nodes quantum-l3-agent active/backup distributed over two nodes quantum-plugin-openvswitch-agent active/active over two nodes © pixelpark | !24
  25. 25. © pixelpark | !25
  26. 26. Services & APIs |
  27. 27. HA OpenStack services and APIs © pixelpark | !27
  28. 28. HA OpenStack services and APIs Pacemaker cluster with two controller nodes to keep
 
 horizon, 
 keystone, 
 glance, 
 nova, 
 RabbitMQ, 
 quantum-server & mysql database always on © pixelpark | !28
  29. 29. © pixelpark | !29
  30. 30. Compute |
  31. 31. HA Nova guests rbd mount under /var/lib/nova/ instances own pool in ceph-cluster 6 x 1GBit/s Ports on every compute © pixelpark | !31
  32. 32. © pixelpark | !32
  33. 33. How did this affect our organization? |
  34. 34. Lessons learned Implementing an OpenStack environment is a challenge Getting training and support is a good idea Ensure quality, work efficiently programmable infrastructure Create a basis for further innovation Be ready for up & coming technology Sponsor an OpenStack Meetup group Have fun! © pixelpark | !34
  35. 35. Get in touch! ! Sebastian Kachel Pixelpark AG www.pixelpark.com sebastian.kachel@pixelpark.com ! ! Florian Haas hastexo www.hastexo.com florian.haas@hastexo.com © pixelpark | !35
  36. 36. Thank you !

×