SlideShare a Scribd company logo
1 of 36
Download to read offline
Practical Lessons from Building a Highly
Available Openstack Private Cloud!
Sebastian Kachel, Florian Haas
Fall 2013, OpenStack Summit Hong Kong, November 5 2013
|© p i x e l p a r k
!
This presentation is licensed under the Creative
Commons Attribution-ShareAlike 3.0 Unported License.
!2
|
Who are we?
||© p i x e l p a r k
Unix / Linux & SysAdmin / DevOps guy
involved in OpenStack in 2012
Based in Berlin, Germany
One of the organizer from OpenStack-Meetup-Berlin
!4
Sebastian Kachel
!
Florian Haas
IT-Cloud-Manager & IT-Operator
CEO & Principal Consultant
HA/Storage/Cloud guy, consultant, instructor
hastexo co-founder & CEO
Based in seat 10C, Economy Class
Occasionally returns to home base near Vienna, Austria
|
What was our challenge to solve?
||© p i x e l p a r k !6
Ensure high availability for all services that we
want use for our customers in a private cloud
|
What’s this about?
||© p i x e l p a r k !8
Pixelpark AG
!
Full service agency for multimedia communications & e-
business solutions
departments: concepts, project management, editorial, design, development & hosting
||© p i x e l p a r k !9
Solution from pixelpark’s high availability private cloud
|
Why OpenStack?
||© p i x e l p a r k !11
Why OpenStack?
Benefits of cloud computing like on-demand, scalable & elastic
Fixed, time based release cycles
Open source
Support
Rapid development
Cloud software that goes beyond IaaS
!
make it highly available
|
Why High Availability?
||© p i x e l p a r k !13
We provide service level agreements with high
availability up to 99,99%.
|
How did we do it?
|
Storage
||© p i x e l p a r k !16
HA Storage
Highly available storage as base data store to make it scale
||© p i x e l p a r k !17
Why Ceph ?
Distributed storage platform designed to provide excellent performance, reliability
and scalability
Guarantees reliable storage with no data loss
Stores: Cinder volumes, Glance images, static data (S3) over radosgw & instances
!
Ceph is an excellent, reliable basis for cloud storage
||© p i x e l p a r k !18
How did we build our Ceph store?
Working with 3 copies
1 Disk per OSD
XFS filesystem
Journaling on separate SSD
Every storage node has 8x Gbit ports in trunk mode
||© p i x e l p a r k !19
|
OpenStack Block Storage
||© p i x e l p a r k !21
HA Block Storage
cinder services in active/backup mode
cinder-volume, cinder-api & cinder-schedule over two nodes
Pacemaker to monitor & control services
||© p i x e l p a r k !22
|
Network
||© p i x e l p a r k !24
HA Network
quantum-dhcp-agents active/active over two nodes
quantum-l3-agent active/backup distributed over two nodes
quantum-plugin-openvswitch-agent active/active over two nodes
quantum-dhcp-agent & quantum-l3-agent scalable over two nodes
Pacemaker to monitor & control network services
||© p i x e l p a r k !25
|
Services & APIs
||© p i x e l p a r k !27
HA OpenStack services and APIs
||© p i x e l p a r k !28
HA OpenStack services and APIs
Pacemaker cluster with two controller nodes to keep



horizon, 

keystone, 

glance, 

nova, 

RabbitMQ, 

quantum-server & mysql database
always on
||© p i x e l p a r k !29
|
Compute
||© p i x e l p a r k !31
HA Nova guests
rbd mount under /var/lib/nova/
instances
own pool in ceph-cluster
6 x 1GBit/s Ports on every
compute
||© p i x e l p a r k !32
|
How did this affect our organization?
||© p i x e l p a r k !34
Implementing an OpenStack environment is a challenge
Getting training and support is a good idea
Ensure quality, work efficiently
programmable infrastructure
Create a basis for further innovation
Be ready for up & coming technology
Sponsor an OpenStack Meetup group
Have fun!
Lessons learned
|© p i x e l p a r k
Get in touch!
!35
!
Sebastian Kachel
Pixelpark AG
www.pixelpark.com
sebastian.kachel@pixelpark.com
!
!
Florian Haas
hastexo
www.hastexo.com
florian.haas@hastexo.com
Thank you !

More Related Content

What's hot

Bringing Private Cloud computing to HPC and Science - EGI TF tf 2013
Bringing Private Cloud computing to HPC and Science -  EGI TF tf 2013Bringing Private Cloud computing to HPC and Science -  EGI TF tf 2013
Bringing Private Cloud computing to HPC and Science - EGI TF tf 2013
Ignacio M. Llorente
 
Why Software Defined Storage is Critical for Your IT Strategy
Why Software Defined Storage is Critical for Your IT StrategyWhy Software Defined Storage is Critical for Your IT Strategy
Why Software Defined Storage is Critical for Your IT Strategy
andreas kuncoro
 

What's hot (20)

OpenNebulaConf2017EU: Elastic Clusters for Data Analysis by Carlos de Alfonso...
OpenNebulaConf2017EU: Elastic Clusters for Data Analysis by Carlos de Alfonso...OpenNebulaConf2017EU: Elastic Clusters for Data Analysis by Carlos de Alfonso...
OpenNebulaConf2017EU: Elastic Clusters for Data Analysis by Carlos de Alfonso...
 
Avoiding cloud lock-in
Avoiding cloud lock-inAvoiding cloud lock-in
Avoiding cloud lock-in
 
Making Openstack Really Easy - Why Build Open Source When You Can Buy? Danny ...
Making Openstack Really Easy - Why Build Open Source When You Can Buy? Danny ...Making Openstack Really Easy - Why Build Open Source When You Can Buy? Danny ...
Making Openstack Really Easy - Why Build Open Source When You Can Buy? Danny ...
 
OpenStack What's New in Essex
OpenStack What's New in Essex OpenStack What's New in Essex
OpenStack What's New in Essex
 
Webinar - Relying on Bare Metal to manage your workloads
Webinar - Relying on Bare Metal to manage your workloadsWebinar - Relying on Bare Metal to manage your workloads
Webinar - Relying on Bare Metal to manage your workloads
 
Bringing Private Cloud computing to HPC and Science - EGI TF tf 2013
Bringing Private Cloud computing to HPC and Science -  EGI TF tf 2013Bringing Private Cloud computing to HPC and Science -  EGI TF tf 2013
Bringing Private Cloud computing to HPC and Science - EGI TF tf 2013
 
Operators experience and perspective on SDN with VLANs and L3 Networks
Operators experience and perspective on SDN with VLANs and L3 NetworksOperators experience and perspective on SDN with VLANs and L3 Networks
Operators experience and perspective on SDN with VLANs and L3 Networks
 
OpenNebula Conf 2014 | The rOCCI project - a year later - alias OpenNebula in...
OpenNebula Conf 2014 | The rOCCI project - a year later - alias OpenNebula in...OpenNebula Conf 2014 | The rOCCI project - a year later - alias OpenNebula in...
OpenNebula Conf 2014 | The rOCCI project - a year later - alias OpenNebula in...
 
Cloud Standards and CloudStack
Cloud Standards and CloudStackCloud Standards and CloudStack
Cloud Standards and CloudStack
 
Introducing Kubestr - A New Way to Explore Your Kubernetes Storage Options
Introducing Kubestr - A New Way to Explore Your Kubernetes Storage OptionsIntroducing Kubestr - A New Way to Explore Your Kubernetes Storage Options
Introducing Kubestr - A New Way to Explore Your Kubernetes Storage Options
 
Xen in the Cloud
Xen in the CloudXen in the Cloud
Xen in the Cloud
 
Persist your data in an ephemeral k8 ecosystem
Persist your data in an ephemeral k8 ecosystemPersist your data in an ephemeral k8 ecosystem
Persist your data in an ephemeral k8 ecosystem
 
Why Software Defined Storage is Critical for Your IT Strategy
Why Software Defined Storage is Critical for Your IT StrategyWhy Software Defined Storage is Critical for Your IT Strategy
Why Software Defined Storage is Critical for Your IT Strategy
 
Hashicorp Corporate Pitch Deck Stenio_v2
Hashicorp Corporate Pitch Deck Stenio_v2 Hashicorp Corporate Pitch Deck Stenio_v2
Hashicorp Corporate Pitch Deck Stenio_v2
 
Managed Kubernetes: What? Why run it yourself? at #OPEN18
Managed Kubernetes: What? Why run it yourself? at #OPEN18Managed Kubernetes: What? Why run it yourself? at #OPEN18
Managed Kubernetes: What? Why run it yourself? at #OPEN18
 
Big Data as easy as 1, 2, 3, ... 4 ... with KNIME
Big Data as easy as 1, 2, 3, ... 4 ... with KNIMEBig Data as easy as 1, 2, 3, ... 4 ... with KNIME
Big Data as easy as 1, 2, 3, ... 4 ... with KNIME
 
Onboarding and Orchestrating High Performing Networking Software
Onboarding and Orchestrating High Performing Networking SoftwareOnboarding and Orchestrating High Performing Networking Software
Onboarding and Orchestrating High Performing Networking Software
 
RedisConf17 - Amadeus - Redis-Cluster operator
RedisConf17 - Amadeus - Redis-Cluster operatorRedisConf17 - Amadeus - Redis-Cluster operator
RedisConf17 - Amadeus - Redis-Cluster operator
 
Introduction to open stack
Introduction to open stackIntroduction to open stack
Introduction to open stack
 
AWS re:Invent 2016 - Scality's Open Source AWS S3 Server
AWS re:Invent 2016 - Scality's Open Source AWS S3 ServerAWS re:Invent 2016 - Scality's Open Source AWS S3 Server
AWS re:Invent 2016 - Scality's Open Source AWS S3 Server
 

Similar to Openstack summit2013-hongkong

exoscale at the CloudStack User Group London - June 26th 2014
exoscale at the CloudStack User Group London - June 26th 2014exoscale at the CloudStack User Group London - June 26th 2014
exoscale at the CloudStack User Group London - June 26th 2014
Antoine COETSIER
 
Red hat ceph storage customer presentation
Red hat ceph storage customer presentationRed hat ceph storage customer presentation
Red hat ceph storage customer presentation
Rodrigo Missiaggia
 
Building Efficient HPC Clouds with MCAPICH2 and RDMA-Hadoop over SR-IOV Infin...
Building Efficient HPC Clouds with MCAPICH2 and RDMA-Hadoop over SR-IOV Infin...Building Efficient HPC Clouds with MCAPICH2 and RDMA-Hadoop over SR-IOV Infin...
Building Efficient HPC Clouds with MCAPICH2 and RDMA-Hadoop over SR-IOV Infin...
inside-BigData.com
 
Budapest Data/ML - Building Modern Data Streaming Apps with NiFi, Flink and K...
Budapest Data/ML - Building Modern Data Streaming Apps with NiFi, Flink and K...Budapest Data/ML - Building Modern Data Streaming Apps with NiFi, Flink and K...
Budapest Data/ML - Building Modern Data Streaming Apps with NiFi, Flink and K...
Timothy Spann
 

Similar to Openstack summit2013-hongkong (20)

CEPH & OPENSTACK - Red Hat's Winning Combination for Enterprise Clouds
CEPH & OPENSTACK - Red Hat's Winning Combination for Enterprise CloudsCEPH & OPENSTACK - Red Hat's Winning Combination for Enterprise Clouds
CEPH & OPENSTACK - Red Hat's Winning Combination for Enterprise Clouds
 
Open Hybrid Cloud - Erik Geensen
Open Hybrid Cloud - Erik GeensenOpen Hybrid Cloud - Erik Geensen
Open Hybrid Cloud - Erik Geensen
 
exoscale at the CloudStack User Group London - June 26th 2014
exoscale at the CloudStack User Group London - June 26th 2014exoscale at the CloudStack User Group London - June 26th 2014
exoscale at the CloudStack User Group London - June 26th 2014
 
New use cases for Ceph, beyond OpenStack, Luis Rico
New use cases for Ceph, beyond OpenStack, Luis RicoNew use cases for Ceph, beyond OpenStack, Luis Rico
New use cases for Ceph, beyond OpenStack, Luis Rico
 
Red Hat Ceph Storage: Past, Present and Future
Red Hat Ceph Storage: Past, Present and FutureRed Hat Ceph Storage: Past, Present and Future
Red Hat Ceph Storage: Past, Present and Future
 
Red Hat Storage Day Boston - OpenStack + Ceph Storage
Red Hat Storage Day Boston - OpenStack + Ceph StorageRed Hat Storage Day Boston - OpenStack + Ceph Storage
Red Hat Storage Day Boston - OpenStack + Ceph Storage
 
Red hat ceph storage customer presentation
Red hat ceph storage customer presentationRed hat ceph storage customer presentation
Red hat ceph storage customer presentation
 
Open Cloud Storage @ OpenStack Summit Paris
Open Cloud Storage @ OpenStack Summit ParisOpen Cloud Storage @ OpenStack Summit Paris
Open Cloud Storage @ OpenStack Summit Paris
 
Peanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStack
Peanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStackPeanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStack
Peanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStack
 
Sven Vogel: Running CloudStack and OpenShift with NetApp on KVM
Sven Vogel: Running CloudStack and OpenShift with NetApp on KVMSven Vogel: Running CloudStack and OpenShift with NetApp on KVM
Sven Vogel: Running CloudStack and OpenShift with NetApp on KVM
 
Open stackbrief happylearning
Open stackbrief happylearningOpen stackbrief happylearning
Open stackbrief happylearning
 
Oracle - Continuous Delivery NYC meetup, June 07, 2018
Oracle - Continuous Delivery NYC meetup, June 07, 2018Oracle - Continuous Delivery NYC meetup, June 07, 2018
Oracle - Continuous Delivery NYC meetup, June 07, 2018
 
IBM RedHat OCP Vs xKS.pptx
IBM RedHat OCP Vs xKS.pptxIBM RedHat OCP Vs xKS.pptx
IBM RedHat OCP Vs xKS.pptx
 
OCCIware@POSS 2016 - an extensible, standard XaaS cloud consumer platform
OCCIware@POSS 2016 - an extensible, standard XaaS cloud consumer platformOCCIware@POSS 2016 - an extensible, standard XaaS cloud consumer platform
OCCIware@POSS 2016 - an extensible, standard XaaS cloud consumer platform
 
Introduction to OpenStack (2012)
Introduction to OpenStack (2012)Introduction to OpenStack (2012)
Introduction to OpenStack (2012)
 
Red Hat Storage Roadmap
Red Hat Storage RoadmapRed Hat Storage Roadmap
Red Hat Storage Roadmap
 
Red Hat Storage Roadmap
Red Hat Storage RoadmapRed Hat Storage Roadmap
Red Hat Storage Roadmap
 
Building Efficient HPC Clouds with MCAPICH2 and RDMA-Hadoop over SR-IOV Infin...
Building Efficient HPC Clouds with MCAPICH2 and RDMA-Hadoop over SR-IOV Infin...Building Efficient HPC Clouds with MCAPICH2 and RDMA-Hadoop over SR-IOV Infin...
Building Efficient HPC Clouds with MCAPICH2 and RDMA-Hadoop over SR-IOV Infin...
 
Cisco: Cassandra adoption on Cisco UCS & OpenStack
Cisco: Cassandra adoption on Cisco UCS & OpenStackCisco: Cassandra adoption on Cisco UCS & OpenStack
Cisco: Cassandra adoption on Cisco UCS & OpenStack
 
Budapest Data/ML - Building Modern Data Streaming Apps with NiFi, Flink and K...
Budapest Data/ML - Building Modern Data Streaming Apps with NiFi, Flink and K...Budapest Data/ML - Building Modern Data Streaming Apps with NiFi, Flink and K...
Budapest Data/ML - Building Modern Data Streaming Apps with NiFi, Flink and K...
 

More from Deepak Mane (14)

Openstackha 130925132534-phpapp02
Openstackha 130925132534-phpapp02Openstackha 130925132534-phpapp02
Openstackha 130925132534-phpapp02
 
Openstack vm live migration
Openstack vm live migrationOpenstack vm live migration
Openstack vm live migration
 
Openstack swift introduction
Openstack swift introductionOpenstack swift introduction
Openstack swift introduction
 
Openstack ha
Openstack haOpenstack ha
Openstack ha
 
Network topology for ha
Network topology for haNetwork topology for ha
Network topology for ha
 
Load balancing of controller openstack
Load balancing of controller   openstackLoad balancing of controller   openstack
Load balancing of controller openstack
 
Intel open stack-summit-session-nov13-final
Intel open stack-summit-session-nov13-finalIntel open stack-summit-session-nov13-final
Intel open stack-summit-session-nov13-final
 
Hardware considerations for different node types
Hardware considerations for different node typesHardware considerations for different node types
Hardware considerations for different node types
 
Ha with neutron network
Ha with neutron networkHa with neutron network
Ha with neutron network
 
Deployment topologies for high availability (ha)
Deployment topologies for high availability (ha)Deployment topologies for high availability (ha)
Deployment topologies for high availability (ha)
 
Ha logical setup
Ha logical setupHa logical setup
Ha logical setup
 
High availability networking openstack
High availability networking   openstackHigh availability networking   openstack
High availability networking openstack
 
High availability and fault tolerance
High availability and fault toleranceHigh availability and fault tolerance
High availability and fault tolerance
 
High availability and fault tolerance of openstack
High availability and fault tolerance of openstackHigh availability and fault tolerance of openstack
High availability and fault tolerance of openstack
 

Recently uploaded

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Recently uploaded (20)

Navigating Identity and Access Management in the Modern Enterprise
Navigating Identity and Access Management in the Modern EnterpriseNavigating Identity and Access Management in the Modern Enterprise
Navigating Identity and Access Management in the Modern Enterprise
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Quantum Leap in Next-Generation Computing
Quantum Leap in Next-Generation ComputingQuantum Leap in Next-Generation Computing
Quantum Leap in Next-Generation Computing
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Stronger Together: Developing an Organizational Strategy for Accessible Desig...
Stronger Together: Developing an Organizational Strategy for Accessible Desig...Stronger Together: Developing an Organizational Strategy for Accessible Desig...
Stronger Together: Developing an Organizational Strategy for Accessible Desig...
 
ChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps ProductivityChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps Productivity
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Introduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMIntroduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDM
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
How to Check CNIC Information Online with Pakdata cf
How to Check CNIC Information Online with Pakdata cfHow to Check CNIC Information Online with Pakdata cf
How to Check CNIC Information Online with Pakdata cf
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
 
JavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuideJavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate Guide
 

Openstack summit2013-hongkong

  • 1. Practical Lessons from Building a Highly Available Openstack Private Cloud! Sebastian Kachel, Florian Haas Fall 2013, OpenStack Summit Hong Kong, November 5 2013
  • 2. |© p i x e l p a r k ! This presentation is licensed under the Creative Commons Attribution-ShareAlike 3.0 Unported License. !2
  • 4. ||© p i x e l p a r k Unix / Linux & SysAdmin / DevOps guy involved in OpenStack in 2012 Based in Berlin, Germany One of the organizer from OpenStack-Meetup-Berlin !4 Sebastian Kachel ! Florian Haas IT-Cloud-Manager & IT-Operator CEO & Principal Consultant HA/Storage/Cloud guy, consultant, instructor hastexo co-founder & CEO Based in seat 10C, Economy Class Occasionally returns to home base near Vienna, Austria
  • 5. | What was our challenge to solve?
  • 6. ||© p i x e l p a r k !6 Ensure high availability for all services that we want use for our customers in a private cloud
  • 8. ||© p i x e l p a r k !8 Pixelpark AG ! Full service agency for multimedia communications & e- business solutions departments: concepts, project management, editorial, design, development & hosting
  • 9. ||© p i x e l p a r k !9 Solution from pixelpark’s high availability private cloud
  • 11. ||© p i x e l p a r k !11 Why OpenStack? Benefits of cloud computing like on-demand, scalable & elastic Fixed, time based release cycles Open source Support Rapid development Cloud software that goes beyond IaaS ! make it highly available
  • 13. ||© p i x e l p a r k !13 We provide service level agreements with high availability up to 99,99%.
  • 14. | How did we do it?
  • 16. ||© p i x e l p a r k !16 HA Storage Highly available storage as base data store to make it scale
  • 17. ||© p i x e l p a r k !17 Why Ceph ? Distributed storage platform designed to provide excellent performance, reliability and scalability Guarantees reliable storage with no data loss Stores: Cinder volumes, Glance images, static data (S3) over radosgw & instances ! Ceph is an excellent, reliable basis for cloud storage
  • 18. ||© p i x e l p a r k !18 How did we build our Ceph store? Working with 3 copies 1 Disk per OSD XFS filesystem Journaling on separate SSD Every storage node has 8x Gbit ports in trunk mode
  • 19. ||© p i x e l p a r k !19
  • 21. ||© p i x e l p a r k !21 HA Block Storage cinder services in active/backup mode cinder-volume, cinder-api & cinder-schedule over two nodes Pacemaker to monitor & control services
  • 22. ||© p i x e l p a r k !22
  • 24. ||© p i x e l p a r k !24 HA Network quantum-dhcp-agents active/active over two nodes quantum-l3-agent active/backup distributed over two nodes quantum-plugin-openvswitch-agent active/active over two nodes quantum-dhcp-agent & quantum-l3-agent scalable over two nodes Pacemaker to monitor & control network services
  • 25. ||© p i x e l p a r k !25
  • 27. ||© p i x e l p a r k !27 HA OpenStack services and APIs
  • 28. ||© p i x e l p a r k !28 HA OpenStack services and APIs Pacemaker cluster with two controller nodes to keep
 
 horizon, 
 keystone, 
 glance, 
 nova, 
 RabbitMQ, 
 quantum-server & mysql database always on
  • 29. ||© p i x e l p a r k !29
  • 31. ||© p i x e l p a r k !31 HA Nova guests rbd mount under /var/lib/nova/ instances own pool in ceph-cluster 6 x 1GBit/s Ports on every compute
  • 32. ||© p i x e l p a r k !32
  • 33. | How did this affect our organization?
  • 34. ||© p i x e l p a r k !34 Implementing an OpenStack environment is a challenge Getting training and support is a good idea Ensure quality, work efficiently programmable infrastructure Create a basis for further innovation Be ready for up & coming technology Sponsor an OpenStack Meetup group Have fun! Lessons learned
  • 35. |© p i x e l p a r k Get in touch! !35 ! Sebastian Kachel Pixelpark AG www.pixelpark.com sebastian.kachel@pixelpark.com ! ! Florian Haas hastexo www.hastexo.com florian.haas@hastexo.com