Build production-grade PostgreSQL Cloud Foundry service
•
0 likes•2,519 views
This document discusses building a production-grade PostgreSQL service on Cloud Foundry. Key points include: - Dedicated PostgreSQL instances per service are recommended over shared instances to avoid single points of failure. - On-demand provisioning of instances is essential for scalability and ease of deployment. Bosh is well-suited for automating infrastructure management. - Any necessary PostgreSQL replication and clustering must be automated to support scalability and high availability of the service. - The architecture involves a service broker implementing the Cloud Foundry API, with PostgreSQL-specific logic encapsulated separately for configuration, credentials, and catalog data. Deployments are managed by a Bosh deployer.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (20)
Similar to Build production-grade PostgreSQL Cloud Foundry service
Similar to Build production-grade PostgreSQL Cloud Foundry service (20)
More from anynines GmbH
More from anynines GmbH (17)
Recently uploaded
Recently uploaded (20)
Build production-grade PostgreSQL Cloud Foundry service
- 1. Building a produc.on grade PostgreSQL Cloud Foundry Service
- 3. Produc.on Ready Litmus Test: Run a public CF.
- 6. PostgreSQL Server vs. Cluster
- 7. Replica.on
- 9. Async replica.on is built-in since PostgreSQL 9
- 12. repmgr Replica.on Manager for PostgreSQL clusters
- 13. • Monitoring replica.on performance • Failure detec.on • Automated failover • Leader elec.on • Master promo.on
- 14. Shared vs Dedicated PostgreSQL VMs
- 15. Shared
- 16. • Single VM or single cluster of VMs • Single PostgreSQL server or single PostgreSQL cluster • Isola8on limited to PostreSQL mul8- tenancy capabili8es Shared PostgreSQL Cluster > Bad idea 3 VMs Postgresql VM#1 Postgresql VM#2 Postgresql VM#3 1 VM Postgresql VM#1 PostgreSQL Cluster Single PostgreSQL Server Service Instance Service Instance 2 Service Instance 3 Service Instance 1 Service Instance 2 Service Instance 3 Service Instance 1 Service Instance 2 Service Instance 3 Service Instance 1 Service Instance 2 Service Instance 3 Service Instance 1 OR 1x 1x
- 18. Cloud Foundry Run.me 3 VMs PostgreSQL Cluster Postgresql VM#1 Postgresql VM#2 Postgresql VM#3 Service Instance Service Instance Service Instance Service Instance Service Instance Service Instance Service Instance Service Instance Service Instance App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App
- 19. Cloud Foundry Run.me 3 VMs PostgreSQL Cluster Service Instance Service Instance Service Instance Service Instance Service Instance Service Instance App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App Service Instance Service Instance Service Instance
- 20. Cloud Foundry Run.me 3 VMs PostgreSQL Cluster Service Instance Service Instance Service Instance Service Instance Service Instance Service Instance App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App Service Instance Service Instance Service Instance
- 21. Cloud Foundry Run.me 3 VMs PostgreSQL Cluster Service Instance Service Instance Service Instance Service Instance Service Instance Service Instance App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App Service Instance Service Instance Service Instance
- 22. Your shared PostgreSQL cluster goes down, all your PostgreSQL database instances go down.
- 23. Dedicated
- 24. • Service instance = dedicated VM or dedicated cluster of VMs • Uses infrastructure isola8on to enable mul8-tenancy support Dedicated PostgreSQL instances > Good idea my-3node-postgres-cluster-2 Postgresql VM#1 Postgresql VM#2 Postgresql VM#3 my-single-postgres-1 Postgresql VM#1 Service Instance Service Instance n x m x and / or
- 25. Cloud Foundry Run.me App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App Postgresql VM#1 Postgresql VM#2 Postgresql VM#3 Service Instance Postgresql VM Service Instance Postgresql VM Service Instance Postgresql VM Service Instance Postgresql VM Service Instance Postgresql VM#1 Postgresql VM#2 Postgresql VM#3 Service Instance Postgresql VM Service Instance Postgresql VM Service Instance
- 26. Cloud Foundry Run.me App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App Postgresql VM#1 Postgresql VM#2 Postgresql VM#3 Service Instance Postgresql VM Service Instance Postgresql VM Service Instance Postgresql VM Service Instance Postgresql VM Service Instance Postgresql VM#1 Postgresql VM#2 Postgresql VM#3 Service Instance Postgresql VM Service Instance Postgresql VM Service Instance
- 27. Cloud Foundry Run.me App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App Postgresql VM#1 Postgresql VM#2 Postgresql VM#3 Service Instance Postgresql VM Service Instance Postgresql VM Service Instance Postgresql VM Service Instance Postgresql VM Service Instance Postgresql VM#1 Postgresql VM#2 Postgresql VM#3 Service Instance Postgresql VM Service Instance Postgresql VM Service Instance
- 28. PostgreSQL failures are contained. Only one service instance affected.
- 30. Pre-Provisioned
- 31. Pre-provisoned service instances my-3node-postgres-cluster-2 Postgresql VM#1 Postgresql VM#2 Postgresql VM#3 my-single-postgres-1 Postgresql VM#1 Service InstanceService Instance Service Broker
- 32. $> cf create-service postgresql single-small my-single-postgres-1 Easy Deployment
- 33. Pre-provisioned service instances my-3node-postgres-cluster-2 Postgresql VM#1 Postgresql VM#2 Postgresql VM#3 my-single-postgres-1 Postgresql VM#1 Service InstanceService Instance Service Broker
- 34. $> cf create-service postgresql cluster-small my-3node-postgres- cluster-2 Easy Deployment
- 35. Pre-provisioned service instances my-3node-postgres-cluster-2 Postgresql VM#1 Postgresql VM#2 Postgresql VM#3 my-single-postgres-1 Postgresql VM#1 Service InstanceService Instance Service Broker
- 37. On-demand provisioned service instances Service Broker Some Automa.on
- 38. On-demand provisioned service instances my-single-postgres-1 Postgresql VM#1 Service Instance Service Broker Some Automa.on
- 39. Pre-provisoned service instances my-3node-postgres-cluster-2 Postgresql VM#1 Postgresql VM#2 Postgresql VM#3 my-single-postgres-1 Postgresql VM#1 Service InstanceService Instance Service Broker Some Automa.on
- 41. Bosh = ❤
- 43. VM and persistent disk management
- 44. OS independence
- 45. Blueprint vs. construc.on Bosh Release vs. Bosh deployment
- 46. One Bosh release, several service plans. PostgreSQL single vm vs. PostgreSQL cluster
- 52. Scalability
- 54. $> cf service-update my-single- postgres-1 -p cluster-large Scalability
- 55. my-3node-postgres-cluster-1 Postgresql VM#1 Postgresql VM#2 Postgresql VM#3 my-single-postgres-1 Postgresql VM#1 Postgresql VM#2 Postgresql VM#3 Single node postgresql service instance > turned into a 3-node postgresql cluster.
- 56. $> cf service-update my-3node-postgres-cluster-1 -p cluster-large Scalability
- 57. my-3node-postgres-cluster-1 Postgresql VM#1 Postgresql VM#2 Postgresql VM#3 my-single-postgres-1 Postgresql VM#1 Postgresql VM#2 Postgresql VM#3 Small cluster turned into a large cluster.
- 59. a9s Deployer Templates Deployments Bosh a9s Service Broker my-3node-postgres-cluster-2 Postgresql VM#1 Postgresql VM#2 Postgresql VM#3 my-single-postgres-1 Postgresql VM#1 Middleware Adapter Cloud Foundry Adapter a9s PostgreSQL SPI Service InstanceService Instance my-3node-postgres-cluster-3 Postgresql VM#1 Postgresql VM#2 Postgresql VM#3 Service Instance … Cloud ControllerCF Client create service create service create deployment from template xy with a_ributes {…} deploy release abc & deployment manifest xyz Execute deployments create service specific creden.als create binding
- 61. • Implements the CF Service Broker API • Generic • Data service specific SPIs a9s Service Broker
- 63. The PostgreSQL SPI encapsulates PostgreSQL specific logic
- 64. • Service catalog metadata, e.g. service plans • PostgreSQL instance creden8al management (service bindings) a9s PostgreSQL SPI
- 65. a9s Deployer
- 66. The a9s Deployer manages Bosh deployments
- 69. Lessons Learned
- 70. • Dedicated service instances are mandatory • On-demand provisioning is essen.al • Bosh does a great job
- 71. The greatest challenge with PostgreSQL was
- 72. • Finding a PostgreSQL replica.on & clustering toolset that allows automa.on • Itera.vely learn how to configure and automate common and edge-case scenarios.