Introduction into Cloud Foundry and Bosh describing architecture, deployment, app staging and Cloud Foundry & Bosh self-healing capabilities.

1. Cloud Foundry & Bosh
A Cloud Love

2. In this talk you will

3. • discover the anynines stack
• get known to Cloud Foundry
• learn how Bosh deploys Cloud Foundry

4. Introduction

6. 100% European

7. 30+ employees

8. The anynines Stack

9. Built on approved
Open Source
Software

10. Cloud Foundry
OpenStack
VMware
Hardware

11. We migrated from a
Rented VMware to a
self-hosted OpenStack.

12. < 30 min downtime.
Read more:
http://rh.gd/a9vmw2sos

13. Cloud Foundry

14. • open source software, Apache 2 license
• developed by Pivotal,
~$500 mio. funding
• mostly written in Ruby & Go

15. CF Architecture

16. Anynines Elastic Runtime MongoDB Service
MongoDB Service Broker
MongoDB Bosh
MongoDB Service Clusters
…
Load Balancer & SSL Broker
Application Router
Cloud Controller Health Manager
UAA Login Service
NATS Messaging Bus
Blob Store
DEA Pool
DEA VM 1 DEA VM 2 DEA VM n
App Container 1
App Container 2
App Container 3
App Container 4
App Container 5 App Container n
Bosh
Bosh Director
…
Bosh Health Manager
Bosh Workers Bosh Resurrector
Bosh Task Queue Bosh DNS Server

17. Deploying an App

18. Anynines Elastic Runtime
Blob Store Cloud Controller
DEA DEA DEA
App Container App Container
= Droplet = Your runnable app
Application Deployment
cf push {meta: data}
Health Manager

19. Staging an App

20. Anynines Elastic Runtime
Blob Store Cloud Controller
DEA DEA DEA
App Container
= Droplet = Your runnable app
Application Staging
Global Buildpacks
+ =

21. Anynines Elastic Runtime
Blob Store Cloud Controller
DEA DEA DEA
App Container
= Droplet = Your runnable app
Application Staging
Global Buildpacks
+App C=ontainer

22. Scaling an App

23. cf scale myapp -i 2

24. Anynines Elastic Runtime
Application Scale-Out
Blob Store Cloud Controller Health Manager
NATS Message Bus
DEA DEA DEA
App Container
= Droplet = Your runnable app
App Container

25. Cloud Foundry
Elastic Runtime
Summary

26. • Application server grid on steroids
• Generic buildpack support
• SCM agnostic deployments

28. Services

29. cf create-service mongodb cluster-med mydb1

30. Create Service Instance
Anynines Elastic Runtime
Blob Store Cloud Controller
Health Manager
DEA
App Container App Container
MongoDB Service
Service Broker
Example: MongoDB - Could be any other service
Service Provisioner Inception VM
DEA Mongo Cluster 1
VM VM VM
Service Bosh
Mongo Cluster 2
VM VM VM

31. cf bind-service mongodb mydb1

32. Create Service Instance
Anynines Elastic Runtime MongoDB Service
Blob Store Cloud Controller
Health Manager
DEA
App Container App Container
Service Broker
Example: MongoDB - Could be any other service
Service Provisioner Inception VM
DEA Mongo Cluster 1
VM VM VM
Service Bosh
Mongo Cluster 2
VM VM VM
{user: john, password: doe}

33. Back to the
big picture
Read more
http://rh.gd/1E41ZqZ

34. Anynines Elastic Runtime MongoDB Service
MongoDB Service Broker
MongoDB Bosh
MongoDB Service Clusters
…
Load Balancer & SSL Broker
Application Router
Cloud Controller Health Manager
UAA Login Service
NATS Messaging Bus
Blob Store
DEA Pool
DEA VM 1 DEA VM 2 DEA VM n
App Container 1
App Container 2
App Container 3
App Container 4
App Container 5 App Container n
Bosh
Bosh Director
…
Bosh Health Manager
Bosh Workers Bosh Resurrector
Bosh Task Queue Bosh DNS Server

35. How to deploy this
multitude of services?

36. Bosh

37. • IaaS agnostic
• Turnkey deployments for large
distributed systems
• VM orchestration
• Installation automation

38. Anynines Operations Manager (Bosh) Anynines IaaS (OpenStack)
Bosh Agent
CF Health Manager (Process)
VIRTUAL MACHINE
Process Monitor
CF DEA (Process)
VIRTUAL MACHINE
Bosh Agent Process Monitor
Bosh Health Monitor
Bosh Director
NATS Message Bus
Infrastructure Level Self-Healing
CF DEA (Process)
VIRTUAL MACHINE
Bosh Agent Process Monitor
Bosh CLI
Bosh Blobstore
DNS Server
Bosh CPI
Registry
Resurrector
Task Queue
Task Workers
VM VM VM VM VM VM VM VM

39. Bosh CPI
-
Cloud Provider Interface

40. Bosh CPI
# Stemcell
create_stemcell(image, cloud_properties)
delete_stemcell(stemcell_id)
!
# VM
create_vm(agent_id, stemcell_id, resource_pool,
networks, disk_locality, env)
delete_vm(vm_id)
reboot_vm(vm_id)
configure_networks(vm_id, networks)
!
# Disk
create_disk(size, vm_locality)
delete_disk(disk_id)
attach_disk(vm_id, disk_id)
detach_disk(vm_id, disk_id)

41. OpenStack CPI
http://rh.gd/1oDezng

42. Four Layers of HA

43. 1. Application Failure
⇒ Reboot in new Container ✔
2. Rack Failure
⇒ Availability Zones ✔
3. PaaS Process Failure
⇒ Reboot component in a new VM ✔
4. PaaS VM Failure
⇒ VM Monitor ⇒ Recreate VM ✔

44. Application Failure

45. Anynines Elastic Runtime
Blob Store Cloud Controller Health Manager
NATS Message Bus
DEA DEA DEA
App Container
App Container App Container
= Droplet = Your runnable app
Application Level Self-Healing

46. Availability Zone Failure
(e.g. Rack Failure)

47. Anynines Elastic Runtime
Application Level Self-Healing
IaaS Availability Zone 1 IaaS Availability Zone 2 IaaS Availability Zone 3
DEAs DEAs DEAs
Application
Container
Application
Container
Application
Container
Application
Container
Application
Container
Application
Container
Application
Container
Application
Container

48. PaaS Process Failure

49. Anynines Operations Manager (Bosh) Anynines IaaS (OpenStack)
MACHINE Bosh Agent Process Monitor
VIRTUAL CF Health Manager (Process)
CF DEA (Process)
VIRTUAL MACHINE
Bosh Agent Process Monitor
Bosh Health Monitor
Bosh Director
NATS Message Bus
Infrastructure Level Self-Healing
CF DEA (Process)
VIRTUAL MACHINE
Bosh Agent Process Monitor

50. PaaS VM Failure

51. Anynines Operations Manager (Bosh) Anynines IaaS (OpenStack)
MACHINE Bosh Agent Process Monitor
VIRTUAL CF Health Manager (Process)
CF DEA (Process)
VIRTUAL MACHINE
Bosh Agent Process Monitor
CF DEA (Process)
VIRTUAL MACHINE
Bosh Agent Process Monitor
Bosh Health Monitor
Bosh Director
NATS Message Bus
Infrastructure Level Self-Healing

52. Anynines Operations Manager (Bosh) Anynines IaaS (OpenStack)
MACHINE Bosh Agent Process Monitor
VIRTUAL CF Health Manager (Process)
CF DEA (Process)
VIRTUAL MACHINE
Bosh Agent Process Monitor
Bosh Health Monitor
Bosh Director
NATS Message Bus
Infrastructure Level Self-Healing
CF DEA (Process)
VIRTUAL MACHINE
Bosh Agent Process Monitor

53. Summary

54. • Cloud Foundry is a free, production
ready Heroku-like PaaS
• Awesome app runtime
• Service orchestration
• Transparent due to open source
• No vendor-lock in

55. • Bosh is a cloud-ready orchestration tool
• Describe a distributed-system blueprint
⇒ Bosh will build it for you. Ready to use.

56. Which part(s) should be
presented in the next talk?

57. Thank you!