The document introduces BOSH, a tool designed for orchestrating large-scale deployments of distributed systems on platforms like Cloud Foundry. It highlights BOSH's architecture, deployment processes, and its ability to automate installations across various infrastructure types, ensuring repeatability and scalability. Additionally, it discusses practical use cases, including deploying data services and managing cloud resources efficiently.

1. An Introduction into
BOSH

2. Introduction

4. Cloud Foundry

5. Cloud Foundry
is a
distributed system

6. Operating a platform +
operating apps on the
platform must be easier
than doing so without it.

7. How do operate a platform
such as Cloud Foundry
at a large-scale?

8. BOSH is built with platform
operations in mind.

9. What is BOSH?

10. „BOSH let’s you orchestrate the
lifecycle of large-scale
deployments of
distributed systems
to infrastructure.“

11. Infrastructure as a Service (IaaS), e.g. OpenStack
VIRTUAL DATACENTER
VIRTUAL MACHINE
BOSH
Router
STORAGE
Storage Node Storage Node Storage Node
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
BOSH API
Storage Volume
Operating
System
BOSH Agent
VIRTUAL MACHINE
BOSH CLI
$> bosh deploy
IaaS API
BOSH CPI

12. Infrastructure as a Service (IaaS), e.g. OpenStack
VIRTUAL DATACENTER
VIRTUAL MACHINE
BOSH
Router
STORAGE
Storage Node Storage Node Storage Node
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
BOSH API
Operating
System
BOSH Agent
VIRTUAL MACHINE
BOSH CLI
$> bosh deploy
IaaS API
PostgreSQL
BOSH CPI

13. Infrastructure as a Service (IaaS), e.g. OpenStack
VIRTUAL DATACENTER
VIRTUAL MACHINE
BOSH
Router
STORAGE
Storage Node Storage Node Storage Node
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
BOSH API
Operating
System
BOSH Agent
VIRTUAL MACHINE
BOSH CLI
$> bosh deploy
IaaS API
…
BOSH Agent
VIRTUAL MACHINE
PostgreSQL Operating
System
BOSH Agent
VIRTUAL MACHINE
Cloud
Controller
Operating
System
BOSH Agent
VIRTUAL MACHINE
UAA
BOSH CPI

14. How BOSH works

15. BOSH Architecture

16. BOSH Installation BOSH Managed Infrastructure
Resources
Some process
BOSH Agent
VIRTUALMACHINE
Process Monitor
Yet another process
VIRTUALMACHINE
BOSH Agent Process Monitor
BOSH Health Monitor
BOSH Director
NATS Message Bus
Some other process
VIRTUALMACHINE
BOSH Agent Process Monitor
Process Monitor
BOSH Registry
BLOB Store
❤️
🎖
🎖
🎖
📡
CPI
MACHIN
E

17. BOSH Installation
VIRTUAL MACHINE
🎖 BOSH Director
📡 NATS Message Bus
🎖 BOSH Registry
🎖 BLOB Store
BOSH Health Monitor❤️
BOSH on a single VM = MicroBOSH

18. BOSH Installation
VIRTUAL MACHINE
BOSH Health Monitor❤️
BOSH on multiple VMs
VIRTUAL MACHINE
BOSH Director🎖
VIRTUAL MACHINE
BOSH Registry🎖
VIRTUAL MACHINE
BLOB Store
🎖
❤️
VIRTUAL MACHINE
NATS Message Bus📡

19. BOSH Automation

20. BOSH Releases
contain the automation

22. A BOSH-Deployment
depends on 1 .. *
Stemcells

23. • VM template
• BOSH clones new VMs from stemcells
• Stemcell = OS + BOSH Agent
• BOSH Agent acts on the VM
• Stemcells are infrastructure and OS
specific (VMware + Ubuntu, OpenStack + CentOS, etc.)

24. A BOSH-Deployment
is described by a Release & Manifest

25. • Release = collection of
• source code
• configuration files
• startup scripts
• software packages
• jobs

26. A Release describe 1 .. * Jobs

27. • Jobs = Processes to be run
• = set of configuration files
• + scripts
• > run process from a package,
e.g. mysqld

28. A Release contains 1 .. * Package

29. • Package
• src code
• compile script
• install script

30. A BOSH Deployment’s
settings are contained in a
Manifest

31. • defines the layout and properties of a
deployment
• network architecture
• VM dimensions, used stemcells (OS)

32. • bosh cli pushed manifest to BOSH
director
• > BOSH director creates a deployment

33. Infrastructure settings
settings are contained in the
Cloud Config

34. BOSH makes your
deployments…

35. Infrastructure Independent

36. • A BOSH release contains the main-
automation (software packages, how to run processes)
• BOSH releases can be re-used on
every* infrastructure

37. Automate once,
deploy everywhere.

38. VMware
BOSH
BOSH CLI
$> bosh target http://bosh-on.vmware.com$> bosh deploy
Some
Service / App
BOSH Agent
VIRTUAL MACHINE
Some
Service / App
BOSH Agent
VIRTUAL MACHINE
Some
Service / App
BOSH Agent
VIRTUAL MACHINE
Some
Service / App
BOSH Agent
VIRTUAL MACHINE
Some
Service / App
BOSH Agent
VIRTUAL MACHINE
Some
Service / App
BOSH Agent
VIRTUAL MACHINE
OpenStack
BOSH
AWS
BOSH

39. BOSH CLI
VMware AWS OpenStack
$> bosh target http://bosh-on.aws.com$> bosh deploy
Some
Service / App
BOSH Agent
VIRTUAL MACHINE
Some
Service / App
BOSH Agent
VIRTUAL MACHINE
Some
Service / App
BOSH Agent
VIRTUAL MACHINE
Some
Service / App
BOSH Agent
VIRTUAL MACHINE
Some
Service / App
BOSH Agent
VIRTUAL MACHINE
Some
Service / App
BOSH Agent
VIRTUAL MACHINE
BOSH BOSH BOSH

40. OpenStack
BOSH
BOSH CLI
$> bosh target http://bosh-on.openstack.com$> bosh deploy
Some
Service / App
BOSH Agent
VIRTUAL MACHINE
Some
Service / App
BOSH Agent
VIRTUAL MACHINE
Some
Service / App
BOSH Agent
VIRTUAL MACHINE
Some
Service / App
BOSH Agent
VIRTUAL MACHINE
Some
Service / App
BOSH Agent
VIRTUAL MACHINE
Some
Service / App
BOSH Agent
VIRTUAL MACHINE
VMware
BOSH
AWS
BOSH

41. Infrastructure as a Service (IaaS), e.g. OpenStack
VIRTUAL DATACENTER
VIRTUAL MACHINE
BOSH
Router
STORAGE
Storage Node Storage Node Storage Node
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
BOSH API
Operating
System
BOSH Agent
VIRTUAL MACHINE
BOSH CLI
$> bosh deploy
IaaS API
…
BOSH Agent
VIRTUAL MACHINE
PostgreSQL Operating
System
BOSH Agent
VIRTUAL MACHINE
Cloud
Controller
Operating
System
BOSH Agent
VIRTUAL MACHINE
UAA
BOSH CPI

42. OpenStack
VIRTUAL DATACENTER
VIRTUAL MACHINE
BOSH
Router
STORAGE
Storage Node Storage Node Storage Node
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
BOSH API
Operating
System
BOSH Agent
VIRTUAL MACHINE
BOSH CLI
$> bosh deploy
IaaS API
PostgreSQL Operating
System
BOSH Agent
VIRTUAL MACHINE
Cloud
Controller
Operating
System
BOSH Agent
VIRTUAL MACHINE
UAA
OPENSTACK CPI

43. VIRTUAL DATACENTER
VIRTUAL MACHINE
BOSH
Router
STORAGE
Storage Node Storage Node Storage Node
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
HDD HDD
BOSH API
Operating
System
BOSH Agent
VIRTUAL MACHINE
BOSH CLI
$> bosh deploy
IaaS API
PostgreSQL Operating
System
BOSH Agent
VIRTUAL MACHINE
Cloud
Controller
Operating
System
BOSH Agent
VIRTUAL MACHINE
UAA
AWS CPI

44. • Switch deployment between clouds
• Keep the same release
• Use a stemcell specific to the new
cloud
• Adapt the cloud config

45. Operating System
Independent

46. A BOSH release does not
depend on the OS

47. The only dependency to the
OS is a BOSH stemcell

48. Operating System
Image
BOSH Agent
VIRTUAL MACHINE
OS image +
BOSH agent
= Stemcell

49. Ubuntu
Stemcell
BOSH Agent
VIRTUAL MACHINE

50. SUSE
Stemcell
BOSH Agent
VIRTUAL MACHINE

51. • Channing the OS of a BOSH deployed
system
• Keep the same release
• Change the stemcell
• Change the manifest

52. Scalable

53. Horizontal Scaling
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE
Some Service
BOSH Agent
VIRTUAL MACHINE

54. • Scaling-out a BOSH deployed system
• Keep the same release
• Use the same stemcell
• Change the manifest

55. Vertical Scaling

56. 4GB RAM
1 vCPU
10GB persistent disk
BOSH Agent
VIRTUAL MACHINE
4 GB RAM, 1 vCPU
10 GB Persistent Disk
Data
PostgreSQL

57. BOSH Agent
PostgreSQL
VIRTUAL MACHINE
8 GB RAM, 2 vCPUs
10 GB Persistent Disk
Data
BOSH Agent
VIRTUAL MACHINE
4 GB RAM, 1 vCPU
PostgreSQL
10 GB Persistent Disk
Data
20 GB Persistent Disk
Data

58. BOSH Deployments are
Predictable

59. • Src code is compiled in a freshly
created VMs
• VMs always contain exact the software,
specified in the release
• No left-overs of prior deployments as
new VMs are used.

60. BOSH Deployments are
Repeatable

61. Executing a specific BOSH
deployment always leads to exact
same deployed system.

62. Monitored &
Self-Healing

63. Self-healing
process failures

64. BOSH Installation BOSH Managed
Infrastructure Resources
Some process
BOSH Agent
VIRTUALMACHINE
Process Monitor
Yet another process
VIRTUALMACHINE
BOSH Agent
BOSH Health Monitor
BOSH Director
NATS Message Bus
Some other process
VIRTUALMACHINE
BOSH Agent Process Monitor
BOSH Registry
BLOB Store
❤️
🎖
🎖
🎖
📡
CPI
MACHIN
E
Some other process
Process MonitorProcess Monitor

65. Self-healing
process monitor failures

66. BOSH Installation BOSH Managed
Infrastructure Resources
Some process
BOSH Agent
VIRTUALMACHINE
Process Monitor
Yet another process
VIRTUALMACHINE
BOSH Agent
BOSH Health Monitor
BOSH Director
NATS Message Bus
Some other process
VIRTUALMACHINE
BOSH Agent Process Monitor
BOSH Registry
BLOB Store
❤️
🎖
🎖
🎖
📡
CPI
MACHIN
E
Some other process
Process MonitorProcess Monitor
Process Monitor

67. Self-healing
VM failures

68. BOSH Installation BOSH Managed
Infrastructure Resources
Some process
BOSH Agent
VIRTUALMACHINE
Process Monitor
Yet another process
VIRTUALMACHINE
BOSH Agent Process Monitor
NATS Message Bus
Some other process
VIRTUALMACHINE
BOSH Agent Process Monitor
Process Monitor
BOSH Registry
BLOB Store
🎖
🎖
📡
🎖 BOSH Director
CPI
MACHIN
E
Some other process
VIRTUALMACHINE
BOSH Agent Process Monitor
BOSH Health Monitor❤️

69. Self-healing
BOSH Agent failures

70. BOSH Managed
Infrastructure Resources
Yet another process
VIRTUALMACHINE
Process Monitor
BOSH Installation
Some process
BOSH Agent
VIRTUALMACHINE
Process Monitor
BOSH Agent
NATS Message Bus
Some other process
VIRTUALMACHINE
BOSH Agent Process Monitor
BOSH Registry
BLOB Store
🎖
🎖
📡
🎖 BOSH Director
CPI
MACHIN
E
BOSH Agent
BOSH Health Monitor❤️
Yet another process
VIRTUALMACHINE
Process MonitorBOSH Agent

71. How BOSH is used

72. Developing automation
with BOSH
BOSH Automation
Design Workflow

73. https://mariash.github.io/lear
n-bosh/

74. Applying automation
with BOSH
BOSH Deployment
Workflow

75. • Upload stemcell
• Upload a release
• Set deployment with a manifest
• Execute deployment

76. When to use BOSH

77. „BOSH let’s you
orchestrate the lifecycle
of large-scale deployments of
distributed systems
to infrastructure.“

78. Use Case:
a9s Data Service
Framework

79. a9s Deployer
Templates Deployments
BOSH
a9s Service Broker
my-3node-mongodb-cluster-2
MongoDB
VM#1
MongoDB
VM#2
MongoDB
VM#3
my-single-mongodb-1
MongoDB
VM#1
Middleware Adapter
Cloud Foundry Adapter
a9s MongoDB SPI
Service InstanceService Instance
my-3node-mongodb-cluster-3
MongoDB
VM#1
MongoDB
VM#2
MongoDB
VM#3
Service Instance
…
Cloud ControllerCF Client
create service
create service
create deployment from template xy with attributes {…}
deploy release abc & deployment manifest xyz
Execute deployments
create
service specific
credentials
create binding

80. Use Case:
Deploy Cloud Foundry

81. Thank you.
@fischerjulian
julian.fischer@anynines.co
m