The document provides updates on Cloud Foundry, an open platform as a service, highlighting improvements in architecture, app lifecycle management, and operational efficiency. It details ongoing developments in features, frameworks, and tools, as well as the introduction of BOSH for deployment and lifecycle management of large-scale services. Community engagement is emphasized through contributions on GitHub and support channels for developers and contributors.

1. Cloud Foundry Update
The Industry’s Open Platform as a Service
Twitter: @cloudfoundry
© 2012 VMware, Inc. All rights reserved

2. Mark Lucovsky
VP Engineering, Cloud Foundry, VMware
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 2

3. CloudFoundry.org
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 3

4. The New CloudFoundry.org
cloudfoundry.com
production updated ~2x/week
github
github.com/cloudfoundry
on +2 and ✓ change pushed to github
Reviewers +1/-1 Gerrit Code Review +2/-2 Committers
reviews.cloudfoundry.org
test verification score ✓ ✗ git push triggers test execution
Jenkins CI
ci.cloudfoundry.org
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 4

5. More
Clouds
More More
Partners Community
More
Code
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 5

6. What have we been up to: Visible Features
§ Services
• Caldecott – tunnel into your services, explore with standard client tools
• PostgreSQL, RabbitMQ
§ Frameworks, Runtimes, and Tools
• Java and Ruby Auto-Reconfiguration
• Scala, node.JS 0.6.*, Erlang, JRuby, PHP, Python, .NET, Spring 3.1, Grails 2.0
• Multi-Node Chef based deployment tools
• Maven Plugin, Eclipse Integration
• VMC manifests, Java Debugging, Rails Console
§ Micro Cloud Foundry x 3
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 6

7. 80% of our work has been below the water line
§ Developer Visible Features
§ Contributor Visible Features
• re-visiting architectural issues
• extensive hardening
• algorithm tuning
• scalability enhancements
• operational enhancements
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 7

8. App lifecycle management: at launch
start/stop instances
§ awesome conceptual
architecture, logical flows
§ simplistic design provided a cloud
controller health
solid conceptual foundation
manager
§ scalability, robustness,
operational efficiency, and cc - db actual
get expected
extensibility was inadequate state
state
NFS
§ deconstruction/refactoring dea
• enable multiple independently resources,
droplets, packages
scalable components
• eliminate “boot storms” at scale fetch droplets
• tune the hot data paths
§ apply learning from the beta
• across the board and to all major
system components
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 8

9. App lifecycle management: +1yr
v2
cloud
stager health
v2
controller New!
manager
cc - db staging
jobs New!
package
uaa - db cache New! v2*
New! dea
redis
New!
uaa - AuthN blobstore
staging logs New!
New!
more new code than old code CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 9

10. App execution (DEA): at launch and +1yr
§ Major internal rewrite
§ Validating isolation model in Jenkins
§ Live in CF.com ~30d dea.rb
container api
nat and firewall
dea.rb
private network
apps
app
private fs
warden container*
CONFIDENTIAL * also running in our Jenkins workers
© 2012 VMware, Inc. All rights reserved 10

11. Router: at launch and +1yr
http request http request
nginx nginx
(+lua extension)
proxied lookup
request node:port
upstream
router.rb
locator svc
proxied proxied
nats request nats request
<app>.cf.com <app>.cf.com
ê ê
node:port node:port
dea dea
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 11

12. Production Grade Cloud Foundry Clusters
§ 500 – 5,000 VMs cloudfoundry.com
§ 40+ unique node types
§ 75+ unique software packages
§ 75+ unique environments
§ 2x/week cf.com updates
§ 24x7x365 non-stop operation
§ No-downtime deployments
§ Reliable, robust, repeatable
deployments, updates,
capacity adjustments
§ Small teams manage many
instances production, staging, stress, qa, dev
Google style problem  Google style solution
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 12

13. Cloud Foundry BOSH
§ Cloud Foundry BOSH is an open source tool-chain for
release engineering, deployment, and lifecycle management of
large scale distributed services
• Prescriptive way of creating releases and managing systems and services
• It is not a collection of shell scripts, not a pile of Perl
§ Built to deploy and manage production-class, large scale clusters
• Production grade Cloud Foundry clusters: 500+ VMs, 40+ jobs, 75+ packages
• Multi-node, multi-tier, complex clusters: e.g., our Gerrit/Jenkins Cluster
§ Built for devops usage and scale by a crack team of veterans
• A project, not a product: command line interface, YAML, etc.
• Continuous improvement, iterative development, rough edges
github.com/cloudfoundry/bosh
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 13

14. BOSH: under the hood
BOSH User
“BOSH is deployed by BOSH”
bosh cli director healthmon
cloudfoundry.com
db redis nats
workers blobs
active jobs
agent
IaaS CPI stemcell disk
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 14

15. IaaS neutral by design
vSphere: battle tested implementation,
thousands of deployments CPI: code complete
vCloud Director: “work in progress”, 2H 2012 functional status: “work in progress”
Cloud Foundry BOSH
Cloud Provider Interface (CPI)
contribute: github.com/cloudfoundry/bosh
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 15

16. Where do I go for what
§ Learn
• developers: http://docs.cloudfoundry.com
• contributors: http://cloudfoundry.org
§ Ask Questions
• using BOSH: http://groups.google.com/a/cloudfoundry.org/group/bosh-users
• code BOSH: http://groups.google.com/a/cloudfoundry.org/group/bosh-dev
• code VCAP: http://groups.google.com/a/cloudfoundry.org/group/dev
• use cloudfoundry.com: http://support.cloudfoundry.com
§ File a Bug
• http://cloudfoundry.atlassian.net
§ Browse, Fork, Contribute
• browse on github: https://github.com/cloudfoundry/bosh
• contribute: gerrit-clone ssh://reviews.cloudfoundry.org:29418/bosh.git
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 16