0
Pivotal Cloud Platform Deep Dive 
Part 2: Architecture and The Operator Experience 
Pivotal CF Team 
© Copyright 2014 Pivo...
Cloud Foundry Architecture Stack 
Router 
Cloud Controller 
UAA/Login Servers Health Manager 
Service Broker Node(s) 
Logg...
Pushing an application 
Router 
Blobstore DB 
SC 
Cloud Controller Service Broker 
Node(s) 
DEA 
DEA 
DEA 
DEA 
Runtime 
p...
Application Staging 
Router 
Blobstore DB 
Cloud Controller 
DEA 
Runtime 
Detect Compile Upload 
No 
System 
Buildpacks 
...
Application containers and scaling 
Blobstore 
Router 
Cloud Controller 
DEA 
Messaging (NATS) 
DEA DEA 
Runtime 
Access 
...
Service create and bind 
DB 
CLI Cloud 
create service (HTTP) 
bind service (HTTP) 
Router 
Service 
credentials 
reserve ...
What’s on Pivotal CF for an 
operator? 
© Copyright 2014 Pivotal. © Copyright 2014 Pivotal. AAllll rriigghhttss rreesseerr...
Pivotal CF operations 
Developer Operator 
© Copyright 2014 Pivotal. All rights reserved. 9
Install runtime 
and container 
Deploy to dev 
© Copyright 2014 Pivotal. All rights reserved. 10
Install runtime and 
container 
Install services (db, 
messaging, hadoop, …) 
Deploy to dev 
© Copyright 2014 Pivotal. All...
Install runtime and 
container 
Install services (db, 
messaging, hadoop, …) 
Setup load-balancing, 
SSL termination and 
...
Install runtime and 
container 
Install services (db, 
messaging, hadoop, …) 
Setup load-balancing, SSL 
termination and d...
Install runtime and 
container 
Install services (db, 
messaging, hadoop, …) 
Setup load-balancing, SSL 
termination and d...
Install runtime and 
container 
Install services (db, 
messaging, hadoop, …) 
Setup load-balancing, SSL 
termination and d...
Install runtime and 
container 
Install services (db, 
messaging, hadoop, …) 
Setup load-balancing, SSL 
termination and d...
Install runtime and 
container 
Install services (db, 
messaging, hadoop, …) 
Setup load-balancing and 
dynamic routing 
S...
Install runtime and 
container 
Install services (db, 
messaging, hadoop, …) 
Setup load-balancing and 
dynamic routing 
S...
The Pivotal CF way 
© Copyright 2014 Pivotal. All rights reserved. 
Deploy to dev
The Pivotal CF way 
© Copyright 2014 Pivotal. All rights reserved. 
Deploy to dev 
> cf push 
Cloud 
Controller 
Health 
M...
The operator in the PaaS era 
Developer Operator 
© Copyright 2014 Pivotal. All rights reserved. 21
The operator in the PaaS era 
© Copyright 2014 Pivotal. All rights reserved. 22
Operator 
Concerns 
Setup High 
Availability 
Monitor the 
platform 
Install the 
platform 
Handle upgrades 
and updates 
...
Pivotal CF 
Target multiple services 
IaaS 
Install the 
platform 
Setup High 
Availability 
clouds 
Handle live upgrades ...
Mobile Services 
for Pivotal CF 
Cassandra 
for Pivotal CF 
ElasticSearch 
for Pivotal CF 
CloudBees Jenkins 
Enterprise 
...
Mobile Services 
for Pivotal CF 
Cassandra 
for Pivotal CF 
ElasticSearch 
for Pivotal CF 
CloudBees Jenkins 
Enterprise 
...
© Copyright 2014 Pivotal. All rights reserved. 
Demo
BOSH 
© Copyright 2014 Pivotal. All rights reserved.
Why BOSH 
Provision services, 
not machines 
Enables continuous 
delivery 
Cloud-agnostic view 
of Platform Ops 
Holistic ...
Ops Manager + BOSH 
DB 
Blobstore 
BOSH 
Health 
Monitor 
Deploy my 
Services 
Worker VMs 
Messaging 
Health Manager 
Clou...
Operator 
Concerns 
Setup High 
Availability 
Monitor the 
platform 
Install the 
platform 
Handle upgrades 
and updates 
...
Orgs, Spaces, Users and Quotas 
© Copyright 2014 Pivotal. All rights reserved. 32
Organizations 
Logical division within a Pivotal CF 
install / Foundation. 
Each organization has its own users 
and assig...
Quotas and Plans 
Different quota limits (e.g. “small”, 
“enterprise”, “default”, “runaway”) 
can be assigned per Organiza...
Spaces 
Logical sub-division within an 
organization 
Users authorized at an organization 
level can have different roles ...
© Copyright 2014 Pivotal. All rights reserved. 36
Operator 
Concerns 
Setup High 
Availability 
Monitor the 
platform 
Install the 
platform 
Handle upgrades 
and updates 
...
Platform Monitoring 
How do I know when to scale DEAs? 
How many requests each Router is servicing? 
What is the current l...
Platform Monitoring 
Pivotal Ops Metrics provides a single 
JMX interface to access metrics for 
each Pivotal CF component...
Platform Monitoring 
JMX 
Provider 
Collector 
JMX Monitoring 
Tool 
© Copyright 2014 Pivotal. All rights reserved. 40
Platform Monitoring 
JMX 
Provider 
Collector 
JMX Monitoring 
Tool 
© Copyright 2014 Pivotal. All rights reserved. 41
Operator 
Concerns 
Setup High 
Availability 
Monitor the 
platform 
Install the 
platform 
Handle upgrades 
and updates 
...
4 Layers of built-in High Availability 
Application Instance 
Platform Processes 
Platform VMs 
Availability Zones 
© Copy...
4 Layers of built-in High Availability 
Application Instance 
Platform Processes 
Platform VMs 
Availability Zones 
© Copy...
App Instance HA 
Blobstore 
Router 
Cloud Controller 
DEA 
Messaging (NATS) 
DEA DEA 
Actual State 
Health Manager 
Cloud ...
4 Layers of built-in High Availability 
Application Instance 
Platform Processes 
Platform VMs 
Availability Zones 
© Copy...
DB 
© Copyright 2014 Pivotal. All rights reserved. 
47 
Platform Processes HA 
Blobstore 
BOSH 
Health 
Monitor 
Pivotal C...
Platform Processes HA 
Cloud ControllTearrget 
Agent PRreoscteasrts 
© Copyright 2014 Pivotal. All rights reserved. 48
4 Layers of built-in High Availability 
Application Instance 
Platform Processes 
Platform VMs 
Availability Zones 
© Copy...
DB 
© Copyright 2014 Pivotal. All rights reserved. 
50 
Platform VMs HA 
Blobstore 
BOSH 
Health 
Monitor 
Pivotal CF 
Clo...
4 Layers of built-in High Availability 
Application Instance 
Platform Processes 
Platform VMs 
Availability Zones 
© Copy...
Messaging (NATS) 
© Copyright 2014 Pivotal. All rights reserved. 
Availability Zone #2 
52 
Availability Zones 
DEA 
DEA 
...
Operator 
Concerns 
Setup High 
Availability 
Monitor the 
platform 
Install the 
platform 
Handle upgrades 
and updates 
...
Pivotal CF: Enterprise Grade SW Delivery 
Simple & Comprehensive 
• End to end platform to iterate quickly and build 
high...
Pivotal CF: 
The Platform for a New Era of Software Innovation 
INTEGRATED OPERATOR 
FUNCTIONS READY MIDDLEWARE SERVICES A...
A NEW PLATFORM FOR A NEW ERA
Upcoming SlideShare
Loading in...5
×

Part 2: Architecture and the Operator Experience (Pivotal Cloud Platform Roadshow)

2,324

Published on

The primary goals of this session are to:

Do a deep dive into the CF architecture via animated slides illustrating push, stage, deploy, scale, and health management.

Also do a brief dive into BOSH, including why BOSH, what it is, and animations of how it works. It’s not an operations focused workshop, so we keep the treatment light.

Discuss the value adds to CF BOSH OSS that Pivotal brings through the Pivotal Ops Manager product and our associated ecosystem of data and mobile services.

Quickly prove that I can push an app to a Pivotal CF environment running on vCHS in the same exact way I can push an app to PWS.

Pivotal Cloud Platform Roadshow is coming to a city near you!

Join Pivotal technologists and learn how to build and deploy great software on a modern cloud platform. Find your city and register now http://bit.ly/1poA6PG

Published in: Software

Transcript of "Part 2: Architecture and the Operator Experience (Pivotal Cloud Platform Roadshow)"

  1. 1. Pivotal Cloud Platform Deep Dive Part 2: Architecture and The Operator Experience Pivotal CF Team © Copyright 2014 Pivotal. All rights reserved. 2
  2. 2. Cloud Foundry Architecture Stack Router Cloud Controller UAA/Login Servers Health Manager Service Broker Node(s) Loggregator DEA Pool Messaging (NATS) BOSH Director BOSH Agent ! IaaS © Copyright 2014 Pivotal. All rights reserved. 3
  3. 3. Pushing an application Router Blobstore DB SC Cloud Controller Service Broker Node(s) DEA DEA DEA DEA Runtime push app + app MD 1. Upload bits/metadata 2. Create/bind services 3. Stage app 4. Deploy app + = © Copyright 2014 Pivotal. All rights reserved. 4
  4. 4. Application Staging Router Blobstore DB Cloud Controller DEA Runtime Detect Compile Upload No System Buildpacks + = Yes © Copyright 2014 Pivotal. All rights reserved. 5
  5. 5. Application containers and scaling Blobstore Router Cloud Controller DEA Messaging (NATS) DEA DEA Runtime Access App © Copyright 2014 Pivotal. All rights reserved. 6
  6. 6. Service create and bind DB CLI Cloud create service (HTTP) bind service (HTTP) Router Service credentials reserve resources obtain connection data Controller Service Broker Data Service create service (HTTP) bind service (HTTP) Runtime © Copyright 2014 Pivotal. All rights reserved. 7
  7. 7. What’s on Pivotal CF for an operator? © Copyright 2014 Pivotal. © Copyright 2014 Pivotal. AAllll rriigghhttss rreesseerrvveedd.. 8
  8. 8. Pivotal CF operations Developer Operator © Copyright 2014 Pivotal. All rights reserved. 9
  9. 9. Install runtime and container Deploy to dev © Copyright 2014 Pivotal. All rights reserved. 10
  10. 10. Install runtime and container Install services (db, messaging, hadoop, …) Deploy to dev © Copyright 2014 Pivotal. All rights reserved. 11
  11. 11. Install runtime and container Install services (db, messaging, hadoop, …) Setup load-balancing, SSL termination and dynamic routing Deploy to dev © Copyright 2014 Pivotal. All rights reserved. 12
  12. 12. Install runtime and container Install services (db, messaging, hadoop, …) Setup load-balancing, SSL termination and dynamic routing Setup / config High Availability Deploy to dev © Copyright 2014 Pivotal. All rights reserved. 13
  13. 13. Install runtime and container Install services (db, messaging, hadoop, …) Setup load-balancing, SSL termination and dynamic routing Setup / config High Availability Setup APM Deploy to dev © Copyright 2014 Pivotal. All rights reserved. 14
  14. 14. Install runtime and container Install services (db, messaging, hadoop, …) Setup load-balancing, SSL termination and dynamic routing Setup / config High Availability Setup APM Setup log streaming Deploy to dev © Copyright 2014 Pivotal. All rights reserved. 15
  15. 15. Install runtime and container Install services (db, messaging, hadoop, …) Setup load-balancing, SSL termination and dynamic routing Setup / config High Availability Setup APM Setup log streaming Deploy to dev App Deployed © Copyright 2014 Pivotal. All rights reserved. 16
  16. 16. Install runtime and container Install services (db, messaging, hadoop, …) Setup load-balancing and dynamic routing Setup / config High Availability Setup APM Setup log streaming Blue-green deployment Restart server Create service Deploy to dev Upgrade app Deploy to Test Change JDK Redeploy Scale up Scale Platform Update app Bind service Deploy to QA Update app server Unbind service Change route Promote to production Escale memory Check logs Scale down Delete App © Copyright 2014 Pivotal. All rights reserved. 17
  17. 17. Install runtime and container Install services (db, messaging, hadoop, …) Setup load-balancing and dynamic routing Setup / config High Availability Setup APM Setup log streaming Blue-green deployment Restart server Create service Deploy to dev Upgrade app Deploy to Test Change JDK Redeploy Scale up Scale Platform Update app Bind service Deploy to QA Update app server Unbind service Change route Promote to production Escale memory Check logs Scale down Delete App © Copyright 2014 Pivotal. All rights reserved. 18
  18. 18. The Pivotal CF way © Copyright 2014 Pivotal. All rights reserved. Deploy to dev
  19. 19. The Pivotal CF way © Copyright 2014 Pivotal. All rights reserved. Deploy to dev > cf push Cloud Controller Health Manager NATS (message bus) Router App Deployed
  20. 20. The operator in the PaaS era Developer Operator © Copyright 2014 Pivotal. All rights reserved. 21
  21. 21. The operator in the PaaS era © Copyright 2014 Pivotal. All rights reserved. 22
  22. 22. Operator Concerns Setup High Availability Monitor the platform Install the platform Handle upgrades and updates Plan capacity Manage users and quotas © Copyright 2014 Pivotal. All rights reserved. 23
  23. 23. Pivotal CF Target multiple services IaaS Install the platform Setup High Availability clouds Handle live upgrades and updates Install and manage Scale and plan capacity © Copyright 2014 Pivotal. All rights reserved. 24
  24. 24. Mobile Services for Pivotal CF Cassandra for Pivotal CF ElasticSearch for Pivotal CF CloudBees Jenkins Enterprise BOSH Director BOSH Agent IaaS © Copyright 2014 Pivotal. All rights reserved. 25
  25. 25. Mobile Services for Pivotal CF Cassandra for Pivotal CF ElasticSearch for Pivotal CF CloudBees Jenkins Enterprise BOSH Director BOSH Agent IaaS Click to install No downtime updates Explore install logs Click to scale the platform Built-in High Availability Built-in Platform Monitoring Integrated services © Copyright 2014 Pivotal. All rights reserved. 26
  26. 26. © Copyright 2014 Pivotal. All rights reserved. Demo
  27. 27. BOSH © Copyright 2014 Pivotal. All rights reserved.
  28. 28. Why BOSH Provision services, not machines Enables continuous delivery Cloud-agnostic view of Platform Ops Holistic Toolchain for “rule them all" Eliminate bespoke automation on top of config management © Copyright 2014 Pivotal. All rights reserved. 29
  29. 29. Ops Manager + BOSH DB Blobstore BOSH Health Monitor Deploy my Services Worker VMs Messaging Health Manager Cloud Controller Target VM BOSH Director NATS IaaS © Copyright 2014 Pivotal. All rights reserved. 30
  30. 30. Operator Concerns Setup High Availability Monitor the platform Install the platform Handle upgrades and updates Plan capacity Manage users and quotas © Copyright 2014 Pivotal. All rights reserved. 31
  31. 31. Orgs, Spaces, Users and Quotas © Copyright 2014 Pivotal. All rights reserved. 32
  32. 32. Organizations Logical division within a Pivotal CF install / Foundation. Each organization has its own users and assigned quota User permissions / roles are specified per space within an organization Sub-divided into Spaces © Copyright 2014 Pivotal. All rights reserved. 33
  33. 33. Quotas and Plans Different quota limits (e.g. “small”, “enterprise”, “default”, “runaway”) can be assigned per Organization Quota defines © Copyright 2014 Pivotal. All rights reserved. 34 !• Total Memory • Total # of Services • Total # of Routes
  34. 34. Spaces Logical sub-division within an organization Users authorized at an organization level can have different roles per space Services and Applications are created / specified per Space Same Service can have different meanings per space © Copyright 2014 Pivotal. All rights reserved. 35
  35. 35. © Copyright 2014 Pivotal. All rights reserved. 36
  36. 36. Operator Concerns Setup High Availability Monitor the platform Install the platform Handle upgrades and updates Plan capacity Manage users and quotas © Copyright 2014 Pivotal. All rights reserved. 37
  37. 37. Platform Monitoring How do I know when to scale DEAs? How many requests each Router is servicing? What is the current load of my Cloud Controllers? © Copyright 2014 Pivotal. All rights reserved. 38
  38. 38. Platform Monitoring Pivotal Ops Metrics provides a single JMX interface to access metrics for each Pivotal CF component • DEAs • Cloud Controllers • Routers • Health Managers • NATS, UAA, Login Server, … © Copyright 2014 Pivotal. All rights reserved. 39
  39. 39. Platform Monitoring JMX Provider Collector JMX Monitoring Tool © Copyright 2014 Pivotal. All rights reserved. 40
  40. 40. Platform Monitoring JMX Provider Collector JMX Monitoring Tool © Copyright 2014 Pivotal. All rights reserved. 41
  41. 41. Operator Concerns Setup High Availability Monitor the platform Install the platform Handle upgrades and updates Plan capacity Manage users and quotas © Copyright 2014 Pivotal. All rights reserved. 42
  42. 42. 4 Layers of built-in High Availability Application Instance Platform Processes Platform VMs Availability Zones © Copyright 2014 Pivotal. All rights reserved. 43
  43. 43. 4 Layers of built-in High Availability Application Instance Platform Processes Platform VMs Availability Zones © Copyright 2014 Pivotal. All rights reserved. 44
  44. 44. App Instance HA Blobstore Router Cloud Controller DEA Messaging (NATS) DEA DEA Actual State Health Manager Cloud Foundry Runtime © Copyright 2014 Pivotal. All rights reserved. 45
  45. 45. 4 Layers of built-in High Availability Application Instance Platform Processes Platform VMs Availability Zones © Copyright 2014 Pivotal. All rights reserved. 46
  46. 46. DB © Copyright 2014 Pivotal. All rights reserved. 47 Platform Processes HA Blobstore BOSH Health Monitor Pivotal CF DEA Agent Process Health Manager Agent Messaging Agent Process Process Cloud Controller Target BOSH Director NATS Agent Process
  47. 47. Platform Processes HA Cloud ControllTearrget Agent PRreoscteasrts © Copyright 2014 Pivotal. All rights reserved. 48
  48. 48. 4 Layers of built-in High Availability Application Instance Platform Processes Platform VMs Availability Zones © Copyright 2014 Pivotal. All rights reserved. 49
  49. 49. DB © Copyright 2014 Pivotal. All rights reserved. 50 Platform VMs HA Blobstore BOSH Health Monitor Pivotal CF Cloud Controller Agent Process Health Manager Agent Messaging BOSH Director NATS Agent Process Process Cloud Controller Agent Process Ressurector Re-create VM VM is missing…
  50. 50. 4 Layers of built-in High Availability Application Instance Platform Processes Platform VMs Availability Zones © Copyright 2014 Pivotal. All rights reserved. 51
  51. 51. Messaging (NATS) © Copyright 2014 Pivotal. All rights reserved. Availability Zone #2 52 Availability Zones DEA DEA DEA Router Blobstore Cloud Controller Health Manager Push app Availability Zone #1 DEA DEA
  52. 52. Operator Concerns Setup High Availability Monitor the platform Install the platform Handle upgrades and updates Plan capacity Manage users and quotas © Copyright 2014 Pivotal. All rights reserved. 53
  53. 53. Pivotal CF: Enterprise Grade SW Delivery Simple & Comprehensive • End to end platform to iterate quickly and build highly scalable cloud apps • IT Ops automation with no scripts, no templates, no config headaches • Easy to use management dashboard Scalable & Efficient • Elastic scale of PaaS capacity and applications through simple interfaces or scripting • Higher application instance density on the same IaaS footprint through advanced containerization Extensible • Independent of the IaaS provider, the runtime languages supported & the brokered services • Simple APIs ensure easy extension and customization Governed & Secure • Individual and team-based roles and permissions • Easy integration w/ 3rd party tools and agents Highly Available • Built in health monitoring and management of applications and the platform • Zero downtime deploys/updates of the platform and applications © Copyright 2014 Pivotal. All rights reserved. 54
  54. 54. Pivotal CF: The Platform for a New Era of Software Innovation INTEGRATED OPERATOR FUNCTIONS READY MIDDLEWARE SERVICES AUTO DEPLOY AND SCALE • Instant Dynamic Routing • Streaming Logging Agg • ID/team/RBAC/Policy • APM, Auto-scaling • Ready integration • Four layers of built-in Availability • Auto-detect runtimes, frameworks • “Push and it works” model • CF Push [.WAR] • CF Push [Docker] • CF Push [.ASP] • Elastic Pivotal HD • HAWQ Analytics • Mobile Push • Mobile Sync • Mobile API • MySQL HA • Redis • Rabbit MQ • Elastic Search • Cassandra • Jenkins (Partner) ….and more DEPLOY, OPERATE, UPDATE, SCALE ON ANY INFRASTRUCTURE © Copyright 2014 Pivotal. All rights reserved. 55
  55. 55. A NEW PLATFORM FOR A NEW ERA
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×