Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
© Copyright 2014 Pivotal. All rights reserved.
The image cannot be
displayed. Your computer may
not have enough memory to
...
© Copyright 2015 Pivotal. All rights reserved.
Architecture and the Operator Experience
•  Pivotal Cloud Foundry Architect...
© Copyright 2014 Pivotal. All rights reserved. 3
This…. (not cool)."
© Copyright 2014 Pivotal. All rights reserved. 4
And this…(also not cool)
© Copyright 2014 Pivotal. All rights reserved. 5
Loggregator
DEA Pool
Router
Cloud Controller
BOSH Director BOSH Agent
UAA...
© Copyright 2014 Pivotal. All rights reserved. 6
Router
Cloud Controller
Service Broker
Node(s)
DEA
DEA
DEA
DEA
Blobstore ...
© Copyright 2014 Pivotal. All rights reserved. 7
Router
Cloud Controller
DEA
Blobstore DB
Runtime
Detect
Compile Upload
No...
© Copyright 2014 Pivotal. All rights reserved. 8
BlobstoreRouter Cloud Controller
DEA
Messaging (NATS)
DEA DEA
Runtime
Acc...
© Copyright 2014 Pivotal. All rights reserved. 9
DB
Router
Service
credentials
reserve resources
obtain connection data
CL...
© Copyright 2014 Pivotal. All rights reserved. 10
2 Key Components to Pivotal Cloud Foundry
• Ops Manager/ Operations Mana...
© Copyright 2014 Pivotal. All rights reserved.
Demo"
© Copyright 2014 Pivotal. All rights reserved. 12
Pivotal CF deployment on CenturyLink Cloud"
© Copyright 2014 Pivotal. All rights reserved. 13
© Copyright 2014 Pivotal. All rights reserved. 14
© Copyright 2014 Pivotal. All rights reserved. 15
© Copyright 2014 Pivotal. All rights reserved. 16
© Copyright 2014 Pivotal. All rights reserved. 17
© Copyright 2014 Pivotal. All rights reserved. 18
© Copyright 2014 Pivotal. All rights reserved. 19
© Copyright 2014 Pivotal. All rights reserved. 20
© Copyright 2014 Pivotal. All rights reserved. 21
© Copyright 2014 Pivotal. All rights reserved. 22
© Copyright 2014 Pivotal. All rights reserved. 23
© Copyright 2014 Pivotal. All rights reserved. 24
© Copyright 2014 Pivotal. All rights reserved. 25
© Copyright 2014 Pivotal. All rights reserved.
The image cannot be
displayed. Your computer may
not have enough memory to
...
© Copyright 2014 Pivotal. All rights reserved. 27
Pivotal Cloud Foundry operations"
Developer
 Operator
© Copyright 2014 Pivotal. All rights reserved. 28
Install runtime
and container
Deploy to dev
© Copyright 2014 Pivotal. All rights reserved. 29
Install runtime and
container
Install services (db,
messaging, hadoop, …...
© Copyright 2014 Pivotal. All rights reserved. 30
Install runtime and
container
Install services (db,
messaging, hadoop, …...
© Copyright 2014 Pivotal. All rights reserved. 31
Install runtime and
container
Setup load-balancing, SSL
termination and ...
© Copyright 2014 Pivotal. All rights reserved. 32
Install runtime and
container
Setup load-balancing, SSL
termination and ...
© Copyright 2014 Pivotal. All rights reserved. 33
Install runtime and
container
Setup load-balancing, SSL
termination and ...
© Copyright 2014 Pivotal. All rights reserved. 34
Install runtime and
container
Setup load-balancing, SSL
termination and ...
© Copyright 2014 Pivotal. All rights reserved. 35
Install runtime and
container
Install services (db,
messaging, hadoop, …...
© Copyright 2014 Pivotal. All rights reserved. 36
Install runtime and
container
Install services (db,
messaging, hadoop, …...
© Copyright 2014 Pivotal. All rights reserved.
Deploy to dev
The Pivotal CF way"
© Copyright 2014 Pivotal. All rights reserved.
Deploy to dev
>cf push!
Cloud
Controller
Health
Manager
NATS
(message bus)
...
© Copyright 2014 Pivotal. All rights reserved. 39
The operator in the PaaS era"
Developer
 Operator
© Copyright 2014 Pivotal. All rights reserved. 40
The operator in the PaaS era"
© Copyright 2014 Pivotal. All rights reserved. 41
Operator
Concerns
Monitor the
platform
Handle upgrades
and updates
Plan ...
© Copyright 2014 Pivotal. All rights reserved. 42
IaaS
Pivotal CF
Install the
platform
Setup High
Availability
Handle live...
© Copyright 2014 Pivotal. All rights reserved. 43
IaaS
BOSH Director BOSH Agent
Mobile Services
for Pivotal CF
ElasticSear...
© Copyright 2014 Pivotal. All rights reserved. 44
IaaS
BOSH Director BOSH Agent
Mobile Services
for Pivotal CF
ElasticSear...
© Copyright 2014 Pivotal. All rights reserved.
BOSH"
© Copyright 2014 Pivotal. All rights reserved. 46
Provision services,
not machines
Enables continuous
delivery
Cloud-agnos...
© Copyright 2014 Pivotal. All rights reserved. 47
Ops Manager + BOSH"
Blobstore
BOSH
Health
Monitor
DB
Deploy my
Services
...
© Copyright 2014 Pivotal. All rights reserved. 48
Operator
Concerns
Monitor the
platform
Handle upgrades
and updates
Plan ...
© Copyright 2014 Pivotal. All rights reserved. 49
Orgs, Spaces, Users and Quotas"
© Copyright 2014 Pivotal. All rights reserved. 50
Organizations"
Logical division within a Pivotal CF
install / Foundation...
© Copyright 2014 Pivotal. All rights reserved. 51
Quotas and Plans"
Different quota limits (e.g. “small”,
“enterprise”, “d...
© Copyright 2014 Pivotal. All rights reserved. 52
Spaces"
Logical sub-division within an
organization
Services and Applica...
© Copyright 2014 Pivotal. All rights reserved. 53
© Copyright 2014 Pivotal. All rights reserved. 54
Operator
Concerns
Monitor the
platform
Handle upgrades
and updates
Plan ...
© Copyright 2014 Pivotal. All rights reserved. 55
Platform Monitoring"
How do I know when to scale DEAs?
How many requests...
© Copyright 2014 Pivotal. All rights reserved. 56
Platform Monitoring"
Pivotal Ops Metrics provides a single
JMX interface...
© Copyright 2014 Pivotal. All rights reserved. 57
Platform Monitoring"
Collector
JMX
Provider
JMX Monitoring
Tool
© Copyright 2014 Pivotal. All rights reserved. 58
Platform Monitoring"
Collector
JMX
Provider
JMX Monitoring
Tool
© Copyright 2014 Pivotal. All rights reserved. 59
Operator
Concerns
Monitor the
platform
Handle upgrades
and updates
Plan ...
© Copyright 2014 Pivotal. All rights reserved. 60
4 Layers of built-in High Availability"
Application Instance
Platform Pr...
© Copyright 2014 Pivotal. All rights reserved. 61
4 Layers of built-in High Availability"
Application Instance
Platform Pr...
© Copyright 2014 Pivotal. All rights reserved. 62
App Instance HA"
Blobstore
Router
Cloud Controller
DEA
Messaging (NATS)
...
© Copyright 2014 Pivotal. All rights reserved. 63
4 Layers of built-in High Availability"
Application Instance
Platform Pr...
© Copyright 2014 Pivotal. All rights reserved. 64
Platform Processes HA"
Blobstore
BOSH
Health
Monitor
DB
Messaging
Health...
© Copyright 2014 Pivotal. All rights reserved. 65
Platform Processes HA"
Target
VMCloud Controller
Agent ProcessRestart
© Copyright 2014 Pivotal. All rights reserved. 66
4 Layers of built-in High Availability"
Application Instance
Platform Pr...
© Copyright 2014 Pivotal. All rights reserved. 67
Platform VMs HA"
Blobstore
BOSH
Health
Monitor
DB
Messaging
Health Manag...
© Copyright 2014 Pivotal. All rights reserved. 68
4 Layers of built-in High Availability"
Application Instance
Platform Pr...
© Copyright 2014 Pivotal. All rights reserved.
Availability Zone #2
69
Availability Zones"
DEA
DEA
DEA
Router
Blobstore
Cl...
© Copyright 2014 Pivotal. All rights reserved. 70
Operator
Concerns
Monitor the
platform
Handle upgrades
and updates
Plan ...
© Copyright 2014 Pivotal. All rights reserved. 71
© Copyright 2014 Pivotal. All rights reserved. 72
© Copyright 2014 Pivotal. All rights reserved.
Bonus Demo Time - Diego
73
© Copyright 2014 Pivotal. All rights reserved. 74
•  Support for multiple backend implementations without warden rewrite
•...
© Copyright 2014 Pivotal. All rights reserved.
So What?
75
© Copyright 2014 Pivotal. All rights reserved. 76
One Polyglot Cluster
© Copyright 2014 Pivotal. All rights reserved.
The image cannot be
displayed. Your computer may
not have enough memory to
...
Upcoming SlideShare
Loading in …5
×

Pivotal CenturyLink Cloud Platform Seminar Presentations: Architecture & Operations

843 views

Published on

To learn more about Pivotal Cloud Foundry, visit pivotal.io/platform-as-a-service/pivotal-cloud-foundry

Published in: Technology
  • Be the first to comment

Pivotal CenturyLink Cloud Platform Seminar Presentations: Architecture & Operations

  1. 1. © Copyright 2014 Pivotal. All rights reserved. The image cannot be displayed. Your computer may not have enough memory to Pivotal Cloud Platform Deep Dive Architecture and The Operator Experience 1
  2. 2. © Copyright 2015 Pivotal. All rights reserved. Architecture and the Operator Experience •  Pivotal Cloud Foundry Architecture •  Structured Platform for Cloud Native Apps •  One Click CenturyLink Ops Manager and CenturyLink Dashboard •  The Operator Experience
  3. 3. © Copyright 2014 Pivotal. All rights reserved. 3 This…. (not cool)."
  4. 4. © Copyright 2014 Pivotal. All rights reserved. 4 And this…(also not cool)
  5. 5. © Copyright 2014 Pivotal. All rights reserved. 5 Loggregator DEA Pool Router Cloud Controller BOSH Director BOSH Agent UAA/Login Servers Health Manager Service Broker Node(s) Messaging (NATS) ! IaaS Cloud Foundry Architecture Stack"
  6. 6. © Copyright 2014 Pivotal. All rights reserved. 6 Router Cloud Controller Service Broker Node(s) DEA DEA DEA DEA Blobstore DB Runtime 1.  Upload bits/metadata 2.  Create/bind services 3.  Stage app 4.  Deploy app push app + app MD SC + = Pushing an application"
  7. 7. © Copyright 2014 Pivotal. All rights reserved. 7 Router Cloud Controller DEA Blobstore DB Runtime Detect Compile Upload No System Buildpacks + = Yes `" Runtime
  8. 8. © Copyright 2014 Pivotal. All rights reserved. 8 BlobstoreRouter Cloud Controller DEA Messaging (NATS) DEA DEA Runtime Access App Application containers and scaling"
  9. 9. © Copyright 2014 Pivotal. All rights reserved. 9 DB Router Service credentials reserve resources obtain connection data CLI Cloud Controller Service Broker Data Service Runtime create service (HTTP) bind service (HTTP) create service (HTTP) bind service (HTTP) Service create and bind"
  10. 10. © Copyright 2014 Pivotal. All rights reserved. 10 2 Key Components to Pivotal Cloud Foundry • Ops Manager/ Operations Manager: A web application that you use to deploy and manage a Pivotal Cloud Foundry PaaS • Elastic Runtime: The set of core Cloud Foundry services that are installed, upgraded and scaled via Ops Manager
  11. 11. © Copyright 2014 Pivotal. All rights reserved. Demo"
  12. 12. © Copyright 2014 Pivotal. All rights reserved. 12 Pivotal CF deployment on CenturyLink Cloud"
  13. 13. © Copyright 2014 Pivotal. All rights reserved. 13
  14. 14. © Copyright 2014 Pivotal. All rights reserved. 14
  15. 15. © Copyright 2014 Pivotal. All rights reserved. 15
  16. 16. © Copyright 2014 Pivotal. All rights reserved. 16
  17. 17. © Copyright 2014 Pivotal. All rights reserved. 17
  18. 18. © Copyright 2014 Pivotal. All rights reserved. 18
  19. 19. © Copyright 2014 Pivotal. All rights reserved. 19
  20. 20. © Copyright 2014 Pivotal. All rights reserved. 20
  21. 21. © Copyright 2014 Pivotal. All rights reserved. 21
  22. 22. © Copyright 2014 Pivotal. All rights reserved. 22
  23. 23. © Copyright 2014 Pivotal. All rights reserved. 23
  24. 24. © Copyright 2014 Pivotal. All rights reserved. 24
  25. 25. © Copyright 2014 Pivotal. All rights reserved. 25
  26. 26. © Copyright 2014 Pivotal. All rights reserved. The image cannot be displayed. Your computer may not have enough memory to © Copyright 2014 Pivotal. All rights reserved. What’s on Pivotal Cloud Foundry for an operator? 26
  27. 27. © Copyright 2014 Pivotal. All rights reserved. 27 Pivotal Cloud Foundry operations" Developer Operator
  28. 28. © Copyright 2014 Pivotal. All rights reserved. 28 Install runtime and container Deploy to dev
  29. 29. © Copyright 2014 Pivotal. All rights reserved. 29 Install runtime and container Install services (db, messaging, hadoop, …) Deploy to dev
  30. 30. © Copyright 2014 Pivotal. All rights reserved. 30 Install runtime and container Install services (db, messaging, hadoop, …) Setup load-balancing, SSL termination and dynamic routing Deploy to dev
  31. 31. © Copyright 2014 Pivotal. All rights reserved. 31 Install runtime and container Setup load-balancing, SSL termination and dynamic routing Setup / config High Availability Deploy to dev Install services (db, messaging, hadoop, …)
  32. 32. © Copyright 2014 Pivotal. All rights reserved. 32 Install runtime and container Setup load-balancing, SSL termination and dynamic routing Setup / config High Availability Setup APM Deploy to dev Install services (db, messaging, hadoop, …)
  33. 33. © Copyright 2014 Pivotal. All rights reserved. 33 Install runtime and container Setup load-balancing, SSL termination and dynamic routing Setup / config High Availability Setup APM Setup log streaming Deploy to dev Install services (db, messaging, hadoop, …)
  34. 34. © Copyright 2014 Pivotal. All rights reserved. 34 Install runtime and container Setup load-balancing, SSL termination and dynamic routing Setup / config High Availability Setup APM Setup log streaming Deploy to dev App Deployed Install services (db, messaging, hadoop, …)
  35. 35. © Copyright 2014 Pivotal. All rights reserved. 35 Install runtime and container Install services (db, messaging, hadoop, …) Setup load-balancing and dynamic routing Setup / config High Availability Setup APM Setup log streaming Deploy to dev Deploy to Test Deploy to QA Promote to production Scale up Update app Scale down Redeploy Unbind service Bind service Restart server Change route Scale Platform Create service Delete App Blue-green deployment Check logs scale memory Update app server Change JDK Upgrade app
  36. 36. © Copyright 2014 Pivotal. All rights reserved. 36 Install runtime and container Install services (db, messaging, hadoop, …) Setup load-balancing and dynamic routing Setup / config High Availability Setup APM Setup log streaming Deploy to dev Deploy to Test Deploy to QA Promote to production Scale up Update app Scale down Redeploy Unbind service Bind service Restart server Change route Scale Platform Create service Delete App Blue-green deployment Check logs Escale memory Update app server Change JDK Upgrade app
  37. 37. © Copyright 2014 Pivotal. All rights reserved. Deploy to dev The Pivotal CF way"
  38. 38. © Copyright 2014 Pivotal. All rights reserved. Deploy to dev >cf push! Cloud Controller Health Manager NATS (message bus) Router App Deployed The Pivotal CF way"
  39. 39. © Copyright 2014 Pivotal. All rights reserved. 39 The operator in the PaaS era" Developer Operator
  40. 40. © Copyright 2014 Pivotal. All rights reserved. 40 The operator in the PaaS era"
  41. 41. © Copyright 2014 Pivotal. All rights reserved. 41 Operator Concerns Monitor the platform Handle upgrades and updates Plan capacity Manage users and quotas Install the platform Setup High Availability
  42. 42. © Copyright 2014 Pivotal. All rights reserved. 42 IaaS Pivotal CF Install the platform Setup High Availability Handle live upgrades and updates Scale and plan capacity Install and manage servicesTarget multiple clouds
  43. 43. © Copyright 2014 Pivotal. All rights reserved. 43 IaaS BOSH Director BOSH Agent Mobile Services for Pivotal CF ElasticSearch for Pivotal CF CloudBees Jenkins Enterprise Cassandra for Pivotal CF
  44. 44. © Copyright 2014 Pivotal. All rights reserved. 44 IaaS BOSH Director BOSH Agent Mobile Services for Pivotal CF ElasticSearch for Pivotal CF CloudBees Jenkins Enterprise Cassandra for Pivotal CF Click to install No downtime updates Explore install logs Click to scale the platform Built-in High Availability Built-in Platform Monitoring Integrated services
  45. 45. © Copyright 2014 Pivotal. All rights reserved. BOSH"
  46. 46. © Copyright 2014 Pivotal. All rights reserved. 46 Provision services, not machines Enables continuous delivery Cloud-agnostic view of Platform Ops Holistic Toolchain for “rule them all" Eliminate bespoke automation on top of config management Why BOSH"
  47. 47. © Copyright 2014 Pivotal. All rights reserved. 47 Ops Manager + BOSH" Blobstore BOSH Health Monitor DB Deploy my Services Worker VMs Messaging Health Manager Cloud Controller BOSH Director NATS IaaS
  48. 48. © Copyright 2014 Pivotal. All rights reserved. 48 Operator Concerns Monitor the platform Handle upgrades and updates Plan capacity Manage users and quotas Install the platform Setup High Availability
  49. 49. © Copyright 2014 Pivotal. All rights reserved. 49 Orgs, Spaces, Users and Quotas"
  50. 50. © Copyright 2014 Pivotal. All rights reserved. 50 Organizations" Logical division within a Pivotal CF install / Foundation. Each organization has its own users and assigned quota User permissions / roles are specified per space within an organization Sub-divided into Spaces
  51. 51. © Copyright 2014 Pivotal. All rights reserved. 51 Quotas and Plans" Different quota limits (e.g. “small”, “enterprise”, “default”, “runaway”) can be assigned per Organization Quota defines •  Total Memory •  Total # of Services •  Total # of Routes
  52. 52. © Copyright 2014 Pivotal. All rights reserved. 52 Spaces" Logical sub-division within an organization Services and Applications are created / specified per Space Users authorized at an organization level can have different roles per space Same Service can have different meanings per space
  53. 53. © Copyright 2014 Pivotal. All rights reserved. 53
  54. 54. © Copyright 2014 Pivotal. All rights reserved. 54 Operator Concerns Monitor the platform Handle upgrades and updates Plan capacity Manage users and quotas Install the platform Setup High Availability
  55. 55. © Copyright 2014 Pivotal. All rights reserved. 55 Platform Monitoring" How do I know when to scale DEAs? How many requests each Router is servicing? What is the current load of my Cloud Controllers?
  56. 56. © Copyright 2014 Pivotal. All rights reserved. 56 Platform Monitoring" Pivotal Ops Metrics provides a single JMX interface to access metrics for each Pivotal CF component •  DEAs •  Cloud Controllers •  Routers •  Health Managers •  NATS, UAA, Login Server, …
  57. 57. © Copyright 2014 Pivotal. All rights reserved. 57 Platform Monitoring" Collector JMX Provider JMX Monitoring Tool
  58. 58. © Copyright 2014 Pivotal. All rights reserved. 58 Platform Monitoring" Collector JMX Provider JMX Monitoring Tool
  59. 59. © Copyright 2014 Pivotal. All rights reserved. 59 Operator Concerns Monitor the platform Handle upgrades and updates Plan capacity Manage users and quotas Install the platform Setup High Availability
  60. 60. © Copyright 2014 Pivotal. All rights reserved. 60 4 Layers of built-in High Availability" Application Instance Platform Processes Platform VMs Availability Zones
  61. 61. © Copyright 2014 Pivotal. All rights reserved. 61 4 Layers of built-in High Availability" Application Instance Platform Processes Platform VMs Availability Zones
  62. 62. © Copyright 2014 Pivotal. All rights reserved. 62 App Instance HA" Blobstore Router Cloud Controller DEA Messaging (NATS) DEA DEA Runtime Health Manager Actual State Cloud Foundry
  63. 63. © Copyright 2014 Pivotal. All rights reserved. 63 4 Layers of built-in High Availability" Application Instance Platform Processes Platform VMs Availability Zones
  64. 64. © Copyright 2014 Pivotal. All rights reserved. 64 Platform Processes HA" Blobstore BOSH Health Monitor DB Messaging Health Manager Target VM Cloud Controller BOSH Director NATS Agent Agent Agent Process Process Process Pivotal CF DEA Agent Process
  65. 65. © Copyright 2014 Pivotal. All rights reserved. 65 Platform Processes HA" Target VMCloud Controller Agent ProcessRestart
  66. 66. © Copyright 2014 Pivotal. All rights reserved. 66 4 Layers of built-in High Availability" Application Instance Platform Processes Platform VMs Availability Zones
  67. 67. © Copyright 2014 Pivotal. All rights reserved. 67 Platform VMs HA" Blobstore BOSH Health Monitor DB Messaging Health Manager BOSH Director NATS Agent Agent Cloud Controller Agent Process Process Process Pivotal CF Cloud Controller Agent Process Ressurector Re-create VM VM is missing…
  68. 68. © Copyright 2014 Pivotal. All rights reserved. 68 4 Layers of built-in High Availability" Application Instance Platform Processes Platform VMs Availability Zones
  69. 69. © Copyright 2014 Pivotal. All rights reserved. Availability Zone #2 69 Availability Zones" DEA DEA DEA Router Blobstore Cloud Controller Health Manager Messaging (NATS) Push app Availability Zone #1 DEA DEA
  70. 70. © Copyright 2014 Pivotal. All rights reserved. 70 Operator Concerns Monitor the platform Handle upgrades and updates Plan capacity Manage users and quotas Install the platform Setup High Availability
  71. 71. © Copyright 2014 Pivotal. All rights reserved. 71
  72. 72. © Copyright 2014 Pivotal. All rights reserved. 72
  73. 73. © Copyright 2014 Pivotal. All rights reserved. Bonus Demo Time - Diego 73
  74. 74. © Copyright 2014 Pivotal. All rights reserved. 74 •  Support for multiple backend implementations without warden rewrite •  Remove dependency between components •  Might as well be in Go Diego? DEA Pool Cloud Controller Health Manager
  75. 75. © Copyright 2014 Pivotal. All rights reserved. So What? 75
  76. 76. © Copyright 2014 Pivotal. All rights reserved. 76 One Polyglot Cluster
  77. 77. © Copyright 2014 Pivotal. All rights reserved. The image cannot be displayed. Your computer may not have enough memory to THANK YOU! See you after the break! 77

×