Part 2: Architecture and the Operator Experience (Pivotal Cloud Platform Roadshow)
Upcoming SlideShare
Loading in...5
×

Like this? Share it with your network

Share

Part 2: Architecture and the Operator Experience (Pivotal Cloud Platform Roadshow)

  • 844 views
Uploaded on

The primary goals of this session are to: ...

The primary goals of this session are to:

Do a deep dive into the CF architecture via animated slides illustrating push, stage, deploy, scale, and health management.

Also do a brief dive into BOSH, including why BOSH, what it is, and animations of how it works. It’s not an operations focused workshop, so we keep the treatment light.

Discuss the value adds to CF BOSH OSS that Pivotal brings through the Pivotal Ops Manager product and our associated ecosystem of data and mobile services.

Quickly prove that I can push an app to a Pivotal CF environment running on vCHS in the same exact way I can push an app to PWS.

Pivotal Cloud Platform Roadshow is coming to a city near you!

Join Pivotal technologists and learn how to build and deploy great software on a modern cloud platform. Find your city and register now http://bit.ly/1poA6PG

More in: Software
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
844
On Slideshare
823
From Embeds
21
Number of Embeds
2

Actions

Shares
Downloads
120
Comments
0
Likes
5

Embeds 21

https://twitter.com 12
http://www.slideee.com 9

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Pivotal Cloud Platform Deep Dive Part 2: Architecture and The Operator Experience Pivotal CF Team © Copyright 2014 Pivotal. All rights reserved. 2
  • 2. Cloud Foundry Architecture Stack Router Cloud Controller UAA/Login Servers Health Manager Service Broker Node(s) Loggregator DEA Pool Messaging (NATS) BOSH Director BOSH Agent ! IaaS © Copyright 2014 Pivotal. All rights reserved. 3
  • 3. Pushing an application Router Blobstore DB SC Cloud Controller Service Broker Node(s) DEA DEA DEA DEA Runtime push app + app MD 1. Upload bits/metadata 2. Create/bind services 3. Stage app 4. Deploy app + = © Copyright 2014 Pivotal. All rights reserved. 4
  • 4. Application Staging Router Blobstore DB Cloud Controller DEA Runtime Detect Compile Upload No System Buildpacks + = Yes © Copyright 2014 Pivotal. All rights reserved. 5
  • 5. Application containers and scaling Blobstore Router Cloud Controller DEA Messaging (NATS) DEA DEA Runtime Access App © Copyright 2014 Pivotal. All rights reserved. 6
  • 6. Service create and bind DB CLI Cloud create service (HTTP) bind service (HTTP) Router Service credentials reserve resources obtain connection data Controller Service Broker Data Service create service (HTTP) bind service (HTTP) Runtime © Copyright 2014 Pivotal. All rights reserved. 7
  • 7. What’s on Pivotal CF for an operator? © Copyright 2014 Pivotal. © Copyright 2014 Pivotal. AAllll rriigghhttss rreesseerrvveedd.. 8
  • 8. Pivotal CF operations Developer Operator © Copyright 2014 Pivotal. All rights reserved. 9
  • 9. Install runtime and container Deploy to dev © Copyright 2014 Pivotal. All rights reserved. 10
  • 10. Install runtime and container Install services (db, messaging, hadoop, …) Deploy to dev © Copyright 2014 Pivotal. All rights reserved. 11
  • 11. Install runtime and container Install services (db, messaging, hadoop, …) Setup load-balancing, SSL termination and dynamic routing Deploy to dev © Copyright 2014 Pivotal. All rights reserved. 12
  • 12. Install runtime and container Install services (db, messaging, hadoop, …) Setup load-balancing, SSL termination and dynamic routing Setup / config High Availability Deploy to dev © Copyright 2014 Pivotal. All rights reserved. 13
  • 13. Install runtime and container Install services (db, messaging, hadoop, …) Setup load-balancing, SSL termination and dynamic routing Setup / config High Availability Setup APM Deploy to dev © Copyright 2014 Pivotal. All rights reserved. 14
  • 14. Install runtime and container Install services (db, messaging, hadoop, …) Setup load-balancing, SSL termination and dynamic routing Setup / config High Availability Setup APM Setup log streaming Deploy to dev © Copyright 2014 Pivotal. All rights reserved. 15
  • 15. Install runtime and container Install services (db, messaging, hadoop, …) Setup load-balancing, SSL termination and dynamic routing Setup / config High Availability Setup APM Setup log streaming Deploy to dev App Deployed © Copyright 2014 Pivotal. All rights reserved. 16
  • 16. Install runtime and container Install services (db, messaging, hadoop, …) Setup load-balancing and dynamic routing Setup / config High Availability Setup APM Setup log streaming Blue-green deployment Restart server Create service Deploy to dev Upgrade app Deploy to Test Change JDK Redeploy Scale up Scale Platform Update app Bind service Deploy to QA Update app server Unbind service Change route Promote to production Escale memory Check logs Scale down Delete App © Copyright 2014 Pivotal. All rights reserved. 17
  • 17. Install runtime and container Install services (db, messaging, hadoop, …) Setup load-balancing and dynamic routing Setup / config High Availability Setup APM Setup log streaming Blue-green deployment Restart server Create service Deploy to dev Upgrade app Deploy to Test Change JDK Redeploy Scale up Scale Platform Update app Bind service Deploy to QA Update app server Unbind service Change route Promote to production Escale memory Check logs Scale down Delete App © Copyright 2014 Pivotal. All rights reserved. 18
  • 18. The Pivotal CF way © Copyright 2014 Pivotal. All rights reserved. Deploy to dev
  • 19. The Pivotal CF way © Copyright 2014 Pivotal. All rights reserved. Deploy to dev > cf push Cloud Controller Health Manager NATS (message bus) Router App Deployed
  • 20. The operator in the PaaS era Developer Operator © Copyright 2014 Pivotal. All rights reserved. 21
  • 21. The operator in the PaaS era © Copyright 2014 Pivotal. All rights reserved. 22
  • 22. Operator Concerns Setup High Availability Monitor the platform Install the platform Handle upgrades and updates Plan capacity Manage users and quotas © Copyright 2014 Pivotal. All rights reserved. 23
  • 23. Pivotal CF Target multiple services IaaS Install the platform Setup High Availability clouds Handle live upgrades and updates Install and manage Scale and plan capacity © Copyright 2014 Pivotal. All rights reserved. 24
  • 24. Mobile Services for Pivotal CF Cassandra for Pivotal CF ElasticSearch for Pivotal CF CloudBees Jenkins Enterprise BOSH Director BOSH Agent IaaS © Copyright 2014 Pivotal. All rights reserved. 25
  • 25. Mobile Services for Pivotal CF Cassandra for Pivotal CF ElasticSearch for Pivotal CF CloudBees Jenkins Enterprise BOSH Director BOSH Agent IaaS Click to install No downtime updates Explore install logs Click to scale the platform Built-in High Availability Built-in Platform Monitoring Integrated services © Copyright 2014 Pivotal. All rights reserved. 26
  • 26. © Copyright 2014 Pivotal. All rights reserved. Demo
  • 27. BOSH © Copyright 2014 Pivotal. All rights reserved.
  • 28. Why BOSH Provision services, not machines Enables continuous delivery Cloud-agnostic view of Platform Ops Holistic Toolchain for “rule them all" Eliminate bespoke automation on top of config management © Copyright 2014 Pivotal. All rights reserved. 29
  • 29. Ops Manager + BOSH DB Blobstore BOSH Health Monitor Deploy my Services Worker VMs Messaging Health Manager Cloud Controller Target VM BOSH Director NATS IaaS © Copyright 2014 Pivotal. All rights reserved. 30
  • 30. Operator Concerns Setup High Availability Monitor the platform Install the platform Handle upgrades and updates Plan capacity Manage users and quotas © Copyright 2014 Pivotal. All rights reserved. 31
  • 31. Orgs, Spaces, Users and Quotas © Copyright 2014 Pivotal. All rights reserved. 32
  • 32. Organizations Logical division within a Pivotal CF install / Foundation. Each organization has its own users and assigned quota User permissions / roles are specified per space within an organization Sub-divided into Spaces © Copyright 2014 Pivotal. All rights reserved. 33
  • 33. Quotas and Plans Different quota limits (e.g. “small”, “enterprise”, “default”, “runaway”) can be assigned per Organization Quota defines © Copyright 2014 Pivotal. All rights reserved. 34 !• Total Memory • Total # of Services • Total # of Routes
  • 34. Spaces Logical sub-division within an organization Users authorized at an organization level can have different roles per space Services and Applications are created / specified per Space Same Service can have different meanings per space © Copyright 2014 Pivotal. All rights reserved. 35
  • 35. © Copyright 2014 Pivotal. All rights reserved. 36
  • 36. Operator Concerns Setup High Availability Monitor the platform Install the platform Handle upgrades and updates Plan capacity Manage users and quotas © Copyright 2014 Pivotal. All rights reserved. 37
  • 37. Platform Monitoring How do I know when to scale DEAs? How many requests each Router is servicing? What is the current load of my Cloud Controllers? © Copyright 2014 Pivotal. All rights reserved. 38
  • 38. Platform Monitoring Pivotal Ops Metrics provides a single JMX interface to access metrics for each Pivotal CF component • DEAs • Cloud Controllers • Routers • Health Managers • NATS, UAA, Login Server, … © Copyright 2014 Pivotal. All rights reserved. 39
  • 39. Platform Monitoring JMX Provider Collector JMX Monitoring Tool © Copyright 2014 Pivotal. All rights reserved. 40
  • 40. Platform Monitoring JMX Provider Collector JMX Monitoring Tool © Copyright 2014 Pivotal. All rights reserved. 41
  • 41. Operator Concerns Setup High Availability Monitor the platform Install the platform Handle upgrades and updates Plan capacity Manage users and quotas © Copyright 2014 Pivotal. All rights reserved. 42
  • 42. 4 Layers of built-in High Availability Application Instance Platform Processes Platform VMs Availability Zones © Copyright 2014 Pivotal. All rights reserved. 43
  • 43. 4 Layers of built-in High Availability Application Instance Platform Processes Platform VMs Availability Zones © Copyright 2014 Pivotal. All rights reserved. 44
  • 44. App Instance HA Blobstore Router Cloud Controller DEA Messaging (NATS) DEA DEA Actual State Health Manager Cloud Foundry Runtime © Copyright 2014 Pivotal. All rights reserved. 45
  • 45. 4 Layers of built-in High Availability Application Instance Platform Processes Platform VMs Availability Zones © Copyright 2014 Pivotal. All rights reserved. 46
  • 46. DB © Copyright 2014 Pivotal. All rights reserved. 47 Platform Processes HA Blobstore BOSH Health Monitor Pivotal CF DEA Agent Process Health Manager Agent Messaging Agent Process Process Cloud Controller Target BOSH Director NATS Agent Process
  • 47. Platform Processes HA Cloud ControllTearrget Agent PRreoscteasrts © Copyright 2014 Pivotal. All rights reserved. 48
  • 48. 4 Layers of built-in High Availability Application Instance Platform Processes Platform VMs Availability Zones © Copyright 2014 Pivotal. All rights reserved. 49
  • 49. DB © Copyright 2014 Pivotal. All rights reserved. 50 Platform VMs HA Blobstore BOSH Health Monitor Pivotal CF Cloud Controller Agent Process Health Manager Agent Messaging BOSH Director NATS Agent Process Process Cloud Controller Agent Process Ressurector Re-create VM VM is missing…
  • 50. 4 Layers of built-in High Availability Application Instance Platform Processes Platform VMs Availability Zones © Copyright 2014 Pivotal. All rights reserved. 51
  • 51. Messaging (NATS) © Copyright 2014 Pivotal. All rights reserved. Availability Zone #2 52 Availability Zones DEA DEA DEA Router Blobstore Cloud Controller Health Manager Push app Availability Zone #1 DEA DEA
  • 52. Operator Concerns Setup High Availability Monitor the platform Install the platform Handle upgrades and updates Plan capacity Manage users and quotas © Copyright 2014 Pivotal. All rights reserved. 53
  • 53. Pivotal CF: Enterprise Grade SW Delivery Simple & Comprehensive • End to end platform to iterate quickly and build highly scalable cloud apps • IT Ops automation with no scripts, no templates, no config headaches • Easy to use management dashboard Scalable & Efficient • Elastic scale of PaaS capacity and applications through simple interfaces or scripting • Higher application instance density on the same IaaS footprint through advanced containerization Extensible • Independent of the IaaS provider, the runtime languages supported & the brokered services • Simple APIs ensure easy extension and customization Governed & Secure • Individual and team-based roles and permissions • Easy integration w/ 3rd party tools and agents Highly Available • Built in health monitoring and management of applications and the platform • Zero downtime deploys/updates of the platform and applications © Copyright 2014 Pivotal. All rights reserved. 54
  • 54. Pivotal CF: The Platform for a New Era of Software Innovation INTEGRATED OPERATOR FUNCTIONS READY MIDDLEWARE SERVICES AUTO DEPLOY AND SCALE • Instant Dynamic Routing • Streaming Logging Agg • ID/team/RBAC/Policy • APM, Auto-scaling • Ready integration • Four layers of built-in Availability • Auto-detect runtimes, frameworks • “Push and it works” model • CF Push [.WAR] • CF Push [Docker] • CF Push [.ASP] • Elastic Pivotal HD • HAWQ Analytics • Mobile Push • Mobile Sync • Mobile API • MySQL HA • Redis • Rabbit MQ • Elastic Search • Cassandra • Jenkins (Partner) ….and more DEPLOY, OPERATE, UPDATE, SCALE ON ANY INFRASTRUCTURE © Copyright 2014 Pivotal. All rights reserved. 55
  • 55. A NEW PLATFORM FOR A NEW ERA