Journey To The Cloud Native Enterprise:
Pivotal Cloud Foundry Technical Overview
Vijay Rajagopal
Advisory Platform Architect
Pivotal
#PivotalForum #CloudNative #PaaS #Microservices #DevOps #Containers #Multicloud #CloudFoundry
3© 2016 Pivotal Software, Inc. All rights reserved.
The Cloud Platform Evolution
TRADITIONAL IAAS
Virtualization
Platform
Virtualization
Platform
Operating SystemOperating System
DatabaseDatabase
Web/App
Server
Web/App
Server
Messagin
g
Messagin
g
Your Application
Code
Your Application
Code
Physical ServersPhysical Servers
DatabaseDatabase
Web/App
Server
Web/App
Server
Messagin
g
Messagin
g
Your Application
Code
Your Application
Code
IAASIAAS
Your Application
Code
Your Application
Code
PAAS
PAAS
IAASIAAS
CLOUD NATIVE
PLATFORM
4© 2016 Pivotal Software, Inc. All rights reserved.
The Innovation Gap in Traditional IT
W
eeks/M
onths
Developer Operator
5© 2016 Pivotal Software, Inc. All rights reserved.
“The traditional model is that you take
your software to the wall that separates
development and operations, and throw
it over and then forget about it.”
“Not in Amazon.
You build it. You run it.”
-Werner Vogels, CTO
Amazon
Code
to
Production
every
11
seconds
6© 2016 Pivotal Software, Inc. All rights reserved.
Three layers supporting the full App life-cycle (Dev through Prod)
12 factor apps &
Microservices
12 factor apps &
Microservices
Containers
Orchestration
Containers
Orchestration
Infrastructure
Automation
Infrastructure
Automation
Introducing: The Cloud Native Platform
Polyglot Buildpacks,
Spring Boot & Cloud
Polyglot Buildpacks,
Spring Boot & Cloud
Elastic Runtime &
Platform Services
Elastic Runtime &
Platform Services
Operation Manager
& BOSH
Operation Manager
& BOSH
Cloud Native
Frameworks
Cloud Native
Frameworks
Cloud Native
Runtimes
Cloud Native
Runtimes
Cloud Native
Operations
Cloud Native
Operations
Shared Responsibility CultureShared Responsibility Culture
Hours/M
inutes
* A Structured Platform, based on an Industry Open Source Standard
7© 2016 Pivotal Software, Inc. All rights reserved.
“Get rid of all inefficacies in a
85 year-old process”
“100 days down to minutes…Conceive
an Insurance product on a Monday,
deliver it on a Friday”
“A great platform to change the way a
company thinks”Andy Zitney, SVP
Infrastructure Services
CF Summit 2015
Innovate
or Die
(vs
Sam
e-M
ess-for-Less)
9© 2016 Pivotal Software, Inc. All rights reserved.
Application
Framework
Infrastructure
Automation
Platform
Runtime
Frameworks designed for microservice
architectures with components for
service discovery, metrics, circuit
breakers and more.
Application container runtime with data
services, automated build pipeline,
routing, health management , APM and
logging.
API-based infrastructure provisioning
that delivers bit-for-bit, consistent, self-
healing deployments across private and
public cloud.
A complete framework for delivering software rapidly,
consistently and reliably at scale.
Pivotal Cloud Foundry
Dev
IT Ops
IT Ops
Dev
CultureCulture
BOSH
Spring
Cloud
Spring
Boot
10© 2016 Pivotal Software, Inc. All rights reserved.
Container Scheduling
Application Framework
ServicesPlatform Runtime
Routing DatabaseConfigurationService Discovery
Big Data
Object Storage
Mobile
Build CI
User ProvidedLogging & Metrics Messaging
Circuit
Breakers
12 Factor Apps
RESTful
Services
Microservices
.NETSpring Boot Node.jsRuby on Rails
Operations
Zero Downtime
Deployments
Failover &
Recovery
Scaling
Security
Patching
Platform
Upgrades
Infrastructur
e
OpenStack AmazonVMware
11© 2016 Pivotal Software, Inc. All rights reserved.
SERVICES
MYSQL HA
RIAK CS
HD
GEMFIRE
REDIS
RABBITMQ
DATASTAX CASSANDRA
MONGODB
NEO4J
CLOUDBEES J ENKINS
API GATEWAY
DATA SYNC
PUSH NOTIFICATIONS
APP DISTRIBUTION
ELASTIC RUNTIME
DIEGO
(DOCKER FILES, LINUX
APPS, .NET APPS)
CLOUD CONTROLLER
ROUTER
LOGIN SERVER / UAA
LOGGREGATOR
BLOBSTORE
PROXY LOAD BALANCER
ELASTIC RUNTIME ADD-ONS
USER INTERFACES
METRICS SERVER
APM
cf CLI
AUTO-SCALING
LDAP / AD (SAML)
NOTIFICATIONS
OPS METRICS
APPS MANAGER
SINGLE SIGN ON (SSO)
High Level Architecture
PIVOTAL NETWORK
BOSH
OPS MANAGER
vCloud AirVMWAREOPENSTACKAWS …
CERTIFICATIONDOCUMENTATIONSUPPORT
• Multi-cloud platform, that is
infrastructure agnostic
• Single pane of glass visibility
into entire platform
• Enables portability and
security of applications
12© 2016 Pivotal Software, Inc. All rights reserved.
Let’s Dive Deeper…
1. Development Frameworks
2. Elastic Runtimes
3. Infrastructure Automation
13© 2016 Pivotal Software, Inc. All rights reserved.
Cloud Native Frameworks
All the tools developers and architects need to
create resilient, secure, and scalable applications
14© 2016 Pivotal Software, Inc. All rights reserved.
Empowered
Culture
Infrastructure
Automation
Runtime
Platform
Cloud Native Application Framework
12 factor appMicroservices Polyglot
Java, Ruby,
Python,
Node, PHP,
Go
15© 2016 Pivotal Software, Inc. All rights reserved.
What are Microservices ?
Loosely coupled service oriented architecture with bounded
contexts
If every service has to be updated in
concert, it’s not loosely coupled!
If you have to know about surrounding
services you don’t have a bounded
context.
16© 2016 Pivotal Software, Inc. All rights reserved.
- Managed
independently
- Not held up by
slowest “train”
- Fits cloud native
“scale-up” model
- Reduces risk
Source: Diagram from Leading the Transformation, 2015.
17© 2016 Pivotal Software, Inc. All rights reserved.
Use 12 factor app principles to create cloud
ready applications
A set of best practices for
developing and deploying
cloud-native software.
Practices translate into
platform features and
workflow requirements.
Codebase Dependencies Config
Backing
Services
Build,
Release,
Run
Processes
Port
Binding
Concurrency
Disposability
Dev/Prod
Parity
Logs
Admin
Processes
Source: “The Twelve-Factor App.”
18© 2016 Pivotal Software, Inc. All rights reserved.
Config Server
Service Registry
Circuit Breaker
Dashboard
19© 2016 Pivotal Software, Inc. All rights reserved.
We wrote the book on it
20© 2016 Pivotal Software, Inc. All rights reserved.
Cloud Native Runtimes
Quicken the pace of delivering software reliably
and securely at scale
21© 2016 Pivotal Software, Inc. All rights reserved.
Empowered
Culture
Application
Framework
Cloud Native Runtime Platform
Self ServiceContainers Self Healing
Infrastructure
Automation
22© 2016 Pivotal Software, Inc. All rights reserved.
Cloud Native Runtime Platform
 Integrate everything an organization needs to deploy and
manage the application lifecycle
– Building and orchestrating containers
– Dynamic app scheduling
– Log aggregation
– Self healing
– Auto-scaling
– Application Performance Monitoring
– Security & Isolation
– Roles and Policy Management
23© 2016 Pivotal Software, Inc. All rights reserved.
Everything to deploy and manage the app
APPLICATIONHealth
management
APM
Log
aggregation
Roles and
Policy Security and
Isolation
Scaling
Blue green
deployment
24© 2016 Pivotal Software, Inc. All rights reserved.
Application Deployment Overview
① Upload app
bits and
metadata
push apppush app
Router
② Create and bind services
③ Stage application
④ Deploy application
Pivotal CF
Elastic
Runtime
BlobstoreBlobstore DBDB
Cloud
Controller
Cloud
Controller
Service Broker
Node(s)
Service Broker
Node(s)
DEADEA
DEADEA
DEADEA
“CELL”“CELL”
+ app MD+ app MD
+ =
Service
credentials
25© 2016 Pivotal Software, Inc. All rights reserved.
BBSBBS
Services
Container scheduler handles workloads
BRAINBRAIN
26© 2016 Pivotal Software, Inc. All rights reserved.
BBSBBS
Services
Dynamic load balancing
BRAINBRAIN
27© 2016 Pivotal Software, Inc. All rights reserved.
Dynamic load balancing
BBSBBS
Services
BRAINBRAIN
28© 2016 Pivotal Software, Inc. All rights reserved.
Remediation and rebalance of workloads
BBSBBS
Services
BRAINBRAIN
29© 2016 Pivotal Software, Inc. All rights reserved.
Remediation and rebalance of workloads
BBSBBS
Services
BRAINBRAIN
30© 2016 Pivotal Software, Inc. All rights reserved.
Remediation and rebalance of workloads
BBSBBS
Services
BRAINBRAIN
31© 2016 Pivotal Software, Inc. All rights reserved.
BUT…You must be this tall
to use Microservices
https://www.flickr.com/photos/gusset/3723
• RAPID PROVISIONING
• BASIC MONITORING
• RAPID APPLICATION DEPLOYMENT
• DEVOPS CULTURE
“It Takes a Platform”
http://martinfowler.com/bliki/MicroservicePrerequisites.html
32© 2016 Pivotal Software, Inc. All rights reserved.
Why Build It yourself?
Pivotal Cloud Foundry Spring Cloud
Services
33© 2016 Pivotal Software, Inc. All rights reserved.
Spring Cloud Service on Pivotal Cloud Foundry
 Built-in essential services
– Config Server, Service Registry, Circuit Breaker
 Environment Provisioning / Infrastructure Automation
 On-Demand/Automatic Scaling
 Failover/Resilience
 Routing/Load Balancing
 Data Microservices (Spring Cloud Data Flow)
 Application and Infrastructure Monitoring
34© 2016 Pivotal Software, Inc. All rights reserved.
Cloud Native Infrastructure
Automation
Allow individuals to easily version, package,
deploy and operate software
35© 2016 Pivotal Software, Inc. All rights reserved.
Infrastructure as Code
 Multi-IaaS, Integrated API
 Configuration changes
 No downtime
updates/upgrades
 Remediation
 Scale out/scale in
 Consistency and Reliability
Manage Services, Not Servers
36© 2016 Pivotal Software, Inc. All rights reserved.
Declarative Idempotent
Service Abstractions
declared state current state
Three-in-One
1. Automated
Provisioning
2. Configuration
Management
3. Release
Engineering
http://pivotal.io/pcf-dev
PCF Dev
http://pivotal.io/pcf-dev
PCF Dev
41© 2016 Pivotal Software, Inc. All rights reserved.
vrajagopal@pivotal.io
Pivotal Cloud Foundry: A Technical Overview

Pivotal Cloud Foundry: A Technical Overview

  • 2.
    Journey To TheCloud Native Enterprise: Pivotal Cloud Foundry Technical Overview Vijay Rajagopal Advisory Platform Architect Pivotal #PivotalForum #CloudNative #PaaS #Microservices #DevOps #Containers #Multicloud #CloudFoundry
  • 3.
    3© 2016 PivotalSoftware, Inc. All rights reserved. The Cloud Platform Evolution TRADITIONAL IAAS Virtualization Platform Virtualization Platform Operating SystemOperating System DatabaseDatabase Web/App Server Web/App Server Messagin g Messagin g Your Application Code Your Application Code Physical ServersPhysical Servers DatabaseDatabase Web/App Server Web/App Server Messagin g Messagin g Your Application Code Your Application Code IAASIAAS Your Application Code Your Application Code PAAS PAAS IAASIAAS CLOUD NATIVE PLATFORM
  • 4.
    4© 2016 PivotalSoftware, Inc. All rights reserved. The Innovation Gap in Traditional IT W eeks/M onths Developer Operator
  • 5.
    5© 2016 PivotalSoftware, Inc. All rights reserved. “The traditional model is that you take your software to the wall that separates development and operations, and throw it over and then forget about it.” “Not in Amazon. You build it. You run it.” -Werner Vogels, CTO Amazon Code to Production every 11 seconds
  • 6.
    6© 2016 PivotalSoftware, Inc. All rights reserved. Three layers supporting the full App life-cycle (Dev through Prod) 12 factor apps & Microservices 12 factor apps & Microservices Containers Orchestration Containers Orchestration Infrastructure Automation Infrastructure Automation Introducing: The Cloud Native Platform Polyglot Buildpacks, Spring Boot & Cloud Polyglot Buildpacks, Spring Boot & Cloud Elastic Runtime & Platform Services Elastic Runtime & Platform Services Operation Manager & BOSH Operation Manager & BOSH Cloud Native Frameworks Cloud Native Frameworks Cloud Native Runtimes Cloud Native Runtimes Cloud Native Operations Cloud Native Operations Shared Responsibility CultureShared Responsibility Culture Hours/M inutes * A Structured Platform, based on an Industry Open Source Standard
  • 7.
    7© 2016 PivotalSoftware, Inc. All rights reserved. “Get rid of all inefficacies in a 85 year-old process” “100 days down to minutes…Conceive an Insurance product on a Monday, deliver it on a Friday” “A great platform to change the way a company thinks”Andy Zitney, SVP Infrastructure Services CF Summit 2015 Innovate or Die (vs Sam e-M ess-for-Less)
  • 8.
    9© 2016 PivotalSoftware, Inc. All rights reserved. Application Framework Infrastructure Automation Platform Runtime Frameworks designed for microservice architectures with components for service discovery, metrics, circuit breakers and more. Application container runtime with data services, automated build pipeline, routing, health management , APM and logging. API-based infrastructure provisioning that delivers bit-for-bit, consistent, self- healing deployments across private and public cloud. A complete framework for delivering software rapidly, consistently and reliably at scale. Pivotal Cloud Foundry Dev IT Ops IT Ops Dev CultureCulture BOSH Spring Cloud Spring Boot
  • 9.
    10© 2016 PivotalSoftware, Inc. All rights reserved. Container Scheduling Application Framework ServicesPlatform Runtime Routing DatabaseConfigurationService Discovery Big Data Object Storage Mobile Build CI User ProvidedLogging & Metrics Messaging Circuit Breakers 12 Factor Apps RESTful Services Microservices .NETSpring Boot Node.jsRuby on Rails Operations Zero Downtime Deployments Failover & Recovery Scaling Security Patching Platform Upgrades Infrastructur e OpenStack AmazonVMware
  • 10.
    11© 2016 PivotalSoftware, Inc. All rights reserved. SERVICES MYSQL HA RIAK CS HD GEMFIRE REDIS RABBITMQ DATASTAX CASSANDRA MONGODB NEO4J CLOUDBEES J ENKINS API GATEWAY DATA SYNC PUSH NOTIFICATIONS APP DISTRIBUTION ELASTIC RUNTIME DIEGO (DOCKER FILES, LINUX APPS, .NET APPS) CLOUD CONTROLLER ROUTER LOGIN SERVER / UAA LOGGREGATOR BLOBSTORE PROXY LOAD BALANCER ELASTIC RUNTIME ADD-ONS USER INTERFACES METRICS SERVER APM cf CLI AUTO-SCALING LDAP / AD (SAML) NOTIFICATIONS OPS METRICS APPS MANAGER SINGLE SIGN ON (SSO) High Level Architecture PIVOTAL NETWORK BOSH OPS MANAGER vCloud AirVMWAREOPENSTACKAWS … CERTIFICATIONDOCUMENTATIONSUPPORT • Multi-cloud platform, that is infrastructure agnostic • Single pane of glass visibility into entire platform • Enables portability and security of applications
  • 11.
    12© 2016 PivotalSoftware, Inc. All rights reserved. Let’s Dive Deeper… 1. Development Frameworks 2. Elastic Runtimes 3. Infrastructure Automation
  • 12.
    13© 2016 PivotalSoftware, Inc. All rights reserved. Cloud Native Frameworks All the tools developers and architects need to create resilient, secure, and scalable applications
  • 13.
    14© 2016 PivotalSoftware, Inc. All rights reserved. Empowered Culture Infrastructure Automation Runtime Platform Cloud Native Application Framework 12 factor appMicroservices Polyglot Java, Ruby, Python, Node, PHP, Go
  • 14.
    15© 2016 PivotalSoftware, Inc. All rights reserved. What are Microservices ? Loosely coupled service oriented architecture with bounded contexts If every service has to be updated in concert, it’s not loosely coupled! If you have to know about surrounding services you don’t have a bounded context.
  • 15.
    16© 2016 PivotalSoftware, Inc. All rights reserved. - Managed independently - Not held up by slowest “train” - Fits cloud native “scale-up” model - Reduces risk Source: Diagram from Leading the Transformation, 2015.
  • 16.
    17© 2016 PivotalSoftware, Inc. All rights reserved. Use 12 factor app principles to create cloud ready applications A set of best practices for developing and deploying cloud-native software. Practices translate into platform features and workflow requirements. Codebase Dependencies Config Backing Services Build, Release, Run Processes Port Binding Concurrency Disposability Dev/Prod Parity Logs Admin Processes Source: “The Twelve-Factor App.”
  • 17.
    18© 2016 PivotalSoftware, Inc. All rights reserved. Config Server Service Registry Circuit Breaker Dashboard
  • 18.
    19© 2016 PivotalSoftware, Inc. All rights reserved. We wrote the book on it
  • 19.
    20© 2016 PivotalSoftware, Inc. All rights reserved. Cloud Native Runtimes Quicken the pace of delivering software reliably and securely at scale
  • 20.
    21© 2016 PivotalSoftware, Inc. All rights reserved. Empowered Culture Application Framework Cloud Native Runtime Platform Self ServiceContainers Self Healing Infrastructure Automation
  • 21.
    22© 2016 PivotalSoftware, Inc. All rights reserved. Cloud Native Runtime Platform  Integrate everything an organization needs to deploy and manage the application lifecycle – Building and orchestrating containers – Dynamic app scheduling – Log aggregation – Self healing – Auto-scaling – Application Performance Monitoring – Security & Isolation – Roles and Policy Management
  • 22.
    23© 2016 PivotalSoftware, Inc. All rights reserved. Everything to deploy and manage the app APPLICATIONHealth management APM Log aggregation Roles and Policy Security and Isolation Scaling Blue green deployment
  • 23.
    24© 2016 PivotalSoftware, Inc. All rights reserved. Application Deployment Overview ① Upload app bits and metadata push apppush app Router ② Create and bind services ③ Stage application ④ Deploy application Pivotal CF Elastic Runtime BlobstoreBlobstore DBDB Cloud Controller Cloud Controller Service Broker Node(s) Service Broker Node(s) DEADEA DEADEA DEADEA “CELL”“CELL” + app MD+ app MD + = Service credentials
  • 24.
    25© 2016 PivotalSoftware, Inc. All rights reserved. BBSBBS Services Container scheduler handles workloads BRAINBRAIN
  • 25.
    26© 2016 PivotalSoftware, Inc. All rights reserved. BBSBBS Services Dynamic load balancing BRAINBRAIN
  • 26.
    27© 2016 PivotalSoftware, Inc. All rights reserved. Dynamic load balancing BBSBBS Services BRAINBRAIN
  • 27.
    28© 2016 PivotalSoftware, Inc. All rights reserved. Remediation and rebalance of workloads BBSBBS Services BRAINBRAIN
  • 28.
    29© 2016 PivotalSoftware, Inc. All rights reserved. Remediation and rebalance of workloads BBSBBS Services BRAINBRAIN
  • 29.
    30© 2016 PivotalSoftware, Inc. All rights reserved. Remediation and rebalance of workloads BBSBBS Services BRAINBRAIN
  • 30.
    31© 2016 PivotalSoftware, Inc. All rights reserved. BUT…You must be this tall to use Microservices https://www.flickr.com/photos/gusset/3723 • RAPID PROVISIONING • BASIC MONITORING • RAPID APPLICATION DEPLOYMENT • DEVOPS CULTURE “It Takes a Platform” http://martinfowler.com/bliki/MicroservicePrerequisites.html
  • 31.
    32© 2016 PivotalSoftware, Inc. All rights reserved. Why Build It yourself? Pivotal Cloud Foundry Spring Cloud Services
  • 32.
    33© 2016 PivotalSoftware, Inc. All rights reserved. Spring Cloud Service on Pivotal Cloud Foundry  Built-in essential services – Config Server, Service Registry, Circuit Breaker  Environment Provisioning / Infrastructure Automation  On-Demand/Automatic Scaling  Failover/Resilience  Routing/Load Balancing  Data Microservices (Spring Cloud Data Flow)  Application and Infrastructure Monitoring
  • 33.
    34© 2016 PivotalSoftware, Inc. All rights reserved. Cloud Native Infrastructure Automation Allow individuals to easily version, package, deploy and operate software
  • 34.
    35© 2016 PivotalSoftware, Inc. All rights reserved. Infrastructure as Code  Multi-IaaS, Integrated API  Configuration changes  No downtime updates/upgrades  Remediation  Scale out/scale in  Consistency and Reliability Manage Services, Not Servers
  • 35.
    36© 2016 PivotalSoftware, Inc. All rights reserved. Declarative Idempotent Service Abstractions declared state current state Three-in-One 1. Automated Provisioning 2. Configuration Management 3. Release Engineering
  • 36.
  • 37.
  • 38.
    41© 2016 PivotalSoftware, Inc. All rights reserved. vrajagopal@pivotal.io