Pivotal Cloud Foundry 101
Sufyaan Kazi
Trusted partner for IT innovation and digital transformation
New mode for cloud-computing – open and enterprise ready
Gold standard for modern software development
3© 2016 Pivotal Software, Inc. All rights reserved.
Who are Pivotal? http://bit.ly/2cmRm9m
4© 2016 Pivotal Software, Inc. All rights reserved.
Who are Pivotal? http://bit.ly/2cmS86h
5© 2016 Pivotal Software, Inc. All rights reserved.
Cloud Native Power Lunch Series
Sufyaan Kazi
skazi@pivotal.io
@sufyaan_kazi
CI/CD Pipeline
What is your target process?
Create an
environment
for the app
• Install the OS, correct
appservers, libraries
etc
• Or create a Docker
image/container (?)
Execute this
application
somewhere
• Find “compute” to run
this app (a VM,
containers etc)
• Or use Kubernetes
(?)
Build an
Artifact
• Run gradle, maven etc.
App &
Container ? ???
• Is the app tied to that
image?
• What happens when the
(OS) needs patching?
• How do you access log
files?
• How do you connect to
a backing service?
???
• Is their anything hardcoded
in the image for each
environment?
• What licenses, ports etc. are
open?
• Any network updates
required?
???
• What is the network
path to access the app?
• What controls
autoscaling?
• What happens when the
container crashes?
And repeat
for SIT,
PreProd,
Prod …
And repeat
for Version 2
….
???
• Is the original image still
valid?
???
• Can we have both old
and new running at the
same time?
7© 2016 Pivotal Software, Inc. All rights reserved.
Platform
Deliver a modern application development and operations environment that lets your developers focus on generating value for customers.
Microservices Open Source Continuous Delivery Containers DevOps
8© Copyright 2016 Pivotal. All rights reserved.
BOSH pre 2013 ...
VSphereBOSH
BOSH
Worker VMs
9© 2016 Pivotal Software, Inc. All rights reserved.
What does it mean to have a “Platform” ?
The minimum features needed…
PaaS
Routing
Load
Balancing
Service
Brokers
Infrastructure
automation
Log
aggregation
Health
monitoring &
recovery
Immutable
artifact
repository
10© Copyright 2016 Pivotal. All rights reserved.
Demo
https://github.com/ihuston/python-cf-examples
11© 2016 Pivotal Software, Inc. All rights reserved.
ORIGINS
2013
Transferred to Pivotal from Vmware
● Open Source
● Cloud Native Architecture
2014
First commercialized by Pivotal
● Pivotal Cloud Foundry (PCF)
● Pivotal Web Services (PWS)
● 1 trillion dollars in market cap
supporting the project
● Top talent recruited from Puppet,
AWS, Google, etc
2015
Governance passed to Cloud
Foundry Foundation
2016
On 7th release of PCF
11
https://github.com/cloudfoundry
12© 2016 Pivotal Software, Inc. All rights reserved.
CLOUD FOUNDRY FOUNDATION
AN OPEN INDUSTRY STANDARD
PLATINUMSILVERGOLD
12
13© Copyright 2016 Pivotal. All rights reserved.
Many flavours of CF
14© Copyright 2016 Pivotal. All rights reserved.
Message Bus
Extend the CF Runtime with
Cloud Foundry BOSH
IaaS
Cloud Foundry
Operations Manager/BOSH
DB
BOSH Director
Blobs
Health Monitor
Deployment
• Packages
• Blobs
• Source
• Jobs
• Manifest
Deploy my
CF
etcd
Target VM
Operator
CELL
Target VMCloud Controller
Target VM
15© Copyright 2016 Pivotal. All rights reserved.
CF High Level Architecture
Elastic Runtime
Dynamic Router
OAuth 2.0 Server (UAA)
CELL
Garden
Build Packs
Login Server
CC & CC Bridge
Blob Store
BBS/etcd
Sys Log
ServiceBrokers
Collector App Log
ROUTING
AUTHENTICATION
APP LIFECYCLE
APP STORAGE
& EXECUTION
MESSAGING
METRICS & LOGGING
BBS Converger
BOSH
16© Copyright 2016 Pivotal. All rights reserved.
Router
Cloud Controller
Cloud Controller
Bridge
Auctioneer BBS
CELL Rep
Executor
CELL Rep
Executor
CELL Rep
Executor
Stage an Application
17© Copyright 2016 Pivotal. All rights reserved.
Demo
https://github.com/Pivotal-Field-Engineering/PCF-demo
18© Copyright 2016 Pivotal. All rights reserved.
CELL
Stage an ApplicationRouter
Cloud Foundry
Elastic Runtime
Blobstore DB
Detect Compile Upload
NoYes
System
Buildpacks
+ =
Cloud Controller
Service
credentials
Cloud Controller
Bridge
Task
19© Copyright 2016 Pivotal. All rights reserved.
Router
Cloud Controller
Cloud Controller
Bridge
Auctioneer BBS
CELL Rep
Executor
CELL Rep
Executor
CELL Rep
Executor
ACCESS
APP
Deploying an Application
20© 2016 Pivotal Software, Inc. All rights reserved.
Containers Pre-date the Docker Hype
Google started
Linux container
effort “Control
Groups”
Added to the
Linux Kernel in
2007
Cloud Foundry
uses Linux
container
technology -
“Warden
containers”
early 2012
Docker is like
github for
container
images
Docker joins
Cloud Foundry
Foundation
Google, MSFT,
IBM working on
orchestration of
multiple Docker
containers
2006 2014
Cloud Foundry has been using container
technology pre-Docker
2012
21© 2016 Pivotal Software, Inc. All rights reserved.
Platform provides standard
Buildpack for runtime*
Platform provides fixed OS
container image
Developer brings app
Developer brings runtime
Docker image
Developer brings Docker
OS image
Developer brings app
Buildpacks Docker
* Devs may also provide their own buildpacks
Platform provides fixed
host OS Kernel
Platform provides fixed
host OS Kernel
Application
Container
Standardization or Customization is Your Choice
AND
22© 2016 Pivotal Software, Inc. All rights reserved.
BUILD PACKS
23© 2016 Pivotal Software, Inc. All rights reserved.
Use 12 factor app principles to create cloud
ready applications
➢ A set of best practices for
developing and deploying
cloud-native software.
➢ Practices translate into
platform features and
workflow requirements.
Codebase Dependencies Config
Backing
Services
Build,
Release,
Run
Processes
Port
Binding
Concurrency
Disposability
Dev/Prod
Parity
Logs
Admin
Processes
Source: “The Twelve-Factor App.”
24© 2015 Pivotal Software, Inc. All rights reserved.
But Microservices!
25© Copyright 2016 Pivotal. All rights reserved.
Demo
https://github.com/skazi-pivotal/spring-boot-cities-service
https://github.com/skazi-pivotal/spring-boot-cities-ui
26© 2016 Pivotal Software, Inc. All rights reserved.
• Eureka
• Hystrix + Turbine
• Ribbon
• Feign
• Zuul
http://netflix.github.io
27© 2016 Pivotal Software, Inc. All rights reserved.
MODERN CLOUD NATIVE PLATFORM
Pivotal Cloud Foundry empowers
companies with a cloud platform
engineered for start-up speed—designed
for continuous innovation, across multiple
clouds, at scale.
28© Copyright 2016 Pivotal. All rights reserved.
Message Bus
Extend the CF Runtime with
Cloud Foundry BOSH
IaaS
Cloud Foundry
Operations Manager/BOSH
DB
BOSH Director
Blobs
Health Monitor
Deployment
• Packages
• Blobs
• Source
• Jobs
• Manifest
Extend my
CF
etcd
Target VM
Operator
CELL
Target VMCloud Controller
Target VM
Jenkins
AGENT
MySQL
AGENT
Cassandra
AGENT
29© Copyright 2016 Pivotal. All rights reserved.
Pivotal CF High Level Architecture
Elastic Runtime
Dynamic Router
OAuth 2.0 Server (UAA)
CELL
Garden
Build Packs
Login Server
CC & CC Bridge
Blob Store
BBS/etcd
Sys Log
ServiceBrokers
Collector App Log
ROUTING
AUTHENTICATION
APP LIFECYCLE
APP STORAGE
& EXECUTION
MESSAGING
METRICS & LOGGING
BBS Converger
BOSH
30© Copyright 2016 Pivotal. All rights reserved.
Demo
https://github.com/pivotal-bank/cf-SpringBootTrader
31© 2016 Pivotal Software, Inc. All rights reserved.
CI/CDwith Concourse (http://concourse.ci/)
32© Copyright 2016 Pivotal. All rights reserved.
Demo
33© 2015 Pivotal Software, Inc. All rights reserved.
We’re Hiring!!
pivotal.io/careers
35© 2016 Pivotal Software, Inc. All rights reserved.
CF OPEN SOURCE
MOMENTUM
Source: http://cloud-foundry.meetup.com/ on Jun 12 2015
53 CORPORATIONS
158 MEETUPS 49 COUNTRIES
21K MEMBERS
2200 DEVELOPERS
65K COMMITS
650 CODE SUBMITTERS
SUBMITTERS
COMMITS
in
from
35
36© 2016 Pivotal Software, Inc. All rights reserved.
36
● Absolutely critical for CF users and ecosystem
● Make it lasting and durable
● CF “Core”:
○ Cloud Foundry Certified PaaS
○ Target Q4 2015
● CF Extensions
○ Target Early 2016
CLOUD FOUNDRY CERTIFICATION PROGRAM Cloud Foundry Core
• Certified Products and “As a
Service” Implementations
• Must Use Specific CF-Release
CFF Maintained Add-ons
• Projects owned by Foundation
• Extend or work with CF Core
• Must meet qualifications for
relevant CF Extension
certification
Certified CF Extensions
• Projects and products external
to the foundation
• Are certified by the foundation
as interoperable with CF Core
Extended Ecosystem
• Projects and products external
to the foundation
• Not certified
BOSH, while not in CF Core,
remains critical to our ecosystem
development efforts and
represents several opportunities
for certification programs.
37© 2016 Pivotal Software, Inc. All rights reserved.
PIVOTAL IS THE LEADING CONTRIBUTOR & EXPERT….
37

Manchester geek night pcf 101

  • 2.
    Pivotal Cloud Foundry101 Sufyaan Kazi Trusted partner for IT innovation and digital transformation New mode for cloud-computing – open and enterprise ready Gold standard for modern software development
  • 3.
    3© 2016 PivotalSoftware, Inc. All rights reserved. Who are Pivotal? http://bit.ly/2cmRm9m
  • 4.
    4© 2016 PivotalSoftware, Inc. All rights reserved. Who are Pivotal? http://bit.ly/2cmS86h
  • 5.
    5© 2016 PivotalSoftware, Inc. All rights reserved. Cloud Native Power Lunch Series Sufyaan Kazi skazi@pivotal.io @sufyaan_kazi
  • 6.
    CI/CD Pipeline What isyour target process? Create an environment for the app • Install the OS, correct appservers, libraries etc • Or create a Docker image/container (?) Execute this application somewhere • Find “compute” to run this app (a VM, containers etc) • Or use Kubernetes (?) Build an Artifact • Run gradle, maven etc. App & Container ? ??? • Is the app tied to that image? • What happens when the (OS) needs patching? • How do you access log files? • How do you connect to a backing service? ??? • Is their anything hardcoded in the image for each environment? • What licenses, ports etc. are open? • Any network updates required? ??? • What is the network path to access the app? • What controls autoscaling? • What happens when the container crashes? And repeat for SIT, PreProd, Prod … And repeat for Version 2 …. ??? • Is the original image still valid? ??? • Can we have both old and new running at the same time?
  • 7.
    7© 2016 PivotalSoftware, Inc. All rights reserved. Platform Deliver a modern application development and operations environment that lets your developers focus on generating value for customers. Microservices Open Source Continuous Delivery Containers DevOps
  • 8.
    8© Copyright 2016Pivotal. All rights reserved. BOSH pre 2013 ... VSphereBOSH BOSH Worker VMs
  • 9.
    9© 2016 PivotalSoftware, Inc. All rights reserved. What does it mean to have a “Platform” ? The minimum features needed… PaaS Routing Load Balancing Service Brokers Infrastructure automation Log aggregation Health monitoring & recovery Immutable artifact repository
  • 10.
    10© Copyright 2016Pivotal. All rights reserved. Demo https://github.com/ihuston/python-cf-examples
  • 11.
    11© 2016 PivotalSoftware, Inc. All rights reserved. ORIGINS 2013 Transferred to Pivotal from Vmware ● Open Source ● Cloud Native Architecture 2014 First commercialized by Pivotal ● Pivotal Cloud Foundry (PCF) ● Pivotal Web Services (PWS) ● 1 trillion dollars in market cap supporting the project ● Top talent recruited from Puppet, AWS, Google, etc 2015 Governance passed to Cloud Foundry Foundation 2016 On 7th release of PCF 11 https://github.com/cloudfoundry
  • 12.
    12© 2016 PivotalSoftware, Inc. All rights reserved. CLOUD FOUNDRY FOUNDATION AN OPEN INDUSTRY STANDARD PLATINUMSILVERGOLD 12
  • 13.
    13© Copyright 2016Pivotal. All rights reserved. Many flavours of CF
  • 14.
    14© Copyright 2016Pivotal. All rights reserved. Message Bus Extend the CF Runtime with Cloud Foundry BOSH IaaS Cloud Foundry Operations Manager/BOSH DB BOSH Director Blobs Health Monitor Deployment • Packages • Blobs • Source • Jobs • Manifest Deploy my CF etcd Target VM Operator CELL Target VMCloud Controller Target VM
  • 15.
    15© Copyright 2016Pivotal. All rights reserved. CF High Level Architecture Elastic Runtime Dynamic Router OAuth 2.0 Server (UAA) CELL Garden Build Packs Login Server CC & CC Bridge Blob Store BBS/etcd Sys Log ServiceBrokers Collector App Log ROUTING AUTHENTICATION APP LIFECYCLE APP STORAGE & EXECUTION MESSAGING METRICS & LOGGING BBS Converger BOSH
  • 16.
    16© Copyright 2016Pivotal. All rights reserved. Router Cloud Controller Cloud Controller Bridge Auctioneer BBS CELL Rep Executor CELL Rep Executor CELL Rep Executor Stage an Application
  • 17.
    17© Copyright 2016Pivotal. All rights reserved. Demo https://github.com/Pivotal-Field-Engineering/PCF-demo
  • 18.
    18© Copyright 2016Pivotal. All rights reserved. CELL Stage an ApplicationRouter Cloud Foundry Elastic Runtime Blobstore DB Detect Compile Upload NoYes System Buildpacks + = Cloud Controller Service credentials Cloud Controller Bridge Task
  • 19.
    19© Copyright 2016Pivotal. All rights reserved. Router Cloud Controller Cloud Controller Bridge Auctioneer BBS CELL Rep Executor CELL Rep Executor CELL Rep Executor ACCESS APP Deploying an Application
  • 20.
    20© 2016 PivotalSoftware, Inc. All rights reserved. Containers Pre-date the Docker Hype Google started Linux container effort “Control Groups” Added to the Linux Kernel in 2007 Cloud Foundry uses Linux container technology - “Warden containers” early 2012 Docker is like github for container images Docker joins Cloud Foundry Foundation Google, MSFT, IBM working on orchestration of multiple Docker containers 2006 2014 Cloud Foundry has been using container technology pre-Docker 2012
  • 21.
    21© 2016 PivotalSoftware, Inc. All rights reserved. Platform provides standard Buildpack for runtime* Platform provides fixed OS container image Developer brings app Developer brings runtime Docker image Developer brings Docker OS image Developer brings app Buildpacks Docker * Devs may also provide their own buildpacks Platform provides fixed host OS Kernel Platform provides fixed host OS Kernel Application Container Standardization or Customization is Your Choice AND
  • 22.
    22© 2016 PivotalSoftware, Inc. All rights reserved. BUILD PACKS
  • 23.
    23© 2016 PivotalSoftware, Inc. All rights reserved. Use 12 factor app principles to create cloud ready applications ➢ A set of best practices for developing and deploying cloud-native software. ➢ Practices translate into platform features and workflow requirements. Codebase Dependencies Config Backing Services Build, Release, Run Processes Port Binding Concurrency Disposability Dev/Prod Parity Logs Admin Processes Source: “The Twelve-Factor App.”
  • 24.
    24© 2015 PivotalSoftware, Inc. All rights reserved. But Microservices!
  • 25.
    25© Copyright 2016Pivotal. All rights reserved. Demo https://github.com/skazi-pivotal/spring-boot-cities-service https://github.com/skazi-pivotal/spring-boot-cities-ui
  • 26.
    26© 2016 PivotalSoftware, Inc. All rights reserved. • Eureka • Hystrix + Turbine • Ribbon • Feign • Zuul http://netflix.github.io
  • 27.
    27© 2016 PivotalSoftware, Inc. All rights reserved. MODERN CLOUD NATIVE PLATFORM Pivotal Cloud Foundry empowers companies with a cloud platform engineered for start-up speed—designed for continuous innovation, across multiple clouds, at scale.
  • 28.
    28© Copyright 2016Pivotal. All rights reserved. Message Bus Extend the CF Runtime with Cloud Foundry BOSH IaaS Cloud Foundry Operations Manager/BOSH DB BOSH Director Blobs Health Monitor Deployment • Packages • Blobs • Source • Jobs • Manifest Extend my CF etcd Target VM Operator CELL Target VMCloud Controller Target VM Jenkins AGENT MySQL AGENT Cassandra AGENT
  • 29.
    29© Copyright 2016Pivotal. All rights reserved. Pivotal CF High Level Architecture Elastic Runtime Dynamic Router OAuth 2.0 Server (UAA) CELL Garden Build Packs Login Server CC & CC Bridge Blob Store BBS/etcd Sys Log ServiceBrokers Collector App Log ROUTING AUTHENTICATION APP LIFECYCLE APP STORAGE & EXECUTION MESSAGING METRICS & LOGGING BBS Converger BOSH
  • 30.
    30© Copyright 2016Pivotal. All rights reserved. Demo https://github.com/pivotal-bank/cf-SpringBootTrader
  • 31.
    31© 2016 PivotalSoftware, Inc. All rights reserved. CI/CDwith Concourse (http://concourse.ci/)
  • 32.
    32© Copyright 2016Pivotal. All rights reserved. Demo
  • 33.
    33© 2015 PivotalSoftware, Inc. All rights reserved. We’re Hiring!! pivotal.io/careers
  • 35.
    35© 2016 PivotalSoftware, Inc. All rights reserved. CF OPEN SOURCE MOMENTUM Source: http://cloud-foundry.meetup.com/ on Jun 12 2015 53 CORPORATIONS 158 MEETUPS 49 COUNTRIES 21K MEMBERS 2200 DEVELOPERS 65K COMMITS 650 CODE SUBMITTERS SUBMITTERS COMMITS in from 35
  • 36.
    36© 2016 PivotalSoftware, Inc. All rights reserved. 36 ● Absolutely critical for CF users and ecosystem ● Make it lasting and durable ● CF “Core”: ○ Cloud Foundry Certified PaaS ○ Target Q4 2015 ● CF Extensions ○ Target Early 2016 CLOUD FOUNDRY CERTIFICATION PROGRAM Cloud Foundry Core • Certified Products and “As a Service” Implementations • Must Use Specific CF-Release CFF Maintained Add-ons • Projects owned by Foundation • Extend or work with CF Core • Must meet qualifications for relevant CF Extension certification Certified CF Extensions • Projects and products external to the foundation • Are certified by the foundation as interoperable with CF Core Extended Ecosystem • Projects and products external to the foundation • Not certified BOSH, while not in CF Core, remains critical to our ecosystem development efforts and represents several opportunities for certification programs.
  • 37.
    37© 2016 PivotalSoftware, Inc. All rights reserved. PIVOTAL IS THE LEADING CONTRIBUTOR & EXPERT…. 37