1© Copyright 2016 EMC Corporation. All rights reserved.
CLOUD NATIVE APPLICATIONS
DEVOPS, EMC, AND CLOUD FOUNDRY
2© Copyright 2015 EMC Corporation. All rights reserved.
Product Companies Are Creating “Smart Devices”
EVERY INDUSTRY IS BEING DIGITALLY TRANSFORMED
3© Copyright 2015 EMC Corporation. All rights reserved.
User EXPERIENCE is Everything
3
iPhone released June 29, 2007
4© Copyright 2015 EMC Corporation. All rights reserved.
The agile manifesto
• It’s Really Different
• Individuals and interactions
over processes and tools
• Working software over
comprehensive documentation
• Customer collaboration over
contract negotiation
• Responding to change over
following a plan
5© Copyright 2015 EMC Corporation. All rights reserved.
“Any organization that designs
a system (defined broadly) will
produce a design whose
structure is a copy of the
organization's communication
structure.
Melvyn Conway, 1967
6© Copyright 2015 EMC Corporation. All rights reserved.
DevOps is a collaborative
culture & philosophy between
technical teams, often derived
from modern software
development methods
7© Copyright 2016 EMC Corporation. All rights reserved.
8© Copyright 2016 EMC Corporation. All rights reserved.
“The Puppet Labs 2014 State of DevOps
report noted that IT high-performers are
twice as likely to exceed profitability,
market share, and productivity goals as well
as enjoy 50% higher market
capitalization growth over three years.”
NEW TECH IS COOL, BUT DOES IT MATTER?
9© Copyright 2016 EMC Corporation. All rights reserved.
• Business Digitization has been
happening since we could digitize
stuff
• What is different now and how does
that relate to the rise of Cloud Native
Applications?
Digitization of Business
10© Copyright 2016 EMC Corporation. All rights reserved.
• Microsoft Word
• Microsoft Excel
• Microsoft Outlook
• Microsoft Exchange
• Microsoft SharePoint
• Developed by software
companies
• Operated by business
• Mass-Market appeal
• No business
differentiation
Software of the 80’s and 90’s
11© Copyright 2016 EMC Corporation. All rights reserved.
Your business
Your Product / Service Offering
- Requires Differentiation -
=
Custom Applications
Today’s Business Digitization:
Customer Interaction
Source: JPMorgan Chase Annual Shareholder Letter (2015)
“Silicon Valley is coming…and
they all want to eat our lunch.”
- Jamie Dimon
CEO, JPMorgan Chase
Source: User Summit (2014)
“If you went to bed last night as an
industrial company, you’re going to
wake up in the morning as a
software and analytics company.”
- Jeff Immelt
CEO, General Electric
The day Home Depot realized Amazon
sold more hammers than they did, they
decided to become a software company.
Source: Anecdotal
75%
of application development supporting digital
business will be built not bought by 2020
Source: Gartner
16© Copyright 2016 EMC Corporation. All rights reserved.
Software Developers are eating the world
Occupational Title Employment, 2014
Projected
Employment, 2024 Change
Software developers, applications 718,400 853,700 19%
Software developers, systems software 395,600 447,000 13%
Telephone operators 13,100 7,500 -42%
Postal service mail sorters, processors,
and processing machine operators
117,600 78,000 -34%
Insurance underwriters 103,400 91,600 -11%
Travel agents 74,100 65,400 -12%
SOURCE: U.S. Bureau of Labor Statistics, Employment Projections program
Industry Change
Accommodation and food services 6%
Construction 14%
Direct health and medical insurance carriers 59%
Finance and insurance 17%
Mining, quarrying, and oil and gas extraction 13%
Real estate 22%
Retail trade 36%
SOURCE: U.S. Bureau of Labor Statistics, Employment Projections program
17© Copyright 2016 EMC Corporation. All rights reserved.
Retail Software
• New version every 12-24
months
• Fixed capacity requirements with
slow incremental growth
• Resources deployed infrequently
Developers
• Many version updates occur
each day
• Elastic day to day capacity
requirements
• Resources deployed frequently
Infrastructure Requirements
18© Copyright 2016 EMC Corporation. All rights reserved.
.war .jar
dependencies
libraries
service
manifest
App App App
LB
DB
Multi-server run time
environment(s)
.tar.gz
Turning this: Into this:
WOULDN’T IT BE GREAT IF WE HAD A TOOL…
19© Copyright 2016 EMC Corporation. All rights reserved.
Prescriptive
CHRONOS
scheduler.next
container.
next
Assembly
20© Copyright 2016 EMC Corporation. All rights reserved.
Prescriptive
CHRONOS
scheduler.next
gorouter
CloudController Auth
Loggregator
Staging
Buildpacks
BOSH
Service Broker
Diego
Garden
etcd
Core
Services
container.
next
Assembly
21© Copyright 2016 EMC Corporation. All rights reserved.
Prescriptive
CHRONOS
scheduler.next
container.
next
Assembly
22© Copyright 2016 EMC Corporation. All rights reserved.
22
“How much value do
you get from managing
operating systems”
23© Copyright 2016 EMC Corporation. All rights reserved.
Here is my source code.
Run it in the cloud for me.
I do not care how.
- Onsi Fakhouri
@onsijoe
25© Copyright 2016 EMC Corporation. All rights reserved.
http://46zwyrvli634e39iq2l9mv8g.wpengine.netdna-cdn.com/wp-content/uploads/2013/06/DevOps-infinity-loop2.png
26© Copyright 2016 EMC Corporation. All rights reserved.
How many cloud native applications?
Dedicated or shared with legacy apps?
Self hosted or provider managed? (capex vs opex)
HOW TO CHOOSE THE INFRASTRUCTURE?
27© Copyright 2016 EMC Corporation. All rights reserved.
NET = KNOW THYSELF. KNOW THY PATH.
Enterprises SaaS Startups People Without Revenue
Pressures & Unicorns
Structured Platform +
Curated Cloud Native IaaS +
Turnkey Infrastructure
(on or off-premises)
Focus on differentiating
your business by gaining
speed in apps and data
Build an stack that
optimizes for YOUR
singular app
Assembly Platform +
Cloud Native IaaS +
Turnkey infrastructure
(on or off-premises)
Build an unstructured stack,
build your own IaaS,
assemble the infrastructure
DIY Platform +
DIY IaaS +
DIY Infrastructure
(on or off-premises)
What
Who
How
28© Copyright 2016 EMC Corporation. All rights reserved.
DEMO TIME
29© Copyright 2016 EMC Corporation. All rights reserved.
HOW DO I PERSONALLY GET THERE?
30© Copyright 2016 EMC Corporation. All rights reserved.
DEVELOPERS – THE NEW KINGMAKERS
• DISRUPTION IS CHEAPER THAN EVER
• PUBLIC CLOUD IS THE NEW DATA CENTER
• OPEN-SOURCE SOFTWARE RULES
• COMMUNITY IS THE NEW TECH SUPPORT
31© Copyright 2016 EMC Corporation. All rights reserved.
LISTEN TO SOME PODCASTS……
vBrownbag Lists of Podcasts
• VCDX Series
• VCP6-DT Series
• Intro to VVOLS
• HowTo: Docker++ (coreOS) w/Scott_Lowe
• Setting up Network Services w/Puppet
• PowerShell Desired State Configuration
The Cloud Cast
• Masters, Minions and Pods – Kubernetes
• Streaming Analytics for Distributed Apps
• Container-Centric Application Deployments
• Moving DevOps forward with CI:CD
• Understanding CoreOS
• Understanding Git and GitHUB
32© Copyright 2016 EMC Corporation. All rights reserved.
3
THE HOT AISLE PODCAST
Uniquely focused on delivering content for the next
generation of Systems Engineers while giving
customers and partners equal access to the journey.
Podcast Examples:
• Venture Capital
• Microservices & Data Fabrics
• Containers & Persistence
• OpenStack
• Developer Advocacy
• Open Source Community
• Innovation
• Cloud
• Subscribe: http://apple.co/1Uch55T
33© Copyright 2016 EMC Corporation. All rights reserved.
GUESTS
Kohsuke
Kawaguchi
Patrick
Mcfaden
Jason
Hand
Clint
Kitson
Thomas
Rampelberg
34© Copyright 2016 EMC Corporation. All rights reserved.
GUESTS
Ashley
McNamara
Andrew Clay
Shafer
Randy
Bias
Mitchell
Hashimoto
Steve
Francia
35© Copyright 2016 EMC Corporation. All rights reserved.
ENGAGE WITH EMC {CODE}
emccode@emc.com
@EMCCode
http://emccode.github.io
http://blog.emccode.com
http://dasboard.emccode.com
http://community.emccode.com/
36© Copyright 2016 EMC Corporation. All rights reserved.
- Pre Sales Engineers -
- Passionate Technologist -
- Love teaching/training -
- real world experience -
• cloud platforms
– VMware Photon, Cloud Foundry,
Apache Mesos, Kubernetes,
Openshift, Swarm
• containers
– Docker, rktt, runC
• devops & agile
– methods and overviews
– real world examples
• hardware & appliances
– VxRack
– Caspian & Bravo
@ m c o w g e r
@ v t e x a n
@ b v e r k l e y
38© Copyright 2016 EMC Corporation. All rights reserved.
ELASTIC RUNTIME COMPONENTS
Pivotal CF Elastic Runtime
Dynamic Router
OAuth 2.0 Server (UAA)
CELL
Garden
Build Packs
Login Server
CC & CC Bridge
Blob Store
BBS (etcd)
Sys Log
ServiceBrokers
Collector App Log
ROUTING
AUTHENTICATION
APP LIFECYCLE
APP STORAGE
& EXECUTION
MESSAGING
METRICS & LOGGING
Pivotal CF OpsManager/BOSH
BBS Brain / Converger
39© Copyright 2016 EMC Corporation. All rights reserved.
40© Copyright 2016 EMC Corporation. All rights reserved.
Everything to deploy and manage
the app
41© Copyright 2016 EMC Corporation. All rights reserved.
Traditional
On-Premises
(On Prem)
Made at Home
PIZZA AS A SERVICE
Dining Table
Soda
Electric/Gas
Oven
Fire
Pizza Dough
Tomato Sauce
Toppings
Cheese
Infrastructure as a
Service
(IaaS)
Take and Bake
Platform as a Service
(PaaS)
Pizza Delivered
Software as a
Service
(SaaS)
Dined Out
Dining Table
Soda
Electric/Gas
Oven
Fire
Pizza Dough
Tomato Sauce
Toppings
Cheese
Dining Table
Soda
Electric/Gas
Oven
Fire
Pizza Dough
Tomato Sauce
Toppings
Cheese
Dining Table
Soda
Electric/Gas
Oven
Fire
Pizza Dough
Tomato Sauce
Toppings
Cheese
You Manage Vendor Manages
42© Copyright 2016 EMC Corporation. All rights reserved.
From Monolithic to Micro-services
The Rise of Cloud Native Applications
43© Copyright 2016 EMC Corporation. All rights reserved.
Ways to Measure Success
CATEGORY BENEFIT HOW? MEASURE
Governance Reduce deploy time and complexity;
avoid “configuration drift”
Use of automated Continuous Delivery
pipeline and tool chain
Length of old vs. new deploy request
fulfillment time
Automation Decrease software time to market Automated provisioning, DevOps and
Continuous Delivery (CD)
Time required to get a feature or fix
into production (old vs. new)
Shorter initial provisioning time Use PaaS/IaaS resources in a self-service
model, avoid tickets
Time required (old vs. new)
Dynamic infrastructure sizing; elastic
scaling
Scale applications/resources out on-demand
or using auto-scale tile
Time to scale out (old vs. new)
Shorter deployment time Automate deployment through CD pipeline
and Jenkins
Time to deploy (old vs. new)
Shorter testing time Use TDD/CD principals; automate more
testing; PaaS provisioning, config. consistency,
rollback
Test cycle time (old vs. new)
Resiliency Automated health management BOSH; 4 levels of PCF health management Time to recover; app, container, vm
Shorter rollback time; better accuracy Use of artifact server, CD pipeline and
deployment scripts
Time for successful rollback
Updates and patching without
downtime
Blue/green deployments; rolling platform
updates
Average downtime for updates (old vs.
new)
44© Copyright 2016 EMC Corporation. All rights reserved.
Build Something Great
Container Scheduling
Application
ServicesPlatform Runtime
Routing DatabaseConfigurationService Discovery
Big Data
Object Storage
Mobile
Build CI
User ProvidedLogging & Metrics Messaging
Operations
Zero Downtime
Deployments
Failover &
Recovery
Scaling
Security
Patching
Platform
Upgrades
Infrastructure OpenStack AmazonVMware

Cloud Native Applications - DevOps, EMC and Cloud Foundry

  • 1.
    1© Copyright 2016EMC Corporation. All rights reserved. CLOUD NATIVE APPLICATIONS DEVOPS, EMC, AND CLOUD FOUNDRY
  • 2.
    2© Copyright 2015EMC Corporation. All rights reserved. Product Companies Are Creating “Smart Devices” EVERY INDUSTRY IS BEING DIGITALLY TRANSFORMED
  • 3.
    3© Copyright 2015EMC Corporation. All rights reserved. User EXPERIENCE is Everything 3 iPhone released June 29, 2007
  • 4.
    4© Copyright 2015EMC Corporation. All rights reserved. The agile manifesto • It’s Really Different • Individuals and interactions over processes and tools • Working software over comprehensive documentation • Customer collaboration over contract negotiation • Responding to change over following a plan
  • 5.
    5© Copyright 2015EMC Corporation. All rights reserved. “Any organization that designs a system (defined broadly) will produce a design whose structure is a copy of the organization's communication structure. Melvyn Conway, 1967
  • 6.
    6© Copyright 2015EMC Corporation. All rights reserved. DevOps is a collaborative culture & philosophy between technical teams, often derived from modern software development methods
  • 7.
    7© Copyright 2016EMC Corporation. All rights reserved.
  • 8.
    8© Copyright 2016EMC Corporation. All rights reserved. “The Puppet Labs 2014 State of DevOps report noted that IT high-performers are twice as likely to exceed profitability, market share, and productivity goals as well as enjoy 50% higher market capitalization growth over three years.” NEW TECH IS COOL, BUT DOES IT MATTER?
  • 9.
    9© Copyright 2016EMC Corporation. All rights reserved. • Business Digitization has been happening since we could digitize stuff • What is different now and how does that relate to the rise of Cloud Native Applications? Digitization of Business
  • 10.
    10© Copyright 2016EMC Corporation. All rights reserved. • Microsoft Word • Microsoft Excel • Microsoft Outlook • Microsoft Exchange • Microsoft SharePoint • Developed by software companies • Operated by business • Mass-Market appeal • No business differentiation Software of the 80’s and 90’s
  • 11.
    11© Copyright 2016EMC Corporation. All rights reserved. Your business Your Product / Service Offering - Requires Differentiation - = Custom Applications Today’s Business Digitization: Customer Interaction
  • 12.
    Source: JPMorgan ChaseAnnual Shareholder Letter (2015) “Silicon Valley is coming…and they all want to eat our lunch.” - Jamie Dimon CEO, JPMorgan Chase
  • 13.
    Source: User Summit(2014) “If you went to bed last night as an industrial company, you’re going to wake up in the morning as a software and analytics company.” - Jeff Immelt CEO, General Electric
  • 14.
    The day HomeDepot realized Amazon sold more hammers than they did, they decided to become a software company. Source: Anecdotal
  • 15.
    75% of application developmentsupporting digital business will be built not bought by 2020 Source: Gartner
  • 16.
    16© Copyright 2016EMC Corporation. All rights reserved. Software Developers are eating the world Occupational Title Employment, 2014 Projected Employment, 2024 Change Software developers, applications 718,400 853,700 19% Software developers, systems software 395,600 447,000 13% Telephone operators 13,100 7,500 -42% Postal service mail sorters, processors, and processing machine operators 117,600 78,000 -34% Insurance underwriters 103,400 91,600 -11% Travel agents 74,100 65,400 -12% SOURCE: U.S. Bureau of Labor Statistics, Employment Projections program Industry Change Accommodation and food services 6% Construction 14% Direct health and medical insurance carriers 59% Finance and insurance 17% Mining, quarrying, and oil and gas extraction 13% Real estate 22% Retail trade 36% SOURCE: U.S. Bureau of Labor Statistics, Employment Projections program
  • 17.
    17© Copyright 2016EMC Corporation. All rights reserved. Retail Software • New version every 12-24 months • Fixed capacity requirements with slow incremental growth • Resources deployed infrequently Developers • Many version updates occur each day • Elastic day to day capacity requirements • Resources deployed frequently Infrastructure Requirements
  • 18.
    18© Copyright 2016EMC Corporation. All rights reserved. .war .jar dependencies libraries service manifest App App App LB DB Multi-server run time environment(s) .tar.gz Turning this: Into this: WOULDN’T IT BE GREAT IF WE HAD A TOOL…
  • 19.
    19© Copyright 2016EMC Corporation. All rights reserved. Prescriptive CHRONOS scheduler.next container. next Assembly
  • 20.
    20© Copyright 2016EMC Corporation. All rights reserved. Prescriptive CHRONOS scheduler.next gorouter CloudController Auth Loggregator Staging Buildpacks BOSH Service Broker Diego Garden etcd Core Services container. next Assembly
  • 21.
    21© Copyright 2016EMC Corporation. All rights reserved. Prescriptive CHRONOS scheduler.next container. next Assembly
  • 22.
    22© Copyright 2016EMC Corporation. All rights reserved. 22 “How much value do you get from managing operating systems”
  • 23.
    23© Copyright 2016EMC Corporation. All rights reserved. Here is my source code. Run it in the cloud for me. I do not care how. - Onsi Fakhouri @onsijoe
  • 24.
    25© Copyright 2016EMC Corporation. All rights reserved. http://46zwyrvli634e39iq2l9mv8g.wpengine.netdna-cdn.com/wp-content/uploads/2013/06/DevOps-infinity-loop2.png
  • 25.
    26© Copyright 2016EMC Corporation. All rights reserved. How many cloud native applications? Dedicated or shared with legacy apps? Self hosted or provider managed? (capex vs opex) HOW TO CHOOSE THE INFRASTRUCTURE?
  • 26.
    27© Copyright 2016EMC Corporation. All rights reserved. NET = KNOW THYSELF. KNOW THY PATH. Enterprises SaaS Startups People Without Revenue Pressures & Unicorns Structured Platform + Curated Cloud Native IaaS + Turnkey Infrastructure (on or off-premises) Focus on differentiating your business by gaining speed in apps and data Build an stack that optimizes for YOUR singular app Assembly Platform + Cloud Native IaaS + Turnkey infrastructure (on or off-premises) Build an unstructured stack, build your own IaaS, assemble the infrastructure DIY Platform + DIY IaaS + DIY Infrastructure (on or off-premises) What Who How
  • 27.
    28© Copyright 2016EMC Corporation. All rights reserved. DEMO TIME
  • 28.
    29© Copyright 2016EMC Corporation. All rights reserved. HOW DO I PERSONALLY GET THERE?
  • 29.
    30© Copyright 2016EMC Corporation. All rights reserved. DEVELOPERS – THE NEW KINGMAKERS • DISRUPTION IS CHEAPER THAN EVER • PUBLIC CLOUD IS THE NEW DATA CENTER • OPEN-SOURCE SOFTWARE RULES • COMMUNITY IS THE NEW TECH SUPPORT
  • 30.
    31© Copyright 2016EMC Corporation. All rights reserved. LISTEN TO SOME PODCASTS…… vBrownbag Lists of Podcasts • VCDX Series • VCP6-DT Series • Intro to VVOLS • HowTo: Docker++ (coreOS) w/Scott_Lowe • Setting up Network Services w/Puppet • PowerShell Desired State Configuration The Cloud Cast • Masters, Minions and Pods – Kubernetes • Streaming Analytics for Distributed Apps • Container-Centric Application Deployments • Moving DevOps forward with CI:CD • Understanding CoreOS • Understanding Git and GitHUB
  • 31.
    32© Copyright 2016EMC Corporation. All rights reserved. 3 THE HOT AISLE PODCAST Uniquely focused on delivering content for the next generation of Systems Engineers while giving customers and partners equal access to the journey. Podcast Examples: • Venture Capital • Microservices & Data Fabrics • Containers & Persistence • OpenStack • Developer Advocacy • Open Source Community • Innovation • Cloud • Subscribe: http://apple.co/1Uch55T
  • 32.
    33© Copyright 2016EMC Corporation. All rights reserved. GUESTS Kohsuke Kawaguchi Patrick Mcfaden Jason Hand Clint Kitson Thomas Rampelberg
  • 33.
    34© Copyright 2016EMC Corporation. All rights reserved. GUESTS Ashley McNamara Andrew Clay Shafer Randy Bias Mitchell Hashimoto Steve Francia
  • 34.
    35© Copyright 2016EMC Corporation. All rights reserved. ENGAGE WITH EMC {CODE} emccode@emc.com @EMCCode http://emccode.github.io http://blog.emccode.com http://dasboard.emccode.com http://community.emccode.com/
  • 35.
    36© Copyright 2016EMC Corporation. All rights reserved. - Pre Sales Engineers - - Passionate Technologist - - Love teaching/training - - real world experience - • cloud platforms – VMware Photon, Cloud Foundry, Apache Mesos, Kubernetes, Openshift, Swarm • containers – Docker, rktt, runC • devops & agile – methods and overviews – real world examples • hardware & appliances – VxRack – Caspian & Bravo @ m c o w g e r @ v t e x a n @ b v e r k l e y
  • 37.
    38© Copyright 2016EMC Corporation. All rights reserved. ELASTIC RUNTIME COMPONENTS Pivotal CF Elastic Runtime Dynamic Router OAuth 2.0 Server (UAA) CELL Garden Build Packs Login Server CC & CC Bridge Blob Store BBS (etcd) Sys Log ServiceBrokers Collector App Log ROUTING AUTHENTICATION APP LIFECYCLE APP STORAGE & EXECUTION MESSAGING METRICS & LOGGING Pivotal CF OpsManager/BOSH BBS Brain / Converger
  • 38.
    39© Copyright 2016EMC Corporation. All rights reserved.
  • 39.
    40© Copyright 2016EMC Corporation. All rights reserved. Everything to deploy and manage the app
  • 40.
    41© Copyright 2016EMC Corporation. All rights reserved. Traditional On-Premises (On Prem) Made at Home PIZZA AS A SERVICE Dining Table Soda Electric/Gas Oven Fire Pizza Dough Tomato Sauce Toppings Cheese Infrastructure as a Service (IaaS) Take and Bake Platform as a Service (PaaS) Pizza Delivered Software as a Service (SaaS) Dined Out Dining Table Soda Electric/Gas Oven Fire Pizza Dough Tomato Sauce Toppings Cheese Dining Table Soda Electric/Gas Oven Fire Pizza Dough Tomato Sauce Toppings Cheese Dining Table Soda Electric/Gas Oven Fire Pizza Dough Tomato Sauce Toppings Cheese You Manage Vendor Manages
  • 41.
    42© Copyright 2016EMC Corporation. All rights reserved. From Monolithic to Micro-services The Rise of Cloud Native Applications
  • 42.
    43© Copyright 2016EMC Corporation. All rights reserved. Ways to Measure Success CATEGORY BENEFIT HOW? MEASURE Governance Reduce deploy time and complexity; avoid “configuration drift” Use of automated Continuous Delivery pipeline and tool chain Length of old vs. new deploy request fulfillment time Automation Decrease software time to market Automated provisioning, DevOps and Continuous Delivery (CD) Time required to get a feature or fix into production (old vs. new) Shorter initial provisioning time Use PaaS/IaaS resources in a self-service model, avoid tickets Time required (old vs. new) Dynamic infrastructure sizing; elastic scaling Scale applications/resources out on-demand or using auto-scale tile Time to scale out (old vs. new) Shorter deployment time Automate deployment through CD pipeline and Jenkins Time to deploy (old vs. new) Shorter testing time Use TDD/CD principals; automate more testing; PaaS provisioning, config. consistency, rollback Test cycle time (old vs. new) Resiliency Automated health management BOSH; 4 levels of PCF health management Time to recover; app, container, vm Shorter rollback time; better accuracy Use of artifact server, CD pipeline and deployment scripts Time for successful rollback Updates and patching without downtime Blue/green deployments; rolling platform updates Average downtime for updates (old vs. new)
  • 43.
    44© Copyright 2016EMC Corporation. All rights reserved. Build Something Great
  • 44.
    Container Scheduling Application ServicesPlatform Runtime RoutingDatabaseConfigurationService Discovery Big Data Object Storage Mobile Build CI User ProvidedLogging & Metrics Messaging Operations Zero Downtime Deployments Failover & Recovery Scaling Security Patching Platform Upgrades Infrastructure OpenStack AmazonVMware