The Reality of Managing Microservice Deployments at Scale: You Need a Spinnaker

VMware Tanzu
VMware TanzuVMware Tanzu
The Reality of Managing Microservice
Deployments at Scale: You Need a
Spinnaker
October 7–10, 2019
Austin Convention Center
Welcome!
DISCLAIMER(s):
1 - Any third party trademarks are the intellectual property of their respective owners and any mention herein is for
referential purposes only.”
2 -Opinions expressed here are solely our own and do not express the views or opinions of JPMorgan Chase
What We’ll Cover
• Situation Brief
• Introducing Spinnaker
• Spinnaker Demo
• Unleashing the Power
"Spinnaker" by Craig Stanfill is licensed under CC BY-SA 2.0
Situation Brief
Business Scale
$6T
Payments
Processed Daily
99M
Debit and Credit
Card Accounts
51M
Active Digital
Customers
$23T
Assets Under
Custody
Speed
Uniquely Positioned for Success
Breadth Efficiency
Technology Investments Support Significant Business Scale
Trust
Technology Scale
6.5K
Applications
390PB
Data Storage
53K
Technologists
300K
Virtual and Mobile
Workspaces
Technology Approach
6,000+
Cloud deployments
a day across
90+
Pivotal Platform
foundations
Focus on
Outcomes
Drive ResultsModernize,
Simplify
• Developer
efficiency
• Deliver new
business
capabilities faster
• Improve
customer
experience
Build-Release Circa 2017-2018
1 2
Jules
The development
team’s CI/CD system
built on OSS Jenkins
AIM
Custom deployment automation and
config management tool for fast, safe,
repeatable deployments to multiple
technology.
3
Gaia
The application platform
built on Pivotal
Application Service
1 2 3
….years of engineering
investment!
Pivotal Application Service
cf push
Deploy
Application
Artifacts
AIM Core
AIM for
Cloud
Endpoints
AIM
Artifacts
GFS
Manifest
Applicatio
n Binaries
Myriad
gap-aim-
deployer
AIM
Endpoint
Coordinator
/gap
AIM core
command
s
aim
create package
create endpoint
publish package
Pull Artifacts
REST API –
POST
deploy package
Why Acceleration Is Not Enough
We needed a Continuous Delivery platform that offers:
Common, consistent
developer experience
supporting private and
public cloud platforms
Safer deployment
capabilities packaged
as first class constructs
within the workflow
Quality deployments
at scale—confidence to
deploy all the time
Do You Know What a
Spinnaker Can Do?
Spinnaker: OSS Multi-Cloud Delivery Platform
“...the passionate open
source community
dedicated to making
deployment pain go
away.”
https://www.spinnaker.io/publications/ebook/
Spinnaker Embeds CD Expertise
“We want to provide
guardrails, not gates.”
—Dianne Marsh, Netflix
2012 2019
Netflix built Asgard
for managing
cloud-based
applications and
infrastructure
Netflix expanded
Asgard ideas and
introduced Spinnaker
internally
Spinnaker open
sourced
Spinnaker
community
grows
Canary analysis
and chaos
monkey added
to Spinnaker
Pivotal becomes
third largest
contributor to
Spinnaker OSS
Spinnaker joins
Continuous
Delivery
Foundation
Application Centric Control Plane
=
Turn monitoring
into action
Deploy safely
with speed
Spinnaker Best Practices
• Blue/green deployments
• Rollbacks
• Automated canary analysis
https://medium.com/netflix-techblog/automated-canary-
analysis-at-netflix-with-kayenta-3260bc7acc69
Why We Chose
Spinnaker for
Our Continuous
Delivery Platform
• Quality deployments at scale
• Multi-cloud support
• Zero-code, zero-downtime advanced
deployment strategies
• Application centric visibility—active
state
• Value of open source software—move
at the speed of cloud innovations
Build-Release with Spinnaker
2
AIM + Spinnaker
AIM powered by Spinnaker
for all deploy actions to
include application and
service creation
cf push
+
cf create
service
Deploy
Application
Artifacts
+
Create
Services
1
Jules
The development
team’s CI system built
on OSS Jenkins
3
Gaia
The application platform
built on Pivotal
Application Service
Pipeline Orchestration
Blue/Green, Highlander, Rollback, Canary
1 3
….years of engineering
investment!
Pivotal Application Service
2
DEMO
Unleashing the Power:
Next Steps
Next Steps: Unleashing the Power
What are We Doing
• Commitment to OSS (e.g., learning to
be less proprietary)
• Developers can start-up fast (familiar
tools, blueprints, frameworks, etc.)
• Teams are trained and engaged
(e.g., knowledge sharing, Tech
Primers, ‘Cloud Party’ days)
• Developers can deploy to
production (with guardrails)
How We Get There
(Hint: It’s a process!)
1. Deconstruct the big pipeline and
assess all the steps (value stream
mapping)
2. Rebuild the pipeline with the right
jobs for the right tools (e.g., separate
CI and CD duties)
3. Improved RBAC and Pipeline
Controls (e.g. Policy Enforcement)
4. Continue to leverage partners that
help you shape ideas and unlock
solutions
Next Cloud Platform—Kubernetes
1 2
Development
The development team’s
CI system built on OSS
Jenkins plus code
repository
Spinnaker
AIMless pipeline
orchestration with
artifact repository
3
Kubernetes
Delivery to any cloud
1 2 3
Deploy
Apps
Pull
Images
Multi-Cloud Platform
1 2
Development
The development team’s
CI system built on OSS
Jenkins plus code
repository
Spinnaker
Pipeline orchestration
with image repository
3
Hybrid Multi-cloud
Ability to deploy to any
cloud platform directly
1 2 3
Deploy
Apps
Pull
Images
In Closing…
Engineers
should be at
the heart of
your
transformation
Acceleration is
not enough for
large
enterprises
Spinnaker as a
ubiquitous
multi-cloud
delivery system
is a game
changer
Bring the
organization
along for the
ride (e.g., Cloud
Party)
Don’t get stuck
in customized
tooling
because of
“years of
investment”
Announcing Beta
Pivotal Continuous Delivery
with Spinnaker
Proven, community-driven, open-source Spinnaker releases
that are validated, enhanced, and supported by Pivotal.
Learn more: www.pivotal.io/spinnaker
Stay Connected.
More at SpringOne Platform:
Day 3 Keynote
Cutting-Edge Continuous Delivery: Automated Canary
Analysis Through Spring-Based Spinnaker
(Tuesday, 2:00pm–3:10pm, 15AB)
Highly Available and Resilient Multi-Site Deployments
Using Spinnaker
(Wednesday, 11:30am–12:40pm, Ballroom F)
#springone@s1p
1 of 23

More Related Content

What's hot(20)

Mark Harrison AppDev 2021Mark Harrison AppDev 2021
Mark Harrison AppDev 2021
Mark Harrison193 views
Introduction to Rundeck Introduction to Rundeck
Introduction to Rundeck
Rundeck623 views
OneRender 2015OneRender 2015
OneRender 2015
Miguel Arias309 views

Similar to The Reality of Managing Microservice Deployments at Scale: You Need a Spinnaker(20)

Pivotal Overview: Canadian TeamPivotal Overview: Canadian Team
Pivotal Overview: Canadian Team
VMware Tanzu806 views
Ahmed El Mawaziny CVAhmed El Mawaziny CV
Ahmed El Mawaziny CV
Ahmed El Mawaziny106 views
Technology insights: Decision Science PlatformTechnology insights: Decision Science Platform
Technology insights: Decision Science Platform
Decision Science Community154 views
Sumeet cvSumeet cv
Sumeet cv
SUMEET SRIVASTAVA267 views
Re-Platforming Applications for the CloudRe-Platforming Applications for the Cloud
Re-Platforming Applications for the Cloud
Carter Wickstrom179 views
NUS-ISS Learning Day 2018- Designing software to make the most of cloud platf...NUS-ISS Learning Day 2018- Designing software to make the most of cloud platf...
NUS-ISS Learning Day 2018- Designing software to make the most of cloud platf...
Institute of Systems Science, National University of Singapore103 views

Recently uploaded(20)

Like SpecFlowLike SpecFlow
Like SpecFlow
Dmitry Dorogoy9 views
linux-namespaces.pdflinux-namespaces.pdf
linux-namespaces.pdf
Ignat Korchagin17 views
Java-ML-lego-j-fallJava-ML-lego-j-fall
Java-ML-lego-j-fall
Jago de Vreede45 views
The Case Against Frameworks - JFall 2023The Case Against Frameworks - JFall 2023
The Case Against Frameworks - JFall 2023
Jan-Hendrik Kuperus12 views
Build and Modernize Intelligent Apps​Build and Modernize Intelligent Apps​
Build and Modernize Intelligent Apps​
Lorenzo Barbieri35 views
www.hyperdo.app to do app for adhd.pptxwww.hyperdo.app to do app for adhd.pptx
www.hyperdo.app to do app for adhd.pptx
Audrius Janulis14 views

The Reality of Managing Microservice Deployments at Scale: You Need a Spinnaker

  • 1. The Reality of Managing Microservice Deployments at Scale: You Need a Spinnaker October 7–10, 2019 Austin Convention Center
  • 2. Welcome! DISCLAIMER(s): 1 - Any third party trademarks are the intellectual property of their respective owners and any mention herein is for referential purposes only.” 2 -Opinions expressed here are solely our own and do not express the views or opinions of JPMorgan Chase
  • 3. What We’ll Cover • Situation Brief • Introducing Spinnaker • Spinnaker Demo • Unleashing the Power "Spinnaker" by Craig Stanfill is licensed under CC BY-SA 2.0
  • 4. Situation Brief
  • 5. Business Scale $6T Payments Processed Daily 99M Debit and Credit Card Accounts 51M Active Digital Customers $23T Assets Under Custody Speed Uniquely Positioned for Success Breadth Efficiency Technology Investments Support Significant Business Scale Trust Technology Scale 6.5K Applications 390PB Data Storage 53K Technologists 300K Virtual and Mobile Workspaces
  • 6. Technology Approach 6,000+ Cloud deployments a day across 90+ Pivotal Platform foundations Focus on Outcomes Drive ResultsModernize, Simplify • Developer efficiency • Deliver new business capabilities faster • Improve customer experience
  • 7. Build-Release Circa 2017-2018 1 2 Jules The development team’s CI/CD system built on OSS Jenkins AIM Custom deployment automation and config management tool for fast, safe, repeatable deployments to multiple technology. 3 Gaia The application platform built on Pivotal Application Service 1 2 3 ….years of engineering investment! Pivotal Application Service cf push Deploy Application Artifacts AIM Core AIM for Cloud Endpoints AIM Artifacts GFS Manifest Applicatio n Binaries Myriad gap-aim- deployer AIM Endpoint Coordinator /gap AIM core command s aim create package create endpoint publish package Pull Artifacts REST API – POST deploy package
  • 8. Why Acceleration Is Not Enough We needed a Continuous Delivery platform that offers: Common, consistent developer experience supporting private and public cloud platforms Safer deployment capabilities packaged as first class constructs within the workflow Quality deployments at scale—confidence to deploy all the time
  • 9. Do You Know What a Spinnaker Can Do?
  • 10. Spinnaker: OSS Multi-Cloud Delivery Platform “...the passionate open source community dedicated to making deployment pain go away.” https://www.spinnaker.io/publications/ebook/
  • 11. Spinnaker Embeds CD Expertise “We want to provide guardrails, not gates.” —Dianne Marsh, Netflix 2012 2019 Netflix built Asgard for managing cloud-based applications and infrastructure Netflix expanded Asgard ideas and introduced Spinnaker internally Spinnaker open sourced Spinnaker community grows Canary analysis and chaos monkey added to Spinnaker Pivotal becomes third largest contributor to Spinnaker OSS Spinnaker joins Continuous Delivery Foundation
  • 12. Application Centric Control Plane = Turn monitoring into action Deploy safely with speed
  • 13. Spinnaker Best Practices • Blue/green deployments • Rollbacks • Automated canary analysis https://medium.com/netflix-techblog/automated-canary- analysis-at-netflix-with-kayenta-3260bc7acc69
  • 14. Why We Chose Spinnaker for Our Continuous Delivery Platform • Quality deployments at scale • Multi-cloud support • Zero-code, zero-downtime advanced deployment strategies • Application centric visibility—active state • Value of open source software—move at the speed of cloud innovations
  • 15. Build-Release with Spinnaker 2 AIM + Spinnaker AIM powered by Spinnaker for all deploy actions to include application and service creation cf push + cf create service Deploy Application Artifacts + Create Services 1 Jules The development team’s CI system built on OSS Jenkins 3 Gaia The application platform built on Pivotal Application Service Pipeline Orchestration Blue/Green, Highlander, Rollback, Canary 1 3 ….years of engineering investment! Pivotal Application Service 2
  • 16. DEMO
  • 17. Unleashing the Power: Next Steps
  • 18. Next Steps: Unleashing the Power What are We Doing • Commitment to OSS (e.g., learning to be less proprietary) • Developers can start-up fast (familiar tools, blueprints, frameworks, etc.) • Teams are trained and engaged (e.g., knowledge sharing, Tech Primers, ‘Cloud Party’ days) • Developers can deploy to production (with guardrails) How We Get There (Hint: It’s a process!) 1. Deconstruct the big pipeline and assess all the steps (value stream mapping) 2. Rebuild the pipeline with the right jobs for the right tools (e.g., separate CI and CD duties) 3. Improved RBAC and Pipeline Controls (e.g. Policy Enforcement) 4. Continue to leverage partners that help you shape ideas and unlock solutions
  • 19. Next Cloud Platform—Kubernetes 1 2 Development The development team’s CI system built on OSS Jenkins plus code repository Spinnaker AIMless pipeline orchestration with artifact repository 3 Kubernetes Delivery to any cloud 1 2 3 Deploy Apps Pull Images
  • 20. Multi-Cloud Platform 1 2 Development The development team’s CI system built on OSS Jenkins plus code repository Spinnaker Pipeline orchestration with image repository 3 Hybrid Multi-cloud Ability to deploy to any cloud platform directly 1 2 3 Deploy Apps Pull Images
  • 21. In Closing… Engineers should be at the heart of your transformation Acceleration is not enough for large enterprises Spinnaker as a ubiquitous multi-cloud delivery system is a game changer Bring the organization along for the ride (e.g., Cloud Party) Don’t get stuck in customized tooling because of “years of investment”
  • 22. Announcing Beta Pivotal Continuous Delivery with Spinnaker Proven, community-driven, open-source Spinnaker releases that are validated, enhanced, and supported by Pivotal. Learn more: www.pivotal.io/spinnaker
  • 23. Stay Connected. More at SpringOne Platform: Day 3 Keynote Cutting-Edge Continuous Delivery: Automated Canary Analysis Through Spring-Based Spinnaker (Tuesday, 2:00pm–3:10pm, 15AB) Highly Available and Resilient Multi-Site Deployments Using Spinnaker (Wednesday, 11:30am–12:40pm, Ballroom F) #springone@s1p