Success Factors for a Mature Microservices Implementation

TECHNOLOGY SOLUTIONS DELIVERED
TECHNOLOGY SOLUTIONS DELIVEREDTECHNOLOGY SOLUTIONS DELIVERED
Success Factors for a Mature
Microservices Implementation
Dustin Ruehle
ECS Team, Senior Cloud Architect
@DustinRuehle

About me...
• Been at ECS 9+ years
• My Cloud Native journey began 2+ years ago
• Working with Pivotal as a trusted partner
• Pairing with large customers enabling transformation using Pivotal Cloud Foundry
• Platform, operations, application migration/modernization
• For who:
• a very large private company,
• a near Fortune 100 company,
• and several others with a Fortune 500 average of 24
• CF Summit 2016 – Monitoring Cloud Foundry – Learning about the
Firehose
• SpringOne Platform 2016 – Custom Tile Generation in PCF

Do you ever feel like…

What is the problem?

“Taking to long to offer new features”

“We get a lot of users at once during a promotion and we crash”

“We get a lot of users at once during a promotion and we crash”
What are some of your problems?

What should be our goal?

What should be our goal?
avoid undifferentiated heavy lifting

This is what I need…right?

Or do I need this to solve my problem?

This isn’t new…

Do you agree?
=
Cloud Native

What about this?
=
Cloud Native
=

Cloud Native is what?
• 12 factor applications
• Microservices
• Self-service architecture
• API-Based collaboration
• Antifragility
- Matt Stine
Migrating to Cloud-Native Application Architectures

Cloud Native why?
”Cloud Native describes the patterns of high performing
organizations delivering software faster, consistently and
reliably at scale.”
- Pivotal
Faster, easier, safer

Cloud Native why?
”Cloud Native describes the patterns of high performing
organizations delivering software faster, consistently and
reliably at scale.”
- Pivotal
Faster, easier, safer
AND IT SOLVES A BUSINESS PROBLEM

Random success factor…. A µS smell test
When I want to deploy this

When I want to deploy this But have to deploy all that

Not loosely coupled
When I want to deploy this But have to deploy all that

When I want to use this

I have to know about all that

Not a bounded context

Refactor your
Bounded context

Your are probably doing this…
Customer
Ordering Reporting

Your should probably be doing this…
Customer
Ordering Reporting
CustomerPolyglot Persistence
API-Based collaboration

Why containers aren’t enough?
To go to prod…
• Setup non-prod env
• Develop my business capability
• Determine
• logging
• monitoring (app and where it runs)
• security
• Integrate with other services to test
• Performance test my new business capability
• Setup my prod env
• Scale up and down based on user demand
• Troubleshoot my application working with other business
capabilities
• Patch my environment – CVEs for example

Problems I have yet to solve…
To go to prod…
• Develop my business capability
• Determine
• logging
• security
• Troubleshoot my application working with other
business capabilities

Easy, I’ll just create some scripts…
Create my container

Create my container
Deploy my app with my
container

Create my container
container
Scale my app

Create my container
container
Scale my app
All my other scripts

Now what?

Somebody really smart said…
“A cloud-native application is an application
that has been designed and implemented to run
on a Platform-as-a-Service installation and to
embrace horizontal elastic scaling.”
- Kevin Hoffman
Beyond the Twelve-Factor App

Somebody really smart said…
“A cloud-native application is an application
that has been designed and implemented to run
on a Platform-as-a-Service installation and to
embrace horizontal elastic scaling.”
- Kevin Hoffman
Beyond the Twelve-Factor App
Hint: This is another success factor

What is Pivotal Cloud Foundry?

What is Pivotal Cloud Foundry?
- from Pivotal CF Immersion Intro

Pivotal Cloud Foundry Architecture
Container Scheduling
Application Framework
ServicesPlatform Runtime (Elastic Runtime)
Routing DatabaseConfigurationService Discovery
Big Data
Object Storage
Mobile
Build CI
User ProvidedLogging & Metrics Messaging
Circuit Breakers12 Factor Apps RESTful ServicesMicroservices
.NETSpring Boot Node.jsRuby on Rails
Operations Zero Downtime
Deployments
Failover &
Recovery
Scaling
Security
Patching
Platform
Upgrades

TECHNOLOGY SOLUTIONS DELIVERED41
Pivotal Cloud Foundry
Contract: BOSH Release
Contract: Cloud Provider Interface
Roles
Dev
Dev IT Ops
Cloud Foundry
BOSH
Runtime Platform
Operations
(Infrastructure Automation)
IT Ops
IT Ops
Services
Applications
Contract: 12 Factor App
more…
Infrastructure
Tools

PCF–Distributed
VirtualApplicance
Availability Zone 1 Availability Zone 2
DEA
VM
DEA
VM
VMGO Router VMGO Router
DEA
VM
Cells
VM
DEA
VM
Cells
VM
IaaS – vSphere, AWS, Openstack, others…
BOSH
VMConvergerVMConverger
Page 42
PCF Resiliency
Scenario: A Diego Cell (VM)
where your app container is
running crashes
App traffic and cf cli traffic (port 80/443)

PCF–Distributed
VirtualApplicance
DEA
VM
DEA
VM
DEA
VM
Cells
VM
DEA
VM
Cells
VM
BOSH
VMConverger
Failed VMs
are recovered
VMConverger
Page 43
PCF Resiliency
desired state
actual state
desired state
actual state

PCF–Distributed
VirtualApplicance
DEA
VM
DEA
VM
DEA
VM
Cells
VM
DEA
VM
Cells
VM
BOSH
Failed VMs
are recovered
VMConverger
Page 44
PCF Resiliency
PCF redistributes the
applications that were running
on that cell.
desired state
actual state
VMConverger
desired state
actual state

PCF–Distributed
VirtualApplicance
DEA
VM
DEA
VM
DEA
VM
Cells
VM
DEA
VM
Cells
VM
BOSH
Failed VMs
are recovered
VMConverger
Page 45
PCF Resiliency
PCF redistributes the
applications that were running
on that cell.
BOSH recreates the Diego Cell
and apps can now run on that
cell again
desired state
actual state
VMConverger
desired state
actual state

PCF–Distributed
VirtualApplicance
DEA
VM
DEA
VM
DEA
VM
Cells
VM
DEA
VM
Cells
VM
BOSH
VMConverger
desired state
actual state
desired state
actual state
Failed VMs
are recovered
Failed
Processes are
recovered
Monit
VMConverger
Page 46
PCF Resiliency

PCF–Distributed
VirtualApplicance
DEA
VM
DEA
VM
DEA
VM
Cells
VM
DEA
VM
Cells
VM
BOSH
VMConverger
desired state
actual state
desired state
actual state
Failed VMs
are recovered
Failed
Processes are
recovered
Monit
VMConverger
Application Instances
balanced across
availability zones
Page 47
PCF Resiliency

PCF–Distributed
VirtualApplicance
DEA
VM
DEA
VM
DEA
VM
Cells
VM
DEA
VM
Cells
VM
BOSH
VMConverger
desired state
actual state
desired state
actual state
Failed VMs
are recovered
Failed
Processes are
recovered
Monit
VMConverger
Application Instances
balanced across
availability zones
Failed Application
Instances are
recovered
Page 48
PCF Resiliency

What are the problems we are solving again?
We started with…
- Taking to long to offer new features
- We get a lot of users at once during
a promotion and we crash

We started with…
Cloud Native
Helps me solve problems

We started with…
We inherited…
• Determine
• logging
• security
• Troubleshoot my application working with other
business capabilities
Cloud Native
Helps me solve problems

A platform solved a lot…but some remain…
Problems that remain…
- How do I troubleshoot my
application working with other
business capabilities?
- How does my application know
how to connect to other
applications?
- How do I manage configuration
for my application?
- How do I handle when an
application I consume behaves
badly?
- How do I connect to my backing
services?

How can I solve these problems?
applications?
for my application?
badly?
services?

How can I solve these problems?
applications?
for my application?
badly?
services?
Hint: This is another success factor

What magic is this?

What magic is this?
Service Discovery - Eureka

What magic is this?
Circuit Breaker - Hystrix

What magic is this?
Distributed tracing – Spring Cloud Slueth

What magic is this?
Centralized external configuration management – Spring Cloud Config

What magic is this?
Centralized external configuration management – Spring Cloud Config
Connect to backend services like databases and message brokers – Spring Cloud Connectors

Not just for Java…
resilient, scalable microservices to .NET developers

Not just for Java…
resilient, scalable microservices to .NET developers
Service Discovery Config server Cloud Connectors

Did I solve my problems?

Do you feel like this?

Or this?

Did I meet my goal?
avoid undifferentiated heavy lifting

Did I meet my goal?
modern undifferentiated heavy lifting

Questions?

Success Factors for a Mature Microservices Implementation

More Related Content

What's hot

Similar to Success Factors for a Mature Microservices Implementation

Recently uploaded

Success Factors for a Mature Microservices Implementation