Decoupled microservices-Building scalable applications.pptx

DECOUPLED MICROSERVICES: BUILDING SCALABLE APPLICATIONS
© 2022, Amazon Web Services, Inc. or its affiliates.
Decoupled microservices
Building scalable applications

Agenda (45 min)
Introduction
Application integration patterns
Concrete use cases: Our labs today
Choose your own adventure: Work on your most relevant labs

Introduction

If your application is cloud-native,
large scale, or distributed, and it
doesn’t include a messaging
component, that’s probably a bug.
Tim Bray
formerly AWS Messaging, Workflow Management
4

Potential drawbacks of
synchronous systems
• Synchronous systems are tightly
coupled
• A problem in a synchronous
downstream dependency has
immediate impact on upstream callers
• Retries from upstream callers can
all too easily fan out and amplify
problems
Photo: Dirk Fröhner

Message exchange
One way Request-response
Message
channel
Receiver
• No response expected
Synchronous vs. fire-and-forget
• Response expected
Return address
Correlation ID
Sender
Message
channel
Responder
Requester
Message
channel

Message channels
Point-to-point (queue) Publish-subscribe (topic)
• Consumed by one receiver
• Easy to scale
• Flatten peak loads
• Consumed by all subscribers
• Durable subscriber
Receivers
Sender
Queue
C
C
Subscribers
Publisher
Topic
C C
C
C

Message channels
AWS service for queue functionality:
• Amazon Simple Queue Services (Amazon SQS)
• Serverless & cloud-native
AWS service for topic functionality:
• Amazon Simple Notification Service (Amazon SNS)
• Serverless & cloud-native
Receivers
Publisher
Amazon SQS Amazon SNS
C
C
Sender
Subscribers
C
C
C
C

Message channels
AWS service for queue functionality (nonserverless):
• Amazon MQ (managed Apache Active MQ)
• For applications constrained to protocols like JMS, AMQP,
etc.
AWS service for topic functionality (nonserverless):
• Amazon MQ (managed Apache Active MQ)
• For applications constrained to protocols like JMS, AMQP,
etc.
Receivers
Sender
Subscribers
Publisher
Amazon MQ Amazon MQ
C
C C
C
C
C

Message channels
Topic-queue-chaining
• Allows fan-out and receiver scale-out at the same time
Publisher
Topic
Queue
Queue
Receivers
Application 1
Application 2

Message routing
Message filter Recipient list
• Receive only a relevant subset of messages
• Controlled by subscriber
• Publisher remains completely unaware
• Send only a relevant subset of messages to a subscriber
• Controlled by publisher or separate component
• Potentially adds coupling
Subscribers
Publisher
Subscribers
Publisher
Topic
color = blue
color =
yellow
Recipient
list

Message routing
Scatter-gather
Requester
Topic
Responders
Queue
Aggregato
r
Processor
How to distribute a request across potentially interested or relevant parties and capture their individual responses?
• RFQ scenarios, or search for best response
• Parallel processing scenarios; for example, divide and conquer

Message routing
Pipes and filters
• Event triggers chain of processing steps (“filters”)
• Knowledge of destination for next steps is wired into each filter
• Similar patterns: Chain of responsibility, processing pipeline, saga choreography
Event
source
Pipe Filter Filter
Pipe Pipe Result target
…
Filter
Step 1 Step 2 Step n

Message routing
Saga orchestration
• Event triggers orchestrated workflow
• Knowledge of workflow is externalized into orchestrator component, as well as for potential rollback
• Workflow participants remain as loosely coupled as possible
Processor
Processor
Processor
Processor
Event
source
Orchestrator
…
Step 1
Step 2 Step n-1
Step n
Result
target

Message routing
Saga orchestration
• AWS Step Functions for Serverless Saga orchestration
Processor
Processor
Processor
Processor
Event
source
Orchestrator
…
Step 1
Step 2 Step n-1
Step n
Result
target

Concrete use cases
labs for today

Context: Wild Rydes, Inc.

Choose your path
• We have four labs for you today, plus a
common foundation lab
• After intro of use cases, context, and
patterns, you can pick the most relevant
labs for you
• We will summarize the labs again for you
afterwards

Choose your path
Foundation
Lab 0

Choose your path
Foundation
Lab 0
Lab 1
Fan-out,
Message-filtering

Choose your path
Foundation
Lab 0
Lab 1
Fan-out,
Message-filtering
Lab 2
Topic-queue-chaining,
Queues as buffering LBs

Choose your path
Foundation
Lab 0
Lab 1
Fan-out,
Message-filtering
Lab 2
Lab 3
Scatter-gather

Choose your path
Foundation
Lab 0
Lab 1
Fan-out,
Message-filtering
Lab 2
Lab 3
Scatter-gather
Lab 4
Saga orchestration

Use case: Submit a
for labs 1 + 2

Use case: Submit a ride completion
AWS Cloud
Customer
notification
service
Customer
accounting
service
Customer
loyalty
service
Data lake
ingestion
service
Extraordinary
rides
service
{
"from": "...",
"to": "...",
"duration": "...",
"distance": "...",
"customer": "...",
"fare": "..."
}
POST /submit-ride-completion
201 Created
Location: ...
Content-Location: ...
{
<cmpl-ride-repr>
}
Rides store
Unicorn
management
service
Wild Rydes
unicorn app

AWS Cloud
Customer
notification
service
Customer
accounting
service
Customer
loyalty
service
Data lake
ingestion
service
Extraordinary
rides
service
{
"from": "...",
"to": "...",
"duration": "...",
"distance": "...",
"customer": "...",
"fare": "..."
}
201 Created
Location: ...
{
<cmpl-ride-repr>
}
Rides store
Unicorn
management
service
Interested in rides with
fare >= x
distance >= y
Wild Rydes
unicorn app

AWS Cloud
Customer
notification
service
Customer
accounting
service
Customer
loyalty
service
Data lake
ingestion
service
Extraordinary
rides
service
{
"from": "...",
"to": "...",
"duration": "...",
"distance": "...",
"customer": "...",
"fare": "..."
}
201 Created
Location: ...
{
<cmpl-ride-repr>
}
Rides store
Unicorn
management
service
Integration via database?
Wild Rydes
unicorn app

AWS Cloud
Customer
notification
service
Customer
accounting
service
Customer
loyalty
service
Data lake
ingestion
service
Extraordinary
rides
service
{
"from": "...",
"to": "...",
"duration": "...",
"distance": "...",
"customer": "...",
"fare": "..."
}
201 Created
Location: ...
{
<cmpl-ride-repr>
}
Rides store
Unicorn
management
service
Integration via database?
Oh my!
Wild Rydes
unicorn app

AWS Cloud
Customer
notification
service
Customer
accounting
service
Customer
loyalty
service
Data lake
ingestion
service
Extraordinary
rides
service
{
"from": "...",
"to": "...",
"duration": "...",
"distance": "...",
"customer": "...",
"fare": "..."
}
201 Created
Location: ...
{
<cmpl-ride-repr>
}
Rides store
Unicorn
management
service
Integration via REST APIs?
Wild Rydes
unicorn app

AWS Cloud
Customer
notification
service
Customer
accounting
service
Customer
loyalty
service
Data lake
ingestion
service
Extraordinary
rides
service
{
"from": "...",
"to": "...",
"duration": "...",
"distance": "...",
"customer": "...",
"fare": "..."
}
201 Created
Location: ...
{
<cmpl-ride-repr>
}
Rides store
Unicorn
management
service
Integration via REST APIs?
Absolutely, but…
Wild Rydes
unicorn app

AWS Cloud
Customer
notification
service
Customer
accounting
service
Customer
loyalty
service
Data lake
ingestion
service
Extraordinary
rides
service
{
"from": "...",
"to": "...",
"duration": "...",
"distance": "...",
"customer": "...",
"fare": "..."
}
201 Created
Location: ...
{
<cmpl-ride-repr>
}
Rides store
Unicorn
management
service
https://...
https://...
https://...
https://...
https://...
Wild Rydes
unicorn app

R E C I P I E N T L I S T S E R V I C E
AWS Cloud
Customer
notification
service
Customer
accounting
service
Customer
loyalty
service
Data lake
ingestion
service
Extraordinary
rides
service
{
"from": "...",
"to": "...",
"duration": "...",
"distance": "...",
"customer": "...",
"fare": "..."
}
201 Created
Location: ...
{
<cmpl-ride-repr>
}
Rides store
Unicorn
management
service
https://...
https://...
https://...
https://...
https://...
Request
distribution
service
Wild Rydes
unicorn app

S E L F - M A N A G E D F I L T E R I N G
AWS Cloud
Customer
notification
service
Customer
accounting
service
Customer
loyalty
service
Data lake
ingestion
service
Extraordinary
rides
service
{
"from": "...",
"to": "...",
"duration": "...",
"distance": "...",
"customer": "...",
"fare": "..."
}
201 Created
Location: ...
{
<cmpl-ride-repr>
}
Rides store
Unicorn
management
service
https://...
https://...
https://...
https://...
https://...
Request
distribution
service
Interested in rides with
fare >= x
distance >= y
Wild Rydes
unicorn app

AWS Cloud
Customer
notification
service
Customer
accounting
service
Customer
loyalty
service
Data lake
ingestion
service
Extraordinary
rides
service
{
"from": "...",
"to": "...",
"duration": "...",
"distance": "...",
"customer": "...",
"fare": "..."
}
201 Created
Location: ...
{
<cmpl-ride-repr>
}
Rides store
Unicorn
management
service
https://...
https://...
https://...
https://...
https://...
Request
distribution
service
Integration via messaging?
Absolutely!
Wild Rydes
unicorn app

P U B L I S H - S U B S C R I B E ( T O P I C )
AWS Cloud
Customer
notification
service
Customer
accounting
service
Customer
loyalty
service
Data lake
ingestion
service
Extraordinary
rides
service
{
"from": "...",
"to": "...",
"duration": "...",
"distance": "...",
"customer": "...",
"fare": "..."
}
201 Created
Location: ...
{
<cmpl-ride-repr>
}
Rides store
Unicorn
management
service
Ride
completion
topic
Wild Rydes
unicorn app

M E S S A G E F I L T E R
AWS Cloud
Customer
notification
service
Customer
accounting
service
Customer
loyalty
service
Data lake
ingestion
service
Extraordinary
rides
service
{
"from": "...",
"to": "...",
"duration": "...",
"distance": "...",
"customer": "...",
"fare": "..."
}
201 Created
Location: ...
{
<cmpl-ride-repr>
}
Rides store
Unicorn
management
service
Ride
completion
topic
SNS message filter:
fare >= x
distance >= y
Wild Rydes
unicorn app

M E S S A G E F I L T E R
AWS Cloud
Customer
notification
service
Customer
accounting
service
Customer
loyalty
service
Data lake
ingestion
service
Extraordinary
rides
service
{
"from": "...",
"to": "...",
"duration": "...",
"distance": "...",
"customer": "...",
"fare": "..."
}
201 Created
Location: ...
{
<cmpl-ride-repr>
}
Rides store
Unicorn
management
service
Ride
completion
topic
SNS message filter:
fare >= x
distance >= y
Lab 1
Wild Rydes
unicorn app

T O P I C - Q U E U E - C H A I N I N G
AWS Cloud
Customer
notification
service
Customer
accounting
service
Customer
loyalty
service
Data lake
ingestion
service
Extraordinary
rides
service
{
"from": "...",
"to": "...",
"duration": "...",
"distance": "...",
"customer": "...",
"fare": "..."
}
201 Created
Location: ...
{
<cmpl-ride-repr>
}
Rides store
Unicorn
management
service
Ride
completion
topic
Lab 2
Wild Rydes
unicorn app

Use case:
for lab 3

Unicorn management service
Use case: Instant ride RFQ
S C A T T E R - G A T H E R
AWS Cloud
Unicorn
management
resource
{
"from": "...",
"to": "...",
"customer": "..."
}
POST / submit-instant-ride-rfq
202 Accepted
Location: ...
{
"links": { ... },
"status": "...",
"eta": "..."
}
Unicorn
management
resource
Unicorn
management
resource
Request for
quotes topic
Ride booking
service
…
Wild Rydes
unicorn app

AWS Cloud
Unicorn
management
resource
GET / retrieve-rfq-status
Unicorn
management
resource
Unicorn
management
resource
…
Request for
quotes topic
Ride booking
service
RFQ response
queue
Wild Rydes
unicorn app
200 OK
{
"links": { ... },
"status":
"running",
"eta": "..."
}

AWS Cloud
Unicorn
management
resource
GET / retrieve-rfq-status
Unicorn
management
resource
Unicorn
management
resource
…
Request for
quotes topic
Ride booking
service
RFQ response
queue
Wild Rydes
unicorn app
200 OK
{
"links": { ...
<link-to-
result>
... },
"status": "done"
}

AWS Cloud
Unicorn
management
resource
GET / retrieve-rfq-result
Unicorn
management
resource
Unicorn
management
resource
…
Request for
quotes topic
Ride booking
service
RFQ response
queue
Wild Rydes
unicorn app
200 OK
{
"links": { ... },
"from": "...",
"to": "...",
"quotes": "..."
}

Use case: Fare
for lab 4

AWS Cloud
Customer
notification
service
Customer
accounting
service
Customer
loyalty
service
Data lake
ingestion
service
Extraordinary
rides
service
{
"from": "...",
"to": "...",
"duration": "...",
"distance": "...",
"customer": "...",
"fare": "..."
}
201 Created
Location: ...
{
<cmpl-ride-repr>
}
Rides store
Unicorn
management
service
Ride
completion
topic
Wild Rydes
unicorn app

AWS Cloud
Customer
notification
service
Customer
loyalty
service
Data lake
ingestion
service
Extraordinary
rides
service
{
"from": "...",
"to": "...",
"duration": "...",
"distance": "...",
"customer": "...",
"fare": "..."
}
201 Created
Location: ...
{
<cmpl-ride-repr>
}
Rides store
Unicorn
management
service
Ride
completion
topic
Wild Rydes
unicorn app
Customer
accounting
service

Use case: Fare collection
S A G A O R C H E S T R A T I O N
1. Credit card pre-authorization
Payment
service
Payment
gateway API

2. Charge card using pre-authorization code
Payment
service
Payment
gateway API
Payment
service
Payment
gateway API

3. Update customer account
Customer
accounting service
Accounting
system
Payment
service
Payment
gateway API
Payment
service
Payment
gateway API

To be treated as one distributed TA, to leave the systems in a
semantically consistent state
Customer
accounting service
Accounting
system
Payment
service
Payment
gateway API
Payment
service
Payment
gateway API

L A B 1 A R C H I T E C T U R E : F A N - O U T , M E S S A G E F I L T E R I N G
AWS Cloud
Customer
notification
service
Customer
accounting
service
Customer
loyalty
service
Data lake
ingestion
service
Extraordinary
rides
service
SNS message filter:
fare >= x
distance >= y
Ride
completion
topic
Rides
store
Unicorn
management
service
https://...
{
"from": "...",
"to": "...",
"duration": "...",
"distance": "...",
"customer": "...",
"fare": "..."
}
201 Created
Location: ...
{
<cmpl-ride-repr>
}
Wild Rydes
unicorn app

L A B 2 A R C H I T E C T U R E : T O P I C - Q U E U E - C H A I N I N G , Q U E U E S A S B U F F E R I N G L O A D B A L A N C E R S
AWS Cloud
SNS message filter:
fare >= x
distance >= y
Customer
notification
service
Customer
accounting
service
Customer
loyalty
service
Data lake
ingestion
service
Extraordinary
rides
service
Ride
completion
topic
Rides
store
Unicorn
management
service
{
"from": "...",
"to": "...",
"duration": "...",
"distance": "...",
"customer": "...",
"fare": "..."
}
201 Created
Location: ...
{
<cmpl-ride-repr>
}
Wild Rydes
unicorn app

L A B 3 A R C H I T E C T U R E : S C A T T E R - G A T H E R
AWS Cloud
Unicorn
management
resource
Unicorn
management
resource
Unicorn
management
resource
…
Request for
quotes topic
Ride booking
service
RFQ response
queue
Wild Rydes
unicorn app

L A B 4 A R C H I T E C T U R E : S A G A O R C H E S T R A T I O N
To be treated as one distributed TA, to leave the systems in a
semantically consistent state
Customer
accounting service
Accounting
system
Payment
service
Payment
gateway API
Payment
service
Payment
gateway API

Lab 0 / overview

Your for today:
https://dashboard.eventengine.run

Now, choose your own adventure
https://async-messaging.workshop.aws

call to

Resources & call to action
AWS blogs and other content on messaging and application integration
• https://aws.amazon.com/messaging/
• https://aws.amazon.com/event-driven-architecture/
• https://aws.amazon.com/blogs/compute/category/messaging/

AWS workshops on messaging and application integration
• https://async-messaging.workshop.aws/
• http://mqworkshop.com/

AWS workshops on messaging and application integration
• https://async-messaging.workshop.aws/
• http://mqworkshop.com/
Keep in mind, loose coupling is better than lousy coupling

Thank you!

Decoupled microservices-Building scalable applications.pptx

Recommended

Recommended

More Related Content

Similar to Decoupled microservices-Building scalable applications.pptx

Similar to Decoupled microservices-Building scalable applications.pptx (20)

Recently uploaded

Recently uploaded (20)

Decoupled microservices-Building scalable applications.pptx

Editor's Notes