Beyond serverless.pptx

To Serverless and Beyond!
Successful eCommerce Migration of LEGO.com
Sheen Brisals
The LEGO Group
@sheenbrisals

There is happy life with
Serverless!

Agenda
▪ Starting with Serverless
▪ Travelling with Serverless
▪ Accelerating with Serverless

Starting with Serverless
▪ Motivation
▪ Preparation
▪ Quick win

November 2017 – Migration thoughts
Oracle
ATG
Tax
System
VPC
Node.js
+
React
Elastic Beanstalk
container
Server contents Server contents
Tax
Products CR
M
Fulfillment Rewards
VPC
Gateway
503 Service
Unavailable
Corporate
data center
Server contents

Summer 2018 – Serverless thoughts

No one starts perfect with Serverless.
That’s fine, but strive to be better at every iteration,
and that is important
- Sheen Brisals

September 2018 – First Lambda function
VPC
Node.js
+
React
Elastic Beanstalk
container
Server contents Server contents
Tax
Products CR
M
Fulfillment Rewards
AWS Cloud
SaaS
VPC
Gateway
Server contents
Corporate
data center
Tax
System
Tax
System
Oracle
ATG
Amazon API
Gateway
AWS Lambda
function

Travelling with Serverless
▪ Principles
▪ Processes
▪ Triumphs

Serverless requires a "mind-shift" to see the
products as event-driven orchestration of
managed services, knitted with infrastructure
code, to bring the best value
for the customer
- Sheen Brisals

AWS
Cloud
… cos everything is AWSome
• Number of services
• Support and active community
• Service updates

Serverles
s
… the why matters more than the what
Trigg
er
Pu
sh
Trigg
er
Pu
sh
Trigg
er
Pu
sh
Trigg
er
Produ
ct
Prici
ng
SK
U
an ecosystem of
managed services
granular level
optimisation
ideal for iterative development
brings engineering diversity

… coz it does what it says on the tin
Managed
Services
• Fastrack development
• Event driven & decoupling
• Resilient, secure & scalable
• Native integrations
• Functionless (codeless)

… coz bitten badly by the monolith
Microservice
s• Start simple (small) and evolve
• Independent deploy pipeline
• API & event driven communication
• Refactor to grow with the technology
• Service ownership

… start small. scale fast
Agile and Iterative
daily
standup
retro
planning
grooming
review
• Practical agile
• Speed matters in development
• Focus squads
• Solution first, perfection next
• 2 week sprints

… agree fast. act fast
design
review
agree
develop
Design, Review,
Decide
• Open mindset for ideas
• Bold approach & quick decisions
• Iterate and improve
• Solution detailing, where needed
• Make engineers architects

Architect in
set-pieces
… accomplish peace by piece
• Visualise big but focus small
• Event-driven interaction
• Rehearse the design
• PoC but don’t throw away
• Embrace serverless patterns

A set-piece is a scene or sequence of scenes whose
execution requires logistical planning
with
LEG
O

Set-piece architecture requires planning and execution,
but can be rehearsed in advance

Product catalog import and update
Commerce
platform
Feeds transformProducts
feeds

Event-driven data pipeline
Transform
feed
Transformed
feeds queue
Feed
s
store
Commerce
platform API
Update
data
Data
feeds Trigger Pus
h
Trigger Update
• Feeds in JSON format
• Independent feed flow
• Immediate handling of feeds
• Decoupled processing
• Failure retry process
• Failure notification
DLQ
Thousands per day processed as soon as
possible
Fine-grained control on throughput and errors
Observability

Event-driven data pipeline
Commerce
platform API
Data
feeds
Trigger
Pus
h
Trigger
Update
Pus
h
Trigger
Pus
h
Trigger
Product
Pricing
SK
U
Observability
DLQ
s

… cos manual is painful
Automation
• Account separation – Dev, Test, QA, Prod
• Integration tests
• Test in real environment
• Grow the CI/CD pipeline
• Developers towards DevOps

July 10, 2019
shop.LEGO.com
was switched to
serverless
on AWS

August 15, 2019 – Unified LEGO.com

AWS services in use
Amazon S3
Amazon
SNS
AWS
Fargate
AWS Lambda
Amazon Kinesis Data
Firehose
Amazon DynamoDB
Amazon API Gateway
AWS Step Functions
Amazon
SQS
Amazon
EC2
Amazon
ECS
Amazon
ECR
Amazon
VPC
AWS
WAF
AWS
KMS
AWS Identity and Access
Management (IAM)
AWS X-Ray
Amazon Route 53
AWS CloudTrail
Amazon ElastiCache
Amazon CloudWatch
Amazon EventBridge
AWS CloudFormation
Parameter Store

Growing usage stats from production
170+ Lambda functions
35+ microservices
40+ API Gateway endpoints
25+ DynamoDB tables
30+ S3 buckets
20+ SNS topics
60+ SQS queues +
DLQs
200+ Systems Manager params
2 EventBridge custom bus

1. Serverless microservices – 80% logic
2. Frontend app – React, Node.js - Fargate
3. GraphQL query layer – Fargate
4. Headless commerce platform – SaaS
5. Content management system – SaaS
6. Rewards platform - SaaS
NE
W
NE
W
NE
W
NE
W
NE
W
NE
W

So, we migrated. We are serverless!
Are we done then?

Accelerating with Serverless
▪ Team
▪ Value
▪ Technology

Agile, iterative and automated serverless development on
AWS is like a gravity defying take-off.
Once launched, no stopping!
- Sheen Brisals

… grow serverless engineers
▪ Team
▪ Growth & Diversity
▪ Value
▪ Technology

https://bit.ly/31zrh1N
Serverless Engineer is a software engineer
who is innovative, efficient, capable of
building secure, cloud first and cost effective
functional solutions, iteratively using
managed services

Serverless drives engineering
diversity

services
checkout content
infra
management
Before – Focus Squads

management
Now – Full-stack Squads
checkout
infra
apps paymentsfuture
content rewards new

▪ Team
▪ DevOps Culture
▪ Value
▪ Technology
… you build it. You run it

• Engineers perform end to end service delivery
• Become part of the on-call team
• Studying logs and monitoring applications
• Work with infra, security and SR specialists
• Mission Control dashboard for deployment visibility

▪ Team
▪ DevOps Culture
▪ Sharing
▪ Value
… sharing is caring

▪ Team
▪ Value
▪ Business value
▪ Technology

You can’t do today’s job with yesterday’s methods
and be in business tomorrow
- George W Bush

Product recommendation
Kinesis
Data Firehose
API
Gateway
S3
bucket
Event
producer
Fan-out
function
Event
dispatchers
Trigger
Asyn
c
Event
consumers
Data analytics
consumer

▪ Team
▪ Value
▪ Business value
▪ Customer value
▪ Technology

Customers don’t care how much you know until
they know how much you care
- Damon Richards

Feature – Store inventory check

Store inventory
check
Inventory
feeds
Feed
s
Feed handlerFeeds
ingest API
Store
inventory
Shop
Stock
check
API
Stock check
handler
Geo
coordinates
Store
locations
1
2
3
Functionless
integration
Accelerating
for more
value!
SKU
Postcode
SKU
Postcode

Store inventory
check
Inventory
feeds
Feed
s
Feed handlerFeeds
ingest API
Store
inventory
Shop
Stock
check
API
Stock check
handler
Geo
coordinates
Store
locations
1
2
3
SKU
Postcode
SKU
Postcode
Dashboard Event bus

▪ Team
▪ Value
▪ Technology
▪ Amazon EventBridge

Amazon EventBridge is a serverless event bus service
that makes it easy to connect your applications with
data from a variety of sources

Amazon EventBridge
Custom event bus
Default event bus
Partner event bus
Event producers
(sources)
Event consumers
(targets)
Partner apps
Custom apps
AWS
services
Event bus Filtering &
routing rules

Use case: Submit order notification

Rewards
platform
Customer
Shipment
Order
All orders
Only VIP customer orders

Shipping
Send order
to SAP
Checkou
t
Submit
order
Reward
s
Process
rewards
New order
All orders
VIP
customer
orders

Shipping
Send order
to SAP
Checkou
t
Submit
order
Reward
s
Process
rewards
{
  "detail": {
     "metadata": {
“domain”: “LEGO-SHOP”,
        “service": “service_checkout”,
        "type": “ORDER”,
        "status": “SUBMITTED”
      },
      "data": {
“orderNumber": “T12346789”,
“customerId": “bf3703467718”,
“locale”: “en-GB”,
“value”: 59.99,
       “isVIPOrder": “true”
      }
  }
}
Submitted order event

Shipping
Send order
to SAP
Checkou
t
Submit
order
Reward
s
Process
rewards
{
  "detail": {
     "metadata": {
        “service": [“service_checkout“],
        "type": [“ORDER“],
        "status": [“SUBMITTED“]
      }
  }
}
{
  "detail": {
     "metadata": {
      },
      "data": {
“value”: 59.99,
      }
  }
}
All submitted orders

Shipping
Send order
to SAP
Checkou
t
Submit
order
Reward
s
Process
rewards
{
  "detail": {
     "metadata": {
      },
      "data": {
        “isVIPOrder": [“true“],
      }
  }
}
{
  "detail": {
     "metadata": {
      }
  }
}
{
  "detail": {
     "metadata": {
      },
      "data": {
“value”: 59.99,
      }
  }
}
Only VIP customer orders
All submitted orders

To close…
Serverless is not just the starter kit
It is your engine as well
Travel with it
Fall in love with it!

go
build
serverles
s thank
you!@sheenbrisals

Beyond serverless.pptx

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Beyond serverless.pptx

Similar to Beyond serverless.pptx (20)

More from AWSCOMSUM

More from AWSCOMSUM (20)

Recently uploaded

Recently uploaded (20)

Beyond serverless.pptx