DATA IN MOTION
Combining the Strengths
of AWS and Confluent
September 22, 2021
11 AM MDT

Our Learning
Checklist
What we’ll cover during this session
01
02
03
04
05
Confluent Overview
AWS Overview
Big Compass Overview
AWS + Confluent Case Studies
AWS + Confluent Better Together

Meet the
Speakers
Kapil Kumar
Co-CEO
Big Compass
Jobin George
Senior Partner Solutions
Architect | Big Data
AWS
Joseph Morais
Staff Cloud Partner
Solutions Architect
Confluent

Confluent Overview
Joseph Morais
Staff Cloud Partner Solutions Architect | Confluent

Other
Systems
Other
Systems
Kafka
Connect
Kafka Cluster
Kafka
Connect
Apache Kafka is an Event Streaming Platform
...many more

Event Streaming allow us to set Data in Motion:
Continuously processing evolving streams of data in real-time
Rich front-end
customer
experiences
Real-time
Events
Real-time
Event Streams and Analysis
A Sale A shipment
A Trade
A Customer
Experience
Real-time
backend
operations

Confluent Enables Your
Event Streaming Success
Hall of Innovation
CTO Innovation
Award Winner
2019
Enterprise Technology
Innovation
AWARDS
Confluent founders are
original creators of Apache
Kafka®
Confluent has 1 million+
hours of experience with
Kafka and we currently
manage over 6,000 clusters
in Confluent Cloud
Confluent helps enterprises
successfully deploy event
streaming at scale and
accelerate time to market
Confluent Platform extends
Apache Kafka® to be a
secure, enterprise-ready
platform

Confluent: Everywhere
Confluent Platform
The Enterprise Distribution of
Apache Kafka
Confluent Cloud
Apache Kafka Re-engineered
for the Cloud
Self-Managed Software
Fully-Managed Service
VM
Deploy on any platform, on-prem or cloud
Available on the leading public clouds

Serverless on AWS
Jobin George
Senior Partner Solutions Architect | AWS

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
10
What do our customers need to drive success?
Get to market faster High performance
and scalability
Security and
isolation by design
Lower total cost of
ownership

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
11
Why are customers building with a serverless-first
strategy?
Agility Performance Cost Security

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
12
How are customers adopting a serverless strategy?
Lift and shift
REDUCE
the amount of DIY
MIGRATE
to AWS
MODERNIZE
on AWS
Retire SaaS Refactor
Replatform
BUILD NEW INNOVATION

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
13
HUNDREDS
OF THOUSANDS
of customers
TRILLIONS
of Lambda executions
per month
Serverless adoption is growing fast

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
14
Small pieces, loosely joined

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
15
Serverless is more than compute
AWS
Lambda
AWS
Fargate
Amazon
API Gateway
Amazon
SNS
Amazon
SQS
AWS
Step Functions
COMPUTE
DATA STORES
INTEGRATION
AWS
AppSync
Amazon Aurora
Serverless
Amazon
S3
Amazon
DynamoDB
Amazon
EventBridge

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
16
How can you innovate faster with operational
consistency?
Replatforming – aka
“lift-tinker-and-shift.”
Replatforming involves making
optimizations in order to achieve some
tangible benefit in the cloud without
changing the core architecture of the
application. For example, moving from
managing your own message broker to
Amazon MQ, or leveraging your current
monitoring tool with AWS Lambda.
Standardize on familiar tooling while also benefiting from a serverless strategy

© 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark.
Confluent Cloud on AWS – Reference Architecture

© 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark.
Simple Serverless Architecture with AWS and
Confluent Cloud
https://tinyurl.com/cfltaws

Big Compass Overview
Kapil Kumar
Co-CEO | Big Compass

Empower Your Information with Data Agility
IT Consulting Company that specializes in moving and combining
data to make it readily available for better insights and operations

● Leverage best of breed as opposed to
one size fits all
● Combine technologies to complement
each other’s strengths
● Leverage cloud technologies - Cloud
first approach
● Go serverless when it makes sense
● AWS and Confluent pair well together
especially when dealing with complex
integration challenges
Big Compass Approach

AWS + Confluent
Better Together

Scenario
An API needs to be developed to accept
RESTful requests from customers and the
requests need to be transformed and sent
to Salesforce
AWS + Confluent
API Connectivity
AWS Services Used:
+ API Gateway
+ Lambda
Confluent Services Used:
+ Salesforce Sink Connector

Scenario
Salesforce emits Platform Events that
must be captured and sent to persistent
data storage for querying
AWS + Confluent
Salesforce Events
AWS services used:
+ Lambda
+ RDS
Confluent services used:
+ Salesforce Source Connector
+ Lambda Sink Connector

● Data transformation
● Orchestration
● APIs
● Data storage
● Infrastructure and hosting
● DevOps and CI/CD
● Logging
● Real-time streaming
● Connectors
AWS + Confluent
Additional Scenarios
Big Compass AWS + Confluent Blog
Low Latency Real-Time Cache Updates with
Amazon ElastiCache for Redis and Confluent
Cloud Kafka
Real-Time Serverless Ingestion, Streaming, and
Analytics using AWS and Confluent Cloud

AWS + Confluent
Case Studies

CUSTOMER CASE STUDY
Dental Insurance Firm
Challenge
A large dental insurance firm has its data locked in an
on-prem legacy IBM iSeries DB2 database.
1. Scalability limited
2. Unable to leverage cloud technologies to innovate.
3. Unable to analyze application data to gain valuable
insights and offer value added services to
customers.

CUSTOMER CASE STUDY
Dental Insurance Firm - Architecture

© 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark.
Challenge
Manual backend operations process. Distributed view of
customers and provide a real-time digital experience for tracking
the status of their cars. Need to improve customer engagement.
Solution
The solution was built with Confluent and ksqlDB on AWS as a
central nervous system connecting core ACERTUS systems,
including transportation management, title and registration, and
car haul systems
Results
Opened up new business opportunities that generated more
than $10 million in revenue in the first year. A new integrated
end-to-end solution that would incorporate many services
picking up vehicles; washing, fueling, and servicing them as
needed; and then delivering them to their destinations.
Automotive Logistics and
Services Use case - ACERTUS

© 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark.
Challenge
Maximize customer satisfaction and revenue growth by creating a
hyper-personalized online retail experience, turning each
customer visit into a one-on-one marketing opportunity.
Solution
Use Confluent to combine historical customer data with real-time
digital signals from customers, generating hyper-personalized
content – and using AWS Lambda to trigger special offers –
which is inserted in real time back into the customer’s session.
Results
● Real-time hyper-personalization of the customer experience
● Increased customer conversions
● Accelerated innovation
● Confluent Cloud frees up developers’ time
Retail use case – AO.com
https://www.confluent.io/customers/ao/

Big Compass
Accelerators
AWS and Confluent

Download
AWS Accelerator
Download
Confluent Accelerator
Data Agility Services
Confluent Implementation
Featured on:

Kapil Kumar
Co-CEO & Co-Founder
Big Compass
kapil@bigcompass.com
Jobin George
Senior Partner Solutions
Architect | Big Data
AWS
jobigeor@amazon.com
Joseph Morais
Staff Cloud Partner
Solutions Architect
Confluent
jmorais@confluent.io
Connect with Us
Thank you for attending!