SlideShare a Scribd company logo
1 of 22
Download to read offline
Getting More From Your Data with Azure
Cosmos DB, Synapse, and Confluent
Cloud
Session Speakers
Sr. Product Marketing Manager – Partnerships
Peter Kennedy is a product marketer at Confluent
focused on accelerating partnerships and joint go-to-
market activities surrounding Confluent Cloud. Prior to
Confluent, he worked for Microsoft as a product and
partner marketer in the IoT portfolio.
Peter Kennedy, Confluent
Sr. Specialist, Azure Cosmos DB/NoSQL Global Black Belt
Luciano Moreira is an Azure Cosmos DB specialist at
Microsoft who helps companies tackle challenging data
scenarios, successfully building performance and resilient
solutions with Azure.
Luciano Moreira, Microsoft
Real-time
Data
A Sale
A shipment
A Trade
A Customer
Experience
Data streaming fuels modern data platforms
“We need to shift our thinking from everything
at rest, to everything in motion.” —
Real-Time Data Streaming
Rich Front-End Customer
Experiences
Real-Time Backend
Operations
Companies move to the cloud to build
modern data platforms
Agile Elastic Cost-saving
Fast
deployment
“More than 45% of IT spending on infrastructure and application software
will shift from on-prem to cloud by 2024.” – Gartner
These cloud-native data platforms power
business critical applications and analytics
5
Self-Managed Data Platforms
● Inflexible architecture makes it hard
to integrate with other systems
● Expensive in both upfront and
ongoing maintenance costs
● Slow to scale to meet evolving
demands
Cloud Data Platforms
● Lowers TCO by decoupling storage
from compute and leveraging
consumption- based pricing
● Increases flexibility and agility
● Simplifies operations with built into
auto-scaling and maintenance cycles
Integrating multiple systems to the cloud
is challenging
1. Wastes time and resources
Replacing or refactoring legacy data
systems across environments is not easy.
During which, data visibility can be limited.
1. Conceals blind spots
Getting actionable data from disparate data
sources is cumbersome. Most data insight
comes from nightly loads, merges, and
batch updates to create a complete view.
1. Creates data silos
Difficulties with integrating multiple data
silos and data formats.
On-Prem
Legacy Data
Store
Cloud
Cloud Data
Store
CRM
SaaS
App
Nightly
Reporting
Applications ETL App
Batch Jobs
Confluent helps you modernize and
integrate legacy with the cloud
1. Accelerate and simplify
migration
Link on-prem and cloud for easier data
movement across environments with real-
time event streaming to start migrating
immediately
1. Enhance data in real-time
Process data in flight with ksqlDB and use
our fully managed service to enrich or
transform your data before inserting into
the cloud database
1. Reduces TCO
Leverage fully managed services and
avoid prohibitive licensing costs from
existing solutions offered by legacy vendors
On-Prem Cloud
Legacy Data
Store
Cloud Data
Store
Apache
Kafka
120+ Pre-built
Connectors
Stream
Processing
with ksqlDB
CRM
SaaS App
The Confluent Advantage
Everywhere
Maintain flexibility with
deployments on Azure
and connect across
clouds and on-premises
that sync in real-time
Complete
Go beyond Kafka to
build real-time apps on
Azure quickly, reliably,
and securely
Cloud-Native
Apache Kafka re-
architected to harness
the power of the cloud
on Azure
Stream confidently on a highly available platform built by the world's utmost
Apache Kafka experts with built-in enterprise-ready security, compliance, and privacy controls
Confluent and Microsoft
Trusted by Azure, Partners, and Customers
Direct integration with
popular services
Unified operations
and billing experience
Deep relationship and
solution preference
Azure Native Services
3rd-Party ISV Services
Unified Billing Experience
Transact directly through Azure
Marketplace to remove friction and
burn down existing Azure commits
on your M.A.C.C. agreement.
Unified security & management
Trusted enterprise-grade security
with default encryption, private
networking, and single sign-on.
Process cybersecurity data from 120+
sources to increase enterprise
visibility.
Microsoft Strategic Alliance
Confluent & MSFT announced our
strategic partnership in January of 2021,
and due to unprecedented customer
demand we announced the expansion
and extension of our partnership in April
of 2022
Microsoft Preferred Solution
Confluent Cloud has been validated by a
team of Microsoft experts and has
proven to generate business impact,
technology transformation, and cross-
organizational improvements for its
customers.
Azure
Synapse
Azure Event
Hub
Azure
Cosmos DB
Azure Data
Lake Storage
Azure Blob
Storage
Azure
Functions
Understanding the architecture
Azure
On-Prem
Oracle HDFS Teradata,
Netezza
Mainframe
KSQL
Confluent Platform Confluent Cluster Linking
App
OSS Kafka Confluent Cluster Linking
Oracle HDFS Teradata,
Netezza
Mainframe
App
Cloud Apps
3rd party data
Additional Regions or Clouds
Confluent Cluster Linking
Cosmos DB
Azure
Functions
Azure Cosmos DB
Azure Cosmos DB is a fully
managed NoSQL database
service for modern app
development. Get
guaranteed single-digit
millisecond response times
and 99.999-percent
availability, backed by
SLAs, automatic and
instant scalability, and
open-source APIs for
MongoDB and Cassandra.
Azure Cosmos DB
● Unlimited scalability
● Global distribution
● Multi-master
● Low latency (< 10ms)
● Flexible schema
● Multiple SDKs
● Autoscale
● Serverless
● Consistency models
Azure Cosmos DB
Reference (2021)
Azure Cosmos DB Conf
Azure Cosmos DB use cases
Azure
Understanding the architecture:
Azure Cosmos DB
On-Prem
Oracle HDFS Teradata,
Netezza
Mainframe
KSQL
Confluent Platform Confluent Cluster Linking
App
OSS Kafka Confluent Cluster Linking
Oracle HDFS Teradata,
Netezza
Mainframe
App
Cloud Apps
3rd party data
Additional Regions or Clouds
Confluent Cluster Linking
Cosmos DB
Azure
Functions
Synapse
Cosmos DB
Cosmos DB
Global replication
Azure Functions +
Change Feed
Global
distribution
SDKs
Azure ML
Power BI
Data Science and Business Analytics
view data in very different ways
DATA SCI ENCE BUSI NESS ANALY TI CS
Big data
Experimentation
Fast exploration
Semi-structured
OR
Relational data
Proven security & privacy
Dependable performance
Structured
DATA WAREHOUSE
DATA L AKE
Ease of use
Fast expl or at i on
Qui ck to st ar t
Proven secur i t y
Ai r t i ght pr i vacy
Dependabl e per f or mance
Azure meets these challenges
with a single service to provide limitless analytics
The first unified, cloud
native platform for
converged analytics
Data
Warehouse
Data
Lake
Event
Brokers
Azure Synapse Link
Cosmos DB Dataverse
Near real-time
analytics
No managed ETL
Built for convergence
Azure Synapse Link
Azure Cosmos DB
Auto-Sync
Transactional Store
Row store optimized for
transactional reads and writes
Analytical Store
Column store optimized
for analytical queries
Operational
Data Container
Synapse Link
Cloud-Native HTAP
SQL
Azure Synapse Analytics
Reduce architectural complexity
with cloud-native HTAP
Azure
Understanding the architecture:
Azure Cosmos DB & Synapse
On-Prem
Oracle HDFS Teradata,
Netezza
Mainframe
KSQL
Confluent Platform Confluent Cluster Linking
App
OSS Kafka Confluent Cluster Linking
Oracle HDFS Teradata,
Netezza
Mainframe
App
Cloud Apps
3rd party data
Additional Regions or Clouds
Confluent Cluster Linking
Cosmos DB
Azure
Functions
Synapse
Cosmos DB
Cosmos DB
Global replication
Azure Functions +
Change Feed
Global
distribution
SDKs
Power BI
Azure ML
Next steps
Get started
Try Azure for free
azure.microsoft.com/en-us/free/
Visit the Microsoft booth
Microsoft
Get started
Try Confluent for free with $400
in free credits
confluent.io/confluent-cloud
Visit the Confluent booth
Confluent

More Related Content

Similar to Luciano Moreira_Jacob Bogie-BRSP005-10.3_22_FINAL.pdf

Streaming Time Series Data With Kenny Gorman and Elena Cuevas | Current 2022
Streaming Time Series Data With Kenny Gorman and Elena Cuevas | Current 2022Streaming Time Series Data With Kenny Gorman and Elena Cuevas | Current 2022
Streaming Time Series Data With Kenny Gorman and Elena Cuevas | Current 2022HostedbyConfluent
 
Cosmos DB - Database for Serverless era
Cosmos DB - Database for Serverless eraCosmos DB - Database for Serverless era
Cosmos DB - Database for Serverless eraMichał Jankowski
 
Serverless Kafka on AWS as Part of a Cloud-native Data Lake Architecture
Serverless Kafka on AWS as Part of a Cloud-native Data Lake ArchitectureServerless Kafka on AWS as Part of a Cloud-native Data Lake Architecture
Serverless Kafka on AWS as Part of a Cloud-native Data Lake ArchitectureKai Wähner
 
Why Cloud-Native Kafka Matters: 4 Reasons to Stop Managing it Yourself
Why Cloud-Native Kafka Matters: 4 Reasons to Stop Managing it YourselfWhy Cloud-Native Kafka Matters: 4 Reasons to Stop Managing it Yourself
Why Cloud-Native Kafka Matters: 4 Reasons to Stop Managing it YourselfDATAVERSITY
 
Mainframe Modernization with Precisely and Microsoft Azure
Mainframe Modernization with Precisely and Microsoft AzureMainframe Modernization with Precisely and Microsoft Azure
Mainframe Modernization with Precisely and Microsoft AzurePrecisely
 
Building Complex Workloads in Cloud - AWS PS Summit Canberra
Building Complex Workloads in Cloud - AWS PS Summit CanberraBuilding Complex Workloads in Cloud - AWS PS Summit Canberra
Building Complex Workloads in Cloud - AWS PS Summit CanberraAmazon Web Services
 
DIMT 2023 SG - Hands-on Workshop_ Getting started with Confluent Cloud.pdf
DIMT 2023 SG - Hands-on Workshop_ Getting started with Confluent Cloud.pdfDIMT 2023 SG - Hands-on Workshop_ Getting started with Confluent Cloud.pdf
DIMT 2023 SG - Hands-on Workshop_ Getting started with Confluent Cloud.pdfconfluent
 
Data Migration and Data-Tier Applications with SQL Azure
Data Migration and Data-Tier Applications with SQL AzureData Migration and Data-Tier Applications with SQL Azure
Data Migration and Data-Tier Applications with SQL AzureMark Kromer
 
101_Customer_Move and Modernize Siebel_07012021.pptx
101_Customer_Move and Modernize Siebel_07012021.pptx101_Customer_Move and Modernize Siebel_07012021.pptx
101_Customer_Move and Modernize Siebel_07012021.pptxBhagavathyPadmanabha1
 
To the Cloud and beyond (Nantes, Rebuild 2018)
To the Cloud and beyond (Nantes, Rebuild 2018)To the Cloud and beyond (Nantes, Rebuild 2018)
To the Cloud and beyond (Nantes, Rebuild 2018)Alex Danvy
 
Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...
Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...
Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...Amazon Web Services
 
Windowsazureplatform Overviewlatest
Windowsazureplatform OverviewlatestWindowsazureplatform Overviewlatest
Windowsazureplatform Overviewlatestrajramab
 
Streaming IBM i to Kafka for Next-Gen Use Cases
Streaming IBM i to Kafka for Next-Gen Use CasesStreaming IBM i to Kafka for Next-Gen Use Cases
Streaming IBM i to Kafka for Next-Gen Use CasesPrecisely
 
AWS + Confluent: Better Together
AWS + Confluent: Better TogetherAWS + Confluent: Better Together
AWS + Confluent: Better Togetherconfluent
 
Azure SQL DB Managed Instances Built to easily modernize application data layer
Azure SQL DB Managed Instances Built to easily modernize application data layerAzure SQL DB Managed Instances Built to easily modernize application data layer
Azure SQL DB Managed Instances Built to easily modernize application data layerMicrosoft Tech Community
 
4. aws enterprise summit seoul 기존 엔터프라이즈 it 솔루션 클라우드로 이전하기 - thomas park
4. aws enterprise summit seoul   기존 엔터프라이즈 it 솔루션 클라우드로 이전하기 - thomas park4. aws enterprise summit seoul   기존 엔터프라이즈 it 솔루션 클라우드로 이전하기 - thomas park
4. aws enterprise summit seoul 기존 엔터프라이즈 it 솔루션 클라우드로 이전하기 - thomas parkAmazon Web Services Korea
 
Optimize App Performance and Security by Managing Microsoft Workloads on AWS ...
Optimize App Performance and Security by Managing Microsoft Workloads on AWS ...Optimize App Performance and Security by Managing Microsoft Workloads on AWS ...
Optimize App Performance and Security by Managing Microsoft Workloads on AWS ...Amazon Web Services
 

Similar to Luciano Moreira_Jacob Bogie-BRSP005-10.3_22_FINAL.pdf (20)

Streaming Time Series Data With Kenny Gorman and Elena Cuevas | Current 2022
Streaming Time Series Data With Kenny Gorman and Elena Cuevas | Current 2022Streaming Time Series Data With Kenny Gorman and Elena Cuevas | Current 2022
Streaming Time Series Data With Kenny Gorman and Elena Cuevas | Current 2022
 
Cosmos DB - Database for Serverless era
Cosmos DB - Database for Serverless eraCosmos DB - Database for Serverless era
Cosmos DB - Database for Serverless era
 
Serverless Kafka on AWS as Part of a Cloud-native Data Lake Architecture
Serverless Kafka on AWS as Part of a Cloud-native Data Lake ArchitectureServerless Kafka on AWS as Part of a Cloud-native Data Lake Architecture
Serverless Kafka on AWS as Part of a Cloud-native Data Lake Architecture
 
Why Cloud-Native Kafka Matters: 4 Reasons to Stop Managing it Yourself
Why Cloud-Native Kafka Matters: 4 Reasons to Stop Managing it YourselfWhy Cloud-Native Kafka Matters: 4 Reasons to Stop Managing it Yourself
Why Cloud-Native Kafka Matters: 4 Reasons to Stop Managing it Yourself
 
Mainframe Modernization with Precisely and Microsoft Azure
Mainframe Modernization with Precisely and Microsoft AzureMainframe Modernization with Precisely and Microsoft Azure
Mainframe Modernization with Precisely and Microsoft Azure
 
Building Complex Workloads in Cloud - AWS PS Summit Canberra
Building Complex Workloads in Cloud - AWS PS Summit CanberraBuilding Complex Workloads in Cloud - AWS PS Summit Canberra
Building Complex Workloads in Cloud - AWS PS Summit Canberra
 
DIMT 2023 SG - Hands-on Workshop_ Getting started with Confluent Cloud.pdf
DIMT 2023 SG - Hands-on Workshop_ Getting started with Confluent Cloud.pdfDIMT 2023 SG - Hands-on Workshop_ Getting started with Confluent Cloud.pdf
DIMT 2023 SG - Hands-on Workshop_ Getting started with Confluent Cloud.pdf
 
Data Migration and Data-Tier Applications with SQL Azure
Data Migration and Data-Tier Applications with SQL AzureData Migration and Data-Tier Applications with SQL Azure
Data Migration and Data-Tier Applications with SQL Azure
 
101_Customer_Move and Modernize Siebel_07012021.pptx
101_Customer_Move and Modernize Siebel_07012021.pptx101_Customer_Move and Modernize Siebel_07012021.pptx
101_Customer_Move and Modernize Siebel_07012021.pptx
 
To the Cloud and beyond (Nantes, Rebuild 2018)
To the Cloud and beyond (Nantes, Rebuild 2018)To the Cloud and beyond (Nantes, Rebuild 2018)
To the Cloud and beyond (Nantes, Rebuild 2018)
 
Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...
Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...
Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...
 
Windowsazureplatform Overviewlatest
Windowsazureplatform OverviewlatestWindowsazureplatform Overviewlatest
Windowsazureplatform Overviewlatest
 
Streaming IBM i to Kafka for Next-Gen Use Cases
Streaming IBM i to Kafka for Next-Gen Use CasesStreaming IBM i to Kafka for Next-Gen Use Cases
Streaming IBM i to Kafka for Next-Gen Use Cases
 
AWS + Confluent: Better Together
AWS + Confluent: Better TogetherAWS + Confluent: Better Together
AWS + Confluent: Better Together
 
Azure SQL DB Managed Instances Built to easily modernize application data layer
Azure SQL DB Managed Instances Built to easily modernize application data layerAzure SQL DB Managed Instances Built to easily modernize application data layer
Azure SQL DB Managed Instances Built to easily modernize application data layer
 
4. aws enterprise summit seoul 기존 엔터프라이즈 it 솔루션 클라우드로 이전하기 - thomas park
4. aws enterprise summit seoul   기존 엔터프라이즈 it 솔루션 클라우드로 이전하기 - thomas park4. aws enterprise summit seoul   기존 엔터프라이즈 it 솔루션 클라우드로 이전하기 - thomas park
4. aws enterprise summit seoul 기존 엔터프라이즈 it 솔루션 클라우드로 이전하기 - thomas park
 
Optimize App Performance and Security by Managing Microsoft Workloads on AWS ...
Optimize App Performance and Security by Managing Microsoft Workloads on AWS ...Optimize App Performance and Security by Managing Microsoft Workloads on AWS ...
Optimize App Performance and Security by Managing Microsoft Workloads on AWS ...
 
Azure 10 major services
Azure 10 major servicesAzure 10 major services
Azure 10 major services
 
M meijer paas - tech-days 2015
M meijer   paas - tech-days 2015M meijer   paas - tech-days 2015
M meijer paas - tech-days 2015
 
Infrastructure Solution Day | Final
Infrastructure Solution Day | FinalInfrastructure Solution Day | Final
Infrastructure Solution Day | Final
 

More from HostedbyConfluent

Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
Renaming a Kafka Topic | Kafka Summit London
Renaming a Kafka Topic | Kafka Summit LondonRenaming a Kafka Topic | Kafka Summit London
Renaming a Kafka Topic | Kafka Summit LondonHostedbyConfluent
 
Evolution of NRT Data Ingestion Pipeline at Trendyol
Evolution of NRT Data Ingestion Pipeline at TrendyolEvolution of NRT Data Ingestion Pipeline at Trendyol
Evolution of NRT Data Ingestion Pipeline at TrendyolHostedbyConfluent
 
Ensuring Kafka Service Resilience: A Dive into Health-Checking Techniques
Ensuring Kafka Service Resilience: A Dive into Health-Checking TechniquesEnsuring Kafka Service Resilience: A Dive into Health-Checking Techniques
Ensuring Kafka Service Resilience: A Dive into Health-Checking TechniquesHostedbyConfluent
 
Exactly-once Stream Processing with Arroyo and Kafka
Exactly-once Stream Processing with Arroyo and KafkaExactly-once Stream Processing with Arroyo and Kafka
Exactly-once Stream Processing with Arroyo and KafkaHostedbyConfluent
 
Fish Plays Pokemon | Kafka Summit London
Fish Plays Pokemon | Kafka Summit LondonFish Plays Pokemon | Kafka Summit London
Fish Plays Pokemon | Kafka Summit LondonHostedbyConfluent
 
Tiered Storage 101 | Kafla Summit London
Tiered Storage 101 | Kafla Summit LondonTiered Storage 101 | Kafla Summit London
Tiered Storage 101 | Kafla Summit LondonHostedbyConfluent
 
Building a Self-Service Stream Processing Portal: How And Why
Building a Self-Service Stream Processing Portal: How And WhyBuilding a Self-Service Stream Processing Portal: How And Why
Building a Self-Service Stream Processing Portal: How And WhyHostedbyConfluent
 
From the Trenches: Improving Kafka Connect Source Connector Ingestion from 7 ...
From the Trenches: Improving Kafka Connect Source Connector Ingestion from 7 ...From the Trenches: Improving Kafka Connect Source Connector Ingestion from 7 ...
From the Trenches: Improving Kafka Connect Source Connector Ingestion from 7 ...HostedbyConfluent
 
Future with Zero Down-Time: End-to-end Resiliency with Chaos Engineering and ...
Future with Zero Down-Time: End-to-end Resiliency with Chaos Engineering and ...Future with Zero Down-Time: End-to-end Resiliency with Chaos Engineering and ...
Future with Zero Down-Time: End-to-end Resiliency with Chaos Engineering and ...HostedbyConfluent
 
Navigating Private Network Connectivity Options for Kafka Clusters
Navigating Private Network Connectivity Options for Kafka ClustersNavigating Private Network Connectivity Options for Kafka Clusters
Navigating Private Network Connectivity Options for Kafka ClustersHostedbyConfluent
 
Apache Flink: Building a Company-wide Self-service Streaming Data Platform
Apache Flink: Building a Company-wide Self-service Streaming Data PlatformApache Flink: Building a Company-wide Self-service Streaming Data Platform
Apache Flink: Building a Company-wide Self-service Streaming Data PlatformHostedbyConfluent
 
Explaining How Real-Time GenAI Works in a Noisy Pub
Explaining How Real-Time GenAI Works in a Noisy PubExplaining How Real-Time GenAI Works in a Noisy Pub
Explaining How Real-Time GenAI Works in a Noisy PubHostedbyConfluent
 
TL;DR Kafka Metrics | Kafka Summit London
TL;DR Kafka Metrics | Kafka Summit LondonTL;DR Kafka Metrics | Kafka Summit London
TL;DR Kafka Metrics | Kafka Summit LondonHostedbyConfluent
 
A Window Into Your Kafka Streams Tasks | KSL
A Window Into Your Kafka Streams Tasks | KSLA Window Into Your Kafka Streams Tasks | KSL
A Window Into Your Kafka Streams Tasks | KSLHostedbyConfluent
 
Mastering Kafka Producer Configs: A Guide to Optimizing Performance
Mastering Kafka Producer Configs: A Guide to Optimizing PerformanceMastering Kafka Producer Configs: A Guide to Optimizing Performance
Mastering Kafka Producer Configs: A Guide to Optimizing PerformanceHostedbyConfluent
 
Data Contracts Management: Schema Registry and Beyond
Data Contracts Management: Schema Registry and BeyondData Contracts Management: Schema Registry and Beyond
Data Contracts Management: Schema Registry and BeyondHostedbyConfluent
 
Code-First Approach: Crafting Efficient Flink Apps
Code-First Approach: Crafting Efficient Flink AppsCode-First Approach: Crafting Efficient Flink Apps
Code-First Approach: Crafting Efficient Flink AppsHostedbyConfluent
 
Debezium vs. the World: An Overview of the CDC Ecosystem
Debezium vs. the World: An Overview of the CDC EcosystemDebezium vs. the World: An Overview of the CDC Ecosystem
Debezium vs. the World: An Overview of the CDC EcosystemHostedbyConfluent
 
Beyond Tiered Storage: Serverless Kafka with No Local Disks
Beyond Tiered Storage: Serverless Kafka with No Local DisksBeyond Tiered Storage: Serverless Kafka with No Local Disks
Beyond Tiered Storage: Serverless Kafka with No Local DisksHostedbyConfluent
 

More from HostedbyConfluent (20)

Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
Renaming a Kafka Topic | Kafka Summit London
Renaming a Kafka Topic | Kafka Summit LondonRenaming a Kafka Topic | Kafka Summit London
Renaming a Kafka Topic | Kafka Summit London
 
Evolution of NRT Data Ingestion Pipeline at Trendyol
Evolution of NRT Data Ingestion Pipeline at TrendyolEvolution of NRT Data Ingestion Pipeline at Trendyol
Evolution of NRT Data Ingestion Pipeline at Trendyol
 
Ensuring Kafka Service Resilience: A Dive into Health-Checking Techniques
Ensuring Kafka Service Resilience: A Dive into Health-Checking TechniquesEnsuring Kafka Service Resilience: A Dive into Health-Checking Techniques
Ensuring Kafka Service Resilience: A Dive into Health-Checking Techniques
 
Exactly-once Stream Processing with Arroyo and Kafka
Exactly-once Stream Processing with Arroyo and KafkaExactly-once Stream Processing with Arroyo and Kafka
Exactly-once Stream Processing with Arroyo and Kafka
 
Fish Plays Pokemon | Kafka Summit London
Fish Plays Pokemon | Kafka Summit LondonFish Plays Pokemon | Kafka Summit London
Fish Plays Pokemon | Kafka Summit London
 
Tiered Storage 101 | Kafla Summit London
Tiered Storage 101 | Kafla Summit LondonTiered Storage 101 | Kafla Summit London
Tiered Storage 101 | Kafla Summit London
 
Building a Self-Service Stream Processing Portal: How And Why
Building a Self-Service Stream Processing Portal: How And WhyBuilding a Self-Service Stream Processing Portal: How And Why
Building a Self-Service Stream Processing Portal: How And Why
 
From the Trenches: Improving Kafka Connect Source Connector Ingestion from 7 ...
From the Trenches: Improving Kafka Connect Source Connector Ingestion from 7 ...From the Trenches: Improving Kafka Connect Source Connector Ingestion from 7 ...
From the Trenches: Improving Kafka Connect Source Connector Ingestion from 7 ...
 
Future with Zero Down-Time: End-to-end Resiliency with Chaos Engineering and ...
Future with Zero Down-Time: End-to-end Resiliency with Chaos Engineering and ...Future with Zero Down-Time: End-to-end Resiliency with Chaos Engineering and ...
Future with Zero Down-Time: End-to-end Resiliency with Chaos Engineering and ...
 
Navigating Private Network Connectivity Options for Kafka Clusters
Navigating Private Network Connectivity Options for Kafka ClustersNavigating Private Network Connectivity Options for Kafka Clusters
Navigating Private Network Connectivity Options for Kafka Clusters
 
Apache Flink: Building a Company-wide Self-service Streaming Data Platform
Apache Flink: Building a Company-wide Self-service Streaming Data PlatformApache Flink: Building a Company-wide Self-service Streaming Data Platform
Apache Flink: Building a Company-wide Self-service Streaming Data Platform
 
Explaining How Real-Time GenAI Works in a Noisy Pub
Explaining How Real-Time GenAI Works in a Noisy PubExplaining How Real-Time GenAI Works in a Noisy Pub
Explaining How Real-Time GenAI Works in a Noisy Pub
 
TL;DR Kafka Metrics | Kafka Summit London
TL;DR Kafka Metrics | Kafka Summit LondonTL;DR Kafka Metrics | Kafka Summit London
TL;DR Kafka Metrics | Kafka Summit London
 
A Window Into Your Kafka Streams Tasks | KSL
A Window Into Your Kafka Streams Tasks | KSLA Window Into Your Kafka Streams Tasks | KSL
A Window Into Your Kafka Streams Tasks | KSL
 
Mastering Kafka Producer Configs: A Guide to Optimizing Performance
Mastering Kafka Producer Configs: A Guide to Optimizing PerformanceMastering Kafka Producer Configs: A Guide to Optimizing Performance
Mastering Kafka Producer Configs: A Guide to Optimizing Performance
 
Data Contracts Management: Schema Registry and Beyond
Data Contracts Management: Schema Registry and BeyondData Contracts Management: Schema Registry and Beyond
Data Contracts Management: Schema Registry and Beyond
 
Code-First Approach: Crafting Efficient Flink Apps
Code-First Approach: Crafting Efficient Flink AppsCode-First Approach: Crafting Efficient Flink Apps
Code-First Approach: Crafting Efficient Flink Apps
 
Debezium vs. the World: An Overview of the CDC Ecosystem
Debezium vs. the World: An Overview of the CDC EcosystemDebezium vs. the World: An Overview of the CDC Ecosystem
Debezium vs. the World: An Overview of the CDC Ecosystem
 
Beyond Tiered Storage: Serverless Kafka with No Local Disks
Beyond Tiered Storage: Serverless Kafka with No Local DisksBeyond Tiered Storage: Serverless Kafka with No Local Disks
Beyond Tiered Storage: Serverless Kafka with No Local Disks
 

Recently uploaded

Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraDeakin University
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptxMaking_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptxnull - The Open Security Community
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Neo4j
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 

Recently uploaded (20)

Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning era
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptxMaking_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 

Luciano Moreira_Jacob Bogie-BRSP005-10.3_22_FINAL.pdf

  • 1. Getting More From Your Data with Azure Cosmos DB, Synapse, and Confluent Cloud
  • 2. Session Speakers Sr. Product Marketing Manager – Partnerships Peter Kennedy is a product marketer at Confluent focused on accelerating partnerships and joint go-to- market activities surrounding Confluent Cloud. Prior to Confluent, he worked for Microsoft as a product and partner marketer in the IoT portfolio. Peter Kennedy, Confluent Sr. Specialist, Azure Cosmos DB/NoSQL Global Black Belt Luciano Moreira is an Azure Cosmos DB specialist at Microsoft who helps companies tackle challenging data scenarios, successfully building performance and resilient solutions with Azure. Luciano Moreira, Microsoft
  • 3. Real-time Data A Sale A shipment A Trade A Customer Experience Data streaming fuels modern data platforms “We need to shift our thinking from everything at rest, to everything in motion.” — Real-Time Data Streaming Rich Front-End Customer Experiences Real-Time Backend Operations
  • 4. Companies move to the cloud to build modern data platforms Agile Elastic Cost-saving Fast deployment “More than 45% of IT spending on infrastructure and application software will shift from on-prem to cloud by 2024.” – Gartner
  • 5. These cloud-native data platforms power business critical applications and analytics 5 Self-Managed Data Platforms ● Inflexible architecture makes it hard to integrate with other systems ● Expensive in both upfront and ongoing maintenance costs ● Slow to scale to meet evolving demands Cloud Data Platforms ● Lowers TCO by decoupling storage from compute and leveraging consumption- based pricing ● Increases flexibility and agility ● Simplifies operations with built into auto-scaling and maintenance cycles
  • 6. Integrating multiple systems to the cloud is challenging 1. Wastes time and resources Replacing or refactoring legacy data systems across environments is not easy. During which, data visibility can be limited. 1. Conceals blind spots Getting actionable data from disparate data sources is cumbersome. Most data insight comes from nightly loads, merges, and batch updates to create a complete view. 1. Creates data silos Difficulties with integrating multiple data silos and data formats. On-Prem Legacy Data Store Cloud Cloud Data Store CRM SaaS App Nightly Reporting Applications ETL App Batch Jobs
  • 7. Confluent helps you modernize and integrate legacy with the cloud 1. Accelerate and simplify migration Link on-prem and cloud for easier data movement across environments with real- time event streaming to start migrating immediately 1. Enhance data in real-time Process data in flight with ksqlDB and use our fully managed service to enrich or transform your data before inserting into the cloud database 1. Reduces TCO Leverage fully managed services and avoid prohibitive licensing costs from existing solutions offered by legacy vendors On-Prem Cloud Legacy Data Store Cloud Data Store Apache Kafka 120+ Pre-built Connectors Stream Processing with ksqlDB CRM SaaS App
  • 8. The Confluent Advantage Everywhere Maintain flexibility with deployments on Azure and connect across clouds and on-premises that sync in real-time Complete Go beyond Kafka to build real-time apps on Azure quickly, reliably, and securely Cloud-Native Apache Kafka re- architected to harness the power of the cloud on Azure Stream confidently on a highly available platform built by the world's utmost Apache Kafka experts with built-in enterprise-ready security, compliance, and privacy controls
  • 9. Confluent and Microsoft Trusted by Azure, Partners, and Customers Direct integration with popular services Unified operations and billing experience Deep relationship and solution preference Azure Native Services 3rd-Party ISV Services Unified Billing Experience Transact directly through Azure Marketplace to remove friction and burn down existing Azure commits on your M.A.C.C. agreement. Unified security & management Trusted enterprise-grade security with default encryption, private networking, and single sign-on. Process cybersecurity data from 120+ sources to increase enterprise visibility. Microsoft Strategic Alliance Confluent & MSFT announced our strategic partnership in January of 2021, and due to unprecedented customer demand we announced the expansion and extension of our partnership in April of 2022 Microsoft Preferred Solution Confluent Cloud has been validated by a team of Microsoft experts and has proven to generate business impact, technology transformation, and cross- organizational improvements for its customers. Azure Synapse Azure Event Hub Azure Cosmos DB Azure Data Lake Storage Azure Blob Storage Azure Functions
  • 10. Understanding the architecture Azure On-Prem Oracle HDFS Teradata, Netezza Mainframe KSQL Confluent Platform Confluent Cluster Linking App OSS Kafka Confluent Cluster Linking Oracle HDFS Teradata, Netezza Mainframe App Cloud Apps 3rd party data Additional Regions or Clouds Confluent Cluster Linking Cosmos DB Azure Functions
  • 11. Azure Cosmos DB Azure Cosmos DB is a fully managed NoSQL database service for modern app development. Get guaranteed single-digit millisecond response times and 99.999-percent availability, backed by SLAs, automatic and instant scalability, and open-source APIs for MongoDB and Cassandra.
  • 12. Azure Cosmos DB ● Unlimited scalability ● Global distribution ● Multi-master ● Low latency (< 10ms) ● Flexible schema ● Multiple SDKs ● Autoscale ● Serverless ● Consistency models
  • 13. Azure Cosmos DB Reference (2021) Azure Cosmos DB Conf
  • 14. Azure Cosmos DB use cases
  • 15. Azure Understanding the architecture: Azure Cosmos DB On-Prem Oracle HDFS Teradata, Netezza Mainframe KSQL Confluent Platform Confluent Cluster Linking App OSS Kafka Confluent Cluster Linking Oracle HDFS Teradata, Netezza Mainframe App Cloud Apps 3rd party data Additional Regions or Clouds Confluent Cluster Linking Cosmos DB Azure Functions Synapse Cosmos DB Cosmos DB Global replication Azure Functions + Change Feed Global distribution SDKs Azure ML Power BI
  • 16. Data Science and Business Analytics view data in very different ways DATA SCI ENCE BUSI NESS ANALY TI CS Big data Experimentation Fast exploration Semi-structured OR Relational data Proven security & privacy Dependable performance Structured DATA WAREHOUSE DATA L AKE
  • 17. Ease of use Fast expl or at i on Qui ck to st ar t Proven secur i t y Ai r t i ght pr i vacy Dependabl e per f or mance Azure meets these challenges with a single service to provide limitless analytics
  • 18. The first unified, cloud native platform for converged analytics Data Warehouse Data Lake Event Brokers Azure Synapse Link Cosmos DB Dataverse
  • 19. Near real-time analytics No managed ETL Built for convergence Azure Synapse Link
  • 20. Azure Cosmos DB Auto-Sync Transactional Store Row store optimized for transactional reads and writes Analytical Store Column store optimized for analytical queries Operational Data Container Synapse Link Cloud-Native HTAP SQL Azure Synapse Analytics Reduce architectural complexity with cloud-native HTAP
  • 21. Azure Understanding the architecture: Azure Cosmos DB & Synapse On-Prem Oracle HDFS Teradata, Netezza Mainframe KSQL Confluent Platform Confluent Cluster Linking App OSS Kafka Confluent Cluster Linking Oracle HDFS Teradata, Netezza Mainframe App Cloud Apps 3rd party data Additional Regions or Clouds Confluent Cluster Linking Cosmos DB Azure Functions Synapse Cosmos DB Cosmos DB Global replication Azure Functions + Change Feed Global distribution SDKs Power BI Azure ML
  • 22. Next steps Get started Try Azure for free azure.microsoft.com/en-us/free/ Visit the Microsoft booth Microsoft Get started Try Confluent for free with $400 in free credits confluent.io/confluent-cloud Visit the Confluent booth Confluent