Zero to 60 with Azure Cosmos DB

Nashville Azure Meetup
NashAzure.com

Instrumentation Logging
Log Monitoring
Development
DevOps
Operations Security
Compliance
Monitoring
Governance
Coding
Unit TestingPerformance Testing
Architecture
Code Reviews
Coded-UI Testing
Integration Testing
Patching
Service Packs
Infrastructure EoL Mgmt
Procurement
Backup Management
Disaster Recovery
Build Automation
Release Pipeline
Automated Provisioning
Pipeline Orchestration Scripting
Continuous Integration
Firewall Rules
Intrusion Detection
Intrusion Prevention
Penetration Testing
Cybersecurity
Data
Classification
Encryption
Alerting
Tier 1 Support
GDPRSOC 2
Audit
ISO 27001
Vendor Management
User-Acceptance Testing
Risk Management Records Management
Configuration Mgmt
Asset Tracking
Licensing and Renewals

Typical Software Application
UI
(Front-end)
Database
(Back-end)

Database Workloads
Operational
Analytical
Streaming
App Database
Database Insights ML Models
Insights ML ModelsDatabaseIoT

Database Workloads
Operational
Analytical
Streaming
SQL Data Warehouse
Azure Data Lake
Hive + Spark
Machine Learning
Cosmos DB

Azure Cosmos DB: WHAT?
Microsoft’s PaaS
Database Service
NOSQL
NoSQL
Data Store
Serverless
On-Premise
Cloud
Relational
Data
{}
JSON
Server
Infrastructure
Service
Endpoint

Azure Cosmos DB: WHAT?
Multi-Model
Database
Support for
multiple
database APIs

Multi-Model Capability
MongoDBApp A
App B
Cassandra
App C SQL Server
Cosmos DB
data migration
Cosmos DB
data migration
Cosmos DB
data migration

Multi-Model Capability
App A
App B
App C
Cosmos DB
Cosmos DB
Cosmos DB

Cosmos DB Data Models
Cosmos DB
Column
Key-Value
Document
Graph

Cosmos DB Data Models
Column
Key-Value
Document
Graph

Application Deployment Scenario
Developer
Code
Application
+
Database

Application
+
Database

Primary
Secondary
Secondary
Secondary
Secondary

Secondary
Secondary
Secondary
Secondary
Primary

Geo-Distribution & Failover
Primary
Database
Secondary
(Read Replica 1)
Secondary
(Read Replica 2)
Secondary
(Read Replica n)

Primary
Database
Secondary
(Read Replica 1)
Secondary
(Read Replica 2)
Secondary
(Read Replica n)
Application
(CRUD Operations)

Primary
Database
Secondary
(Read Replica 1)
Secondary
(Read Replica 2)
Secondary
(Read Replica n)
Dashboard
(Reads Only)

Primary
Database
Primary
Database
Secondary
(Read Replica 2)
Secondary
(Read Replica n)
Application
(CRUD Operations)

Primary
Database
Primary
Database
Secondary
(Read Replica 2)
Secondary
(Read Replica n)

Cosmos DB Geo-Distribution
West US
East US
Geo-distribution

East US
Geo-distribution
West US
All Users

East US
West US
All Users
Automatic
Failover

East US
West US
All Users

Planet-Scale Geo-Distribution
Available for all
Azure Regions

Cosmos DB Multi-Master Capability
East US
Geo-distribution
West US
All Users
Reads
+ Writes
Reads
Only

Cosmos DB Multi-Master Capability
East US
West US
New York
Reads
+ Writes
Reads
+ Writes
Seattle
Data Replication
Data Replication

20 40
60
0
Core Capabilities?
Multi-model
Geo-Distribution
Failover
Getting Started
Nomenclature
Data Migration
Programming Model
Advanced Topics
Change Feed
Gremlin API
Use-cases

Core Capabilities
Multi-model
Geo-Distribution
Failover 20 40
60
0
Getting Started?
Nomenclature
Data Migration
Programming Model
Advanced Topics
Change Feed
Gremlin API
Use-cases

Cosmos DB Nomenclature
Resource Model
Partitioning & Throughput
Consistency Levels

Cosmos DB Resource Model
Account
https://woodgrove.documents.azure.com
- R e pr esent s t h e C o s mo s D B I n s t anc e
- E x po s es A c c o u nt -lev el S e t t in gs
o G l o b a l d i s t r i b u t i o n
o C o n s i s t e n c y L e v e l s
o F i r e w a l l
o K e y s

Account
Database
USA
Database
EUR
Database
AUS
- O n e o r m o r e d a t abas es i n e a c h a c c o u nt
- A c c o u nt -lev el S e t t in gs a p p lied t o e a c h a c c o u nt
o G l o b a l d i s t r i b u t i o n
o C o n s i s t e n c y L e v e l s
o F i r e w a l l
o K e y s

Account
Database
USA
Database
EUR
Database
AUS
Collection
Customer
Collection
Account
Collection
Transaction
- S i m il ar t o a t ab l e
- R e pr esent s a l o g ic al e n t it y

Account
Database
USA
Database
EUR
Database
AUS
Collection
Customer
Collection
Account
Collection
Transaction
Items
} E a c h i t em r e pr esent s
a J S O N r e c o r d

Cosmos DB Partitioning & Throughput
Account
Database
USA
Throughput

Cosmos DB Partitioning
Account
Database
USA
Partition Key: User Id

Partition Key: User Id
hash(User Id)
Psuedo-random distribution of data over
range of possible hashed values

hash(User Id)
….
Adnan
Lisa
…
Partition 1 Partition 2 Partition n
Pascal
Ali
Bob
Sonya
Rimma
Alice
Carol
…

Cosmos DB Throughput
Measured in Request Units (RU’s)
1 RU => Resources required to
read 1kb of data

Cosmos DB Throughput
Example Item Size: 1 kb
Reads per sec: 500
Writes per sec: 500
Request Units:
(500 x 1) + (500 x 5) = 3,000 RUs
Request Unit Calculator: https://www.documentdb.com/capacityplanner

Cosmos DB Consistency Levels
1. Strong
2. Bounded Staleness
3. Session
4. Consistent Prefix
5. Eventual

Geo-distribution and failover are not
required.

One writer; multiple readers
Read Latency is acceptable, but data
staleness is NOT.
One version of the truth required for
all readers

A certain known degree of staleness
is acceptable
Writes are fast, reads slightly slower

Reads lag behind writes by most
k prefixes or t interval

Read your own writes

Never see out of order writes

Potential for out-of-order writes

Data Migration to Cosmos DB
Azure Portal
Cosmos DB

Data Migration to Cosmos DB
Cosmos DB
MongoDB
Cassandra
SQL Server
Cosmos DB
Data Migration Tool

Programming Model
- Stored Procedures
- User-defined Functions (UDFs)
- Triggers

Core Capabilities
Multi-model
Geo-Distribution
Failover 20 40
60
0
Getting Started
Nomenclature
Data Migration
Programming Model
Advanced Topics
Change Feed
Gremlin API
Use-cases

Cosmos DB Change Feed
Cosmos DB

Cosmos DB
Updates

Cosmos DB
Change Feed
Consumer 1
Consumer 2
Consumer 3

Cosmos DB Gremlin API
Enables use of graph data model
Allows storage of Vertices, Edges, and Properties
Ideal for highly-connected data
Data queried using Gremlin queries

Cosmos DB Use Cases
E-Commerce
Healthcare
IoT
Operational
Analytical
Streaming

Use Case: E-Commerce
Region A Region B
Azure
Traffic Manager
App hosted
in Region B
App hosted
in Region A
Cosmos DB
in Region B
Cosmos DB
in Region A
Geo-Distribution

Use Case: Healthcare
Point-of-Care
(Bedside)
Telemetry
Notes
Prescriptions
Test
Results HDFS
EMR

EMR
Cosmos DB

Cosmos DB
Change Feed
Processor
Doctor
Pharmacy

Use Case: IoT
Cosmos DB
Sensor
Telemetry

Use Case: IoT
Cosmos DB
Change Feed
Processor
Cosmos DB
SQL Server
API

Use Case: IoT
Cosmos DB
Change Feed
Processor
Cosmos DB
SQL Server
API
Aircraft
Manufacturer
US DOT
Airline
Violations

Recap
Cosmos DB
Simplified Management
- Provision within minutes
- No Infrastructure to manage
- No patches/updates

Recap
Cosmos DB
Disaster Recovery OOTB
- HADR/BCDR out-of-the-box
- Failover: Automatic + Manual
- Minimal to no configuration

Recap
Cosmos DB
Global Scalability
- Geo-Distribution
- Planet-scale
- Multi-Master support

Recap
Cosmos DB
Programmability
- REST API
- Multiple Languages supported
- Change Feed for event sourcing
REST
SDK

Thank You!
Azure Databricks
Nashville Azure Meetup
NashAzure.com

Zero to 60 with Azure Cosmos DB

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Zero to 60 with Azure Cosmos DB

Similar to Zero to 60 with Azure Cosmos DB (20)

Recently uploaded

Recently uploaded (20)

Zero to 60 with Azure Cosmos DB