CosmosDB.pptx

•Download as PPTX, PDF•

0 likes•28 views

Fast, distributed NoSQL and relational database at any scale. This contains many features including Partition and Indexes, Data movement, Change Feed Integration (Azure Functions and Search), Consistency Models, Replication and Multi-write, etc.,

Technology

Azure Cosmos DB
Udaiappa Ramachandran ( Udai )
https://udai.io

About me
• Udaiappa Ramachandran ( Udai )
• CTO-Akumina, Inc.
• Microsoft Azure MVP
• Cloud Expert
• Microsoft Azure, Amazon Web Services, and Google
• New Hampshire Cloud User Group (http://www.meetup.com/nashuaug )
• https://udai.io

Agenda
• Intro to SQL API
• SQL API SDK
• Partition and Indexes
• Data movement
• Change Feed
• Integration (Azure Functions and Search)
• Consistency Models
• Replication and Multi-write
• Cosmos DB Emulator
• Demo…Demo…Demo…

Introduction
• No SQL Feature(s)
• High Volume of data
• Non relational
• Data from many different sources and forms
• Dynamic data schema to store different types of data
• High velocity and real time data
• Designed for scale-out
• Cosmos DB is a Platform as a service for the following No SQL Databases
• SQL API (Document DB) – JSON Document (Sql Queries)
• MongoDB – BSON Document (MondoDB queries)
• Gremlin – Graph (vertices and Edges)
• Cassandra – Columnar (Schema)
• Table API – Key Value (Azure Table Storage)

Cosmos DB SQL API
• Fast NoSQL database
• Globally distributed
• Guaranteed speed at any scale
• Single digit milliseconds response time
• Ready for mission-critical applications (99.999)
• Fully managed and cost-effective serverless database

Database, Containers and Items
• Indexing
• Data Types
• Time to live
• Transactions and
optimistic
• Concurrency
control

Throughput
• Measured as Request Units (RUs)
• Assigned at Database or Container level
• Standard
• AutoScale
• Serverless

Partitions
• Logical partitions
• Physical partitions
• Choosing partition key
• Synthetic partition key

Data Movement
• Kafka Connector
• Stream Analytics
• Spark Connector
• Azure Data Factory

Consistency Model
• Bounded Staleness
• Consistent Prefix
• Eventual
• Session
• Strong

Change Feed
• Reading change feed
• Change feed processor
• Trigger Azure Functions

Integration with Functions/Cognitive Search
• Bind Cosmos DB using Change Feed
• Run FullText index using Cognitive Search

.NET SDK
• Client-Side (SDK)
• Working with Databases, Containers, Documents
• Bulk insert
• Transaction support
• Stateful and Stateless paging
• Server-Side
• Stored Procedure
• User-defined Functions
• Triggers
• Bulk insert using Stored Procedure

Multi-Region Write
• Sliding scale of well-defined consistency models (strong consistency is not
supported)
• Low latency write operations across the globe
• High availability with financially backed SLA
• Multi-region support in the SDK
• Conflict resolution policy (built-in and custom)
• insert, replace, delete

Replication & Failover
• Distribute data across global data centers
• Automatic failover and manual failover
• Configure region in SDK

Cosmos DB Emulator
• Run cosmos DB locally
• Runs on Windows, Linux or Container

Response Status Code & Headers
• HTTP Status Codes for Azure Cosmos DB | Microsoft Docs
• Common response headers - Azure Cosmos DB REST API | Microsoft Docs

Reference
• Introduction to Azure Cosmos DB | Microsoft Docs
• Complete Training Video: https://docs.microsoft.com/en-us/events/learn-
events/learnlive-azure-cosmos-db-certification-study-hall/?WT.mc_id=AZ-
MVP-5004665
• Azure Cosmos DB Capacity Calculator
• Demo Samples: https://github.com/nhcloud/techtalk

In the PowerPoint presentation about Azure Synapse, we begin by introducing Azure Synapse as an integrated analytics service, emphasizing its role in unifying big data and data warehousing. Key features such as unlimited information processing, querying of both relational and non-relational data, and integration with AI and BI capabilities are highlighted. The presentation delves into the architecture of Azure Synapse, illustrating how it interconnects with Azure Data Lake, Power BI, and Azure Machine Learning. We explore its robust data integration capabilities, including Azure Synapse Pipelines for efficient ETL processes. The discussion then moves to its prowess in analytics and big data processing, supporting various languages like T-SQL, Python, and Scala. The integration of Azure Synapse with AI and machine learning is underscored, showcasing its application in predictive analytics. Security features form a crucial part of the talk, emphasizing data protection and compliance aspects. Real-world use cases demonstrate Azure Synapse's practical applications in business settings. A comparative analysis with other data platforms highlights Synapse's unique benefits. The presentation concludes with guidance on getting started with Azure Synapse, followed by a summary, inviting audience questions and providing contact information for further engagement.

Azure Stream Analytics

Davide Mauri

Non è necessario tirare in ballo l’IoT per immaginare quanto possa essere utile per fare query sui dati mentre questi fluiscono verso il database, e non solamente dopo. Si apre un mondo di possibilità per quanto riguarda alerting & monitoring in tempo reale, che è chiaramente la parte più immediata, ma è anche possibile pensare a cose come real-time dasboarding e soluzioni per aggiustare prezzi ed offerte di prodotti in tempo reale. In questa sessione vedremo come è possibile utilizzare Azure Stream Analytics ed il suo linguaggio SQL-Like per analizzare i dati in streaming, e quindi iniziare a prendere confidenza con questo nuovo approccio ormai sempre pià in voga e sempre più richesto, sia nel mondo dell’IoT che non.

Document db

Christian Holm Diget

AWS re:Invent 2016: Workshop: Using the Database Migration Service (DMS) for ...

Amazon Web Services

It can help you do much more. You can use DMS to consolidate multiple databases into a single database or split a single database into multiple databases. You can also use DMS for data distribution to multiple systems. For both of these use cases your source database can be outside of AWS (on premises) or in AWS (EC2 or RDS). DMS can also be used for near real-time replication of data. Replication can be done to one or more targets within AWS, in the same region or across regions. You can also replicate data from databases within AWS to databases outside of AWS. In this session we will discuss all these usage patterns and help you try them out yourselves. Prerequisites: You should have good database knowledge and at least some experience with Amazon RDS or Amazon Aurora. Participants should have an AWS account established and available for use during the workshop. Please bring your own laptop.

Виталий Бондаренко "Fast Data Platform for Real-Time Analytics. Architecture ...

Fwdays

We will start from understanding how Real-Time Analytics can be implemented on Enterprise Level Infrastructure and will go to details and discover how different cases of business intelligence be used in real-time on streaming data. We will cover different Stream Data Processing Architectures and discus their benefits and disadvantages. I'll show with live demos how to build Fast Data Platform in Azure Cloud using open source projects: Apache Kafka, Apache Cassandra, Mesos. Also I'll show examples and code from real projects.

Azure CosmosDb

Marco Parenzan

Extending your data to the cloud

Microsoft TechNet - Belgium and Luxembourg

Azure Databricks – Customer Experiences and Lessons Denzil Ribeiro Madhu Ganta

Databricks

Spark is fast becoming a critical part of Customer Solutions on Azure. Databricks on Microsoft Azure provides a first-class experience for building and running Spark applications. The Microsoft Azure CAT team engaged with many early adopter customers helping them build their solutions on Azure Databricks. In this session, we begin by reviewing typical workload patterns, integration with other Azure services like Azure Storage, Azure Data Lake, IoT / Event Hubs, SQL DW, PowerBI etc. Most importantly, we will share real-world tips and learnings that you can take and apply in your Data Engineering / Data Science workloads

Azure SQL Database is a fully managed cloud database service with built-in intelligence, elastic scale, performance, reliability, and data protection that enables enterprises and ISVs to reduce their total cost of ownership and operational cost and overheads. In this session, I will share real-world experience of successfully migrated existing SaaS application and on-premises workload for some our tier 1 customers and ISV partners to Azure SQL Database service. The session walks through planning, assessment, migration tools and best practices from the proven experiences and practices of migrating real world applications to Azure SQL Database service.

J1 T1 3 - Azure Data Lake store & analytics 101 - Kenneth M. Nielsen

MS Cloud Summit

Simplify Your Database Migration to AWS | AWS Public Sector Summit 2016

Amazon Web Services

Migrating a database from one platform to another has been a pain point for many organizations for a long time. Often times, it involves weeks of careful planning and a migration strategy to minimize impact to the business. Many organizations are locked into a database platform even when there are better options available because they don’t want to take up the migration challenge. AWS Data Migration Service helps with live migration of databases across homogenous or heterogeneous database platforms. The service supports homogenous migrations such as Oracle to Oracle, and also heterogeneous migrations between different database platforms, such as Oracle to Amazon Aurora or Microsoft SQL Server to MySQL. The AWS Schema Conversion Tool is a desktop application that makes heterogeneous database migrations easy by automatically converting the source database schema to a format compatible with the target database. The tool helps with conversion of a database schema from an Oracle or Microsoft SQL Server database to an Amazon RDS MySQL DB instance or an Amazon Aurora DB cluster. Join us in this session to explore how these capabilities can simplify your database migration challenge.

Survey of the Microsoft Azure Data Landscape

Ike Ellis

AWS Česko-Slovenský Webinár 03: Vývoj v AWS

Vladimir Simek

Služba Amazon Web Services poskytuje vysoce spolehlivou, škálovatelnou a nízkorozpočtovou cloudovou platformu, kterou používají stovky tisíc firem v 190 zemích po celém světě. Startupy, malé a střední podniky, velké enterprise firmy a zákazníci ve veřejném sektoru mají přístup ke stavebním kamenům, které slouží na rychlý vývoj aplikací jako reakce na měnící se obchodní požadavky. Bez ohledu na to, zda chcete vytvářet webové nebo mobilní aplikace, prípadně postavené na klasických serverech či kontejnerech, AWS davá vývojářům do rukou mnoho nástrojů, které jim pomáhají vytvářet a nasazovat aplikace jednoduše, rychle a při nízkých nákladech.

Move your on prem data to a lake in a Lake in Cloud

CAMMS

With the boom in data; the volume and its complexity, the trend is to move data to the cloud. Where and How do we do this? Azure gives you the answer. In this session, I will give you an introduction to Azure Data Lake and Azure Data Factory, and why they are good for the type of problem we are talking about. You will learn how large datasets can be stored on the cloud, and how you could transport your data to this store. The session will briefly cover Azure Data Lake as the modern warehouse for data on the cloud,

Azure CosmosDb - Where we are

Marco Parenzan

Introducing Azure Databases

Grant Fritchey

CosmosDB for DBAs & Developers

Niko Neugebauer

SQL, NoSQL, Distributed SQL: Choose your DataStore carefully

Md Kamaruzzaman

mongodb_DS.pptx

DavoudSalehi1

Migrate from SQL Server or Oracle into Amazon Aurora using AWS Database Migra...

Amazon Web Services

As organizations look to improve application performance and decrease costs, they are increasingly looking to migrate from commercial database engines into open source. Amazon Aurora is a MySQL-compatible relational database engine that combines the speed and availability of high-end commercial databases with the simplicity and cost-effectiveness of open source databases. In this webinar, we will cover how to use Database Migration Service (DMS) to go about the migration, and how to use the schema conversion tool to convert schemas into Amazon Aurora. We’ll then follow with a quick demo of the entire process, and close with tips and best practices. Learning Objectives: Understand how AWS Database migration can help you migrate from a commercial database into Amazon Aurora to improve application performance and decrease database costs.

AWS January 2016 Webinar Series - Getting Started with Big Data on AWS

Amazon Web Services

With hundreds of new and sometimes disparate tools, it’s hard to keep pace. Amazon Web Services provides a broad and fully integrated portfolio of cloud computing services to help you build, secure and deploy your big data applications. Attend this webinar to get an overview of the different big data options available in the AWS Cloud – including popular big data frameworks such as Hadoop, Spark, NoSQL databases, and more. Learn about ideal use cases, cases to avoid, performance, interfaces, and more. Finally, learn how you can build valuable applications with a real-life example. Learning Objectives: Learn about big data tools available at AWS Understand ideal use cases Learn some of the key considerations such as performance, scalability, elasticity and availability, when selecting big data tools Who Should Attend: Data Architects, Data Scientists, Developers

Accelerating Business Intelligence Solutions with Microsoft Azure pass

Jason Strate

Business Intelligence (BI) solutions need to move at the speed of business. Unfortunately, roadblocks related to availability of resources and deployment often present an issue. What if you could accelerate the deployment of an entire BI infrastructure to just a couple hours and start loading data into it by the end of the day. In this session, we'll demonstrate how to leverage Microsoft tools and the Azure cloud environment to build out a BI solution and begin providing analytics to your team with tools such as Power BI. By end of the session, you'll gain an understanding of the capabilities of Azure and how you can start building an end to end BI proof-of-concept today.

Windows Azure

Rishu Mehra

Cloud architectural patterns and Microsoft Azure tools

Pushkar Chivate

Best practices on Building a Big Data Analytics Solution (SQLBits 2018 Traini...

Michael Rys

From theory to implementation - follow the steps of implementing an end-to-end analytics solution illustrated with some best practices and examples in Azure Data Lake. During this full training day we will share the architecture patterns, tooling, learnings and tips and tricks for building such services on Azure Data Lake. We take you through some anti-patterns and best practices on data loading and organization, give you hands-on time and the ability to develop some of your own U-SQL scripts to process your data and discuss the pros and cons of files versus tables. This were the slides presented at the SQLBits 2018 Training Day on Feb 21, 2018.

The Best of re:invent 2016

Amazon Web Services

AWS re:Invent 2016 was AWS’ largest event yet with over 32,000 attendees, 400 breakout sessions, and two keynotes of new product announcements. In this talk, we’ll explore the core themes of AWS re:Invent 2016 such as serverless and artificial intelligence. We will also drill down into several of the services and features unveiled including AWS Batch, AWS Shield, Aurora for Postgres, X-Ray, Polly, Lex, Rekognition, AWS Step Functions. Light appetizers and refreshments will be provided.

What's New for the Windows Azure Developer? Lots!!

Michael Collier

RAG Patterns and Vector Search in Generative AI

CosmosDB.pptx

Recommended

Recommended

More Related Content

Similar to CosmosDB.pptx

Similar to CosmosDB.pptx (20)

More from Udaiappa Ramachandran

More from Udaiappa Ramachandran (20)

Recently uploaded

Recently uploaded (20)

CosmosDB.pptx

Editor's Notes