SQL Azure Federation and Scalability

Ing. Eduardo Castro, PhDecastro@grupoasesor.nethttp://ecastrom.blogspot.comhttp://comunidadwindows.orghttp://tiny.cc/comwindows

Microsoft SQL AzureInformation Platform as a Service Managed Service Scale on Demand Innovate Faster Platform capabilities delivered as a service Database as a utility with pay as you Innovate with new data application (Database, Data Sync, Reporting…) grow scaling patterns Reduced complexity, greater flexibility Rely on Business-ready SLAs Build cloud-based data solutions on a familiar relational model Easy provisioning and deployment Enable multi-tenant solutions Build on existing developer skills and Auto High availability and fault tolerant Manage multiple servers familiar Transact-SQL syntax

A relational DB in the cloud SQL Azure Database Data Hub Others (Future) .NET Services Applications SQL Services Relational database as a service Highly available, automatically maintained Live Services Windows Azure Extension of the SQL Server Data Platform Applications Windows Windows Windows Others Server Vista/XP Mobile

Single Logical Multiple Physical Database Replicas Replica 1 Replica 2 DB Replica 3

Reference Data Sync Data Symmetric Programming Model Data Hub Aggregation• Initial services – core RDBMS capabilities with SQL Azure Database, Data Sync• Future Offerings • Additional data platform capabilities: Reporting, BI • New services: Reference Data

Clear Feedback: “I want a database in the Cloud”Focus on combining the best features of SQL Server running at scale with low friction

Application Application Application Browser Browser ODBC, OLEDB, ADO.N Application Application REST Client REST Client SQL Client* et PHP, Ruby, … Cloud Cloud Evolves HTTP+REST HTTP+REST HTTP HTTP TDS Windows Azure Windows Azure Web App REST (Astoria) Web AppData Center Data Center REST Client ADO.Net + EF SQL Client* REST/SOAP + ACE Model TDS + TSQL Model SDS Current SDS Next * Client access enabled using TDS for ODBC, ADO.Net, OLEDB, PHP-SQL, Ruby, …

SQL Azure Database Others (Future) SQL AzureApplications Windows Azure AppFabricWindows Azure Applications Windows Others

SQL Azure Database TDS DatabaseApplication Database DatabaseSQL Azure Database Others (Future)

SQL Azure Database DatabaseApplication Max database size Database is 50 GB DatabaseApplication Database

Applications use standard SQL client libraries: ODBC, ADO.Net, PHP, … Application Internet Azure Cloud TDS (tcp) Security Boundary Load balancer forwards „sticky‟ sessions to TDS protocol tier LB TDS (tcp) Gateway Gateway Gateway Gateway Gateway Gateway Gateway: TDS protocol gateway, enforces AUTHN/AUTHZ policy; proxy to CloudDB TDS (tcp)L SQL SQL SQL SQL Scalability and Availability: Fabric, Failover, Replication, and Load balancing

Gateway Process TDS Endpoint AdminSvc Endpoint Provisioning Endpoint Protocol Parser Business Logic Services Connection MgmtL SQL SQL SQL SQL Scalability and Availability: Fabric, Failover, Replication, and Load balancing

Live DNS Cluster Customer Browser Live DNS Svc 1 Datacenter (Sub-Region) 5 Portal LB Gateway LB 2 4 3 6Front-end Node Front-end Node Front-end Node Front-end NodeAdmin Portal Admin Portal Gateway Gateway 7 Backend Node Backend Node Backend NodeSQL Server SQL Server SQL Server Mgmt. Mgmt. Mgmt. Services Fabric Services Fabric Services Fabric

1 TDS Gateway Front-end Node TDS Session Protocol Parser 2 3 Gateway Logic Master Cluster Master Node 4 Master Node Components 7 5 8 6Backend Node 1 Backend Node 2 Backend Node 3 SQL Instance SQL Instance SQL Instance SQL DB SQL DB SQL DB Scalability and and Availability: Fabric,Failover,Replication, and Load balancing Scalability Availability: Fabric, Failover, Replication, and Load balancing

AccountServerDatabase

Challenges Today “Capacity Bursting“ Elastic scale – database as a service Capacity Average Usage Time Pay as you grow and shrink Compute # of Hr‟s Average Usage Easy to provision and manage database No hardware, no manual Promotions, events, ticket selling businesses are “bursts – bound” by database administration required nature Capacity constraints limit business agility High costs of entry into new business Difficult to roll out extra capacity quickly Idle capacity “off-bursts” is cost prohibitive

T1 T2 T3 T4 T5T6 T7 T8 T9 T10 All my data is handled byT11 one DB on one server T12 T13 T14 T15T16 T17 T18 T19 T20

− Provisioning Covered by − Growing and shrinking capacity SQL Azure today− Managing − Upgrading, patching, HA for lots of databases− Routing − Where is the directory? − How to scale it and use it? Coming up in SQL Azure:− Partition Management Federations − Splitting and Merging, without loss of availability − Fan-out

Con- figData1 Data2 Data3 Data4 Data5

Root Federation “CustData” (Federation Key: CustID) Member: [min, 100) AU AU AUPK=5 PK=25 PK=35 Member: [100, 488) AU AU AUPK=105 PK=235 PK=365 Member: [488, max) AU AU AUPK=555 PK=2545 PK=3565

SalesDBFederation “Orders_Fed” (Federation Key: CustID) Member: [min, max)

Create a Federation use a BIGINT as the Federation KeyCOS222 What‟s New in Microsoft SQL Azure,

Establish the customerid as the Federation Key Data with the same customerid in these two tables should be treated as an Atomic Unit

COS222 What‟s New in Microsoft SQL Azure,

SalesDB ProductsFederation “Orders_Fed” (Federation Key: CustID) Member: [min, max) orders zipcode

SalesDB ProductsFederation “Orders_Fed”(Federation Key: CustID) Member: [min, max) orders zipcode Member: [min, 100)ord zipcodeers Member: [100, max) ord zipcode ers

Federation Root houses the Directory Split the Federation Member into two at the customerid 100 boundaryCOS222 What‟s New in Microsoft SQL Azure,

Use Federation Member that containscustomerids < 100 Use Federation Member that contains customerids > 100

App Member: [min, 100) AU AU AUPK=5 PK=25 PK=56 zipcode

xyz.database.windows.net efg.database.windows.net Master prod1 Prod2 prod2 DR1 Master clone copy prod2 clone copy abc.database.windows.net prod2 Master Dev1 clone copy South Central US North Central USCREATE DATABASE efg.prod2clone abc.prod2cloneCREATE DATABASE xyz.prod2clone AS COPY OF xyz.prod2 AS COPY OF xyz.prod2

CTP1 SQL Azure Database Data Sync ServiceRetail Stores For SQL Azure Remote Offices Sync CTP2 On-Premises (Headquarters)

http://ecastrom.blogspot.com	687
http://comunidadwindows.org	575
http://mswindowscr.org	216
http://todosobresql.blogspot.com	78
http://ecastrom.blogspot.mx	44
http://ecastrom.blogspot.com.es	42
http://sqlserverpedia.blogspot.com	18
http://www.ecastrom.blogspot.com	9
http://ecastrom.blogspot.com.ar	9
http://comunidadwindows.com	5
http://todosobresql.blogspot.com.ar	4
http://todosobresql.blogspot.ca	3
http://todosobresql.blogspot.mx	3
http://ecastrom.blogspot.it	2
http://ecastrom.blogspot.com.br	1
http://ecastrom.blogspot.co.nz	1
http://ecastrom.blogspot.in	1
http://translate.googleusercontent.com	1
http://ecastrom.blogspot.ca	1
http://todosobresql.blogspot.com.es	1
http://www.ecastrom.blogspot.com.ar	1
http://sqlserverpedia.blogspot.co.uk	1
http://sqlserverpedia.blogspot.in	1
http://www.ecastrom.blogspot.mx	1

SQL Azure Federation and Scalability

by Eduardo Castro on Jan 05, 2012

Accessibility

Categories

Tags

Upload Details

Usage Rights

24 Embeds 1,705

Statistics

SQL Azure Federation and Scalability — Presentation Transcript