SlideShare a Scribd company logo
1 of 43
In The Name Of God
1Relational Cloud
A Database-as-a-Service for the Cloud
Relational Cloud
By: Hossein Riasati
[riasati@ut.ac.ir]
University of Tehran, College of Farabi
Relational Cloud 3
“Simplicity is the ultimate sophistication.”
~ Leonardo da Vinci
A cloud database is a database that typically runs on a cloud
computing platform.
1. Virtual machine Image
2. Database as a service (DBaaS)
Cloud Database
4Relational Cloud
Relational Cloud 5
Moving tasks from database user to service operator:
• Configuration
• Scalability
• Performance tuning
• Backup
• Privacy
• Access control
• Licensing
• Pay-per-use
What is DBaaS?
Some Cloud Databases
• Amazon RDS
• Microsoft SQL Azure (MSSQL)
• Google Cloud SQL (MySQL)
• EnterpriseDB (PostgreSQL)
• Garantia Data (NoSQL)
• MongoLab (MongoDB)
• StormDB
• Xeround
10 Most Useful Cloud Databases
6Relational Cloud
Amazon RDS is a web service that makes it easy to set up, operate,
and scale a relational database in the cloud. It provides cost-
efficient and resizable capacity while managing time-consuming
database management tasks, freeing you up to focus on your
applications and business.
• MySQL (2009)
• Oracle (2011)
• SQL Server (2012)
• PostgreSQL (2013)
Amazon Relational Database Service (RDS)
7Relational Cloud
• A cloud-based service offering data-storage capabilities
• Based on Microsoft SQL Server
• High availability
• Elastic scale
• Rapid provisioning
• Pay-per-use
Microsoft SQL Azure
8Relational Cloud
9Relational Cloud
Relational Database + Cloud Computing = Relational Cloud
Relational Cloud 11
• Efficient Multi-tenancy
• Elastic Scalability
• Database Privacy
Challenges in Relational Cloud
Relational Cloud 12
Goal: minimize the number of machines required, while meeting
application-level query performance goals
1st approach: DB-in-VM
• Each database on a single VM
• Multiple VMs on a single physical machine
• Requires 2x to 3x more machines
• Delivers 6x to 12x less performance
Efficient Multi-tenancy
Relational Cloud 13
2nd approach:
• Single database server on each machine
• Multiple logical databases on each server
• Relational Cloud periodically determines which databases should
be placed on which machines
• Using a non-linear optimization formulation
• Estimates the resource utilization of multiple databases
Efficient Multi-tenancy
Relational Cloud 14
• When a database work-load exceeds the capacity of a single
machine
• Query processing (and the corresponding data) is partitioned
amongst multiple nodes
• Workload-aware partitioner
• Automatically analyze complex query workloads
• Map data items to nodes
• Minimize the number of multi-node transactions/statements
Elastic Scalability
Relational Cloud 15
• CryptDB
• Prevents administrators from seeing a user's data
• Adjustable security
• Different encryption levels for different types of data
• Only a 22.5% performance reduction in throughput
Privacy
Relational Cloud 16
• Existing unmodified DBMS engines in the back-end nodes
• Each tenant of the system can load one or more databases
• Applications communicate with Relational Cloud using a
standard connectivity layer such as JDBC.
System Design
Relational Cloud 17
System Design
Relational Cloud 18
• Partition each database into one or more pieces when the load
on a database exceeds the capacity of a single machine
• Place the database partitions on the back-end machines
• Minimize the number of machines
• Balance load
• Migrate the partitions as needed without causing downtime
• Replicate the data for availability
• Secure the data and process the queries so that they can run on
untrusted back-ends over encrypted data
Role of front-end nodes
Relational Cloud 19
• Goals:
• To scale a single database to multiple nodes
• To enable more granular placement and load balance
• Current strategy is well-suited to OLTP and Web workloads
• OLTP vs. OLAP
• Minimizes the number of multi-node transactions
• Workload-aware partitioning strategy
• Front-end node periodically analyzes query execution traces to
identify sets of tuples that are accessed together
Database Partitioning
Relational Cloud 21
• Execution graph (weighted)
• Each node is a tuple or collection of tuples
• An edge is drawn between any two nodes whose tuples are touched
within a single transaction
• G, Karypis and V, Kumar, A fast and high quality multilevel
scheme for partitioning irregular graphs, SIAM J. Sci. Comput.,
20(1), 1998
• Output of the partitioner is an assignment of individual tuples to
logical partitions
Database Partitioning
Relational Cloud 22
• Where to dispatch each query?
• Classification problem (Decision Tree)
• Features: the tuple attributes
• Target field: Partition label for each tuple
• Independence from schema layout & foreign key information
• Discover correlations hidden in the data
Database Partitioning
Relational Cloud 23
• Big graph problem!
• Database with N tuples
• N nodes
• N2 edges
• Existing graph partitioning implementations scale only to a few
tens of millions of nodes
• Heuristic methods:
• Blanket statement removal
• Sampling tuples and transactions
Database Partitioning
Relational Cloud 24
Ready for part 2 ?!
Relational Cloud 25
• Monitoring the resource requirements of each workload
• Predicting the load multiple workloads will generate when run
together on a server
• Assigning workloads to physical servers
• Migrating them between physical nodes
Monitoring and consolidation engine: Kairos
Kairos input: existing (non-consolidated) collection of workloads,
and a set of target physical machines
Placement & Migration
Relational Cloud 26
1. Resource Monitor
• Through an automated statistics collection process, the resource monitor
captures a number of DBMS and OS statistics
2. Combined Load Predictor
• Developed a non-linear model of CPU, RAM, and disk
• To predict the combined resource requirements when multiple workloads are
consolidated onto a single physical server
• Accuracy at predicting the combined disk requirements of multiple workloads
is up to 30 x better than simply assuming that disk I/O combines additively
3. Consolidation Engine
• Kairos uses non-linear optimization techniques to place database partitions on
back-end nodes
Kairos components
Relational Cloud 27
• Relocate database partitions across physical nodes
• Why migration?
1. For scheduled maintenance and administration tasks
2. To respond to load changes
• Live migration: without downtime or reducing performance
• Currently developing and testing a cache-like approach
Live Migration
Relational Cloud 28
Last Part: Privacy
Relational Cloud 29
• Encrypt each value of each row independently into an onion
• Back-end DBMS unable to answer queries
• A design that will allow DBAs to perform tuning tasks without
having any visibility into the actual stored data
• Adjustable Security
CryptDB
Relational Cloud 30
1. RND: Randomized encryption
2. DET: Deterministic encryption
3. OPE: Order-preserving encryption
4. HOM: Homomorphic encryption
Cryptographic Techniques
Weaker
Relational Cloud 31
Onion Layers of Encryption
Relational Cloud 32
• Start the database with all data encrypted with the most private
scheme, RND.
• JDBC client has access to the keys for all onion layers of every
ciphertext stored on the server (by computing them based on a
single master key).
• When the JDBC client driver receives SQL queries from the
application, it computes the onion keys needed by the server to
decrypt certain columns to the maximum privacy level that will
allow the query execute on the server.
CryptDB
Relational Cloud 33
• Security level dynamically adapts based on the queries that
applications make.
• For simplicity, CryptDB encrypts all data items in a column using
the same set of keys.
• Each layer of the onion has a different key (different from any
other column).
CryptDB
Relational Cloud 34
• The encryption algorithms are symmetric; in order for the server
to remove a layer, the server must receive the symmetric onion
key for that layer from the JDBC client.
• Once the entire column has been decrypted, the original onion
ciphertext is discarded, since inner onion layers can support a
superset of queries compared to outer layers.
• Key factor in performance: ciphertext expansion
CryptDB
Relational Cloud 35
• SELECT i_price, ... FROM item WHERE i_id=N
• Initially each column in the database is separately encrypted in
several layers of encryption, RND the outer layer.
• JDBC client will decrypt the i_id column to DET level 4 by
sending the appropriate decryption key to the server.
• The query will return RND-encrypted ciphertexts to the JDBC
client, which will decrypt them for the application.
CryptDB Example
Relational Cloud 36
• SELECT c_discount, w_tax, ... FROM customer,
warehouse WHERE w_id=c_w_id AND c_id=N
• JDBC client needs to decrypt the w_id and c_w_id columns to
DET level 2.
• JDBC client needs to decrypt c_id column to DET level 4 and
send the DET-encrypted value N to the server.
CryptDB Example
Relational Cloud 37
• SELECT SUM(ol_amount) FROM order_line WHERE
ol_o_id=N
• Server needs the keys to adjust the encryption of the
ol_amount field to HOM.
CryptDB Example
Relational Cloud 38
Experiments
Relational Cloud 39
Experiments:
Consolidation/Multi-tenancy
• Obtained the load statistics for about 200 servers from three
data centers hosting the production database servers
Relational Cloud 40
Experiments:
Consolidation/Multi-tenancy
Multiplexing efficiency for TPC-C workloads
Relational Cloud 41
• Measured the time to process 100,000 statements
(selects/updates)
• Client-side overhead: an average per statement 25.6 ms
• Server-side overhead:
Experiments: CryptDB Performance
Relational Cloud 42
Experiments: Scalability
Relational Cloud 43
Experiments: Network Latency
Relational Cloud 44
So, what do you think about
Relational Cloud?
Relational Cloud 45
Thank You

More Related Content

What's hot

Directory Write Leases in MagFS
Directory Write Leases in MagFSDirectory Write Leases in MagFS
Directory Write Leases in MagFSMaginatics
 
Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights
Maginatics Cloud Storage Platform - MCSP 3.0 Technical HighlightsMaginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights
Maginatics Cloud Storage Platform - MCSP 3.0 Technical HighlightsMaginatics
 
Try Cloud Spanner
Try Cloud SpannerTry Cloud Spanner
Try Cloud SpannerSimon Su
 
VTU 6th Sem Elective CSE - Module 4 cloud computing
VTU 6th Sem Elective CSE - Module 4  cloud computingVTU 6th Sem Elective CSE - Module 4  cloud computing
VTU 6th Sem Elective CSE - Module 4 cloud computingSachin Gowda
 
VTU Open Elective 6th Sem CSE - Module 2 - Cloud Computing
VTU Open Elective 6th Sem CSE - Module 2 - Cloud ComputingVTU Open Elective 6th Sem CSE - Module 2 - Cloud Computing
VTU Open Elective 6th Sem CSE - Module 2 - Cloud ComputingSachin Gowda
 
Scaling Your Database In The Cloud
Scaling Your Database In The CloudScaling Your Database In The Cloud
Scaling Your Database In The CloudCory Isaacson
 
Scalar DB: A library that makes non-ACID databases ACID-compliant
Scalar DB: A library that makes non-ACID databases ACID-compliantScalar DB: A library that makes non-ACID databases ACID-compliant
Scalar DB: A library that makes non-ACID databases ACID-compliantScalar, Inc.
 
Architectural patterns for high performance microservices in kubernetes
Architectural patterns for high performance microservices in kubernetesArchitectural patterns for high performance microservices in kubernetes
Architectural patterns for high performance microservices in kubernetesRafał Leszko
 
Scylla Summit 2016: Scylla at Samsung SDS
Scylla Summit 2016: Scylla at Samsung SDSScylla Summit 2016: Scylla at Samsung SDS
Scylla Summit 2016: Scylla at Samsung SDSScyllaDB
 
Jay Kreps on Project Voldemort Scaling Simple Storage At LinkedIn
Jay Kreps on Project Voldemort Scaling Simple Storage At LinkedInJay Kreps on Project Voldemort Scaling Simple Storage At LinkedIn
Jay Kreps on Project Voldemort Scaling Simple Storage At LinkedInLinkedIn
 
Cassandra and Spark
Cassandra and SparkCassandra and Spark
Cassandra and Sparknickmbailey
 
10 Tricks to Ensure Your Oracle Coherence Cluster is Not a "Black Box" in Pro...
10 Tricks to Ensure Your Oracle Coherence Cluster is Not a "Black Box" in Pro...10 Tricks to Ensure Your Oracle Coherence Cluster is Not a "Black Box" in Pro...
10 Tricks to Ensure Your Oracle Coherence Cluster is Not a "Black Box" in Pro...SL Corporation
 
Oracle Coherence: in-memory datagrid
Oracle Coherence: in-memory datagridOracle Coherence: in-memory datagrid
Oracle Coherence: in-memory datagridEmiliano Pecis
 
Apache Cassandra @Geneva JUG 2013.02.26
Apache Cassandra @Geneva JUG 2013.02.26Apache Cassandra @Geneva JUG 2013.02.26
Apache Cassandra @Geneva JUG 2013.02.26Benoit Perroud
 
How LinkedIn uses memcached, a spoonful of SOA, and a sprinkle of SQL to scale
How LinkedIn uses memcached, a spoonful of SOA, and a sprinkle of SQL to scaleHow LinkedIn uses memcached, a spoonful of SOA, and a sprinkle of SQL to scale
How LinkedIn uses memcached, a spoonful of SOA, and a sprinkle of SQL to scaleLinkedIn
 

What's hot (20)

Directory Write Leases in MagFS
Directory Write Leases in MagFSDirectory Write Leases in MagFS
Directory Write Leases in MagFS
 
Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights
Maginatics Cloud Storage Platform - MCSP 3.0 Technical HighlightsMaginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights
Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights
 
Try Cloud Spanner
Try Cloud SpannerTry Cloud Spanner
Try Cloud Spanner
 
VTU 6th Sem Elective CSE - Module 4 cloud computing
VTU 6th Sem Elective CSE - Module 4  cloud computingVTU 6th Sem Elective CSE - Module 4  cloud computing
VTU 6th Sem Elective CSE - Module 4 cloud computing
 
VTU Open Elective 6th Sem CSE - Module 2 - Cloud Computing
VTU Open Elective 6th Sem CSE - Module 2 - Cloud ComputingVTU Open Elective 6th Sem CSE - Module 2 - Cloud Computing
VTU Open Elective 6th Sem CSE - Module 2 - Cloud Computing
 
Scaling Your Database In The Cloud
Scaling Your Database In The CloudScaling Your Database In The Cloud
Scaling Your Database In The Cloud
 
Scalar DB: A library that makes non-ACID databases ACID-compliant
Scalar DB: A library that makes non-ACID databases ACID-compliantScalar DB: A library that makes non-ACID databases ACID-compliant
Scalar DB: A library that makes non-ACID databases ACID-compliant
 
Cloud
CloudCloud
Cloud
 
Architectural patterns for high performance microservices in kubernetes
Architectural patterns for high performance microservices in kubernetesArchitectural patterns for high performance microservices in kubernetes
Architectural patterns for high performance microservices in kubernetes
 
Scylla Summit 2016: Scylla at Samsung SDS
Scylla Summit 2016: Scylla at Samsung SDSScylla Summit 2016: Scylla at Samsung SDS
Scylla Summit 2016: Scylla at Samsung SDS
 
Project Voldemort
Project VoldemortProject Voldemort
Project Voldemort
 
Jay Kreps on Project Voldemort Scaling Simple Storage At LinkedIn
Jay Kreps on Project Voldemort Scaling Simple Storage At LinkedInJay Kreps on Project Voldemort Scaling Simple Storage At LinkedIn
Jay Kreps on Project Voldemort Scaling Simple Storage At LinkedIn
 
Cassandra and Spark
Cassandra and SparkCassandra and Spark
Cassandra and Spark
 
Task programming
Task programmingTask programming
Task programming
 
Oracle Coherence
Oracle CoherenceOracle Coherence
Oracle Coherence
 
10 Tricks to Ensure Your Oracle Coherence Cluster is Not a "Black Box" in Pro...
10 Tricks to Ensure Your Oracle Coherence Cluster is Not a "Black Box" in Pro...10 Tricks to Ensure Your Oracle Coherence Cluster is Not a "Black Box" in Pro...
10 Tricks to Ensure Your Oracle Coherence Cluster is Not a "Black Box" in Pro...
 
Oracle Coherence
Oracle CoherenceOracle Coherence
Oracle Coherence
 
Oracle Coherence: in-memory datagrid
Oracle Coherence: in-memory datagridOracle Coherence: in-memory datagrid
Oracle Coherence: in-memory datagrid
 
Apache Cassandra @Geneva JUG 2013.02.26
Apache Cassandra @Geneva JUG 2013.02.26Apache Cassandra @Geneva JUG 2013.02.26
Apache Cassandra @Geneva JUG 2013.02.26
 
How LinkedIn uses memcached, a spoonful of SOA, and a sprinkle of SQL to scale
How LinkedIn uses memcached, a spoonful of SOA, and a sprinkle of SQL to scaleHow LinkedIn uses memcached, a spoonful of SOA, and a sprinkle of SQL to scale
How LinkedIn uses memcached, a spoonful of SOA, and a sprinkle of SQL to scale
 

Viewers also liked

Oracle on AWS partner webinar series
Oracle on AWS partner webinar series Oracle on AWS partner webinar series
Oracle on AWS partner webinar series Tom Laszewski
 
Amazon RDS: Deep dive with Oracle
Amazon RDS: Deep dive with OracleAmazon RDS: Deep dive with Oracle
Amazon RDS: Deep dive with OracleAmazon Web Services
 
SQL Server Database as a Cloud Service
SQL Server Database as a Cloud ServiceSQL Server Database as a Cloud Service
SQL Server Database as a Cloud ServicePio Balistoy
 
Private Cloud Database Consolidation
Private Cloud Database ConsolidationPrivate Cloud Database Consolidation
Private Cloud Database ConsolidationRex Wang
 
Encryption-Based Multilevel Model for DBMS
Encryption-Based Multilevel Model for DBMSEncryption-Based Multilevel Model for DBMS
Encryption-Based Multilevel Model for DBMSAmna Magzoub
 
Identity based proxy-oriented data uploading and remote data integrity checki...
Identity based proxy-oriented data uploading and remote data integrity checki...Identity based proxy-oriented data uploading and remote data integrity checki...
Identity based proxy-oriented data uploading and remote data integrity checki...Finalyearprojects Toall
 
Identity Based Secure Distributed Storage Scheme
Identity Based Secure Distributed Storage SchemeIdentity Based Secure Distributed Storage Scheme
Identity Based Secure Distributed Storage SchemeVenkatesh Devam ☁
 
Scalable and secure sharing of public health record using attribute based Enc...
Scalable and secure sharing of public health record using attribute based Enc...Scalable and secure sharing of public health record using attribute based Enc...
Scalable and secure sharing of public health record using attribute based Enc...shreyank byadagi
 
CLOUD CPOMPUTING SECURITY
CLOUD CPOMPUTING SECURITYCLOUD CPOMPUTING SECURITY
CLOUD CPOMPUTING SECURITYShivananda Rai
 
(DAT303) Oracle on AWS and Amazon RDS: Secure, Fast, and Scalable
(DAT303) Oracle on AWS and Amazon RDS: Secure, Fast, and Scalable(DAT303) Oracle on AWS and Amazon RDS: Secure, Fast, and Scalable
(DAT303) Oracle on AWS and Amazon RDS: Secure, Fast, and ScalableAmazon Web Services
 
How to Draw an Effective ER diagram
How to Draw an Effective ER diagramHow to Draw an Effective ER diagram
How to Draw an Effective ER diagramTech_MX
 
Marketo Protips 3: New Advice You Can Implement Today
Marketo Protips 3: New Advice You Can Implement TodayMarketo Protips 3: New Advice You Can Implement Today
Marketo Protips 3: New Advice You Can Implement TodayJeff Shearer
 
China methanol industry market research and investment forecast report
China methanol industry market research and investment forecast reportChina methanol industry market research and investment forecast report
China methanol industry market research and investment forecast reportQianzhan Intelligence
 
ffbPresentation1
ffbPresentation1ffbPresentation1
ffbPresentation1slenhert
 
안나수이향수
안나수이향수안나수이향수
안나수이향수hjsoidjgo
 

Viewers also liked (20)

Oracle on AWS partner webinar series
Oracle on AWS partner webinar series Oracle on AWS partner webinar series
Oracle on AWS partner webinar series
 
Amazon RDS: Deep dive with Oracle
Amazon RDS: Deep dive with OracleAmazon RDS: Deep dive with Oracle
Amazon RDS: Deep dive with Oracle
 
SQL Server Database as a Cloud Service
SQL Server Database as a Cloud ServiceSQL Server Database as a Cloud Service
SQL Server Database as a Cloud Service
 
Private Cloud Database Consolidation
Private Cloud Database ConsolidationPrivate Cloud Database Consolidation
Private Cloud Database Consolidation
 
Encryption-Based Multilevel Model for DBMS
Encryption-Based Multilevel Model for DBMSEncryption-Based Multilevel Model for DBMS
Encryption-Based Multilevel Model for DBMS
 
Identity based proxy-oriented data uploading and remote data integrity checki...
Identity based proxy-oriented data uploading and remote data integrity checki...Identity based proxy-oriented data uploading and remote data integrity checki...
Identity based proxy-oriented data uploading and remote data integrity checki...
 
Cloud Storage and Security
Cloud Storage and SecurityCloud Storage and Security
Cloud Storage and Security
 
Identity Based Secure Distributed Storage Scheme
Identity Based Secure Distributed Storage SchemeIdentity Based Secure Distributed Storage Scheme
Identity Based Secure Distributed Storage Scheme
 
PPT FOR IDBSDDS SCHEMES
PPT FOR IDBSDDS SCHEMESPPT FOR IDBSDDS SCHEMES
PPT FOR IDBSDDS SCHEMES
 
Scalable and secure sharing of public health record using attribute based Enc...
Scalable and secure sharing of public health record using attribute based Enc...Scalable and secure sharing of public health record using attribute based Enc...
Scalable and secure sharing of public health record using attribute based Enc...
 
Final review presentation
Final review presentationFinal review presentation
Final review presentation
 
CLOUD CPOMPUTING SECURITY
CLOUD CPOMPUTING SECURITYCLOUD CPOMPUTING SECURITY
CLOUD CPOMPUTING SECURITY
 
Ppt 1
Ppt 1Ppt 1
Ppt 1
 
(DAT303) Oracle on AWS and Amazon RDS: Secure, Fast, and Scalable
(DAT303) Oracle on AWS and Amazon RDS: Secure, Fast, and Scalable(DAT303) Oracle on AWS and Amazon RDS: Secure, Fast, and Scalable
(DAT303) Oracle on AWS and Amazon RDS: Secure, Fast, and Scalable
 
How to Draw an Effective ER diagram
How to Draw an Effective ER diagramHow to Draw an Effective ER diagram
How to Draw an Effective ER diagram
 
Marketo Protips 3: New Advice You Can Implement Today
Marketo Protips 3: New Advice You Can Implement TodayMarketo Protips 3: New Advice You Can Implement Today
Marketo Protips 3: New Advice You Can Implement Today
 
School work
School workSchool work
School work
 
China methanol industry market research and investment forecast report
China methanol industry market research and investment forecast reportChina methanol industry market research and investment forecast report
China methanol industry market research and investment forecast report
 
ffbPresentation1
ffbPresentation1ffbPresentation1
ffbPresentation1
 
안나수이향수
안나수이향수안나수이향수
안나수이향수
 

Similar to Relational cloud, A Database-as-a-Service for the Cloud

How to Set Up ApsaraDB for RDS on Alibaba Cloud
How to Set Up ApsaraDB for RDS on Alibaba CloudHow to Set Up ApsaraDB for RDS on Alibaba Cloud
How to Set Up ApsaraDB for RDS on Alibaba CloudAlibaba Cloud
 
[RightScale Webinar] Architecting Databases in the cloud: How RightScale Doe...
[RightScale Webinar] Architecting Databases in the cloud:  How RightScale Doe...[RightScale Webinar] Architecting Databases in the cloud:  How RightScale Doe...
[RightScale Webinar] Architecting Databases in the cloud: How RightScale Doe...RightScale
 
The impact of cloud NSBCon NY by Yves Goeleven
The impact of cloud NSBCon NY by Yves GoelevenThe impact of cloud NSBCon NY by Yves Goeleven
The impact of cloud NSBCon NY by Yves GoelevenParticular Software
 
Virtualization and cloud computing
Virtualization and cloud computingVirtualization and cloud computing
Virtualization and cloud computingDeep Gupta
 
Data Lake and the rise of the microservices
Data Lake and the rise of the microservicesData Lake and the rise of the microservices
Data Lake and the rise of the microservicesBigstep
 
DDD and CQRS for .NET Developers
DDD and CQRS for .NET DevelopersDDD and CQRS for .NET Developers
DDD and CQRS for .NET DevelopersAllan Mangune
 
iland Internet Solutions: Leveraging Cassandra for real-time multi-datacenter...
iland Internet Solutions: Leveraging Cassandra for real-time multi-datacenter...iland Internet Solutions: Leveraging Cassandra for real-time multi-datacenter...
iland Internet Solutions: Leveraging Cassandra for real-time multi-datacenter...DataStax Academy
 
Leveraging Cassandra for real-time multi-datacenter public cloud analytics
Leveraging Cassandra for real-time multi-datacenter public cloud analyticsLeveraging Cassandra for real-time multi-datacenter public cloud analytics
Leveraging Cassandra for real-time multi-datacenter public cloud analyticsJulien Anguenot
 
Data management in cloud computing trainee
Data management in cloud computing  traineeData management in cloud computing  trainee
Data management in cloud computing traineeDamilola Mosaku
 
Scaling Your Database in the Cloud
Scaling Your Database in the CloudScaling Your Database in the Cloud
Scaling Your Database in the CloudRightScale
 
LISA2017 Big Three Cloud Networking
LISA2017 Big Three Cloud NetworkingLISA2017 Big Three Cloud Networking
LISA2017 Big Three Cloud NetworkingChris McEniry
 
Database Virtualization: The Next Wave of Big Data
Database Virtualization: The Next Wave of Big DataDatabase Virtualization: The Next Wave of Big Data
Database Virtualization: The Next Wave of Big Dataexponential-inc
 
Cloud computing and Service Platforms
Cloud computing and Service Platforms Cloud computing and Service Platforms
Cloud computing and Service Platforms Vibhawa Nirmal
 
Cloud Data Strategy event London
Cloud Data Strategy event LondonCloud Data Strategy event London
Cloud Data Strategy event LondonMongoDB
 
MongoDB World 2018: Breaking the Mold - Redesigning Dell's E-Commerce Platform
MongoDB World 2018: Breaking the Mold - Redesigning Dell's E-Commerce PlatformMongoDB World 2018: Breaking the Mold - Redesigning Dell's E-Commerce Platform
MongoDB World 2018: Breaking the Mold - Redesigning Dell's E-Commerce PlatformMongoDB
 
MongoDB.local Atlanta: MongoDB on Z
MongoDB.local Atlanta: MongoDB on ZMongoDB.local Atlanta: MongoDB on Z
MongoDB.local Atlanta: MongoDB on ZMongoDB
 
C* Summit 2013: Cassandra at eBay Scale by Feng Qu and Anurag Jambhekar
C* Summit 2013: Cassandra at eBay Scale by Feng Qu and Anurag JambhekarC* Summit 2013: Cassandra at eBay Scale by Feng Qu and Anurag Jambhekar
C* Summit 2013: Cassandra at eBay Scale by Feng Qu and Anurag JambhekarDataStax Academy
 
MongoDB 4.0 새로운 기능 소개
MongoDB 4.0 새로운 기능 소개MongoDB 4.0 새로운 기능 소개
MongoDB 4.0 새로운 기능 소개Ha-Yang(White) Moon
 

Similar to Relational cloud, A Database-as-a-Service for the Cloud (20)

How to Set Up ApsaraDB for RDS on Alibaba Cloud
How to Set Up ApsaraDB for RDS on Alibaba CloudHow to Set Up ApsaraDB for RDS on Alibaba Cloud
How to Set Up ApsaraDB for RDS on Alibaba Cloud
 
[RightScale Webinar] Architecting Databases in the cloud: How RightScale Doe...
[RightScale Webinar] Architecting Databases in the cloud:  How RightScale Doe...[RightScale Webinar] Architecting Databases in the cloud:  How RightScale Doe...
[RightScale Webinar] Architecting Databases in the cloud: How RightScale Doe...
 
The impact of cloud NSBCon NY by Yves Goeleven
The impact of cloud NSBCon NY by Yves GoelevenThe impact of cloud NSBCon NY by Yves Goeleven
The impact of cloud NSBCon NY by Yves Goeleven
 
Cloud computing_Final
Cloud computing_FinalCloud computing_Final
Cloud computing_Final
 
Virtualization and cloud computing
Virtualization and cloud computingVirtualization and cloud computing
Virtualization and cloud computing
 
Data Lake and the rise of the microservices
Data Lake and the rise of the microservicesData Lake and the rise of the microservices
Data Lake and the rise of the microservices
 
DDD and CQRS for .NET Developers
DDD and CQRS for .NET DevelopersDDD and CQRS for .NET Developers
DDD and CQRS for .NET Developers
 
iland Internet Solutions: Leveraging Cassandra for real-time multi-datacenter...
iland Internet Solutions: Leveraging Cassandra for real-time multi-datacenter...iland Internet Solutions: Leveraging Cassandra for real-time multi-datacenter...
iland Internet Solutions: Leveraging Cassandra for real-time multi-datacenter...
 
Leveraging Cassandra for real-time multi-datacenter public cloud analytics
Leveraging Cassandra for real-time multi-datacenter public cloud analyticsLeveraging Cassandra for real-time multi-datacenter public cloud analytics
Leveraging Cassandra for real-time multi-datacenter public cloud analytics
 
Data management in cloud computing trainee
Data management in cloud computing  traineeData management in cloud computing  trainee
Data management in cloud computing trainee
 
Scaling Your Database in the Cloud
Scaling Your Database in the CloudScaling Your Database in the Cloud
Scaling Your Database in the Cloud
 
LISA2017 Big Three Cloud Networking
LISA2017 Big Three Cloud NetworkingLISA2017 Big Three Cloud Networking
LISA2017 Big Three Cloud Networking
 
Database Virtualization: The Next Wave of Big Data
Database Virtualization: The Next Wave of Big DataDatabase Virtualization: The Next Wave of Big Data
Database Virtualization: The Next Wave of Big Data
 
25 snowflake
25 snowflake25 snowflake
25 snowflake
 
Cloud computing and Service Platforms
Cloud computing and Service Platforms Cloud computing and Service Platforms
Cloud computing and Service Platforms
 
Cloud Data Strategy event London
Cloud Data Strategy event LondonCloud Data Strategy event London
Cloud Data Strategy event London
 
MongoDB World 2018: Breaking the Mold - Redesigning Dell's E-Commerce Platform
MongoDB World 2018: Breaking the Mold - Redesigning Dell's E-Commerce PlatformMongoDB World 2018: Breaking the Mold - Redesigning Dell's E-Commerce Platform
MongoDB World 2018: Breaking the Mold - Redesigning Dell's E-Commerce Platform
 
MongoDB.local Atlanta: MongoDB on Z
MongoDB.local Atlanta: MongoDB on ZMongoDB.local Atlanta: MongoDB on Z
MongoDB.local Atlanta: MongoDB on Z
 
C* Summit 2013: Cassandra at eBay Scale by Feng Qu and Anurag Jambhekar
C* Summit 2013: Cassandra at eBay Scale by Feng Qu and Anurag JambhekarC* Summit 2013: Cassandra at eBay Scale by Feng Qu and Anurag Jambhekar
C* Summit 2013: Cassandra at eBay Scale by Feng Qu and Anurag Jambhekar
 
MongoDB 4.0 새로운 기능 소개
MongoDB 4.0 새로운 기능 소개MongoDB 4.0 새로운 기능 소개
MongoDB 4.0 새로운 기능 소개
 

Recently uploaded

OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...Shane Coughlan
 
%in Harare+277-882-255-28 abortion pills for sale in Harare
%in Harare+277-882-255-28 abortion pills for sale in Harare%in Harare+277-882-255-28 abortion pills for sale in Harare
%in Harare+277-882-255-28 abortion pills for sale in Hararemasabamasaba
 
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...masabamasaba
 
Chinsurah Escorts ☎️8617697112 Starting From 5K to 15K High Profile Escorts ...
Chinsurah Escorts ☎️8617697112  Starting From 5K to 15K High Profile Escorts ...Chinsurah Escorts ☎️8617697112  Starting From 5K to 15K High Profile Escorts ...
Chinsurah Escorts ☎️8617697112 Starting From 5K to 15K High Profile Escorts ...Nitya salvi
 
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...masabamasaba
 
%in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park %in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park masabamasaba
 
The Top App Development Trends Shaping the Industry in 2024-25 .pdf
The Top App Development Trends Shaping the Industry in 2024-25 .pdfThe Top App Development Trends Shaping the Industry in 2024-25 .pdf
The Top App Development Trends Shaping the Industry in 2024-25 .pdfayushiqss
 
Exploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdfExploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdfproinshot.com
 
VTU technical seminar 8Th Sem on Scikit-learn
VTU technical seminar 8Th Sem on Scikit-learnVTU technical seminar 8Th Sem on Scikit-learn
VTU technical seminar 8Th Sem on Scikit-learnAmarnathKambale
 
10 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 202410 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 2024Mind IT Systems
 
%in Lydenburg+277-882-255-28 abortion pills for sale in Lydenburg
%in Lydenburg+277-882-255-28 abortion pills for sale in Lydenburg%in Lydenburg+277-882-255-28 abortion pills for sale in Lydenburg
%in Lydenburg+277-882-255-28 abortion pills for sale in Lydenburgmasabamasaba
 
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...masabamasaba
 
Announcing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK SoftwareAnnouncing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK SoftwareJim McKeeth
 
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...panagenda
 
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisamasabamasaba
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfkalichargn70th171
 
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdfintroduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdfVishalKumarJha10
 
The title is not connected to what is inside
The title is not connected to what is insideThe title is not connected to what is inside
The title is not connected to what is insideshinachiaurasa2
 
%+27788225528 love spells in Vancouver Psychic Readings, Attraction spells,Br...
%+27788225528 love spells in Vancouver Psychic Readings, Attraction spells,Br...%+27788225528 love spells in Vancouver Psychic Readings, Attraction spells,Br...
%+27788225528 love spells in Vancouver Psychic Readings, Attraction spells,Br...masabamasaba
 

Recently uploaded (20)

OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
 
%in Harare+277-882-255-28 abortion pills for sale in Harare
%in Harare+277-882-255-28 abortion pills for sale in Harare%in Harare+277-882-255-28 abortion pills for sale in Harare
%in Harare+277-882-255-28 abortion pills for sale in Harare
 
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
 
Chinsurah Escorts ☎️8617697112 Starting From 5K to 15K High Profile Escorts ...
Chinsurah Escorts ☎️8617697112  Starting From 5K to 15K High Profile Escorts ...Chinsurah Escorts ☎️8617697112  Starting From 5K to 15K High Profile Escorts ...
Chinsurah Escorts ☎️8617697112 Starting From 5K to 15K High Profile Escorts ...
 
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
 
%in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park %in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park
 
The Top App Development Trends Shaping the Industry in 2024-25 .pdf
The Top App Development Trends Shaping the Industry in 2024-25 .pdfThe Top App Development Trends Shaping the Industry in 2024-25 .pdf
The Top App Development Trends Shaping the Industry in 2024-25 .pdf
 
Exploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdfExploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdf
 
VTU technical seminar 8Th Sem on Scikit-learn
VTU technical seminar 8Th Sem on Scikit-learnVTU technical seminar 8Th Sem on Scikit-learn
VTU technical seminar 8Th Sem on Scikit-learn
 
10 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 202410 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 2024
 
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 
%in Lydenburg+277-882-255-28 abortion pills for sale in Lydenburg
%in Lydenburg+277-882-255-28 abortion pills for sale in Lydenburg%in Lydenburg+277-882-255-28 abortion pills for sale in Lydenburg
%in Lydenburg+277-882-255-28 abortion pills for sale in Lydenburg
 
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
 
Announcing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK SoftwareAnnouncing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK Software
 
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
 
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
 
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdfintroduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
 
The title is not connected to what is inside
The title is not connected to what is insideThe title is not connected to what is inside
The title is not connected to what is inside
 
%+27788225528 love spells in Vancouver Psychic Readings, Attraction spells,Br...
%+27788225528 love spells in Vancouver Psychic Readings, Attraction spells,Br...%+27788225528 love spells in Vancouver Psychic Readings, Attraction spells,Br...
%+27788225528 love spells in Vancouver Psychic Readings, Attraction spells,Br...
 

Relational cloud, A Database-as-a-Service for the Cloud

  • 1. In The Name Of God 1Relational Cloud
  • 2. A Database-as-a-Service for the Cloud Relational Cloud By: Hossein Riasati [riasati@ut.ac.ir] University of Tehran, College of Farabi
  • 3. Relational Cloud 3 “Simplicity is the ultimate sophistication.” ~ Leonardo da Vinci
  • 4. A cloud database is a database that typically runs on a cloud computing platform. 1. Virtual machine Image 2. Database as a service (DBaaS) Cloud Database 4Relational Cloud
  • 5. Relational Cloud 5 Moving tasks from database user to service operator: • Configuration • Scalability • Performance tuning • Backup • Privacy • Access control • Licensing • Pay-per-use What is DBaaS?
  • 6. Some Cloud Databases • Amazon RDS • Microsoft SQL Azure (MSSQL) • Google Cloud SQL (MySQL) • EnterpriseDB (PostgreSQL) • Garantia Data (NoSQL) • MongoLab (MongoDB) • StormDB • Xeround 10 Most Useful Cloud Databases 6Relational Cloud
  • 7. Amazon RDS is a web service that makes it easy to set up, operate, and scale a relational database in the cloud. It provides cost- efficient and resizable capacity while managing time-consuming database management tasks, freeing you up to focus on your applications and business. • MySQL (2009) • Oracle (2011) • SQL Server (2012) • PostgreSQL (2013) Amazon Relational Database Service (RDS) 7Relational Cloud
  • 8. • A cloud-based service offering data-storage capabilities • Based on Microsoft SQL Server • High availability • Elastic scale • Rapid provisioning • Pay-per-use Microsoft SQL Azure 8Relational Cloud
  • 9. 9Relational Cloud Relational Database + Cloud Computing = Relational Cloud
  • 10. Relational Cloud 11 • Efficient Multi-tenancy • Elastic Scalability • Database Privacy Challenges in Relational Cloud
  • 11. Relational Cloud 12 Goal: minimize the number of machines required, while meeting application-level query performance goals 1st approach: DB-in-VM • Each database on a single VM • Multiple VMs on a single physical machine • Requires 2x to 3x more machines • Delivers 6x to 12x less performance Efficient Multi-tenancy
  • 12. Relational Cloud 13 2nd approach: • Single database server on each machine • Multiple logical databases on each server • Relational Cloud periodically determines which databases should be placed on which machines • Using a non-linear optimization formulation • Estimates the resource utilization of multiple databases Efficient Multi-tenancy
  • 13. Relational Cloud 14 • When a database work-load exceeds the capacity of a single machine • Query processing (and the corresponding data) is partitioned amongst multiple nodes • Workload-aware partitioner • Automatically analyze complex query workloads • Map data items to nodes • Minimize the number of multi-node transactions/statements Elastic Scalability
  • 14. Relational Cloud 15 • CryptDB • Prevents administrators from seeing a user's data • Adjustable security • Different encryption levels for different types of data • Only a 22.5% performance reduction in throughput Privacy
  • 15. Relational Cloud 16 • Existing unmodified DBMS engines in the back-end nodes • Each tenant of the system can load one or more databases • Applications communicate with Relational Cloud using a standard connectivity layer such as JDBC. System Design
  • 17. Relational Cloud 18 • Partition each database into one or more pieces when the load on a database exceeds the capacity of a single machine • Place the database partitions on the back-end machines • Minimize the number of machines • Balance load • Migrate the partitions as needed without causing downtime • Replicate the data for availability • Secure the data and process the queries so that they can run on untrusted back-ends over encrypted data Role of front-end nodes
  • 18. Relational Cloud 19 • Goals: • To scale a single database to multiple nodes • To enable more granular placement and load balance • Current strategy is well-suited to OLTP and Web workloads • OLTP vs. OLAP • Minimizes the number of multi-node transactions • Workload-aware partitioning strategy • Front-end node periodically analyzes query execution traces to identify sets of tuples that are accessed together Database Partitioning
  • 19. Relational Cloud 21 • Execution graph (weighted) • Each node is a tuple or collection of tuples • An edge is drawn between any two nodes whose tuples are touched within a single transaction • G, Karypis and V, Kumar, A fast and high quality multilevel scheme for partitioning irregular graphs, SIAM J. Sci. Comput., 20(1), 1998 • Output of the partitioner is an assignment of individual tuples to logical partitions Database Partitioning
  • 20. Relational Cloud 22 • Where to dispatch each query? • Classification problem (Decision Tree) • Features: the tuple attributes • Target field: Partition label for each tuple • Independence from schema layout & foreign key information • Discover correlations hidden in the data Database Partitioning
  • 21. Relational Cloud 23 • Big graph problem! • Database with N tuples • N nodes • N2 edges • Existing graph partitioning implementations scale only to a few tens of millions of nodes • Heuristic methods: • Blanket statement removal • Sampling tuples and transactions Database Partitioning
  • 22. Relational Cloud 24 Ready for part 2 ?!
  • 23. Relational Cloud 25 • Monitoring the resource requirements of each workload • Predicting the load multiple workloads will generate when run together on a server • Assigning workloads to physical servers • Migrating them between physical nodes Monitoring and consolidation engine: Kairos Kairos input: existing (non-consolidated) collection of workloads, and a set of target physical machines Placement & Migration
  • 24. Relational Cloud 26 1. Resource Monitor • Through an automated statistics collection process, the resource monitor captures a number of DBMS and OS statistics 2. Combined Load Predictor • Developed a non-linear model of CPU, RAM, and disk • To predict the combined resource requirements when multiple workloads are consolidated onto a single physical server • Accuracy at predicting the combined disk requirements of multiple workloads is up to 30 x better than simply assuming that disk I/O combines additively 3. Consolidation Engine • Kairos uses non-linear optimization techniques to place database partitions on back-end nodes Kairos components
  • 25. Relational Cloud 27 • Relocate database partitions across physical nodes • Why migration? 1. For scheduled maintenance and administration tasks 2. To respond to load changes • Live migration: without downtime or reducing performance • Currently developing and testing a cache-like approach Live Migration
  • 26. Relational Cloud 28 Last Part: Privacy
  • 27. Relational Cloud 29 • Encrypt each value of each row independently into an onion • Back-end DBMS unable to answer queries • A design that will allow DBAs to perform tuning tasks without having any visibility into the actual stored data • Adjustable Security CryptDB
  • 28. Relational Cloud 30 1. RND: Randomized encryption 2. DET: Deterministic encryption 3. OPE: Order-preserving encryption 4. HOM: Homomorphic encryption Cryptographic Techniques Weaker
  • 29. Relational Cloud 31 Onion Layers of Encryption
  • 30. Relational Cloud 32 • Start the database with all data encrypted with the most private scheme, RND. • JDBC client has access to the keys for all onion layers of every ciphertext stored on the server (by computing them based on a single master key). • When the JDBC client driver receives SQL queries from the application, it computes the onion keys needed by the server to decrypt certain columns to the maximum privacy level that will allow the query execute on the server. CryptDB
  • 31. Relational Cloud 33 • Security level dynamically adapts based on the queries that applications make. • For simplicity, CryptDB encrypts all data items in a column using the same set of keys. • Each layer of the onion has a different key (different from any other column). CryptDB
  • 32. Relational Cloud 34 • The encryption algorithms are symmetric; in order for the server to remove a layer, the server must receive the symmetric onion key for that layer from the JDBC client. • Once the entire column has been decrypted, the original onion ciphertext is discarded, since inner onion layers can support a superset of queries compared to outer layers. • Key factor in performance: ciphertext expansion CryptDB
  • 33. Relational Cloud 35 • SELECT i_price, ... FROM item WHERE i_id=N • Initially each column in the database is separately encrypted in several layers of encryption, RND the outer layer. • JDBC client will decrypt the i_id column to DET level 4 by sending the appropriate decryption key to the server. • The query will return RND-encrypted ciphertexts to the JDBC client, which will decrypt them for the application. CryptDB Example
  • 34. Relational Cloud 36 • SELECT c_discount, w_tax, ... FROM customer, warehouse WHERE w_id=c_w_id AND c_id=N • JDBC client needs to decrypt the w_id and c_w_id columns to DET level 2. • JDBC client needs to decrypt c_id column to DET level 4 and send the DET-encrypted value N to the server. CryptDB Example
  • 35. Relational Cloud 37 • SELECT SUM(ol_amount) FROM order_line WHERE ol_o_id=N • Server needs the keys to adjust the encryption of the ol_amount field to HOM. CryptDB Example
  • 37. Relational Cloud 39 Experiments: Consolidation/Multi-tenancy • Obtained the load statistics for about 200 servers from three data centers hosting the production database servers
  • 39. Relational Cloud 41 • Measured the time to process 100,000 statements (selects/updates) • Client-side overhead: an average per statement 25.6 ms • Server-side overhead: Experiments: CryptDB Performance
  • 42. Relational Cloud 44 So, what do you think about Relational Cloud?

Editor's Notes

  1. Virtual allow users to purchase virtual machine instances for a limited time  Users can either upload their own machine image with a database installed on it, or use ready-made machine images that already include an optimized installation of a database
  2. Outsourcing
  3. Efficient multi-tenancy. Given a set of databases and workloads, what is the best way to serve them from a given set of machines? Elastic scalability. A good DBaaS must support database and work-loads of different sizes, The challenge arise when a database work-load exceeds the capacity of a single machine Privacy. A significant barrier to deploying databases in the cloud is the perceived lack of privacy, which in turn reduces the degree of trust users are willing to place in the system
  4. each VM contains a separate copy of the OS and database, and each database has its own buffer pool, forces its own log to disk, etc
  5. JDBC is a Java database connectivity from Oracle Corporation. This technology is an API that defines how a client may access a database. It provides methods for querying and updating data in a database.
  6. On-Line Transaction Processing (TPS) On-Line Analytical Processing (MIS, DSS, Data Mining)
  7. (1) Blanket statement removal, i,e,, the exclusion from the graph occasional statements that scan large portions of the database
  8. Consolidate: combine (a number of things) into a single more effective or logical whole
  9. 2: The reason is that two combined workloads perform many fewer I/Os than the sum of their individual I/Os: when combined, workloads share a single log & buffer, and can both benefit from group commit. Moreover, DBMS perform a substantial amount of non-essential I/O during idle periods. 3: (1) minimize the number of machines required to support a given workload mix, and (2) balance load across the back-end machine
  10. After the client issues a few queries, the server removes any unneeded onion layers of encryption, and from then on, it does not perform any more cryptographic operations.