Google Megastore

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Megastore - Providing Scalable, Highly Available J. Baker, C. Bond, J.C. Corbett, JJ Furman, A. Khorlin, J. Larson, J-M...

Agenda <ul><li>Motivation </li></ul><ul><li>Architecture </li></ul><ul><li>ACID over NOSQL Database </li></ul><ul><li>Repl...

Motivation <ul><li>Build a system to please everyone (users, admins, developers). </li></ul>

Motivation <ul><li>High availability – Fully functional during planned maintenance periods, as well as most unplanned infr...

Agenda <ul><li>Motivation </li></ul><ul><li>Megastore Architecture </li></ul><ul><li>ACID over NOSQL Database </li></ul><u...

Megastore Overview <ul><li>Widely deployed in Google for several years. </li></ul><ul><li>Used on more than 100 production...

Architecture <ul><li>Built on top of Bigtable and Chubby. </li></ul><ul><li>Blends the scalability of a NoSQL datastore wi...

Architecture

Architecture <ul><li>Scalable replication. </li></ul>

Architecture <ul><li>Operation across Entity Groups </li></ul>

Agenda <ul><li>Motivation </li></ul><ul><li>Megastore Architecture </li></ul><ul><li>ACID over NOSQL Database </li></ul><u...

Data Model <ul><li>Somewhere between RDBMS and row-column storage of NOSQL. </li></ul><ul><ul><li>Schemas </li></ul></ul><...

Sample Schema

Mapping to Bigtable <ul><li>Primary Keys are chosen to cluster entities that will be read together. </li></ul><ul><li>Each...

Indexes <ul><li>Two level of indexes: </li></ul><ul><ul><li>Local index: Separate indexes for each entity group. Stored in...

Transactions & Concurrency <ul><li>Entity group is a mini-database providing serializable ACID semantics. </li></ul><ul><l...

Transactions & Concurrency <ul><li>Three level of reads consistency </li></ul><ul><ul><li>Current: apply all previous comm...

Transactions & Concurrency <ul><li>Write transaction: </li></ul><ul><ul><li>Current read: Obtain the timestamp and log pos...

Transactions & Concurrency <ul><li>Queues provide transactional messaging between entity groups. Declaring a queue automat...

Agenda <ul><li>Motivation </li></ul><ul><li>Megastore Architecture </li></ul><ul><li>ACID over NOSQL Database </li></ul><u...

Paxos <ul><li>Basic Paxos </li></ul><ul><li>Multi-Paxos </li></ul>

Reads

Writes

Failure Detection <ul><li>Coordinators obtain specific Chubby locks in remote datacenters at startup. </li></ul><ul><li>If...

Agenda <ul><li>Motivation </li></ul><ul><li>Megastore Architecture </li></ul><ul><li>ACID over NOSQL Database </li></ul><u...

Distribution of Availability

Distribution of Average Latencies

Conclusion <ul><li>Most users see five nines availability </li></ul><ul><li>Average read latencies are tens of millisecond...

Questions?

Share Slideshare

LinkedIn
Facebook
Twitter

Embed

Size (px)

Show related Slideshows at end

WordPress Shortcode

Link

Share
Email

Megastore by Google by Ankita Kapratwar 2939 views
Megastore - ID2220 Presentation by Arinto Murdopo 1249 views
Learning from google megastore (Par... by Schubert Zhang 7705 views
MORE Mega Store ......... by PESHWA ACHARYA 7001 views
Cassandra Compression and Performan... by Schubert Zhang 8637 views
CS295 Week5: Megastore - Providing ... by Varad Meru 672 views

View on Slideshare

1 of 29 Ad

View on Slideshare

1 of 29 Ad