Webtech Conference: NoSQL and Web scalability

NoSQL and Web scalability Luca Bonmassar

NoSQL - introduction • A database that does not expose an SQL interface (negative definition) • Not a news in the computer science • Many subcategories: – BigData – Column stores SQL – Document databases – Key-value stores – Graph Databases

Why NoSQL? performance, scalability

Does it fit in my project?

Memcached • A key - value storage, data is serialized • No persistent storage, data expires • A new layer between application and database • Application must manage cache explicitely • Performance boost

Memcached protocol • Human readable protocol • Set (key, val, expire) • Get (key), mget(key) • Delete (key) • Same logical interface of a Map (hash)

Access patterns • select * from table where p1 = property1 and p2 = property2 and p3 = property3 vs • key =

Access patterns • select * from table where p1 = property1 and p2 = property2 and p3 = property3 vs • key = property1 property2 property3

Access patterns • select * from table where p1 = property1 and p2 = property2 and p3 = property3 vs • key = property1::property2 ::property3

Access patterns • select * from table where p1 = property1 and p2 = property2 and p3 = property3 vs • key = MD5( property1::property2 ::property3 )

Memcached - workflow

Memcached - workflow SQL DB

Memcached - workflow Memcached SQL DB

Sharding

Routing requests • A-F o use r Fo • G-N user Puf use • O-S r Uw e • T-Z

NoSQL + sharding • Split data into multiple servers • Use keys as shard entries

NoSQL + sharding • Split data into multiple servers • Use keys as shard entries key: bae61f3f62f342b3c4d7f0d8dd128365

NoSQL + sharding • Split data into multiple servers • Use keys as shard entries key: bae61f3f62f342b3c4d7f0d8dd128365 shard index data key

MemcacheDB • A Memcached server with BerkleyDB storage • Same interface as Memcached, can be used where Memcached is already being used • Performance are comparable to Memcached

MemcacheDB - workflow Memcached SQL DB

MemcacheDB - workflow Memcached

MemcacheDB - workflow MemcacheDB Memcached

MemcacheDB - performance MySQL MemcacheDB Memcached 90000.0 67500.0 45000.0 22500.0 0 key: 16 read/s value: 100B write/s

Cons ?

NoSQL references • memcachedb.org • memcached.org • nosql.mypopescu.com • technoroy.blogspot.com/2008/07/shard- database-design.html

Thank you! Any questions? luca@coderloop.com linkedin.com/in/lucabonmassar www.coderloop.com

Webtech Conference: NoSQL and Web scalability

by Luca Bonmassar on Nov 23, 2010

Accessibility

Categories

Tags

Upload Details

Usage Rights

1 Embed 7

Statistics

Webtech Conference: NoSQL and Web scalability — Presentation Transcript