Patterns / Antipatterns with NoSQL

[Anti]Patterns with NoSQL Luca Bonmassar

NoSQL vs. SQL NOSQL DAY ’11

NoSQL / NoAgendaNo specific NoSQL technologies (document, key/value, ...)No specific NoSQL db features (sharding, replication, ...)No specific ...... NOSQL DAY ’11

Does it solve my problem? NOSQL DAY ’11

Does it solve my problem?But what is your problem? NOSQL DAY ’11

Does it solve my problem?But what is your problem?NoSQL fragmentation (like NoCloud, NoJava,NoMicrosoft, ...) NOSQL DAY ’11

[Anti]PatternsThe “dynamic” websiteData mappingThe AlienThe binary AlienThe SQLQueueOvernormalizedUnpredictable tomorrow NOSQL DAY ’11

Who am I?Passionate abouttechnologyFavorite topics: Cloud,Virtualization, NoSQLGamiﬁcation fan! (or fun?) NOSQL DAY ’11

The “dynamic” website

The “dynamic” website NOSQL DAY ’11

The “dynamic” websiteI have a website NOSQL DAY ’11

The “dynamic” websiteI have a websiteDynamic contents everywhere NOSQL DAY ’11

The “dynamic” websiteI have a websiteDynamic contents everywhereHigh DB load NOSQL DAY ’11

The “dynamic” website SELECT username SELECT COUNT(###) WHERE ... FROM users WHERE sessionid = ### SELECT username FROM users WHERE sessionid = ###SELECT COUNT("submissions"."puzzle_id")FROM "submissions" WHERE (puzzle_id IS NOT NULL) AND (user_id IS NOT NULL) SELECT COUNT(###) WHERE ... SELECT COUNT(###) WHERE ... GROUP BY puzzle_id ... SELECT users.*, count(distinct puzzle_id) FROM submissions JOIN users on submissions.user_id SELECT * FROM submissions = users.id where submissions.current_state = WHERE ... SELECT avatar.* FROM users "succeeded" ... WHERE ... NOSQL DAY ’11

The “dynamic” websiteIs it that dynamic?Are there any datastructures that ﬁt betterthan relational? NOSQL DAY ’11

Cache, Cache, CacheUse Ad-Hoc Caching (e.g. Rails Caching)SQL Table as cache NOSQL DAY ’11

SQL Table as CacheWhen you use SQL Table asCache, a kitten somewherediesUse Memcache,MemcacheDB, Redis NOSQL DAY ’11

Better tools? NOSQL DAY ’11

Rethink data structuresSELECT COUNT(*) ...SELECT COUNT(*) ...SELECT COUNT(*) ...submitted++passed++failed++ NOSQL DAY ’11

Rethink data structuresSELECT *, count(distinct ...)FROM submissions JOINusers on ... wheresubmissions.current_state= "succeeded" ...List(5)List.add / List.replace NOSQL DAY ’11

Data mapping

Data mappingAn original idea: we need a newsfeed!Users can comment on feed itemsUsers can reply to comments NOSQL DAY ’11

What the customer is looking for NOSQL DAY ’11

What the developer is thinking about NOSQL DAY ’11

But how to ...

Eureka!The item has a feed_id anda parent_idYou have now a navigableSQL data structure! NOSQL DAY ’11

Data mapping - alternativesDo not try this at home! (or any ofﬁce)A document db can help { feed : 42, user : ‘luca.bonmassar’, data : ‘living the dream!’, comments : [{user : ‘jonny’ : ‘make sense!’ }] } NOSQL DAY ’11

The Alien

The AlienA type of object stored in a relational databaseNo (or weak) relations with any other tableStored in the db because the db == persistency NOSQL DAY ’11

User SettingsUser preferencesuser_id, dataData as BLOB or TEXT NOSQL DAY ’11

The AlienThe Alien is a key/value entityUse a key/value storage to store it NOSQL DAY ’11

The binary Alien

The binary AlienLike the Alien, but the payload is pure binary dataCommon solution to store “small” imagesEven worse: Base64 encoded binary NOSQL DAY ’11

The binary AlienMove the binary Alien to a binary content provider S3 or Filesystem are good onesLet the webserver access/serve them directly NOSQL DAY ’11

The SQLQueue

The SQLQueueDistributed components need to exchange data Producers / Consumers Backlog of work to be completedSQL database (== persistency) as persistent queue NOSQL DAY ’11

Mail delivery NOSQL DAY ’11

The SQLQueueNo “relations”, like the AlienSimulating a Queue using AUTO_INCREMENT ids andtransactions NOSQL DAY ’11

SQLQueueIn some countries,SQLQueue is considered acrime against softwareUse message queues(Amazon SQS, MemcacheQ,StormMQ, RabbitMQ, ... ) NOSQL DAY ’11

Overnormalized

Overnormalized NOSQL DAY ’11

OvernormalizedThe process of organizing data to minimize redundancy NOSQL DAY ’11

OvernormalizedThe process of organizing data to minimize redundancyA larger schema is broken into smaller ones NOSQL DAY ’11

OvernormalizedThe process of organizing data to minimize redundancyA larger schema is broken into smaller ones user_id, email NOSQL DAY ’11

OvernormalizedThe process of organizing data to minimize redundancyA larger schema is broken into smaller ones user_id, email user_id, phone_num NOSQL DAY ’11

OvernormalizedThe process of organizing data to minimize redundancyA larger schema is broken into smaller ones user_id, email user_id, phone_num user_id, badge NOSQL DAY ’11

OvernormalizedPRO: reduce redundancy less overhead each table scale separately NOSQL DAY ’11

OvernormalizedCons: NOSQL DAY ’11

OvernormalizedCons:... JOIN... JOIN... JOIN... JOIN... JOIN... JOIN... JOIN... NOSQL DAY ’11

OvernormalizedCache the normalized dataDenormalize / keep a replica of the denormalized viewUse document db or key/value storage for the replica NOSQL DAY ’11

Unpredictable tomorrow

Unpredictable tomorrowYou are now part of a new Agile(TM) projectYou are Agile(TM), so: No complete specs No complete use cases NOSQL DAY ’11

How many wonderful things around meA mobile App w/ internet backend“Simple” use cases User can log in User can update their location User can get all the many wonderful things they have around themselves NOSQL DAY ’11

How many wonderful things around meData Model: User PlacesAliens!!! Aliens!!! Aliens!!! NOSQL DAY ’11

...but sooner or later... NOSQL DAY ’11

How many wonderful things around meUsers can send/receive friendship invitationsUsers can import FB friends, Twitter followersUsers can interact with messages, pokesUsers can check-in into placesUsers can share their checkins with friends... NOSQL DAY ’11

Unpredictable tomorrowNo silver bulletsMix technologies E.g. relational databases to handle relationsMigrations are painful, but always an option NOSQL DAY ’11

One more thing

RecapDoes it make sense with the relational paradigm?Do I need a persistent storage or a relational database? NOSQL DAY ’11

Thanks! Any Questions? NOSQL DAY ’11

Contactsluca@coderloop.comlinkedin.com/in/lucabonmassartwitter.com/lucabonmassarjoind.in/talk/view/2939 NOSQL DAY ’11

http://a0.twimg.com	17
http://twitter.com	3
http://www.chfstudio.com	3
http://www.slideshare.net	3

Patterns / Antipatterns with NoSQL

by Luca Bonmassar

Accessibility

Categories

Upload Details

Usage Rights

4 Embeds 26

Statistics

Patterns / Antipatterns with NoSQL Presentation Transcript