No sql taiwan #6 redis data structure

NoSQL Taiwan #6 Redis Data Structure

About Me• Felix Lin• hellolucky• Rails developer• http://twitter.com/hellolucky123• http://blog.hellolucky.info

This talk will tell you ......• How to build a simple social website by using SQL• Whats the performance issue about SQL• How to use the data structures of Redis• How to solve the performance issue of SQL by using Redis• Why I love Redis so much

This talk won’t tell you ......• How fast Redis is• How to Use Lua script in Redis• How to calculate memory usage• How to administrate Redis• The best practice of Redis

Database

User UserFollowRelation

FollowUser UserFollowRelation

FollowUser UserFollowRelation Follower

FollowUser UserFollowRelation Follower Feed

About User

About User# Create UserINSERT INTO ùsers` (`name`, `feeds_count`, `created_at`) VALUES(hellolucky, 0, 1350906890)# Find UserSELECT ùsers`.* FROM ùsers` WHERE ùsers`.ìd` = 1# Update UserUPDATE ùsers` SET `name` = hellolucky123 WHERE ùsers`.ìd` = 1# Delete UserDELETE FROM ùsers` WHERE ùsers`.ìd` = 1

About Relation

About Relation# Set Following UserINSERT INTO ùser_follow_relations` (ùser_id`, `follow_id`) VALUES(1, 2)INSERT INTO ùser_follow_relations` (ùser_id`, `follow_id`) VALUES(1, 3)INSERT INTO ùser_follow_relations` (ùser_id`, `follow_id`) VALUES(1, 4)INSERT INTO ùser_follow_relations` (ùser_id`, `follow_id`) VALUES(1, 5)

About Relation# Find Following User IdsSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 1# Find Follower IdsSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.ùser_id` WHEREùser_follow_relations`.`follow_id` = 1

About Relation UserFollowRelation Records > 1000000# Find Following User IdsSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 1# Find Follower IdsSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.ùser_id` WHEREùser_follow_relations`.`follow_id` = 1

About Relation UserFollowRelation Records > 1000000# Find Following User IdsSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 1# Find Follower IdsSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.ùser_id` WHEREùser_follow_relations`.`follow_id` = 1 Slow!

About Relation# Find Following User CountSELECT COUNT(*) FROM ùsers` INNER JOINùser_follow_relations` ON ùsers`.ìd` =ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 1# Find Follower CountSELECT COUNT(*) FROM ùsers` INNER JOINùser_follow_relations` ON ùsers`.ìd` =ùser_follow_relations`.ùser_id` WHEREùser_follow_relations`.`follow_id` = 1

About Relation UserFollowRelation Records ># Find Following User Count 1000000SELECT COUNT(*) FROM ùsers` INNER JOINùser_follow_relations` ON ùsers`.ìd` =ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 1# Find Follower CountSELECT COUNT(*) FROM ùsers` INNER JOINùser_follow_relations` ON ùsers`.ìd` =ùser_follow_relations`.ùser_id` WHEREùser_follow_relations`.`follow_id` = 1

About Relation UserFollowRelation Records ># Find Following User Count 1000000SELECT COUNT(*) FROM ùsers` INNER JOINùser_follow_relations` ON ùsers`.ìd` =ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 1# Find Follower CountSELECT COUNT(*) FROM ùsers` INNER JOINùser_follow_relations` ON ùsers`.ìd` =ùser_follow_relations`.ùser_id` WHEREùser_follow_relations`.`follow_id` = 1 Slow!

About Relation# Find User1s Following UsersSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 1# Find User12 Following UsersSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 2# The Same Following UsersUser1s Following Users & User2s Following Users

About Relation# Find User1s Following Users Slow + SlowSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 1# Find User12 Following UsersSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 2# The Same Following UsersUser1s Following Users & User2s Following Users

About Relation# Find User1s Following Users Slow + SlowSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 1# Find User12 Following UsersSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 2# The Same Following UsersUser1s Following Users & User2s Following Users = Very Slow!

About Feed

About Feed# Create FeedINSERT INTO `feeds` (ùser_id` , `content`, `created_at`) VALUES (1,description, 1350906890)# Update CounterUPDATE ùsers` SET `feeds_count` = COALESCE(`feeds_count`, 0) +1 WHERE ùsers`.ìd` = 1

About FeedBEGIN# Create FeedINSERT INTO `feeds` (ùser_id` , `content`, `created_at`) VALUES (1,description, 1350906890)# Update CounterUPDATE ùsers` SET `feeds_count` = COALESCE(`feeds_count`, 0) +1 WHERE ùsers`.ìd` = 1COMMIT

About FeedBEGIN Transaction# Create FeedINSERT INTO `feeds` (ùser_id` , `content`, `created_at`) VALUES (1,description, 1350906890)# Update CounterUPDATE ùsers` SET `feeds_count` = COALESCE(`feeds_count`, 0) +1 WHERE ùsers`.ìd` = 1COMMIT

About FeedBEGIN Transaction# Create FeedINSERT INTO `feeds` (ùser_id` , `content`, `created_at`) VALUES (1,description, 1350906890)# Update CounterUPDATE ùsers` SET `feeds_count` = COALESCE(`feeds_count`, 0) +1 WHERE ùsers`.ìd` = 1COMMIT Slow!

About Feed# Find Following User IdsSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 1# Find Following Users FeedsSELECT `feeds`.* FROM `feeds` WHERE user_id in (2,3,4,5)

About Feed A Little Data# Find Following User IdsSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 1# Find Following Users FeedsSELECT `feeds`.* FROM `feeds` WHERE user_id in (2,3,4,5)

About Feed A Little Data# Find Following User IdsSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 1# Find Following Users FeedsSELECT `feeds`.* FROM `feeds` WHERE user_id in (2,3,4,5) Very Slow!

About Others

About Others# Find Top 10 Of The Talkiest UserSELECT `users`.* FROM `users` ORDER BY feeds_count LIMIT 10# Find Top 10 Of The Newest FeedsSELECT `feeds`.* FROM `feeds` ORDER BY created_at desc LIMIT 10

Redis？

About User# Create UserINSERT INTO ùsers` (`name`, `feeds_count`, `created_at`) VALUES(hellolucky, 0, 1350906890)# Find User StringsSELECT ùsers`.* FROM ùsers` WHERE ùsers`.ìd` = 1 Strings are the most basic kind of Redis value. Redis Strings are binary# Update UserUPDATE ùsers` SET `name` = string can contain any kind of data, for safe, this means that a Redis hellolucky123 WHERE ùsers`.ìd` = 1# DeleteaUser image or a serialized Ruby object. instance JPEG - http://redis.io/topics/data-typesDELETE FROM ùsers` WHERE ùsers`.ìd` = 1

About User# Create UserINSERT INTO ùsers` (`name`, `feeds_count`, `created_at`) VALUES(hellolucky, 0, 1350906890)# Find UserSELECT ùsers`.* FROM ùsers` WHERE ùsers`.ìd` = 1# Update User hellolucky set user:1:name set user:1:feeds_count 0UPDATE ùsers` SET `name` = hellolucky123 WHERE ùsers`.ìd` = 1 set user:1:created_at 1350906890# Delete UserDELETE FROM ùsers` WHERE ùsers`.ìd` = 1

About User# Create UserINSERT INTO ùsers` (`name`, `feeds_count`, `created_at`) VALUES(hellolucky, 0, 1350906890)# Find User KeySELECT ùsers`.* FROM ùsers` WHERE ùsers`.ìd` = 1# Update User hellolucky set user:1:name set user:1:feeds_count 0UPDATE ùsers` SET `name` = hellolucky123 WHERE ùsers`.ìd` = 1 set user:1:created_at 1350906890# Delete UserDELETE FROM ùsers` WHERE ùsers`.ìd` = 1

About User# Create UserINSERT INTO ùsers` (`name`, `feeds_count`, `created_at`) VALUES(hellolucky, 0, 1350906890)# Find User ValueSELECT ùsers`.* FROM ùsers` WHERE ùsers`.ìd` = 1# Update User hellolucky set user:1:name set user:1:feeds_count 0UPDATE ùsers` SET `name` = hellolucky123 WHERE ùsers`.ìd` = 1 set user:1:created_at 1350906890# Delete UserDELETE FROM ùsers` WHERE ùsers`.ìd` = 1

About User# Create UserINSERT INTO ùsers` (`name`, `feeds_count`, `created_at`) VALUES(hellolucky, 0, 1350906890)# Find UserSELECT ùsers`.* FROM ùsers` WHERE ùsers`.ìd` = 1# Update User Hash is betterUPDATE ùsers` SET `name` = hellolucky123 WHERE ùsers`.ìd` = 1# Delete UserDELETE FROM ùsers` WHERE ùsers`.ìd` = 1

About User# Create UserINSERT INTO ùsers` (`name`, `feeds_count`, `created_at`) VALUES(hellolucky, 0, 1350906890)# Find UserSELECT ùsers`.* FROM ùsers` WHERE ùsers`.ìd` = 1 Hashes# Update User Redis Hashes are maps between string fields and string values, so theyUPDATE ùsers` SET `name` = hellolucky123 WHERE ùsers`.ìd` = 1 are the perfect data type to represent objects.# Delete User - http://redis.io/topics/data-typesDELETE FROM ùsers` WHERE ùsers`.ìd` = 1

About User# Create UserINSERT INTO ùsers` (`name`, `feeds_count`, `created_at`) VALUES(hellolucky, 0, 1350906890)# Find UserSELECT ùsers`.* FROM ùsers` WHERE ùsers`.ìd` = 1# Update User hmset user:1 name hellolucky feeds_count 0 created_at 1350906890UPDATE ùsers` SET `name` = hellolucky123 WHERE ùsers`.ìd` = 1 zadd global:user_ids 0 1# Delete UserDELETE FROM ùsers` WHERE ùsers`.ìd` = 1

About User# Create UserINSERT INTO ùsers` (`name`, `feeds_count`, `created_at`) VALUES(hellolucky, 0, 1350906890)# Find UserSELECT ùsers`.* KeyFROM ùsers` WHERE ùsers`.ìd` = 1# Update User hmset user:1 name hellolucky feeds_count 0 created_at 1350906890UPDATE ùsers` SET `name` = hellolucky123 WHERE ùsers`.ìd` = 1 zadd global:user_ids 0 1# Delete UserDELETE FROM ùsers` WHERE ùsers`.ìd` = 1

About User# Create UserINSERT INTO ùsers` (`name`, `feeds_count`, `created_at`) VALUES(hellolucky, 0, 1350906890)# Find User FieldsSELECT ùsers`.* FROM ùsers` WHERE ùsers`.ìd` = 1# Update User hmset user:1 name hellolucky feeds_count 0 created_at 1350906890UPDATE ùsers` SET `name` = hellolucky123 WHERE ùsers`.ìd` = 1 zadd global:user_ids 0 1# Delete UserDELETE FROM ùsers` WHERE ùsers`.ìd` = 1

About User# Create UserINSERT INTO ùsers` (`name`, `feeds_count`, `created_at`) VALUES(hellolucky, 0, 1350906890)# Find UserSELECT ùsers`.* FROM ùsers` WHERE ùsers`.ìd` = 1 Values# Update User hmset user:1 name hellolucky feeds_count 0 created_at 1350906890UPDATE ùsers` SET `name` = hellolucky123 WHERE ùsers`.ìd` = 1 zadd global:user_ids 0 1# Delete UserDELETE FROM ùsers` WHERE ùsers`.ìd` = 1

About User# Create UserINSERT INTO ùsers` (`name`, `feeds_count`, `created_at`) VALUES(hellolucky, 0, 1350906890)# Find UserSELECT ùsers`.* FROM ùsers` WHERESets Sorted ùsers`.ìd` = 1# Update User Sorted Sets are, similarly to Redis Sets, non repeating RedisUPDATE ùsers` SET `name`difference is thatWHERE ùsers`.ìdà=Sorted collections of Strings. The = hellolucky123 every member of 1 Set is associated with score, that is used in order to take the sorted# Delete UserDELETE FROM from the smallest to the greatest score. While members set ordered, ùsers` WHERE ùsers`.ìd` = 1 are unique, scores may be repeated. - http://redis.io/topics/data-types

About User# Create UserINSERT INTO ùsers` (`name`, `feeds_count`, `created_at`) VALUES(hellolucky, 0, 1350906890)# Find UserSELECT ùsers`.* FROM ùsers` WHERE ùsers`.ìd` = 1# Update User feeds_count hmset user:1 name hellolucky feeds_count 0 created_at 1350906890UPDATE ùsers` SET `name` = hellolucky123 WHERE ùsers`.ìd` = 1 zadd global:user_ids 0 1# Delete UserDELETE FROM ùsers` WHERE ùsers`.ìd` = 1

About User# Create UserINSERT INTO ùsers` (`name`, `feeds_count`, `created_at`) VALUES(hellolucky, 0, 1350906890)# Find UserSELECT ùsers`.* FROM ùsers` WHERE ùsers`.ìd` = 1# Update User user_id hmset user:1 name hellolucky feeds_count 0 created_at 1350906890UPDATE ùsers` SET `name` = hellolucky123 WHERE ùsers`.ìd` = 1 zadd global:user_ids 0 1# Delete UserDELETE FROM ùsers` WHERE ùsers`.ìd` = 1

About User# Create UserINSERT INTO ùsers` (`name`, `feeds_count`, `created_at`) VALUES(hellolucky, 0, 1350906890)# Find UserSELECT ùsers`.* FROM ùsers` WHERE ùsers`.ìd` = 1# Update User For top 10 of the talkiest user hmset user:1 name hellolucky feeds_count 0 created_at 1350906890UPDATE ùsers` SET `name` = hellolucky123 WHERE ùsers`.ìd` = 1 zadd global:user_ids 0 1# Delete UserDELETE FROM ùsers` WHERE ùsers`.ìd` = 1

About User# Create UserINSERT INTO ùsers` (`name`, `feeds_count`, `created_at`) VALUES(hellolucky, 0, 1350906890)# Find UserSELECT ùsers`.* FROM ùsers` WHERE ùsers`.ìd` = 1# Update UserUPDATE ùsers` SET `name` = hellolucky123 WHERE ùsers`.ìd` = 1# Delete Userhmget user:1 name feeds_count created_atDELETE FROM ùsers` WHERE ùsers`.ìd` = 1

About User# Create UserINSERT INTO ùsers` (`name`, `feeds_count`, `created_at`) VALUES(hellolucky, 0, 1350906890)# Find UserSELECT ùsers`.* FROM ùsers` WHERE ùsers`.ìd` = 1# Update UserUPDATE ùsers` SET `name` = hellolucky123 WHERE ùsers`.ìd` = 1# Delete User HGETALL is betterDELETE FROM ùsers` WHERE ùsers`.ìd` = 1

About User# Create UserINSERT INTO ùsers` (`name`, `feeds_count`, `created_at`) VALUES(hellolucky, 0, 1350906890)# Find UserSELECT ùsers`.* FROM ùsers` WHERE ùsers`.ìd` = 1# Update UserUPDATE ùsers` SET `name` = hellolucky123 WHERE ùsers`.ìd` = 1# Delete Userhgetall user:1DELETE FROM ùsers` WHERE ùsers`.ìd` = 1

About User# Create UserINSERT INTO ùsers` (`name`, `feeds_count`, `created_at`) VALUEShset user:1 name hellolucky123(hellolucky, 0, 1350906890)# Find UserSELECT ùsers`.* FROM ùsers` WHERE ùsers`.ìd` = 1# Update UserUPDATE ùsers` SET `name` = hellolucky123 WHERE ùsers`.ìd` = 1# Delete UserDELETE FROM ùsers` WHERE ùsers`.ìd` = 1

About User# Create UserINSERT INTO ùsers` (`name`, `feeds_count`, `created_at`) VALUES(hellolucky, 0, 1350906890)delFind User# user:1SELECT ùsers`.* FROM ùsers` WHERE ùsers`.ìd` = 1# Update UserUPDATE ùsers` SET `name` = hellolucky123 WHERE ùsers`.ìd` = 1# Delete UserDELETE FROM ùsers` WHERE ùsers`.ìd` = 1

About Relation# Set Following UserINSERT INTO ùser_follow_relations` (ùser_id`, `follow_id`) VALUES(1, 2)INSERT INTO ùser_follow_relations` (ùser_id`, `follow_id`) VALUES(1, 3)INSERT INTO ùser_follow_relations` (ùser_id`, `follow_id`) VALUES(1, 4)INSERT INTO ùser_follow_relations` (ùser_id`, `follow_id`) VALUES(1, 5)

About Relation# Set Following UserINSERT INTO ùser_follow_relations` (ùser_id`, `follow_id`) VALUES(1, 2)INSERT INTO ùser_follow_relations` (ùser_id`, `follow_id`) VALUES(1, 3) SetsINSERT are the most basic kind of Redis value. Redis Strings are binaryStrings INTO ùser_follow_relations` (ùser_id`, `follow_id`) VALUES(1, 4) this means that a Redis string can contain any kind of data, forsafe,instance a JPEG image or a serialized Ruby object.INSERT INTO ùser_follow_relations` (ùser_id`, `follow_id`) VALUES(1, 5) - http://redis.io/topics/data-types

About Relation# Set Following UserINSERT INTO ùser_follow_relations` (ùser_id`, `follow_id`) VALUES(1, 2)INSERT INTO ùser_follow_relations` (ùser_id`, `follow_id`) VALUES(1, 3)INSERT INTO ùser_follow_relations` (ùser_id`, `follow_id`) VALUESsadd user:1:follow_ids 2(1, 4) user:2:follower_ids 1saddINSERT INTO ùser_follow_relations` (ùser_id`, `follow_id`) VALUES(1, 5)

About Relation# Find Following User IdsSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 1# Find Follower IdsSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.ùser_id` WHEREsmembers user:1:follow_idsùser_follow_relations`.`follow_id` = 1

About Relation # Find Following User Idssmembers user:1:follower_idsSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 1# Find Follower IdsSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.ùser_id` WHEREùser_follow_relations`.`follow_id` = 1

About Relation# Find Following User CountSELECT COUNT(*) FROM ùsers` INNER JOINùser_follow_relations` ON ùsers`.ìd` =ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 1# Find Follower CountSELECT COUNT(*) FROM ùsers` INNER JOINùser_follow_relations` ON ùsers`.ìd` =scard user:1:follow_idsùser_follow_relations`.ùser_id` WHEREùser_follow_relations`.`follow_id` = 1

About Relation # Find Following User Countscard user:1:follower_ids ùsers` INNER JOIN SELECT COUNT(*) FROM ùser_follow_relations` ON ùsers`.ìd` = ùser_follow_relations`.`follow_id` WHERE ùser_follow_relations`.ùser_id` = 1 # Find Follower Count SELECT COUNT(*) FROM ùsers` INNER JOIN ùser_follow_relations` ON ùsers`.ìd` = ùser_follow_relations`.ùser_id` WHERE ùser_follow_relations`.`follow_id` = 1

About Relation# Find User1s Following UsersSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 1# Find User12 Following UsersSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 2# The Same Following UsersUser1s Following Users & User2s Following Users

About Relation # Find User1s Following Users SELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relations` ON ùsers`.ìd` = ùser_follow_relations`.`follow_id` WHERE ùser_follow_relations`.ùser_id` = 1sinter user:1:follow_ids user:2:follow_ids # Find User12 Following Users SELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relations` ON ùsers`.ìd` = ùser_follow_relations`.`follow_id` WHERE ùser_follow_relations`.ùser_id` = 2 # The Same Following Users User1s Following Users & User2s Following Users

About Feed# Create FeedINSERT INTO `feeds` (ùser_id` , `content`, `created_at`) VALUES (1,description, 1350906890)# Update CounterUPDATE ùsers` SET `feeds_count` = COALESCE(`feeds_count`, 0) +hmset feed:1 user_id=11content description created_at 13509068901 WHERE ùsers`.ìd`sadd user:2:follow:feed_ids 1rpush global:feed_ids 1

About Feed# Create FeedINSERT INTO `feeds` (ùser_id` , `content`, `created_at`) VALUES (1,description, 1350906890) Store feed# Update CounterUPDATE ùsers` SET `feeds_count` = COALESCE(`feeds_count`, 0) +hmset feed:1 user_id=11content description created_at 13509068901 WHERE ùsers`.ìd`sadd user:2:follow:feed_ids 1rpush global:feed_ids 1

About Feed# Create FeedINSERT INTO `feeds` (ùser_id` , `content`, `created_at`) VALUES (1,description, 1350906890)# Update Counter Push feed id toUPDATE ùsers` SET `feeds_count` = COALESCE(`feeds_count`, 0) + followershmset feed:1 user_id=11content description created_at 13509068901 WHERE ùsers`.ìd`sadd user:2:follow:feed_ids 1rpush global:feed_ids 1

About Feed# Create FeedINSERT INTO `feeds` (ùser_id` , `content`, `created_at`) VALUES (1,description, 1350906890)# Update Counter I’m lazy to list, itUPDATE ùsers` SET `feeds_count` = COALESCE(`feeds_count`, 0) + should more.....hmset feed:1 user_id=11content description created_at 13509068901 WHERE ùsers`.ìd`sadd user:2:follow:feed_ids 1rpush global:feed_ids 1

About Feed# Create FeedINSERT INTO `feeds` (ùser_id` , `content`, `created_at`) VALUES (1,description, 1350906890)# Update Counter ListsUPDATE ùsers` SET `feeds_count` = COALESCE(`feeds_count`, 0) +1 WHERE Lists are simply lists of strings, sorted by insertion order. It is Redis ùsers`.ìd` = 1possible to add elements to a Redis List pushing new elements on the head (on the left) or on the tail (on the right) of the list. - http://redis.io/topics/data-types

About Feed# Create FeedINSERT INTO `feeds` (ùser_id` , `content`, `created_at`) VALUES (1,description, 1350906890)# Update CounterUPDATE ùsers` SET `feeds_count` = COALESCE(`feeds_count`, 0) +hmset feed:1 user_id=11content description created_at 13509068901 WHERE ùsers`.ìd`sadd user:2:follow:feed_ids 1 For top 10 of the newest feedsrpush global:feed_ids 1

About Feedhincrby user:1 feeds_count 1zincrby global:user_ids 1 1 # Create FeedINSERT INTO `feeds` (ùser_id` , `content`, `created_at`) VALUES (1,description, 1350906890)# Update CounterUPDATE ùsers` SET `feeds_count` = COALESCE(`feeds_count`, 0) +1 WHERE ùsers`.ìd` = 1

About Feed Update counterhincrby user:1 feeds_count 1zincrby global:user_ids 1 1 # Create FeedINSERT INTO `feeds` (ùser_id` , `content`, `created_at`) VALUES (1,description, 1350906890)# Update CounterUPDATE ùsers` SET `feeds_count` = COALESCE(`feeds_count`, 0) +1 WHERE ùsers`.ìd` = 1

About Feedhincrby user:1 feeds_count 1zincrby global:user_ids 1 1 # Create FeedINSERT INTO `feeds` (ùser_id` , `content`, `created_at`) VALUES (1,description, 1350906890)# Update CounterUPDATE ùsers` SET `feeds_count` = COALESCE(`feeds_count`, 0) +1 WHERE ùsers`.ìd` = 1

About Feed For top 10 of the talkiest userhincrby user:1 feeds_count 1zincrby global:user_ids 1 1 # Create FeedINSERT INTO `feeds` (ùser_id` , `content`, `created_at`) VALUES (1,description, 1350906890)# Update CounterUPDATE ùsers` SET `feeds_count` = COALESCE(`feeds_count`, 0) +1 WHERE ùsers`.ìd` = 1

About Feed# Find Following User IdsSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 1# Find Following Users FeedsSELECT `feeds`.* FROM `feeds` WHERE user_id in (2,3,4,5)

About Feed# Find Following User IdsSELECT ùsers`.id FROM ùsers` INNER JOIN ùser_follow_relationsÒN ùsers`.ìd` = ùser_follow_relations`.`follow_id` WHEREùser_follow_relations`.ùser_id` = 1# Find Following Users FeedsSELECT `feeds`.* FROM `feeds` WHERE user_id in (2,3,4,5)smembers user:1:follow:feed_ids

About Others# Find Top 10 Of The Talkiest UserSELECT `users`.* FROM `users` ORDER BY feeds_count LIMIT 10# Find Top 10 Of The Newest FeedsSELECT `feeds`.* FROM `feeds` ORDER BY created_at desc LIMIT 10zrevrange global:user_ids 0 9

About Otherslrange global:feed_ids 0 9# Find Top 10 Of The Talkiest UserSELECT `users`.* FROM `users` ORDER BY feeds_count LIMIT 10# Find Top 10 Of The Newest FeedsSELECT `feeds`.* FROM `feeds` ORDER BY created_at desc LIMIT 10

Conclusion

MySQL + Redis = Lego

http://blog.hellolucky.info	1801
http://nosql.mypopescu.com	1402
http://judydba.tistory.com	370
http://feeds.feedburner.com	265
http://clasense4.wordpress.com	209
http://hadoopbigdata.wordpress.com	141
http://purpleworks.nemoz.co.kr	28
http://m.purpleworks.nemoz.co.kr	23
http://tumblr.hootsuite.com	19
http://www.hanrss.com	18
http://newsblur.com	11
http://www.newsblur.com	9
https://twitter.com	7
https://si0.twimg.com	3
http://127.0.0.1	2
http://localhost	2
http://cafe.naver.com	2
http://soafaq.com	1
http://translate.googleusercontent.com	1
http://xianguo.com	1
https://abs.twimg.com	1

No sql taiwan #6 redis data structure

by Felix Lin on Oct 23, 2012

Accessibility

Categories

Upload Details

Usage Rights

21 Embeds 4,316

Statistics

No sql taiwan #6 redis data structure Presentation Transcript