Blazing Data With Redis (and LEGOS!)
•Download as KEY, PDF•
21 likes•6,321 views
There are many fast data stores, and then there is Redis. Learn about this excellent NoSQL solution that is a powerful in-memory key-value store. Learn how to solve traditionally difficult problems with Redis, and how you can benefit from 100,000 reads/writes a second on commodity hardware. We’ll discuss how and when to use the different datatypes and commands to fit your needs. We’ll discuss the different PHP libraries with their pros and cons. We’ll then show some live examples on how to use it for a chatroom, and how Redis manages a billion data points for our dating matching system. Finally, we’ll discuss some of the upcoming features in the near future, such as clustering and scripting.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Blazing Data With Redis (and LEGOS!)
Similar to Blazing Data With Redis (and LEGOS!) (20)
Recently uploaded
Recently uploaded (20)
Blazing Data With Redis (and LEGOS!)
- 1. Blazing Data with Redis S!) By: Justin Carmony LE GO ( and
- 2. edis) About Me (I <3 R • Director of Development for DeseretNews.com • CIO of CEVO • I Make (and Break) Web Stuff • Focus on Scalable, Real-time Websites & APIs
- 3. About Presentation • We’ll ask for questions several times during presentation & the end. • I will post links, slides, resource, etc. • Goal: Educate & Inspire you on how, when, and why to use Redis!
- 4. by rt e S ta th ts ing Le ur eas ence M udi A
- 5. u ta abo em lk obl Ta Pr t’s Le mon C o m
- 6. in ja N a e re m u’ so Yo e A w oper evel D
- 7. to nt e a n W nli e W kO ac ers! Tr S U Bos Rea s: “W l-Ti e W me ant Da ta!”
- 8. in ja N a e re m u’ so Yo e A w oper evel D We Want To Know Who Is Viewing Our Site!
- 9. “I’ll Just Add a Table to MySQl....”
- 18. Real-Time Data
- 19. Real-Time Data • High Volume Writes • High Volume Reads • Low Latency / Delay • Grows Exponentially compared to Rest of your Data
- 20. Traditional Data Stores • Examples: Databases (i.e. MySQL, Postgre) • Writing is Resource Intensive • Stored on Disk (aka Slower) • Slower as Volume Grows ds...) or the rw • Challenge for Replication (i no
- 21. olu me ighV ith H ites s w Wr wn s & el tdo ead M R
- 23. Redis - Built for Speed • Key-Value Storage • In-Memory • • • • nd...) seco ai ta (W
- 24. Isn’t This Just Memcached?
- 25. o! N Isn’t This Just Memcached?
- 26. Redis - Built for Speed • Key-Value Storage • In-Memory • Persistence • Multiple Data Types • Transactions • Pub/Sub w/ Blocking ast ...) it ’s F (and
- 29. 0+ s ,00 rite 1 00 W s & ond ad ec Re r S Pe Ludicrous Speed Fast
- 30. It’s gone Plaid!
- 31. To w is H o R ed U se
- 32. Step One: Install & Run • Linux & Mac: Compile from Source • No Dependencies • make && make install • Windows • Download Binaries • Compile? Best of Luck
- 33. Running Redis • Run: redis-server • Can use configuration file • Run as a “service”: http://redis.io/topics/ quickstart • redis-cli to try out commands
- 35. Redis Keys • Keys MUST be UNIQUE • Keys are Binary Safe Strings • Super Long Keys (i.e. 1024 bytes) are costly to look up • Cryptic Short Keys (i.e. u:1000:pwd) have little performance improvement over a descriptive key (i.e. user:1000:password)
- 37. This is not an RMDBS • It’s All About the Keys, Not the Values • There is no “Querying” • There are no “Indexes” • There are no “Schemas”
- 38. e nt oc um ta! D D a Yo ur
- 39. Step Four: Get to Know your Data Types g Your in ! ow ces Kn Pie L ike go Le
- 40. Redis Strings • Store Simple Strings • Binary Safe • Great for JSON • Advanced Commands
- 41. Data-Type “Matrix” Sorted Unsorted Sorted Comparable Sets Sets Stand Alone Lists Hashes
- 42. Quick Variable Guide • Hashes - Small in Size,Very Efficient • Lists - Awesome Queues, Size Doesn’t Affect Performance • Sets - Great for Intersecting with others • Sorted Sets - Use to Keep “Indexes”, Sorts using Scores
- 43. Step Five: Learn the Commands
- 44. Learning the Commands • Generic Commands for All Keys • Commands for Each Data Type • Each Command has Big O Notation for Performance • Simple,Yet Powerful
- 46. ive act s ter ple In m E xa
- 47. g It tin her ut et P g A ll To
- 48. Using Redis With PHP • Predis • PHP Library • Easy to Use • Very Fast to Update New Features • phpredis • PHP Extension ing • Faster, but requires Be Us compiling module e ’ll dis W Pre
- 50. Simple Cache • Data Types: • Strings • Commands: • SETEX <key> <seconds to expire> <value> • GET <key> • EXPIREAT <key> <timestamp>
- 51. Connecting <?php // Include the Predis Autoloader require 'predis/lib/Predis/Autoloader.php'; // Register the Autoloader PredisAutoloader::register(); // Create a Client with defaults $redis = new PredisClient(); // Create with Connection String $redis = new PredisClient('tcp://10.0.0.1:6379'); /** Our Examples Will Assume This Is Already Done **/
- 52. Simple Cache $key = 'cache.user:justin'; $data_str = $redis->get($key); if($data_str) { ! $data = unserialize($data_str); } else { ! // Really Expensive Method of Getting This Data ! $data = MyDatabase::GetExpensiveData(); ! $redis->setex($key, 60, serialize($data)); } /* Do something with the $data */
- 53. Example: Online Users • Data Types: • Sets • Commands: • SADD <key> <value> • SUNION <key1> <key2> <key3> <key....> • EXPIRE <key> <timestamp>
- 55. Marking Users Online /* Store Current User */ // Current User ID $user_id = 1234; // Get Current Time $now = time(); $min = date("i",$now); // Generate the Key $key = "online:".$min; // Adding user to online users $redis->sadd($key, $user_id); $redis->expire($key, 60 * 10); // Expire in 10 minutes
- 56. Getting Online Users /* Getting Onling Users */ $keys = array(); // Get Current Time $now = time(); $min = date("i",$now); $count = 0; $minutes_ago = 5; while($count < $minutes_ago) { ! $keys[] = "online:".$min; ! ! $count++; ! $min--; ! if($min < 0) ! { ! ! $min = 59; ! } } $scmd = $redis->createCommand("sunion",$keys); $online_ids = $redis->executeCommand($scmd);
- 57. Example: Friends Online • Data Types: • Sets • Additional Commands: • SUNIONSTORE <dest> <key1> <key2> <key....> • SINTER <key1> <key2> <key...>
- 58. My Friends Online /* My Friends Online */ $keys = array('online_users'); $user_id = '1234'; // Get Current Time $min = date("i",time()); $count = 0; $minutes_ago = 5; while($count < $minutes_ago) { ! $keys[] = "online:".$min; ! $count++; ! $min--; ! if($min < 0) { $min = 59; } } // SUNIONSTORE online_users online:10 online:9 online:8 online:7 online:6 $scmd = $redis->createCommand("sunionstore",$keys); $redis->executeCommand($scmd); $online_friend_ids = $redis->sinter('online_users' ! , 'user:'.$user_id.'.friend_ids');
- 59. Under The Hood
- 60. Few Things About Redis • Single Threaded • Can “Shard” For More Capacity / Performance • All Commands are Atomic • Transactions for Multiple Atomic Commands • Pipelining for High Performance
- 61. Persistence • Snapshots on a Configurable Schedule • Will “fork” the process and write the DataSet to Disk • Append-Only File • Will Let You Survive a “Reboot”
- 62. New Stuff / On The Horizon • Lua Scripting (Kinda Querying) • Redis Clustering
- 63. aL ive ut bo ? A H ow emo D
- 64. One Redis Server
- 65. 50 Servers * 8 Clients = 400 Workers
- 66. Rackspace Cloud + Salt (saltstack.org) + Redis & PHP
- 67. Demo Time!
- 68. Questions?
- 69. Your Homework Download & Play Around with Redis! It’s Awesome!
- 71. Flickr Credits & Images: http://gim.ie/jsLJ
- 72. Thanks! Rate My Talk (PLEASE): https://joind.in/6486 Twitter: @JustinCarmony IRC: carmony #uphpu #phpc #salt Website: http://www.justincarmony.com/blog Email: justin@justincarmony.com
Editor's Notes
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n