Blazing Data With Redis (and LEGOS!)

Blazing Data with Redis S!) By: Justin Carmony LE GO ( and

edis)About Me (I <3 R• Director of Development for DeseretNews.com• CIO of CEVO• I Make (and Break) Web Stuff• Focus on Scalable, Real-time Websites & APIs

About Presentation• We’ll ask for questions several times during presentation & the end.• I will post links, slides, resource, etc.• Goal: Educate & Inspire you on how, when, and why to use Redis!

by rt e S ta th ts ingLe ur eas enceM udi A

u ta abo em lk obl Ta Pr t’sLe monC o m

in ja N a e re m u’ soYo e A w oper evel D

to nt e a n W nli e W kO ac ers! Tr S U BosRea s: “W l-Ti e W me ant Da ta!”

in ja N a e re m u’ so Yo e A w oper evel DWe Want To Know Who Is Viewing Our Site!

“I’ll Just Add a Table to MySQl....”

Real-Time Data

Real-Time Data • High Volume Writes • High Volume Reads • Low Latency / Delay • Grows Exponentially compared to Rest of your Data

Traditional Data Stores• Examples: Databases (i.e. MySQL, Postgre)• Writing is Resource Intensive• Stored on Disk (aka Slower)• Slower as Volume Grows ds...) or the rw• Challenge for Replication (i no

olu me ighV ith H ites s w Wr wn s & el tdo eadM R

Many NoSQL Solutions

Redis - Built for Speed• Key-Value Storage• In-Memory•••• nd...) seco ai ta (W

Isn’t This Just Memcached?

o! NIsn’t This Just Memcached?

Redis - Built for Speed• Key-Value Storage• In-Memory• Persistence• Multiple Data Types• Transactions• Pub/Sub w/ Blocking ast ...) it ’s F (and

Extremely Fast...

Ludicrous Speed Fast

0+ s ,00 rite 1 00 W s & ond ad ec Re r S PeLudicrous Speed Fast

It’s gone Plaid!

To w isH o R edU se

Step One: Install & Run• Linux & Mac: Compile from Source • No Dependencies • make && make install• Windows • Download Binaries • Compile? Best of Luck

Running Redis• Run: redis-server• Can use conﬁguration ﬁle• Run as a “service”: http://redis.io/topics/ quickstart• redis-cli to try out commands

Step Two:Understand Keys

Redis Keys• Keys MUST be UNIQUE• Keys are Binary Safe Strings• Super Long Keys (i.e. 1024 bytes) are costly to look up• Cryptic Short Keys (i.e. u:1000:pwd) have little performance improvement over a descriptive key (i.e. user:1000:password)

Step Three:Thinking Key-Value

This is not an RMDBS• It’s All About the Keys, Not the Values• There is no “Querying”• There are no “Indexes”• There are no “Schemas”

e nt oc um ta!D D a Yo ur

Step Four: Get to Know your Data Types g Your in ! ow ces Kn Pie L ike go Le

Redis Strings• Store Simple Strings• Binary Safe• Great for JSON• Advanced Commands

Data-Type “Matrix” Sorted Unsorted SortedComparable Sets SetsStand Alone Lists Hashes

Quick Variable Guide• Hashes - Small in Size,Very Efﬁcient• Lists - Awesome Queues, Size Doesn’t Affect Performance• Sets - Great for Intersecting with others• Sorted Sets - Use to Keep “Indexes”, Sorts using Scores

Step Five:Learn the Commands

Learning the Commands• Generic Commands for All Keys• Commands for Each Data Type• Each Command has Big O Notation for Performance• Simple,Yet Powerful

ive act s ter pleIn m E xa

g It tin her ut etP gA ll To

Using Redis With PHP• Predis • PHP Library • Easy to Use • Very Fast to Update New Features• phpredis • PHP Extension ing • Faster, but requires Be Us compiling module e ’ll dis W Pre

Example: Simple Caching

Simple Cache• Data Types: • Strings• Commands: • SETEX <key> <seconds to expire> <value> • GET <key> • EXPIREAT <key> <timestamp>

Connecting<?php// Include the Predis Autoloaderrequire predis/lib/Predis/Autoloader.php;// Register the AutoloaderPredisAutoloader::register();// Create a Client with defaults$redis = new PredisClient();// Create with Connection String$redis = new PredisClient(tcp://10.0.0.1:6379);/** Our Examples Will Assume This Is Already Done **/

Simple Cache$key = cache.user:justin;$data_str = $redis->get($key);if($data_str){! $data = unserialize($data_str);}else{! // Really Expensive Method of Getting This Data! $data = MyDatabase::GetExpensiveData();! $redis->setex($key, 60, serialize($data));}/* Do something with the $data */

Example: Online Users• Data Types: • Sets• Commands: • SADD <key> <value> • SUNION <key1> <key2> <key3> <key....> • EXPIRE <key> <timestamp>

Example: Users Online

Marking Users Online /* Store Current User */ // Current User ID $user_id = 1234;// Get Current Time$now = time();$min = date("i",$now);// Generate the Key$key = "online:".$min;// Adding user to online users$redis->sadd($key, $user_id);$redis->expire($key, 60 * 10); // Expire in 10 minutes

Getting Online Users/* Getting Onling Users */$keys = array();// Get Current Time$now = time();$min = date("i",$now);$count = 0;$minutes_ago = 5;while($count < $minutes_ago){! $keys[] = "online:".$min;!! $count++;! $min--;! if($min < 0)! {! ! $min = 59;! }}$scmd = $redis->createCommand("sunion",$keys);$online_ids = $redis->executeCommand($scmd);

Example: Friends Online• Data Types: • Sets• Additional Commands: • SUNIONSTORE <dest> <key1> <key2> <key....> • SINTER <key1> <key2> <key...>

My Friends Online/* My Friends Online */$keys = array(online_users);$user_id = 1234;// Get Current Time$min = date("i",time());$count = 0;$minutes_ago = 5;while($count < $minutes_ago){! $keys[] = "online:".$min;! $count++;! $min--;! if($min < 0) { $min = 59; }}// SUNIONSTORE online_users online:10 online:9 online:8 online:7 online:6$scmd = $redis->createCommand("sunionstore",$keys);$redis->executeCommand($scmd);$online_friend_ids = $redis->sinter(online_users! , user:.$user_id..friend_ids);

Under The Hood

Few Things About Redis• Single Threaded• Can “Shard” For More Capacity / Performance• All Commands are Atomic• Transactions for Multiple Atomic Commands• Pipelining for High Performance

Persistence• Snapshots on a Conﬁgurable Schedule • Will “fork” the process and write the DataSet to Disk• Append-Only File• Will Let You Survive a “Reboot”

New Stuff / On The Horizon• Lua Scripting (Kinda Querying)• Redis Clustering

aL ive ut bo ? AH ow emo D

One Redis Server

50 Servers * 8 Clients = 400 Workers

Rackspace Cloud +Salt (saltstack.org) + Redis & PHP

Demo Time!

Questions?

Your HomeworkDownload & Play Around with Redis! It’s Awesome!

More Info?http://www.justincarmony.com/redis

Flickr Credits & Images: http://gim.ie/jsLJ

Thanks!Rate My Talk (PLEASE): https://joind.in/6486 Twitter: @JustinCarmony IRC: carmony #uphpu #phpc #salt Website: http://www.justincarmony.com/blog Email: justin@justincarmony.com

Blazing Data With Redis (and LEGOS!)

by Justin Carmony

Accessibility

Categories

Upload Details

Usage Rights

1 Embed 18

Statistics

Blazing Data With Redis (and LEGOS!) Presentation Transcript