Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
@ flickr & tripod
Presented by Sean Perkins
Sr. Production Engineer
flickr & tripod
100+ physical hosts
500+ instances
600k Ops/s
Use Cases for Redis
Cameraroll
24 hosts (12 on each coast)
4 masters per host
cache
twemproxy client
ketama hash ring
Activityfeed
8 hosts
8 masters per host
cache
twemproxy client
ketama hash ring
Notifications
3 Hosts
1 Master
2 Slaves
Clients on both coasts
Redis only in one
And many many more…
45 redis-general hosts w/ ~200 instances
about 50% have HA
Why Redis
Redis Cluster
Manual builds at first
created package to automate setup
tested failed nodes
benchmarking
redis-cluster101
redis-cluster102
redis-cluster103
196GB RAM each
8 master instances x 3 hosts = 24
16 slave instances x 3...
Console (tripod on boarding site)
Java Spring Client
Cache
Smart Client
redis-cluster101
redis-cluster102
redis-cluster103
64GB RAM each
4 master instances x 3 hosts = 12
8 slave instances x 3 h...
Activitybot
Kue Library and Nodejs
Queue
Smart Client
Questions?
Upcoming SlideShare
Loading in …5
×

RedisConf17 - Redis Cluster at flickr and tripod

747 views

Published on

RedisConf17 breakout session

Published in: Technology

RedisConf17 - Redis Cluster at flickr and tripod

  1. 1. @ flickr & tripod Presented by Sean Perkins Sr. Production Engineer
  2. 2. flickr & tripod 100+ physical hosts 500+ instances 600k Ops/s
  3. 3. Use Cases for Redis
  4. 4. Cameraroll 24 hosts (12 on each coast) 4 masters per host cache twemproxy client ketama hash ring
  5. 5. Activityfeed 8 hosts 8 masters per host cache twemproxy client ketama hash ring
  6. 6. Notifications 3 Hosts 1 Master 2 Slaves Clients on both coasts Redis only in one
  7. 7. And many many more… 45 redis-general hosts w/ ~200 instances about 50% have HA
  8. 8. Why Redis
  9. 9. Redis Cluster Manual builds at first created package to automate setup tested failed nodes benchmarking
  10. 10. redis-cluster101 redis-cluster102 redis-cluster103 196GB RAM each 8 master instances x 3 hosts = 24 16 slave instances x 3 hosts = 48 tripod
  11. 11. Console (tripod on boarding site) Java Spring Client Cache Smart Client
  12. 12. redis-cluster101 redis-cluster102 redis-cluster103 64GB RAM each 4 master instances x 3 hosts = 12 8 slave instances x 3 hosts = 24 flickr
  13. 13. Activitybot Kue Library and Nodejs Queue Smart Client
  14. 14. Questions?

×