Advertisement

RedisConf17 - Redis Cluster at flickr and tripod

Redis Labs
Redis Labs
Jun. 2, 2017••
RedisConf17 - Redis Cluster at flickr and tripod
RedisConf17 - Redis Cluster at flickr and tripod
RedisConf17 - Redis Cluster at flickr and tripod
RedisConf17 - Redis Cluster at flickr and tripod
RedisConf17 - Redis Cluster at flickr and tripod
RedisConf17 - Redis Cluster at flickr and tripod
RedisConf17 - Redis Cluster at flickr and tripod
RedisConf17 - Redis Cluster at flickr and tripod
RedisConf17 - Redis Cluster at flickr and tripod
RedisConf17 - Redis Cluster at flickr and tripod
RedisConf17 - Redis Cluster at flickr and tripod
RedisConf17 - Redis Cluster at flickr and tripod
RedisConf17 - Redis Cluster at flickr and tripod
RedisConf17 - Redis Cluster at flickr and tripod

Check these out next

Counting image views using redis cluster
Counting image views using redis cluster
Redis Labs
Troubleshooting redis
Troubleshooting redis
DaeMyung Kang
RedisConf17 - Redis Graph
RedisConf17 - Redis Graph
Redis Labs
RedisConf17 - Turbo-charge your apps with Amazon Elasticache for Redis
RedisConf17 - Turbo-charge your apps with Amazon Elasticache for Redis
Redis Labs
RedisConf17 - Home Depot - Turbo charging existing applications with Redis
RedisConf17 - Home Depot - Turbo charging existing applications with Redis
Redis Labs
Dynomite: A Highly Available, Distributed and Scalable Dynamo Layer--Ioannis ...
Dynomite: A Highly Available, Distributed and Scalable Dynamo Layer--Ioannis ...
Redis Labs
MySQL Head to Head Performance
MySQL Head to Head Performance
Kyle Bader
Which Hypervisor is Best?
Which Hypervisor is Best?
Kyle Bader
1 of 14

RedisConf17 - Redis Cluster at flickr and tripod

Jun. 2, 2017••
Download to read offline
Technology

RedisConf17 breakout session

Redis Labs
Redis Labs
Advertisement
Advertisement
Advertisement

Recommended

RedisConf17 - Doing More With Redis - Ofer Bengal and Yiftach ShoolmanRedisConf17 - Doing More With Redis - Ofer Bengal and Yiftach Shoolman
RedisConf17 - Doing More With Redis - Ofer Bengal and Yiftach ShoolmanRedis Labs748 views•99 slides
RedisConf17 - Lyft - Geospatial at Scale - Daniel HochmanRedisConf17 - Lyft - Geospatial at Scale - Daniel Hochman
RedisConf17 - Lyft - Geospatial at Scale - Daniel HochmanRedis Labs2.3K views•26 slides
RedisConf17- Using Redis at scale @ TwitterRedisConf17- Using Redis at scale @ Twitter
RedisConf17- Using Redis at scale @ TwitterRedis Labs3.7K views•26 slides
RedisConf17 - Redis in High Traffic Adtech StackRedisConf17 - Redis in High Traffic Adtech Stack
RedisConf17 - Redis in High Traffic Adtech StackRedis Labs1.5K views•38 slides
What's new with enterprise Redis - Leena Joshi, Redis LabsWhat's new with enterprise Redis - Leena Joshi, Redis Labs
What's new with enterprise Redis - Leena Joshi, Redis LabsRedis Labs1.7K views•42 slides
RedisConf17 - Redis Development, An Update - @antirezRedisConf17 - Redis Development, An Update - @antirez
RedisConf17 - Redis Development, An Update - @antirezRedis Labs600 views•29 slides

More Related Content

Slideshows for you(20)

Counting image views using redis clusterCounting image views using redis cluster
Counting image views using redis cluster
Redis Labs•3.4K views
Troubleshooting redisTroubleshooting redis
Troubleshooting redis
DaeMyung Kang•2.6K views
RedisConf17 - Redis GraphRedisConf17 - Redis Graph
RedisConf17 - Redis Graph
Redis Labs•754 views
RedisConf17 - Turbo-charge your apps with Amazon Elasticache for RedisRedisConf17 - Turbo-charge your apps with Amazon Elasticache for Redis
RedisConf17 - Turbo-charge your apps with Amazon Elasticache for Redis
Redis Labs•496 views
RedisConf17 - Home Depot - Turbo charging existing applications with RedisRedisConf17 - Home Depot - Turbo charging existing applications with Redis
RedisConf17 - Home Depot - Turbo charging existing applications with Redis
Redis Labs•977 views
Dynomite: A Highly Available, Distributed and Scalable Dynamo Layer--Ioannis ...Dynomite: A Highly Available, Distributed and Scalable Dynamo Layer--Ioannis ...
Dynomite: A Highly Available, Distributed and Scalable Dynamo Layer--Ioannis ...
Redis Labs•3.9K views
MySQL Head to Head PerformanceMySQL Head to Head Performance
MySQL Head to Head Performance
Kyle Bader•351 views
Which Hypervisor is Best?Which Hypervisor is Best?
Which Hypervisor is Best?
Kyle Bader•315 views
Day 2 General Session Presentations RedisConfDay 2 General Session Presentations RedisConf
Day 2 General Session Presentations RedisConf
Redis Labs•884 views
Handling Redis failover with ZooKeeperHandling Redis failover with ZooKeeper
Handling Redis failover with ZooKeeper
ryanlecompte•19.5K views
How we got to 1 millisecond latency in 99% under repair, compaction, and flus...How we got to 1 millisecond latency in 99% under repair, compaction, and flus...
How we got to 1 millisecond latency in 99% under repair, compaction, and flus...
ScyllaDB•850 views
RedisConf17 - Building Large High Performance Redis Databases with Redis Ente...RedisConf17 - Building Large High Performance Redis Databases with Redis Ente...
RedisConf17 - Building Large High Performance Redis Databases with Redis Ente...
Redis Labs•1.7K views
Ceph Deployment at Target: Customer SpotlightCeph Deployment at Target: Customer Spotlight
Ceph Deployment at Target: Customer Spotlight
Colleen Corrice•205 views
Redis in a Multi Tenant Environment–High Availability, Monitoring & Much More! Redis in a Multi Tenant Environment–High Availability, Monitoring & Much More!
Redis in a Multi Tenant Environment–High Availability, Monitoring & Much More!
Redis Labs•4.4K views
Persistent Storage for Containerized ApplicationsPersistent Storage for Containerized Applications
Persistent Storage for Containerized Applications
Colleen Corrice•637 views
Redis for horizontally scaled data processing at jFrog bintrayRedis for horizontally scaled data processing at jFrog bintray
Redis for horizontally scaled data processing at jFrog bintray
Redis Labs•685 views
Building Scalable, Real Time Applications for Financial Services with DataStaxBuilding Scalable, Real Time Applications for Financial Services with DataStax
Building Scalable, Real Time Applications for Financial Services with DataStax
DataStax•1.1K views
HIgh Performance Redis- Tague Griffith, GoProHIgh Performance Redis- Tague Griffith, GoPro
HIgh Performance Redis- Tague Griffith, GoPro
Redis Labs•1.4K views
Red Hat Storage RoadmapRed Hat Storage Roadmap
Red Hat Storage Roadmap
Colleen Corrice•353 views
Ceph: Open Source Storage Software Optimizations on Intel® Architecture for C...Ceph: Open Source Storage Software Optimizations on Intel® Architecture for C...
Ceph: Open Source Storage Software Optimizations on Intel® Architecture for C...
Odinot Stanislas•23.2K views

Similar to RedisConf17 - Redis Cluster at flickr and tripod(20)

Docker in the WildDocker in the Wild
Docker in the Wild
Chris Mague•291 views
Docker in the WildDocker in the Wild
Docker in the Wild
Christian Mague•381 views
Redis Meetup TLV - K8s Session 28/10/2018Redis Meetup TLV - K8s Session 28/10/2018
Redis Meetup TLV - K8s Session 28/10/2018
Danni Moiseyev•99 views
IMCSummit 2015 - Day 2 IT Business Track - 4 Myths about In-Memory Databases ...IMCSummit 2015 - Day 2 IT Business Track - 4 Myths about In-Memory Databases ...
IMCSummit 2015 - Day 2 IT Business Track - 4 Myths about In-Memory Databases ...
In-Memory Computing Summit •2.6K views
[OpenStack Days Korea 2016] Track1 - All flash CEPH 구성 및 최적화[OpenStack Days Korea 2016] Track1 - All flash CEPH 구성 및 최적화
[OpenStack Days Korea 2016] Track1 - All flash CEPH 구성 및 최적화
OpenStack Korea Community•26.9K views
Amazon Elasticache Deep Dive - March 2017 AWS Online Tech TalksAmazon Elasticache Deep Dive - March 2017 AWS Online Tech Talks
Amazon Elasticache Deep Dive - March 2017 AWS Online Tech Talks
Amazon Web Services•2K views
ElastiCache Deep Dive: Best Practices and Usage Patterns - March 2017 AWS Onl...ElastiCache Deep Dive: Best Practices and Usage Patterns - March 2017 AWS Onl...
ElastiCache Deep Dive: Best Practices and Usage Patterns - March 2017 AWS Onl...
Amazon Web Services•8.4K views
Orchestrating Redis & K8s OperatorsOrchestrating Redis & K8s Operators
Orchestrating Redis & K8s Operators
DoiT International•893 views
Docker vs kvmDocker vs kvm
Docker vs kvm
Wilson Cunalata•620 views
SUSE Expert Days Paris 2018 - SUSE HA Cluster Multi-DeviceSUSE Expert Days Paris 2018 - SUSE HA Cluster Multi-Device
SUSE Expert Days Paris 2018 - SUSE HA Cluster Multi-Device
SUSE•404 views
Troubleshooting Redis- DaeMyung Kang, KakaoTroubleshooting Redis- DaeMyung Kang, Kakao
Troubleshooting Redis- DaeMyung Kang, Kakao
Redis Labs•1.2K views
Getting started with Amazon ElastiCacheGetting started with Amazon ElastiCache
Getting started with Amazon ElastiCache
Amazon Web Services•4.8K views
Scylla on Kubernetes: Introducing the Scylla OperatorScylla on Kubernetes: Introducing the Scylla Operator
Scylla on Kubernetes: Introducing the Scylla Operator
ScyllaDB•2.9K views
Choosing A Proxy Server - Apachecon 2014Choosing A Proxy Server - Apachecon 2014
Choosing A Proxy Server - Apachecon 2014
bryan_call•53.5K views
Introduction to Apache KafkaIntroduction to Apache Kafka
Introduction to Apache Kafka
Shiao-An Yuan•1.6K views
VMworld Europe 2014: Virtual SAN Best Practices and Use CasesVMworld Europe 2014: Virtual SAN Best Practices and Use Cases
VMworld Europe 2014: Virtual SAN Best Practices and Use Cases
VMworld•1K views
4Developers 2015: Scaling LAMP doesn't have to suck - Sebastian Grodzicki4Developers 2015: Scaling LAMP doesn't have to suck - Sebastian Grodzicki
4Developers 2015: Scaling LAMP doesn't have to suck - Sebastian Grodzicki
PROIDEA•361 views
Devopsconf2015 sebamontini-151117150231-lva1-app6891Devopsconf2015 sebamontini-151117150231-lva1-app6891
Devopsconf2015 sebamontini-151117150231-lva1-app6891
Flavia Marinelli•197 views
Devopsconf 2015 sebamontiniDevopsconf 2015 sebamontini
Devopsconf 2015 sebamontini
Sebastian Montini•251 views
Oracle RAC Presentation at Oracle Open WorldOracle RAC Presentation at Oracle Open World
Oracle RAC Presentation at Oracle Open World
Paul Marden•1.5K views
Advertisement

More from Redis Labs(20)

Redis Day Bangalore 2020 - Session state caching with redisRedis Day Bangalore 2020 - Session state caching with redis
Redis Day Bangalore 2020 - Session state caching with redis
Redis Labs•2.7K views
Protecting Your API with Redis by Jane Paek - Redis Day Seattle 2020Protecting Your API with Redis by Jane Paek - Redis Day Seattle 2020
Protecting Your API with Redis by Jane Paek - Redis Day Seattle 2020
Redis Labs•846 views
The Happy Marriage of Redis and Protobuf by Scott Haines of Twilio - Redis Da...The Happy Marriage of Redis and Protobuf by Scott Haines of Twilio - Redis Da...
The Happy Marriage of Redis and Protobuf by Scott Haines of Twilio - Redis Da...
Redis Labs•1.6K views
SQL, Redis and Kubernetes by Paul Stanton of Windocks - Redis Day Seattle 2020SQL, Redis and Kubernetes by Paul Stanton of Windocks - Redis Day Seattle 2020
SQL, Redis and Kubernetes by Paul Stanton of Windocks - Redis Day Seattle 2020
Redis Labs•409 views
Rust and Redis - Solving Problems for Kubernetes by Ravi Jagannathan of VMwar...Rust and Redis - Solving Problems for Kubernetes by Ravi Jagannathan of VMwar...
Rust and Redis - Solving Problems for Kubernetes by Ravi Jagannathan of VMwar...
Redis Labs•299 views
Redis for Data Science and Engineering by Dmitry Polyakovsky of OracleRedis for Data Science and Engineering by Dmitry Polyakovsky of Oracle
Redis for Data Science and Engineering by Dmitry Polyakovsky of Oracle
Redis Labs•355 views
Practical Use Cases for ACLs in Redis 6 by Jamie Scott - Redis Day Seattle 2020Practical Use Cases for ACLs in Redis 6 by Jamie Scott - Redis Day Seattle 2020
Practical Use Cases for ACLs in Redis 6 by Jamie Scott - Redis Day Seattle 2020
Redis Labs•273 views
Moving Beyond Cache by Yiftach Shoolman Redis Labs - Redis Day Seattle 2020Moving Beyond Cache by Yiftach Shoolman Redis Labs - Redis Day Seattle 2020
Moving Beyond Cache by Yiftach Shoolman Redis Labs - Redis Day Seattle 2020
Redis Labs•209 views
Leveraging Redis for System Monitoring by Adam McCormick of SBG - Redis Day S...Leveraging Redis for System Monitoring by Adam McCormick of SBG - Redis Day S...
Leveraging Redis for System Monitoring by Adam McCormick of SBG - Redis Day S...
Redis Labs•169 views
JSON in Redis - When to use RedisJSON by Jay Won of Coupang - Redis Day Seatt...JSON in Redis - When to use RedisJSON by Jay Won of Coupang - Redis Day Seatt...
JSON in Redis - When to use RedisJSON by Jay Won of Coupang - Redis Day Seatt...
Redis Labs•286 views
Highly Available Persistent Session Management Service by Mohamed Elmergawi o...Highly Available Persistent Session Management Service by Mohamed Elmergawi o...
Highly Available Persistent Session Management Service by Mohamed Elmergawi o...
Redis Labs•111 views
Anatomy of a Redis Command by Madelyn Olson of Amazon Web Services - Redis Da...Anatomy of a Redis Command by Madelyn Olson of Amazon Web Services - Redis Da...
Anatomy of a Redis Command by Madelyn Olson of Amazon Web Services - Redis Da...
Redis Labs•116 views
Building a Multi-dimensional Analytics Engine with RedisGraph by Matthew Goos...Building a Multi-dimensional Analytics Engine with RedisGraph by Matthew Goos...
Building a Multi-dimensional Analytics Engine with RedisGraph by Matthew Goos...
Redis Labs•101 views
RediSearch 1.6 by Pieter Cailliau - Redis Day Bangalore 2020RediSearch 1.6 by Pieter Cailliau - Redis Day Bangalore 2020
RediSearch 1.6 by Pieter Cailliau - Redis Day Bangalore 2020
Redis Labs•97 views
RedisGraph 2.0 by Pieter Cailliau - Redis Day Bangalore 2020RedisGraph 2.0 by Pieter Cailliau - Redis Day Bangalore 2020
RedisGraph 2.0 by Pieter Cailliau - Redis Day Bangalore 2020
Redis Labs•78 views
RedisTimeSeries 1.2 by Pieter Cailliau - Redis Day Bangalore 2020RedisTimeSeries 1.2 by Pieter Cailliau - Redis Day Bangalore 2020
RedisTimeSeries 1.2 by Pieter Cailliau - Redis Day Bangalore 2020
Redis Labs•72 views
RedisAI 0.9 by Sherin Thomas of Tensorwerk - Redis Day Bangalore 2020RedisAI 0.9 by Sherin Thomas of Tensorwerk - Redis Day Bangalore 2020
RedisAI 0.9 by Sherin Thomas of Tensorwerk - Redis Day Bangalore 2020
Redis Labs•301 views
Rate-Limiting 30 Million requests by Vijay Lakshminarayanan and Girish Koundi...Rate-Limiting 30 Million requests by Vijay Lakshminarayanan and Girish Koundi...
Rate-Limiting 30 Million requests by Vijay Lakshminarayanan and Girish Koundi...
Redis Labs•384 views
Three Pillars of Observability by Rajalakshmi Raji Srinivasan of Site24x7 Zoh...Three Pillars of Observability by Rajalakshmi Raji Srinivasan of Site24x7 Zoh...
Three Pillars of Observability by Rajalakshmi Raji Srinivasan of Site24x7 Zoh...
Redis Labs•83 views
Solving Complex Scaling Problems by Prashant Kumar and Abhishek Jain of Myntr...Solving Complex Scaling Problems by Prashant Kumar and Abhishek Jain of Myntr...
Solving Complex Scaling Problems by Prashant Kumar and Abhishek Jain of Myntr...
Redis Labs•105 views

Recently uploaded(20)

在哪里可以办美国大学文凭《夏威夷太平洋大学毕业证成绩单仿制》在哪里可以办美国大学文凭《夏威夷太平洋大学毕业证成绩单仿制》
在哪里可以办美国大学文凭《夏威夷太平洋大学毕业证成绩单仿制》
efagvah•0 views
Responsive Web Design Crafting Websites for the Multi-Device World (2).pdfResponsive Web Design Crafting Websites for the Multi-Device World (2).pdf
Responsive Web Design Crafting Websites for the Multi-Device World (2).pdf
iSQUARE Business Solution•0 views
GD Water Consult.pdfGD Water Consult.pdf
GD Water Consult.pdf
AmitMehta214•0 views
KMM - Kanban Maturity ModelKMM - Kanban Maturity Model
KMM - Kanban Maturity Model
Adail Viana Neto•0 views
在哪里可以办新西兰大学文凭《曼努考理工学院毕业证成绩单仿制》在哪里可以办新西兰大学文凭《曼努考理工学院毕业证成绩单仿制》
在哪里可以办新西兰大学文凭《曼努考理工学院毕业证成绩单仿制》
efagvah•0 views
Justifikasi Badspot After_Kota Palembang.pptxJustifikasi Badspot After_Kota Palembang.pptx
Justifikasi Badspot After_Kota Palembang.pptx
Arwan Priatna•0 views
DIGITAL SUPPLY CHAIN WITH BLOCKCHAINDIGITAL SUPPLY CHAIN WITH BLOCKCHAIN
DIGITAL SUPPLY CHAIN WITH BLOCKCHAIN
ABOORVAponnan•0 views
Chapter_11-Heragu.pptxChapter_11-Heragu.pptx
Chapter_11-Heragu.pptx
Madan Karki•0 views
Exploratory Data Analysis - A Comprehensive Guide to EDA.pdfExploratory Data Analysis - A Comprehensive Guide to EDA.pdf
Exploratory Data Analysis - A Comprehensive Guide to EDA.pdf
StephenAmell4•0 views
EPAK_EANT_Präsentation (EN).pdfEPAK_EANT_Präsentation (EN).pdf
EPAK_EANT_Präsentation (EN).pdf
Simone Agresti•0 views
Exploratory Data Analysis - A Comprehensive Guide to EDA.pdfExploratory Data Analysis - A Comprehensive Guide to EDA.pdf
Exploratory Data Analysis - A Comprehensive Guide to EDA.pdf
JamieDornan2•0 views
2023 Global Privacy Benchmarks Survey - Webinar May 30 2023.pdf2023 Global Privacy Benchmarks Survey - Webinar May 30 2023.pdf
2023 Global Privacy Benchmarks Survey - Webinar May 30 2023.pdf
TrustArc•0 views
ARTIFICIAL intelligence pptARTIFICIAL intelligence ppt
ARTIFICIAL intelligence ppt
GTGAMING11•0 views
AI Intro.pptxAI Intro.pptx
AI Intro.pptx
DSCYorkU•0 views
CS504 Updated Handouts.pdfCS504 Updated Handouts.pdf
CS504 Updated Handouts.pdf
MuhammadWaseem853949•0 views
ChatGPT_Prompts.pptxChatGPT_Prompts.pptx
ChatGPT_Prompts.pptx
Chakrit Phain•0 views
Hybrid Mobile App Development Frameworks.pdfHybrid Mobile App Development Frameworks.pdf
Hybrid Mobile App Development Frameworks.pdf
TarunTiwari94•0 views
BIS Research conducted a webinar on Carbon Neutral Data Center PracticesBIS Research conducted a webinar on Carbon Neutral Data Center Practices
BIS Research conducted a webinar on Carbon Neutral Data Center Practices
BIS Research Inc.•0 views
Into The Box 2023 Keynote day 2Into The Box 2023 Keynote day 2
Into The Box 2023 Keynote day 2
Ortus Solutions, Corp•0 views
Into The Box 2023 Keynote Day 1Into The Box 2023 Keynote Day 1
Into The Box 2023 Keynote Day 1
Ortus Solutions, Corp•0 views
Advertisement

RedisConf17 - Redis Cluster at flickr and tripod

  1. @ flickr & tripod Presented by Sean Perkins Sr. Production Engineer
  2. flickr & tripod 100+ physical hosts 500+ instances 600k Ops/s
  3. Use Cases for Redis
  4. Cameraroll 24 hosts (12 on each coast) 4 masters per host cache twemproxy client ketama hash ring
  5. Activityfeed 8 hosts 8 masters per host cache twemproxy client ketama hash ring
  6. Notifications 3 Hosts 1 Master 2 Slaves Clients on both coasts Redis only in one
  7. And many many more… 45 redis-general hosts w/ ~200 instances about 50% have HA
  8. Why Redis
  9. Redis Cluster Manual builds at first created package to automate setup tested failed nodes benchmarking
  10. redis-cluster101 redis-cluster102 redis-cluster103 196GB RAM each 8 master instances x 3 hosts = 24 16 slave instances x 3 hosts = 48 tripod
  11. Console (tripod on boarding site) Java Spring Client Cache Smart Client
  12. redis-cluster101 redis-cluster102 redis-cluster103 64GB RAM each 4 master instances x 3 hosts = 12 8 slave instances x 3 hosts = 24 flickr
  13. Activitybot Kue Library and Nodejs Queue Smart Client
  14. Questions?

Editor's Notes

  1. https://www.flickr.com/photos/64863289@N03/16463233379
  2. https://www.flickr.com/photos/cheesy42/5945217559
Advertisement