Scaling Redis To 1M Ops/Sec: Jane Paek
•
3 likes•811 views
This document summarizes scaling Redis to 1 million operations per second. It discusses clustering and sharding options like partitioning the data across multiple Redis servers. It also covers patterns and anti-patterns when scaling, like using pipelines and avoiding running slow keys operations. Benchmarking tools like memtier-benchmark and redis-benchmark are presented. A demo is included and resources like documentation, modules, and training from Redis Labs are provided.
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Scaling Redis To 1M Ops/Sec: Jane Paek
Similar to Scaling Redis To 1M Ops/Sec: Jane Paek (20)
More from Redis Labs
More from Redis Labs (20)
Recently uploaded
Recently uploaded (20)
Scaling Redis To 1M Ops/Sec: Jane Paek
- 1. PRESENTED BY Scaling Redis to 1M Ops/Sec Presenter: Jane Paek Redis Labs, Solution Architect Manager jane@redislabs.com
- 2. PRESENTED BY 1 A Shard by Any Other Name? 2 Clustering / Partitioning Options 3 Patterns and Anti-Patterns to Scaling Agenda: 2 Demo 3 Resources 3 Tools Available for Benchmarking
- 3. PRESENTED BY What to Expect from a Single Redis Server Process 1 redis instance = 1 redis-server process = shard Hostname : port Localhost: 6379 Lists Hashes Bitmaps Strings Bit field Streams Hyperloglog Sorted Sets Sets Geospatial Indexes
- 4. strings, ttl lists, sets, pub/sub streams search ML + Graph Relationships Graph RAM + Flash + Disk Client Location / Proximity Geo Intelligent Session Management Hash, Sets API Rate Limiting Hash User SessionsHashes, Sets Where Can You Place Redis? Pub/Sub Messaging Pub/Sub JSON Storage JSON medium.com
- 5. PRESENTED BY Scaling Redis via Database Clustering • Use multiple shards to create a logical redis database Node 1 0-4K Node 2 4K-8K Node 3 8K – 12K Node 4 12k - 16K Logically Clustered Redis Database ?????
- 6. PRESENTED BY Scaling Redis – Client Side Sharding - Range Partitioning • Map ranges of objects into specific Redis instances Node 1 Keys: a-g Node 2 Keys: h-o Node 3 Keys: p-t Node 4 Keys: u-z Logically Clustered Redis Database “Get a” Which shard holds a? node 1 Connect to node 1 for key a
- 7. PRESENTED BY Scaling Redis - Client Side Sharding - Hash with Query Routing • Redis Cluster API - Hash Keys via CRC16 mod # shards Logically Clustered Redis Database “Get a” What is the hash slot for a? 15495 Which shard holds the slot? 4 Connect to node 4 for key a Node 1 0-4K Node 2 4K-8K Node 3 8K – 12K Node 4 12k - 16K
- 8. PRESENTED BY Scaling Redis via Proxy-Side Sharding • Clients connect to the Proxy • Proxy handles the connection to the redis shards • Single host and port (from the client view) Node 1 0-4K Node 2 4K-8K Node 3 8K – 12K Node 4 12k - 16K Logically Clustered Redis Database Proxy ( translates keys to slots to shards)
- 9. PRESENTED BY Enterprise Cluster Example of Multitenant Redis Deployment Node 1 Node 2 Node 3 Database 1 Proxy R1M1 M2R2 Database 2 M1 Database 3 R1M1 Proxy
- 10. PRESENTED BY Patterns and Anti-Patterns to Scaling • Do Use Pipelines Use Unlink vs DEL Use Connection Pooling Aim for small value sizes <10kb Understand time complexity O(1) vs O(log(N)) vs O(N) Shard using hash tags {keeptogether} Monitor Slow Logs • Be careful of.. Running keys * in prod Sorted set queries Persistence (rdb and AoF) Caching keys without TTL • Helps to avoid eviction
- 11. PRESENTED BY Tools for Benchmarking – memtier-benchmark (Get/Set) • Memtier-benchmark (Create by Redis Labs) https://github.com/RedisLabs/memtier_benchmark • Test Parameters and Options: -d, -data-size=SIZE Object data size (default: 32) -n, --requests=NUMBER Number of total requests per client (default: 10000) -c, --clients=NUMBER Number of clients per thread (default: 50) -t, --threads=NUMBER Number of threads (default: 4) --test-time=SECS Number of seconds to run the test --ratio=RATIO Set:Get ratio (default: 1:10) --pipeline=NUMBER Number of concurrent pipelined requests (default: 1)
- 12. PRESENTED BY Tools for Benchmarking – redis-benchmark (Part of redis distribution) • Tests for PING, SET, GET, INCR, LISTS, HASH, MSET • Can specify the command to benchmark • Test Parameters and Options -h <hostname> Server hostname (default 127.0.0.1) -p <port> Server port (default 6379) -a <password> Password for Redis Auth -c <clients> Number of parallel connections (default 50) -n <requests> Total number of requests (default 100000) -d <size> Data size of SET/GET value in bytes (default 2) -P <numreq> Pipeline <numreq> requests. Default 1 (no pipeline) -t <tests> Only run the comma separated list of tests.
- 13. PRESENTED BY Examples for redis-benchmark $ redis-benchmark -h 127.0.0.1 –p 6379 $ redis-benchmark -t set,lpush -n 100000 -q $ redis-benchmark -n 100000 -q script load "redis.call('set','foo','bar')" Coming Soon $ redis-benchmark --cluster -p 7000 $ redis-benchmark -p 7000 --threads 6 --cluster # If the cluster has three masters, use two threads per master node •
- 15. PRESENTED BY Home of Redis Labs https://redislabs.com/get-started Redis References https://redis.io Redis Modules https://redislabs.com/community/redis-modules-hub Redis Clients https://redis.io/clients Redis Downloads https://redis.io/download Redis University https://university.redislabs.com New Classes April 16, 2019 Introduction to Redis Data Structures 101 Redis for Java Developers RediSearch Redis Streams Redis Resources : Jane Paek - jane@redislabs.com
- 16. PRESENTED BY Thank You Jane Paek jane@redislabs.com https://redislabs.com
- 17. Thank you!