ElastiCache: Deep Dive Best Practices and Usage Patterns - AWS Online Tech Talks
•
3 likes•1,451 views
This document provides an overview of Amazon ElastiCache and discusses best practices and usage patterns. It describes how ElastiCache provides fully managed, in-memory caching for internet-scale applications using Redis or Memcached. Examples of common usage patterns are discussed, such as caching, real-time analytics, gaming leaderboards, and geospatial applications. Customer examples from BBC and Expedia are also presented that discuss how they leverage ElastiCache.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to ElastiCache: Deep Dive Best Practices and Usage Patterns - AWS Online Tech Talks
Similar to ElastiCache: Deep Dive Best Practices and Usage Patterns - AWS Online Tech Talks (20)
More from Amazon Web Services
More from Amazon Web Services (20)
ElastiCache: Deep Dive Best Practices and Usage Patterns - AWS Online Tech Talks
- 1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Gaurav Kumar, Sr Product Manager April 23, 2018 Amazon ElastiCache: Deep Dive Best Practices and Usage Patterns
- 2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Why ElastiCache? ElastiCacheOverview ElastiCacheCapabilities ElastiCache Redis ElastiCache Memcached Common Usage Patterns Customer Examples Agenda
- 3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Internet-scale Apps Need Low Latency and High Concurrency Users 1M+ Data volume TB-PB-EB Locality Global Performance Milliseconds -Microseconds Request Rate Millions Access Mobile, IoT, Devices Scale Up-Out-In Economics Pay as you go Developer access Instant API access Gaming leaderboards Financial trading Social media Ride hailing Media streaming Dating Session stores
- 4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Introducing Amazon ElastiCache Fully-managed, Redis or Memcached compatible, low-latency, in-memory data store Fully Managed Extreme Performance Easily Scalable AWS manages all hardware and software setup, configuration, monitoring In-memory data store and cache for sub-millisecond response times Read scaling with replicas. Write and memory scaling with sharding. Non disruptive scaling
- 5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Key Features Amazon ElastiCache for Redis
- 6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ElastiCache Redis Fully Managed & Hardened Secure & Compliant Fast in-memory data store in the cloud. Use as a database, cache, message broker, queue VPC for cluster isolation, encryption at rest/transit, HIPAA compliance Highly Available & Reliable Read replicas, multiple primaries, multi-AZ with automatic failover Easily Scalable Cluster with up to 6.1 TiB of in-memory data Read scaling with replicas Write and memory scaling with sharding Scale out or in #1 Key-Value Store* Fast in-memory data store in the cloud. Use as a database, cache, message broker, queue *: https://db-engines.com/en/ranking
- 7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Redis—#1 Key-Value Data Store* Fast <1ms latency for most commands Open source Simple Highly available Replication Atomic operations Supports transactions In-memory key-value store Powerful ~200 commands, Lua scripting, Geospatial, Pub/Sub Various data structures Strings, lists, hashes, sets, sorted sets, bitmaps, and HyperLogLogs *: https://db-engines.com/en/ranking
- 8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Fully Managed & Hardened Dynamic write throttling AWS manages all hardware and software setup, configuration, patching Detailed monitoring metrics, CloudWatch integration Smooth failovers Optimized swap memory
- 9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Secure & Compliant • VPC • Isolate cluster to chosen IP range • Encryption • In-Transit: Encrypt all communications between clients, server, nodes • At-Rest: Encrypt backups on disk and in Amazon S3 • Support for Redis AUTH • Fully managed: Setup via API, CLI or console, automatic certificate issuance, renewal • Compliance • HIPAA Eligibility for ElastiCache Redis 3.2.6 R R R Availability Zone A Availability Zone B Availability Zone C Private Subnet Private Subnet Private Subnet Security Group Security Group Security Group Security Group Security Group Security Group Public Subnet Public Subnet Public Subnet Encryption at REST Amazon S3 Bucket Encryption In-Transit Redis AUTH Redis RDB Snapshot R: Redis Cluster
- 10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Highly Available & Reliable • Read replicas for read availability • Multi-AZ with auto failover • Automatic failure detection and replica promotion • Repair failed nodes • Redis cluster sharding • Faster failover • Availability due to partitioning Availability Zone B Availability Zone C Redis Cluster Availability Zone A P R Slots 0–5454 Slots10910–16363 R Slots 5455–10909 R R Slots 0–5454 Slots10910–16363 P Slots 5455–10909 R P Slots 0–5454 Slots10910–16363 R Slots 5455–10909 Shards, primaries, and read replicas Exaple: 3 shard cluster, 2 read replicas P: Primary R: Replica S: Shard S S S
- 11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Easily Scalable with Redis Cluster Mode • Scale memory and compute • Scale up to a cluster of 6.1 TiB of in-memory data • A cluster consists of 1 to 15 shards • Each shard has a primary node and up to 5 replica nodes across multiple AZs for read scaling • Increase writes by adding shards Availability Zone B Availability Zone C Redis Cluster Availability Zone A P R Slots 0–5454 Slots10910–16363 R Slots 5455–10909 R R Slots 0–5454 Slots10910–16363 P Slots 5455–10909 R P Slots 0–5454 Slots10910–16363 R Slots 5455–10909 Shards, primaries, and read replicas Exaple: 3 shard cluster, 2 read replicas P: Primary R: Replica S: Shard S S S
- 12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Online Cluster Resizing—Zero Downtime • Add or remove shards to scale out/in • Zero downtime—cluster continues to serve read/write requests • No client side changes or app rewrites • Scale up to 6.1TB of in-memory capacity P Shard 1 P Shard 2 P Shard 3 0–5461 5462–10922 10923–16383 Simple API AWS elasticache modify-remplication-group-shard-configuration – replication-group-id re-group-id --apply-immediately – node-groupd-count 5 P: Primary
- 13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Online Custer Resizing—Zero Downtime Scale Out P Shard 1 P Shard 2 P Shard 3 0–5461 5462–10922 10923–16383 Amazon EC2 No Application Interruption P Shard 4 2910–5094, 9831––10922 P Shard 5 5784–6875, 14200–16383 Reads/Writes Added Added Unified slot distribution across shards 0–2909, 5095–5461 5462–5783, 6876–9830 10923–14199 P: Primary
- 14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Online Custer Resizing—Zero Downtime Scale In P Shard 1 P Shard 2 P Shard 3 0–5461 5462–10922 10923–16383 Amazon EC2 No Application Interruption P Shard 4 2910–5094, 9831––10922 P Shard 5 5784–6875, 14200–16383 Reads/Writes Removed Removed Unified slot distribution across shards 0–2909, 5095–5461 5462–5783, 6876–9830 10923–14199 P: Primary
- 15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon ElastiCache for Memcached Key Features
- 16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ElastiCache Memcached Secure & Hardened Fully Managed Memcached Easily Scalable VPC for cluster isolationFast in-memory data store in the cloud. Use as a cache to reduce latency and improve throughput Sharding to scale in-memory cache with up to 20 nodes and 8.14 TiB per cluster $
- 17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Memcached—Fast Caching Fast Open source No persistence Very established Easy to scale In-memory key-value datastore Slab allocator Supports strings, objects Multi-threaded
- 18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Common Usage PatternsAmazon ElastiCache
- 19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Usage Patterns Gaming leaderboards Chat apps PubSub Caching Session store Machine Learning Real-time model scoring Real-time Analytics store Media streaming store Job queue Geospatial
- 20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Caching
- 21. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Real-time Analytics Store
- 22. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Gaming—Real-time Leaderboards
- 23. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Geospatial
- 24. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Media Streaming Store
- 25. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Session Store
- 26. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Chat Apps
- 27. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Job Queue
- 28. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Machine Learning (Real-time Model Scoring)
- 29. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Customers Amazon ElastiCache
- 30. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. BBC’s Nanoservices Architecture with ElastiCache BBC is using the nanoservices pattern to design for serverless, and to maximise the potential of continuous delivery, reusability, and flexibility. BBC uses ElastiCache Redis to power the nanoservices architecture. ElastiCache Redis is used to achieve sub-millisecond responses, not just in caching content, but as a control (metadata store) and communication (queue) layer. The BBC has over 1,000 nanoservices in production. Together, they create a range of dynamic web pages, and also APIs for mobile and TV apps. [BBC’s nanoservices architecture] is built on an AWS-hosted platform that makes extensive use of Amazon ElastiCache.” – Matthew Clark Head of Architecture, BBC “ Content cache Metadata store Queue Developer Architecture R R RNanoservice Store User Data (APIs, etc.) Nanoservice platform
- 31. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Expedia’s Real-time Analytics with ElastiCache Expedia is a leader in the $1 trillion travel industry, with an extensive portfolio that includes some of the world’s most trusted travel brands. Expedia’s real-time analytics application collects data for its “test & learn” experiments on Expedia sites. The analytics application processes ~200 million messages daily. With ElastiCache Redis as caching layer, the write throughput on DynamoDB has been set to 3500, down from 35000, reducing the cost by 6x.” – Kuldeep Chowhan Engineering Manager, Expedia “ Kenesis Firehose Real-time streams of lodging mark data EC2 Redshift Aurora S3 Ingest multiple data streams Join/ compare events ElastiCache (Redis) Reference data on-premises Historical queries on up to 2 years of data Staging near real- time data Operational queries of real-time data
- 32. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Customers
- 33. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ThankYou! https://aws.amazon.com/elasticache/ Amazon ElastiCache
Editor's Notes
- Amazon ElastiCache is a web service that makes it easy to deploy, operate, and scale an in-memory data store and cache in the cloud. The service improves the performance of web applications by allowing you to retrieve information from fast, managed, in-memory data stores, instead of relying entirely on slower disk-based databases. Amazon ElastiCache supports two open-source in-memory engines: Redis - a fast, open source, in-memory data store and cache. Amazon ElastiCache for Redis is a Redis-compatible in-memory service that delivers the ease-of-use and power of Redis along with the availability, reliability and performance suitable for the most demanding applications. Both single-node and up to 15-shard clusters are available, enabling scalability to up to 6.1 TiB of in-memory data. ElastiCache for Redis is fully managed, scalable, and secure - making it an ideal candidate to power high-performance use cases such as Web, Mobile Apps, Gaming, Ad-Tech, and IoT. Memcached - a widely adopted memory object caching system. ElastiCache is protocol compliant with Memcached, so popular tools that you use today with existing Memcached environments will work seamlessly with the service. Extreme Performance Amazon ElastiCache works as an in-memory data store and cache to support the most demanding applications requiring sub-millisecond response times. By utilizing an end-to-end optimized stack running on customer dedicated nodes, Amazon Elasticache provides you secure, blazing fast performance. Secure and Hardened Amazon ElastiCache supports Amazon VPC, enabling you to isolate your cluster to the IP ranges you choose for your nodes, and use them to connect to your application. ElastiCache continuously monitors your nodes and applies the necessary patches to keep your environment secure. Redis and Memcached Compatible With Amazon ElastiCache, you get native access to Redis or Memcached in-memory environments. This enables compatibility with your existing tools and applications.
- Amazon ElastiCache is a web service that makes it easy to deploy, operate, and scale an in-memory data store or cache in the cloud. The service improves the performance of web applications by allowing you to retrieve information from fast, managed, in-memory data stores, instead of relying entirely on slower disk-based databases. Amazon ElastiCache supports two open-source in-memory engines: Redis - a fast, open source, in-memory data store and cache. Amazon ElastiCache for Redis is a Redis-compatible in-memory service that delivers the ease-of-use and power of Redis along with the availability, reliability and performance suitable for the most demanding applications. Both single-node and up to 15-shard clusters are available, enabling scalability to up to 3.55 TiB of in-memory data. ElastiCache for Redis is fully managed, scalable, and secure - making it an ideal candidate to power high-performance use cases such as Web, Mobile Apps, Gaming, Ad-Tech, and IoT. Memcached - a widely adopted memory object caching system. ElastiCache is protocol compliant with Memcached, so popular tools that you use today with existing Memcached environments will work seamlessly with the service. Extreme Performance Amazon ElastiCache works as an in-memory data store and cache to support the most demanding applications requiring sub-millisecond response times. By utilizing an end-to-end optimized stack running on customer dedicated nodes, Amazon Elasticache provides you secure, blazing fast performance. Secure and Hardened Amazon ElastiCache supports Amazon VPC, enabling you to isolate your cluster to the IP ranges you choose for your nodes, and use them to connect to your application. ElastiCache continuously monitors your nodes and applies the necessary patches to keep your environment secure. Redis and Memcached Compatible With Amazon ElastiCache, you get native access to Redis or Memcached in-memory environments. This enables compatibility with your existing tools and applications.
- https://www.youtube.com/watch?v=ie4dWGT76LM