Submit Search
Upload
Redis as database - HashedIn
•
1 like
•
288 views
H
HashedIn Technologies
Follow
Redis as a Database
Read less
Read more
Technology
Report
Share
Report
Share
1 of 14
Download now
Download to read offline
Recommended
Redis memory optimization sripathi, CTO hashedin
Redis memory optimization sripathi, CTO hashedin
HashedIn Technologies
Redis Modules - Redis India Tour - 2017
Redis Modules - Redis India Tour - 2017
HashedIn Technologies
Redis Use Cases - Performance & Scalability
Redis Use Cases - Performance & Scalability
HashedIn Technologies
Indexing with solr search server and hadoop framework
Indexing with solr search server and hadoop framework
keval dalasaniya
Proven Low-Cost Database for Your Business
Proven Low-Cost Database for Your Business
Embarcadero Technologies
Red Hat Storage Day Atlanta - Red Hat Gluster Storage vs. Traditional Storage...
Red Hat Storage Day Atlanta - Red Hat Gluster Storage vs. Traditional Storage...
Red_Hat_Storage
Scalable and High available Distributed File System Metadata Service Using gR...
Scalable and High available Distributed File System Metadata Service Using gR...
Alluxio, Inc.
HBaseCon 2012 | Content Addressable Storages for Fun and Profit - Berk Demir,...
HBaseCon 2012 | Content Addressable Storages for Fun and Profit - Berk Demir,...
Cloudera, Inc.
Recommended
Redis memory optimization sripathi, CTO hashedin
Redis memory optimization sripathi, CTO hashedin
HashedIn Technologies
Redis Modules - Redis India Tour - 2017
Redis Modules - Redis India Tour - 2017
HashedIn Technologies
Redis Use Cases - Performance & Scalability
Redis Use Cases - Performance & Scalability
HashedIn Technologies
Indexing with solr search server and hadoop framework
Indexing with solr search server and hadoop framework
keval dalasaniya
Proven Low-Cost Database for Your Business
Proven Low-Cost Database for Your Business
Embarcadero Technologies
Red Hat Storage Day Atlanta - Red Hat Gluster Storage vs. Traditional Storage...
Red Hat Storage Day Atlanta - Red Hat Gluster Storage vs. Traditional Storage...
Red_Hat_Storage
Scalable and High available Distributed File System Metadata Service Using gR...
Scalable and High available Distributed File System Metadata Service Using gR...
Alluxio, Inc.
HBaseCon 2012 | Content Addressable Storages for Fun and Profit - Berk Demir,...
HBaseCon 2012 | Content Addressable Storages for Fun and Profit - Berk Demir,...
Cloudera, Inc.
Pillars of Heterogeneous HDFS Storage
Pillars of Heterogeneous HDFS Storage
Pete Kisich
Achieving Separation of Compute and Storage in a Cloud World
Achieving Separation of Compute and Storage in a Cloud World
Alluxio, Inc.
Realtime Analytical Query Processing and Predictive Model Building on High Di...
Realtime Analytical Query Processing and Predictive Model Building on High Di...
Spark Summit
Apache Druid®: A Dance of Distributed Processes
Apache Druid®: A Dance of Distributed Processes
Imply
Dremio introduction
Dremio introduction
Alexis Gendronneau
Seagate Implementation of Dense Storage Utilizing HDDs and SSDs
Seagate Implementation of Dense Storage Utilizing HDDs and SSDs
Red_Hat_Storage
Introduction to Big Data and Hadoop
Introduction to Big Data and Hadoop
SSandip Patil
Real-Time Analytics in Transactional Applications by Brian Bulkowski
Real-Time Analytics in Transactional Applications by Brian Bulkowski
Data Con LA
Aerospike: The Enterprise Class NoSQL Database for Real-Time Applications
Aerospike: The Enterprise Class NoSQL Database for Real-Time Applications
Brillix
DataLogix Hadoop Solution
DataLogix Hadoop Solution
DataLogix B.V.
Capacity Planning For Your Growing MongoDB Cluster
Capacity Planning For Your Growing MongoDB Cluster
MongoDB
Data Protection in Hybrid Enterprise Data Lake Environment
Data Protection in Hybrid Enterprise Data Lake Environment
DataWorks Summit
Hedvig & ClusterHQ - Persistent, portable storage for Docker
Hedvig & ClusterHQ - Persistent, portable storage for Docker
Eric Carter
ImpalaToGo design explained
ImpalaToGo design explained
David Groozman
Map reduce & HDFS with Hadoop
Map reduce & HDFS with Hadoop
Diego Pacheco
Implementation of Dense Storage Utilizing HDDs with SSDs and PCIe Flash Acc...
Implementation of Dense Storage Utilizing HDDs with SSDs and PCIe Flash Acc...
Red_Hat_Storage
2017 DB Trends for Powering Real-Time Systems of Engagement
2017 DB Trends for Powering Real-Time Systems of Engagement
Aerospike, Inc.
Optimizing Latency-Sensitive Queries for Presto at Facebook: A Collaboration ...
Optimizing Latency-Sensitive Queries for Presto at Facebook: A Collaboration ...
Alluxio, Inc.
Aziksa hadoop architecture santosh jha
Aziksa hadoop architecture santosh jha
Data Con LA
Simple server side cache for Express.js with Node.js
Simple server side cache for Express.js with Node.js
Gokusen Newz
Aem asset optimizations & best practices
Aem asset optimizations & best practices
Kanika Gera
Redis meetup
Redis meetup
Nikhil Dole
More Related Content
What's hot
Pillars of Heterogeneous HDFS Storage
Pillars of Heterogeneous HDFS Storage
Pete Kisich
Achieving Separation of Compute and Storage in a Cloud World
Achieving Separation of Compute and Storage in a Cloud World
Alluxio, Inc.
Realtime Analytical Query Processing and Predictive Model Building on High Di...
Realtime Analytical Query Processing and Predictive Model Building on High Di...
Spark Summit
Apache Druid®: A Dance of Distributed Processes
Apache Druid®: A Dance of Distributed Processes
Imply
Dremio introduction
Dremio introduction
Alexis Gendronneau
Seagate Implementation of Dense Storage Utilizing HDDs and SSDs
Seagate Implementation of Dense Storage Utilizing HDDs and SSDs
Red_Hat_Storage
Introduction to Big Data and Hadoop
Introduction to Big Data and Hadoop
SSandip Patil
Real-Time Analytics in Transactional Applications by Brian Bulkowski
Real-Time Analytics in Transactional Applications by Brian Bulkowski
Data Con LA
Aerospike: The Enterprise Class NoSQL Database for Real-Time Applications
Aerospike: The Enterprise Class NoSQL Database for Real-Time Applications
Brillix
DataLogix Hadoop Solution
DataLogix Hadoop Solution
DataLogix B.V.
Capacity Planning For Your Growing MongoDB Cluster
Capacity Planning For Your Growing MongoDB Cluster
MongoDB
Data Protection in Hybrid Enterprise Data Lake Environment
Data Protection in Hybrid Enterprise Data Lake Environment
DataWorks Summit
Hedvig & ClusterHQ - Persistent, portable storage for Docker
Hedvig & ClusterHQ - Persistent, portable storage for Docker
Eric Carter
ImpalaToGo design explained
ImpalaToGo design explained
David Groozman
Map reduce & HDFS with Hadoop
Map reduce & HDFS with Hadoop
Diego Pacheco
Implementation of Dense Storage Utilizing HDDs with SSDs and PCIe Flash Acc...
Implementation of Dense Storage Utilizing HDDs with SSDs and PCIe Flash Acc...
Red_Hat_Storage
2017 DB Trends for Powering Real-Time Systems of Engagement
2017 DB Trends for Powering Real-Time Systems of Engagement
Aerospike, Inc.
Optimizing Latency-Sensitive Queries for Presto at Facebook: A Collaboration ...
Optimizing Latency-Sensitive Queries for Presto at Facebook: A Collaboration ...
Alluxio, Inc.
Aziksa hadoop architecture santosh jha
Aziksa hadoop architecture santosh jha
Data Con LA
Simple server side cache for Express.js with Node.js
Simple server side cache for Express.js with Node.js
Gokusen Newz
What's hot
(20)
Pillars of Heterogeneous HDFS Storage
Pillars of Heterogeneous HDFS Storage
Achieving Separation of Compute and Storage in a Cloud World
Achieving Separation of Compute and Storage in a Cloud World
Realtime Analytical Query Processing and Predictive Model Building on High Di...
Realtime Analytical Query Processing and Predictive Model Building on High Di...
Apache Druid®: A Dance of Distributed Processes
Apache Druid®: A Dance of Distributed Processes
Dremio introduction
Dremio introduction
Seagate Implementation of Dense Storage Utilizing HDDs and SSDs
Seagate Implementation of Dense Storage Utilizing HDDs and SSDs
Introduction to Big Data and Hadoop
Introduction to Big Data and Hadoop
Real-Time Analytics in Transactional Applications by Brian Bulkowski
Real-Time Analytics in Transactional Applications by Brian Bulkowski
Aerospike: The Enterprise Class NoSQL Database for Real-Time Applications
Aerospike: The Enterprise Class NoSQL Database for Real-Time Applications
DataLogix Hadoop Solution
DataLogix Hadoop Solution
Capacity Planning For Your Growing MongoDB Cluster
Capacity Planning For Your Growing MongoDB Cluster
Data Protection in Hybrid Enterprise Data Lake Environment
Data Protection in Hybrid Enterprise Data Lake Environment
Hedvig & ClusterHQ - Persistent, portable storage for Docker
Hedvig & ClusterHQ - Persistent, portable storage for Docker
ImpalaToGo design explained
ImpalaToGo design explained
Map reduce & HDFS with Hadoop
Map reduce & HDFS with Hadoop
Implementation of Dense Storage Utilizing HDDs with SSDs and PCIe Flash Acc...
Implementation of Dense Storage Utilizing HDDs with SSDs and PCIe Flash Acc...
2017 DB Trends for Powering Real-Time Systems of Engagement
2017 DB Trends for Powering Real-Time Systems of Engagement
Optimizing Latency-Sensitive Queries for Presto at Facebook: A Collaboration ...
Optimizing Latency-Sensitive Queries for Presto at Facebook: A Collaboration ...
Aziksa hadoop architecture santosh jha
Aziksa hadoop architecture santosh jha
Simple server side cache for Express.js with Node.js
Simple server side cache for Express.js with Node.js
Similar to Redis as database - HashedIn
Aem asset optimizations & best practices
Aem asset optimizations & best practices
Kanika Gera
Redis meetup
Redis meetup
Nikhil Dole
Apache hadoop basics
Apache hadoop basics
saili mane
Application architectures with hadoop – big data techcon 2014
Application architectures with hadoop – big data techcon 2014
Jonathan Seidman
Application architectures with Hadoop – Big Data TechCon 2014
Application architectures with Hadoop – Big Data TechCon 2014
hadooparchbook
Session 01 - Into to Hadoop
Session 01 - Into to Hadoop
AnandMHadoop
EN - Azure - Cache for Redis.pdf
EN - Azure - Cache for Redis.pdf
ArnaudMorvillier1
Hadoop - HDFS
Hadoop - HDFS
KavyaGo
Hadoop
Hadoop
ronit gaikwad
Using Apache Arrow, Calcite, and Parquet to Build a Relational Cache
Using Apache Arrow, Calcite, and Parquet to Build a Relational Cache
Dremio Corporation
Make a Move to AWS Now
Make a Move to AWS Now
Buurst
Introduction to Redis
Introduction to Redis
Arnab Mitra
Application Architectures with Hadoop - Big Data TechCon SF 2014
Application Architectures with Hadoop - Big Data TechCon SF 2014
hadooparchbook
VM-aware Adaptive Storage Cache Prefetching
VM-aware Adaptive Storage Cache Prefetching
Shinagawa Laboratory, The University of Tokyo
Ceph as software define storage
Ceph as software define storage
Mahmoud Shiri Varamini
Chapter2.pdf
Chapter2.pdf
WasyihunSema2
Demystifying bigdata ashish1
Demystifying bigdata ashish1
Ashish singh
Why MySQL High Availability Matters
Why MySQL High Availability Matters
Matt Lord
Big Data and Cloud Computing
Big Data and Cloud Computing
Farzad Nozarian
Redis vs Memcached
Redis vs Memcached
Gaurav Agrawal
Similar to Redis as database - HashedIn
(20)
Aem asset optimizations & best practices
Aem asset optimizations & best practices
Redis meetup
Redis meetup
Apache hadoop basics
Apache hadoop basics
Application architectures with hadoop – big data techcon 2014
Application architectures with hadoop – big data techcon 2014
Application architectures with Hadoop – Big Data TechCon 2014
Application architectures with Hadoop – Big Data TechCon 2014
Session 01 - Into to Hadoop
Session 01 - Into to Hadoop
EN - Azure - Cache for Redis.pdf
EN - Azure - Cache for Redis.pdf
Hadoop - HDFS
Hadoop - HDFS
Hadoop
Hadoop
Using Apache Arrow, Calcite, and Parquet to Build a Relational Cache
Using Apache Arrow, Calcite, and Parquet to Build a Relational Cache
Make a Move to AWS Now
Make a Move to AWS Now
Introduction to Redis
Introduction to Redis
Application Architectures with Hadoop - Big Data TechCon SF 2014
Application Architectures with Hadoop - Big Data TechCon SF 2014
VM-aware Adaptive Storage Cache Prefetching
VM-aware Adaptive Storage Cache Prefetching
Ceph as software define storage
Ceph as software define storage
Chapter2.pdf
Chapter2.pdf
Demystifying bigdata ashish1
Demystifying bigdata ashish1
Why MySQL High Availability Matters
Why MySQL High Availability Matters
Big Data and Cloud Computing
Big Data and Cloud Computing
Redis vs Memcached
Redis vs Memcached
Recently uploaded
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
BookNet Canada
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Mark Simos
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
Rizwan Syed
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
Ridwan Fadjar
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
shyamraj55
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Patryk Bandurski
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
Miki Katsuragi
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April Automation LPDG
MarianaLemus7
Science&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdf
jimielynbastida
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
null - The Open Security Community
Key Features Of Token Development (1).pptx
Key Features Of Token Development (1).pptx
LBM Solutions
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
2toLead Limited
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
carlostorres15106
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
UiPathCommunity
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
Fwdays
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
Fwdays
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
comworks
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
Enterprise Knowledge
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
Kalema Edgar
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
Mark Billinghurst
Recently uploaded
(20)
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April Automation LPDG
Science&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdf
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
Key Features Of Token Development (1).pptx
Key Features Of Token Development (1).pptx
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
Redis as database - HashedIn
1.
Redis as a
Database
2.
Copyright © 2017
HashedIn Technologies Pvt. Ltd. Redis is used as a cache …...
3.
Copyright © 2017
HashedIn Technologies Pvt. Ltd. …… But Redis is also a Database
4.
Copyright © 2017
HashedIn Technologies Pvt. Ltd. Redis Options In memory store Backups Only High Availability HA + Sharding Redis Enterprise
5.
Copyright © 2017
HashedIn Technologies Pvt. Ltd. ● Disk backup for reliability ● Provides two option for persistence ○ RDB (Snapshot) - Full backup , Very good for disaster recovery, Fast restarts with big datasets ○ AOF (Append Only File) - Incremental backup, More durable, fsync policies ● Can use combination of AOF and RDB ○ During failover - AOF file will be used to reconstruct the original database Redis Persistence
6.
Copyright © 2017
HashedIn Technologies Pvt. Ltd. High availability in Redis is achieved through master-slave replication. One master can have multiple replica. Whenever master is unavailable one of the slaves can be promoted as master. There are many high-availability tools available that can monitor and manage a master-slave replica configuration, the most common solution that comes bundled with Redis is Redis Sentinel. Redis High Availability
7.
Copyright © 2017
HashedIn Technologies Pvt. Ltd. ● Automatic Failover ● Monitoring ● Notifications ● Configuration Provider Redis Sentinel Features
8.
Copyright © 2017
HashedIn Technologies Pvt. Ltd. ● Sentinel is a process which monitors each master ● Exchange messages on port 26379 ● Minimum number of sentinels for effective monitoring 3 ● A Quorum of sentinel must agree before master considered to be down ● Sentinel API to check state or health of monitored instances ● Re-configuring Sentinel at Runtime How Redis Sentinel works?
9.
Copyright © 2017
HashedIn Technologies Pvt. Ltd. Redis is a single threaded process due to this it has some limitations: ● CPU of the server ● Amount of memory that server can have Due to this scaling is really a challenge. To overcome this we can use concept of Sharding. Ideally you should start using sharding once - ● Data doesn’t fit into a single instance ● CPU utilization is very high impacting and impacting the performance ● Handle more requests per second Redis Sharding
10.
Copyright © 2017
HashedIn Technologies Pvt. Ltd. ● Split the data between multiple Redis instances ● Helps to scale computational power, network bandwidth ● Allows horizontal scaling ● There are different techniques of partitioning - ○ Range Partitioning ○ Hash Partitioning ○ Consistent Hashing ● Different implementation of partitioning ○ Client side partitioning ○ Proxy assisted partitioning ○ Query routing Partitioning
11.
Copyright © 2017
HashedIn Technologies Pvt. Ltd. ● Multi key operations are not supported. i.e. - Intersection of two sets, ● Partitioning granularity is the key. So sharding a dataset with single huge key i.e. sorted set is not possible ● Data handling becomes more complex. i.e. - Recovering your data from multiple RDB / AOF files ● Rebalancing of data becomes more complex in case of increasing your capacity Disadvantage of Partitioning
12.
Copyright © 2017
HashedIn Technologies Pvt. Ltd. ● Released in Redis 3.0 ● Responsible for mapping the data to right node ● Automatically shard your data across multiple Redis nodes ● During partitions less impact on performance ● High Availability ● Continue operations when a subset of the nodes are experiencing failures ● Cluster bus - Failure detection, configuration update, failover authorization ● Merge operations are avoided Redis Cluster
13.
Copyright © 2017
HashedIn Technologies Pvt. Ltd. How Redis Cluster Works?
14.
Copyright © 2017
HashedIn Technologies Pvt. Ltd. Q&A Thank You
Download now