<b>MongoDB @ Redis Labs </b>[10:40 am - 11:00 am]<br />Efficiently digesting data in large volumes can prove to be challenging for any database. The challenges are compounded when this influx must be analyzed on the fly, or ""tasted"", to satisfy the sophisticated palates of modern apps. Luckily, there are several proven remedies you can concoct with Redis to help with potential indigestion.

1. Redis & MongoDB
Stop Big Data Indigestion Before It Starts
@itamarhaber

2. @itamarhaber
A Redis Geek and Chief Developer Advocate
at
Have you signed for newsletter?
[1] https://redislabs.com/redis-watch-archive

3. You probably haven't seen anything
like this before
VolumeMongoDB truly excels when
is comes to volume and
variety of data…
…but data coming in at
extreme velocity poses
a digestive challenge for
for any disk-based database

4. A talk about MongoDB performance
[2] WiredTiger iiBench Results
I'm hardly an
expert, but with
MongoDB v3
storage engines
and future work
this could very
well be a moot
point 

5. Data ingestion at high velocity
Mobile, online and IoT apps
produce more and more data
with every day that passes.
Simply storing the data as it
comes in doesn't cut it anymore – real time
processing is a must in order distill information
from the data as it rushes in.

6. A talk about more performance
By doing LESS
you can do MORE
(with MongoDB)
Put differently, "chew" your
data with Redis to prevent
data ingestion indigestion

7. ● "...an [4] open source, BSD licensed,
advanced key-value cache and store"
● 5+2 data types, 160+ commands, entirely in
RAM, Lua scripts, PubSub...
● Nee circa 2009, by [5] antirez
(a.k.a Salvatore Sanfilippo)
● Sponsored by Pivotal
[3] Redis (REmote Dictionary Server)

8. OSS, humane, pure,
flexible, efficient,
scalable, highly
clusterable,
sexy, fresh,
is actively
ton of uses,
has a client in every
lean & small, supple,
track record, tiny,
and much moar...
...fun & easy, free
inspiring, simple,
innovative, robust,
available, cool,
portable, geeky,
mature, stable,
developed, has a
rich, dependable,
every language,
proven production
vibrant community,
Why use Redis
❤❤1.5M ops / sec
using a single
EC2 instance!
[6] Recorded webinar
Because it is

9. Use case A: Google Analytics
• A real time analytics platform
• Strongly focuses on users' behavior
• Primary data storage is MongoDB
• Activity is collected immediately or in bulks
• Raw data fed to Hadoop for offline crunching
• Real time metrics and initial information from
the stream is obtained with Redis

10. Use case A: Sessionization
• Analyzing sessions
• Stream of user activities
• Stored as documents
• 10s-1000s events each
• Different users interleaved
• The result: multiple small
updates to each session document

11. Use case A: with Redis
Diagram:
Before: Firehose -> Mongo & Hadoop ->
Mongo
After : Firehose -> Redis & Hadoop -> Mongo

12. TBD
Sessions events

13. Once you see it, it can't be unseen
Using Redis as a buffer in front
of MongoDB for write-
intensive, hot Big Data is a
useful pattern that makes it
easy to get information in real
time as well as distribute the
load more efficiently.

14. Use case B: Waze
• An international navigation app/service
• Strongly focuses on public transit
• 10s of millions of users during peak hours
• Primary data storage is MongoDB
• Base data is created in advance
• Real time updates (traffic, vehicles and
passengers) pour into Redis for scheduling
adjustments and notifications

15. Use case C: Tindr
• A dating app/service
• Strongly focuses on spatially-related groups
• Primary data storage is MongoDB
• Data includes user profiles & preferences
• An influx of positional and preferential
("swipes") events is first munched by Redis

16. Use case D: Clash of Clans
• A massive real time game
• Strongly focuses on matched team play
• 1000s of teams with 100s of members
• Primary data storage is MongoDB
• Match progress is sieved through Redis for
real time resources status, leaderboards and
scoring

17. Use case E: Weather.com
• IoT startup
• Focuses on environmental monitoring
• Pilot: real time fire fighting
• Primary data storage is MongoDB
• Sensor data (temperature, humidity, …) is
aggregated in Redis, providing warnings and
alarms in real time

18. Questions from the audience

19. Questions or feedback? Contact me!
Itamar Haber
Chief Developer Advocate
📧 itamar@redislabs.com
@itamarhaber