SlideShare a Scribd company logo
1 of 29
Download to read offline
Overcoming Media
Streaming Challenges
with NoSQL
Felipe Mendes, Solution Architect at ScyllaDB
Noelly Medina, Technical Engineer Team Lead at ScyllaDB
+ For data-intensive applications that require high
throughput and predictable low latencies
+ Close-to-the-metal design takes full advantage of
modern infrastructure
+ >5x higher throughput
+ >20x lower latency
+ >75% TCO savings
+ Compatible with Apache Cassandra and Amazon
DynamoDB
+ DBaaS/Cloud, Enterprise and Open Source
solutions
The Database for Gamechangers
2
“ScyllaDB stands apart...It’s the rare product
that exceeds my expectations.”
– Martin Heller, InfoWorld contributing editor and reviewer
“For 99.9% of applications, ScyllaDB delivers all the
power a customer will ever need, on workloads that other
databases can’t touch – and at a fraction of the cost of
an in-memory solution.”
– Adrian Bridgewater, Forbes senior contributor
3
+400 Gamechangers Leverage ScyllaDB
Seamless experiences
across content + devices
Digital experiences at
massive scale
Corporate fleet
management
Real-time analytics 2,000,000 SKU -commerce
management
Video recommendation
management
Threat intelligence service
using JanusGraph
Real time fraud detection
across 6M transactions/day
Uber scale, mission critical
chat & messaging app
Network security threat
detection
Power ~50M X1 DVRs with
billions of reqs/day
Precision healthcare via
Edison AI
Inventory hub for retail
operations
Property listings and
updates
Unified ML feature store
across the business
Cryptocurrency exchange
app
Geography-based
recommendations
Global operations- Avon,
Body Shop + more
Predictable performance for
on sale surges
GPS-based exercise
tracking
Serving dynamic live
streams at scale
Powering India's top
social media platform
Personalized
advertising to players
Distribution of game
assets in Unreal Engine
Introductions
Felipe Mendes, Solution Architect at ScyllaDB
+ Years of experience with Linux and other distributed systems
+ An open source enthusiast
+ Passion towards helping businesses to achieve their most challenging
goals
Noelly Medina, Technical Engineer Team Lead at ScyllaDB
+ Years of experience in customer-facing roles
+ Customer’s satisfaction is my satisfaction
+ Always seeking for new challenges
Agenda
+ After all … What is Streaming?
+ A glance at Media Streaming
+ Challenges
+ How can ScyllaDB help?
+ Use Cases
+ The Future of Streaming Media
What is Streaming?
Seems Accurate?
streaming noun [U] (INTERNET)
the activity of listening to or watching sound or video directly from the internet
streaming adjective [ not gradable ]
playing continuously as sound or moving images are sent in a flow directly from the Internet to a computer
streaming noun [ U ] IT, INTERNET, COMMUNICATIONS
the act of sending sound or video to a computer, mobile phone, etc. directly from the internet so that it does not need to be
downloaded and saved first
stream·ing noun
a method of transmitting or receiving data (especially video and audio material) over a computer network as a steady, continuous
flow, allowing playback to start while the rest of the data is still being received.
Cambridge Dictionary
Oxford Languages
Seems Accurate?
streaming noun [U] (INTERNET)
the activity of listening to or watching sound or video directly from the internet
streaming adjective [ not gradable ]
playing continuously as sound or moving images are sent in a flow directly from the Internet to a computer
streaming noun [ U ] IT, INTERNET, COMMUNICATIONS
the act of sending sound or video to a computer, mobile phone, etc. directly from the internet so that it does not need to be
downloaded and saved first
stream·ing noun
a method of transmitting or receiving data (especially video and audio material) over a computer network as a steady, continuous
flow, allowing playback to start while the rest of the data is still being received.
Cambridge Dictionary
Oxford Languages
Tuning It Up A Little Bit
+ a method of transmitting or receiving data in motion over a computer network,
+ as a steady, continuous flow
+ with one or more data processors along the way
+ allowing for fast consumption while the rest of the data is still being received
+ backed up by a storage layer for data persistence and consistency
stream·ing noun
Notable Examples
The
Speak
er’s
came
ra
displa
ys
here
Numberly’s web tracking
Synapse services
Business rules
Partners
calculation
Segmentation store
distribution
configuration
Media Streaming
Are We There Yet?
stream·ing noun
a method of transmitting or receiving data (especially video and audio material) over a
computer network as a steady, continuous flow
Media Streaming Gamechangers
Media Streaming Challenges
+ Low Latency
Critical to any streaming type of
use case. No circling wheels?
+ High Throughput
Support ultra-fast data ingestion
and lookups at scale
+ Geo-Replication
Enhanced user experience, and
smart replication
+ High Availability
ZERO downtime, support all peak
(SuperBowl?) traffic
+ Without Breaking the Bank
Reduce OpEx and CapEx as a
whole
Too Good To Be True?
Disney+ Hotstar replaced ElasticSearch and Redis with ScyllaDB
Too Good To Be True?
Tubi latencies went from ~300ms to ~10ms on their ML Feature Store
Too Good To Be True?
Comcast reduced their C* footprint from >950 nodes to 78 ScyllaDB nodes!
Cassandra
Node Count
ScyllaDB
Node Count
Recordings Ring 432 18
Reminders Ring 96 18
Recordings Secondary Ring 70 18
History Ring 96 6
Instruction and Lookup Ring 268 18
Total 962 78
Pre ScyllaDB
Node Count
962
Post ScyllaDB
Node Count
78
ScyllaDB Database Architecture
Horizontal & Vertical Scaling
Built in C++
(no Java overhead)
System and Data
Center Aware
Sharding Per Core Shard-Aware Drivers
Auto-Performance
Tuning
Network
Processor NUMA
Storage
Unique Close-to-Metal Architecture
ScyllaDB Database Architecture
Built in C++
(no Java overhead)
System and Data
Center Aware
Sharding Per Core Shard-Aware Drivers
Auto-Performance
Tuning
Use Cases
Brainstorming…
stream·ing noun
a method of transmitting or receiving data (especially video and audio material) over a
computer network as a steady, continuous flow
+ Open the app
+ Validate whether subscription is active
+ Verify device data (security, sw level, telemetry)
+ Check device location (regulations, personalization)
+ On playback: Number of concurrent streams per account
+ Endless possibilities!
ScyllaDB and Streaming Media Use Cases
Lookup endpoint where the actual
medium is stored for playback and
serving back to the end user
Recommendations
High throughput
volume
Extreme low latency OLTP & OLAP
Geo Replication Lower Costs
Stream Metadata Store
Provide a personalized view of
which content to consume next
based on its previous interactions
Catalog
Stores all relevant media data for
what is currently available within
the services' catalog
Playhead Tracking
Ability to know at which point in
time an user stopped consuming a
given media, so it can be
resumable later
ML Feature Store
A central store empowers data
scientists to run models under a
single place with recent data
Workload Prioritization
The Future?
What's Next?
What's Next?
What's Next?
Powered by
Q&A
ScyllaDB University
Free online learning
scylladb.com/university
Optimizing Performance in
Rust for Low-Latency Database
ScyllaDB Cloud
Start free Trial
scylladb.com/cloud
MAY 11 10 AM PT
scylladb.com/events
Thank you
for joining us today.
@scylladb scylladb/
slack.scylladb.com
@scylladb company/scylladb/
scylladb/

More Related Content

Similar to Overcoming Media Streaming Challenges with NoSQL

Liberate Your Data: Integrate Data From Traditional On-Prem Systems to Next-G...
Liberate Your Data: Integrate Data From Traditional On-Prem Systems to Next-G...Liberate Your Data: Integrate Data From Traditional On-Prem Systems to Next-G...
Liberate Your Data: Integrate Data From Traditional On-Prem Systems to Next-G...Precisely
 
Introduction to Stream Processing
Introduction to Stream ProcessingIntroduction to Stream Processing
Introduction to Stream ProcessingGuido Schmutz
 
Extending The Enterprise With Office 365 & Azure for the Enterprise
Extending The Enterprise With Office 365 & Azure for the EnterpriseExtending The Enterprise With Office 365 & Azure for the Enterprise
Extending The Enterprise With Office 365 & Azure for the EnterpriseRichard Harbridge
 
(ARC346) Scaling To 25 Billion Daily Requests Within 3 Months On AWS
(ARC346) Scaling To 25 Billion Daily Requests Within 3 Months On AWS(ARC346) Scaling To 25 Billion Daily Requests Within 3 Months On AWS
(ARC346) Scaling To 25 Billion Daily Requests Within 3 Months On AWSAmazon Web Services
 
Internet of Things (IoT) - in the cloud or rather on-premises?
Internet of Things (IoT) - in the cloud or rather on-premises?Internet of Things (IoT) - in the cloud or rather on-premises?
Internet of Things (IoT) - in the cloud or rather on-premises?Guido Schmutz
 
DM Radio Webinar: Adopting a Streaming-Enabled Architecture
DM Radio Webinar: Adopting a Streaming-Enabled ArchitectureDM Radio Webinar: Adopting a Streaming-Enabled Architecture
DM Radio Webinar: Adopting a Streaming-Enabled ArchitectureDATAVERSITY
 
Webinar: Cleaning up the SDS Mess - Four Keys to Success
Webinar: Cleaning up the SDS Mess - Four Keys to SuccessWebinar: Cleaning up the SDS Mess - Four Keys to Success
Webinar: Cleaning up the SDS Mess - Four Keys to SuccessStorage Switzerland
 
AWS Sydney Summit 2013 - Scalable Media Processing on the Cloud
AWS Sydney Summit 2013 - Scalable Media Processing on the CloudAWS Sydney Summit 2013 - Scalable Media Processing on the Cloud
AWS Sydney Summit 2013 - Scalable Media Processing on the CloudAmazon Web Services
 
Netflix Playback Data Systems Team and Job Overview
Netflix Playback Data Systems Team and Job OverviewNetflix Playback Data Systems Team and Job Overview
Netflix Playback Data Systems Team and Job OverviewSuudhan Rangarajan
 
Unbundling the Modern Streaming Stack With Dunith Dhanushka | Current 2022
Unbundling the Modern Streaming Stack With Dunith Dhanushka | Current 2022Unbundling the Modern Streaming Stack With Dunith Dhanushka | Current 2022
Unbundling the Modern Streaming Stack With Dunith Dhanushka | Current 2022HostedbyConfluent
 
CMG2013 Workshop: Netflix Cloud Native, Capacity, Performance and Cost Optimi...
CMG2013 Workshop: Netflix Cloud Native, Capacity, Performance and Cost Optimi...CMG2013 Workshop: Netflix Cloud Native, Capacity, Performance and Cost Optimi...
CMG2013 Workshop: Netflix Cloud Native, Capacity, Performance and Cost Optimi...Adrian Cockcroft
 
AWS Summit 2013 | Auckland - Scalable Media Processing on the Cloud
AWS Summit 2013 | Auckland - Scalable Media Processing on the CloudAWS Summit 2013 | Auckland - Scalable Media Processing on the Cloud
AWS Summit 2013 | Auckland - Scalable Media Processing on the CloudAmazon Web Services
 
Introduction to Stream Processing
Introduction to Stream ProcessingIntroduction to Stream Processing
Introduction to Stream ProcessingGuido Schmutz
 
Video Streaming
Video StreamingVideo Streaming
Video StreamingVideoguy
 
(BAC307) The Cold Data Playbook: Building the Ultimate Archive Solution in Am...
(BAC307) The Cold Data Playbook: Building the Ultimate Archive Solution in Am...(BAC307) The Cold Data Playbook: Building the Ultimate Archive Solution in Am...
(BAC307) The Cold Data Playbook: Building the Ultimate Archive Solution in Am...Amazon Web Services
 
EQR Reporting: Rails + Amazon EC2
EQR Reporting:  Rails + Amazon EC2EQR Reporting:  Rails + Amazon EC2
EQR Reporting: Rails + Amazon EC2jeperkins4
 
The Purpose of Cloud-technology for Video Production
The Purpose of Cloud-technology for Video ProductionThe Purpose of Cloud-technology for Video Production
The Purpose of Cloud-technology for Video ProductionMaarten Verwaest
 

Similar to Overcoming Media Streaming Challenges with NoSQL (20)

Liberate Your Data: Integrate Data From Traditional On-Prem Systems to Next-G...
Liberate Your Data: Integrate Data From Traditional On-Prem Systems to Next-G...Liberate Your Data: Integrate Data From Traditional On-Prem Systems to Next-G...
Liberate Your Data: Integrate Data From Traditional On-Prem Systems to Next-G...
 
Introduction to Stream Processing
Introduction to Stream ProcessingIntroduction to Stream Processing
Introduction to Stream Processing
 
Extending The Enterprise With Office 365 & Azure for the Enterprise
Extending The Enterprise With Office 365 & Azure for the EnterpriseExtending The Enterprise With Office 365 & Azure for the Enterprise
Extending The Enterprise With Office 365 & Azure for the Enterprise
 
(ARC346) Scaling To 25 Billion Daily Requests Within 3 Months On AWS
(ARC346) Scaling To 25 Billion Daily Requests Within 3 Months On AWS(ARC346) Scaling To 25 Billion Daily Requests Within 3 Months On AWS
(ARC346) Scaling To 25 Billion Daily Requests Within 3 Months On AWS
 
Internet of Things (IoT) - in the cloud or rather on-premises?
Internet of Things (IoT) - in the cloud or rather on-premises?Internet of Things (IoT) - in the cloud or rather on-premises?
Internet of Things (IoT) - in the cloud or rather on-premises?
 
DM Radio Webinar: Adopting a Streaming-Enabled Architecture
DM Radio Webinar: Adopting a Streaming-Enabled ArchitectureDM Radio Webinar: Adopting a Streaming-Enabled Architecture
DM Radio Webinar: Adopting a Streaming-Enabled Architecture
 
IBM Aspera overview
IBM Aspera overview IBM Aspera overview
IBM Aspera overview
 
Webinar: Cleaning up the SDS Mess - Four Keys to Success
Webinar: Cleaning up the SDS Mess - Four Keys to SuccessWebinar: Cleaning up the SDS Mess - Four Keys to Success
Webinar: Cleaning up the SDS Mess - Four Keys to Success
 
AWS Sydney Summit 2013 - Scalable Media Processing on the Cloud
AWS Sydney Summit 2013 - Scalable Media Processing on the CloudAWS Sydney Summit 2013 - Scalable Media Processing on the Cloud
AWS Sydney Summit 2013 - Scalable Media Processing on the Cloud
 
Netflix Playback Data Systems Team and Job Overview
Netflix Playback Data Systems Team and Job OverviewNetflix Playback Data Systems Team and Job Overview
Netflix Playback Data Systems Team and Job Overview
 
Unbundling the Modern Streaming Stack With Dunith Dhanushka | Current 2022
Unbundling the Modern Streaming Stack With Dunith Dhanushka | Current 2022Unbundling the Modern Streaming Stack With Dunith Dhanushka | Current 2022
Unbundling the Modern Streaming Stack With Dunith Dhanushka | Current 2022
 
CMG2013 Workshop: Netflix Cloud Native, Capacity, Performance and Cost Optimi...
CMG2013 Workshop: Netflix Cloud Native, Capacity, Performance and Cost Optimi...CMG2013 Workshop: Netflix Cloud Native, Capacity, Performance and Cost Optimi...
CMG2013 Workshop: Netflix Cloud Native, Capacity, Performance and Cost Optimi...
 
Tech Essentials October 2008
Tech Essentials October 2008Tech Essentials October 2008
Tech Essentials October 2008
 
AWS Summit 2013 | Auckland - Scalable Media Processing on the Cloud
AWS Summit 2013 | Auckland - Scalable Media Processing on the CloudAWS Summit 2013 | Auckland - Scalable Media Processing on the Cloud
AWS Summit 2013 | Auckland - Scalable Media Processing on the Cloud
 
Introduction to Stream Processing
Introduction to Stream ProcessingIntroduction to Stream Processing
Introduction to Stream Processing
 
Video Streaming
Video StreamingVideo Streaming
Video Streaming
 
(BAC307) The Cold Data Playbook: Building the Ultimate Archive Solution in Am...
(BAC307) The Cold Data Playbook: Building the Ultimate Archive Solution in Am...(BAC307) The Cold Data Playbook: Building the Ultimate Archive Solution in Am...
(BAC307) The Cold Data Playbook: Building the Ultimate Archive Solution in Am...
 
EQR Reporting: Rails + Amazon EC2
EQR Reporting:  Rails + Amazon EC2EQR Reporting:  Rails + Amazon EC2
EQR Reporting: Rails + Amazon EC2
 
The Purpose of Cloud-technology for Video Production
The Purpose of Cloud-technology for Video ProductionThe Purpose of Cloud-technology for Video Production
The Purpose of Cloud-technology for Video Production
 
IWM DAMS
IWM DAMSIWM DAMS
IWM DAMS
 

Recently uploaded

Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 

Recently uploaded (20)

Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 

Overcoming Media Streaming Challenges with NoSQL

  • 1. Overcoming Media Streaming Challenges with NoSQL Felipe Mendes, Solution Architect at ScyllaDB Noelly Medina, Technical Engineer Team Lead at ScyllaDB
  • 2. + For data-intensive applications that require high throughput and predictable low latencies + Close-to-the-metal design takes full advantage of modern infrastructure + >5x higher throughput + >20x lower latency + >75% TCO savings + Compatible with Apache Cassandra and Amazon DynamoDB + DBaaS/Cloud, Enterprise and Open Source solutions The Database for Gamechangers 2 “ScyllaDB stands apart...It’s the rare product that exceeds my expectations.” – Martin Heller, InfoWorld contributing editor and reviewer “For 99.9% of applications, ScyllaDB delivers all the power a customer will ever need, on workloads that other databases can’t touch – and at a fraction of the cost of an in-memory solution.” – Adrian Bridgewater, Forbes senior contributor
  • 3. 3 +400 Gamechangers Leverage ScyllaDB Seamless experiences across content + devices Digital experiences at massive scale Corporate fleet management Real-time analytics 2,000,000 SKU -commerce management Video recommendation management Threat intelligence service using JanusGraph Real time fraud detection across 6M transactions/day Uber scale, mission critical chat & messaging app Network security threat detection Power ~50M X1 DVRs with billions of reqs/day Precision healthcare via Edison AI Inventory hub for retail operations Property listings and updates Unified ML feature store across the business Cryptocurrency exchange app Geography-based recommendations Global operations- Avon, Body Shop + more Predictable performance for on sale surges GPS-based exercise tracking Serving dynamic live streams at scale Powering India's top social media platform Personalized advertising to players Distribution of game assets in Unreal Engine
  • 4. Introductions Felipe Mendes, Solution Architect at ScyllaDB + Years of experience with Linux and other distributed systems + An open source enthusiast + Passion towards helping businesses to achieve their most challenging goals Noelly Medina, Technical Engineer Team Lead at ScyllaDB + Years of experience in customer-facing roles + Customer’s satisfaction is my satisfaction + Always seeking for new challenges
  • 5. Agenda + After all … What is Streaming? + A glance at Media Streaming + Challenges + How can ScyllaDB help? + Use Cases + The Future of Streaming Media
  • 7. Seems Accurate? streaming noun [U] (INTERNET) the activity of listening to or watching sound or video directly from the internet streaming adjective [ not gradable ] playing continuously as sound or moving images are sent in a flow directly from the Internet to a computer streaming noun [ U ] IT, INTERNET, COMMUNICATIONS the act of sending sound or video to a computer, mobile phone, etc. directly from the internet so that it does not need to be downloaded and saved first stream·ing noun a method of transmitting or receiving data (especially video and audio material) over a computer network as a steady, continuous flow, allowing playback to start while the rest of the data is still being received. Cambridge Dictionary Oxford Languages
  • 8. Seems Accurate? streaming noun [U] (INTERNET) the activity of listening to or watching sound or video directly from the internet streaming adjective [ not gradable ] playing continuously as sound or moving images are sent in a flow directly from the Internet to a computer streaming noun [ U ] IT, INTERNET, COMMUNICATIONS the act of sending sound or video to a computer, mobile phone, etc. directly from the internet so that it does not need to be downloaded and saved first stream·ing noun a method of transmitting or receiving data (especially video and audio material) over a computer network as a steady, continuous flow, allowing playback to start while the rest of the data is still being received. Cambridge Dictionary Oxford Languages
  • 9. Tuning It Up A Little Bit + a method of transmitting or receiving data in motion over a computer network, + as a steady, continuous flow + with one or more data processors along the way + allowing for fast consumption while the rest of the data is still being received + backed up by a storage layer for data persistence and consistency stream·ing noun
  • 10. Notable Examples The Speak er’s came ra displa ys here Numberly’s web tracking Synapse services Business rules Partners calculation Segmentation store distribution configuration
  • 12. Are We There Yet? stream·ing noun a method of transmitting or receiving data (especially video and audio material) over a computer network as a steady, continuous flow
  • 14. Media Streaming Challenges + Low Latency Critical to any streaming type of use case. No circling wheels? + High Throughput Support ultra-fast data ingestion and lookups at scale + Geo-Replication Enhanced user experience, and smart replication + High Availability ZERO downtime, support all peak (SuperBowl?) traffic + Without Breaking the Bank Reduce OpEx and CapEx as a whole
  • 15. Too Good To Be True? Disney+ Hotstar replaced ElasticSearch and Redis with ScyllaDB
  • 16. Too Good To Be True? Tubi latencies went from ~300ms to ~10ms on their ML Feature Store
  • 17. Too Good To Be True? Comcast reduced their C* footprint from >950 nodes to 78 ScyllaDB nodes! Cassandra Node Count ScyllaDB Node Count Recordings Ring 432 18 Reminders Ring 96 18 Recordings Secondary Ring 70 18 History Ring 96 6 Instruction and Lookup Ring 268 18 Total 962 78 Pre ScyllaDB Node Count 962 Post ScyllaDB Node Count 78
  • 18. ScyllaDB Database Architecture Horizontal & Vertical Scaling Built in C++ (no Java overhead) System and Data Center Aware Sharding Per Core Shard-Aware Drivers Auto-Performance Tuning Network Processor NUMA Storage Unique Close-to-Metal Architecture
  • 19. ScyllaDB Database Architecture Built in C++ (no Java overhead) System and Data Center Aware Sharding Per Core Shard-Aware Drivers Auto-Performance Tuning
  • 21. Brainstorming… stream·ing noun a method of transmitting or receiving data (especially video and audio material) over a computer network as a steady, continuous flow + Open the app + Validate whether subscription is active + Verify device data (security, sw level, telemetry) + Check device location (regulations, personalization) + On playback: Number of concurrent streams per account + Endless possibilities!
  • 22. ScyllaDB and Streaming Media Use Cases Lookup endpoint where the actual medium is stored for playback and serving back to the end user Recommendations High throughput volume Extreme low latency OLTP & OLAP Geo Replication Lower Costs Stream Metadata Store Provide a personalized view of which content to consume next based on its previous interactions Catalog Stores all relevant media data for what is currently available within the services' catalog Playhead Tracking Ability to know at which point in time an user stopped consuming a given media, so it can be resumable later ML Feature Store A central store empowers data scientists to run models under a single place with recent data
  • 28. Q&A ScyllaDB University Free online learning scylladb.com/university Optimizing Performance in Rust for Low-Latency Database ScyllaDB Cloud Start free Trial scylladb.com/cloud MAY 11 10 AM PT scylladb.com/events
  • 29. Thank you for joining us today. @scylladb scylladb/ slack.scylladb.com @scylladb company/scylladb/ scylladb/