SlideShare a Scribd company logo
Personalizing Netflix

    A brief history
            Jon Sanders
 Recommendation Systems Engineering
               Netflix
           Los Gatos, CA
       jsanders @ netflix.com

        http://jobs.netflix.com
Fun facts about Netflix
World’s largest online movie rental service   #1 in customer satisfaction
Founded 1997                                  Video rental companies (Consumer Reports)
                                              Online retail (ForeSee)

With more than…
                                              On an average day
10M subscribers, $1B revenue
                                              2M DVDs shipped
100K DVD titles, 50 distribution centers
                                              2M movie ratings received
12K streaming movies & TV episodes
1.5B minutes streamed to 1M Xbox360’s
2B movie ratings




60% of movies selected based on personalized recommendations

                 Connecting people with movies they’ll love
In the beginning…




 Everyone sees the same site
Evolve methodically
The rating widget

•  Ask about & predict movie Enjoyment

•  User-similarity collaborative filter

•  Recommendations fuel discovery
Score & sort any movie




Combine popularity & enjoyment prediction
Tune recommendations
•  Movie-similarity collaborative filter

•  K-nearest-neighbor algorithm

•  More credible connections
Interest-based discovery




Metadata connections: actor, director, genre, …
Ask about Interest




Moderate prominence of catalog areas
Ask other people




Community offers decision support
Explain why




Build trust with reflected evidence
$1M Netflix Prize
•  Improve accuracy of Enjoyment predictions
   –  100M ratings
   –  Achieve 10% better than Netflix RMSE


•  Innovative, engaged research community

•  Highly relevant results
   –  Global and time-based corrections
   –  SVD, RBM models
   –  Blending predictors
A website for each subscriber
Evolution continues
•  Tailor with more metadata, implicit data
•  Streaming-specific personalization




•  Collaborative Filtering is a component of personalization
•  People want to drive, not be led
•  Offer discovery, focus and decision support

                   http://jobs.netflix.com
Links

•    http://jobs.netflix.com
•    http://www.netflix.com/ContactUs
•    http://www.netflixprize.com
•    http://www.netflix.com/netflixfindyourvoice
•    http://en.wikipedia.org/wiki/Collaborative_filtering

More Related Content

Similar to Jon Sanders on Collaborative Filters at SXSW

Romantic Comedy in Netflix
Romantic Comedy in NetflixRomantic Comedy in Netflix
Romantic Comedy in NetflixAyesha Majid
 
How To Create The Killer Location Aware Social Networking Application
How To Create The Killer Location Aware Social Networking ApplicationHow To Create The Killer Location Aware Social Networking Application
How To Create The Killer Location Aware Social Networking ApplicationMobileMonday Tel-Aviv
 
Rulebreaker lewis deck
Rulebreaker lewis deckRulebreaker lewis deck
Rulebreaker lewis deckAaron Cohen
 
Bootstrapping Recommendations OSCON 2015
Bootstrapping Recommendations OSCON 2015Bootstrapping Recommendations OSCON 2015
Bootstrapping Recommendations OSCON 2015Max De Marzi
 
How to Build a Recommendation Engine on Spark
How to Build a Recommendation Engine on SparkHow to Build a Recommendation Engine on Spark
How to Build a Recommendation Engine on SparkCaserta
 
Bootstrapping Recommendations with Neo4j
Bootstrapping Recommendations with Neo4jBootstrapping Recommendations with Neo4j
Bootstrapping Recommendations with Neo4jMax De Marzi
 
Netflix Presentation
Netflix PresentationNetflix Presentation
Netflix Presentationsmiths05
 
From DVD in the mail to Streaming from the Cloud
From DVD in the mail to Streaming from the CloudFrom DVD in the mail to Streaming from the Cloud
From DVD in the mail to Streaming from the CloudCloud Genius
 
Podcasting Présentation
Podcasting PrésentationPodcasting Présentation
Podcasting PrésentationThierry Weber
 
Data to make hit tv show
Data to make hit tv showData to make hit tv show
Data to make hit tv showDebashish Jana
 
Netflix Presentation - George's
Netflix Presentation - George'sNetflix Presentation - George's
Netflix Presentation - George'sGeorge Ferko
 
XML and Data Feeds - Standardisation and Implementation for Success (Robert S...
XML and Data Feeds - Standardisation and Implementation for Success (Robert S...XML and Data Feeds - Standardisation and Implementation for Success (Robert S...
XML and Data Feeds - Standardisation and Implementation for Success (Robert S...auexpo Conference
 
Sit team 6 presentation
Sit team 6 presentationSit team 6 presentation
Sit team 6 presentationstephenc66
 
Big data - A critical appraisal
Big data - A critical appraisalBig data - A critical appraisal
Big data - A critical appraisalBart Knijnenburg
 
CRM Netflix case-study
CRM Netflix case-studyCRM Netflix case-study
CRM Netflix case-studyOla Haffar
 
Big Data, Analytics, and Content Recommendations on AWS
Big Data, Analytics, and Content Recommendations on AWSBig Data, Analytics, and Content Recommendations on AWS
Big Data, Analytics, and Content Recommendations on AWSAmazon Web Services
 
Becoming A Resource For More Busines
Becoming A Resource For More BusinesBecoming A Resource For More Busines
Becoming A Resource For More BusinesSchoonts
 

Similar to Jon Sanders on Collaborative Filters at SXSW (20)

Romantic Comedy in Netflix
Romantic Comedy in NetflixRomantic Comedy in Netflix
Romantic Comedy in Netflix
 
How To Create The Killer Location Aware Social Networking Application
How To Create The Killer Location Aware Social Networking ApplicationHow To Create The Killer Location Aware Social Networking Application
How To Create The Killer Location Aware Social Networking Application
 
Rulebreaker lewis deck
Rulebreaker lewis deckRulebreaker lewis deck
Rulebreaker lewis deck
 
Winning Pitch
Winning PitchWinning Pitch
Winning Pitch
 
Netflix
NetflixNetflix
Netflix
 
Bootstrapping Recommendations OSCON 2015
Bootstrapping Recommendations OSCON 2015Bootstrapping Recommendations OSCON 2015
Bootstrapping Recommendations OSCON 2015
 
How to Build a Recommendation Engine on Spark
How to Build a Recommendation Engine on SparkHow to Build a Recommendation Engine on Spark
How to Build a Recommendation Engine on Spark
 
Bootstrapping Recommendations with Neo4j
Bootstrapping Recommendations with Neo4jBootstrapping Recommendations with Neo4j
Bootstrapping Recommendations with Neo4j
 
Netflix Presentation
Netflix PresentationNetflix Presentation
Netflix Presentation
 
From DVD in the mail to Streaming from the Cloud
From DVD in the mail to Streaming from the CloudFrom DVD in the mail to Streaming from the Cloud
From DVD in the mail to Streaming from the Cloud
 
Netflix
Netflix Netflix
Netflix
 
Podcasting Présentation
Podcasting PrésentationPodcasting Présentation
Podcasting Présentation
 
Data to make hit tv show
Data to make hit tv showData to make hit tv show
Data to make hit tv show
 
Netflix Presentation - George's
Netflix Presentation - George'sNetflix Presentation - George's
Netflix Presentation - George's
 
XML and Data Feeds - Standardisation and Implementation for Success (Robert S...
XML and Data Feeds - Standardisation and Implementation for Success (Robert S...XML and Data Feeds - Standardisation and Implementation for Success (Robert S...
XML and Data Feeds - Standardisation and Implementation for Success (Robert S...
 
Sit team 6 presentation
Sit team 6 presentationSit team 6 presentation
Sit team 6 presentation
 
Big data - A critical appraisal
Big data - A critical appraisalBig data - A critical appraisal
Big data - A critical appraisal
 
CRM Netflix case-study
CRM Netflix case-studyCRM Netflix case-study
CRM Netflix case-study
 
Big Data, Analytics, and Content Recommendations on AWS
Big Data, Analytics, and Content Recommendations on AWSBig Data, Analytics, and Content Recommendations on AWS
Big Data, Analytics, and Content Recommendations on AWS
 
Becoming A Resource For More Busines
Becoming A Resource For More BusinesBecoming A Resource For More Busines
Becoming A Resource For More Busines
 

Recently uploaded

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...Product School
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
 
Quantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIsQuantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIsVlad Stirbu
 
In-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT ProfessionalsIn-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT ProfessionalsExpeed Software
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Product School
 
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀DianaGray10
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...Elena Simperl
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxAbida Shariff
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Thierry Lestable
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backElena Simperl
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaRTTS
 
ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupCatarinaPereira64715
 
UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2DianaGray10
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsPaul Groth
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...Sri Ambati
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance
 

Recently uploaded (20)

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
Quantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIsQuantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIs
 
In-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT ProfessionalsIn-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT Professionals
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User Group
 
UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 

Jon Sanders on Collaborative Filters at SXSW

  • 1. Personalizing Netflix A brief history Jon Sanders Recommendation Systems Engineering Netflix Los Gatos, CA jsanders @ netflix.com http://jobs.netflix.com
  • 2. Fun facts about Netflix World’s largest online movie rental service #1 in customer satisfaction Founded 1997 Video rental companies (Consumer Reports) Online retail (ForeSee) With more than… On an average day 10M subscribers, $1B revenue 2M DVDs shipped 100K DVD titles, 50 distribution centers 2M movie ratings received 12K streaming movies & TV episodes 1.5B minutes streamed to 1M Xbox360’s 2B movie ratings 60% of movies selected based on personalized recommendations Connecting people with movies they’ll love
  • 3. In the beginning… Everyone sees the same site
  • 5. The rating widget •  Ask about & predict movie Enjoyment •  User-similarity collaborative filter •  Recommendations fuel discovery
  • 6. Score & sort any movie Combine popularity & enjoyment prediction
  • 7. Tune recommendations •  Movie-similarity collaborative filter •  K-nearest-neighbor algorithm •  More credible connections
  • 9. Ask about Interest Moderate prominence of catalog areas
  • 10. Ask other people Community offers decision support
  • 11. Explain why Build trust with reflected evidence
  • 12. $1M Netflix Prize •  Improve accuracy of Enjoyment predictions –  100M ratings –  Achieve 10% better than Netflix RMSE •  Innovative, engaged research community •  Highly relevant results –  Global and time-based corrections –  SVD, RBM models –  Blending predictors
  • 13. A website for each subscriber
  • 14. Evolution continues •  Tailor with more metadata, implicit data •  Streaming-specific personalization •  Collaborative Filtering is a component of personalization •  People want to drive, not be led •  Offer discovery, focus and decision support http://jobs.netflix.com
  • 15. Links •  http://jobs.netflix.com •  http://www.netflix.com/ContactUs •  http://www.netflixprize.com •  http://www.netflix.com/netflixfindyourvoice •  http://en.wikipedia.org/wiki/Collaborative_filtering