SlideShare a Scribd company logo
AbemaTV
RecSys2018
2018 December 14th
CyberAgent, Inc. All Rights Reserved
2018 6
AbemaTV
• RecSys
•
• Q&A
RecSys Overview
RecSys Overview
•
• 12
• :
• :10/2-7
• (10/2)
• (10/3-5)
• (10/6-7)
•
• Long : 18% (181 Submissions)
• Short : 25% (150 Submissions)
RecSys Overview
RecSys Overview
800 (73% )
RecSys Overview
•
RecSys Overview
10/3 10/4 10/5
Keynote1 Keynote2 Paper Session 5:
RecSys that Care
Paper Session 1:
Explanations
Paper Session 3:
Learning & Optimazation
Paper Session 6:
Metrics & Evaluations
Industry Session 1:
Alogrithms
Industry Session 2:
System Considerations
Paper Session 7:
Beyond Users & Items
Paper Session 2:
Products
Paper Session 4:
Travel & Entertainment
Keynote3
RecSys Overview
KeyNote
Five E’s: Reflecting on the Design of Recommendations
Elizabeth F. Churchill (Google)
• Explainable (understandable/intelligible)
• Equitable(fair & impartial)
• Ethical(morally good or correct)
• Expedient (convenient & practical)
• Exigent (pressing & demanding)
How Algorithmic Confounding in Recommendation Systems
Increases Homogeneity and Decreases Utility
• feedback loop
•
• feedback loop
https://arxiv.org/abs/1710.11214
Unbiased Offline Recommender Evaluation for
Missing-Not-At-Random Implicit Feedback
•
• Inverse Propensity Score
•
Causal Embeddings for Recommendation
• Criteo AI Labs RecSys 2018 Best long paper
•
• Domain Adaptatin
Calibrated Recommendations
• Netflix
• 70% 30%
• User
KL divergence (Calibration Metric)
• Calibration Metric
• Divercity
Black : play history
Red : before calibration
Green : after calibration
https://dl.acm.org/citation.cfm?id=3240372
Artwork Personalization at Netflix
• Netflix Industry session
•
(ex
)
• Contextial Bandit
https://medium.com/netflix-techblog/artwork-personalization-c589f074ad76
Artwork Personalization at Netflix
Explore, Exploit, and Explain: Personalizing Explainable
Recommendations with Bandits
• Sportify Contextual Bandits
•
Contextual Bandit BART
•
music
https://hellogiggles.com/reviews-coverage/music/spotify-playlist-favorite-songs-of-2017-wrapped/
GENERATION MEETS RECOMMENDATION:
Proposing Novel Items for Groups of Users
•
• item
• VAE Encoder Decoder Z item z
• item k Z
• z Decoder item( feature)
https://haroldsoh.files.wordpress.com/2018/10/sohvo_recsys18.pdf
Interpreting User Inaction in Recommender Systems
• item
MovieLens
• 7 ("Would Not Enjoy”
“Watched” “Not Noticed” “Not Now” “ Others Better” “Explore Later or
Decided To Watch”)
•
A Field Study of Related Video Recommendations: Newest,
Most Similar, or Most Relevant?
• CTR
• MovieLens
•
Judging Similarity: A User-Centric Study of Related Item
Recommendations
• MovieLens 6
• CF
RecSys2019
https://recsys.acm.org/recsys19/
:2019 9/16-20
:
RecSys Challenge 2019 by Trivago
Thank you

More Related Content

Similar to AbemaTV レコメンド開発エンジニアによる RecSys 2018 参加レポート

NetApp Tableau Presentation Final
NetApp Tableau Presentation FinalNetApp Tableau Presentation Final
NetApp Tableau Presentation Final
Mark Wu
 
2008_Pugh-Kirch-Allstate-FINAL
2008_Pugh-Kirch-Allstate-FINAL 2008_Pugh-Kirch-Allstate-FINAL
2008_Pugh-Kirch-Allstate-FINAL
Cathy Kirch
 
Six Sigma Training Tutorial for industrial engineering in factory.pdf
Six Sigma Training Tutorial for industrial engineering in factory.pdfSix Sigma Training Tutorial for industrial engineering in factory.pdf
Six Sigma Training Tutorial for industrial engineering in factory.pdf
abdulrohman195
 
Design for Six Sigma - An Overview by RAISE Ramanan Delivered at HAL Manageme...
Design for Six Sigma - An Overview by RAISE Ramanan Delivered at HAL Manageme...Design for Six Sigma - An Overview by RAISE Ramanan Delivered at HAL Manageme...
Design for Six Sigma - An Overview by RAISE Ramanan Delivered at HAL Manageme...
Ramanan Lakshminarayanan
 

Similar to AbemaTV レコメンド開発エンジニアによる RecSys 2018 参加レポート (20)

NetApp Tableau Presentation Final
NetApp Tableau Presentation FinalNetApp Tableau Presentation Final
NetApp Tableau Presentation Final
 
Oracle Cloud modernized Finance Process at CSL
Oracle Cloud modernized Finance Process at CSLOracle Cloud modernized Finance Process at CSL
Oracle Cloud modernized Finance Process at CSL
 
ARC's Sid Snitkin & Ralph Rio's AIM Workshop at ARC's 2009 Industry Forum
ARC's Sid Snitkin & Ralph Rio's AIM Workshop at ARC's 2009 Industry ForumARC's Sid Snitkin & Ralph Rio's AIM Workshop at ARC's 2009 Industry Forum
ARC's Sid Snitkin & Ralph Rio's AIM Workshop at ARC's 2009 Industry Forum
 
IT Service Catalogs: 5 Keys to Good Service Design
IT Service Catalogs: 5 Keys to Good Service DesignIT Service Catalogs: 5 Keys to Good Service Design
IT Service Catalogs: 5 Keys to Good Service Design
 
Six sigma ajal
Six sigma ajalSix sigma ajal
Six sigma ajal
 
2008_Pugh-Kirch-Allstate-FINAL
2008_Pugh-Kirch-Allstate-FINAL 2008_Pugh-Kirch-Allstate-FINAL
2008_Pugh-Kirch-Allstate-FINAL
 
Data Quality Strategies
Data Quality StrategiesData Quality Strategies
Data Quality Strategies
 
A Viable Process Model for Learning Analytics
A Viable Process Model for Learning AnalyticsA Viable Process Model for Learning Analytics
A Viable Process Model for Learning Analytics
 
Lean 6 Sigma Toolkit in PowerPoint and Excel
Lean 6 Sigma Toolkit in PowerPoint and ExcelLean 6 Sigma Toolkit in PowerPoint and Excel
Lean 6 Sigma Toolkit in PowerPoint and Excel
 
IFS Metrix Service Management: An Overview
IFS Metrix Service Management: An OverviewIFS Metrix Service Management: An Overview
IFS Metrix Service Management: An Overview
 
IT Operating model and maturity - Path to proactive IT services
IT Operating model and maturity - Path to proactive IT servicesIT Operating model and maturity - Path to proactive IT services
IT Operating model and maturity - Path to proactive IT services
 
DocOps — The Analytical Window to Your Customer’s Experience with Wade Clements
DocOps — The Analytical Window to Your Customer’s Experience with Wade ClementsDocOps — The Analytical Window to Your Customer’s Experience with Wade Clements
DocOps — The Analytical Window to Your Customer’s Experience with Wade Clements
 
Research Data Shared Service Webinar #1
Research Data Shared Service Webinar #1Research Data Shared Service Webinar #1
Research Data Shared Service Webinar #1
 
Standards metadata management - version control and its governance
Standards metadata management - version control and its governanceStandards metadata management - version control and its governance
Standards metadata management - version control and its governance
 
Sandeep Resume
Sandeep ResumeSandeep Resume
Sandeep Resume
 
All About Business Analyst Becoming a successful BA
All About Business Analyst Becoming a successful BAAll About Business Analyst Becoming a successful BA
All About Business Analyst Becoming a successful BA
 
Six Sigma Training Tutorial for industrial engineering in factory.pdf
Six Sigma Training Tutorial for industrial engineering in factory.pdfSix Sigma Training Tutorial for industrial engineering in factory.pdf
Six Sigma Training Tutorial for industrial engineering in factory.pdf
 
Selling MDM to Leadership: TCO Calculation
Selling MDM to Leadership: TCO CalculationSelling MDM to Leadership: TCO Calculation
Selling MDM to Leadership: TCO Calculation
 
Design for Six Sigma - An Overview by RAISE Ramanan Delivered at HAL Manageme...
Design for Six Sigma - An Overview by RAISE Ramanan Delivered at HAL Manageme...Design for Six Sigma - An Overview by RAISE Ramanan Delivered at HAL Manageme...
Design for Six Sigma - An Overview by RAISE Ramanan Delivered at HAL Manageme...
 
7 Key Elements for Operation Quality Improvement
7 Key Elements for Operation Quality Improvement7 Key Elements for Operation Quality Improvement
7 Key Elements for Operation Quality Improvement
 

More from cyberagent

More from cyberagent (20)

WWW2019で見るモバイルコンピューティングの技術と動向 山本悠ニ
WWW2019で見るモバイルコンピューティングの技術と動向    山本悠ニWWW2019で見るモバイルコンピューティングの技術と動向    山本悠ニ
WWW2019で見るモバイルコンピューティングの技術と動向 山本悠ニ
 
Web フィルタリング最前線: 「「検閲回避」回避」 角田孝昭
Web フィルタリング最前線: 「「検閲回避」回避」    角田孝昭Web フィルタリング最前線: 「「検閲回避」回避」    角田孝昭
Web フィルタリング最前線: 「「検閲回避」回避」 角田孝昭
 
WebにおけるHuman Dynamics 武内慎
WebにおけるHuman Dynamics    武内慎WebにおけるHuman Dynamics    武内慎
WebにおけるHuman Dynamics 武内慎
 
Webと経済学 數見拓朗
Webと経済学    數見拓朗Webと経済学    數見拓朗
Webと経済学 數見拓朗
 
Data Engineering Meetup #1 持続可能なデータ基盤のためのデータの多様性に対する取り組み
Data Engineering Meetup #1 持続可能なデータ基盤のためのデータの多様性に対する取り組みData Engineering Meetup #1 持続可能なデータ基盤のためのデータの多様性に対する取り組み
Data Engineering Meetup #1 持続可能なデータ基盤のためのデータの多様性に対する取り組み
 
継続的な開発スタイル AbemaTVのiOSアプリを週1でリリースしている話
継続的な開発スタイル AbemaTVのiOSアプリを週1でリリースしている話継続的な開発スタイル AbemaTVのiOSアプリを週1でリリースしている話
継続的な開発スタイル AbemaTVのiOSアプリを週1でリリースしている話
 
AbemaTVにおける推薦システム
AbemaTVにおける推薦システムAbemaTVにおける推薦システム
AbemaTVにおける推薦システム
 
機械学習エンジニアを見せたAWSの再:発明とは? 〜re:Invent 2018 参加レポート〜
機械学習エンジニアを見せたAWSの再:発明とは? 〜re:Invent 2018 参加レポート〜機械学習エンジニアを見せたAWSの再:発明とは? 〜re:Invent 2018 参加レポート〜
機械学習エンジニアを見せたAWSの再:発明とは? 〜re:Invent 2018 参加レポート〜
 
インターネットテレビ局「AbemaTV」プロダクトの変遷
インターネットテレビ局「AbemaTV」プロダクトの変遷インターネットテレビ局「AbemaTV」プロダクトの変遷
インターネットテレビ局「AbemaTV」プロダクトの変遷
 
番組宣伝に関するAbemaTV分析事例の紹介
番組宣伝に関するAbemaTV分析事例の紹介番組宣伝に関するAbemaTV分析事例の紹介
番組宣伝に関するAbemaTV分析事例の紹介
 
WWW2018 論文読み会  Webと経済学
 WWW2018 論文読み会  Webと経済学 WWW2018 論文読み会  Webと経済学
WWW2018 論文読み会  Webと経済学
 
WWW2018 論文読み会 WebにおけるHuman Dynamics
WWW2018 論文読み会 WebにおけるHuman DynamicsWWW2018 論文読み会 WebにおけるHuman Dynamics
WWW2018 論文読み会 WebにおけるHuman Dynamics
 
WWW2018 論文読み会 Web Search and Mining
WWW2018 論文読み会 Web Search and MiningWWW2018 論文読み会 Web Search and Mining
WWW2018 論文読み会 Web Search and Mining
 
サイバーエージェントの機械学習エンジニアが体験したGoogle I/O 2018
サイバーエージェントの機械学習エンジニアが体験したGoogle I/O 2018サイバーエージェントの機械学習エンジニアが体験したGoogle I/O 2018
サイバーエージェントの機械学習エンジニアが体験したGoogle I/O 2018
 
ログ解析基盤におけるストリーム処理パイプラインについて
ログ解析基盤におけるストリーム処理パイプラインについてログ解析基盤におけるストリーム処理パイプラインについて
ログ解析基盤におけるストリーム処理パイプラインについて
 
Orion an integrated multimedia content moderation system for web services
Orion  an integrated multimedia content moderation system for web servicesOrion  an integrated multimedia content moderation system for web services
Orion an integrated multimedia content moderation system for web services
 
Orion an integrated multimedia content moderation system for web services
Orion  an integrated multimedia content moderation system for web servicesOrion  an integrated multimedia content moderation system for web services
Orion an integrated multimedia content moderation system for web services
 
「これ危ない設定じゃないでしょうか」とヒアリングするための仕組み @AWS Summit Tokyo 2018
「これ危ない設定じゃないでしょうか」とヒアリングするための仕組み @AWS Summit Tokyo 2018「これ危ない設定じゃないでしょうか」とヒアリングするための仕組み @AWS Summit Tokyo 2018
「これ危ない設定じゃないでしょうか」とヒアリングするための仕組み @AWS Summit Tokyo 2018
 
"マルチメディア機械学習" の取り組み
"マルチメディア機械学習"  の取り組み"マルチメディア機械学習"  の取り組み
"マルチメディア機械学習" の取り組み
 
推薦アルゴリズムの今までとこれから
推薦アルゴリズムの今までとこれから推薦アルゴリズムの今までとこれから
推薦アルゴリズムの今までとこれから
 

Recently uploaded

Automobile Management System Project Report.pdf
Automobile Management System Project Report.pdfAutomobile Management System Project Report.pdf
Automobile Management System Project Report.pdf
Kamal Acharya
 
Hall booking system project report .pdf
Hall booking system project report  .pdfHall booking system project report  .pdf
Hall booking system project report .pdf
Kamal Acharya
 
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
R&R Consult
 

Recently uploaded (20)

Arduino based vehicle speed tracker project
Arduino based vehicle speed tracker projectArduino based vehicle speed tracker project
Arduino based vehicle speed tracker project
 
Electrostatic field in a coaxial transmission line
Electrostatic field in a coaxial transmission lineElectrostatic field in a coaxial transmission line
Electrostatic field in a coaxial transmission line
 
Construction method of steel structure space frame .pptx
Construction method of steel structure space frame .pptxConstruction method of steel structure space frame .pptx
Construction method of steel structure space frame .pptx
 
Automobile Management System Project Report.pdf
Automobile Management System Project Report.pdfAutomobile Management System Project Report.pdf
Automobile Management System Project Report.pdf
 
A CASE STUDY ON ONLINE TICKET BOOKING SYSTEM PROJECT.pdf
A CASE STUDY ON ONLINE TICKET BOOKING SYSTEM PROJECT.pdfA CASE STUDY ON ONLINE TICKET BOOKING SYSTEM PROJECT.pdf
A CASE STUDY ON ONLINE TICKET BOOKING SYSTEM PROJECT.pdf
 
İTÜ CAD and Reverse Engineering Workshop
İTÜ CAD and Reverse Engineering WorkshopİTÜ CAD and Reverse Engineering Workshop
İTÜ CAD and Reverse Engineering Workshop
 
retail automation billing system ppt.pptx
retail automation billing system ppt.pptxretail automation billing system ppt.pptx
retail automation billing system ppt.pptx
 
Top 13 Famous Civil Engineering Scientist
Top 13 Famous Civil Engineering ScientistTop 13 Famous Civil Engineering Scientist
Top 13 Famous Civil Engineering Scientist
 
ASME IX(9) 2007 Full Version .pdf
ASME IX(9)  2007 Full Version       .pdfASME IX(9)  2007 Full Version       .pdf
ASME IX(9) 2007 Full Version .pdf
 
ONLINE CAR SERVICING SYSTEM PROJECT REPORT.pdf
ONLINE CAR SERVICING SYSTEM PROJECT REPORT.pdfONLINE CAR SERVICING SYSTEM PROJECT REPORT.pdf
ONLINE CAR SERVICING SYSTEM PROJECT REPORT.pdf
 
KIT-601 Lecture Notes-UNIT-5.pdf Frame Works and Visualization
KIT-601 Lecture Notes-UNIT-5.pdf Frame Works and VisualizationKIT-601 Lecture Notes-UNIT-5.pdf Frame Works and Visualization
KIT-601 Lecture Notes-UNIT-5.pdf Frame Works and Visualization
 
Introduction to Casting Processes in Manufacturing
Introduction to Casting Processes in ManufacturingIntroduction to Casting Processes in Manufacturing
Introduction to Casting Processes in Manufacturing
 
Hall booking system project report .pdf
Hall booking system project report  .pdfHall booking system project report  .pdf
Hall booking system project report .pdf
 
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
 
Scaling in conventional MOSFET for constant electric field and constant voltage
Scaling in conventional MOSFET for constant electric field and constant voltageScaling in conventional MOSFET for constant electric field and constant voltage
Scaling in conventional MOSFET for constant electric field and constant voltage
 
NO1 Pandit Black Magic Removal in Uk kala jadu Specialist kala jadu for Love ...
NO1 Pandit Black Magic Removal in Uk kala jadu Specialist kala jadu for Love ...NO1 Pandit Black Magic Removal in Uk kala jadu Specialist kala jadu for Love ...
NO1 Pandit Black Magic Removal in Uk kala jadu Specialist kala jadu for Love ...
 
Cloud-Computing_CSE311_Computer-Networking CSE GUB BD - Shahidul.pptx
Cloud-Computing_CSE311_Computer-Networking CSE GUB BD - Shahidul.pptxCloud-Computing_CSE311_Computer-Networking CSE GUB BD - Shahidul.pptx
Cloud-Computing_CSE311_Computer-Networking CSE GUB BD - Shahidul.pptx
 
Introduction to Machine Learning Unit-4 Notes for II-II Mechanical Engineering
Introduction to Machine Learning Unit-4 Notes for II-II Mechanical EngineeringIntroduction to Machine Learning Unit-4 Notes for II-II Mechanical Engineering
Introduction to Machine Learning Unit-4 Notes for II-II Mechanical Engineering
 
A case study of cinema management system project report..pdf
A case study of cinema management system project report..pdfA case study of cinema management system project report..pdf
A case study of cinema management system project report..pdf
 
ENERGY STORAGE DEVICES INTRODUCTION UNIT-I
ENERGY STORAGE DEVICES  INTRODUCTION UNIT-IENERGY STORAGE DEVICES  INTRODUCTION UNIT-I
ENERGY STORAGE DEVICES INTRODUCTION UNIT-I
 

AbemaTV レコメンド開発エンジニアによる RecSys 2018 参加レポート

  • 5. RecSys Overview • • 12 • : • :10/2-7 • (10/2) • (10/3-5) • (10/6-7)
  • 6. • • Long : 18% (181 Submissions) • Short : 25% (150 Submissions) RecSys Overview
  • 8. 800 (73% ) RecSys Overview
  • 10. 10/3 10/4 10/5 Keynote1 Keynote2 Paper Session 5: RecSys that Care Paper Session 1: Explanations Paper Session 3: Learning & Optimazation Paper Session 6: Metrics & Evaluations Industry Session 1: Alogrithms Industry Session 2: System Considerations Paper Session 7: Beyond Users & Items Paper Session 2: Products Paper Session 4: Travel & Entertainment Keynote3 RecSys Overview
  • 11. KeyNote Five E’s: Reflecting on the Design of Recommendations Elizabeth F. Churchill (Google) • Explainable (understandable/intelligible) • Equitable(fair & impartial) • Ethical(morally good or correct) • Expedient (convenient & practical) • Exigent (pressing & demanding)
  • 12.
  • 13. How Algorithmic Confounding in Recommendation Systems Increases Homogeneity and Decreases Utility • feedback loop • • feedback loop https://arxiv.org/abs/1710.11214
  • 14. Unbiased Offline Recommender Evaluation for Missing-Not-At-Random Implicit Feedback • • Inverse Propensity Score • Causal Embeddings for Recommendation • Criteo AI Labs RecSys 2018 Best long paper • • Domain Adaptatin
  • 15. Calibrated Recommendations • Netflix • 70% 30% • User KL divergence (Calibration Metric) • Calibration Metric • Divercity Black : play history Red : before calibration Green : after calibration https://dl.acm.org/citation.cfm?id=3240372
  • 16. Artwork Personalization at Netflix • Netflix Industry session • (ex ) • Contextial Bandit https://medium.com/netflix-techblog/artwork-personalization-c589f074ad76 Artwork Personalization at Netflix
  • 17. Explore, Exploit, and Explain: Personalizing Explainable Recommendations with Bandits • Sportify Contextual Bandits • Contextual Bandit BART • music https://hellogiggles.com/reviews-coverage/music/spotify-playlist-favorite-songs-of-2017-wrapped/
  • 18. GENERATION MEETS RECOMMENDATION: Proposing Novel Items for Groups of Users • • item • VAE Encoder Decoder Z item z • item k Z • z Decoder item( feature) https://haroldsoh.files.wordpress.com/2018/10/sohvo_recsys18.pdf
  • 19. Interpreting User Inaction in Recommender Systems • item MovieLens • 7 ("Would Not Enjoy” “Watched” “Not Noticed” “Not Now” “ Others Better” “Explore Later or Decided To Watch”) •
  • 20. A Field Study of Related Video Recommendations: Newest, Most Similar, or Most Relevant? • CTR • MovieLens • Judging Similarity: A User-Centric Study of Related Item Recommendations • MovieLens 6 • CF
  • 21.