SlideShare a Scribd company logo
MediaEval Letter:
Context of Experience
Michael Riegler, Martha Larson, Concetto Spampinato,
Jonas Markussen, Pål Halvorsen, Carsten Griwodz
I had an Idea
but…
Pimp my Task…
lets add some
planes
give - situation
context - recommender
systems
“All meaningful and lasting change starts first in
your imagination and then works its way out.
Imagination is more important than knowledge.”
–Albert Einstein
Context of Experience
Recommending Videos Suiting a Watching Situation
Goals of the Task
Explore suitability of video
content
Watched in a certain situation
In this case airplanes
small screens, distractions…
Classify in “good” or “bad” to be
watched on an airplane
Video
Runs
Use all information
available
Content (visual, audio…)
Metadata (ratings,
comments…)
More…
Dataset
Movies collected from KLM
over 3 month
Crowdsourced user opinions
Only Workers that have
experience
Ranking of videos to get
consent
Dataset Details
Around 300 movies
Split into test and train set
(30/70)
Metadata (names, ratings…)
Audio features
Visual features
Links to videos
First Experiments
Used Data Precision Recall F1-score
Metadata 0,581 0,6 0,583
User ratings 0,371 0,609 0,461
Visual
information
0,447 0,476 0,458
Meta without
user ratings
0,524 0,516 0,519
First Experiments
Used Data Precision Recall F1-score
Metadata 0,581 0,6 0,583
User ratings 0,371 0,609 0,461
Visual
information
0,447 0,476 0,458
Meta without
user ratings
0,524 0,516 0,519
First Experiments
Used Data Precision Recall F1-score
Metadata 0,581 0,6 0,583
User ratings 0,371 0,609 0,461
Visual
information
0,447 0,476 0,458
Meta without
user ratings
0,524 0,516 0,519
First Experiments
Used Data Precision Recall F1-score
Metadata 0,581 0,6 0,583
User ratings 0,371 0,609 0,461
Visual
information
0,447 0,476 0,458
Meta without
user ratings
0,524 0,516 0,519
First Experiments
Used Data Precision Recall F1-score
Metadata 0,581 0,6 0,583
User ratings 0,371 0,609 0,461
Visual
information
0,447 0,476 0,458
Meta without
user ratings
0,524 0,516 0,519
Interesting Insights
No correlation between
popular ranking sites (IMDB,
Meteoritic…) and what
people choose
Some genres are favourite
(Comedies, Family movies
leading)
Planed Improvements
Get more data
Add more features
Collect data from people that
are actually flying (maybe
researchers are a good
choice)
Include a subtask for the
recommendation part
See You Next Year…
If you like challenges and
movies and airplanes ;-)

More Related Content

Viewers also liked

ดอกบัวหลวง
ดอกบัวหลวงดอกบัวหลวง
ดอกบัวหลวง
Pook Chotika
 
Maven & mongo & sring
Maven & mongo & sringMaven & mongo & sring
Maven & mongo & sring
Tzu Chi University
 
Group 5- Top 10 Apps
Group 5- Top 10 AppsGroup 5- Top 10 Apps
Group 5- Top 10 Apps
avaldes17
 
Alphabet memory
Alphabet memoryAlphabet memory
Alphabet memory
Grace2358
 

Viewers also liked (6)

ดอกบัวหลวง
ดอกบัวหลวงดอกบัวหลวง
ดอกบัวหลวง
 
titles
titlestitles
titles
 
Maven & mongo & sring
Maven & mongo & sringMaven & mongo & sring
Maven & mongo & sring
 
Group 5- Top 10 Apps
Group 5- Top 10 AppsGroup 5- Top 10 Apps
Group 5- Top 10 Apps
 
SUNDAR P-RESuME
SUNDAR P-RESuMESUNDAR P-RESuME
SUNDAR P-RESuME
 
Alphabet memory
Alphabet memoryAlphabet memory
Alphabet memory
 

Recently uploaded

How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
Ralf Eggert
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
Frank van Harmelen
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
Elena Simperl
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Product School
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
Product School
 
ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User Group
CatarinaPereira64715
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
Abida Shariff
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Thierry Lestable
 

Recently uploaded (20)

How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User Group
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 

Context in Multimedia Experience

  • 1. MediaEval Letter: Context of Experience Michael Riegler, Martha Larson, Concetto Spampinato, Jonas Markussen, Pål Halvorsen, Carsten Griwodz
  • 2. I had an Idea but…
  • 3. Pimp my Task… lets add some planes give - situation context - recommender systems
  • 4. “All meaningful and lasting change starts first in your imagination and then works its way out. Imagination is more important than knowledge.” –Albert Einstein
  • 5. Context of Experience Recommending Videos Suiting a Watching Situation
  • 6. Goals of the Task Explore suitability of video content Watched in a certain situation In this case airplanes small screens, distractions… Classify in “good” or “bad” to be watched on an airplane
  • 8. Runs Use all information available Content (visual, audio…) Metadata (ratings, comments…) More…
  • 9. Dataset Movies collected from KLM over 3 month Crowdsourced user opinions Only Workers that have experience Ranking of videos to get consent
  • 10. Dataset Details Around 300 movies Split into test and train set (30/70) Metadata (names, ratings…) Audio features Visual features Links to videos
  • 11. First Experiments Used Data Precision Recall F1-score Metadata 0,581 0,6 0,583 User ratings 0,371 0,609 0,461 Visual information 0,447 0,476 0,458 Meta without user ratings 0,524 0,516 0,519
  • 12. First Experiments Used Data Precision Recall F1-score Metadata 0,581 0,6 0,583 User ratings 0,371 0,609 0,461 Visual information 0,447 0,476 0,458 Meta without user ratings 0,524 0,516 0,519
  • 13. First Experiments Used Data Precision Recall F1-score Metadata 0,581 0,6 0,583 User ratings 0,371 0,609 0,461 Visual information 0,447 0,476 0,458 Meta without user ratings 0,524 0,516 0,519
  • 14. First Experiments Used Data Precision Recall F1-score Metadata 0,581 0,6 0,583 User ratings 0,371 0,609 0,461 Visual information 0,447 0,476 0,458 Meta without user ratings 0,524 0,516 0,519
  • 15. First Experiments Used Data Precision Recall F1-score Metadata 0,581 0,6 0,583 User ratings 0,371 0,609 0,461 Visual information 0,447 0,476 0,458 Meta without user ratings 0,524 0,516 0,519
  • 16. Interesting Insights No correlation between popular ranking sites (IMDB, Meteoritic…) and what people choose Some genres are favourite (Comedies, Family movies leading)
  • 17. Planed Improvements Get more data Add more features Collect data from people that are actually flying (maybe researchers are a good choice) Include a subtask for the recommendation part
  • 18. See You Next Year… If you like challenges and movies and airplanes ;-)