Presentation 17 may morning casestudy 1 sam davies

943 views
871 views

Published on

Published in: Entertainment & Humor
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
943
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
13
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Presentation 17 may morning casestudy 1 sam davies

  1. 1. R&D © BBC 2012Automatic Mood Classification of TVProgrammesSam Davies, Jana Eggink, Denise BlandBBC Research & Development
  2. 2. R&D © BBC MMVIIIBritish Broadcasting Corporation Archive• BBC I&A– Perivale, London– >1,000,000 items• ~ 650,000 TV• ~ 350,000 Radio• ~ 1.5 million hours– Since 1922• BBC Redux– online– 300,000 hours of TV and radio– Since 2007• BBC Written Archive– 4 ½ miles of documents– Caversham, Reading
  3. 3. R&D © BBC MMVIIICurrent Programme Retrieval• Infax– > 1,500,000 programmes• LonClasss– > 52,000 concepts• “pop music”, “Iraq”, “criticismof growing plants for biofuels”,“Dover Castle communicationscentre”, “fake psychics”,“posters of Ariel Sharon”.– BBC Redux
  4. 4. R&D © BBC MMVIIICurrent Programme Retrieval – BBC Internal• Infax– > 1,500,000 programmes• LonClasss– > 52,000 concepts• “pop music”, “Iraq”, “criticismof growing plants for biofuels”,“Dover Castle communicationscentre”, “fake psychics”,“posters of Ariel Sharon”.– BBC Redux– BBC Snippets
  5. 5. R&D © BBC MMVIIICurrent Programme Retrieval – Public facing• BBC iPlayer– Catch-up service– Known item search– Standard categorisation
  6. 6. R&D © BBC MMVIIICurrent Programme Retrieval – Public facing• BBC iPlayer– Catch-up service– Known item search– Standard categorisation• bbc.co.uk/programmes– More episodes– Editorially chosen similarprogrammes
  7. 7. R&D © BBC MMVIIICurrent Programme Retrieval – Public facing• BBC iPlayer– Catch-up service– Known item search– Standard categorisation• bbc.co.uk/programmes– More episodes– Editorially chosen similarprogrammes• Link key contributors– Editorially identified– Automatically linked
  8. 8. R&D © BBC MMVIIIMood Based Classification – System overviewFeature Extraction• Video & Audio Analysis– Colour histogram, motiondetection, brightness.– Spectral audio components• Object identification– Faces, animals, objects(Tardis)– Gunshots, laughter, screaming
  9. 9. R&D © BBC MMVIIIMood Based Classification: Ground truth collection• Ground Truth Collection– Video• 200 members of public from varieddemographic• 250 programmes• Asked to classify programme clipsbased around adjectives takenfrom Affective Theory
  10. 10. R&D © BBC MMVIIIMood Based Classification - GUI
  11. 11. R&D © BBC MMVIIIMood Based Classification - GUI
  12. 12. R&D © BBC MMVIIIOther mood based features - Music• Ground Truth Collection– Video• 200 members of public fromvaried demographic• 250 programmes– Music• MusicalMoods– 20,000 members ofpublic– 60 theme tunes
  13. 13. R&D © BBC MMVIIIOther mood based features - Text• Identify mood of any text on three axis:– Valence (positive/negative) e.g. triumphant, love, paradise– Arousal (amount of emotion instilled) e.g. rage, thrill, explosion– Dominance (power) e.g. winner, confident, admired• Increases dimensionality of sentiment analysis• Use on large datasets negates requirement for syntactical analysis• Subtitles are more correct than derived metadata (automatic speech transcripts, machinevision, machine listening)• Fast, scalable• Domain independent
  14. 14. R&D © BBC MMVIIIOther mood based features - Text
  15. 15. R&D © BBC MMVIIIOther mood based features: TextPrecision 0.95Recall 0.91F1 Score 0.93
  16. 16. R&D © BBC MMVIIIFuture areas - Combination of Affect and Semantic
  17. 17. R&D © BBC MMVIIIFuture areas - Highlights Generation• Sports matches– Audio based analysis– Two stages• Live match identification• Interesting section detected– Accuracy of 78%– Looking currently to includesocial media to increaseaccuracy.
  18. 18. R&D © BBC MMVIIIPublications & more info• Davies, S., Bland, D. & Grafton R (2010) “A Framework for Automatic Mood Classification of TV Programmes”presented at SAMT 2010.• Davies, S. (2010) “Interestingness Detection in Sports Audio Broadcasts” presented at IEEE ICMLA 2010• Knoiusz, P. & Mikolajcyzk, K. (2011) “Soft Assignment Of Visual Words As Linear Coordinate Coding AndOptimisation Of Its Reconstruction Error” presented at ICIP 2011• Knoiusz, P. & Mikolajcyzk, K. (2011) “Spatial Coordinate Coding To Reduce Histogram Representations, DominantAngle and Colour Pyramid Match” presented at ICIP 2011• Davies, S. & Bland, D. (2011) “An Improved Framework for Affective Classification and Browsing of Large ScaleBroadcast Archives” presented at ACM SIGIR 2011• Mann, M. & Cox, T. (2011) “Music Mood Classification of Television Theme Tunes” presented at ISMIR 2011• Davies, S., Mann, M., Cox, T. & Allen, P. (2011) “Musical Moods: A Mass Participation Experiment for Affective MusicClassification” presented at ISMIR 2011• Eggink, J. Allen, P. & Bland, D. (2011) “A Pilot Study for Mood-Based Classification of TV programmes” presented atACM SIGAC 2011• Eggink, J. & Bland, D. (2012) “A Large Scale Experiment for Mood-Based Classification of TV Programmes”presented at ICME 2012• Available at http://www.bbc.co.uk/rd/publications/whitepapers.shtml
  19. 19. R&D © BBC MMVIIIThank you• Questions• Contact;– sam.davies@bbc.co.uk

×