SocialZap      Enriching Television Content with                Social MediaBouke HuurninkSealincMediaSymposium23-11-2012
COMMITkickoff20 March 2012
Imagine you are a television         producer
You increasingly put content          online
But someone is taking your viewers     – and your ad revenue…
Why are they going to     YouTube?
The Power of SocialThe crowd decides what’sinteresting
How can we use the power of         social?
Introducing…SocialZap
SocialZap1.   Give it a television broadcast, it finds     popular topics in online chatter2.   It then identifies the ‘Za...
Zap Points gohere(or we can make you acool new website)
Who are we?
The SocialZap partners   Language analysis         pros          Computer vision              experts   Software     pros ...
How will we do it?
SocialZap – how it works1.   Collect tweets for your broadcasts2.   Analyse them for popular (visual) topics3.   Learn a v...
SocialZapUsing the crowds to find the crowds (and get back your ad revenue)
That was the pitch• Now for the nitty-gritty stuff
System module dataflow                                Central Server Tweet           Caption            Video             ...
System module dataflow                                Central Server Tweet           Caption            Video             ...
System module dataflow                                Central Server Tweet           Caption            Video             ...
System module dataflow                                Central Server Tweet           Caption            Video             ...
System module dataflow                                Central Server Tweet           Caption            Video             ...
System module dataflow                                Central Server Tweet           Caption            Video             ...
Status• System-level   – Designed blueprint of the system architecture   – Determined role division among partners   – Def...
Way Forward• Version 1 of the demo 2013 Q1• Several extensions (shoud haves) are considered, e.g.,    –   Add speech recog...
On a side note• A positive development for Sound and Vision  – It is time to start integrating automatic techniques    in ...
Conclusion• SocialZap enables users to zap to popular points of  discussion• Replaces uploading to YouTube and laborious m...
SocialZap
SocialZap
SocialZap
Upcoming SlideShare
Loading in …5
×

SocialZap

923 views

Published on

'Pitch' type presentation for the SocialZap demonstrator at the SEALincMeida Symposium on 23 November 2012. Also includes an update of the current status of the R&D with the various technical partners

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
923
On SlideShare
0
From Embeds
0
Number of Embeds
311
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Television is becomingincreasinglyavailable online. People make money from ad revenue
  • A tremendousamount of materialfromtelevisionprogramming is beingposted online andviewedby home users, whopresumablylike the convenience of beingabletovview the segmentsthey are interested in without navigatingtothemmanually. Consequence = lost ad revenue
  • Short clips on a popuklar topics, so we don’t start watchingfrom the beginning of the program
  • Television is becomingincreasinglyavailable online. People make money from ad revenue
  • SocialZap

    1. 1. SocialZap Enriching Television Content with Social MediaBouke HuurninkSealincMediaSymposium23-11-2012
    2. 2. COMMITkickoff20 March 2012
    3. 3. Imagine you are a television producer
    4. 4. You increasingly put content online
    5. 5. But someone is taking your viewers – and your ad revenue…
    6. 6. Why are they going to YouTube?
    7. 7. The Power of SocialThe crowd decides what’sinteresting
    8. 8. How can we use the power of social?
    9. 9. Introducing…SocialZap
    10. 10. SocialZap1. Give it a television broadcast, it finds popular topics in online chatter2. It then identifies the ‘Zap Points’ in the broadcast for those topics3. Shares the social Zap Points on your website, identifying popular content for more viewers Goodbye YouTube!
    11. 11. Zap Points gohere(or we can make you acool new website)
    12. 12. Who are we?
    13. 13. The SocialZap partners Language analysis pros Computer vision experts Software pros The keepers of Dutch television Multimedia interfacers Social mavens all
    14. 14. How will we do it?
    15. 15. SocialZap – how it works1. Collect tweets for your broadcasts2. Analyse them for popular (visual) topics3. Learn a visual model for popular topic4. Find that topic in your broadcast5. Display in your (Uitzending Gemist) player6. Use Zap Points for sharing, commenting, and getting more viewers
    16. 16. SocialZapUsing the crowds to find the crowds (and get back your ad revenue)
    17. 17. That was the pitch• Now for the nitty-gritty stuff
    18. 18. System module dataflow Central Server Tweet Caption Video Video Front-End UsersAnalyzer Analyzer Miner Indexer Closed Captions (optional) Uitzending Beeld en Geluid Gemist User-Generated Content
    19. 19. System module dataflow Central Server Tweet Caption Video Video Front-End UsersAnalyzer Analyzer Miner Indexer Closed Captions (optional) Uitzending Beeld en Geluid Gemist User-Generated Content
    20. 20. System module dataflow Central Server Tweet Caption Video Video Front-End UsersAnalyzer Analyzer Miner Indexer Closed Captions (optional) Uitzending Beeld en Geluid Gemist User-Generated Content
    21. 21. System module dataflow Central Server Tweet Caption Video Video Front-End UsersAnalyzer Analyzer Miner Indexer Closed Captions (optional) Uitzending Beeld en Geluid Gemist User-Generated Content
    22. 22. System module dataflow Central Server Tweet Caption Video Video Front-End UsersAnalyzer Analyzer Miner Indexer Closed Captions (optional) Uitzending Beeld en Geluid Gemist User-Generated Content
    23. 23. System module dataflow Central Server Tweet Caption Video Video Front-End UsersAnalyzer Analyzer Miner Indexer Closed Captions (optional) Uitzending Beeld en Geluid Gemist User-Generated Content
    24. 24. Status• System-level – Designed blueprint of the system architecture – Determined role division among partners – Defined data exchange• Data-level – Small dataset of DWDD and POWNews video and tweets created• Component-level – Tweet analyzer provided first results – Video miner provided first results – UvA software is up-and-running on NISV server
    25. 25. Way Forward• Version 1 of the demo 2013 Q1• Several extensions (shoud haves) are considered, e.g., – Add speech recognition – User-generated content for determining tweet intent’ – Training data from tweets – Linking archive elements to identified fragments in Uitzending Gemist content.• We believe link with Use-Case 2 is most prevalent in interface that will be developed – Once interface is more concrete we should make the link explicit.• We foresee synergy with the COMMIT Infinity project, for speech recognition and twitter analysis.
    26. 26. On a side note• A positive development for Sound and Vision – It is time to start integrating automatic techniques in the archive – This is the first time computer vision software is being integrated into Sound and Vision workflow• Also, Twitter data as potentially valuable source of contextual metadata?!
    27. 27. Conclusion• SocialZap enables users to zap to popular points of discussion• Replaces uploading to YouTube and laborious manual entry• Challenging research questions around social media analysis and video analysis• Establishes computer vision workflow in audiovisual archive SocialZa p!

    ×