In this slides I present my work in multimedia and how I try to always include the user into the whole picture.

1. THE HUMAN SIDE OF
MULTIMEDIA SYSTEMS
MICHAEL RIEGLER
http://goo.gl/uU5J6h

2. Outline
Research topics
What we did so far
Future work

3. Overview research topics
Crowdsourcing
Medical Video
Analysis
Serious Games
Parallel
Processing
Social
Computing

4. Parallel processing
Real time processing of huge multimedia
workloads
Switch from batch to near realtime
Videos and large scale image datasets

5. Crowdsourcing
Use humans for tasks that computers can not do
Can help in many research areas
An easy way to perform user studies
But can be complicated

6. Serious games and
gamification
Rising star in the multimedia community
Try to use game mechanics for collecting data
from users
Gamify boring tasks
You can be creative!
Very interesting for MHealth

7. Social event detection
Event segmentation
Event synchronisation
Event classification
Rising field because of the huge amount of
collected data from the users

8. Medical video analysis
Can help to make tasks for doctors much easier
Very challenging to get data
Analysis of the videos is a challenging task too
Quit unexplored area (apart from colonoscopy)

9. What we did so far…
Intentional framing theory
Perception of deception
Annotation and analysis of medical videos
Annotation of game videos
Social event synchronisation
Serious game for eye tracking
Gamification of cancer screening
Crowdsourcing
Parallel processing (just started)

10. Intentional framing theory
Analyse multimedia content
based on the creators intent
New vista in multimedia
research
Watch my ACM HRHR talk

11. Perception of deception
How manipulated images
are used online
Detect them automatically

12. Annotation and analysis of
medical videos
Annotation tools
Hand drawn annotation
Semi supervised annotation
Endoscopic surgery events
Analysis: object tracking,
etc.

13. MEDANNOTATION TOOL

14. SEMI SUPERVISED ANNOTATION TOOL

15. EVENT MODEL

16. Social event
synchronisation
Synchronisation of
multimedia collections
Based on global image
features
MediaEval participation
Best results

17. Annotation of video games
Like a tool for sportscaster
VideoJot
Combines zooming (Axel
Carlier), drawn annotation
and like lines (Raynor
Vliegendhart)

18. Serious game for eye
tracking
A serious game as an
substitute for eye tracking
First studies showed that it
works

19. Gamification of cancer
screening
Proposal for preliminary
research
Increase the awareness for
cervical and breast cancer
screening
Together with the software
engineering group

20. Crowdsourcing
Gamification of
crowdsourcing
Improving the quality
Save costs
Intrinsic vs. extrinsic
motivation

21. Parallel processing
Explore state of the art
Try different frameworks
Collect data for a large scale experiment (related
to all other research topics)

22. And we did some art…

23. WHAT COMES NEXT…

24. Geo location estimation for
large scale data processing
Real time analysis of videos
GeoMM community gets bigger and bigger
Plan is to establish it as an own research field
Can be used for many systems:
Real time recommendation
Location based video guide etc.

25. Social Event Segmentation
Extend our work from MediaEval
Event classification based on global image
features

26. Gamification of cancer
screening
Wait for the proposal
Develop a gamified app for it

27. Perception of Deception
Detecting Manipulated images and how they are
used online
Dataset creation almost finished
Next step: Analysis
Create a own MediaEval task

28. Serious Game for
Eyetracking
Very good feedback at ACM MM
Next step: compare with real eye tracking
Possibility for a collaboration with University of
Florida

29. Permanent Crowdsourcing
Multimedia System
Possible collaboration with Vincent Carvillat and
Axel Carlier
To test multimedia systems (like annotation tools
etc.)
Never ending crowdsourcing for semi supervised
learning

30. Continue with intentional
framing
Specification of framing categories
User studies
Use of computer vision

31. THANK YOU