Workshop on Semantic Multimedia Database Technologies 2009 (SeMuDaTe‘09) Dominik Renzel, Patrick Schlebusch, Ralf Klamma, YiweiCao, Dejan, Kovachev Informatik5 (Information Systems), RWTH Aachen University 2.12.2009 Graz, Austria

1. Workshop on Semantic Multimedia
Database Technologies 2009 (SeMuDaTe‘09)
Virtual Campfire –
Collaborative Multimedia Semantization with
SeMuDaTe‘09
Mobile Social Software
D. Renzel
P. Schlebusch
Y. Cao
R. Klamma
D. Kovachev
Dominik Renzel, Patrick Schlebusch,
Ralf Klamma, Yiwei Cao, Dejan Kovachev
Informatik 5 (Information Systems), RWTH Aachen University
2.12.2009
Lehrstuhl Informatik 5
(Informationssysteme)
Graz, Austria
Prof. Dr. M. Jarke
I5-RSK*-1209-1

2. Agenda
 Introduction
SeMuDaTe‘09
– Use Case Scenario
– Technical Background
Demonstration
D. Renzel

P. Schlebusch
Y. Cao
R. Klamma
D. Kovachev
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-RSK*-1209-2

3. Use Case Scenario –
Mobile Event Scouting
Hey, Johannes, you are at SeMuDaTe, demo session now. will share photo.
right? Is itinteresting. So Mathias is also
Seems worth going there? Think about Pic ready. Search for “graz and semudate“
coming too... come too! I’ll be back!
there... Will
SeMuDaTe‘09
Arnold heard of SeMuDaTe Workshop (Event) and thinks of participating. He
knows that his pal Johannes is currently (Time) there (Place) and sees him
online in his XMPP chat client roster. Arnold contacts Johannes and asks if it‘s
worth taking the private jet to participate.
D. Renzel
Arnold – Johannes answers from his iPhone XMPP chat client, that an interesting Johannes –
P. Schlebusch
Y. Cao Potential Event Visitor demo is currently ongoing and announces to share an image from the room. Mobile Event Scout
R. Klamma
D. Kovachev
Johannes uses the multimedia annotation tool iNMV on his iPhone to capture
a photo of the scenery and to tag it with the keywords "semudate" und
"demo". Afterwards, he informs Arnold, that the photo is ready.
Arnold starts NMVx on his laptop and searches for Johannes‘ photo. In
addition to the already existing spatiotemporal semantic annotations created
by Johannes‘ iNMV, he annotates the photo with the Event “SeMuDaTe 2009“.
Applications: Having a closer look, Arnold recognizes his good friend Mathias Lux and adds Applications:
a respective Agent annotation.
• NMVx (SMRA) • iNMV (SMRA)
• Pidgin (Chat) Being satisfied with the collaboratively created semantic annotations, Arnold • OneTeam (Chat)
Lehrstuhl Informatik 5
(Informationssysteme) responds that he will redirect his private jet to Graz to join the event.
Prof. Dr. M. Jarke
I5-RSK*-1209-3

4. Use Case Scenario –
Mobile Event Scouting
Hey, Johannes, you are at SeMuDaTe, demo session now. will share photo.
right? Is itinteresting. So Mathias is also
Seems worth going there? Think about Pic ready. Search for “graz and semudate“
coming too... come too! I’ll be back!
there... Will
SeMuDaTe‘09
Arnold heard of SeMuDaTe Workshop (Event) and thinks of participating. He
knows that his pal Johannes is currently (Time) there (Place) and sees him
online in his XMPP chat client roster. Arnold contacts Johannes and asks if it‘s
worth taking the private jet to participate.
D. Renzel
Arnold – Johannes answers from his iPhone XMPP chat client, that an interesting Johannes –
P. Schlebusch
Y. Cao Potential Event Visitor demo is currently ongoing and announces to share an image from the room. Mobile Event Scout
R. Klamma
D. Kovachev
Johannes uses the multimedia annotation tool iNMV on his iPhone to capture
a photo of the scenery and to tag it with the keywords "semudate" und
"demo". Afterwards, he informs Arnold, that the photo is ready.
Arnold starts NMVx on his laptop and searches for Johannes‘ photo. In
addition to the already existing spatiotemporal semantic annotations created
by Johannes‘ iNMV, he annotates the photo with Event “SeMuDaTe 2009“.
Applications: Having a closer look, Arnold recognizes his good friend Mathias Lux and Applications:
adds a respective Agent annotation.
• NMVx (SMRA) • iNMV (SMRA)
• Pidgin (Chat) Being satisfied with the collaboratively created semantic annotations, Arnold • OneTeam (Chat)
Lehrstuhl Informatik 5
(Informationssysteme) responds that he will redirect his private jet to Graz to join the event.
Prof. Dr. M. Jarke
I5-RSK*-1209-4

5. Technical Background
Integrated Communication & MPEG-7 Services
MPEG-7 Service Invocation • Multimedia Content DS
SeMuDaTe‘09 • LAS XMPP Connector & Extension API • Semantic DS
• IM, Presence, Roster: XMPP Core Specification
• MPEG-7 Services: Jabber RPC (XEP-009)
D. Renzel
P. Schlebusch
Y. Cao
R. Klamma
D. Kovachev
Semi-Automatic MPEG-7 Semantic
Multimedia Annotation
• Mobile Devices: Java ME, iPhone, Android
• Sensors: Camera, GPS Receiver, Gyro, etc.
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-RSK*-1209-5