1. UMIC Workshop on Future Mobile
Applications
UMIC Workshop
on Future Mobile
Applications
Virtual Campfire
iNMV - Storytelling on the iPhone
Yiwei Cao and Xi Chen
Information Systems & Databases
RWTH Aachen University
February 26, 2010
Aachen, Germany
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CC-0210-1

2. Agenda
UMIC Workshop
on Future Mobile
Applications
UMIC: Ultra High-speed Mobile Information and
Communication
Virtual Campfire: community-aware context-aware
semantics-aware multimedia storytelling
– Mobile multimedia management
– Virtual Campfire architecture and concept
– Conclusions and outlook
Virtual Campfire iNMV
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CC-0210-2

3. UMIC Research Cluster
UMIC Workshop
on Future Mobile
Applications
A research cluster established under DFG Excellence
Initiative (2006 – 2011)
Interdisciplinary research cooperation in four research areas
(over 15 institutions)
– Mobile applications and services - Future mobile Web services
and applications
– Wireless transport platforms
– RF subsystem and SoC design
– Performance and reliability, security and privacy, energy efficiency,
and software quality
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CC-0210-3

4. Challenges for Mobile Multimedia
Management
UMIC Workshop
on Future Mobile
Applications
Communities produce and consume media at different places, times, etc.
Semantic mapping of context information
– GPS data -> Tribunes, Curves, etc. (Places)
– Time data -> Lap, Start, Finish, Box stop, etc. (Events)
– Racing car data –> Ferrari, McLaren-Mercedes, BMW-Sauber Community, etc. (Agents)
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CC-0210-4

5. Awareness of Community, of Context
and of Semantics
UMIC Workshop
on Future Mobile
Applications
To improve mobile multimedia management through bridging multimedia
semantics and multimedia context
Professional community support for multimedia management
Multimedia SPARQL
resources
MPEG‐7
Ontology A
(Commsonomy) Ontology B Context
Dublin Core
OWL
Precise
RDFS Domain multimedia
TV‐Anytime Information query results
RDF
EXIF
Lehrstuhl Informatik 5
... Community of
(Informationssysteme)
Prof. Dr. M. Jarke Practice (CoP)
I5-CC-0210-5

6. Virtual Campfire Architecture
UMIC Workshop
on Future Mobile
Applications
(Mobile) Context-Aware Services
Interfaces Data Sources
Storytelling Story Template Map Comsonomy SNA
Media Services Services Services Services Services
Creation
Databases
Media
Tagging
Multimedia Semantics Manager
Connectors: HTTP, SOAP
Media
Search Metadata
Multimedia Multimedia Multimedia
Semantic Adaptation Annotation MPEG-7 Services
Browsing
Multimedia
Multimedia
Multimedia Multimedia Multimedia Multimedia
Repository
Storytelling Player Input Repository
Repository
Mashups WWW
Session User Object Data
Manager Manager Manager Access
Community Engine (LAS)
Invoking services Data flows
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CC-0210-6

7. Virtual Campfire Concept
UMIC Workshop
on Future Mobile
Applications
Semantization
Data repository: cultural heritage, Multimedia management: tagging,
Web 2.0 user generated media etc. semantic annotation
Contextualization
Mobile information capture
Mobile provisioning
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CC-0210-7 Mobile media creation, sharing, and storytelling Multimedia storytelling: collaboration, stereotyping

8. Conclusions
UMIC Workshop
on Future Mobile
Applications
Mobile multimedia management is a complex process: cross-platform
and cross-community
Virtual Campfire for mobile multimedia management
Interoperability enhancement with multimedia metadata standards [KSC*05b]
Community-aware static multimedia adaptation based on community clustering
algorithms [KSCa06]
Context-aware dynamic multimedia adaptation based on semantic enrichment
of multimedia Information [CKHJ08]
Bridging multimedia semantics and multimedia context to reduce data
uncertainty [CKKh09]
Web 2.0 based storytelling on Community of Practice [CKMa08]
Multimedia storytelling for cultural heritage domains [KCJa09]
The storytelling workshop: Workshop on Storytelling and Educational
Lehrstuhl Informatik 5
(Informationssysteme)
Games (STEG)
Prof. Dr. M. Jarke
I5-CC-0210-8

9. Virtual Campfire Goes On ...
UMIC Workshop
on Future Mobile
Applications
Event based
mobile gaming?
Mobile storytelling for
better multimedia
creation and sharing
Template-based
adaptive storytelling
Storytelling for
mobile gaming
Location/navigation LBS Storytelling
for cultural
heritage
Entertaining
Sensing the world via mobile devices
Mobile Situated bilingual Mobile context-
community vocabulary learning aware Chinese
support and poetry learning
Social networking success games
measure
Personal http://www.merinews.com/article/top-10-google-
Lehrstuhl Informatik 5
information android-applications-in-2009/15792647.shtml
(Informationssysteme) management http://androidcommunity.com/top-10-uk-android-
Prof. Dr. M. Jarke
I5-CC-0210-9
/assistant market-apps-revealed-by-t-mobile-20090217/

10. References
UMIC Workshop
on Future Mobile
Applications
R. Klamma, Y. Cao, M. Jarke: Storytelling on the Web 2.0 as a New Means of Creating Arts,
Borko Furht (eds.): Handbook of Multimedia for Digital Entertainment and Arts, Springer, 2009,
pp. 623-650
Y. Cao, A. Hannemann, R. Klamma, D. Renzel: A Community Success Model for Gaming
Communities, Journal of Multimedia, Vol. 4, No. 2 (2009), pp. 87-93, April 2009, Academy
Publisher
D. Renzel, R. Klamma, Y. Cao, D. Kovachev: Virtual Campfire - Collaborative Multimedia
Semantization with Mobile Social Software, Proc. of the 10th International Workshop of the
Multimedia Metadata Community on Semantic Multimedia Database Technologies
(SeMuDaTe'09), CEUR Workshop Proceedings, Vol. 539, Graz, Austria, December, 2009
Y. Cao, M. Jarke, R. Klamma, O. Mendoza, S. Srirama: Mobile Access to MPEG-7 Based
Multimedia Services, Proc. of the Tenth International Conference on Mobile Data Management,
May 18-20, 2009, Taipei, Taiwan, pp. 102-111
Y. Cao, R. Klamma, M. Hou, M. Jarke: Follow Me, Follow You - Spatiotemporal Community
Context Modeling and Adaptation for Mobile Information Systems , Proc. of the 9th
International Conference on Mobile Data Management, April 27-30, 2008, Beijing, China, pp.
108-115
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CC-0210-10

11. iNMV - Agenda
UMIC Workshop
on Future Mobile
Applications
iNMV Features
Developing Environment
Implementation
Our experiences
Installation
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CC-0210-11

12. iNMV Features
Multimedia
UMIC Workshop
on Future Mobile
Applications
Media Search
– Page based results browser
– Scrollable original image preview
– Metadata panel which shows tags,
description and MPEG-7 semantic
descriptions
Media Creation
– Get photos from camera or library
– Annotate Media
– Generate MPEG-7 compatible semantic
descriptions
Lehrstuhl Informatik 5
Keywords Auto-completion
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CC-0210-12

13. iNMV Features
Storytelling
UMIC Workshop
on Future Mobile
Applications
Features
– Story browser
– Story player with video capability
– Play, Pause, Fast Forward, and Rewind
– Metadata panel
Story repository
– YouTell saves stories in a repository
– iNMV refreshes the story list and downloads
stories directly
Story format
– SMIL (Synchronized Multimedia Integration
Language) files generated by YouTell client
– For composing interactive multimedia
Lehrstuhl Informatik 5
(Informationssysteme)
presentations
Prof. Dr. M. Jarke
I5-CC-0210-13

14. iNMV Developing Environments
UMIC Workshop
on Future Mobile
Applications
iPhone 3G
– OS Version 3.1.3
XCode
– Version 3.1.2
– API & Conceptual Documents
iPhone SDK with Simulator
– Version 3.2 beta
Language
– Objective-C
– C
Instrument
– Monitor application performance
Lehrstuhl Informatik 5
(Informationssysteme)
– Measure memory usage
Prof. Dr. M. Jarke
I5-CC-0210-14

15. Cocoa Design Patterns
UMIC Workshop
on Future Mobile
Applications
Delegation
– To notify an event is occurring
– Run custom codes inside a complex object
Model View Controller
– Model: The underlying data engine
– View: Define the user interface
– Controller: Bridge between model and view
Target-Action
– One object sends messages to another
– E.g. a button sends an action to the controller
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CC-0210-15

16. UI Design Principles
UMIC Workshop
on Future Mobile
Applications
Displaying area are limited on the iPhone
– Focus on user’s data
– One thing at a time
– Use Tab Bar to separate different windows
Lehrstuhl Informatik 5 – Use Navigation Bar for streamlined operations
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CC-0210-16

17. Memory Management
UMIC Workshop
on Future Mobile
Applications
Conventional Cocoa memory management
– Reference counting system
– Track your own references
– The runtime does the memory freeing job
– Allocation/Release/Retainment
– “Alloc, copy, new” operations return a retained object
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CC-0210-17

18. Memory Management Strategies
UMIC Workshop
on Future Mobile
Applications
Garbage Collection is not supported
Whenever alloc an object, always remember to release it
Lazy Initialization to save memory
Use separated XIB files for performance
Set a variable to nil after you release it (especially for NSTimers)
Do not use over 20 MB of memory
Respond to low memory warnings
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CC-0210-18

19. iNMV Communicates to VC
UMIC Workshop
on Future Mobile
Applications
Communication with HTTP Connector
– Send HTTP Requests to the Connector
– Requested service and method are determined by the HTTP URL
– Parameters are wrapped in an XML document which is
encapsulated in the HTTP Header
The underlying XML processor
– XML Encoder/Decoder
– NSXML* classes are missing on the iPhone
– Use Goolge‘s Objective-C wrapper around libxml2
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CC-0210-19

20. Lessons Learned
UMIC Workshop
on Future Mobile
Applications
Time-consuming operations freeze the UI
– They can be dispatched to other threads
Download large amount of data also causes non-responsiveness
– Use asynchronized download procedure
When UI is waiting for some data processes
– Show a progress bar or an activity indicator
Mobile multimedia adaptation
– Delivering suitable contents to the mobile phone
– Expansive operations should be taken care of by the server
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CC-0210-20

21. iNMV Installation
UMIC Workshop
on Future Mobile
Applications
For workshop participants with iPhone: installation possible at
Demo session
We’ll setup the a profile for you during the demo, following
things are needed:
– Your iPhone
– Your iPhone’s Identifier(ID)
– A valid account (please register at http://vermeer.informatik.rwth-
Lehrstuhl Informatik 5
aachen.de:9080/LASRegistration/index.jsp)
(Informationssysteme)
Prof. Dr. M. Jarke
I5-CC-0210-21
– Community: UMIC