Your SlideShare is downloading. ×
Virtual Campfire/iNMV Storytelling on the iPhone
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Introducing the official SlideShare app

Stunning, full-screen experience for iPhone and Android

Text the download link to your phone

Standard text messaging rates apply

Virtual Campfire/iNMV Storytelling on the iPhone

1,442
views

Published on

Published in: Technology, Education

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,442
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
5
Comments
0
Likes
1
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. UMIC Workshop on Future Mobile Applications UMIC Workshop on Future Mobile Applications Virtual Campfire iNMV - Storytelling on the iPhone Yiwei Cao and Xi Chen Information Systems & Databases RWTH Aachen University February 26, 2010 Aachen, Germany Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-CC-0210-1
  • 2. Agenda UMIC Workshop on Future Mobile Applications UMIC: Ultra High-speed Mobile Information and Communication Virtual Campfire: community-aware context-aware semantics-aware multimedia storytelling – Mobile multimedia management – Virtual Campfire architecture and concept – Conclusions and outlook Virtual Campfire iNMV Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-CC-0210-2
  • 3. UMIC Research Cluster UMIC Workshop on Future Mobile Applications A research cluster established under DFG Excellence Initiative (2006 – 2011) Interdisciplinary research cooperation in four research areas (over 15 institutions) – Mobile applications and services - Future mobile Web services and applications – Wireless transport platforms – RF subsystem and SoC design – Performance and reliability, security and privacy, energy efficiency, and software quality Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-CC-0210-3
  • 4. Challenges for Mobile Multimedia Management UMIC Workshop on Future Mobile Applications Communities produce and consume media at different places, times, etc. Semantic mapping of context information – GPS data -> Tribunes, Curves, etc. (Places) – Time data -> Lap, Start, Finish, Box stop, etc. (Events) – Racing car data –> Ferrari, McLaren-Mercedes, BMW-Sauber Community, etc. (Agents) Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-CC-0210-4
  • 5. Awareness of Community, of Context and of Semantics UMIC Workshop on Future Mobile Applications To improve mobile multimedia management through bridging multimedia semantics and multimedia context Professional community support for multimedia management Multimedia   SPARQL resources MPEG‐7 Ontology A (Commsonomy) Ontology B Context Dublin Core OWL Precise  RDFS Domain  multimedia  TV‐Anytime Information query results RDF EXIF Lehrstuhl Informatik 5 ... Community of  (Informationssysteme) Prof. Dr. M. Jarke Practice (CoP) I5-CC-0210-5
  • 6. Virtual Campfire Architecture UMIC Workshop on Future Mobile Applications (Mobile) Context-Aware Services Interfaces Data Sources Storytelling Story Template Map Comsonomy SNA Media Services Services Services Services Services Creation Databases Media Tagging Multimedia Semantics Manager Connectors: HTTP, SOAP Media Search Metadata Multimedia Multimedia Multimedia Semantic Adaptation Annotation MPEG-7 Services Browsing Multimedia Multimedia Multimedia Multimedia Multimedia Multimedia Repository Storytelling Player Input Repository Repository Mashups WWW Session User Object Data Manager Manager Manager Access Community Engine (LAS) Invoking services Data flows Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-CC-0210-6
  • 7. Virtual Campfire Concept UMIC Workshop on Future Mobile Applications Semantization Data repository: cultural heritage, Multimedia management: tagging, Web 2.0 user generated media etc. semantic annotation Contextualization Mobile information capture Mobile provisioning Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-CC-0210-7 Mobile media creation, sharing, and storytelling Multimedia storytelling: collaboration, stereotyping
  • 8. Conclusions UMIC Workshop on Future Mobile Applications Mobile multimedia management is a complex process: cross-platform and cross-community Virtual Campfire for mobile multimedia management Interoperability enhancement with multimedia metadata standards [KSC*05b] Community-aware static multimedia adaptation based on community clustering algorithms [KSCa06] Context-aware dynamic multimedia adaptation based on semantic enrichment of multimedia Information [CKHJ08] Bridging multimedia semantics and multimedia context to reduce data uncertainty [CKKh09] Web 2.0 based storytelling on Community of Practice [CKMa08] Multimedia storytelling for cultural heritage domains [KCJa09] The storytelling workshop: Workshop on Storytelling and Educational Lehrstuhl Informatik 5 (Informationssysteme) Games (STEG) Prof. Dr. M. Jarke I5-CC-0210-8
  • 9. Virtual Campfire Goes On ... UMIC Workshop on Future Mobile Applications Event based mobile gaming? Mobile storytelling for better multimedia creation and sharing Template-based adaptive storytelling Storytelling for mobile gaming Location/navigation LBS Storytelling for cultural heritage Entertaining Sensing the world via mobile devices Mobile Situated bilingual Mobile context- community vocabulary learning aware Chinese support and poetry learning Social networking success games measure Personal http://www.merinews.com/article/top-10-google- Lehrstuhl Informatik 5 information android-applications-in-2009/15792647.shtml (Informationssysteme) management http://androidcommunity.com/top-10-uk-android- Prof. Dr. M. Jarke I5-CC-0210-9 /assistant market-apps-revealed-by-t-mobile-20090217/
  • 10. References UMIC Workshop on Future Mobile Applications R. Klamma, Y. Cao, M. Jarke: Storytelling on the Web 2.0 as a New Means of Creating Arts, Borko Furht (eds.): Handbook of Multimedia for Digital Entertainment and Arts, Springer, 2009, pp. 623-650 Y. Cao, A. Hannemann, R. Klamma, D. Renzel: A Community Success Model for Gaming Communities, Journal of Multimedia, Vol. 4, No. 2 (2009), pp. 87-93, April 2009, Academy Publisher D. Renzel, R. Klamma, Y. Cao, D. Kovachev: Virtual Campfire - Collaborative Multimedia Semantization with Mobile Social Software, Proc. of the 10th International Workshop of the Multimedia Metadata Community on Semantic Multimedia Database Technologies (SeMuDaTe'09), CEUR Workshop Proceedings, Vol. 539, Graz, Austria, December, 2009 Y. Cao, M. Jarke, R. Klamma, O. Mendoza, S. Srirama: Mobile Access to MPEG-7 Based Multimedia Services, Proc. of the Tenth International Conference on Mobile Data Management, May 18-20, 2009, Taipei, Taiwan, pp. 102-111 Y. Cao, R. Klamma, M. Hou, M. Jarke: Follow Me, Follow You - Spatiotemporal Community Context Modeling and Adaptation for Mobile Information Systems , Proc. of the 9th International Conference on Mobile Data Management, April 27-30, 2008, Beijing, China, pp. 108-115 Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-CC-0210-10
  • 11. iNMV - Agenda UMIC Workshop on Future Mobile Applications iNMV Features Developing Environment Implementation Our experiences Installation Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-CC-0210-11
  • 12. iNMV Features Multimedia UMIC Workshop on Future Mobile Applications Media Search – Page based results browser – Scrollable original image preview – Metadata panel which shows tags, description and MPEG-7 semantic descriptions Media Creation – Get photos from camera or library – Annotate Media – Generate MPEG-7 compatible semantic descriptions Lehrstuhl Informatik 5 Keywords Auto-completion (Informationssysteme) Prof. Dr. M. Jarke I5-CC-0210-12
  • 13. iNMV Features Storytelling UMIC Workshop on Future Mobile Applications Features – Story browser – Story player with video capability – Play, Pause, Fast Forward, and Rewind – Metadata panel Story repository – YouTell saves stories in a repository – iNMV refreshes the story list and downloads stories directly Story format – SMIL (Synchronized Multimedia Integration Language) files generated by YouTell client – For composing interactive multimedia Lehrstuhl Informatik 5 (Informationssysteme) presentations Prof. Dr. M. Jarke I5-CC-0210-13
  • 14. iNMV Developing Environments UMIC Workshop on Future Mobile Applications iPhone 3G – OS Version 3.1.3 XCode – Version 3.1.2 – API & Conceptual Documents iPhone SDK with Simulator – Version 3.2 beta Language – Objective-C – C Instrument – Monitor application performance Lehrstuhl Informatik 5 (Informationssysteme) – Measure memory usage Prof. Dr. M. Jarke I5-CC-0210-14
  • 15. Cocoa Design Patterns UMIC Workshop on Future Mobile Applications Delegation – To notify an event is occurring – Run custom codes inside a complex object Model View Controller – Model: The underlying data engine – View: Define the user interface – Controller: Bridge between model and view Target-Action – One object sends messages to another – E.g. a button sends an action to the controller Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-CC-0210-15
  • 16. UI Design Principles UMIC Workshop on Future Mobile Applications Displaying area are limited on the iPhone – Focus on user’s data – One thing at a time – Use Tab Bar to separate different windows Lehrstuhl Informatik 5 – Use Navigation Bar for streamlined operations (Informationssysteme) Prof. Dr. M. Jarke I5-CC-0210-16
  • 17. Memory Management UMIC Workshop on Future Mobile Applications Conventional Cocoa memory management – Reference counting system – Track your own references – The runtime does the memory freeing job – Allocation/Release/Retainment – “Alloc, copy, new” operations return a retained object Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-CC-0210-17
  • 18. Memory Management Strategies UMIC Workshop on Future Mobile Applications Garbage Collection is not supported Whenever alloc an object, always remember to release it Lazy Initialization to save memory Use separated XIB files for performance Set a variable to nil after you release it (especially for NSTimers) Do not use over 20 MB of memory Respond to low memory warnings Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-CC-0210-18
  • 19. iNMV Communicates to VC UMIC Workshop on Future Mobile Applications Communication with HTTP Connector – Send HTTP Requests to the Connector – Requested service and method are determined by the HTTP URL – Parameters are wrapped in an XML document which is encapsulated in the HTTP Header The underlying XML processor – XML Encoder/Decoder – NSXML* classes are missing on the iPhone – Use Goolge‘s Objective-C wrapper around libxml2 Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-CC-0210-19
  • 20. Lessons Learned UMIC Workshop on Future Mobile Applications Time-consuming operations freeze the UI – They can be dispatched to other threads Download large amount of data also causes non-responsiveness – Use asynchronized download procedure When UI is waiting for some data processes – Show a progress bar or an activity indicator Mobile multimedia adaptation – Delivering suitable contents to the mobile phone – Expansive operations should be taken care of by the server Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-CC-0210-20
  • 21. iNMV Installation UMIC Workshop on Future Mobile Applications For workshop participants with iPhone: installation possible at Demo session We’ll setup the a profile for you during the demo, following things are needed: – Your iPhone – Your iPhone’s Identifier(ID) – A valid account (please register at http://vermeer.informatik.rwth- Lehrstuhl Informatik 5 aachen.de:9080/LASRegistration/index.jsp) (Informationssysteme) Prof. Dr. M. Jarke I5-CC-0210-21 – Community: UMIC