2008 Steg

739 views

Published on

Published in: Education, Business
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
739
On SlideShare
0
From Embeds
0
Number of Embeds
21
Actions
Shares
0
Downloads
10
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

2008 Steg

  1. 1. Making sense of collaboratively annotated multimedia metadata for (mobile) digital story-telling and educational gaming First International Workshop on Story-Telling and Educational Games (STEG 2008) Maastricht, The Netherlands September 16th 2008 Pablo Moreno Ger , Marc Spaniol, Enrique López Mañas Niels Drobek, Baltasar Fernández-Manjón Universidad Complutense RWTH - Aachen Max Planck Institute
  2. 2. Motivation <ul><li>Educational gaming could use some… </li></ul><ul><ul><li>Attractive narratives </li></ul></ul><ul><ul><li>Good stories interweaving content and interest </li></ul></ul><ul><ul><li>Well-structured and correctly paced narratives for learning situations </li></ul></ul><ul><li>Story-telling could use some… </li></ul><ul><ul><li>Visual support (eye-candy) </li></ul></ul><ul><ul><li>Interactivity </li></ul></ul><ul><li>Actually, these are not new ideas </li></ul><ul><ul><li>Games tell stories </li></ul></ul><ul><ul><li>Interactive stories are games </li></ul></ul>
  3. 3. Education 2.0 <ul><li>New media offers the consumers the opportunity of contributing their own content </li></ul><ul><ul><li>The Internet is going 2.0 </li></ul></ul><ul><ul><li>Education is going 2.0 </li></ul></ul><ul><ul><li>Even videogames are going 2.0 (MMOs, Spore) </li></ul></ul><ul><li>Web 2.0 brought forth the prosumer </li></ul><ul><ul><li>Producer + consumer </li></ul></ul><ul><li>Learning 2.0 is introducing the teaner </li></ul><ul><ul><li>Teacher + learner </li></ul></ul>
  4. 4. But… <ul><li>Can teaners really produce high-quality educational content? </li></ul><ul><ul><li>Instructor guidance </li></ul></ul><ul><ul><li>Peer-correction and improvement </li></ul></ul><ul><li>Is 2.0 educational gaming even possible? </li></ul>
  5. 5. The objectives: <ul><li>Use together digital story-telling and educational gaming platforms </li></ul><ul><li>Provide a collaborative authoring process for story-driven educational gaming </li></ul><ul><li>Facilitate the creation and maintenance of metadata annotations </li></ul>
  6. 6. MIST: Media Integrated Story-Telling <ul><li>Support of an international community of researchers in order to preserve the Afghan cultural heritage by: </li></ul>- Exchange of multimedia artifacts - MPEG-7 based semantic multimedia annotations - Re-contextualization multimedia contents via non-linear stories
  7. 7. MIST – Multimedia Management <ul><li>Creation and management: </li></ul><ul><ul><li>Media collections </li></ul></ul><ul><ul><li>Metadata </li></ul></ul><ul><ul><li>Media variations </li></ul></ul><ul><li>Collaborative indexing based on: </li></ul><ul><ul><li>Free text annotations (à la Flickr) </li></ul></ul><ul><ul><li>Semantic MPEG-7 basetypes </li></ul></ul><ul><ul><ul><li>Agent </li></ul></ul></ul><ul><ul><ul><li>Event </li></ul></ul></ul><ul><ul><ul><li>Concept </li></ul></ul></ul><ul><ul><ul><li>Object </li></ul></ul></ul><ul><ul><ul><li>Place </li></ul></ul></ul><ul><ul><ul><li>Time </li></ul></ul></ul><ul><ul><ul><li>State </li></ul></ul></ul>
  8. 8. MIST – Story Creation <ul><li>Illustration of episodic knowledge </li></ul><ul><ul><li>Modeling of non-linear stories based on Movement Oriented Design (MOD) </li></ul></ul><ul><ul><li>Decomposition of stories according to a problem hierarchy </li></ul></ul><ul><ul><li>Recall of semantic high-quality metadata on multimedia artifacts </li></ul></ul>
  9. 9. MIST – Story Consumption <ul><li>Non-linear access sequences in multimedia stories, i.e. “success vs. failure“ depending on access sequence </li></ul><ul><li>Context information via multimedia annotations </li></ul>
  10. 10. <e-Adventure> <ul><li>Instructor-oriented authoring tool for the creation </li></ul><ul><li>of low-cost educational adventure games for online education </li></ul>http://e-adventure.e-ucm.es
  11. 11. <e-Adventure> <ul><li>Instructor-oriented authoring tool for the creation </li></ul><ul><li>of low-cost educational adventure games for online education </li></ul><ul><li>Why adventure games? </li></ul><ul><ul><li>Biased for content instead of action </li></ul></ul><ul><ul><ul><li>Narrative and puzzles drive the game </li></ul></ul></ul><ul><ul><li>They promote significant learning skills </li></ul></ul><ul><ul><ul><li>Problem solving </li></ul></ul></ul><ul><ul><ul><li>Action planning </li></ul></ul></ul><ul><ul><ul><li>Exploration </li></ul></ul></ul><ul><ul><ul><li>Situated reasoning </li></ul></ul></ul><ul><ul><ul><li>Discovey-based learning </li></ul></ul></ul>
  12. 12. <e-Adventure> <ul><li>Instructor-oriented authoring tool for the creation </li></ul><ul><li>of low-cost educational adventure games for online education </li></ul>
  13. 13. <e-Adventure> <ul><li>Instructor-oriented authoring tool for the creation </li></ul><ul><li>of low-cost educational adventure games for online education </li></ul><ul><li>Games as Learning Objects </li></ul><ul><ul><li><e-Adventure> exports the games as standards-compliant Learning Objects </li></ul></ul><ul><ul><li>IMS Content Packaging + IEEE LOM Metadata </li></ul></ul>
  14. 14. The best of both worlds Game document <e-Adventure> game MIST XML-binding MIST story Edit Refine Adaptation process
  15. 15. The advantages <ul><li>MIST interactive stories can be enriched and executed in a visually appealing environment </li></ul><ul><li><e-Adventure> games can get better story-lines written in MIST </li></ul><ul><li>2.0 (1.5?) creation of educational games </li></ul>
  16. 16. Case-study: Cultural Heritage Tasks in the Bamiyan Valley <ul><li>Documentation of consolidation measures at Bamiyan cliffsite </li></ul><ul><li>Help local workers understand the task and the procedures involved </li></ul><ul><li>Gather annotated media and transmit it through story-driven educational games </li></ul>
  17. 17. The Bamiyan e-Adventure
  18. 18. But… <ul><li>Are we really using everything that </li></ul><ul><li>MIST and <eAdventure> have to offer? </li></ul>?
  19. 19. In MIST… <ul><li>MIST offers a very powerful metadata management system </li></ul><ul><ul><li>Huge media repository </li></ul></ul><ul><ul><li>MPEG-7 metadata annotated collaboratively </li></ul></ul><ul><ul><li>Metadata for each individual media resource </li></ul></ul><ul><ul><li>Different categories (location, coordinates, current state, historical interest…) </li></ul></ul><ul><ul><li>Secured database with access control </li></ul></ul>
  20. 20. In <e-Adventure>… <ul><li>Games can be exported as standards-compliant Learning Objects </li></ul><ul><ul><li>Packaged according to the IMS Content Packaging specification </li></ul></ul><ul><ul><li>Annotated with IEEE Learning Object Metadata </li></ul></ul>
  21. 21. Open questions… <ul><li>Which metadata standards should we use? </li></ul><ul><ul><li>MPEG7 </li></ul></ul><ul><ul><li>IEEE LOM </li></ul></ul><ul><ul><li>Dublin-Core </li></ul></ul><ul><li>On which level should we maintain metadata? </li></ul><ul><ul><li>Game/story </li></ul></ul><ul><ul><li>Individual resource </li></ul></ul><ul><li>How can we maintain the metadata? </li></ul><ul><ul><li>We need good tools to allow users to maintain the metadata collaboratively </li></ul></ul>
  22. 22. Resource-level metadata <ul><li>MPEG 7 seems to be the most powerful </li></ul><ul><li>Our solution: </li></ul><ul><ul><li>Use MIST metadata for the resource level </li></ul></ul><ul><ul><li>Avoid loosing the benefits of MIST when converting the story into a game </li></ul></ul>Game document <e-Adventure> game MD Unit MD Unit MD Unit <ul><li>Collaboratively annotated </li></ul><ul><li>Flexible approach </li></ul><ul><li>Exported from MIST as an XML file </li></ul><ul><li>Runtime link to MIST storage </li></ul><ul><li>Open specification: MPEG7, DublinCore, … </li></ul>
  23. 23. Game/story-level metadata <ul><li>Leverage <e-Adventure> LMS-orientation </li></ul><ul><ul><li>MPEG7 is more powerful, but IEEE LOM is more extended in educational contexts </li></ul></ul><ul><li>Our solution: </li></ul><ul><ul><li>Use IEEE LOM for game-level metadata </li></ul></ul>Learning Object (IMS Content Packaging) LO Metadata (IEEE LOM) Game document <e-Adventure> game MD Unit MD Unit MD Unit
  24. 24. Going mobile <ul><li><m-Adventure> to be released early 2009 </li></ul>
  25. 25. Going mobile <ul><li>MIST for mobile environments currently under development </li></ul><ul><ul><li>Mobile story-player </li></ul></ul><ul><ul><li>Mobile edition of media metadata </li></ul></ul><ul><li>MD-annotation in media-acquisition time </li></ul><ul><ul><li>GPS cameras </li></ul></ul><ul><ul><li>PDAs in field-work </li></ul></ul><ul><ul><li>Fast consultation of experts </li></ul></ul>
  26. 26. Metadata for mobility <ul><li>New metadata dimension </li></ul><ul><ul><li>Device capabilities and profiles </li></ul></ul><ul><li>Available standards/specifications </li></ul><ul><ul><li>MPEG-7: Good for media, poor for hardware </li></ul></ul><ul><ul><li>MPEG-21: Hardware descriptions </li></ul></ul><ul><ul><li>W3C’s Composite Capabilities/Preferences Profiles (CC/PP) </li></ul></ul><ul><ul><li>UAProf </li></ul></ul><ul><ul><li>Wireless Universal Resource File (WURFL) </li></ul></ul><ul><ul><li>… </li></ul></ul>
  27. 27. Conclusions <ul><li>MIST + <e-Adventure> is: </li></ul><ul><ul><li>Web 2.0 creation of educational adventure games </li></ul></ul><ul><ul><li>Enriched game-like interactive story-telling </li></ul></ul><ul><ul><li>Story-driven educational gaming </li></ul></ul><ul><li>Metadata gathering and maintenance is a significant but necessary challenge </li></ul><ul><ul><li>Profesional annotation of metadata does not work </li></ul></ul><ul><ul><li>Collaborative tagging does work (at least in the Web 2.0) </li></ul></ul><ul><li>Metadata for multimedia and education: complicated </li></ul><ul><ul><li>Different specifications for different purposes </li></ul></ul><ul><li>Metadata for mobility: complete mess </li></ul><ul><ul><li>Too many competing formats </li></ul></ul>
  28. 28. Future work <ul><li>Completing the integration between MIST and <e-Adventure> </li></ul><ul><ul><li>Two-way metadata interoperability </li></ul></ul><ul><li>Collaborative development of story-driven educational games </li></ul><ul><ul><li>Tap into RWTH Aachen’s vast repository of annotated media </li></ul></ul><ul><li>Mobile versions of both MIST and <e-Adventure> </li></ul><ul><ul><li>Assure the interoperability from the beginning </li></ul></ul><ul><ul><li>Unification of mobile metadata approaches </li></ul></ul>
  29. 29. Your turn…
  30. 30. Making sense of collaboratively annotated multimedia metadata for (mobile) digital story-telling and educational gaming First International Workshop on Story-Telling and Educational Games (STEG 2008) Maastricht, The Netherlands September 16th 2008 Pablo Moreno Ger , Marc Spaniol, Enrique López Mañas Niels Drobek, Baltasar Fernández-Manjón Universidad Complutense RWTH - Aachen Max Planck Institute

×