Semantic processing of multimedia data by MPEG-7 for capacious knowledge management

1,048 views
954 views

Published on

Marc Spaniol, Ralf Klamma, Matthias Jarke
Sofsem 2002
Workshop on Multimedia Semantics
Milovy, 29th of November 2002

Published in: Technology, Education, Business
1 Comment
0 Likes
Statistics
Notes
  • Be the first to like this

No Downloads
Views
Total views
1,048
On SlideShare
0
From Embeds
0
Number of Embeds
12
Actions
Shares
0
Downloads
14
Comments
1
Likes
0
Embeds 0
No embeds

No notes for slide

Semantic processing of multimedia data by MPEG-7 for capacious knowledge management

  1. 1. Semantic processing of multimedia data by MPEG-7 for capacious knowledge management Marc Spaniol, Ralf Klamma, Matthias Jarke RWTH Aachen Milovy, 29 th of November Workshop on Multimedia Semantics
  2. 2. Agenda <ul><li>Multimedia knowledge creation </li></ul><ul><li>Framework of community-centred knowledge management </li></ul><ul><ul><li>Transcription </li></ul></ul><ul><ul><li>Addressing </li></ul></ul><ul><ul><li>Localization </li></ul></ul><ul><li>Semantic knowledge management by XML and MPEG-7 </li></ul><ul><li>The Virtual Entrepreneurship Lab (VEL) </li></ul><ul><li>Conclusion & Outlook </li></ul>
  3. 3. Knowledge creation process <ul><li>Making implicit knowledge </li></ul><ul><li>explicit (Externalization) </li></ul><ul><li>Management of </li></ul><ul><li>explicit data </li></ul><ul><li>(Combination) </li></ul><ul><li>Retrieval of </li></ul><ul><li>explicit knowledge </li></ul><ul><li>(Internalization) </li></ul><ul><li>Sharing of </li></ul><ul><li>implicit knowledge </li></ul><ul><li>(Socialization) </li></ul><ul><li> There is no media free knowledge  (Multi) media semantics? </li></ul><ul><li> Knowledge Management = Multimedia Management + Ontologies </li></ul>Externalization Internalization implicit explicit implicit explicit Combination Socialization The Knowledge-Creating Company [Nonaka, Takeuchi 95]
  4. 4. How to transfer media dependent knowledge? <ul><li>Multimedia Concepts </li></ul><ul><li>Explanation of activities </li></ul><ul><li>Media versatility </li></ul><ul><li>Unspecified information </li></ul><ul><li>Sample creation </li></ul><ul><li>Learning by doing </li></ul><ul><li>Ontologies </li></ul><ul><li>Abstraction of information </li></ul><ul><li>Strict classification and categorization of data </li></ul><ul><li>Modeling of data sources and information types </li></ul><ul><li>Creation of domain specific structures </li></ul><ul><li>Predefined data structures </li></ul>
  5. 5. Analysis of knowledge management concepts  Goal: Combining their benefits by simultaneously reducing their deficits
  6. 6. Knowledge creation framework: Transcription - Addressing - Localization <ul><li>New computer science approach: </li></ul><ul><li>Combination of ontologies </li></ul><ul><li>and multimedia concepts </li></ul><ul><li> Supporting Transcription </li></ul><ul><li>by (re-) combination of </li></ul><ul><li>transcription tools </li></ul><ul><li> Stabilization Addressing </li></ul><ul><li> Optimizing Localization </li></ul><ul><li>Testing in an interdisciplinary </li></ul><ul><li>collaborative research center </li></ul>Externalization Internalization implicit explicit implicit explicit Combination Socialization The Knowledge-Creating Company [Nonaka, Takeuchi 95] Transcribing – Media/Reading [Jäger, Stanitzek 02] Signals of disturbance [Kümmel, Schüttpelz 02] Multimedia Concepts Ontologies
  7. 7. Semantics in community multimedia
  8. 8. Structural and content based KM with XML and MPEG-7 Basis Schema- Links&Media Basic Basic Tools Localization Tools datatypes XML MPEG-7 [IEEE 02] User interaction User preferences Usage History Navigation & Access Index Views Variations Content organization Collections Models Creation & Production Content Management Media Usage Content description Structural aspects Semantic aspects
  9. 9. <ul><li>< Mpeg7 > </li></ul><ul><li>... </li></ul><ul><li>< ContentDescription xsi:type =&quot; ContentEntityType &quot;> </li></ul><ul><li>< MultimediaContent xsi:type =&quot; VideoType &quot;> </li></ul><ul><li>... </li></ul><ul><li>< VideoSegment id =&quot; seg1 &quot;> </li></ul><ul><li>< TextAnnotation type =&quot; Question &quot;> </li></ul><ul><li>question </li></ul><ul><li></ TextAnnotation > </li></ul><ul><li>< TextAnnotation type =&quot; Categories &quot;> </li></ul><ul><li>related categories </li></ul><ul><li></ TextAnnotation > </li></ul><ul><li>< TextAnnotation type =&quot; Phases &quot;> phases of an entrepreneurship </li></ul><ul><li></ TextAnnotation > </li></ul><ul><li>< TextAnnotation type =&quot; Persons &quot;> </li></ul><ul><li>founder </li></ul><ul><li></ TextAnnotation > </li></ul><ul><li>< TextAnnotation type =&quot; Companies &quot;> </li></ul><ul><li>company name </li></ul><ul><li></ TextAnnotation > </li></ul><ul><li>< MediaTime > </li></ul><ul><li>starting and ending point of the medium </li></ul><ul><li></ MediaTime > </ VideoSegment > </li></ul><ul><li>... </li></ul><ul><li></ MultimediaContent > </li></ul><ul><li></ ContentDescription > </li></ul><ul><li>... </li></ul><ul><li></ Mpeg7 > </li></ul>Structuring of heterogenous Data data XML 3-dimensional Categorization Multimedia Information Additional Information
  10. 10. <ul><li>< Mpeg7 > </li></ul><ul><li>< DescriptionMetadata id =&quot; Kais Rolle &quot;> </li></ul><ul><li>general information about the document </li></ul><ul><li></ DescriptionMetadata > </li></ul><ul><li>< ContentDescription xsi:type =&quot; ContentEntityType &quot;> </li></ul><ul><li>< MultimediaContent xsi:type =&quot; MultimediaCollectionType &quot;> </li></ul><ul><li>< ContentCollection name =&quot; Kais Rolle ”> </li></ul><ul><li>< TextAnnotation > </li></ul><ul><li>Collection type (public/private) </li></ul><ul><li></ TextAnnotation > </li></ul><ul><li>< Content xsi:type =&quot; ImageType &quot;> </li></ul><ul><li>Medium, technical Data, Annotations </li></ul><ul><li></ Content > </li></ul><ul><li>< Content xsi:type =&quot; VideoType &quot;> </li></ul><ul><li>--- </li></ul><ul><li></ Content > </li></ul><ul><li></ ContentCollection > </li></ul><ul><li></ MultimediaContent > </li></ul><ul><li></ ContentDescription > </li></ul><ul><li>< ContentManagement xsi:type =&quot; UserDescriptionType &quot;> </li></ul><ul><li>user management </li></ul><ul><li></ ContentManagement > </li></ul><ul><li></ Mpeg7 > </li></ul>Content and context description by MPEG-7 Multimedia Information Transcription Addressing
  11. 11. Case study: Didactic concept of VEL <ul><li>Hypermedia learning environment </li></ul><ul><li>Extensive, close to reality media material </li></ul><ul><li>Explorative, non-linear learning </li></ul><ul><li>Context dependent presentation </li></ul><ul><li>Repeated considerations due to context changes </li></ul><ul><li>Learning structure: </li></ul><ul><ul><li>Student = explorer </li></ul></ul><ul><ul><li>Teacher = consultant, mentor </li></ul></ul><ul><li>Public / private collections </li></ul><ul><li>Users‘ annotations </li></ul>
  12. 12. Virtual Entrepreneurship Lab (VEL)
  13. 13. <ul><li>MPEG-7 helps to overcome gap between </li></ul><ul><li>Multimedia Concepts and Ontologies </li></ul><ul><li>Combining loose characterization and generic classification </li></ul><ul><li>with domain modeling and categorization </li></ul><ul><li>Research on personalization and adaptive user interfaces </li></ul><ul><li>Current projects at : i5 </li></ul><ul><li>SOCRATES: Chat/Talk-tool for aphasics self help groups </li></ul><ul><li>MARS: Electronic music analysis tool </li></ul><ul><li>MECCA : Virtual movie archive for cinematic scientists </li></ul><ul><li> Covering multimedia semantics by MPEG-7 </li></ul><ul><li> Personalized multimedia addressing </li></ul>Conclusion & Outlook
  14. 14. Contact <ul><li>mspaniol @ cs . rwth - aachen .de </li></ul><ul><li>klamma @ cs . rwth - aachen .de </li></ul><ul><li>jarke @ cs . rwth - achen .de </li></ul>www.graeculus.de

×