Real-time Generation of Topic Maps from Speech Streams

1,104 views

Published on

Topic Maps are means for representing sophisticated indexes of any information collections for the purpose of semantic information. The creation of Topic Maps bases on a theoretic fundament which is introduced in this paper. Moreover, the Observation Principle is the result of a deep investigation of the Subject Equality Decision Chain will be discussed as well as the Semantic Talk System which generates sophisticated, conceptual indexes of speech streams in realtime. This paper describes how these indexes are created, how they are represented as Topic Maps and how they can be used for integration purposes.

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,104
On SlideShare
0
From Embeds
0
Number of Embeds
19
Actions
Shares
0
Downloads
12
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Real-time Generation of Topic Maps from Speech Streams

  1. 1. Real-Time Generation of Topic Maps from Speech Streams <ul><ul><li>TMRA'05 </li></ul></ul><ul><ul><li>Internatioal Workshop on Topic Maps Research and Applications 06.10.2005 </li></ul></ul><ul><ul><li>Karsten Böhm, Lutz Maicher </li></ul></ul><ul><ul><li>University of Leipzig </li></ul></ul><ul><ul><li>boehm|maicher@informatik.uni-leipzig.de </li></ul></ul>
  2. 2. Introduction <ul><li>Topic Maps are means for </li></ul><ul><ul><li>representing (powerful) indexes </li></ul></ul><ul><ul><li>of any information collection </li></ul></ul><ul><ul><li>for semantic information integration </li></ul></ul><ul><li>Our goal: </li></ul><ul><ul><li>real-time generation of conceptual indexes of speech streams, </li></ul></ul><ul><ul><li>represented as Topic Maps </li></ul></ul><ul><ul><li>for integration with other information systems </li></ul></ul>
  3. 3. How to create Topic Maps <ul><li>Topic Maps are a semantic technology ... </li></ul><ul><ul><li>...only in the perspective of information integration </li></ul></ul><ul><ul><li>holding the Co-location objective always true </li></ul></ul><ul><ul><li>„ Subject Proxies indicating identical Subjects has to be viewed as merged ones“ </li></ul></ul><ul><ul><ul><li>Subject Equality Decision Approach </li></ul></ul></ul><ul><ul><ul><li>Subject Viewing Approach </li></ul></ul></ul><ul><li>We have to represent the created indexes to hold the Co-location objective true in the perspective of the creator .... </li></ul><ul><li>... and therefore we need a theoretic fundament. </li></ul>
  4. 4. Subject Equality Decision Chain From the child's perspective: („Elgs are sweet.“) I caught always the same Subject, an elg. From the ranger's perspective: („Bernd needs a cow“) I caught Lisa, Ud (fighting), and Bernd (in summer, in winter and as calf). From the zoologist's perspective: („Elgs are loners.“) I caught two deers and three elgs. Are there any elgs? 1. World without any sensory system Decision about Subject Identity is a perspective dependent process under uncertainty whether Subject Stages caught at different occassions belong to the same Subject. Subject Identity 2. Sensory Systems come to stage, catching Subject Stages
  5. 5. Subject Equality Decision Chain 3. Documenting the impressions (from the rangers perspective) 2. Sensory Systems come to stage, catching Subject Stages (1) Subjectness : I'm only interested in Lisa, Ud, and Bernd not in snow, trees. (2) Creating Subject Proxies for the current Subject Stages of Lisa, Ud and Bernd (3) Try to document the decision about the Subject Identity of the current Subject Stage by the given means of the governing SMD ontology, TMV ontology and TMV vocabulary. Subject Identity of Subject Stages is mapped to Subject Indication of the Subject Proxy (4) Document all further information observed about the Subject Stage. (Documenting = modelling = loosing information) 4. Subject Equality is decided according to the governing SMD Are there any elgs? 1. World without any sensory system
  6. 6. Subject Equality Decision Chain <ul><li>Co-Location Objective: Subject Proxies indicating identical Subjects </li></ul><ul><ul><li>World without any sensory system </li></ul></ul><ul><ul><ul><li>How to make a qualified assertion about the very nature of Subjects? </li></ul></ul></ul><ul><ul><li>Sensory systems come on stage, catching Subject Stages </li></ul></ul><ul><ul><ul><li>Never Subjects, only Subject Stages (see Quine) are observed </li></ul></ul></ul><ul><ul><ul><li>Subject Identity = Subject Stages caught at different occassions belong to the same Subject (see Vatants hubjects) </li></ul></ul></ul><ul><ul><ul><ul><li>perspective dependent (see Biezunsky) </li></ul></ul></ul></ul><ul><ul><ul><ul><li>decision process under uncertainty </li></ul></ul></ul></ul><ul><ul><li>Documenting the impressions from a perspective </li></ul></ul><ul><ul><ul><ul><li>Subjectness in the current perspective </li></ul></ul></ul></ul><ul><ul><ul><ul><li>observations are documented restricted by the available vocabulary (SMD Ontology, TMV ontology, TMV vocabulary) </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Decision about Subject Identity is documented according to the governing Subject Indication Approach </li></ul></ul></ul></ul><ul><ul><li>Subject Equality is decided according to a SMD </li></ul></ul>
  7. 7. The Observation Principle (1.) Observe the information collections in interest (texts, video streams, etc.) and detect Subject Stages of Subjects in interest from the current perspective. (3.) Create a Subject Proxy for each Subject Stage in interest. (4.) Document the decision about the Subject Identity of the current Subject Stage by the given means of the governing SMD ontology, TMV ontology and TMV vocabulary. ( ... and with respect to all expected Subject Equality Decision Approaches applied later to this Subject Proxy) (5.) Document all further information observed about the Subject Stage by the given means of the governing SMD ontology, TMV ontology and TMV vocabulary. .. or how to create Topic Maps from digital domains? (2.) Decide about the Subject Identity of the observed Subject Stages.
  8. 8. The Semantic Talk System <ul><li>Focusses on the support of group oriented conversation </li></ul><ul><li>Implementation of a “minimal invasive” IT-solution </li></ul><ul><li>Application for interviewing scenarios, innovation processes and early stages of product development </li></ul><ul><li>Semantic Talk creates powerful, conceptual indexes of Speech Streams in real-time </li></ul><ul><li>Combines speech recognition (LinguaTec’s VoicePro) with Text Mining algorithms </li></ul><ul><li>Provides dynamic visualization (extended Version of TouchGraph) </li></ul><ul><li>Networked application with multiple clients </li></ul><ul><li>Provides a generic RDF-export </li></ul><ul><li>Cooperation with University Duisburg-Essen, ISA Informationssysteme GmbH </li></ul>
  9. 9. SemantikTalk: Speech recognition and text Mining Sliders for configuration parameters (zooms) local context window Overview window (birds eye view) Window for add. Information (documents, pictures)
  10. 10. The Semantic Talk System Speech recognition 1 (VoicePro) Speech recognition n Integration und Serialization Topic & Association Extraction Background Knowledge with Semantic Relations Visualization component abc foo cdf topic3 xyz
  11. 11. <ul><ul><li>Semantic Talk creates indexes of speech streams </li></ul></ul><ul><ul><li>we have to represent them as Topic Maps </li></ul></ul><ul><ul><li>and use them for semantic information integration </li></ul></ul>
  12. 12. From RDF-output to LTM <st:node rdf:ID=&quot;node_Fisichella&quot;> <st:ID>160615</st:ID> <st:label>Fisichella</st:label> <st:nodelevel>1</st:nodelevel> <st:ref_wort_nr rdf:resource=&quot;http://www.tt.de/dtd/st/pap#node_160615&quot;/> <st:variant st:index=&quot;3&quot; st:type=&quot;4&quot; st:weight=&quot;0.3176&quot;/> </st:node> ST did observe a noticeable usage of the term &quot;Fisichella&quot; in the speech stream ... Semantic Mapping between RDF-output and Topic Map using the Omnigator ... [id7406 : id7276 = &quot;Fisichella&quot; @&quot;http://www.texttech.de/dtd/st/pap#node_160615&quot; @&quot;http://www.texttech.de/dtd/st/pap#node_Fisichella&quot;] {id7406, id3670, [[1]]} {id7406, id7650, [[160615]]} id7549( id7406 : id463, id464 : id2195 ) [id464] {id464, id1636, [[0.31766722453166335]]} {id464, id4378, [[3]]} {id464, id787, [[4]]} ... and this 'noticeable usage of the term Fisichella' becomes the Subject in the Topic Map. (Subject Identity => the same algorithms observes the 'noticable usage' twice)
  13. 13. Integration with other Topic Maps ... Starting point: Integration with an other Topic Map created by the observation principle (for example a motor-sport Topic Map) - a mapping Topic Map is needed (which should be created under the observation principle, too) ... to allow more accurate mapping decisions, it seems to be necessary that the creation process of a Topic Map needs to be documented, too. [id @&quot;http://www.formula1-fansite.org/Fisichella &quot; @&quot;http://www.texttech.de/dtd/st/pap#node_Fisichella&quot;] from the mapping perspective the same Subject is caught, - if Semantic Talk observes a noticeable usage of the term 'Fisichella' - if the motor-sport Topic Map caught a person with the same name.
  14. 14. Discussion

×