Natural Intelligence -Commonsense Question Answeringwith Conceptual Graphs  Fatih Mehmet Güler and Aysenur Birturk  Depart...
Motivation   Massive Knowledge found as Natural Language   Text based Question Answering (no tagging)   Open Domain Que...
Summary of the System   Natural Language is parsed   Utterances are represented using CGs   Concepts and Relation types...
Summary of the System (Cont’d)                       NI           NLP        KRR       Commonsense           CCG        CG...
Background   Combinatory Categorial Grammar (CCG)       C&C Tools   Conceptual Graphs       Cogitant   Open Cyc
Combinatory Categorial Grammar (CCG)   Lexicalized Theory of Grammar based on    Categorial Grammar ( Steedman 2001).    ...
CCG parse for “Mr. Hyde ate twolemmons”
CCG Parse for “Susan knows that Boblikes Fred”
DRS for “Susan knows that Bob likesFred”
C&C Tools   Linguistically Motivated Large-Scale NLP with C&C    and Boxer. (Curran, Clark, Bos, 2007)       C&C Parser ...
C&C Tools   Large Scale NLP is possible with C&C and    Boxer   C&C Parser: state of the art parser for CCG   Boxer: Se...
Open Cyc   Open source version of Cyc system   Cyc: greatest effort to encode Common Sense    knowledge in machine proce...
Open Cyc (cont’d)   (#$likesAsFriend #$GeorgeWBush #$AlGore)   #$isa, #$genls   (#$isa #$GeorgeWBush    #$UnitedStatesP...
Cogitant   Library for Conceptual Graph operations   Supports broad CG operations (Genest &    Salvat, 1998)       Grap...
Natural Intelligence – CommonsenseQuestion Answering with CGs   Augment Common Sense knowledge   Modular Approach      ...
Architecture - Modules   Natural Language Processing (C&C Tools are used    for implementation)       Convert natural la...
System Definition   User enters a sentence from web interface;   This sentence is converted to CGIF using the NLP module...
Common Sense Mapping   Cyc: (prettyString TERM STRING)   Chain up to #$Thing using #$genls relations   Same for relatio...
Sample Concept Hierarchy   #$Place ->           #$EnduringThing-Localized ->                        #$Location-Underspe...
Conversion to Cogitant Support   Convert Cyc hierarcy to Cogitant support    format       Concept Types       Relation ...
Answering Queries
Significance   Sentences like;       What are the intangible things in this situation?       Was Mr. Hyde there while e...
Difficulties   Open Cyc API is broken       Does not work in Turkish locale (fixes are sent to        maintainers)     ...
Conclusion   Central Integrated Common Sense QAS   CCG for Natural Language Processing   Conceptual Graphs for KRR   C...
Future Work   Implement Rule Induction   Backward Chaining (Resolution)   Improve NLP module and Common Sense mapping ...
Upcoming SlideShare
Loading in...5
×

Natural Intelligence ICCS 2010

446

Published on

Fatih Mehmet Güler - Natural Intelligence ICCS 2010 paper presentation

Published in: Technology, Education
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
446
On Slideshare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
1
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Natural Intelligence ICCS 2010

  1. 1. Natural Intelligence -Commonsense Question Answeringwith Conceptual Graphs Fatih Mehmet Güler and Aysenur Birturk Department of Computer Engineering, METU 06531, Ankara/TURKEY fmguler@gmail.com birturk@ceng.metu.edu.tr
  2. 2. Motivation Massive Knowledge found as Natural Language Text based Question Answering (no tagging) Open Domain Question Answering Address Commonsense Reasoning Problem Linguistically motivated KRR  Intelligence is the accumulation of knowledge Integrate State of the Art Tools Ultimate goal: Getting closer to strong AI
  3. 3. Summary of the System Natural Language is parsed Utterances are represented using CGs Concepts and Relation types are mapped to Cyc equivalent counterparts Type hierarchies are computed Knowledge is accumulated If the input is a question  Search for answer (projection)
  4. 4. Summary of the System (Cont’d) NI NLP KRR Commonsense CCG CGs Open Cyc C&C Tools Cogitant
  5. 5. Background Combinatory Categorial Grammar (CCG)  C&C Tools Conceptual Graphs  Cogitant Open Cyc
  6. 6. Combinatory Categorial Grammar (CCG) Lexicalized Theory of Grammar based on Categorial Grammar ( Steedman 2001).  Functions can be applied or composed  Arguments can be picked up or turned into functors (Type raising) Easy for Semantic Representations  Small number of semantically transparent combinatory rules to combine CCG categories.  Assign semantic representations to the lexical entries  Interpret combinatory rules
  7. 7. CCG parse for “Mr. Hyde ate twolemmons”
  8. 8. CCG Parse for “Susan knows that Boblikes Fred”
  9. 9. DRS for “Susan knows that Bob likesFred”
  10. 10. C&C Tools Linguistically Motivated Large-Scale NLP with C&C and Boxer. (Curran, Clark, Bos, 2007)  C&C Parser  POS Tagging, Supertagging  Parsing, Chunking  Named Entity Recognition  Boxer  Uses CCG parser output  Generates DRS Semantic Representations Freely available for research  http://svn.ask.it.usyd.edu.au/trac/candc/wiki
  11. 11. C&C Tools Large Scale NLP is possible with C&C and Boxer C&C Parser: state of the art parser for CCG Boxer: Semantic representations in DRS
  12. 12. Open Cyc Open source version of Cyc system Cyc: greatest effort to encode Common Sense knowledge in machine processable way 500.000 concepts 26.000 relations and 5.000.000 assertions CycL language similar to Lisp We use Cyc to map parsed words to common sense counterparts such as person to #$Person (disambiguation)
  13. 13. Open Cyc (cont’d) (#$likesAsFriend #$GeorgeWBush #$AlGore) #$isa, #$genls (#$isa #$GeorgeWBush #$UnitedStatesPresident) (#$genls #$UnitedStatesPresident #$Person)
  14. 14. Cogitant Library for Conceptual Graph operations Supports broad CG operations (Genest & Salvat, 1998)  Graph representation  Conversion from CGIF  Projection checking  Rule application
  15. 15. Natural Intelligence – CommonsenseQuestion Answering with CGs Augment Common Sense knowledge Modular Approach  Separation of Concerns  State of the art tools
  16. 16. Architecture - Modules Natural Language Processing (C&C Tools are used for implementation)  Convert natural language to CGIF Reasoning (Cogitant library is used for implementation)  CG operations Common Sense (Open Cyc is used for implementation)  Common sense mapping Storage (Conceptual Graphs are stored in a database)  Persistence of CGs
  17. 17. System Definition User enters a sentence from web interface; This sentence is converted to CGIF using the NLP module; CGIF is converted to CGs using the reasoning module; Support is generated to CGs using the common sense module; Common sense rules gathered from common sense module are applied to CGs using reasoning module; CGs are merged to the previous ones using reasoning module; If the input sentence is a question sentence, same operations take place, except the resulting graph is used to query existing CGs using the reasoning service, and if there are projections from this query graph to previous CGs, results are displayed to the user; CGs are persisted using the storage module.
  18. 18. Common Sense Mapping Cyc: (prettyString TERM STRING) Chain up to #$Thing using #$genls relations Same for relations using #$genlPreds Relation hierarchies are converted to forward rules  #$performedBy -> #$temporallyRelated
  19. 19. Sample Concept Hierarchy #$Place -> #$EnduringThing-Localized -> #$Location-Underspecified -> #$Thing -> #$SomethingExisting -> #$Individual -> #$Thing ^^ #$Trajector-Underspecified -> #$Location-Underspecified ^^ #$TemporallyExistingThing -> #$TemporalThing -> #$Individual ^^ #$SpatialThing-Localized -> #$TemporallyExistingThing ^^ #$SpatialThing -> #$Individual ^^ #$Boundary-Underspecified -> #$Region-Underspecified -> #$Location-Underspecified ^^ #$Landmark-Underspecified -> #$Individual ^^ #$Location-Underspecified ^^ #$SpatialThing-NonSituational -> #$SpatialThing ^^ #$Individual ^^ #$Location-Underspecified ^^
  20. 20. Conversion to Cogitant Support Convert Cyc hierarcy to Cogitant support format  Concept Types  Relation Types  Individuals  Rules Convert assertions to Cogitant graph format Apply forward rules
  21. 21. Answering Queries
  22. 22. Significance Sentences like;  What are the intangible things in this situation?  Was Mr. Hyde there while eating the apples?  Does Mr. Hyde exist after eating the apples?  Do the apples exist after Mr. Hyde ate them? Deep Natural Language Understanding State of the art tools Open domain question answering
  23. 23. Difficulties Open Cyc API is broken  Does not work in Turkish locale (fixes are sent to maintainers)  Still, provided API sends one IP packet per character, way too slow over network  Custom socket API is developed and used over TCP  Custom Lisp functions for generalization hierarchy and concept mapping Cogitant problematic  Java API is very limited (compared to C++)  Only works over XML files
  24. 24. Conclusion Central Integrated Common Sense QAS CCG for Natural Language Processing Conceptual Graphs for KRR Cyc for Common Sense
  25. 25. Future Work Implement Rule Induction Backward Chaining (Resolution) Improve NLP module and Common Sense mapping Probabilistic Reasoning Question Answering System (QAS) to be used in;  Education (Learning Management Systems)  Semantic Search (Content Management Systems)  Intelligent Help
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×