Web 3 Expert System


Published on

Published in: Technology, Education
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Web 3 Expert System

  1. 1. Web 3.0 Reasoning Using a Semantic Network J. Brooke Aker CEO Expert System USA Web 3.0 Conference January 26th
  2. 2. Why Use a Semantic Network? <ul><li>Semantic Networks </li></ul><ul><li>Linguistic rules </li></ul><ul><li>Sentence analysis </li></ul><ul><li>Semantic Network </li></ul><ul><li>Shallow text analytics </li></ul><ul><li>Statistics </li></ul><ul><li>Heuristic rules </li></ul><ul><li>Morphological recognition </li></ul>Keyword-based technologies Disambiguation Entity extraction Categorization Natural lang. UI Semantic Search Discovery Sentiment
  3. 3. <ul><li>The heart of semantic technology ; </li></ul><ul><ul><ul><li>Quality of results derived from the complexity and richness of the network. </li></ul></ul></ul><ul><ul><ul><li>Includes all definitions of all words. </li></ul></ul></ul><ul><ul><ul><li>Include relationships among all words. </li></ul></ul></ul>What is a Semantic Network? COGITO® English Semantic Network: - 350,000 words - 2.8m relationships
  4. 4. <ul><li>COGITO ® : deep analysis </li></ul>What Does a Semantic Network Do? 4 Approaches Definition Example Morphological Analysis understand word forms dog , dogs , and dog-catcher are closely related Grammatical Analysis understand the parts of speech &quot;There are 40 rows in the table&quot; uses rows as a noun, vs. &quot;She rows 5 times a week&quot; uses rows as a verb Logical Analysis understand how words relate to other words &quot;Jeffrey Skilling, represented by Attorney Daniel Petrocelli, is married to Rebecca Carter&quot;. Rebecca is married to Jeffrey not Daniel. Semantic Analysis (disambiguation) understand the context of key words &quot;I used beef broth for my soup stock&quot; uses stock in the context of food, vs. &quot;The company keeps lots of stock on hand&quot; uses stock in the context of inventory.
  5. 5. <ul><li>What are the parts of a Semantic Network? </li></ul><ul><li>Using human comprehension for machine understanding of text. </li></ul><ul><li>Machine understanding of text needs: </li></ul><ul><ul><li>A semantic network </li></ul></ul><ul><ul><li>A parser to trace each text back to its basic elements </li></ul></ul><ul><ul><li>A linguistic engine to query the semantic network </li></ul></ul><ul><ul><li>A system to eliminate ambiguity </li></ul></ul>Steps to establish meaning Semantic Network Parse Eliminate Ambiguity Order & Priority 1 2 3 Linguistic Query Engine
  6. 6. Semantic Networks <ul><li>Traditional technologies can only “guess” the meaning using; </li></ul><ul><ul><ul><li>keywords, shallow linguistics, & statistics </li></ul></ul></ul><ul><li>Semantic Networks instead indentify; </li></ul>“ San Jose is an American city” “ San Jose is a geographic part of California” Connections Concepts Terms Abbrev. Phrases Meanings Domains
  7. 7. How do the parts of a Semantic Network fit together?
  8. 8. Technology Stack Semantic Network Semantic Network Semantic Network Semantic Network Semantic Network Linguistic Query Engine Development Studio English Arabic Italian German Other Middle Eastern 1. Morphology 2. Grammatical 4. Disambiguation Develop & Add Custom Rules 3. Logic 80% Precision 90%+ Precision
  9. 9. Superior Performance <ul><ul><li>60KB / sec </li></ul></ul><10 -6 sec Software memory footprint (semantic net and engine) 50 MB 350,000 400,000+ 55,000 20 2,800,000 Virtually unlimited Semantic text analysis processing speed (one CPU) Scalability in number of CPUs Typical time of access to a concept in the semantic net Number of concepts in English semantic net Hyponyms and hypernyms Hypernyms and troponyms Average # of attributes for each concept Number of relations in semantic net (English)
  10. 10. Unique Feature #1 <ul><li>Expanded Definition Sets - captures all possible ways of expressing a concept, beyond the use of a single word; </li></ul><ul><ul><ul><li>Compound word – like “blackbird” or “cookbook” </li></ul></ul></ul><ul><ul><ul><li>Collocation – like “overhead projector” or “landing field” </li></ul></ul></ul><ul><ul><ul><li>Idiomatic expression – like “to fly off the handle” or “to weight anchor” </li></ul></ul></ul><ul><ul><ul><li>Locutions – group of words that express simple concepts that cannot be expressed by a single word </li></ul></ul></ul><ul><ul><ul><li>Verbal lemmas – such as a verb in the infinitive form, e.g. “to write”, or verbal collocations, e.g. “to sneak away” </li></ul></ul></ul>Keyword / Statistical and Shallow Semantic Tech Fails Here  treats “to fly off the handle” all as separate words not as a concept.
  11. 11. Unique Feature #2 <ul><li>Expanded Semantic Relations - expanded set (65) of relations between concepts by looking at their use within the text. Answers questions like “Who did what to whom?”, often called a “triple” or a subject-action-object. WordNet for example contains only 5 relation types. </li></ul>Keyword / Statistical and Shallow Semantic Tech Fails Here  treats “RIM sued Verizon” as the same thing as “Verizon sued RIM” <ul><li>Verb / Subject </li></ul><ul><li>Verb / Direct Object </li></ul><ul><li>Adjective / Class </li></ul><ul><li>Syncon / Class </li></ul><ul><li>Syncon / Corpus </li></ul><ul><li>Syncon / Geography </li></ul><ul><li>Fine Grain / Coarse Grain </li></ul><ul><li>Supernomen / Subnomen </li></ul><ul><li>Omninomen / Parsnomen </li></ul>
  12. 12. Unique Feature #3 <ul><li>Categories of Attributes – every concept in the semantic network also contains attributes which are organized into a hierarchy of categories. The attributes and categories are assigned to maximize similarities and differences between concepts as an aid in disambiguation. </li></ul>Keyword / Statistical and Shallow Semantic Tech Fails Here  can’t tell you what portions of a document are related to categorically … e.g. only points to words not sections within a long document as a first cut. object animals plants people concepts places time natural phenomena states quantity groups
  13. 13. Unique Feature #4 <ul><li>Deepest Entity Extraction Available – can identify 35+ unique entities in any text – that is roughly 3 times our nearest competitor, among these; </li></ul>Keyword / Statistical and Shallow Semantic Tech Fails Here  can’t tell you what a simple object in the text is, rather treats words only as tokens with no understanding of their context. Anniversary Address Animals City Company Continent Country Currency Date Device Email Address Event Facility Fax Number Food Holiday Market Index Medical Condition Medical Treatment Month Measure Natural Disaster Natural Feature Operating System Organization Percent Person Phone Number Plants State SSN Time URL Vehicle Year
  14. 14. Expert System Unique Feature #5 <ul><li>600 Semantic Classifications – an ability to auto-classify content at a deep level, among these; </li></ul>Keyword / Statistical and Shallow Semantic Tech Fails Here  can’t aid in the construction of metadata (information about information) for later logical storage, cache retrieval, maintenance, archiving etc. * aeronautics * breeding * mountaineering * archiving * art * craftwork * auction * astrology * automation * bank * biology * do it yourself * collecting * computer art * graphic * law * building industry * publishing * electronics * electrotechnics * energy * evolution * philosophy * physics * folklore * photography * artistic photography * geology * toys * game * computer science * engineering * education * needlework * work * literature * linguistics * knitting * mathematics * medicine * meteorology * military * fashion * design and engineering * music * jeweler's art * watch making * fishing * post * perfumery * kitchen utensils * public relations * worship * catering * health board * exact science * social science * social service * social services * sled dog * show * sport   * statistics   * musical instruments   * scuba diver   * technology   * telecommunications * thermo hydraulics * transports * tourism * crochet work * city planning * veterinary science * windsurf * zootechnics * bureaucratic terms * scientific terms * technical terms * typewriting * shorthand * pornography
  15. 15. Who Uses Semantic Networks?
  16. 16. Thank you Brooke Aker CEO of Expert System US +1 860-614-2411 [email_address] www.expertsystem.net