The State of Semantics Seth Grimes Alta Plana Corporation @sethgrimes Enterprise Search Summit May 15, 2012
The State of Semantics 2“A computer would deserve to be called intelligent if it could deceive a human into believing that it was human.”Our goal? http://en.wikipedia.org/wiki/File:Alan_Turing_photo.jpg
The State of Semantics 3 Are we there yet? The Far Side by Gary LarsonKen Jennings, IBM Watson, and Brad Rutter play Jeopardy! https://secure.wikimedia.org/wikipedia/en/wiki/File:Watson_Jeopardy.jpg
The State of Semantics 4Ingredients: Semantics Pragmatics Syntax … and knowledge and structure. “Reading from text in general is a hard problem, because it involves all of common sense knowledge. But reading from text in structured domains I don’t think is as hard. It is a critical problem that needs to be solved.” – Edward Feigenbaum
The State of Semantics 5Semantics: The study and use of meaning and relationships.Semantics in practice: A dismissive criticism and seven semantic technologies: “That’s just semantics.” 1. Semantic search. 2. Semantic navigation. 3. Semantic advertising. 4. Semantic content enrichment. 5. Semantic data integration. 6. The Semantic Web. 7. Semantic analysis.
The State of Semantics 6 Eugène Delacroix, St. Michael Defeats the Devil Thus the Orb he roamd With narrow search; and with inspection deep Considerd every Creature, which of all Most opportune might serve his Wiles. -- John Milton, Paradise Lost
The State of Semantics 7 Old Search Semantic Search Search on: keywords + identity, history & context Sources: content/type silos Unified Indexed: terms + metadata (properties) Returned: hit lists Categories / clusters / answers first Relevance: PageRank (Inferred) intent Prevalence: plenty of new Plenty of established platforms with old(ish) search with new(ish) search capabilities, also wanna- bes.
The State of Semantics 8New but old: Dumb and siloed
The State of Semantics 13 Information access w/structure, sentiment:Context Searchsensitive? intent? Sentiment
The State of Semantics 14From search to navigation… Semantic search finds and produces information that supports the searcher’s immediate goal, across appropriate sources. Semantic navigation lets the searcher explore the result set via relationships found in the content (and metainformation).(Advertising is pervasive. When is it semantic?)
The State of Semantics 16To enrichment and integration… Semantic enrichment and integration join across types and/or sources and/or structures, using the meaningful identifiers, to create an ensemble that is greater than the sum of the parts. Enrichment and integration involve: • Mappings and transformations. • Aggregation and collection. • All the typical data concerns: cleansing, profiling, consistency, security,…
The State of Semantics 20Where do the semantics come from?Semantic analysis discerns and extracts features including relationships from source materials.Features = entities, key-value pairs, concepts, topics, events, sentiment, etc.Semantic analysis may draw on: • Statistics. • Patterns (regular expressions). • Linguistics (lexicons and rules). • Machine learning.
The State of Semantics 21Semantic analysis fuels: • Text analytics…text-extended BI. • Search and search-based applications. • SEO.
The State of Semantics 22Text AnalyticsAs part of a larger solutions...
The State of Semantics 23Semantic analysis may also apply to: • Audio including speech. • Images. • Video. http://www.geekosystem.com/ facebook-face-recognition/ http://flylib.com/books/en/2.495.1.54/1/ http://www.sciencedirect.com/scienc e/article/pii/S0167639312000118
The State of Semantics 25 Last, the Semantic Web An assemblage of standards, protocols, and functions.http://www.cambridgesemantics.com/semantic-university/semantic-search-and-the-semantic-web http://img.freebase.com/api/trans/raw/m/02dtnzv
The State of Semantics 26 “The Semantic Web has been and remains a parallel, incomplete, never-up-to-date subset of the World Wide Web and the databases accessible through it.” – self-quote, June 2010http://www.cambridgesemantics.com/semantic-university/semantic-search-and-the-semantic-web http://img.freebase.com/api/trans/raw/m/02dtnzv
The State of Semantics 27 The state of semantics?
The State of Semantics 28 Online & social change everything.http://techpresident.com/news/21618/politico-facebook-sentiment-analysis-bogus