© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
A Five-Star
Rating System for
Semantic Search
Andreas Blumauer
CEO of Semantic Web Company
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
Key questions in this talk
● Beyond precision and recall: What makes a ‘good’ search?
● Beyond document search: What other types of
‘semantic search’ exist?
● Beyond search: What other use case scenarios than ‘search’
benefit from linked data and knowledge graphs?
2
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
Connotation of ‘semantic’
From: Wortschatz Leipzig - http://wortschatz.uni-leipzig.de/
3
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
Some facts and figures
Vertical search & Enterprise search:
● Currently 201 ‘Semantic Search’ Startups (https://angel.co/semantic-search)
● Around US$ 900 million of venture capital
Web search:
● Wikipedia’s pageviews declined 21% the year after Google Knowledge Graph
was launched
● Google search volume for json-ld
4
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
Diverse promises made by
‘Semantic Search’ vendors
Use
Weotta
and get
inspired.
Search is outdated. Google
steers you to right section of
the library, but doesn’t
answer your question or
compile that answer with
others to help you make a
decision.
Ambiance can
automatically match the
meaning of the page to
the products that are
most contextually
relevant in real time.
Benefit from
additional insights
through interactive
visualizations of
reports and search
results derived from
your data lake
5
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
So, what is ‘Semantic Search’?
It’s all about improved user experience, no matter
how complex information procurement is:
I am a web shopper.
I want to have nice buying
experiences when using an
online shop.
I am a doctor. I need a 360-
degree view on my patient. I
don’t have the time to search
around.
6
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
Semantic Search is about
precise contextualization (personalisation)
Semantic search engines are able to link entities in a
meaningful way. They extend graphs ‘on-the-fly’ by
reusing already existing knowledge graphs.
“Which skateboard fits to my
jacket and its manufacturer also
produces snowboards?”
“Which new medical studies
about allergy ABC talk also
about symptoms related to my
current patient?”
7
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
A simple semantic search engine
“Which new medical studies
about allergy ABC talk also
about symptoms related to my
current patient?”
eyes allergy symptoms Go!
ocular allergy symptom
itchy eyes
8
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
A simple semantic search engine
“Which new medical studies
about allergy ABC talk also
about symptoms related to my
current patient?”
eyes allergy symptoms Go!
ocular allergy symptom
itchy eyes
There are various
semantic technologies
to produce this additional
contextualization.
9
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
‘Search’ by extending graphs ‘on-the-fly’
owns
fits
with
fits with“Which skateboard fits with my
jacket and its manufacturer also
produces snowboards?”
produces
produces
Snowboardis a
Skateboardis a
10
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
‘Semantic Re-Engineering’
based on Text Mining
11
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
Semantic Authoring
“Organizations should
focus on semantic
consistency and
performance in
upstream applications
and data stores
instead of information
consolidation in a
data lake.” Gartner
12
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
The Semantic Web and Schema.org
What does it mean for Enterprises?
● 30% of all HTML pages contain structured data
(Source: https://commoncrawl.org/, 2014)
● 5 million web sites provide Schema.org data (Source: Google, 2014)
13
Source:TFF2015,ChristianBizer,Uni
Mannheim
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
Search, analytics and new insights
The IKEA principle
14
More:http://www.confluentforms.com/2015/05/semantic-search-strategy.html
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
Semantic Web and Linked Data
15
+ + =
Structured and
Unstructured Data
Taxonomies Linked (Open) Data
Semantic Search &
Analytics
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
● ‘Interpretation’ of information demand
by any means whatsoever
(see: ‘semantic re-engineering’)
● Single information source
● No explicit metadata, no standards
● Application: Query expansion, Search refiners
● Example: www.reegle.info/clean-energy-search
1-star Semantic Search
16
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
● ‘Interpretation’ of information demand
based on a multi-lingual, controlled vocabulary
including multi-faceted hierarchies
● Single information source
● Explicit metadata layer
● Application: Faceted search
● Example: www.eip-water.eu/my-market-place/news
2-star Semantic Search
17
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
● ‘Interpretation’ of information demand based on
multi-lingual, controlled vocabularies including
multi-faceted hierarchies
● Multiple information sources incl. user profiles
● Explicit and harmonised metadata layer, SKOS
● Typical application: Integrated search /
personalisation
● Example: www.healthdirect.gov.au
3-star Semantic Search
18
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
● ‘Interpretation’ of information demand based on
multi-lingual, interlinked KOS
● Multiple information sources transformed and
stored in a Linked Data RDF Warehouse
● Explicit and harmonised metadata layer accessible
via SPARQL endpoint
● Typical application: Business Analytics
● Example: integrator.poolparty.biz/report_medicine
4-star Semantic Search
19
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
● ‘Interpretation’ of information demand
based on multi-lingual, interlinked KOS
● Multiple information sources
transformed to RDF in real-time
● Explicit & harmonised metadata layer
accessible via federated SPARQL endpoint
5-star Semantic Search
20
Bootstrapping a Virtual
Semantic Data Warehouse
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
A Five-Star Rating System for
Semantic Search
Precise interpretation of information demand
Multilingual, multi-faceted search
Multiple sources
SPARQL-enabled
Federated
21
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
The Rating System
from a UX perspective
Higher recall
Higher precision
Less browsing, personalisation
New insights
Real-time
22
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
SPARQL is the new King of all
Data Scientist’s tools
Read more on LinkedIn Pulse
23
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
Example: Disease Prevalence Analysis
The semantic approach for
tracking scientific
publications
24
© Semantic Web Company - http://www.semantic-web.at/ and http://www.poolparty.biz/
Connect
Andreas Blumauer, MScIT
CEO, Semantic Web Company
a.blumauer@semantic-web.at
http://at.linkedin.com/in/andreasblumauer
https://twitter.com/semwebcompany
https://ablvienna.wordpress.com/
Sorry, no Facebook!
25

111 Blumauer - A Five-Star Rating System for Semantic Search

  • 1.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ A Five-Star Rating System for Semantic Search Andreas Blumauer CEO of Semantic Web Company
  • 2.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ Key questions in this talk ● Beyond precision and recall: What makes a ‘good’ search? ● Beyond document search: What other types of ‘semantic search’ exist? ● Beyond search: What other use case scenarios than ‘search’ benefit from linked data and knowledge graphs? 2
  • 3.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ Connotation of ‘semantic’ From: Wortschatz Leipzig - http://wortschatz.uni-leipzig.de/ 3
  • 4.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ Some facts and figures Vertical search & Enterprise search: ● Currently 201 ‘Semantic Search’ Startups (https://angel.co/semantic-search) ● Around US$ 900 million of venture capital Web search: ● Wikipedia’s pageviews declined 21% the year after Google Knowledge Graph was launched ● Google search volume for json-ld 4
  • 5.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ Diverse promises made by ‘Semantic Search’ vendors Use Weotta and get inspired. Search is outdated. Google steers you to right section of the library, but doesn’t answer your question or compile that answer with others to help you make a decision. Ambiance can automatically match the meaning of the page to the products that are most contextually relevant in real time. Benefit from additional insights through interactive visualizations of reports and search results derived from your data lake 5
  • 6.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ So, what is ‘Semantic Search’? It’s all about improved user experience, no matter how complex information procurement is: I am a web shopper. I want to have nice buying experiences when using an online shop. I am a doctor. I need a 360- degree view on my patient. I don’t have the time to search around. 6
  • 7.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ Semantic Search is about precise contextualization (personalisation) Semantic search engines are able to link entities in a meaningful way. They extend graphs ‘on-the-fly’ by reusing already existing knowledge graphs. “Which skateboard fits to my jacket and its manufacturer also produces snowboards?” “Which new medical studies about allergy ABC talk also about symptoms related to my current patient?” 7
  • 8.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ A simple semantic search engine “Which new medical studies about allergy ABC talk also about symptoms related to my current patient?” eyes allergy symptoms Go! ocular allergy symptom itchy eyes 8
  • 9.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ A simple semantic search engine “Which new medical studies about allergy ABC talk also about symptoms related to my current patient?” eyes allergy symptoms Go! ocular allergy symptom itchy eyes There are various semantic technologies to produce this additional contextualization. 9
  • 10.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ ‘Search’ by extending graphs ‘on-the-fly’ owns fits with fits with“Which skateboard fits with my jacket and its manufacturer also produces snowboards?” produces produces Snowboardis a Skateboardis a 10
  • 11.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ ‘Semantic Re-Engineering’ based on Text Mining 11
  • 12.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ Semantic Authoring “Organizations should focus on semantic consistency and performance in upstream applications and data stores instead of information consolidation in a data lake.” Gartner 12
  • 13.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ The Semantic Web and Schema.org What does it mean for Enterprises? ● 30% of all HTML pages contain structured data (Source: https://commoncrawl.org/, 2014) ● 5 million web sites provide Schema.org data (Source: Google, 2014) 13 Source:TFF2015,ChristianBizer,Uni Mannheim
  • 14.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ Search, analytics and new insights The IKEA principle 14 More:http://www.confluentforms.com/2015/05/semantic-search-strategy.html
  • 15.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ Semantic Web and Linked Data 15 + + = Structured and Unstructured Data Taxonomies Linked (Open) Data Semantic Search & Analytics
  • 16.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ ● ‘Interpretation’ of information demand by any means whatsoever (see: ‘semantic re-engineering’) ● Single information source ● No explicit metadata, no standards ● Application: Query expansion, Search refiners ● Example: www.reegle.info/clean-energy-search 1-star Semantic Search 16
  • 17.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ ● ‘Interpretation’ of information demand based on a multi-lingual, controlled vocabulary including multi-faceted hierarchies ● Single information source ● Explicit metadata layer ● Application: Faceted search ● Example: www.eip-water.eu/my-market-place/news 2-star Semantic Search 17
  • 18.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ ● ‘Interpretation’ of information demand based on multi-lingual, controlled vocabularies including multi-faceted hierarchies ● Multiple information sources incl. user profiles ● Explicit and harmonised metadata layer, SKOS ● Typical application: Integrated search / personalisation ● Example: www.healthdirect.gov.au 3-star Semantic Search 18
  • 19.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ ● ‘Interpretation’ of information demand based on multi-lingual, interlinked KOS ● Multiple information sources transformed and stored in a Linked Data RDF Warehouse ● Explicit and harmonised metadata layer accessible via SPARQL endpoint ● Typical application: Business Analytics ● Example: integrator.poolparty.biz/report_medicine 4-star Semantic Search 19
  • 20.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ ● ‘Interpretation’ of information demand based on multi-lingual, interlinked KOS ● Multiple information sources transformed to RDF in real-time ● Explicit & harmonised metadata layer accessible via federated SPARQL endpoint 5-star Semantic Search 20 Bootstrapping a Virtual Semantic Data Warehouse
  • 21.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ A Five-Star Rating System for Semantic Search Precise interpretation of information demand Multilingual, multi-faceted search Multiple sources SPARQL-enabled Federated 21
  • 22.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ The Rating System from a UX perspective Higher recall Higher precision Less browsing, personalisation New insights Real-time 22
  • 23.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ SPARQL is the new King of all Data Scientist’s tools Read more on LinkedIn Pulse 23
  • 24.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ Example: Disease Prevalence Analysis The semantic approach for tracking scientific publications 24
  • 25.
    © Semantic WebCompany - http://www.semantic-web.at/ and http://www.poolparty.biz/ Connect Andreas Blumauer, MScIT CEO, Semantic Web Company a.blumauer@semantic-web.at http://at.linkedin.com/in/andreasblumauer https://twitter.com/semwebcompany https://ablvienna.wordpress.com/ Sorry, no Facebook! 25