SlideShare a Scribd company logo
1 of 106
Assessing, Creating and Using
Knowledge Graph Restrictions
Sven Lieber, supervised by Anastasia Dimou and Ruben Verborgh
10.03.2022 - public PhD defense
Assessing, Creating and Using
Knowledge Graph Restrictions
Sven Lieber, supervised by Anastasia Dimou and Ruben Verborgh
10.03.2022 - public PhD defense
?
Assessing, Creating and Using
? ? ?
Sven Lieber, supervised by Anastasia Dimou and Ruben Verborgh
10.03.2022 - public PhD defense
?
Crash course about the context
PhD presentation
This PhD is about information processing
Telescope science?
=> Astronomy!
Microscope science?
=> Biology!
Computer science?
=> Information!
“Computer science involves
the study of or the practice of
computation, automation,
and information” - Wikipedia
Physical chaos - hard to find, share or use things
Digital chaos - hard to find, share or use things
“24 hours in photos”, 2011 from Erik Kessels
350k printed images uploaded to Flickr in a single day
Large amount of unconnected data
What is on these two images,
and are they connected somehow?
What is what? We need semantics!
“a separate seat for one person,
typically with a back and four legs.”
- Oxford Languages
“the person in charge of a meeting or
of an organization (used as a neutral
alternative to chairman or
chairwoman)” - Oxford Languages
Please think of “a chair”
Different definitions and understanding about data
Data Silo 1 Data Silo 3
Data Silo 2
A person is alive, has a
first and last name and
has a residence address
A person is real or
fictional
A person is the user of
the app identified via
an Email address
?
?
?
How many persons can we
reach with our marketing
campaign in Ghent?
Data and data modeling using a graph
Person
Sven
Organization
University
Supervisor
Anastasia
Ruben
is subclass
is a
is subclass is subclass
UGent
is a
is enrolled at
knows
knows
is a
is a
A Knowledge Graph
(i) real world entities in a graph structure
(ii) classes and relations in a schema
(iii) linking of arbitrary entities
(iv) covers various topical domains
“Knowledge Graph Refinement: A Survey of
Approaches and Evaluation Methods”, Semantic Web
Journal, 2016, Heiko Paulheim
PhD
student
knows
is enrolled at
Link data in a flexible way
Person
Sven
Organization
University
Supervisor
Anastasia
Ruben
is subclass
is a
is subclass is subclass
UGent
is a
is enrolled at
knows
knows
is a
is a
A Knowledge Graph
(i) real world entities in a graph structure
(ii) classes and relations in a schema
(iii) linking of arbitrary entities
(iv) covers various topical domains
“Knowledge Graph Refinement: A Survey of
Approaches and Evaluation Methods”, Semantic Web
Journal, 2016, Heiko Paulheim
PhD
student
knows
is enrolled at
Express the data model in a flexible way
Person
Sven
Organization
University
Supervisor
Anastasia
Ruben
is subclass
is a
is subclass is subclass
UGent
is a
is enrolled at
knows
knows
is a
is a
A Knowledge Graph
(i) real world entities in a graph structure
(ii) classes and relations in a schema
(iii) linking of arbitrary entities
(iv) covers various topical domains
“Knowledge Graph Refinement: A Survey of
Approaches and Evaluation Methods”, Semantic Web
Journal, 2016, Heiko Paulheim
PhD
student
knows
is enrolled at
A uniform graph representation
Person
Sven
Organization
University
Supervisor
Anastasia
Ruben
is subclass
is a
is subclass is subclass
UGent
is a
is enrolled at
knows
knows
is a
is a
A Knowledge Graph
(i) real world entities in a graph structure
(ii) classes and relations in a schema
(iii) linking of arbitrary entities
(iv) covers various topical domains
“Knowledge Graph Refinement: A Survey of
Approaches and Evaluation Methods”, Semantic Web
Journal, 2016, Heiko Paulheim
PhD
student
knows
is enrolled at
Data integration because of reused definitions of things
Data Silo 1 Data Silo 3
Data Silo 2
A person is alive, has a
first and last name and
has a residence address
A person is real or
fictional
A person is the user of
the app identified via
an Email address
“A vocabulary defines the concepts
and relationships describing an area
of concern” - World Wide Web
Consortium (W3C)
Crash course about the context
-> Represent data in a uniform graph structure
PhD presentation
But how can this be used by a computer?
Data Silo 1 Data Silo 3
Data Silo 2
A person is alive, has a
first and last name and
has a residence address
A person is real or
fictional
A person is the user of
the app identified via
an Email address
Keep the flexible graph representation
in a computer readable text format by using “triples”
Person is a Class .
PhD student is subclass Person .
Supervisor is subclass Person .
University is subclass Organization .
Anastasia is a Supervisor .
Ruben is a Supervisor .
Sven is a PhD Student .
UGent is a University .
Sven is enrolled at UGent .
Reuse the web as global information system
Person is a Class .
http://xmlns.com/foaf/0.1/Person
http://www.w3.org/1999/02/22-rdf-syntax-ns#type
http://www.w3.org/2000/01/rdf-schema#Class .
foaf:Person rdf:type rdfs:Class .
Reuse the web as global information system
-> reuse of definitions for shared understanding
-> link to existing data
foaf:Person rdf:type rdf:Class .
ex:PhdStudent rdfs:subClassOf foaf:Person .
ex:Supervisor rdfs:subClassOf foaf:Person .
ex:University rdfs:subClassOf foaf:Organization .
data:anastasia rdf:type ex:Supervisor .
data:ruben rdf:type ex:Supervisor .
data:sven rdf:type ex:PhDStudent .
data:ugent rdf:type ex:University .
data:sven ex:enrolledAt data:ugent .
data:sven foaf:givenName “Sven” .
data:sven foaf:familyName “Lieber” .
Crash course about the context
-> Data in a uniform graph structure
-> Use the web to represent the graph
PhD presentation
This does not seem right to us …
UGent Sven
is enrolled at
wroteBook
Train 123
… but okay for a computer
because we did not restrict possible links
Let’s talk about semantics … again
“a separate seat for one person,
typically with a back and four legs.”
- Oxford Languages
“the person in charge of a meeting or
of an organization (used as a neutral
alternative to chairman or
chairwoman)” - Oxford Languages
Let’s talk about semantics … again
“a separate seat for one person,
typically with a back and four legs.”
- Oxford Languages
“the person in charge of a meeting or
of an organization (used as a neutral
alternative to chairman or
chairwoman)” - Oxford Languages
We can distinguish now between different things
“a separate seat for one person,
typically with a back and four legs.”
- Oxford Languages
“the person in charge of a meeting or
of an organization (used as a neutral
alternative to chairman or
chairwoman)” - Oxford Languages
Without restrictions a computer cannot differentiate
Sven
knows
?
Domain and Range axioms: “knows”
connects two instances of class Person
Axioms are “statements that are asserted to be true in the
domain being described” - OWL2 Structural Specification
and Functional-Style Syntax, W3C 2012
Provide formal meaning using axioms which supports
inferring new knowledge
Sven
knows
Domain and Range axioms: “knows”
connects two instances of class Person
Person
is a
is a
new “is a” relationships inferred!
What can be inferred here?
Sven
knows
4
has legs
?
Axiom: something with 4 legs is a chair
Ups, we created a Person-Chair
Sven
knows
4
has legs
Person
Chair
Axiom: something with 4 legs is a chair
is a
is a
is a
new “is a” relationships inferred!
Use constraints to define what is valid
Data shapes express “structural constraints to
validate instance data” - SHACL Use Cases and
Requirements, W3C 2017
Person
Birth date
Last name
First name
For example: persons need a birth
date, last name and first name
Vocabulary -> Ontology
“An Ontology is a formal, explicit
specification of a shared
conceptualization” - Thomas R. Gruber
(1993)
Person
Organization
University
Supervisor
is subclass
is subclass is subclass
PhD
student
knows
is enrolled at
“A Conceptualization is an intensional
semantic structure which encodes the
implicit rules constraining the
structure of a piece of reality” -
Guarino et al. (1995)
“The OWL 2 RDF-Based Semantics gives a formal meaning to
every RDF graph” - OWL2 RDF-based Semantics, W3C 2012
The use of restrictions varies in practice
only subclasses Different restrictions
defining formal
meaning
structured metadata in
websites using schema.org
Neuro Behavior
ontology (NBO)
A program to infer knowledge
(a reasoner) needs formal meaning
Crash course about the context
-> Data in a uniform graph structure
-> Use the web to represent the graph
-> We can restrict meaning using axioms or restrict what is
valid using constraints
PhD presentation
Crash course about the context
PhD presentation
Congratulations, you passed Knowledge Graphs 101
Assessing, Creating and Using
Knowledge Graph Restrictions
Sven Lieber, supervised by Anastasia Dimou and Ruben Verborgh
10.03.2022 - public PhD defense
Users need support
Assessing restrictions using Montolo
Creating restrictions using visual notations
Using restrictions to enable data stewardship
Conclusion
Users need support
Assessing restrictions using Montolo
Creating restrictions using visual notations
Using restrictions to enable data stewardship
Conclusion
Imagine you want to create an application (data model)
Reuse existing concepts which fit your use case
for example an event planning app
Reusing ontologies is usually a multi-step process
Discovery of reuse
candidates
Selection of
relevant
ontologies
Customization
and integration
of reused
ontologies
Imagine you want to create an application (data model)
Reuse existing concepts which fit your use case
for example an event planning app
Create your own local constraints
for example Corona measures which temporarily apply
Creating constraints
Person
Birth date
Last name
First name
USER
schema:DatedMoneySpecification
rdf:type sh:NodeShape ;
sh:closed "true"^^xsd:boolean ;
sh:ignoredProperties (
rdf:type
) ;
sh:property [
sh:path schema:amount ;
sh:datatype xsd:float ;
sh:maxCount 1 ;
sh:minCount 1 ;
] ;
sh:property [
sh:path schema:currency ;
rdfs:comment "The currency code (here) is a
mandatory property consisting of three upper-case
letters" ;
sh:datatype xsd:string ;
sh:flags "i" ;
sh:maxCount 1 ;
sh:minCount 1 ;
sh:pattern "^[A-Z]{3}$" ;
] ;
What users get!
What users want
is visual support!
Main research question
How can we support users in the assessment and in the
creation of Knowledge Graph restrictions?
Users need support
Assessing restrictions using Montolo
Creating restrictions using visual notations
Using restrictions to enable data stewardship
Conclusion
The use of restrictions varies in practice
only subclasses Different restrictions
defining formal
meaning
structured metadata in
websites using schema.org
Neuro Behavior
ontology (NBO)
A program to infer knowledge
(a reasoner) needs formal meaning
Different types of restrictions are available in RDFS/OWL
only subclasses Different restrictions
defining formal
meaning
Domain
Disjoint
Properties
Literal ranges
Reasoner
only subclasses
Different restrictions
defining formal
meaning
But some restriction types come with a high
(computational) complexity … not always needed
Domain
Disjoint
Properties
Literal ranges
Reasoner
Reusing ontologies is usually a multi-step process
Discovery of reuse
candidates
Selection of
relevant
ontologies
Customization
and integration
of reused
ontologies
Search existing repositories to reuse common
definitions
Does this vocabulary fit our use case?
Existing statistics do not provide any
information of what restrictions exist
in the vocabulary
Currently only a manual assessment
of ontologies, one by one
Ontology documentation pages
created by Widoco
Ontology loaded into the editor tool
Protégé
Discover and assess ontologies based on restriction use
Possible ontology reuse candidates
(colors = different restriction
types)
Use case
Discover and assess ontologies based on restriction use
Possible ontology reuse candidates
(colors = different restriction
types)
Restriction type
use statistics Use case
Computing the statistics - overview
LODStats
Montolo
Stats
DataCube and PROV
annotated statistics
660
ontologies
565
ontologies
31,850
observations
18 restriction types
Created statistics are FAIR
The statistics are described using
Knowledge Graphs
Dataset available via a repository
or consultable via a website
How many ontologies use each restriction type?
A few often used
restriction types and a
long tail both
in LOV and BioPortal
Restriction types
Negligible number of literal value restrictions
Almost no literalRanges
restrictions
literalPattern not used
at all
Property and cardinality restrictions in the tail
Tail mostly consists of
property-based and
cardinality-based
restrictions expressed
using OWL terms
LOV vs BioPortal: qualified cardinalities
Qualified cardinalities
preferred in BioPortal
ontologies
LOV vs BioPortal: unqualified cardinalities
Unqualified cardinalities
preferred in LOV
ontologies
Certain restrictions slightly more used in BioPortal
BioPortal ontologies
use certain restrictions
more often
Domain and range used less in BioPortal
More domain/range
Restrictions in LOV
Commonly used constraint types and unused potential
Data shapes are relatively
new, here we could only
investigate 19 data sources
Besides assessment support we learned from the statistics
and we can ask more questions
Only half of the ontologies use OWL-based axioms
Little attention for literal values
Attention with editing tools regarding a self fulfilling prophecy
Users need support
Assessing restrictions using Montolo
Creating restrictions using visual notations
Using restrictions to enable data stewardship
Conclusion
Creating constraints
USER
schema:DatedMoneySpecification
rdf:type sh:NodeShape ;
sh:closed "true"^^xsd:boolean ;
sh:ignoredProperties (
rdf:type
) ;
sh:property [
sh:path schema:amount ;
sh:datatype xsd:float ;
sh:maxCount 1 ;
sh:minCount 1 ;
] ;
sh:property [
sh:path schema:currency ;
rdfs:comment "The currency code (here) is a
mandatory property consisting of three upper-case
letters" ;
sh:datatype xsd:string ;
sh:flags "i" ;
sh:maxCount 1 ;
sh:minCount 1 ;
sh:pattern "^[A-Z]{3}$" ;
] ;
What users want
is visual support!
What users get!
Different constraint types need to be visualized
USER
Or
Disjoint
Not
What users want
is visual support!
Existing tools do not specify how to visualize
all SHACL core constraints
USER
Or
Disjoint
Existing visual tools
Based on existing cognitive theories and experiments
we can define how to systematically visualize constraint types
USER
Or
Disjoint
Moody, Daniel. "The ‘physics’ of
notations: toward a scientific basis for
constructing visual notations in software
engineering." IEEE Transactions on
software engineering 35.6 (2009): 756-
779.
Let’s reuse visual notations already familiar to users
VOWL UML
Chapter: Constraint creation
How can we support users familiar with Linked Data
in viewing RDF constraints?
Users familiar with Linked Data
can answer questions about
visually represented RDF constraints
more accurately with a VOWL-based visual notation
than with a UML-based visual notation
Systematically described visual notations
allow systematically improvements/adaptations
Compare visual notations in a user study with 12 participants
Two visual notations
to visualize the same
semantic constructs
Test case Group 1 Group 2
Test case 1 ShapeUML ShapeVOWL
Test case 2 ShapeVOWL ShapeUML
Test case 3 ShapeUML ShapeVOWL
Test case 4 ShapeVOWL ShapeUML
ShapeVOWL ShapeUML
Pre assessment (social demographics + skills)
Main questionnaire to assess
accuracy of answers to provided questions
Post assessment (opinion)
No significant error differences between answers for
ShapeUML and ShapeVOWL
Besides having 2 new visual notations,
we gained new qualitative insights!
Space efficient representation using ShapeUML
Good to have several notations because of familiarity bias
Visual features are important and can also improve ShapeUML
Users need support
Assessing restrictions using Montolo
Creating restrictions using visual notations
Using restrictions to enable data stewardship
Conclusion
Data stewardship: the long-term care of valuable digital assets
Valuable information in archived records
Historic government records or early climate data,
e.g. demographics or taxes on crop yields
Invaluable data loss
NASA is unable to locate the original high quality
moon landing video.
How about 21st century data?
Social media content influences the real world,
what if Twitter and Co are gone?
Historical records
Moon landing in the 1960s
The web and social media
BESOCIAL: a cross-institutional research project to
develop a social media archiving strategy for Belgium
Follow up of a project for
general web archiving
Lead by the Royal
Library of Belgium
Research partners
with different
expertise
Funded by the Belgian
Science Policy Office
#meToo
#IchBinHanna
@SvenLieber
@UGent
#fries
A curator creates social media collections,
possibly via crowdsourcing
A curator creates social media collections,
possibly via crowdsourcing
#meToo
#IchBinHanna
@SvenLieber
@UGent
#fries
Society
Academic
Belgium
New social media posts are “harvested” daily/weekly
#meToo
#IchBinHanna
@SvenLieber
@UGent
#fries
Society
Academic
Belgium
We are preserving content, but also doing this:
Knowledge Graph-based workflow for data stewardship
Society
#meToo
#IchBinHanna
Data
format
A
Data
format
B
Heterogeneous data sources Knowledge Graph Views on the data in different formats
Quality is use-case specific and can be
systematically defined and measured
For example quality dimension
“Rich collection description”
Quality Assessment using
Knowledge Graphs and restrictions
40 user stories such as “As an archive-user, I want to see
descriptive information about the collection from the archivist,
so I can assess if the content is relevant to me.”
Derive quality requirements such as “The description of
each collection should at least have 200 characters”
Metric: Missing collection description
Metric: Number of missing descriptions
Metric: Insufficient collection description
Metric: Number of insufficient descriptions
Report
Quality
Assessment
We could identify quality issues and their root cause
A Knowledge Graph and restrictions supported data
stewardship for social media archiving
Providing an integrated view on the data (with formal
meaning)
Assisted in an automated quality assessment by using constraints
The workflow is generalizable thus helpful in other use cases
Users need support
Assessing restrictions using Montolo
Creating restrictions using visual notations
Using restrictions to enable data stewardship
Conclusion
How can we support users in the assessment and in the
creation of Knowledge Graph restrictions?
Montolo statistics support restriction assessments
with FAIR data which was not possible before
We can rethink the value we give to restrictions, why and
how do we use restrictions systematically?
How can we support users in the assessment and in the
creation of Knowledge Graph restrictions?
There are now 2 visual notations covering all
SHACL core constraints
First steps to make Knowledge Graph constraints more
accessible to domain experts
How can we support users in the assessment and in the
creation of Knowledge Graph restrictions?
The BESOCIAL use case demonstrated the use of restrictions
to tackle data stewardship challenges
The future is less about tools and more about workflows
and data!
A circle representing the human knowledge
“The illustrated guide to a Ph.D.” - Matt Might
Little knowledge after elementary school
“The illustrated guide to a Ph.D.” - Matt Might
More knowledge after high school
“The illustrated guide to a Ph.D.” - Matt Might
Gaining speciality with the Bachelor’s degree
“The illustrated guide to a Ph.D.” - Matt Might
Deepen speciality with the Master’s degree
“The illustrated guide to a Ph.D.” - Matt Might
Reading research papers takes you to the edge of human knowledge
“The illustrated guide to a Ph.D.” - Matt Might
You focus at the boundary
“The illustrated guide to a Ph.D.” - Matt Might
You focus at the boundary for a few years
“The illustrated guide to a Ph.D.” - Matt Might
One day the boundary gives way
“The illustrated guide to a Ph.D.” - Matt Might
The dent you have made is called PhD
“The illustrated guide to a Ph.D.” - Matt Might
The world looks different to you now
“The illustrated guide to a Ph.D.” - Matt Might
Don’t forget the bigger picture
“The illustrated guide to a Ph.D.” - Matt Might
Newly raised questions: future work
Montolo provides metrics, but what are the higher level
dimensions, tools and its usability?
Why and how are restrictions used in the first place?
How do we build our future Knowledge Graphs from a
methodological point of view?
Questions & Answers
Dissertation available as PDF at https://sven-lieber.org/phd
SvenLieber sven-lieber.org
knows.idlab.ugent.be

More Related Content

What's hot

Knowledge Technologies: Opportunities and Challenges
Knowledge Technologies: Opportunities and ChallengesKnowledge Technologies: Opportunities and Challenges
Knowledge Technologies: Opportunities and ChallengesFariz Darari
 
Otsuka Talk in Dec 2017
Otsuka Talk in Dec 2017Otsuka Talk in Dec 2017
Otsuka Talk in Dec 2017Fariz Darari
 
RDA: thinking globally, acting globally
RDA: thinking globally, acting globallyRDA: thinking globally, acting globally
RDA: thinking globally, acting globallyGordon Dunsire
 
RDF and Open Linked Data, a first approach
RDF and Open Linked Data, a first approachRDF and Open Linked Data, a first approach
RDF and Open Linked Data, a first approachhorvadam
 
Question answering in linked data
Question answering in linked dataQuestion answering in linked data
Question answering in linked dataReza Ramezani
 
Linked Open Data Alignment and Enrichment Using Bootstrapping Based Techniques
Linked Open Data Alignment and Enrichment Using Bootstrapping Based TechniquesLinked Open Data Alignment and Enrichment Using Bootstrapping Based Techniques
Linked Open Data Alignment and Enrichment Using Bootstrapping Based TechniquesPrateek Jain
 
Question Answering over Linked Data: Challenges, Approaches & Trends (Tutoria...
Question Answering over Linked Data: Challenges, Approaches & Trends (Tutoria...Question Answering over Linked Data: Challenges, Approaches & Trends (Tutoria...
Question Answering over Linked Data: Challenges, Approaches & Trends (Tutoria...Andre Freitas
 
Introduction to question answering for linked data & big data
Introduction to question answering for linked data & big dataIntroduction to question answering for linked data & big data
Introduction to question answering for linked data & big dataAndre Freitas
 
FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...
FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...
FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...Carole Goble
 
Semantics-aware Techniques for Social Media Analysis, User Modeling and Recom...
Semantics-aware Techniques for Social Media Analysis, User Modeling and Recom...Semantics-aware Techniques for Social Media Analysis, User Modeling and Recom...
Semantics-aware Techniques for Social Media Analysis, User Modeling and Recom...Cataldo Musto
 
Developing Linked Data and Semantic Web-based Applications (Expotec 2015)
Developing Linked Data and Semantic Web-based Applications (Expotec 2015)Developing Linked Data and Semantic Web-based Applications (Expotec 2015)
Developing Linked Data and Semantic Web-based Applications (Expotec 2015)Ig Bittencourt
 
Datalift a-catalyser-for-the-web-of-data-fosdem-05-02-2011
Datalift a-catalyser-for-the-web-of-data-fosdem-05-02-2011Datalift a-catalyser-for-the-web-of-data-fosdem-05-02-2011
Datalift a-catalyser-for-the-web-of-data-fosdem-05-02-2011François Scharffe
 
Riding the wave - Paradigm shifts in information access
Riding the wave - Paradigm shifts in information accessRiding the wave - Paradigm shifts in information access
Riding the wave - Paradigm shifts in information accessdatacite
 
IASSIST 2012 - DDI-RDF - Trouble with Triples
IASSIST 2012 - DDI-RDF - Trouble with TriplesIASSIST 2012 - DDI-RDF - Trouble with Triples
IASSIST 2012 - DDI-RDF - Trouble with TriplesDr.-Ing. Thomas Hartmann
 

What's hot (20)

Knowledge Technologies: Opportunities and Challenges
Knowledge Technologies: Opportunities and ChallengesKnowledge Technologies: Opportunities and Challenges
Knowledge Technologies: Opportunities and Challenges
 
Otsuka Talk in Dec 2017
Otsuka Talk in Dec 2017Otsuka Talk in Dec 2017
Otsuka Talk in Dec 2017
 
RDA: thinking globally, acting globally
RDA: thinking globally, acting globallyRDA: thinking globally, acting globally
RDA: thinking globally, acting globally
 
RDF and Open Linked Data, a first approach
RDF and Open Linked Data, a first approachRDF and Open Linked Data, a first approach
RDF and Open Linked Data, a first approach
 
Question answering in linked data
Question answering in linked dataQuestion answering in linked data
Question answering in linked data
 
General Introduction for Semantic Web and Linked Open Data
General Introduction for Semantic Web and Linked Open DataGeneral Introduction for Semantic Web and Linked Open Data
General Introduction for Semantic Web and Linked Open Data
 
Linked Open Data Alignment and Enrichment Using Bootstrapping Based Techniques
Linked Open Data Alignment and Enrichment Using Bootstrapping Based TechniquesLinked Open Data Alignment and Enrichment Using Bootstrapping Based Techniques
Linked Open Data Alignment and Enrichment Using Bootstrapping Based Techniques
 
Neo4j and bioinformatics
Neo4j and bioinformaticsNeo4j and bioinformatics
Neo4j and bioinformatics
 
Question Answering over Linked Data: Challenges, Approaches & Trends (Tutoria...
Question Answering over Linked Data: Challenges, Approaches & Trends (Tutoria...Question Answering over Linked Data: Challenges, Approaches & Trends (Tutoria...
Question Answering over Linked Data: Challenges, Approaches & Trends (Tutoria...
 
Introduction to question answering for linked data & big data
Introduction to question answering for linked data & big dataIntroduction to question answering for linked data & big data
Introduction to question answering for linked data & big data
 
NISO/NFAIS Joint Virtual Conference: Connecting the Library to the Wider Worl...
NISO/NFAIS Joint Virtual Conference: Connecting the Library to the Wider Worl...NISO/NFAIS Joint Virtual Conference: Connecting the Library to the Wider Worl...
NISO/NFAIS Joint Virtual Conference: Connecting the Library to the Wider Worl...
 
FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...
FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...
FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...
 
Semantics-aware Techniques for Social Media Analysis, User Modeling and Recom...
Semantics-aware Techniques for Social Media Analysis, User Modeling and Recom...Semantics-aware Techniques for Social Media Analysis, User Modeling and Recom...
Semantics-aware Techniques for Social Media Analysis, User Modeling and Recom...
 
Developing Linked Data and Semantic Web-based Applications (Expotec 2015)
Developing Linked Data and Semantic Web-based Applications (Expotec 2015)Developing Linked Data and Semantic Web-based Applications (Expotec 2015)
Developing Linked Data and Semantic Web-based Applications (Expotec 2015)
 
20110728 datalift-rpi-troy
20110728 datalift-rpi-troy20110728 datalift-rpi-troy
20110728 datalift-rpi-troy
 
Datalift a-catalyser-for-the-web-of-data-fosdem-05-02-2011
Datalift a-catalyser-for-the-web-of-data-fosdem-05-02-2011Datalift a-catalyser-for-the-web-of-data-fosdem-05-02-2011
Datalift a-catalyser-for-the-web-of-data-fosdem-05-02-2011
 
Riding the wave - Paradigm shifts in information access
Riding the wave - Paradigm shifts in information accessRiding the wave - Paradigm shifts in information access
Riding the wave - Paradigm shifts in information access
 
NISO/DCMI Webinar: Schema.org and Linked Data: Complementary Approaches to Pu...
NISO/DCMI Webinar: Schema.org and Linked Data: Complementary Approaches to Pu...NISO/DCMI Webinar: Schema.org and Linked Data: Complementary Approaches to Pu...
NISO/DCMI Webinar: Schema.org and Linked Data: Complementary Approaches to Pu...
 
RDF data model
RDF data modelRDF data model
RDF data model
 
IASSIST 2012 - DDI-RDF - Trouble with Triples
IASSIST 2012 - DDI-RDF - Trouble with TriplesIASSIST 2012 - DDI-RDF - Trouble with Triples
IASSIST 2012 - DDI-RDF - Trouble with Triples
 

Similar to Assessing, Creating and Using Knowledge Graph Restrictions

Introduction to Ontology Concepts and Terminology
Introduction to Ontology Concepts and TerminologyIntroduction to Ontology Concepts and Terminology
Introduction to Ontology Concepts and TerminologySteven Miller
 
Objectification Is A Word That Has Many Negative Connotations
Objectification Is A Word That Has Many Negative ConnotationsObjectification Is A Word That Has Many Negative Connotations
Objectification Is A Word That Has Many Negative ConnotationsBeth Johnson
 
Project Credit: Melissa Haendel - On the Nature of Credit
Project Credit: Melissa Haendel - On the Nature of CreditProject Credit: Melissa Haendel - On the Nature of Credit
Project Credit: Melissa Haendel - On the Nature of CreditCASRAI
 
On the nature of Credit
On the nature of CreditOn the nature of Credit
On the nature of Creditmhaendel
 
Linked Open Data Visualization
Linked Open Data VisualizationLinked Open Data Visualization
Linked Open Data VisualizationLaura Po
 
VIZ-VIVO: Towards Visualizations-driven Linked Data Navigation
VIZ-VIVO: Towards Visualizations-driven Linked Data NavigationVIZ-VIVO: Towards Visualizations-driven Linked Data Navigation
VIZ-VIVO: Towards Visualizations-driven Linked Data NavigationMuhammad Javed
 
The Computer Science Ontology: A Large-Scale Taxonomy of Research Areas
The Computer Science Ontology:  A Large-Scale Taxonomy of Research AreasThe Computer Science Ontology:  A Large-Scale Taxonomy of Research Areas
The Computer Science Ontology: A Large-Scale Taxonomy of Research AreasAngelo Salatino
 
The Computer Science Ontology: A Large-Scale Taxonomy of Research Areas
The Computer Science Ontology: A Large-Scale Taxonomy of Research AreasThe Computer Science Ontology: A Large-Scale Taxonomy of Research Areas
The Computer Science Ontology: A Large-Scale Taxonomy of Research AreasAngelo Salatino
 
Searching for patterns in crowdsourced information
Searching for patterns in crowdsourced informationSearching for patterns in crowdsourced information
Searching for patterns in crowdsourced informationSilvia Puglisi
 
Scholars@Cornell: Visualizing the Scholarship Data
Scholars@Cornell: Visualizing the Scholarship DataScholars@Cornell: Visualizing the Scholarship Data
Scholars@Cornell: Visualizing the Scholarship DataMuhammad Javed
 
Repositories and the wider context
Repositories and the wider contextRepositories and the wider context
Repositories and the wider contextJulie Allinson
 
ALIAOnline Practical Linked (Open) Data for Libraries, Archives & Museums
ALIAOnline Practical Linked (Open) Data for Libraries, Archives & MuseumsALIAOnline Practical Linked (Open) Data for Libraries, Archives & Museums
ALIAOnline Practical Linked (Open) Data for Libraries, Archives & MuseumsJon Voss
 
Semantic IoT Semantic Inter-Operability Practices - Part 1
Semantic IoT Semantic Inter-Operability Practices - Part 1Semantic IoT Semantic Inter-Operability Practices - Part 1
Semantic IoT Semantic Inter-Operability Practices - Part 1iotest
 
Istic thesaurus ws-keizer_2010-10-22
Istic thesaurus ws-keizer_2010-10-22Istic thesaurus ws-keizer_2010-10-22
Istic thesaurus ws-keizer_2010-10-22Johannes Keizer
 
Exploring Content with Wikipedia
Exploring Content with WikipediaExploring Content with Wikipedia
Exploring Content with WikipediaYegin Genc
 
4 6 2007 University of Illinois at Urbana Champaign
4 6 2007  University of Illinois at Urbana Champaign4 6 2007  University of Illinois at Urbana Champaign
4 6 2007 University of Illinois at Urbana ChampaignStuart Dunn
 
Lecture: Semantic Word Clouds
Lecture: Semantic Word CloudsLecture: Semantic Word Clouds
Lecture: Semantic Word CloudsMarina Santini
 
Visualization: ACS Sp 2010 CINF Keynote
Visualization: ACS Sp 2010 CINF KeynoteVisualization: ACS Sp 2010 CINF Keynote
Visualization: ACS Sp 2010 CINF KeynoteLiz Dorland
 
Research Inventy : International Journal of Engineering and Science
Research Inventy : International Journal of Engineering and ScienceResearch Inventy : International Journal of Engineering and Science
Research Inventy : International Journal of Engineering and Scienceresearchinventy
 

Similar to Assessing, Creating and Using Knowledge Graph Restrictions (20)

Introduction to Ontology Concepts and Terminology
Introduction to Ontology Concepts and TerminologyIntroduction to Ontology Concepts and Terminology
Introduction to Ontology Concepts and Terminology
 
Objectification Is A Word That Has Many Negative Connotations
Objectification Is A Word That Has Many Negative ConnotationsObjectification Is A Word That Has Many Negative Connotations
Objectification Is A Word That Has Many Negative Connotations
 
Project Credit: Melissa Haendel - On the Nature of Credit
Project Credit: Melissa Haendel - On the Nature of CreditProject Credit: Melissa Haendel - On the Nature of Credit
Project Credit: Melissa Haendel - On the Nature of Credit
 
On the nature of Credit
On the nature of CreditOn the nature of Credit
On the nature of Credit
 
Linked Open Data Visualization
Linked Open Data VisualizationLinked Open Data Visualization
Linked Open Data Visualization
 
VIZ-VIVO: Towards Visualizations-driven Linked Data Navigation
VIZ-VIVO: Towards Visualizations-driven Linked Data NavigationVIZ-VIVO: Towards Visualizations-driven Linked Data Navigation
VIZ-VIVO: Towards Visualizations-driven Linked Data Navigation
 
The Computer Science Ontology: A Large-Scale Taxonomy of Research Areas
The Computer Science Ontology:  A Large-Scale Taxonomy of Research AreasThe Computer Science Ontology:  A Large-Scale Taxonomy of Research Areas
The Computer Science Ontology: A Large-Scale Taxonomy of Research Areas
 
The Computer Science Ontology: A Large-Scale Taxonomy of Research Areas
The Computer Science Ontology: A Large-Scale Taxonomy of Research AreasThe Computer Science Ontology: A Large-Scale Taxonomy of Research Areas
The Computer Science Ontology: A Large-Scale Taxonomy of Research Areas
 
Searching for patterns in crowdsourced information
Searching for patterns in crowdsourced informationSearching for patterns in crowdsourced information
Searching for patterns in crowdsourced information
 
Scholars@Cornell: Visualizing the Scholarship Data
Scholars@Cornell: Visualizing the Scholarship DataScholars@Cornell: Visualizing the Scholarship Data
Scholars@Cornell: Visualizing the Scholarship Data
 
Repositories and the wider context
Repositories and the wider contextRepositories and the wider context
Repositories and the wider context
 
ALIAOnline Practical Linked (Open) Data for Libraries, Archives & Museums
ALIAOnline Practical Linked (Open) Data for Libraries, Archives & MuseumsALIAOnline Practical Linked (Open) Data for Libraries, Archives & Museums
ALIAOnline Practical Linked (Open) Data for Libraries, Archives & Museums
 
Semantic IoT Semantic Inter-Operability Practices - Part 1
Semantic IoT Semantic Inter-Operability Practices - Part 1Semantic IoT Semantic Inter-Operability Practices - Part 1
Semantic IoT Semantic Inter-Operability Practices - Part 1
 
Istic thesaurus ws-keizer_2010-10-22
Istic thesaurus ws-keizer_2010-10-22Istic thesaurus ws-keizer_2010-10-22
Istic thesaurus ws-keizer_2010-10-22
 
The role of Thesauri and Standard Vocabularies in linking data
The role of Thesauri and Standard Vocabularies in linking data The role of Thesauri and Standard Vocabularies in linking data
The role of Thesauri and Standard Vocabularies in linking data
 
Exploring Content with Wikipedia
Exploring Content with WikipediaExploring Content with Wikipedia
Exploring Content with Wikipedia
 
4 6 2007 University of Illinois at Urbana Champaign
4 6 2007  University of Illinois at Urbana Champaign4 6 2007  University of Illinois at Urbana Champaign
4 6 2007 University of Illinois at Urbana Champaign
 
Lecture: Semantic Word Clouds
Lecture: Semantic Word CloudsLecture: Semantic Word Clouds
Lecture: Semantic Word Clouds
 
Visualization: ACS Sp 2010 CINF Keynote
Visualization: ACS Sp 2010 CINF KeynoteVisualization: ACS Sp 2010 CINF Keynote
Visualization: ACS Sp 2010 CINF Keynote
 
Research Inventy : International Journal of Engineering and Science
Research Inventy : International Journal of Engineering and ScienceResearch Inventy : International Journal of Engineering and Science
Research Inventy : International Journal of Engineering and Science
 

Recently uploaded

Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Valters Lauzums
 
7. Epi of Chronic respiratory diseases.ppt
7. Epi of Chronic respiratory diseases.ppt7. Epi of Chronic respiratory diseases.ppt
7. Epi of Chronic respiratory diseases.pptibrahimabdi22
 
Data Analyst Tasks to do the internship.pdf
Data Analyst Tasks to do the internship.pdfData Analyst Tasks to do the internship.pdf
Data Analyst Tasks to do the internship.pdftheeltifs
 
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...gajnagarg
 
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...ZurliaSoop
 
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...gajnagarg
 
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteedamy56318795
 
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制vexqp
 
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制vexqp
 
Capstone in Interprofessional Informatic // IMPACT OF COVID 19 ON EDUCATION
Capstone in Interprofessional Informatic  // IMPACT OF COVID 19 ON EDUCATIONCapstone in Interprofessional Informatic  // IMPACT OF COVID 19 ON EDUCATION
Capstone in Interprofessional Informatic // IMPACT OF COVID 19 ON EDUCATIONLakpaYanziSherpa
 
Jual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
Jual Cytotec Asli Obat Aborsi No. 1 Paling ManjurJual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
Jual Cytotec Asli Obat Aborsi No. 1 Paling Manjurptikerjasaptiker
 
Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...gajnagarg
 
Harnessing the Power of GenAI for BI and Reporting.pptx
Harnessing the Power of GenAI for BI and Reporting.pptxHarnessing the Power of GenAI for BI and Reporting.pptx
Harnessing the Power of GenAI for BI and Reporting.pptxParas Gupta
 
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B ResearchDiscover Why Less is More in B2B Research
Discover Why Less is More in B2B Researchmichael115558
 
Predicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange
Predicting HDB Resale Prices - Conducting Linear Regression Analysis With OrangePredicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange
Predicting HDB Resale Prices - Conducting Linear Regression Analysis With OrangeThinkInnovation
 
Aspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - AlmoraAspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - AlmoraGovindSinghDasila
 
怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制
怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制
怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制vexqp
 
如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样
如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样
如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样wsppdmt
 

Recently uploaded (20)

Sequential and reinforcement learning for demand side management by Margaux B...
Sequential and reinforcement learning for demand side management by Margaux B...Sequential and reinforcement learning for demand side management by Margaux B...
Sequential and reinforcement learning for demand side management by Margaux B...
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
 
7. Epi of Chronic respiratory diseases.ppt
7. Epi of Chronic respiratory diseases.ppt7. Epi of Chronic respiratory diseases.ppt
7. Epi of Chronic respiratory diseases.ppt
 
Data Analyst Tasks to do the internship.pdf
Data Analyst Tasks to do the internship.pdfData Analyst Tasks to do the internship.pdf
Data Analyst Tasks to do the internship.pdf
 
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
 
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
 
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
 
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制
 
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
 
Capstone in Interprofessional Informatic // IMPACT OF COVID 19 ON EDUCATION
Capstone in Interprofessional Informatic  // IMPACT OF COVID 19 ON EDUCATIONCapstone in Interprofessional Informatic  // IMPACT OF COVID 19 ON EDUCATION
Capstone in Interprofessional Informatic // IMPACT OF COVID 19 ON EDUCATION
 
Jual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
Jual Cytotec Asli Obat Aborsi No. 1 Paling ManjurJual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
Jual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
 
Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
 
Harnessing the Power of GenAI for BI and Reporting.pptx
Harnessing the Power of GenAI for BI and Reporting.pptxHarnessing the Power of GenAI for BI and Reporting.pptx
Harnessing the Power of GenAI for BI and Reporting.pptx
 
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B ResearchDiscover Why Less is More in B2B Research
Discover Why Less is More in B2B Research
 
Predicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange
Predicting HDB Resale Prices - Conducting Linear Regression Analysis With OrangePredicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange
Predicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange
 
Cytotec in Jeddah+966572737505) get unwanted pregnancy kit Riyadh
Cytotec in Jeddah+966572737505) get unwanted pregnancy kit RiyadhCytotec in Jeddah+966572737505) get unwanted pregnancy kit Riyadh
Cytotec in Jeddah+966572737505) get unwanted pregnancy kit Riyadh
 
Aspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - AlmoraAspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - Almora
 
怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制
怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制
怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制
 
如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样
如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样
如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样
 

Assessing, Creating and Using Knowledge Graph Restrictions

  • 1. Assessing, Creating and Using Knowledge Graph Restrictions Sven Lieber, supervised by Anastasia Dimou and Ruben Verborgh 10.03.2022 - public PhD defense
  • 2. Assessing, Creating and Using Knowledge Graph Restrictions Sven Lieber, supervised by Anastasia Dimou and Ruben Verborgh 10.03.2022 - public PhD defense ?
  • 3. Assessing, Creating and Using ? ? ? Sven Lieber, supervised by Anastasia Dimou and Ruben Verborgh 10.03.2022 - public PhD defense ?
  • 4. Crash course about the context PhD presentation
  • 5. This PhD is about information processing Telescope science? => Astronomy! Microscope science? => Biology! Computer science? => Information! “Computer science involves the study of or the practice of computation, automation, and information” - Wikipedia
  • 6. Physical chaos - hard to find, share or use things
  • 7. Digital chaos - hard to find, share or use things
  • 8. “24 hours in photos”, 2011 from Erik Kessels 350k printed images uploaded to Flickr in a single day Large amount of unconnected data What is on these two images, and are they connected somehow?
  • 9. What is what? We need semantics! “a separate seat for one person, typically with a back and four legs.” - Oxford Languages “the person in charge of a meeting or of an organization (used as a neutral alternative to chairman or chairwoman)” - Oxford Languages Please think of “a chair”
  • 10. Different definitions and understanding about data Data Silo 1 Data Silo 3 Data Silo 2 A person is alive, has a first and last name and has a residence address A person is real or fictional A person is the user of the app identified via an Email address ? ? ? How many persons can we reach with our marketing campaign in Ghent?
  • 11. Data and data modeling using a graph Person Sven Organization University Supervisor Anastasia Ruben is subclass is a is subclass is subclass UGent is a is enrolled at knows knows is a is a A Knowledge Graph (i) real world entities in a graph structure (ii) classes and relations in a schema (iii) linking of arbitrary entities (iv) covers various topical domains “Knowledge Graph Refinement: A Survey of Approaches and Evaluation Methods”, Semantic Web Journal, 2016, Heiko Paulheim PhD student knows is enrolled at
  • 12. Link data in a flexible way Person Sven Organization University Supervisor Anastasia Ruben is subclass is a is subclass is subclass UGent is a is enrolled at knows knows is a is a A Knowledge Graph (i) real world entities in a graph structure (ii) classes and relations in a schema (iii) linking of arbitrary entities (iv) covers various topical domains “Knowledge Graph Refinement: A Survey of Approaches and Evaluation Methods”, Semantic Web Journal, 2016, Heiko Paulheim PhD student knows is enrolled at
  • 13. Express the data model in a flexible way Person Sven Organization University Supervisor Anastasia Ruben is subclass is a is subclass is subclass UGent is a is enrolled at knows knows is a is a A Knowledge Graph (i) real world entities in a graph structure (ii) classes and relations in a schema (iii) linking of arbitrary entities (iv) covers various topical domains “Knowledge Graph Refinement: A Survey of Approaches and Evaluation Methods”, Semantic Web Journal, 2016, Heiko Paulheim PhD student knows is enrolled at
  • 14. A uniform graph representation Person Sven Organization University Supervisor Anastasia Ruben is subclass is a is subclass is subclass UGent is a is enrolled at knows knows is a is a A Knowledge Graph (i) real world entities in a graph structure (ii) classes and relations in a schema (iii) linking of arbitrary entities (iv) covers various topical domains “Knowledge Graph Refinement: A Survey of Approaches and Evaluation Methods”, Semantic Web Journal, 2016, Heiko Paulheim PhD student knows is enrolled at
  • 15. Data integration because of reused definitions of things Data Silo 1 Data Silo 3 Data Silo 2 A person is alive, has a first and last name and has a residence address A person is real or fictional A person is the user of the app identified via an Email address “A vocabulary defines the concepts and relationships describing an area of concern” - World Wide Web Consortium (W3C)
  • 16. Crash course about the context -> Represent data in a uniform graph structure PhD presentation
  • 17. But how can this be used by a computer? Data Silo 1 Data Silo 3 Data Silo 2 A person is alive, has a first and last name and has a residence address A person is real or fictional A person is the user of the app identified via an Email address
  • 18. Keep the flexible graph representation in a computer readable text format by using “triples” Person is a Class . PhD student is subclass Person . Supervisor is subclass Person . University is subclass Organization . Anastasia is a Supervisor . Ruben is a Supervisor . Sven is a PhD Student . UGent is a University . Sven is enrolled at UGent .
  • 19. Reuse the web as global information system Person is a Class . http://xmlns.com/foaf/0.1/Person http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://www.w3.org/2000/01/rdf-schema#Class . foaf:Person rdf:type rdfs:Class .
  • 20. Reuse the web as global information system -> reuse of definitions for shared understanding -> link to existing data foaf:Person rdf:type rdf:Class . ex:PhdStudent rdfs:subClassOf foaf:Person . ex:Supervisor rdfs:subClassOf foaf:Person . ex:University rdfs:subClassOf foaf:Organization . data:anastasia rdf:type ex:Supervisor . data:ruben rdf:type ex:Supervisor . data:sven rdf:type ex:PhDStudent . data:ugent rdf:type ex:University . data:sven ex:enrolledAt data:ugent . data:sven foaf:givenName “Sven” . data:sven foaf:familyName “Lieber” .
  • 21. Crash course about the context -> Data in a uniform graph structure -> Use the web to represent the graph PhD presentation
  • 22. This does not seem right to us … UGent Sven is enrolled at wroteBook Train 123 … but okay for a computer because we did not restrict possible links
  • 23. Let’s talk about semantics … again “a separate seat for one person, typically with a back and four legs.” - Oxford Languages “the person in charge of a meeting or of an organization (used as a neutral alternative to chairman or chairwoman)” - Oxford Languages
  • 24. Let’s talk about semantics … again “a separate seat for one person, typically with a back and four legs.” - Oxford Languages “the person in charge of a meeting or of an organization (used as a neutral alternative to chairman or chairwoman)” - Oxford Languages
  • 25. We can distinguish now between different things “a separate seat for one person, typically with a back and four legs.” - Oxford Languages “the person in charge of a meeting or of an organization (used as a neutral alternative to chairman or chairwoman)” - Oxford Languages
  • 26. Without restrictions a computer cannot differentiate Sven knows ? Domain and Range axioms: “knows” connects two instances of class Person Axioms are “statements that are asserted to be true in the domain being described” - OWL2 Structural Specification and Functional-Style Syntax, W3C 2012
  • 27. Provide formal meaning using axioms which supports inferring new knowledge Sven knows Domain and Range axioms: “knows” connects two instances of class Person Person is a is a new “is a” relationships inferred!
  • 28. What can be inferred here? Sven knows 4 has legs ? Axiom: something with 4 legs is a chair
  • 29. Ups, we created a Person-Chair Sven knows 4 has legs Person Chair Axiom: something with 4 legs is a chair is a is a is a new “is a” relationships inferred!
  • 30. Use constraints to define what is valid Data shapes express “structural constraints to validate instance data” - SHACL Use Cases and Requirements, W3C 2017 Person Birth date Last name First name For example: persons need a birth date, last name and first name
  • 31. Vocabulary -> Ontology “An Ontology is a formal, explicit specification of a shared conceptualization” - Thomas R. Gruber (1993) Person Organization University Supervisor is subclass is subclass is subclass PhD student knows is enrolled at “A Conceptualization is an intensional semantic structure which encodes the implicit rules constraining the structure of a piece of reality” - Guarino et al. (1995) “The OWL 2 RDF-Based Semantics gives a formal meaning to every RDF graph” - OWL2 RDF-based Semantics, W3C 2012
  • 32. The use of restrictions varies in practice only subclasses Different restrictions defining formal meaning structured metadata in websites using schema.org Neuro Behavior ontology (NBO) A program to infer knowledge (a reasoner) needs formal meaning
  • 33. Crash course about the context -> Data in a uniform graph structure -> Use the web to represent the graph -> We can restrict meaning using axioms or restrict what is valid using constraints PhD presentation
  • 34. Crash course about the context PhD presentation Congratulations, you passed Knowledge Graphs 101
  • 35. Assessing, Creating and Using Knowledge Graph Restrictions Sven Lieber, supervised by Anastasia Dimou and Ruben Verborgh 10.03.2022 - public PhD defense
  • 36. Users need support Assessing restrictions using Montolo Creating restrictions using visual notations Using restrictions to enable data stewardship Conclusion
  • 37. Users need support Assessing restrictions using Montolo Creating restrictions using visual notations Using restrictions to enable data stewardship Conclusion
  • 38. Imagine you want to create an application (data model) Reuse existing concepts which fit your use case for example an event planning app
  • 39. Reusing ontologies is usually a multi-step process Discovery of reuse candidates Selection of relevant ontologies Customization and integration of reused ontologies
  • 40. Imagine you want to create an application (data model) Reuse existing concepts which fit your use case for example an event planning app Create your own local constraints for example Corona measures which temporarily apply
  • 41. Creating constraints Person Birth date Last name First name USER schema:DatedMoneySpecification rdf:type sh:NodeShape ; sh:closed "true"^^xsd:boolean ; sh:ignoredProperties ( rdf:type ) ; sh:property [ sh:path schema:amount ; sh:datatype xsd:float ; sh:maxCount 1 ; sh:minCount 1 ; ] ; sh:property [ sh:path schema:currency ; rdfs:comment "The currency code (here) is a mandatory property consisting of three upper-case letters" ; sh:datatype xsd:string ; sh:flags "i" ; sh:maxCount 1 ; sh:minCount 1 ; sh:pattern "^[A-Z]{3}$" ; ] ; What users get! What users want is visual support!
  • 42. Main research question How can we support users in the assessment and in the creation of Knowledge Graph restrictions?
  • 43. Users need support Assessing restrictions using Montolo Creating restrictions using visual notations Using restrictions to enable data stewardship Conclusion
  • 44. The use of restrictions varies in practice only subclasses Different restrictions defining formal meaning structured metadata in websites using schema.org Neuro Behavior ontology (NBO) A program to infer knowledge (a reasoner) needs formal meaning
  • 45. Different types of restrictions are available in RDFS/OWL only subclasses Different restrictions defining formal meaning Domain Disjoint Properties Literal ranges Reasoner
  • 46. only subclasses Different restrictions defining formal meaning But some restriction types come with a high (computational) complexity … not always needed Domain Disjoint Properties Literal ranges Reasoner
  • 47. Reusing ontologies is usually a multi-step process Discovery of reuse candidates Selection of relevant ontologies Customization and integration of reused ontologies
  • 48. Search existing repositories to reuse common definitions
  • 49. Does this vocabulary fit our use case? Existing statistics do not provide any information of what restrictions exist in the vocabulary
  • 50. Currently only a manual assessment of ontologies, one by one Ontology documentation pages created by Widoco Ontology loaded into the editor tool Protégé
  • 51. Discover and assess ontologies based on restriction use Possible ontology reuse candidates (colors = different restriction types) Use case
  • 52. Discover and assess ontologies based on restriction use Possible ontology reuse candidates (colors = different restriction types) Restriction type use statistics Use case
  • 53. Computing the statistics - overview LODStats Montolo Stats DataCube and PROV annotated statistics 660 ontologies 565 ontologies 31,850 observations 18 restriction types
  • 54. Created statistics are FAIR The statistics are described using Knowledge Graphs Dataset available via a repository or consultable via a website
  • 55. How many ontologies use each restriction type? A few often used restriction types and a long tail both in LOV and BioPortal Restriction types
  • 56. Negligible number of literal value restrictions Almost no literalRanges restrictions literalPattern not used at all
  • 57. Property and cardinality restrictions in the tail Tail mostly consists of property-based and cardinality-based restrictions expressed using OWL terms
  • 58. LOV vs BioPortal: qualified cardinalities Qualified cardinalities preferred in BioPortal ontologies
  • 59. LOV vs BioPortal: unqualified cardinalities Unqualified cardinalities preferred in LOV ontologies
  • 60. Certain restrictions slightly more used in BioPortal BioPortal ontologies use certain restrictions more often
  • 61. Domain and range used less in BioPortal More domain/range Restrictions in LOV
  • 62. Commonly used constraint types and unused potential Data shapes are relatively new, here we could only investigate 19 data sources
  • 63. Besides assessment support we learned from the statistics and we can ask more questions Only half of the ontologies use OWL-based axioms Little attention for literal values Attention with editing tools regarding a self fulfilling prophecy
  • 64. Users need support Assessing restrictions using Montolo Creating restrictions using visual notations Using restrictions to enable data stewardship Conclusion
  • 65. Creating constraints USER schema:DatedMoneySpecification rdf:type sh:NodeShape ; sh:closed "true"^^xsd:boolean ; sh:ignoredProperties ( rdf:type ) ; sh:property [ sh:path schema:amount ; sh:datatype xsd:float ; sh:maxCount 1 ; sh:minCount 1 ; ] ; sh:property [ sh:path schema:currency ; rdfs:comment "The currency code (here) is a mandatory property consisting of three upper-case letters" ; sh:datatype xsd:string ; sh:flags "i" ; sh:maxCount 1 ; sh:minCount 1 ; sh:pattern "^[A-Z]{3}$" ; ] ; What users want is visual support! What users get!
  • 66. Different constraint types need to be visualized USER Or Disjoint Not What users want is visual support!
  • 67. Existing tools do not specify how to visualize all SHACL core constraints USER Or Disjoint Existing visual tools
  • 68. Based on existing cognitive theories and experiments we can define how to systematically visualize constraint types USER Or Disjoint Moody, Daniel. "The ‘physics’ of notations: toward a scientific basis for constructing visual notations in software engineering." IEEE Transactions on software engineering 35.6 (2009): 756- 779.
  • 69. Let’s reuse visual notations already familiar to users VOWL UML
  • 70. Chapter: Constraint creation How can we support users familiar with Linked Data in viewing RDF constraints? Users familiar with Linked Data can answer questions about visually represented RDF constraints more accurately with a VOWL-based visual notation than with a UML-based visual notation
  • 71. Systematically described visual notations allow systematically improvements/adaptations
  • 72. Compare visual notations in a user study with 12 participants Two visual notations to visualize the same semantic constructs Test case Group 1 Group 2 Test case 1 ShapeUML ShapeVOWL Test case 2 ShapeVOWL ShapeUML Test case 3 ShapeUML ShapeVOWL Test case 4 ShapeVOWL ShapeUML ShapeVOWL ShapeUML Pre assessment (social demographics + skills) Main questionnaire to assess accuracy of answers to provided questions Post assessment (opinion)
  • 73.
  • 74. No significant error differences between answers for ShapeUML and ShapeVOWL
  • 75. Besides having 2 new visual notations, we gained new qualitative insights! Space efficient representation using ShapeUML Good to have several notations because of familiarity bias Visual features are important and can also improve ShapeUML
  • 76. Users need support Assessing restrictions using Montolo Creating restrictions using visual notations Using restrictions to enable data stewardship Conclusion
  • 77. Data stewardship: the long-term care of valuable digital assets
  • 78. Valuable information in archived records Historic government records or early climate data, e.g. demographics or taxes on crop yields Invaluable data loss NASA is unable to locate the original high quality moon landing video. How about 21st century data? Social media content influences the real world, what if Twitter and Co are gone? Historical records Moon landing in the 1960s The web and social media
  • 79. BESOCIAL: a cross-institutional research project to develop a social media archiving strategy for Belgium Follow up of a project for general web archiving Lead by the Royal Library of Belgium Research partners with different expertise Funded by the Belgian Science Policy Office
  • 80. #meToo #IchBinHanna @SvenLieber @UGent #fries A curator creates social media collections, possibly via crowdsourcing
  • 81. A curator creates social media collections, possibly via crowdsourcing #meToo #IchBinHanna @SvenLieber @UGent #fries Society Academic Belgium
  • 82. New social media posts are “harvested” daily/weekly #meToo #IchBinHanna @SvenLieber @UGent #fries Society Academic Belgium
  • 83. We are preserving content, but also doing this:
  • 84. Knowledge Graph-based workflow for data stewardship Society #meToo #IchBinHanna Data format A Data format B Heterogeneous data sources Knowledge Graph Views on the data in different formats
  • 85. Quality is use-case specific and can be systematically defined and measured For example quality dimension “Rich collection description”
  • 86. Quality Assessment using Knowledge Graphs and restrictions 40 user stories such as “As an archive-user, I want to see descriptive information about the collection from the archivist, so I can assess if the content is relevant to me.” Derive quality requirements such as “The description of each collection should at least have 200 characters” Metric: Missing collection description Metric: Number of missing descriptions Metric: Insufficient collection description Metric: Number of insufficient descriptions Report Quality Assessment
  • 87. We could identify quality issues and their root cause
  • 88. A Knowledge Graph and restrictions supported data stewardship for social media archiving Providing an integrated view on the data (with formal meaning) Assisted in an automated quality assessment by using constraints The workflow is generalizable thus helpful in other use cases
  • 89. Users need support Assessing restrictions using Montolo Creating restrictions using visual notations Using restrictions to enable data stewardship Conclusion
  • 90. How can we support users in the assessment and in the creation of Knowledge Graph restrictions? Montolo statistics support restriction assessments with FAIR data which was not possible before We can rethink the value we give to restrictions, why and how do we use restrictions systematically?
  • 91. How can we support users in the assessment and in the creation of Knowledge Graph restrictions? There are now 2 visual notations covering all SHACL core constraints First steps to make Knowledge Graph constraints more accessible to domain experts
  • 92. How can we support users in the assessment and in the creation of Knowledge Graph restrictions? The BESOCIAL use case demonstrated the use of restrictions to tackle data stewardship challenges The future is less about tools and more about workflows and data!
  • 93. A circle representing the human knowledge “The illustrated guide to a Ph.D.” - Matt Might
  • 94. Little knowledge after elementary school “The illustrated guide to a Ph.D.” - Matt Might
  • 95. More knowledge after high school “The illustrated guide to a Ph.D.” - Matt Might
  • 96. Gaining speciality with the Bachelor’s degree “The illustrated guide to a Ph.D.” - Matt Might
  • 97. Deepen speciality with the Master’s degree “The illustrated guide to a Ph.D.” - Matt Might
  • 98. Reading research papers takes you to the edge of human knowledge “The illustrated guide to a Ph.D.” - Matt Might
  • 99. You focus at the boundary “The illustrated guide to a Ph.D.” - Matt Might
  • 100. You focus at the boundary for a few years “The illustrated guide to a Ph.D.” - Matt Might
  • 101. One day the boundary gives way “The illustrated guide to a Ph.D.” - Matt Might
  • 102. The dent you have made is called PhD “The illustrated guide to a Ph.D.” - Matt Might
  • 103. The world looks different to you now “The illustrated guide to a Ph.D.” - Matt Might
  • 104. Don’t forget the bigger picture “The illustrated guide to a Ph.D.” - Matt Might
  • 105. Newly raised questions: future work Montolo provides metrics, but what are the higher level dimensions, tools and its usability? Why and how are restrictions used in the first place? How do we build our future Knowledge Graphs from a methodological point of view?
  • 106. Questions & Answers Dissertation available as PDF at https://sven-lieber.org/phd SvenLieber sven-lieber.org knows.idlab.ugent.be