Loading…

Flash Player 9 (or above) is needed to view presentations.
We have detected that you do not have it on your computer. To install it, go here.

Like this presentation? Why not share!

The role of Thesauri and Standard Vocabularies in linking data

on

  • 1,314 views

 

Statistics

Views

Total Views
1,314
Views on SlideShare
1,313
Embed Views
1

Actions

Likes
0
Downloads
34
Comments
0

1 Embed 1

http://unjobs.org 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

CC Attribution-NonCommercial-ShareAlike LicenseCC Attribution-NonCommercial-ShareAlike LicenseCC Attribution-NonCommercial-ShareAlike License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    The role of Thesauri and Standard Vocabularies in linking data The role of Thesauri and Standard Vocabularies in linking data Presentation Transcript

    • The role of Thesauri and Standard Vocabularies in linking data Dr. Johannes Keizer FAO of the United Nations Office of Knowledge Exchange, Research and Extension Knowledge and Capacity for Development
    • The Development of the Internet Beijing, 2010-10-22 Thesaurus Workshop – CAS dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 Open World Mindset  “Closed” (“normal”) IT environments  Data sources carefully controlled.  Data formats “custom-defined” for an application. Thesaurus Workshop – CAS  Linked data based on an “open world mindset”  Integrating data from the open Web  Systems designed to incorporate new information incrementally  By design, tolerance of incomplete information dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 The Linked Data Universe: http://www.linkeddata.org (july 2009) Thesaurus Workshop – CAS dr johannes keizer - FAO of the United Nations - knowledge and capacity for development 4
    • Beijing, 2010-10-22 The Linked Data Universe: http://www.linkeddata.org (july 2010) Thesaurus Workshop – CAS dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Example: BBC Wildlife Finder Beijing, 2010-10-22 Thesaurus Workshop – CAS dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 Humboldt Squid page, pulled together from a diversity of Linked Data sources BBC TV Documentary BBC News item Thesaurus Workshop – CAS Wikipedia Animal Diversity Web: Nocturnal way of life dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 RDF– a grammar for the language of data relatedTo Resource ResourceA ResourceB Thesaurus Workshop – CAS describedBy Resource ResourceA Some text 1. Describe resources using interrelated “statements” (“triples”). 2. Use URIs – unique, globally managed identifiers – as the “words” of statements. dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 Thesaurus Workshop – CAS RDF as a common format for merging data •http://www.w3.org/2007/Talks/0221-Bangalore-IH/ dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 Finding things related to “genes” across databases Thesaurus Workshop – CAS Source: Joanne Luciano, Mitre, and the W3C HCLS IG dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 Role of thesauri/concept schemes  Born as tools to assure consistency in the indexing of library collections  Thesauri were based on “terms”, but terms represented already concepts in a non explicit way Thesaurus Workshop – CAS  Hierarchical and associative relationships represented generic ontological domain knowledge  Candidate building blocks for the semantic web dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • ..from thesaurus to Ontologies…. Beijing, 2010-10-22 Thesaurus Workshop – CAS dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 AGROVOC today  around 30,000 concepts  600000 labels in around 20 languages.  one-stop shop for terminological knowledge related to agriculture in general Thesaurus Workshop – CAS  a knowledge base of related concepts organized in ontological relationships (hierarchical, associative, equivalence)  Is a concept/term/string based system  Concepts may be organized in multiple categories. dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 Semantic Relationships Concept to isA (hierarchy), isPestOf, hasPest Concept Concept to has_lexicalization Term (links concepts to their lexical realizations) Thesaurus Workshop – CAS Term to isSynonymOf, isTranslationOf, Term hasAcronym, hasAbbreviation Term to hasSpellingVariant, hasSingular String dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 The AGROVOC SKOS-XL Model Agrovoc SKOS rdf:type Concept Concept Scheme Scheme skos:inScheme skos:topConceptOf 6211 rdf:type skos:broader 8171 rdf:type Thesaurus Workshop – CAS SKOS skos:broader rdf:type Concept 1474 rdf:type skos:broader 12332 “corn” skosxl:prefLabel skosxl:literalForm rdf:type :foo SKOS rdf:type skosxl:altLabel Label :bar skosxl:literalForm “maize” dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 http://www.w3.org/2004/02/skos/ Thesaurus Workshop – CAS dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 SKOS-XL output <rdf:Description rdf:about="http://aims.fao.org/aos/agrovoc/agrovocScheme"> <rdf:type rdf:resource="http://www.w3.org/2004/02/skos/core#ConceptScheme"/></rdf :Description><rdf:Description rdf:about="http://aims.fao.org/aos/agrovoc/c_330829"> <rdf:type rdf:resource="http://www.w3.org/2004/02/skos/core#Concept"/> URI of AGROVOC concept <skos:inScheme Thesaurus Workshop – CAS rdf:resource="http://aims.fao.org/aos/agrovoc/agrovocScheme"/> <skos:topConceptOf rdf:resource="http://aims.fao.org/aos/agrovoc/agrovocScheme"/></rdf:Descri ption><rdf:Description rdf:about="http://aims.fao.org/aos/agrovoc/xl_en_1278479064610"> <literalForm xmlns="http://www.w3.org/2008/05/skos-xl#" xml:lang="en">subjects</literalForm> <rdf:type rdf:resource="http://www.w3.org/2008/05/skos-xl#Label"/></rdf:Description> dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 Linking vocabularies AGROVOC EUROVOC UNBIS Relationship http://aims.fao. http://eurovoc agroforestry skos:exactMatch org/aos/agrovoc .europa.eu/21 / owl:sameAs /c_207 9055 Thesaurus Workshop – CAS http://aims.fao. http://eurovoc MILK skos:exactMatch org/aos/agrovoc .europa.eu/22 / owl:sameAs /c_4826 0018 http://aims.fao. http://eurovoc MAIZE skos:exactMatch org/aos/agrovoc .europa.eu/21 / owl:sameAs /c_12332 9871 dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • http://agris.fao.org/agris-search/search/display.do?f=2004/ZA/ZA04002.xml;ZA2004000049 Beijing, 2010-10-22 Thesaurus Workshop – CAS dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 http://aims.fao.org/aos/agrovoc/c_7825 Thesaurus Workshop – CAS http://eurovoc.europa.eu/218754 dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 Linking data through common URIs Eurovoc Maize Maize skosxl: literalForm skosxl: literalForm owl:sameAs/exactMatch http://aims.fao.org/ao s/agrovoc/c_12332 Maize UNBIS http://eurovoc.europa.eu/ 219871 AGROVOC Thesaurus Workshop – CAS skosxl: literalForm owl:sameAs/exactMatch Maize http://agris.fao.org/agris- search/search/display.do?f=1996 /TR/TR96001.xml;TR9600026 http://eur- http://unbisnet.un.org:8080/ipac20/ipac.j lex.europa.eu/LexUriServ/LexUriSe sp?session=128F308557F34.283092&pr rv.do?uri=OJ:L:2010:202:0011:001 ofile=bib&uri=full=3100001~!685149~!1& 5:EN:PDF ri=1&aspect=subtab124&menu=search& source=~!horizon http://aims.fao.org/aos/agrovoc/c_12332 owl:sameAs http://eurovoc.europa.eu/219871 dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 What are we doing with unstructured data? • We have enormous amounts of unstructured material • Still most of the documents that we are producing are mostly semantically unstructured Thesaurus Workshop – CAS • Human work to catalogue and index is becoming always more rare • We need machines to do automatic semantic mark ups of text • If machines are trained and based on concept schemes, ther are able to do so dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 Thesaurus Workshop – CAS dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 AgroTagger • Does Concept identification in unstructured texts • Uses Agrovoc as a controlled vocabulary • Prototype under testing with excellent Thesaurus Workshop – CAS results (entire repository of ICARDA indexed) • Will produce in future Structured RDF files that can be used to link data like “open Calais” • dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 Thesaurus Workshop – CAS dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 Thesaurus Workshop – CAS dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 Thesaurus Workshop – CAS dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 Life Demo: Semantic mark ups: http://viewer.opencalais.com/ http://agropedialabs.iitk.ac.in/Tagger/Agrotagger_text.php Thesaurus Workshop – CAS dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • The concept scheme workbench Beijing, 2010-10-22 Thesaurus Workshop – CAS dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 The workbench  Is a web-based working environment for managing the AGROVOC Concept Server  Facilitate the collaborative editing of multilingual terminology and semantic concept information  It includes administration and group management Thesaurus Workshop – CAS features  It includes workflows for maintenance, validation and quality assurance of the data pool  The CS is accessible freely to everybody to facilitates collaborative editing dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 Group/Action/Status GROUP ACTION STATUS Non registered users concept-create Proposed by guest Term editors concept-delete Proposed Ontology editors concept-edit Revised by guest Thesaurus Workshop – CAS Validators term-create Revised Publishers term-edit Validated Administrators term-delete Published .......... Proposed deprecated Deprecated dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 Concept Life Cycle GUEST VALIDATOR PUBLISHER <concept-create> <validates> <publishes> Proposed by guest Validated Published Thesaurus Workshop – CAS ONTOLOGY EDITOR ADMINISTRATOR TERM EDITOR <concept-delete> <validates> <concept-edit> Proposed deprecated Published Revised PUBLISHER <validates> Deprecated 3 dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 Modules • Home • Validation • Search • Consistency Check • Concept/Term • Import/Export Management • User/Group Management Relationship Thesaurus Workshop – CAS • • Statistics/Preferences Management • Classification Scheme Management 3 dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 Search • by string: the user can specify if the system should search by exact match, beginning with, contains or fuzzy • by URI or term code; or by range of term code (e.g. between 123 and 9876) Thesaurus Workshop – CAS • by classification schemes • by creation or modification date • by specific relationships (e.g. search all concepts using the “has_pest”) • by status, language by notes/attributes 3 dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 Graph Visualization  Java Applets based touch graph  Visualizes Thesaurus Workshop – CAS concepts and its relationships with other concepts in graphical view 3 dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Web services Beijing, 2010-10-22 AGROVOC CS maintain access WORKBENCH Triple Store response Thesaurus Workshop – CAS SKOS Other uses Applications 3 dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 AGROVOC Web Services Thesaurus Workshop – CAS dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 Architecture of the System Thesaurus Workshop – CAS dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • System Overview Beijing, 2010-10-22 Front end Middleware Back end Google Administrativ Hibernate Web Gilead e Database Layer Toolkit (Mysql) (GWT) Thesaurus Workshop – CAS Intermediate GWT Layer Protégé Incubator Protégé Triple Store OWL API (Mysql) Graph Web Visualizatio services n 3 dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Giving it a try……. Beijing, 2010-10-22 A demo version of the AWB: http://202.73.13.50:55234/agrovocdevv10d/ With all functionalities, availabe to users for testing purpose. Thesaurus Workshop – CAS Latest stable release version 1.0 : (read/write) http://202.73.13.50:55381/agrovocv10i/ Latest stable release version 1.0 (Read only): http://202.73.13.50:55481/agrovocv10i/ (Visitors only with only view privilege) dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 …and more: http://aims.fao.org Thesaurus Workshop – CAS dr johannes keizer - FAO of the United Nations - knowledge and capacity for development
    • Beijing, 2010-10-22 Thank You! Thesaurus Workshop – CAS dr johannes keizer - FAO of the United Nations - knowledge and capacity for development