Linked Open Data and Applications

651 views

Published on

Intelligent Web Applications guest lecture about LOD and how to use it for applications. Includes pointers and demos for MultimediaN Eculture, Verrijkt Koninkrijk, Dutch Ships and Sailors, IATI 2LOD and RadioMarche

Published in: Education
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
651
On SlideShare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
Downloads
15
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide
  • Lauradoet: - Sem tech / search - Patronen Cases modeleren en publiceren van Linked DataModeleren van Events - Polimedia( - E-culture)Victor doet: - Am.museum - Tools – Carmen? - Historische use cases - VK, Bioned, DSS
  • Interactie momenthier!
  • General purpose
  • Multiple medical and biological datasets
  • Mashups mix data from different sourcesLinks to Dbpedia, MusicBrainz
  • “Published between 1969 and 1991, the 30 volumes still combine the qualities of an authoritative work for a general audience, and an inevitable point of reference for scholars”Digitized version online in 2011, crashing the server
  • VIC: update namespaces
  • Linked Open Data and Applications

    1. 1. Linked Open Data and Applications Victor de Boer Intelligent Web Applications 24/2/2014 With slides from Rinke Hoekstra
    2. 2. Victor de Boer Assistant professor at VU University Amsterdam Domain-driven Semantic Technologies, Linked Data Cultural Heritage Digital History Linked Data for Development
    3. 3. Today • What is LOD? – What’s in it for me (the developer)? • What can I do with LOD – Examples • My LOD projects and applications • Pointers, examples, inspiration
    4. 4. What is Linked Open Data?
    5. 5. Linked Data is about technology for interoperability Open Data is about licenses to allow reuse
    6. 6. Linked Data five star system ★ Available on the web (whatever format), but with an open license ★★ Available as machine-readable structured data (e.g. excel instead of image scan of a table) ★★★ as (2) plus non-proprietary format (e.g. CSV instead of excel) ★★★★ All the above plus, Use open standards from W3C (RDF and SPARQL) to identify things, so that people can point at your stuff ★★★★★ All the above, plus: Link your data to other people’s data to provide context www.w3.org/designissues/linkeddata.html
    7. 7. “Linking Open Data cloud diagram, by Richard Cyganiak and Anja Jentzsch. http://lod-cloud.net/”
    8. 8. Where can I get it? • • • • • • • • • • • • http://datahub.io/ http://datadryad.org/ https://easy.dans.knaw.nl http://datacatalogs.org/ http://www.openstreetmap.org/ http://www.w3.org/wiki/DataSetRDFDumps http://www.freebase.com/ https://data.overheid.nl/ http://data.gov.uk/ http://www.data.gov/ http://publicdata.eu/ http://doc.metalex.eu • http://linkeddata.few.vu.nl/ Rinke Hoekstra
    9. 9. What can I do with it?
    10. 10. Web of Documents (WWW) Linked Documents
    11. 11. Web of Data Linked Data
    12. 12. Without… Slide stolen from Christophe Gueret
    13. 13. With Linked Data Slide stolen from Christophe Gueret
    14. 14. So how do I do it?
    15. 15. Three main ways of accessing remote Linked Data 1. Through HTTP request on the resource URI 2. Through SPARQL queries 3. Get a copy of a dataset (Linked Data Platform, Linked Data API)
    16. 16. 1. Through HTTP request on the resource URI • HTTP GET on resource, parse, follow links – Simple HTTP requests and RDF parsing – One request per resource: may require many requests • Local caching can be done • Crawling
    17. 17. 2. Through SPARQL queries • Full-blown query language • Needs SPARQL endpoint $query = "SELECT distinct ?title ?description WHERE { ?x <http://data.open.ac.uk/podcast/ontology/relatesToCourse> <http://data.open.ac.uk/course/t209>. ?x <http://purl.org/dc/terms/title> ?title. ?x <http://www.w3.org/TR/2010/WD-mediaont-10-20100608/description> ?description } LIMIT 10 "; $requestURL = 'http://data.open.ac.uk/query?query='.urlencode($query); $response = request($requestURL); SPARQL in PHP example http://www.greenhughes.com/content/approach-consuming-linked-data-php
    18. 18. 3. Get a local copy of a dataset • • • through SPARQL CONSTRUCT, crawling or direct file download • Save in triple store – or convert to something else
    19. 19. RDF Libraries Redland: http://www.librdf.org/ Perl, Python, PHP, Ruby, C#, Objective-C Jena: http://jena.sourceforge.net/ Java RDFLib: http://www.rdflib.net/ Python ARC2: http://arc2.semsol.net/ PHP ActiveRDF: http://www.activerdf.org/ Ruby
    20. 20. What can I do with it?
    21. 21. Examples: Linked Data Browsers Allow you to browse remote linked data, clicking through linked resources and visualising images etc. TimBL's Tabulator http://dig.csail.mit.edu/2005/ajar/ajaw/tab.html Disco Marbles OpenLink data browser Explore more! • http://sig.ma • http://mspace.fm/ • http://www.google.com/publicdata • http://datamarket.com/ • http://www.wolframalpha.com/
    22. 22. OpenPhacts explorer http://www.openphacts.org/
    23. 23. Fancy mashups www.bbc.co.uk/music
    24. 24. Intelligent Web Apps! • • • • • • http://www.sandbag.org.uk/maps/offsetmap/ • • http://www.sandbag.org.uk/maps/emissionsmap/ • • http://www.data-art.net/locus/ • • • • • • http://mashupbreakdown.com/ http://conflicthistory.com/ http://traintimes.org.uk/map/tube/ http://bikes.oobrien.com/ http://www.nomenest.info/ http://wheredoesmymoneygo.org/ http://openspending.org/ http://energy.publicdata.eu/ http://www.fearsquare.com http://energielabelapp.nl/ http://register.ocistimo.si/ http://epdb.eu/eulegislation/ http://www.travelschecklist.com/ Rinke Hoekstra
    25. 25. Enough about me, let’s talk about me.
    26. 26. Multimedia E-culture Demonstrator
    27. 27. MultimediaN E-Culture project • Museums have increasingly nice websites • But: most of them are driven by stand-alone collection databases • Data is isolated, both syntactically and semantically • If users can do cross-collection search, the individual collections become more valuable! • Semantic Search
    28. 28. MultimediaN E-Culture 2003-2008: UvA, VU, CWI, DEN, ICN “Use Semantic Web techniques to facilitate interoperability between cultural heritage institutes”
    29. 29. 29
    30. 30. Semantic search • Search for via annotations with concepts (semantic links) • Use the type of semantic link to provide meaningful presentation of the search results Query “Paris” Paris PartOf Montmartre 30
    31. 31. vocabulary alignment “Tokugawa” AAT style/period Edo (Japanese period) Tokugawa AAT is Getty’s Art & Architecture Thesaurus SVCN period Edo SVCN is local in-house ethnology thesaurus 31
    32. 32. Search, Show and Annotate  Multiple search/browse/result interfaces  Google-like  Local view  Map  Graph display  Facet browser  Split up data based on attribute-values  Multiple criteria  Annotation Interface  Use of semantic autocompletion  Experts  Laypeople? 32
    33. 33. Verrijkt Koninkrijk
    34. 34. Het Koninkrijk der Nederlanden in de Tweede Wereldoorlog History of German occupied Dutch society (1940-1945) Published between 1969 and 1991 in 14 volumes, 30 parts, 18.000 pages 1. Digitization, 2. Open Data, 3. Enriched access with Linked Open Data
    35. 35. country, collection, doc-type, volume, chapter, section, sub-section,
    36. 36. SKOS vocabularies as stepping stones Back-of-the-book index (SKOS) 15.234 Concepts 121.525 references Named Entities (SKOS) 88.249 Concepts 364,924 references
    37. 37. niod:oai_wo2_niod_nl_rec_1020 45 dct:subject niod:Blitzkrieg skos:exactMatc h botb:Blitzkrieg http://resolver.verrijktkoninkrijk.nl/nl.vk.d.reg.4.1386
    38. 38. skos:exactMatch skos:exactMatch
    39. 39. http://semanticweb.cs.vu.nl/verrijktkoninkrijk/ Dereferenceable URIs! http://purl.org/collections/nl/niod/V-wapens.rdf
    40. 40. Geographical analysis using background knowledge from GeoNames 12000 10000 8000 6000 4000 2000 0 NE index SELECT * WHERE { ?s skos:prefLabel ?pl. ?s skos:closeMatch ?geo. ?geo gn:parentADM1 ?prov. ?prov gn:name ?provname. ?s niod:pageRef ?pref. } BotB index SPARQL for R http://linkedscience.org/tools/sparql-package-for-r/
    41. 41. Results are links to paragraphs
    42. 42. Quick analysis, inspiring researchers Jewish 5% Communist 8% R-Catholic 12% Liberal 12% Protestant 13% NationalSocialist 29% SocialDemocrat 21% Pillar1 Pillar2 Liber. Protestant Protestan t R-Cath. Liber. R-Cath. Comm Soc-dem Liber. Soc-dem Co 0.29 0.22 0.21 0.20 0.15
    43. 43. Hackathon
    44. 44. Dutch Ships and Sailors
    45. 45. Dutch Ships and Sailors VOC Opvarenden Dutch Asiatic Shipping Generale Zeemonsterrollen Noordelijke Monsterrollen KB Newspapers
    46. 46. 1782 Web of Data gz:Batavia gz:Mercuur gz:Claas Roem gz:Buijksloot 19-12-1780 das:Texel das:Departure 20-7-1781 das:Batavia das:Arrival das:Voyage1 das:Roem, Klaas voc:Buijksloot voc:Claas Roem das:Mercuur 1752
    47. 47. Example web application? VOC Opvarenden Dutch Asiatic Shipping Generale Zeemonsterrollen Noordelijke Monsterrollen KB Newspapers http://semanticweb.cs.vu.nl/dss http://dutchshipsandsailors.nl/
    48. 48. Linked Data 4 Development
    49. 49. Linked Data for International Aid Transparency Initiative Msc. Thesis by Kasper Brandt Victor de Boer
    50. 50. Introduction - IATI “IATI is a voluntary, multi-stakeholder initiative that seeks to improve the transparency of aid in order to increase its effectiveness in tackling poverty.” -- http://www.aidtransparency.net/
    51. 51. IATI datamodel Activities Organisations Aid Type Country Currency Geographical precision Language Location type Organisation role Policy marker Region Sector Transaction type Vocabularies
    52. 52. Model and links based on requirements elicitated from experts Iterative Requirements Engineering Process Model by Loucopoulos and Karakostas
    53. 53. Linking datasets and Applications User questions 1. In total, how much does a given country receive in aid? 2. A comparative index of aid versus the Human Development Index. 3. What is the geographic location of a project? How much aid went to a given province, constituency or village? o Is the aid spent in places where the need is highest? Is it well distributed across the country? o Can we attribute sub-national breakdowns for aid so we can see how much goes to different parts of recipient countries? 4. How does violent conflict in recipient countries affect aid activities? 5. How does aid spending as registered in the IATI standard compare to World Bank indicators?
    54. 54. IATI 2 LOD application http://iati2lod.appspot.com/applications
    55. 55. http://iati2lod.appspot.com/ 1. In total, how much does a given country receive in aid?
    56. 56. http://iati2lod.appspot.com/ 2. A comparative index of aid versus the Human Development Index.
    57. 57. http://iati2lod.appspot.com/ 4. How does violent conflict in recipient countries affect aid activities? 5. How does aid spending as registered in the IATI standard compare to World Bank indicators?
    58. 58. Talking to Linked Data
    59. 59. RadioMarché Local market data Communiqué Web Interface Text-To-Speech GSM/Voice interface Sahel Eco operative Buyers Community radio
    60. 60. EcoMash [M.Sc. thesis by Henk Kroon]
    61. 61. Linked Data for Development (LD4D) Agrovoc GeoNames DBpedia ‘Allo, Linked Data? RadioMarché Linked market data * <VoiceXML> to SPARQL Web applications Voice browser Tel: +31208080855 Skype: +990009369996162208
    62. 62. Linked Open Data… …should make it easier for developers to develop IWAs … from distributed datasources … with heterogeneous data Go build stuff!
    63. 63. Links to datasets and applications • • • • • http://semanticweb.cs.vu.nl/verrijktkoninkrijk http://semanticweb.cs.vu.nl/dss http://semanticweb.cs.vu.nl/radiomarche http://semanticweb.cs.vu.nl/iati http://eculture.multimedian.nl/demo • http://iati2lod.appspot.com/ • http://eculture.multimedian.nl • http://Worldwidesemanticweb.org /sparql/query= /user/query /yasgui/index.html

    ×