Visualizing Open Data with Plonea practical guide on how to query and visualize Linked Open Data                      with...
Linked Data evolution     2007                                          as per 2011     keeps growing...     > 1 million d...
Open Data - what is it?    Open data is a philosophy and practice requiring    that certain data be freely available to ev...
Linked Data vs classic ODBC
SPARQL query structure A SPARQL query comprises, in order: ● Prefix declarations, for abbreviating URIs ● Dataset definiti...
Real example querying DBpediaSELECT * WHERE {?subject rdf:type <http://dbpedia.org/ontology/City>.?subject rdfs:label ?lab...
Lets dive into a real example SELECT * WHERE { ?subject rdf:type <http://dbpedia.org/ontology/City>. ?subject rdfs:label ?...
Lets dive into a real example PREFIX o: <http://dbpedia.org/ontology/> PREFIX p: <http://dbpedia.org/property/> PREFIX rdf...
Corresponding data visualisation withDaviz We have been able to create a data visualisation of open linked data with filte...
Removing redundanciesTIP: In order to get rid of some rednundancy you can use "SAMPLE" or "SELECT DISTINCT"PREFIX   o: <ht...
More examples at Daviz show room      daviz.eionet.europa.eu
Example 2: Large companies (DBpedia) PREFIX o: <http://dbpedia.org/ontology/> PREFIX p: <http://dbpedia.org/property/> PRE...
Example 3: Energy plants (Enipedia) SPARQL Endpoint:http://enipedia.tudelft.nl/sparql BASE <http://enipedia.tudelft.nl/wik...
More resources ●   SPARQL endpoints and their status: http://labs.mondeca.     com/sparqlEndpointsStatus/index.html ●   SP...
Data table manipulation via drag and drop
Modular framework
EEA Daviz       And much more...
EEA Daviz            Live Demo
EEA Daviz - ResourcesMore live examples   ○   Eionet       http://daviz.eionet.europa.eu   ○   EEA       http://www.eea.eu...
Upcoming SlideShare
Loading in …5
×

Visualize open data with Plone - eea.daviz PLOG 2013

2,311
-1

Published on

A practical guide on how to query and visualize Linked Open Data with eea.daviz Plone add-on.

In this presentation you will get an introduction to Linked Open Data and where it is applied. We will see how to query this large open data cloud over the web with the language SPARQL. We will then go through real examples and create interactive and live data visualizations with full data tracebility using eea.sparql and eea.daviz.

Presented at the PLOG2013 conference http://www.coactivate.org/projects/plog2013

Published in: Technology
0 Comments
4 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
2,311
On Slideshare
0
From Embeds
0
Number of Embeds
10
Actions
Shares
0
Downloads
17
Comments
0
Likes
4
Embeds 0
No embeds

No notes for slide

Visualize open data with Plone - eea.daviz PLOG 2013

  1. 1. Visualizing Open Data with Plonea practical guide on how to query and visualize Linked Open Data with eea.daviz product Antonio De Marinis Web Technology Management European Environment Agency www.eea.europa.eu
  2. 2. Linked Data evolution 2007 as per 2011 keeps growing... > 1 million datasets Watch video STRATA conference 2013
  3. 3. Open Data - what is it? Open data is a philosophy and practice requiring that certain data be freely available to everyone, without restrictions from copyright, patents or other mechanisms of control. Linked Open Data (LOD) or simply Linked Data is a technique to interlink all open datasets into a web of data, aka semantic web, using technologies like RDF and SPARQL.
  4. 4. Linked Data vs classic ODBC
  5. 5. SPARQL query structure A SPARQL query comprises, in order: ● Prefix declarations, for abbreviating URIs ● Dataset definition, stating what RDF graph(s) are being queried ● A result clause, identifying what information to return from the query ● The query pattern, specifying what to query for in the underlying dataset ● Query modifiers, slicing, ordering, and otherwise rearranging query results # prefix declarations PREFIX foo: <http://example.com/resources/> ... # dataset definition FROM ... # result clause SELECT ... # query pattern WHERE { ... } # query modifiers ORDER BY ...
  6. 6. Real example querying DBpediaSELECT * WHERE {?subject rdf:type <http://dbpedia.org/ontology/City>.?subject rdfs:label ?label.?subject rdfs:comment ?abstract.?subject <http://dbpedia.org/ontology/populationTotal> ?populationTotal.FILTER (lang(?label) = "en" && lang(?abstract) = "en")} LIMIT 5
  7. 7. Lets dive into a real example SELECT * WHERE { ?subject rdf:type <http://dbpedia.org/ontology/City>. ?subject rdfs:label ?label. ?subject rdfs:comment ?abstract. ?subject <http://dbpedia.org/ontology/populationTotal> ?populationTotal. FILTER (lang(?label) = "en" && lang(?abstract) = "en" && (?populationTotal >= "5000000"^^xsd: integer)) } LIMIT 5
  8. 8. Lets dive into a real example PREFIX o: <http://dbpedia.org/ontology/> PREFIX p: <http://dbpedia.org/property/> PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX geo: <http://www.w3.org/2003/01/geo/wgs84_pos#> SELECT DISTINCT * WHERE { ?subject a o:City. ?subject rdfs:label ?label. OPTIONAL {?subject rdfs:comment ?abstract.} ?subject p:populationTotal ?populationTotal. OPTIONAL {?subject geo:lat ?latitude.} OPTIONAL {?subject geo:long ?longitude.} FILTER (lang(?label) = "en" && lang(?abstract) = "en" && (?populationTotal >= "5000000"^^xsd:integer && ?populationTotal < "60000000"^^xsd:integer)) } ORDER BY DESC(?populationTotal) find all properties by exploring dbpedia e.g. dbpedia http://dbpedia.org/page/Tokyo Example without duplicates http://daviz.eionet. europa.eu/data/local-sparql-queries/most- populated-cities
  9. 9. Corresponding data visualisation withDaviz We have been able to create a data visualisation of open linked data with filters/facets entirely through the web in about 10 minutes! live demo http://www.eea.europa.eu/sandbox/plog2013/most-populated-cities- with-coordinates-plus
  10. 10. Removing redundanciesTIP: In order to get rid of some rednundancy you can use "SAMPLE" or "SELECT DISTINCT"PREFIX o: <http://dbpedia.org/ontology/>PREFIX p: <http://dbpedia.org/property/>PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>PREFIX geo: <http://www.w3.org/2003/01/geo/wgs84_pos#>SELECT ?subject (sql:SAMPLE(?subject) as ?city)(sql:SAMPLE(?label) as ?label)(sql:SAMPLE(?latitude) as ?latitude) live example http://daviz.eionet.europa.(sql:SAMPLE(?longitude) as ?longitude) max(?populationTotal) as ?maxPopulation eu/visualisations/most-populated-cities max(?rainyDays) as ?rainyDaysWHERE {?subject a o:City.?subject rdfs:label ?label.OPTIONAL {?subject rdfs:comment ?abstract.}?subject p:populationTotal ?populationTotal.OPTIONAL {?subject geo:lat ?latitude.}OPTIONAL {?subject geo:long ?longitude.}OPTIONAL {?subject p:yearPrecipitationDays ?rainyDays.}FILTER (lang(?label) = "en" && lang(?abstract) = "en" && (?populationTotal >= "5000000"^^xsd:integer))}GROUP BY ?subjectORDER BY DESC(?maxPopulation)
  11. 11. More examples at Daviz show room daviz.eionet.europa.eu
  12. 12. Example 2: Large companies (DBpedia) PREFIX o: <http://dbpedia.org/ontology/> PREFIX p: <http://dbpedia.org/property/> PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX geo: <http://www.w3.org/2003/01/geo/wgs84_pos#> SELECT * WHERE { ?subject rdf:type <http://dbpedia.org/ontology/Company>. ?subject rdfs:label ?label. ?subject rdfs:comment ?abstract. ?subject p:numEmployees ?employees. ?subject o:location ?location. ?location geo:lat ?latitude. ?location geo:long ?longitude. FILTER (lang(?label) = "en" && lang(?abstract) = "en" && ?employees > 10000) } ORDER BY DESC(?employees) LIMIT 20
  13. 13. Example 3: Energy plants (Enipedia) SPARQL Endpoint:http://enipedia.tudelft.nl/sparql BASE <http://enipedia.tudelft.nl/wiki/> PREFIX a: <http://enipedia.tudelft.nl/wiki/> PREFIX prop: <http://enipedia.tudelft.nl/wiki/Property:> PREFIX cat: <http://enipedia.tudelft.nl/wiki/Category:> PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> select ?Name ?Point ?Generation_capacity where { ?powerPlant prop:Country a:Italy . ?powerPlant rdfs:label ?Name . ?powerPlant prop:Point ?Point . ?powerPlant prop:Generation_capacity_electrical_MW ?Generation_capacity . }
  14. 14. More resources ● SPARQL endpoints and their status: http://labs.mondeca. com/sparqlEndpointsStatus/index.html ● SPARQL tutorial by example: http://www.cambridgesemantics.com/semantic- university/sparql-by-example ● eea.sparql package gives you a sparql client and data holder for plone available on pypi ● eea.daviz bundle includes eea.sparql and the visualisations tools
  15. 15. Data table manipulation via drag and drop
  16. 16. Modular framework
  17. 17. EEA Daviz And much more...
  18. 18. EEA Daviz Live Demo
  19. 19. EEA Daviz - ResourcesMore live examples ○ Eionet http://daviz.eionet.europa.eu ○ EEA http://www.eea.europa.eu/data-and-maps/daviz

×