Chris davisopendatabazaar

Energiedata ontmoet SPARQL Chris Davis c.b.davis@tudelft.nlOctober 4, 2011 1Energy & Industry SectionFaculty of Technology, Policy & Management

Who am I?● Ph.D. student at TU Delft● Energy & Industry Section, at TBM Faculty● Trying to deal with complex socio-technical systems● Interests in visualization, data, simulation October 4, 2011 2

What many people think the Semantic Web looks like:<rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:rdfs="http://www.w3.org/2000/01/rdf-schema#"xmlns:owl="http://www.w3.org/2002/07/owl#" xmlns:swivt="http://semantic-mediawiki.org/swivt/1.0#" xmlns:wiki="http://enipedia.tudelft.nl/wiki/"xmlns:property="http://enipedia.tudelft.nl/wiki/Property:"><owl:Ontology rdf:about="http://enipedia.tudelft.nl/wiki/Special:ExportRDF/Navajo_Powerplant"><swivt:creationDate rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2011-09-23T09:39:50+00:00</swivt:creationDate><owl:imports rdf:resource="http://semantic-mediawiki.org/swivt/1.0"/></owl:Ontology><swivt:Subject rdf:about="http://enipedia.tudelft.nl/wiki/Navajo_Powerplant"><rdfs:label>Navajo Powerplant</rdfs:label><swivt:page rdf:resource="http://enipedia.tudelft.nl/wiki/Navajo_Powerplant"/><rdfs:isDefinedBy rdf:resource="http://enipedia.tudelft.nl/wiki/Special:ExportRDF/Navajo_Powerplant"/><rdf:type rdf:resource="http://enipedia.tudelft.nl/wiki/Category:Powerplant"/><swivt:wikiNamespace rdf:datatype="http://www.w3.org/2001/XMLSchema#integer">0</swivt:wikiNamespace><property:Carbonemissions-23kg rdf:datatype="http://www.w3.org/2001/XMLSchema#double">18325131929.61</property:Carbonemissions-23kg><property:Carbonemissions2000-23kgrdf:datatype="http://www.w3.org/2001/XMLSchema#double">18234413454.711</property:Carbonemissions2000-23kg><property:Carbonemissionsnextdecade-23kgrdf:datatype="http://www.w3.org/2001/XMLSchema#double">18415850404.509</property:Carbonemissionsnextdecade-23kg><property:CarmaId rdf:datatype="http://www.w3.org/2001/XMLSchema#string">30650</property:CarmaId><property:City rdf:resource="http://enipedia.tudelft.nl/wiki/Page"/><property:Congdist rdf:datatype="http://www.w3.org/2001/XMLSchema#string">John Shadegg</property:Congdist><property:Continent rdf:resource="http://enipedia.tudelft.nl/wiki/North_America"/><property:Country rdf:resource="http://enipedia.tudelft.nl/wiki/United_States"/><property:County rdf:resource="http://enipedia.tudelft.nl/wiki/Maricopa"/><property:DBpedia_Page rdf:resource="http://dbpedia.org/resource/Navajo_Generating_Station"/><property:EGRID_ID rdf:datatype="http://www.w3.org/2001/XMLSchema#double">4941</property:EGRID_ID><property:Energyoutput-23J rdf:datatype="http://www.w3.org/2001/XMLSchema#double">6.8759999944992E+16</property:Energyoutput-23J><property:Energyoutput2000-23Jrdf:datatype="http://www.w3.org/2001/XMLSchema#double">6.5159999947872E+16</property:Energyoutput2000-23J><property:Energyoutputnextdecade-23Jrdf:datatype="http://www.w3.org/2001/XMLSchema#double">6.9479999944416E+16</property:Energyoutputnextdecade-23J><property:Fuel_type rdf:resource="http://enipedia.tudelft.nl/wiki/Coal"/><property:Intensity-23kg rdf:datatype="http://www.w3.org/2001/XMLSchema#double">957.08017065964</property:Intensity-23kg><property:Intensity2000-23kg rdf:datatype="http://www.w3.org/2001/XMLSchema#double">1009.696900421</property:Intensity2000-23kg><property:Intensitynextdecade-23kgrdf:datatype="http://www.w3.org/2001/XMLSchema#double">957.08017065964</property:Intensitynextdecade-23kg><property:Isocountry rdf:datatype="http://www.w3.org/2001/XMLSchema#string">USA</property:Isocountry><property:Latitude rdf:datatype="http://www.w3.org/2001/XMLSchema#double">36.9125</property:Latitude><property:Longitude rdf:datatype="http://www.w3.org/2001/XMLSchema#double">-111.3917</property:Longitude><property:Metroarea rdf:resource="http://enipedia.tudelft.nl/wiki/Phoenix-mesa"/>

What the Semantic Web really looks like:

Semantic Web Basics● Everything composed of triples ● Subject, Predicate, Object ● “Apple”, “has color”, “red” ● “red”, “similar to”, “pink”● Every object has a URL – a unique identifier● Triples connect to build property graphs ● May be distributed across the web● Property graphs queried using SPARQL query language via a SPARQL endpoint

Why SPARQL?● Standard query language – like SQL but for the Web ● No more JOIN, just follow links.● Generally more flexible than an API – raw data structure is exposed.● Often allows export of data in variety of formats ● JSON, XML, CSV, HTML, plain text, etc.● Support for federated queries across multiple sources distributed across the Web.

October 4, 2011 8 http://richard.cyganiak.de/2007/10/lod/

What does this mean for us?● Very powerful ideas ● Lots of hype ● A few good use cases ● Still maturing● If youre into Biology or Pokemon, youre in luck● If youre into energy topics, youre not● Best way to predict the future is [for us] to invent it - Alan Kay October 4, 2011

Resources● http://is.gd/sparql - Using SPARQL with Enipedia ● SPARQL tutorials & specifications ● Cheatsheets – SPARQL queries for statistics ● Examples from blog posts ● SparqlExtension – synchronizes wiki with RDF store, embeds queries & visualizations on pages October 4, 2011 10

OpenEI.org

OpenEI.org SPARQL Endpoint● http://en.openei.org/sparql

List all plants, capacity, and commercialonline datePREFIX prop: <http://openei.org/resources/Property-3A>select * where { ?plant prop:GeneratingCapacity ?capacity . ?plant prop:CommercialOnlineDate ?onlineDate .}result

Find all plants, capacity, and commercial online date & sum new installed capacity per yearPREFIX prop: <http://openei.org/resources/Property-3A>select sum(?capacity) as ?totalCapacity ?onlineDate where { ?plant prop:GeneratingCapacity ?capacity . ?plant prop:CommercialOnlineDate ?onlineDate .} group by ?onlineDate order by ?onlineDateresult

Find all plants, capacity, and commercial online date & sum new installed capacity per year grouped by sectorPREFIX prop: <http://openei.org/resources/Property-3A> select sum(?capacity) as ?totalCapacity ?onlineDate ?sector where { ?plant prop:GeneratingCapacity ?capacity . ?plant prop:CommercialOnlineDate ?onlineDate . ?plant prop:Sector ?sector .} group by ?onlineDate ?sector order by ?sector ?onlineDateresult

Other possibilities● Market analysis ● Who buys the most renewable energy? ● Who owns the most renewable energy?

http://enipedia.tudelft.nl12108 Column 16 Column 2 Column 342October 4, 20110 18 Row 1 Row 2 Row 3 Row 4

http://enipedia.tudelft.nl12108 Column 16 Column 2 Column 342October 4, 20110 19 Row 1 Row 2 Row 3 Row 4

October 4, 2011 20

October 4, 2011 21

October 4, 2011 22

October 4, 2011 23

Connecting the Dots... E-PRTR OpenEI.org eGRID Enipedia EU-ETS DBPedia CIA World FactbookOctober 4, 2011 24

October 4, 2011 25

BP Statistical Review of World EnergyOctober 4, 2011 26

October 4, 2011 27 http://is.gd/gasflows

Questions? http://enipedia.tudelft.nl c.b.davis@tudelft.nlOctober 4, 2011 28

October 4, 2011 29

Chris davisopendatabazaar

by Natalia_Trifkovic on Oct 17, 2011

Accessibility

Categories

Upload Details

Usage Rights

1 Embed 91

Statistics

Chris davisopendatabazaar — Presentation Transcript