Data in Switzerland: BFS at OKCon 2013

1,329 views

Published on

Published in: Education, Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,329
On SlideShare
0
From Embeds
0
Number of Embeds
97
Actions
Shares
0
Downloads
5
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Data in Switzerland: BFS at OKCon 2013

  1. 1. Federal Department of Home Affairs FDHA Federal Statistical Office FSO Semantic Data! Linked Data Platform @ FSO Adrian Gschwend (Alain Nadeau) September 2013, OKCon Geneva
  2. 2. 2Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO Swiss Federal Statistical Office FSO • Runs and co-ordinates Switzerland’s entire public statistic system • Produces and disseminates key statistical information in • Demographics, Economy, Society, Spatial planning, Environment • Complex analysis, interpretation and monitoring of its data http://www.bfs.admin.ch/bfs/portal/en/index.html
  3. 3. 3Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO Semantic Data! • OpenData policy since foundation in 1860, public mandate • More than 50’000 files available as of today • 2 or 3 star format according to Tim Berners-Lee • CSV, PX, PDF, printed books • FSO follows developments in data dissemination • Berners-Lee 5-star • Semantic data are the future of open data • FSO mandates Berner Fachhochschule (BFH) to pilot a study: How can existing statistical data (Census 2011) be transformed into semantic data and linked with other semantic data http://lod-cloud.net/versions/2011-09-19/lod-cloud_colored.html
  4. 4. 4Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO We are not alone • Wikipedia / DBpedia / Wikidata • Facebook Graph Search • Google Knowledge Graph (Freebase) • JSON-LD & RDFa (microformats) • Linked Data Cloud Trend: Structured, graph based data!
  5. 5. 5Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO Linked Data Platform for BFS • We know our data best • Tabular publication lacks clear semantics • You might interpret a relation differently • Goal: Increase machine readability, clear vocabulary • Standard: Statistical Data and Metadata Exchange (SDMX) http://sdmx.org/
  6. 6. 6Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO Technology Stack • Standardized graph query language: SPARQL • Ask ad-hoc questions without the performance hit • Output formats: CVS/TSV, JSON, XML & RDF • Direct access via HTTP (data and queries)
  7. 7. 7Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO RDF • W3C standard • Resource Description Framework • Provides various serializations (JSON, XML, Turtle etc.) • Supports internationalization by design (i18n) • Technical base for SPARQL • Federation (no need for one big DB) • In your namespace • Logic languages on top of it (RDFS, OWL) • Support in most popular programming languages
  8. 8. 8Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO Prototype with FSO data • Public SPARQL endpoint • Sample apps/visualization • Own namespace (data.admin.ch) • Unique identifiers for every piece of data • Direct access to HTTP URIs in various RDF formats (dereferencing) • Sample integration from different data source (DBpedia, Google Maps) http://www.gemeindezukunft.ch/acms/projekte/opendata/
  9. 9. 9Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO Sample Applications
  10. 10. 10Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO
  11. 11. 11Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO HTML view
  12. 12. 12Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO Turtle Serialization curl -H "Accept: text/turtle" http://data.admin.ch/bfs/municipality/12099
  13. 13. 13Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO Turtle output
  14. 14. 14Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO Same for JSON Curl -H "Accept: application/rdf+json" http://data.admin.ch/bfs/municipality/12099
  15. 15. 15Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO JSON output
  16. 16. 16Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO JSON-LD for „classical“ web coders curl -H "Accept: application/ld-json" http://data.admin.ch/bfs/municipality/12099 Work in progress, not implemented yet on public endpoint!
  17. 17. 17Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO JSON-LD output
  18. 18. 18Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO Ask ad-hoc questions
  19. 19. 19Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO Get answers your way
  20. 20. 20Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO Visualize things your way
  21. 21. 21Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO
  22. 22. 22Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO What you get • The data is the API • Metadata comes with the data • Standardized vocabulary • Standardized query language • Become your own Data Analyst and Data Scientist • Reduces ETL pain of other formats • Federation (see DBpedia integration) • You choose your output format • Built on HTTP stack (web native!) • Advanced: Schemas, RDFS & OWL • Ask me for demos
  23. 23. 23Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO What you pay for • Steeper learning curve • Data owner has more work to do upfront • You need to get rid of some old concepts in your head But it‘s worth it!
  24. 24. 24Semantic data!| OKCon September 2013 Gschwend/Nadeau Federal Department of Home Affairs FDHA Federal Statistical Office FSO Outlook • Stable namespace ? • More datasets ? • A productive, redundant platform ? • More government divisions on board? Talk to us for questions / remarks / participation!

×