Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Linked Open Govt Data - Sem Tech East


Published on

Keynote talk at 2011 Semantic Technology and Business conference - Washington DC, November 30, 2011. This updates my earlier slideshare talk on linked open govt data - new slides from slide 17 on.

Published in: Technology, Education
  • Be the first to comment

Linked Open Govt Data - Sem Tech East

  1. 1. Linking Open Government Data Jim Hendler Tetherless World Professor of Computer and Cognitive Science Assistant Dean of Information Technology and Web Science Rensselaer Polytechnic Institute @jahendler (twitter)
  2. 2. Government Data on the Web
  3. 3. Government Data Sharing January 1, 2009 “ Openness will strengthen our democracy and promote efficiency and effectiveness in Government.” --- President Obama Putting Govt Data online- beta May 21, 2009 January 19, 2010 online May 21, 2010 online relaunch with semantic web featured June30,2009 December 8, 2009 “ Open Government Directive ” released 2009 2010 … 57 Data Sets ~6000 Data Set ~2000 Data Sets >305,000 Data Sets
  4. 4. Important to the citizens: eg. Education RPI NYS demos
  5. 5. Moving to linked data (UK) <ul><li>Built around “linked data” from the start </li></ul><ul><li>Authorization for this from the Prime Minister </li></ul>
  6. 6. Moving to linked data (US) <ul><li>Third parties (like RPI) translate the government datasets into linked data formats </li></ul><ul><li>• US hosts 6.4B RDF triples 5/21/2010 </li></ul><ul><ul><li>Semantic Web community hosted </li></ul></ul><ul><ul><li> </li></ul></ul>
  7. 7. <ul><li>Linked data lets us create “Data” Mashups </li></ul>More than 50 of these at (and lots more at
  8. 8. +
  9. 10. Adding some Web magic Web Analytics Social Data Networks External Links
  10. 11. Linking GDP of the US and China GDP of China (Billion Chinese Yuan ) GDP of the US (Billion Dollar) [Temporal Mashup] +
  11. 12. Linking GDP of the US and China GDP of China (Billion Chinese Yuan ) GDP of the US (Billion Dollar) [Temporal Mashup] + This mashup was built in less than 4 hours – including conversion of data, web interface, and visualization!
  12. 13. Govt systems can use linked data web for context Datasets: acres burned, and agency budgets Dbpedia: wikipedia descriptions of major US fires
  13. 14. Integrate with Social media
  14. 15. Combining data from different data sharing sites
  15. 16. RPI workflow enhances raw RDF w/useful URIs derive derive create derive revision Convert Access Enhance Version SemDiff
  16. 17. demos, tutorials, RDF-ized datasets, and more
  17. 19. Government Data in the linked open data cloud Government Data is currently over ½ the cloud in size (~17B triples), 10s of thousands of links to other data (within and without)
  18. 20. URI design <ul><li>URI design is crucial to govt data sharing </li></ul><ul><ul><li>esp. within govts </li></ul></ul><ul><ul><li>Whether your goal is linked data or not </li></ul></ul><ul><li>UK Government has designed and made great use of standard URI practices in their linked data </li></ul><ul><ul><li>US exploring URI design schemes </li></ul></ul><ul><ul><ul><li>Join the community at and participate! </li></ul></ul></ul>
  19. 21. Instance Hub
  20. 22. Example: US States
  21. 23. Example: US Govt Agencies
  22. 24. Etc.
  23. 25. Metadata design <ul><li>Metadata design is crucial to govt data sharing </li></ul><ul><ul><li>Needed for search and federation in large data sharing efforts </li></ul></ul><ul><li>International data sharing will be a crucial next step </li></ul><ul><ul><li>W3C Govt Linked Data Working Group </li></ul></ul><ul><ul><li>Need for vocabularies within govt sectors </li></ul></ul><ul><ul><ul><li>Esp for cross-langauge use </li></ul></ul></ul>
  24. 26. International Open Government Data Search
  25. 27. There’s lots of data out there!!
  26. 28. Searching for data <ul><li>Faceted browser with </li></ul><ul><ul><li>Keyword search </li></ul></ul><ul><ul><li>Catalogs </li></ul></ul><ul><ul><li>Countries </li></ul></ul><ul><ul><li>Agencies </li></ul></ul><ul><ul><li>Categories </li></ul></ul><ul><ul><li>(in any order) </li></ul></ul>
  27. 29. Details and download…
  28. 30. Research remains to be done… (it ain’t all hackathons and contests) <ul><li>Trust </li></ul><ul><ul><li>Government data is controversial, and potentially biased </li></ul></ul><ul><ul><ul><li>How do we confirm or dispute? </li></ul></ul></ul><ul><li>Combination </li></ul><ul><ul><li>When we combine data we need to keep the provenance of information (see trust) </li></ul></ul><ul><ul><ul><li>How can we show and use? </li></ul></ul></ul><ul><li>Scaling </li></ul><ul><ul><li>Our project has already converted 9.9B triples from only >2,000 of the 440,000 government databases we can identify (116 catalogs, 38 countries, 16 languges) </li></ul></ul><ul><li>Versioning and updating </li></ul><ul><li>Archiving </li></ul><ul><li>Visualization </li></ul><ul><li>… </li></ul>
  29. 31. Exploring new visualizations Data from
  30. 32. Summary <ul><li>Open Govt data is a critical resource </li></ul><ul><ul><li>Government data released as RDF (UK) </li></ul></ul><ul><ul><li>Government data converted to RDF (US) </li></ul></ul><ul><ul><li>Government data that can be found in many forms and used or converted (WWW) </li></ul></ul><ul><li>Government transparency comes through in the “mashing up” of data from many datasets </li></ul><ul><ul><li>Key to linked data </li></ul></ul><ul><li>An amazing opportunity for technologists (public and private) to play in an important area of the public good </li></ul><ul><ul><li>Innovation needed! </li></ul></ul>
  31. 33. Questions?