The document discusses open data and the CKAN open data catalog. It provides an overview of CKAN, including its data model and API. It also discusses open data initiatives like data.gov.uk and how CKAN is used to power open data portals around the world.

1. Open Data & coding data.gov.uk David Read Open Knowledge Foundation [email_address]

2. Contents The context: Linked Open Data

3. Our data catalogue: CKAN

4. data.gov.uk using CKAN

5. Discussion

6. Open Data ”Data is expensive to create” ”But think of the mutual benefits of it being open” Accessible Allowed to use and republish Without restiction

7. Science UEA criticised for a "culture of withholding information." CC-BY-SA http://commons.wikimedia.org/wiki/User:ChrisO

8. Geographic data

9. Public data

10. Linking data Dr. Hans Rosling, Professor of Global Health, Karolinska Institute, Sweden (TED talk)

11. Linking data 2

12. Linked data

13. Opening government data Transparency --> effectiveness

14. Labour and Conservatives agree (!) with Cambridge economists: Making government datasets public will bring a £6bn boost to UK economy (We have paid for it...)

15. Open Data and Open Software Zero cost

16. Good performance

17. Principles: Many hands make light work / natural selection / wisdom of crowd / on shoulders of giants

18. Not a proprietry format

19. No supplier lock-in

20. Infrastructure Software Data Licence GPL PDDL, ODbL, ODC-By (OKF 2007-) isitopendata.org (OKF 2009-) Modules/Linking Lib, egg Spreadsheet, database, RDF/OWL Human Discovery CKAN (OKF 2008-) Automatic Distribution Apt-get, CPAN, easy_install CKAN datapkg (OKF 2008-) Hosting Sourceforge, PyPI, bitbucket archive.org / knowledgeforge.net Community freshmeat data.gov.uk email list closest?

21. Open Knowledge Foundation Aim: promote Open Knowledge

22. Founded 2004 as a 'not for profit' organisation

23. Strong connections with Cambridge University

24. A key director: Rufus Pollock

25. Volunteer driven

26. Create software tools (CKAN, KnowledgeForge), organise conferences, licenses, create visuals & mash-ups (Where Does My Money Go, Open Shakespeare), campaigns (Panton Principals)

27. Introducing... CKAN ”Comprehensive Knowledge Archive Network” ...well... a fancy Data Catalog

28. ”CKAN is a registry or catalogue system for datasets or other "knowledge" resources. CKAN aims to make it easy to find, share and reuse open content and data, especially in ways that are machine automatable.”

32. Dataset name title version url author licence notes extras Tag name Resource url format description hash CKAN data model * * * Group name title description * *

33. Wiki

36. API REST $ curl http://ckan.net/api/rest/package ["2000-us-census-rdf", "32000-naples-florida-businesses-kml", "aaoe-87", "acawiki", "adb-sdbs", "addgene", "adopt-a-roadside", … Search $ curl "http://ckan.net/api/search/resource?url=.fr&all_fields=1" {"count": 6, "results": [{"id": "819c811c-7afc-4d4f-a7f8-aca0b2a84df5", "package_id": "0ad0dbb9-e1b7-43d6-9fae-ca92a889e871", "url": "http://www.frst.govt.nz/funding/futurefunding", "format": "Spreadsheet", "description": "Future funding (FRST): Spreadsheet", "hash": "", "position": 0}, {"id": ... $ curl http://ckan.net/api/rest/package/coins-data {"id": "78eccf9d-d5b3-4dbd-8ada-6801cfd7e4c8", "name": "coins-data", "title": "COINS data", "version": null, "url": "http://data.gov.uk/dataset/coins", "author": "HM Treasury (UK Government)", "author_email": null, "maintainer": null, "maintainer_email": null, "notes": "### About\r\n\r\nThe UK Government's HM Trea...

37. Datapkg (dpm) Getting a data package $ datapkg index-add file:///.... $ datapkg update $ datapkg search "military spending" military: Military Spending 1890-1914 military-norm: Military Spending 1890-1914 (normalized) $ datapkg install military-norm Downloading military-norm and dependencies. $ datapkg plot military $ datapkg create military-uk-usa table.csv ”Military spending UK vs USA” $ datapkg register military-uk-usa Upload derivative data

38. CKAN communities Europe: Austria, Hungary, Germany, Italy, Finland, Netherlands, France, Norway

39. North America: Colorado, Canada

40. Australasia: New Zealand

41. Sharing metadata ckan.net canada.ckan.net it.ckan.net no.ckan.net data.gov.no data.gov.it

42. Architecture view controller model Drupal front-end Pylons front-end (genshi, routes, repoze.who) Vdm - Versioned Domain Model Postgres REST & Search APIs sqlalchemy Logic layer Data import scripts SOLR Search Export scripts repoze.who Atom feeds sqlalchemy-migrate

43. data.gov.uk Gordon Brown invited Tim Berners-Lee for exciting digital plans

44. David Cameron supportive

45. Run by Antonio Acuna at the Cabinet Office, aided by The National Archives

46. ”Raw Data Now”, then improve and link

47. COI team produce Drupal bulk of data.gov.uk pages with OKFN producing 'data' page in CKAN

55. Measuring success Stats: users, number of datasets, per department, big wins: Ordnance Survey, Coins, top public salaries

56. Creation of visualisations, apps, linked data, news stories, companies - £6bn

57. CKAN – similar goals

58. What do you think?