How open is public data agi 2011-13


Published on

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Open data in relation to public services has typically been collected as a by- product of delivery and include datasets about public services, user satisfaction and performance of providers. Large non-personal datasets routinely collected by public services Service records (such as school, public health record) to give individuals right to access and control their own records User feedback on services (i.e. social care or health) Currently published: spending data, senior salaries, To be published: key data on the National Health Service, schools, criminal courts and transport
  • Accountability: public sector organisation sharing information about the use of public funds (Public Asset register) Choice: providing comparative information to enable a meaningful choice between different public services (spending data) Productivity: reporting of costs and service performance can be a driver for efficiencies (comparable data, spikes cavell), use of data can lead to productivity improvements (GI Value study) Quality and Outcomes: benchmarking of data can help peer based competition and better quality outcomes. Self service by people may improve the quality of data Social growth: access to self-serve (incidence reporting, london cycle hire, wehre is my nearest) Economic Growth: data for reuse to foster analytic service leading to innovation. Operational use: collected for carrying out services (ie asset management, public transport, planning, etc.) Prevention, risk reduction: Linking services 24/7 access to information through the web (on holiday, at home, on travel or in the office)
  • We have been collecting courts data for people accused of riots going through the magistrates courts - as of today, the legal system has processed over 1,100 cases and we have been recorded addresses and demographic details . Against map of multiple deprivation. Location based on crowd sourcing, flickr etc.
  • 1. Make it open No T&Cs about not using the data for commercial use, no restrictions on access. Make the data available to anyone to do whatever they want to with it. That's the only way that the data information revolution is going to work. 2. Make it readable for computers The data needs to be in a format that any computer can use - no more PDFs, thank you very much. If developers can't build applications and campaigners can't analyse it, what use is it? 3. Make it granular The days when we only wanted official statisticians to just put the numbers together in a way we could understand are gone. Now we also want the full, disaggregated data too. It's the only way it will ever be useful for someone wanting to gather the true local picture of local spending. Let us worry about whether the dataset is too big or not. It's not your problem anymore. 4. Make it quick Just get the stuff out there. We'd rather have it as it is - and then get it revised later than have to wait months for it to be finalised. The government has provided express permission for local authorities to do this. So just do it. 5. Make it easy to find There's no point hiding this stuff away. If we can't find it, it may as well not exist. It should be easy to discover and simple to access.
  • Open Public Data ONS: Statistics some published in linked data format NOMIS OS Open Data: Small scale data Natural England: Open data Local authorities: 81 published spending data according to guidelines (87 authorities across uk local authorities publish open data according to openlylocal (following OGL and machine readable) )n 7 July only 15 out of 434 had totally opened data Open data not government: Open street map Non-open data: Google maps (open for public use but licences apply Non-open public data: OS large scale data OS derived data which are not exempt: Public assets, government service location,
  • Human readable data : to be easily understandable to humans, most commonly in html or pdf format, data cannot be easily reused, processed, analysed and linked to other data Open Data : follows open data standards developed by the w3 consortium, to be machine-readable (CSV, XML) Linkable Data: Data that can be compared using comon reference Linked data : specific form of open data, enables the data to be joint up with other related information, coded according to specific classifications (ontologies) published in linked data formats such as RDF using specific uniform resource identifiers.
  • How open is public data agi 2011-13

    1. 1. How Open is Public Data? Dr Gesche Schmid Head of Geographic Information Policy [email_address] Presented at:
    2. 2. Coalition Government: Data Transparency <ul><li>To enable the public to hold politicians and public bodies to account </li></ul><ul><li>To reduce the deficit and deliver better value for money in public spending </li></ul><ul><li>To realize significant economic benefits by enabling businesses and non-profit organisations to build innovative applications and websites using public data. </li></ul>
    3. 3. What is Open Public Data? <ul><li>&quot; Public Data &quot; is the objective, factual, non-personal data on which public services run and are assessed, on which policy decisions are based, or which is collected or generated in the course of public service delivery. </li></ul><ul><li>(Transparency Board, ) </li></ul><ul><li>Open data is data which can be freely used, reused and redistributed by anyone. </li></ul><ul><li>(Open knowledge foundation, ) </li></ul>
    4. 4. Transparency Board: Public data principles <ul><li>Public data will be </li></ul><ul><ul><li>published in reusable, machine-readable form </li></ul></ul><ul><ul><li>released under the same open licence which enables free reuse </li></ul></ul><ul><ul><li>available and easy to find through a single easy to use online access point ( ) </li></ul></ul><ul><ul><li>published using open standards and in reusable form for others to use </li></ul></ul><ul><ul><li>timely and fine grained </li></ul></ul><ul><li>Public bodies should </li></ul><ul><ul><li>actively encourage the re-use of their public data </li></ul></ul><ul><ul><li>maintain and publish inventories of their data holdings </li></ul></ul><ul><ul><li>release data quickly, and then re-publish it in linked data form </li></ul></ul>Nigel Shadbolt Tim Berners-Lee Rufus Pollock Tom Steinberg
    5. 5. Open Data consultation <ul><li>The Open Data consultation paper sets out Government’s proposed approach for Transparency and Open Data Strategy, which is aimed at establishing a culture of openness and transparency in public services. </li></ul><ul><li>We want to hear from everyone – citizens, businesses, public services themselves, and other interest groups – on how we can best embed a culture of openness and transparency in our public services.  The consultation closes on 27 October 2011.  </li></ul>
    6. 6. Data Transparency: Why open public data? <ul><li>Improve local accountability </li></ul><ul><li>Lead to greater choice and informed choice </li></ul><ul><li>Power economic growth </li></ul><ul><li>Give users more power to self serve (social growth) </li></ul><ul><li>Improve productivity through better consistent and comparable data (better quality) </li></ul>
    7. 7. Legislation and Policies: What should/can be released and how <ul><li>Access to data: Freedom of Information Act (FOIA), Environmental Information Regulation (EIR), Data Protection Act (DPA), </li></ul><ul><li>Reuse of data: Reuse of Public Sector Information Regulation (RPSI) </li></ul><ul><li>Technical standards framework for location data (INSPIRE) to facilitate the access and sharing of data. </li></ul><ul><li>Data transparency (Making open data real, Code of practice on transparency, Data policy for a public data corporation) </li></ul>
    8. 8. Open Data consultation on <ul><li>Enhance the Right to data to reuse (FOI, EIR) </li></ul><ul><li>Set transparency standards (machine readable and linked data as the goal) </li></ul><ul><li>Hold bodies to account for delivering open data </li></ul><ul><li>Ensure collection and publication of the most useful data (meaningful data), standards set by central government </li></ul><ul><li>Make the working of public sector more open </li></ul><ul><li>Stimulate enterprise and market making in the use of open data (innovation) </li></ul>
    9. 9. Open Public Data
    10. 10. Examples of Open Data Use Birmingham Gritting routes based on OSM
    11. 11. Examples: Use of Open data <ul><li>Mapping of England riots against poverty indicator (deprivation index): </li></ul>Guardian data blog, Simon Rogers:
    12. 12. London Bike App
    13. 13. How to make data really open <ul><li>1. Make it open </li></ul><ul><li>No T&Cs about not using the data for commercial use, no restrictions on access. </li></ul><ul><li>2. Make it readable for computers </li></ul><ul><li>The data needs to be in a format that any computer can use </li></ul><ul><li>3. Make it granular </li></ul><ul><li>Publish the full, disaggregated data to gather the true local picture of local spending. </li></ul><ul><li>4. Make it quick </li></ul><ul><li>Just get the stuff out there. We'd rather have it as it is - and then get it revised later than have to wait months for it to be finalised. </li></ul><ul><li>5. Make it easy to find </li></ul><ul><li>There's no point hiding this stuff away. It should be easy to discover and simple to access. </li></ul>(open knowledge foundation )
    14. 15. Local Government Open Data <ul><li>Barrow Borugh Council (57) </li></ul><ul><li>Warwickshire Borrow Council (54) </li></ul><ul><li>Sunderland City Council (43) </li></ul><ul><li>Bristol City Council (27) </li></ul><ul><li>Lichfield District Council (19) </li></ul><ul><li>East Staffordshire Borough Council (12) </li></ul><ul><li>East Sussex County Council (12) </li></ul>
    15. 17. What people say about Open Data Not a question of how much data to make open but how to make it open What is the return on investment? There has been little interest in OpenData from our citizen Are the opening up of data enough to meet the need of transparency and accountability? Datasets are inherently dull and are they understood by the local citizen?
    16. 18. Just open data or meaningful open data <ul><li>Establish inventories of data so people know what is available and where to find it </li></ul><ul><li>Follow Open standards so that data can be combined and compared? </li></ul><ul><li>Requires some data quality (currency, accuracy, validity) </li></ul><ul><ul><li>Else: Health Warning! </li></ul></ul>
    17. 19. Open to Linked Data Adapted from Ian Painter Snowflake by Local Government Group
    18. 20. Meeting INSPIRE Compliance: From discovery to mapping Barrow Borough Council using INSPIRE compliant Open Source Web Mapping Service
    19. 21. Use of Open Data <ul><li>Open, Linkable and Linked data: enables connections of data through the web </li></ul><ul><li>Mobile Technology: Access to location based information anywhere. </li></ul><ul><li>Apps: linking location data to local authority records such as environmental health, ratings of restaurants, recording incidences. </li></ul>
    20. 22. Open kent
    21. 24. Licences regulates the use of data <ul><li>UK Government Licence Framework (UKGLF) defines a licensing framework for the use of public data. </li></ul><ul><li>Open Government Licence: free commercial reuse of data with limited exceptions </li></ul><ul><li>Creative commons: set of licenses that permit the sharing of copyright largely for non-commercial use </li></ul><ul><li>Other licensing: operational guidance on data sharing ( </li></ul>
    22. 25. Other licences <ul><li>Third party licences define the use of data </li></ul><ul><li>Example Public Sector Mapping Agreement (PSMA) license: licences the use of Ordnance Survey data across the public sector </li></ul><ul><ul><li>free-to-use: created independent of OS datasets and does not include OS attribute data. </li></ul></ul><ul><ul><li>Derived data: contains one or more feature contained in an OS dataset </li></ul></ul><ul><ul><li>End User License for contractors and community groups </li></ul></ul><ul><ul><li>Exemption process for derived data </li></ul></ul>
    23. 26. Limitations on open public data
    24. 27. Data Privacy <ul><li>Transparency and privacy complement each other. A successful transparency programme is build on confidence of the public that their privacy is protected </li></ul><ul><li>De-anonymisation of large scale datasets may be possible </li></ul><ul><li>O’Hara argues in Transparent Government, Not Transparent Citizens for a case by case assessment of privacy </li></ul>
    25. 28. Affordability: Data is not costless <ul><li>Cost: </li></ul><ul><ul><li>Collection (as part of services) </li></ul></ul><ul><ul><li>Prepare data for publication (extract, convert, check for personal data) </li></ul></ul><ul><ul><li>Sign post (metadata on </li></ul></ul><ul><ul><li>Dissemination (publishing) </li></ul></ul><ul><ul><ul><li>5 stages of publishing </li></ul></ul></ul><ul><ul><ul><li>Meeting INSPIRE compliance requires additional webmapping services </li></ul></ul></ul><ul><li>Charging </li></ul><ul><ul><li>Freely reusable (raw data) </li></ul></ul><ul><ul><li>Marginal cost pricing (to cover costs) </li></ul></ul><ul><ul><li>Commercial rate (value add) </li></ul></ul>
    26. 29. Conclusions <ul><li>Government is opening up public data: many examples of uses </li></ul><ul><li>Data becomes more reusable (license, standards) </li></ul><ul><li>but far from consistent; start of a journey! </li></ul><ul><li>Opening of data is not costless!! </li></ul><ul><li>INSPIRE adds usability of data but also costs </li></ul><ul><li>Who is benefitting from open data? </li></ul><ul><ul><li>My granny versus geek?! </li></ul></ul><ul><li>Who should fund the opening of public data? </li></ul><ul><ul><li>Taxpayer? </li></ul></ul><ul><ul><li>Private sector sponsor? </li></ul></ul><ul><ul><li>Users? </li></ul></ul><ul><li>Who should provide open data? </li></ul><ul><ul><li>Government in form of public data? </li></ul></ul><ul><ul><li>Crowd sourced open data (OSM)? </li></ul></ul><ul><li>What data should be opened up? </li></ul><ul><li>Have your say in the Open Data Consultation! </li></ul><ul><li>http:// /open-data-consultation </li></ul>