Evaluating Open
Data
Stephanie Piper, Peck Sangiambut
Introduction
● Current knowledge on evaluation of Open
Data
● A framework to use for evaluation
● Problems with evaluation...
Reasons for OD
Open Government, Government 2.0, E-Government,
Open source
OpenDefinition.org:
“A piece of data or content ...
What do we hope for open data?
● Increased transparency, accountability
● Citizen empowerment
● Business empowerment
● Inc...
What current metrics are out there?
● Economic valuations of data
○ a value placed on software (apps for democracy)
○ meth...
Current problems with evaluation
● Why bother evaluating?
● How do we actually evaluate an open data project?
○ what is su...
Value (and value-added)
● Why we need a framework
● A value framework
○ 4 types:
■ Economic
■ Operational and Technical
■ ...
Open Data Value Framework
Open Discussion/Provocative Qs
● Tracking derived value/value added
● Issues of scale
Summary
Contact Us:
geothink.ca@gmail.com
Email summary will be sent at the end of the
day
Upcoming SlideShare
Loading in …5
×

Evaluating open data

455 views

Published on

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
455
On SlideShare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Evaluating open data

  1. 1. Evaluating Open Data Stephanie Piper, Peck Sangiambut
  2. 2. Introduction ● Current knowledge on evaluation of Open Data ● A framework to use for evaluation ● Problems with evaluation ● Discussion
  3. 3. Reasons for OD Open Government, Government 2.0, E-Government, Open source OpenDefinition.org: “A piece of data or content is open if anyone is free to use, reuse, and redistribute it - subject only, at most, to the requirements to attribute and/or share-alike” http://www.opendefinition.org World Bank: Technically open and legally open data
  4. 4. What do we hope for open data? ● Increased transparency, accountability ● Citizen empowerment ● Business empowerment ● Increased government - citizen interaction Open Data Handbook. http://opendatahandbook.org/en/why-open-data/
  5. 5. What current metrics are out there? ● Economic valuations of data ○ a value placed on software (apps for democracy) ○ methods from economics: willingness to pay, contingent valuation (stated preference) ● Evaluating public sector information (PSI) ○ current income from data ○ turnover rates ○ calculation of market size by estimating re-users ○ indices for supply-side evaluation of transparency, accessibility ○ still survey based ● Evaluation of public dialogue/awareness ○ questionnaire surveys ● Partners - cost avoidance Dekkers, Makx, Polman, Femke, Velde, Robbin te, & Vries, Marc de. (2006). Measuring European Public Sector Information Resources (MEPSIR). European Commission: Retrieved from http://ec.europa. eu/information_society/policy/psi/actions_eu/policy_actions/mepsir/index_en.htm. Pira International Ltd. (2000). Commercial Exploitation of Europe's Public Sector Information. Retrieved from http://epsiplatform. eu/content/commercial-exploitation-europe-s-public-sector-information-pira-study Office for Public Management (2012). Evaluation of Public Dialogue on open data: Report to Research Councils UK. Retrieved from http: //www.rcuk.ac.uk/documents/documents/RCUKFINALNC200612.pdf
  6. 6. Current problems with evaluation ● Why bother evaluating? ● How do we actually evaluate an open data project? ○ what is success? ● Metrics - not enough ○ Downloads and visitor counts not enough ● Anecdotes - not enough ○ People like numbers ○ http://bit.ly/opendata-betterdata ● Estimates from the likes of Apps for Democracy - not good enough ● Definition of open data is a hindrance
  7. 7. Value (and value-added) ● Why we need a framework ● A value framework ○ 4 types: ■ Economic ■ Operational and Technical ■ Organizational ■ Political and Social Janssen, M., Charalabidis, Y., & Zuiderwijk, A. (2012). Benefits, Adoption Barriers and Myths of Open Data and Open Government. Information Systems Management, 29(4), 258–268. Carpenter, J. and Watts, P. (2013) Assessing the Value of OS OpenData to the Economy of Great Britain – Synopsis. Retrieved from https: //www.gov.uk/government/publications/ordnance-survey-open-data-economic-value-study?goback=%2Egde_3135372_member_252572633
  8. 8. Open Data Value Framework
  9. 9. Open Discussion/Provocative Qs ● Tracking derived value/value added ● Issues of scale
  10. 10. Summary Contact Us: geothink.ca@gmail.com Email summary will be sent at the end of the day

×