1) The document discusses evaluating open data by proposing a framework to assess the value of open data initiatives. 2) It identifies four types of value open data can provide: economic, operational/technical, organizational, and political/social. 3) Current challenges with evaluating open data are identified, such as defining success and relying solely on metrics like downloads or anecdotes. 4) The framework is intended to help address these challenges by providing a more comprehensive way to measure the various types of value open data can create.

1. Evaluating Open
Data
Stephanie Piper, Peck Sangiambut

2. Introduction
● Current knowledge on evaluation of Open
Data
● A framework to use for evaluation
● Problems with evaluation
● Discussion

3. Reasons for OD
Open Government, Government 2.0, E-Government,
Open source
OpenDefinition.org:
“A piece of data or content is open if anyone is free to
use, reuse, and redistribute it - subject only, at most, to
the requirements to attribute and/or share-alike”
http://www.opendefinition.org
World Bank:
Technically open and legally open data

4. What do we hope for open data?
● Increased transparency, accountability
● Citizen empowerment
● Business empowerment
● Increased government - citizen interaction
Open Data Handbook. http://opendatahandbook.org/en/why-open-data/

5. What current metrics are out there?
● Economic valuations of data
○ a value placed on software (apps for democracy)
○ methods from economics: willingness to pay, contingent valuation (stated
preference)
● Evaluating public sector information (PSI)
○ current income from data
○ turnover rates
○ calculation of market size by estimating re-users
○ indices for supply-side evaluation of transparency, accessibility
○ still survey based
● Evaluation of public dialogue/awareness
○ questionnaire surveys
● Partners - cost avoidance
Dekkers, Makx, Polman, Femke, Velde, Robbin te, & Vries, Marc de. (2006). Measuring European Public Sector Information Resources
(MEPSIR). European Commission: Retrieved from http://ec.europa.
eu/information_society/policy/psi/actions_eu/policy_actions/mepsir/index_en.htm.
Pira International Ltd. (2000). Commercial Exploitation of Europe's Public Sector Information. Retrieved from http://epsiplatform.
eu/content/commercial-exploitation-europe-s-public-sector-information-pira-study
Office for Public Management (2012). Evaluation of Public Dialogue on open data: Report to Research Councils UK. Retrieved from http:
//www.rcuk.ac.uk/documents/documents/RCUKFINALNC200612.pdf

6. Current problems with evaluation
● Why bother evaluating?
● How do we actually evaluate an open data project?
○ what is success?
● Metrics - not enough
○ Downloads and visitor counts not enough
● Anecdotes - not enough
○ People like numbers
○ http://bit.ly/opendata-betterdata
● Estimates from the likes of Apps for Democracy - not
good enough
● Definition of open data is a hindrance

7. Value (and value-added)
● Why we need a framework
● A value framework
○ 4 types:
■ Economic
■ Operational and Technical
■ Organizational
■ Political and Social
Janssen, M., Charalabidis, Y., & Zuiderwijk, A. (2012). Benefits, Adoption Barriers and Myths of Open Data and Open Government. Information
Systems Management, 29(4), 258–268.
Carpenter, J. and Watts, P. (2013) Assessing the Value of OS OpenData to the Economy of Great Britain – Synopsis. Retrieved from https:
//www.gov.uk/government/publications/ordnance-survey-open-data-economic-value-study?goback=%2Egde_3135372_member_252572633

8. Open Data Value Framework

9. Open Discussion/Provocative Qs
● Tracking derived value/value added
● Issues of scale

10. Summary
Contact Us:
geothink.ca@gmail.com
Email summary will be sent at the end of the
day