Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

The (im)possibilities of measuring open data impact

271 views

Published on

Presentation at the Open Belgium 2019 conference, why impact measurement is hard, what we know does work, and how we can combine that into a framework that itself is a sensor too.

Published in: Government & Nonprofit
  • Be the first to comment

  • Be the first to like this

The (im)possibilities of measuring open data impact

  1. 1. Measuring the Impact of Open Data turning (im)possibilities into a framework #openbelgium Brussels,4 March 2019 Ton Zijlstra, @ton@m.tzyl.nl @ton_zylstra, thegreenland.eu, slides: https://grnl.eu/frame
  2. 2. the next Google? Hey, we’re the NEXT !
  3. 3. yay! impact!
  4. 4. http://www.flickr.com/photos/chipdatajeffb/8421625784/ yay! impact! http://www.flickr.com/photos/chipdatajeffb/8421625784/
  5. 5. www.flickr.com/photos/nican45/17080405779/
  6. 6. Mission www.flickr.com/photos/pfs481/35040420090/
  7. 7. 10 reasons it’s hard 1. Dealing with variety and aggregating small increments 2. Spotting new entrants, tracking SME’s 3. Comparison needs context 4. Open data provision maturity determines possibilities 5. Demand side maturity determines possibilities 6. Network effects are costly to track 7. Motives shape measurements 8. We don’t know how infrastructure creates impact 9. Measurements get gamed, and become targets 10. E puor si move!
  8. 8. Dealing with variety and aggregating small increments
  9. 9. One
  10. 10. www.flickr.com/photos/markmorgantrinidad/16868989329/
  11. 11. www.flickr.com/photos/thingsworthdescribing/8037304717
  12. 12. www.flickr.com/photos/13523064@N03/15234386535/i
  13. 13. www.flickr.com/photos/leejordan/2461996137/
  14. 14. https://en.wikipedia.org/wiki/And_yet_it_moves#/media/File:E_pur_si_muove.jpg E puor si muove!
  15. 15. common patterns • SME’s benefit most, so track those • Public good, and Price elasticity >1 • Higher order effects occur & are more valuable • Public sector benefits a lot, is strong re-user • Costs for data holders small, <<1% • Openness = higher quality data and interaction • Core registers are an infrastructure and enabler • Open data is a policy instrument, you can choose your impact
  16. 16. www.flickr.com/photos/massivekontent/35905942750/
  17. 17. LEAD LAG Doing the right things Results of the right things happening Indicators
  18. 18. phases, lead (36) & lag (34) PHASE • Provision • Gov impact • Adoption/interaction • Use a policy instrument • Re-use • Ecosystem formation • Network effects LEAD • % gov active, 8 • % holistic data gov, 4 • downloads, 7 • %PSBs / domains, 6 • reach ,5 • stakeholders, 4 • stakeholder nudging, 2 LAG • W3C barometer, 5 • reduced transaction costs, 9 • effort spent by users, 2 • instrument costs compared, 5 • tax revenue, 5 • data economy jobs, 5 • mapping value chains, 3
  19. 19. www.flickr.com/photos/bambe1964/5355199509/
  20. 20. final thoughts • end game is ‘open by design and default’ : impact not a prerequisite • start with base registers, and key policy goals • policy instrument to engage key stakeholders • plan to measure impact by design • framework works in aggregate and at institution level • framework is the measurement: pick & choose across phases • only micro-economic impact studies are real • you can start measuring from the beginning
  21. 21. Thank you. Merci. Hartelijk dank. All photos: Ton Zijlstra, by
 Except screenshots, and where mentioned on the photo. Slides: https://grnl.eu/frame Ton Zijlstra, by nc sa Site: https://thegreenland.eu Blog: https://zylstra.org Contact: ton@thegreenland.eu @ton@m.tzyl.nl @ton_zylstra

×