The Uses of Open DataAndrew StottUK Transparency Boardformerly Director, data.gov.uk& UK Deputy GCIO @dirdigengSkopje, Macedonia andrew.stott@dirdigeng.com21 March 2012 0.91
A World of Open Data 2
3
Federal Government, USA 4
United Kingdom Government 5
Australia 6
Moldova 7
Kenya – first in Africa 8
World Bank 9
London, United Kingdom 10
City of Vancouver, Canada 11
City of Rennes, France 12
City of San Francisco, USA 13
City of Vienna, Austria 14
A World of Open Data Now over 200 governmental Open Data sites 15
Some UK Examples 16
New economic and social value 17
Cleansing and organising data Business Intelligence from item-level purchasing data 18
Information services to the public Weather, transport and public facilities among most downloaded Smartphone Apps 19
Data Mining Prescription data Patient outcome data Longitudinal health records Pupil-level education records 20
Operational efficiency/optimisationReal time info on road delays and roadworks allowslogistics efficiency 21
Financial Products Weather Risk Management (US: $4bn annual contracts value) Flood insurance on detailed topography and river records 22
Customer attraction and retention estate agents/ realtors Financial services builders and other local services Local house prices attract potential customers 23
Public Service data as a hub for civilengagement 24
Public scrutiny of contracts 34 http://www.otvorenezmluvy.sk/
Data Journalism 35
Lessons learned 36
Top-level political support essential“Greater transparency “Public informationwill enable the public does not belong toto hold politicians and Government, itpublic bodies to belongs to theaccount” public.” 37
Strong civil society ―demand-side‖ vital too 38
Passionate team important too! 39
Deliver incrementally 40
Ensure clear, common, licensing 41
It’s not (just) an IT project!CIOs can give leadership, but CIOs/IT Directors often do not “own” the data Key issues are business, policy and politics: don’t let policy makers brand it as “just IT” Keep the IT simple ‒ Established open source (eg CKAN+Drupal) or commercial products (eg Socrata) ‒ use existing contracts/infrastructure with niche firms ‒ host data on existing websites or on public Cloud 42
Don’t accept ―no‖ — work out ―how‖ It’s held separately by n different organisations, and we can’t join it up It will make people angry and scared without helping them It is technically impossible We do not own the data The data is just too large to be published and used Our website cannot hold files this large We know the data is wrong We know the data is wrong, and people will tell us where it is wrong We know the data is wrong, and we will waste valuable resources inputting the corrections people send us People will draw superficial conclusions from the data without understanding the wider picture People will construct league tables from it It will generate more Freedom of Information requests It will cost too much to put it into a standard format It will distort the market Our IT suppliers will charge us a fortune to do an ad hoc extract 43
It’s not just about new dataScope for “Open Data” also includes datapreviously “published” but … in non-reusable format with restricted licence only aimed at specialist groups only for payment only in response to requests difficult to find data.gov.uk contains a lot of data which nobody knew was already published 44
The importance of location 45
Data Quality Release of data will reveal issues of data quality Celebrate greater checking of data! Use as stimulus to Measure Prioritise Improve 46
Continuously engage with developersPhotos: @memespring, 47@MadLabUK, @paul_clarke
.. and highlight applications, not data 48
Open Government Data Re-Use Model Government Business/Civil Society Consumer Government should not do more than strictly necessary Improve Gov data Aggregation Processing, MarketingData Creation and editing and End Use and delivery Organisation packaging Specialist Specialist Specialist Specialist Services Services Services Services 49
Open Data Institute: its mission Develop capability of UK businesses to exploit value of Open Data Engage developers/small businesses to build Open Data supply chains and commercial outlets Help public sector use its own data more effectively Ensure academic research in Open Data technologies 50
Summary Open Data has Triple Objectives: Transparency + Public Services + Economics Varied, innovative business/social models ―Push‖ and ―Pull‖ of data Business and Civil Society engagement is essential ‒ Important to grow open data “ecosystem” Data flow can be both ways 51
The Uses of Open Data