Today I am going to talk Fingal’s perspective on Open Data; Open Data beyond Fingal; how this data is being used; policy; what the public sector needs to do; what the community can do
Fingal County Council first became aware of Open Data in Summer 2010 We were preparing a report comparing financial data about all Local Authorities which was difficult to find and only available in PDF We discovered the Open Data movement and felt that this was a better way We decided to take the initiative with the backing of the County Manager and Fingal Open Data was born
Our former colleague Emer Coleman was heading up the London Datastore and they advised us on how to develop the initiative
As part of Innovation Dublin, ScraperWiki organised a Hacks and Hackers Day in October 2010 We set this event as a target for the launch of Fingal Open Data
This is how the website looks today – it is now on version 3 It provides public access to source data from Council systems.
There are currently 170 datasets organised into 12 categories Detailed information is provided about each dataset, including description, date published and available formats.
The data is subject to the Irish PSI Licence, drawn up by the Department of Finance, which allows for fair use of the data.
After we launched the site, it took a while before Open Data started to broaden out beyond Fingal
Open Data featured as a theme of the Irish Internet Association Annual Conference On the 4 th & 5 th July, the NDRC ran Ireland’s first Open Data Challenge in partnership with Fingal County Council, Dublin City Council, Microsoft and the Irish Internet Association Participants developed ideas and business propositions based on Fingal Open Data and Dublin City data
JustPark which came second in the challenge has been developed since then and has been rebranded as ParkYa
Distillr came third in the competition and has also continued to develop its offering
The Dublinked initiative was announced on 27 th June 2011 and launched on 18 th October 2011 A collaboration between Dublin City, Dun Laoghaire/Rathdown, Fingal & South Dublin County Councils and NUI Maynooth Platform provided by IBM A Network for Sharing Data to facilitate innovation in the urban environment through collaboration between private, public and research partners with the Dublin city region as a proving ground The aim is to enable innovators to collaborate on tackling challenges facing the Dublin city region using public sector data as the basis. www.dublinked.ie
Datastore 200 datasets (557 files) Data from 4 Dublin Councils and OSI data in research zone (thanks to OSI for being the first) National datasets (Hazardous & Transfrontier Waste Shipments; National Public Transport Nodes; NIAH) Regional Datasets Themes focussed for first release of data were Land Use, Transport & Environmental Zones – Open and Research (Members) – O & M Data criteria for Members zone – Legal issues, Technical (e.g. streaming/live data (samples); binary (Traffic)), Commercial (high-value) Formats – open & non-proprietary where possible; can be onerous to convert – working towards this goal; go ugly early; respond to feedback Metadata for each dataset – Dublinked ‘lite’ standard developed in partnership with Dept. Environment, NUI Galway, Dept. Marine & Natural Resources; compliant with international standards
Past Events Planning Technology Spatial Data Visualisation Open Innovation Future Events Public Sector Transport
Irish Open Data Week was held from 7 th – 11 th November 2011 with a number of events around the country
For Open Data to be of value, it must be put to some use The most common use is through web or mobile Apps
In order to encourage the reuse of data published on Fingal Open Data and Dublinked, Fingal County Council organised the Apps4Fingal competition The competition ran from 9 th November 2011 to 9 th January 2012 There was a prize fund of €11,500 thanks to the generosity of our sponsors
23 Apps were submitted 36 Ideas were entered
Winner of the Student Apps Category was Fingal Day Tripper Fingal Day Tripper is a Web App that allows day trippers to select the type of activities they prefer, as well as if they would like to stop for a coffee. They can also specify whether they are travelling with children or disabled passengers. The app will then suggest a day trip in the local area, showing locations of interest on the map. It also provides the option of getting the route and driving directions for the trip and details of each attraction.
Winner of the Community Apps Category was Fingal Traffic View Fingal Traffic View is an Android Mobile App which provides information about traffic cameras, parking zones, disabled parking, train stations and Garda safety zones. These are displayed on a map and users can also view images from the traffic cameras. The App also incorporates a live feed of twitter accounts related to Dublin Traffic.
Winner of the Enterprise Apps Category was mypp.ie Mypp.ie is a Web App which uses Planning Application data from all 4 Dublin local authorities. These are displayed on a map allowing users to easily check planning applications in an area. Features include a notification service, a 3D interactive house showing what works need planning permission, a professional directory and planning-related news feed. Planning applications are colour coded by status and more info can be displayed. mypp.ie has gone on to develop the service further, now incorporating data from 12 local authorities Through buildingeye.com they are seeking to build internationally
Winner of the Overall & Tourism Apps Categories was Discover Fingal Discover Fingal is a Mobile Web App in which users are encouraged to discover historical and cultural sites in Fingal through a Find and Reward Facebook App and Mobile Website. Detailed information is provided about each site. If a user checks into three cultural sites they are rewarded with a voucher for a free cup of tea or coffee which can be redeemed at Skerries Mills.
All winners and runners up of the Apps4Fingal competition
There are a number of other examples of how Irish open Data has been reused
While the apps4fingal concentrated on Fingal services, many of the Apps incorporate data from other services and across the whole of the Dublin region. In addition, most could scale up to National or International services. One App that has been developed since the competition and which makes use of Open Data is KidsMaps. This takes the playground data from the Fingal Open Data site, but also includes playground data sourced from most of the Local Authorities in Ireland. This is a great example of how Apps based on Open Data can be scalable.
The National Transport Authority released a dataset of all Public Transport nodes in the country These were then mapped by a member of the public
The Property Services Regulatory Authority has started publishing the Address, Price and Date of Sale of all residential properties sold in Ireland since 1 st January 2010 A member of the public downloaded this data and used Google Fusion Tables to map the properties
myhome.ie has taken the data and incorporated it into a prototype system which shows mapped properties for sale alongside sold properties
FixYourStreet is an open transparent tool for reporting problems to Local Government It also has an Open Data dimension, as the data is exposed for developers to write programs that consume the data behind the site – location, details and resolution of Reported issues
FixMyArea is a commercial website which utilises the FixYourStreet interface to submit reports to those Local Authorities using the system
FixMyStreet is a voluntary website which utilises the FixYourStreet interface to submit reports to those Local Authorities using the system
What is the Open Data policy situation in Ireland?
The Irish eGovernment Plan was published in April 2012 The Plan includes Requirement for Public Sector agencies to publish Open Data Data contained in Published Reports must also be published in Open data formats Agencies must carry out audits of data holdings Inter-Agency Data Sharing Integration of Administrative Data Data Sharing Clearing House Review of Data Sharing Legislation The Public Service Reform Plan also includes Centralised Open Data Portal
The eGovernment Action plan contains 3 specific actions relating to Open Data All public bodies will publish Open Data Data published in reports should also be published in parallel in open formats Public bodies will identify data holdings and release by default
How do we go about publishing Open Data
How to publish Open Data Choose Data for Release Extract in Open Format Create Metadata Create Open Data page Publish Data & Metadata Link to PSI Licence
What Data should you publish? Data from your Website currently in non-Open formats currently under restricted Licence Data in Reports Data from Online Services & Maps Requested Data Open Data Census
The Open Knowledge Foundation has identified 10 national datasets that should be released by Governments which have been chosen for their breadth and relevance
National Election Results – available on oireachtas.ie in PDF format
Company Register data available on cro.ie and valoff.ie but only through restricted search interfaces
National Mapping at low resolution – No, but OSI mapping has been made available for research purposes on Dublinked
Government Budget – databank.per.gov.ie as non-machine readable Excel download
Government spending – unclear if available via databank.per.gov.ie
Legislation – irishstatutebook.ie in PDF format
National Statistical Data – cso.ie restricted to samples of data
Postcodes – N/A
Public Transport Timetables – irishrail.ie unsupported API; rtpi.ie API in development
Environmental Data on pollution sources – epa.ie IPPC through restricted search interface
What are the next steps for Public Sector bodies?
Each Public Body should assign responsibility for Open Data to a named individual – which is most likely to be the person responsible for FOI and PSI
Public bodies should start releasing data Possibly use Dublinked to try it out No need to build a website – add a page to the website Support from Senior Management within releasing organisations is essential Should align with Organisational Objectives – Fingal : Tourism, Age Friendly County UK Government policy to release data; however, Local Government is finding it difficult – additional work with reducing resources Use it as an opportunity to create an Internal Data Catalogue for Information Management Align with INSPIRE directive requirements – single data catalogue/store for both
We also need to examine whether usage restrictions can be removed from data already released Do you have a PSI page on your website covering website content? Is any of your content covered by a restrictive licence? Does it really need to be? CSO, EPA, Heritage, Marine, Finance, HSE There are also opportunities for Open Academic Data, Open Scientific Data, Open Bibliographic Data, etc And why not Open Business Data? Open Product Catalogues; Airline Flights and Fares; etc. Enel, Italy’s largest power company, has released Open Data Nike have employed Ward Cunningham, inventor of the Wiki, to work on Open Data
We need to agree standards for data formats, service vocabularies, data catalogues We need to measure the quality of the data and records within the data and publish these quality measures We also need to ensure that once we publish Open Data, we continue to do so on an on-going basis We However, this should not prevent us from starting to publish Open Data Standards can be applied retrospectively Potential users of the data would prefer that the data be released in the first instance (just not in PDF) Go ugly, early
While datasets should be published, we also need to look at publishing data as web services e.g. JSON
The Public Service Reform Plan includes an objective for a national public sector data sharing portal
We need to move to a model of publishing by default We need to ask “why shouldn’t we publish the data”, rather than “why should we publish”
Ideally, in the future as Open data matures, the public sector should move to a model of building its own online services on top of its own Open Data Then, if there are any problems with the Open Data feed, it will affect the public body in the same way as those reusing the data
There is often a fear that the data will be misinterpreted or that the quality is too poor to release Use Metadata & release briefing notes to counter misinterpretation There may be a possibility to use it as an opportunity for improvement through crowdsourcing (UK bus stops) There can also be a reluctance to opening up the decision-making process We’ve always done it this way, the legislation doesn’t allow for Innovation requires that we question why we do the things we do and the way we do it Legislation needn’t be a barrier – so long as it doesn’t say that we can’t do it We in the public sector need to Let Go a bit
What can the Open Data Community in Ireland do?
Open Data Value Chain There are many different activities to be carried out, which can be done by many different people
Grow the Community – starting today
Capture Data and/or develop tools for data capture – sometimes the Public Sector doesn’t have the data
Carry out data cleansing of Open Data U.K. Department of Transport made NAPTAN bus stop dataset available to OpenStreetMap OpenStreetMap volunteers check, edit and verify the data via the NOVAM viewer Improved data quality of public dataset Potential for the same approach to be used here with Government datasets
Build Stuff Demonstrate the value of Open Data Demonstrate how Open data can enable new approaches and insights Build tools and services for the wider community
Provide Advice to Government and Public Sector bodies
Where are our Irish Open Data champions? Can this community play a role?
What is the level of political awareness in Ireland of Open Data?
To conclude A good start has been made with Open Data publishing by Dublin Local Authorities and some national agencies, but progress and uptake has been slow Apps and services have been created that demonstrate the value of Open Data A number of stratup companies are building business models on Open Data Open Data is now Governemnt policy Open Data is now Government Policy Each public agency should be developing a plan for how it will publish this data The Open Data community can provide valuable help and guidance As I mentioned earlier, Fingal Open Data is available at data.fingal.ie And you can also follow us on Twitter at fingalopendata
In line with the theme, this presentation is licenced for sharing under a Creative Commons licence It is available for viewing and downloading on slideshare Thank you.
Open Data - The Fingal Perspective
Open Data the Fingal Perspective Open Data Meetup, EngineYard, Dublin 25th October, 2012http://data.fingal.ie @fingalopendata
eGovernment Plan • Public Sector to publish Open Data • Inter Agency Data Sharing • Integration of Administrative Data • Data Sharing Clearing House • Review Data Sharing Legislation • Implementation Plans • Centralised Portal (Public Service Reform Plan)http://www.flickr.com/photos/ronanone/802918511/
How to publish Open Data• Choose Data for Release• Extract in Open Format• Create Metadata• Create Open Data page• Publish Data & Metadata• Link to PSI Licence
What Data?• Data from your Website – currently in non-Open formats – currently under restricted Licence• Data in Reports• Data from Online Services & Maps• Requested Data• Open Data Census http://www.flickr.com/photos/34233222@N05/3801511495/
Open Data Census http://okfnlabs.org/opendatacensus/
oireachtas.ie - PDFOpen Data Census http://okfnlabs.org/opendatacensus/
cro.ie – searchable database; valoff.ie – searchable database with scanned & online mapsOpen Data Census http://okfnlabs.org/opendatacensus/
osi.ie – Dublinked research onlyOpen Data Census http://okfnlabs.org/opendatacensus/
databank.per.gov.ie – database & unstructured Excel downloadOpen Data Census http://okfnlabs.org/opendatacensus/
? - databank.per.gov.ieOpen Data Census http://okfnlabs.org/opendatacensus/
irishstatutebook.ie - PDFOpen Data Census http://okfnlabs.org/opendatacensus/
cso.ie – restricted useOpen Data Census http://okfnlabs.org/opendatacensus/
n/aOpen Data Census http://okfnlabs.org/opendatacensus/
irishrail.ie – realtime API; rtpi.ie – API in developmentOpen Data Census http://okfnlabs.org/opendatacensus/
epa.ie – IPPC searchable databaseOpen Data Census http://okfnlabs.org/opendatacensus/
Open Datathe Fingal Perspective http://data.fingal.ie @fingalopendata
www.slideshare.net/fingalopendata Licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License http://creativecommons.org/licenses/by-nc-sa/3.0/ Use of any Fingal County Council or Fingal Development Board logos and brands are not covered by this license. Pictures as marked used under Creative Commons license.If you believe any content is infringing copyright, please contact us via http://data.fingal.ie
A particular slide catching your eye?
Clipping is a handy way to collect important slides you want to go back to later.