Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Welcome & Housekeeping
Jeni Tennison
Today's objectives
1. Learn about the Open Addresses project
2. Contribute to Discovery Phase
• help us understand require...
Agenda
10:00 – 11:25 Background
11:35 – 12:45 Requirements
12:45 – 13:30 LUNCH
13:30 – 14:50 Issues & Approaches
15:00 – 1...
Who's here?
Ground rules
• Chatham House (except presentations)
• you can report something was said, not who said it
• Save your quest...
Housekeeping
• Toilets
• No fire alarm
• Wifi
• Network: nyquist-guest
• Username: visitor.wireless
• Password: 2ndavenue
...
KEYNOTE
Experiences from Denmark
Morten Lind
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Addresses and Address
Data
Experiences from Denmark
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Introduction
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Ministry for Housing, Urban and Rural Affairs
Address: Gammel Mønt 4, 1117 C...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 12
Disclaimer
The basic fac...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 13
”Mr. and Mrs. Dursley of...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 14
Guru
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 15
Christopher Corbin,
Addr...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 16
Bob Barr
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Concept of Addressing
ODI-UK, 08-08-2014 DK Addresses and Address Data 17
A
...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 18
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 19
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 20
Addresses are important
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 21
Bratislava, August 1968
...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 22
CC Paul Townsend
(Flickr...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 23
… and should be easy to ...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 24
… initiative launched 20...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 25
“As a network, addresses...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 26
Delivery Services
Commun...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
A Brief History
– of addressing in Denmark
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
… 1960 Addresses
covers urban areas only
ODI-UK, 08-08-2014 DK Addresses and...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 29
1978-80: Standard Addres...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 30
1995-2001: Geocoding and...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 31
1995-2001: Geocoding and...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 32
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 33
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 34
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Conceptual Issues
The Concept of Addresses and Address Data
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 36
From “Address as an Attr...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 37
… which encourages Incon...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 38
Towards “Address as an O...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 39
Addresses as a Common As...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 40
Addresses as a Common As...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 41
2000-2001: Supported by ...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Address Data Agreement
The 2002 agreement to provide address data
as “Open d...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
2000-2002 Deadlock Situation
Situation:
• State of the art address data, 97 ...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 44
Ministry of Finance comes to rescue
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 45
2002 …: Free of Charge D...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Drivers behind the
agreement
– and the Evaluation of the Socio-Economic
Impa...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Public Transport Services
ODI-UK, 08-08-2014 DK Addresses and Address Data 4...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Public Safety and Crime Detection
ODI-UK, 08-08-2014 DK Addresses and Addres...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Disease Monitoring and Control
ODI-UK, 08-08-2014 DK Addresses and Address D...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Cancer Research
ODI-UK, 08-08-2014 DK Addresses and Address Data 50
“In stud...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Postal Delivery Services
ODI-UK, 08-08-2014 DK Addresses and Address Data 51...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Emergency Dispatch Services
ODI-UK, 08-08-2014 DK Addresses and Address Data...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Commercial use
ODI-UK, 08-08-2014 DK Addresses and Address Data 53
“In the f...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Assessing the Impact
Estimated Socio-Economic Benefits 2005-2009 of
the Free...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 55
2010: Assessment of Bene...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 56
Chain of Address Data Re...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 57
Increase in Re-use 2002-...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 58
Result: Assessment of Be...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 59
Results Confirmed by EU ...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
OSM Paris, 04-04-2014 DK Addresses and Address Data 60
Potential Cost-benefi...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Present time
Initiatives, opportunities and challenges
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 62
We are in a New World
> ...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 63
Where Emergency Response...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 64
On the Political Agenda
...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 65
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 66
The Address Program
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
DK Addresses and Address Data 67
The data quality
– E.g. timeliness, accurac...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
External Interest in Improvement *)
• Public sector – at all levels:
– Waste...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 69
National TV-spot from Ma...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Benefits for Society
Expected and experienced socio-economic
benefits of the...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Benefits of the Address Program
Improved
Data Quality
and timeliness
Improve...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
The Address Program Business Case
2012 2016 2020
Even
Better
Almost
perfect?...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
DK Addresses and Address Data 73
• Because our address data are open they ar...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Any government wants to create new jobs,
private innovation and entrepreneur...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Data is the new Gold
– Open data is a great
opportunity for pushing
our econ...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Joys Law
"No matter who you are, most of
the smartest people work for
someon...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 77
Open Address Data: Busin...
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
ODI-UK, 08-08-2014 DK Addresses and Address Data 78
MINISTRY FOR
HOUSING, URBAN
AND RURAL AFFAIRS
Contact Information
• Morten Lind, Ministry for Housing, Urban and Rural Aff...
An Open National Address
Gazetteer
Hugh Neffendorf
An Open National Address Gazetteer
Open Addresses Symposium
Vision for an Open Address Database
8 August 2014
Hugh Neffend...
BIS feasibility review
z Prompted by ODUG paper to Data Strategy Board
z Request from Ministers
z BIS review working with ...
Why Open Addressing?
z Critical element of our identity for personal and business
reasons
z Open Data is changing attitude...
Definitive or Open?
z Definitive addressing is the priority goal
z Many users will pay reasonable prices for good data
z B...
Establishing evidence
z Does Open mean growth?
z Little hard evidence on Open Data
y Tracking often stops when no licensin...
The address system today
OS
VOA
LG
LG
LR
NAG PAF
SN&N
+ many
roles
Addresses
UARN UPRN
GeoPlace
LLPGs
NGRs
Land parcels
& ...
Usage sector Open View Benefit
H/M/L
Open Lite
OK?
Notes
Academics ✓✓✓ H Y Better quality research from more accurate data...
Review conclusions
z Seven main options
y Totally Open
y Evolving status quo
y Extended bulk purchases
y New charging mode...
Address Hub vision
Open Addresses
Project Vision
Jeni Tennison
Wider context
• Data culture is changing
• long term, inexorable move to open
• We have seen this before
• software, music...
What can we learn?
• Mixed economy persists
• customer base for closed shrinks
• Shift from products to services
• new opp...
"The sale of the PAF with the Royal Mail was a
mistake. Public access to public sector data
must never be sold or given aw...
“Open data is data that can be freely used,
reused and redistributed by anyone –
subject only, at most, to the requirement...
Open is not equivalent to free
open
data
free
service
Hypothesis 1: closed address files are monopoly
information assets, embedded in huge amounts
of public data, but which can...
Open Addresses Project
• Discovery Phase funded from
Release of Data Fund
• administered by Open Data User
Group within Ca...
Open Addresses Vision
• Meeting the expectations of the
modern information economy
• Collaboratively maintained to
benefit...
Modern requirements
• Addresses are not just for posting mail
• Other requirements:
• validation & auto-completion
• geoco...
Modern maintenance
• Through collaboration
• professional / expert engagement
• the wider crowd
• Supplemented by
• target...
Added value products
open
addresses subsetadd detail
Where we are
• Legal feasibility
• received legal opinion
• doing due diligence on key open datasets
• Technical feasibili...
What next
• Pending approval
• Alpha phase – Oct-Nov
• incorporating Open Addresses Ltd
• building minimum viable product
...
Unique opportunity
• Green field development
• do not need to be limited by legacy
• You can help this succeed
• contribut...
Questions?
Requirements Introduction
Requirements Carousel
• Six tables
• you will visit four
• Go to a table of your choice
• listen to the presentation
• ask...
Requirements from:
Table 1 BBC Chris Henden
Table 2 GDS Paul Downey
Table 3 Direct Marketing Assoc. Tim Drye
Table 4 ONS A...
BREAK
returning at 11:35
Requirements Carousel
Requirements Carousel
Table 1 BBC Chris Henden
Table 2 GDS Paul Downey
Table 3 Direct Marketing Assoc. Tim Drye
Table 4 ON...
LUNCH
returning at 13:30
Meeting the Challenges
Introduction
Meeting the Challenges
• Lots of things to work out
• green(ish) field development
• Focus on five challenges
• hear a tal...
Meeting the Challenges
Tracking provenance
Francis Davey
Tracking provenance
• Three types of sources
• data project sources & processes
• data contributed by third parties
• data...
Due Diligence
• Need certainty for reusers
• Where did addresses originate?
• in initial database
• through subsequent add...
Recording Provenance
Calculating Certainty
• More or less certainty about data
• Supporting information
• using known localities / streets
• ot...
Meeting the Challenges
Sourcing addresses
John Murray
Open Addresses Symposium
Meeting the Challenges
Address inference from open data
John Murray
Sources of Addresses
• Land Registry
• Companies House
• National Social Housing Register (NROSH)
• NHS – GP surgeries, ho...
Sources of Spatial Information
• Ordnance Survey:
– Codepoint Open
– OS Locator
– OS Gazetteer
– Street view
– Named place...
Proposal
• Build a street and places gazetteer, to which address points (PAON and
SAON) may be attached.
• Use spatial dat...
Pixel Analysis
• Overlay vector streets and postcode centroids on OS
StreetView
• Use in conjunction with OS locator for c...
Pixel Analysis
8 August 2014 Open Addresses Symposium 126
Adding Land Registry
8 August 2014 Open Addresses Symposium 127
Maximising Available Data
• Using ONSPD, correcting postcodes where there
is an unambiguous coordinate match from a
termin...
Source Audits
• Land Registry – Good quality, kept up to date,
few errors. Covers England and Wales.
• Companies House – D...
Prototype
• Contains all current GB postcodes.
• Streets added where possible.
• Localities added where possible.
• Correc...
Initial Results
OS_Locator LandReg Companies NROSH Count Percent
0 0 0 1 5,042 0.29%
0 0 1 0 18,990 1.09%
0 0 1 1 606 0.03...
Weaknesses
• Lack of addresses for Scotland
• Inference not always accurate due to:
– Non-vehicular streets
– Streets in c...
Conclusion
• More study needed on veracity to:
– Understand issues in data.
– Ensure integrity of database.
– Make more ac...
Questions?
Test drive the prototype.
Building Gazetteer
• Existing open data
• from OS (& Royal Mail)
• from ONS
• Areas & indicative points
• OpenStreetMap
• ...
Getting Addresses
• General sources
• Land Registry price point data
• Companies House addresses
• Specific lists of
• NHS...
Meeting the Challenges
Structuring addresses
Rob Walker
The BS7666 Approach to Structuring
Data
Rob Walker
BSI IST/36 Geographic information
138Rob Walker 2014-08-08
139
What is BS 7666?
• A standard for gazetteers of geographic objects
• Defines a system of spatial references based upon...
Overall purpose of BS 7666
• For defining common geo-referencing systems for
entities within scope
• Provides a standard w...
Multi-part standard
• Part 0 – General model for gazetteers and spatial
referencing
• Part 1 – Specification for a street ...
142
Gazetteer
• Record of locations of particular type or types
with sufficient information to find and identify
each uniq...
Characteristics of a geographic object
Geographic
Object
Position Identification Classification
reference point
extent
des...
144
Address
• Identifies a real-world location (addressable
object)
• Type of Land and Property Identifier (LPI)
• Provide...
145
Property
Address
Street
Locality
Town
Admin Area
Property address model
Rob Walker 2014-08-08
Scope - entities
Addressable object
Land and property identifier
Public
right
of way
Street
Basic land
and property
unit
A...
147
Structure of Land and Property
Gazetteer (Part 2)
• Scope
• Definition of terms
• Conceptual schema for land and prope...
Issues beyond the Standard
• Guidelines for creation of data
• Property numbering and street naming
• Data quality
• Verif...
Summary
• BS 7666 is a specification for gazetteers of geographic objects
• Particularly for Basic Land and Property Units...
What is an Address?
• What should the scope be?
• Delivery points?
• Buildings?
• Households?
• Rooms?
Addressable Locations
room
house
street
locality
locality
authority
Meeting the Challenges
Measuring quality
Bob Barr
Never mind the quality feel
the width?
Quality measures for a UK Open Address File
Prof Robert Barr OBE
Manchester Geomati...
Private!
Secrecy and Quality
• Proprietary data sets are seldom available for comprehensive quality
assurance
• Where data has been...
Quality
Domain
• What is being addressed?
• Postal delivery points
• Dwellings
• Taxable hereditaments
• Buildings
• Infrastructur...
Completeness
• When % completeness is claimed, how independent is the measure of
the total number of addressable objects i...
Currency
• When is an address added and how soon does it appear in the public
file
• When is an address deleted / archived...
Positional Accuracy
• Does any geocode (Lat.Long or OSGR) correctly identify the addressed
object?
• Are numbered properti...
Attribute Accuracy
• Address attributes such as residential non-residential flags need to be
correct
• Other address attri...
Address Content Accuracy
• Is the right and correct information stored in each address field in the
database
• Does the ad...
Open
Open Address Quality
• By releasing address intelligence on an open platform quality can be checked
and corrections made o...
Conclusions
• Addressing in the UK is NOT:
• Definitive
• Authoritative
• A Public Good
• Of measurable quality
• Fit for ...
Conclusions
BECAUSE:
• Since 1979 the primary motivation for maintaining national address
files has been to make a profit ...
That’s It!
Robert Barr
r.barr@peartrees.com
Quality metrics
• Number of addresses
• Coverage
• what baseline can we use?
• estimate against census stats?
• check agai...
Meeting the Challenges
Organising effort
Jerry Clough
Collaboration
• Why contributors contribute?
• self-interest
• subversion
• fun
• What can we do to capitalise on
these?
Correct Your Address
• Let people control their address
• new builds
• house names
• devotion to locality
• Let look-ups b...
Sustainability
• Core database open & free
• Some lookups open & free
• What can we charge for?
• service-level agreement?...
BREAK
returning at 15:00
Meeting the Challenges
Workshop
Meeting the Challenges Workshop
Table 1 Tracking provenance
Table 2 Sourcing addresses
Table 3 Structuring addresses
Table...
Wrap Up
Jeni Tennison
Next Steps
• We will write this up
• we hope you do too!
• tweet on #openaddresses
• Discovery Phase documentation
• mid S...
Get Involved
• Hiring for Open Addresses
• project lead
• independent Board members
• https://theodi.org/jobs
• Complete t...
Open Addresses Symposium: 8th August 2014
Open Addresses Symposium: 8th August 2014
Open Addresses Symposium: 8th August 2014
Open Addresses Symposium: 8th August 2014
Upcoming SlideShare
Loading in …5
×

Open Addresses Symposium: 8th August 2014

2,294 views

Published on

The Open Data Institute held the Open Addresses Symposium for those interested in shaping the creation of an Open Address Database for the UK

Published in: Data & Analytics
  • Be the first to comment

Open Addresses Symposium: 8th August 2014

  1. 1. Welcome & Housekeeping Jeni Tennison
  2. 2. Today's objectives 1. Learn about the Open Addresses project 2. Contribute to Discovery Phase • help us understand requirements • help us explore feasible approaches 3. Connect with each other
  3. 3. Agenda 10:00 – 11:25 Background 11:35 – 12:45 Requirements 12:45 – 13:30 LUNCH 13:30 – 14:50 Issues & Approaches 15:00 – 15:45 Workshop 15:45 – 16:00 Wrap-up
  4. 4. Who's here?
  5. 5. Ground rules • Chatham House (except presentations) • you can report something was said, not who said it • Save your questions for discussion time • Own your opinion & listen to others' • There are no wrong ideas • we are exploring this territory
  6. 6. Housekeeping • Toilets • No fire alarm • Wifi • Network: nyquist-guest • Username: visitor.wireless • Password: 2ndavenue • Hashtag #openaddresses
  7. 7. KEYNOTE Experiences from Denmark Morten Lind
  8. 8. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Addresses and Address Data Experiences from Denmark
  9. 9. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Introduction
  10. 10. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Ministry for Housing, Urban and Rural Affairs Address: Gammel Mønt 4, 1117 Copenhagen Ministry’s Logo The Ministry Minister Carsten Hansen
  11. 11. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 12 Disclaimer The basic facts are approved … but personal statements are mine
  12. 12. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 13 ”Mr. and Mrs. Dursley of number four, Privet Drive was proud to say that they were perfectly normal …” J.K. Rowlands: ”Harry Potter and the Philosophers Stone” (Chapter 1, p. 1)
  13. 13. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 14 Guru
  14. 14. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 15 Christopher Corbin, Address Data, PSI, Open data Michael Nicholson, Intelligent Addressing, EURADIN Rob Walker, ISO Address Standard
  15. 15. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 16 Bob Barr
  16. 16. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Concept of Addressing ODI-UK, 08-08-2014 DK Addresses and Address Data 17 A B “Structured information that allows the unambiguous determination of an object for purposes of identification and location” From ISO 19160 DIS
  17. 17. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 18
  18. 18. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 19
  19. 19. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 20 Addresses are important
  20. 20. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 21 Bratislava, August 1968 (Nordfoto, DK) … without addresses navigation is difficult
  21. 21. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 22 CC Paul Townsend (Flickr: brizzle born and bred) … so road signs were painted out in the UK during WWII
  22. 22. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 23 … and should be easy to understand
  23. 23. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 24 … initiative launched 2009 by the Universal Postal Union, UPU
  24. 24. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 25 “As a network, addresses allow individuals to be connected to everyday life, have a legal identity, participate in the democratic process, be part of the society, as well as the formal economy, receive public and private services and participate in the information and communication age. Governments and public and private services also benefit from the address network by using it to optimize the reach of policies, communicate with individuals and support goods and service delivery. Addresses are the underlying thread connecting these different actors and their activities, effectively functioning as a network of networks.” Universal Postal Union, UPU
  25. 25. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 26 Delivery Services Communication networks Vehicle navigation Civil registration Marketing Statistics Location planning Yellow pages, mapping Social services Tax, assessmentInsurance/finacing Property market Transport Customer relations Emergency Health care Geo enabled applications ADDR 3A
  26. 26. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS A Brief History – of addressing in Denmark
  27. 27. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS … 1960 Addresses covers urban areas only ODI-UK, 08-08-2014 DK Addresses and Address Data 28 1967 Post code system introduced 1970-73 Addresses extended to rural areas
  28. 28. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 29 1978-80: Standard Address Format Jennifer Red Blue Street 14A, 1.tv 4990 Grenville C Mun.C Street AddNo Floor Door 413 0915 14A 1 tv
  29. 29. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 30 1995-2001: Geocoding and Harmonization Basic method: Collect addresses from 2-3 property base registers and combine them with the “house-number layer” in the first generation of digital maps. Store the resulting data in the public Building and Dwelling Register MapKRR Property Data Registers BBR Building- and Dwelling Register Municipal Technical Base Maps
  30. 30. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 31 1995-2001: Geocoding and Harmonization Mun StrC AdNo X-coord. Y-coord. Arc. --- ---- ---- -------,-- -------,-- ----- 619 4605 _17A 248.510,45 153.345,08 175,0 The initiative was a volunteer municipal project supported by the government and the local government association by standards, access to public registers and project coordination
  31. 31. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 32
  32. 32. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 33
  33. 33. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 34
  34. 34. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Conceptual Issues The Concept of Addresses and Address Data
  35. 35. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 36 From “Address as an Attribute” Population Register Tax Property Register Building Register Health Care Register of Business Entities Utilities
  36. 36. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 37 … which encourages Inconsistency Property register Orchards Lane 2 DB1Utility data base: Old Kings Road 88 DB1
  37. 37. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 38 Towards “Address as an Object” Population Register Tax Property Register Building Register Customer management Business Entities Utilities Address Register
  38. 38. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 39 Addresses as a Common Asset for Society 22 Before 2 Oak Lane After 0a3f507f-c5df-32b8-e044-0003ba298018
  39. 39. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 40 Addresses as a Common Asset for Society Address System Concept of Addresses as a common, public asset and resource Person (CPR, health, social, Tax …) Business Legal entities production units… Building, dwelling, utilities, property …
  40. 40. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 41 2000-2001: Supported by Legal Framework Public and Common Private Road Legislation § Population Register Legislation § Building Register Legislation § Until 2001 Building Register Act Sect. 3a-3g § 2001: All legal regulation of addressing transferred to the Act on Building and Dwelling Registration (Last revision 2012) Statutory order on road names and Addresses § 2003: Detailed regulation on rules for addressing (Latest revision May 2014) From 2001 - …
  41. 41. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Address Data Agreement The 2002 agreement to provide address data as “Open data”, without fee or license restrictions
  42. 42. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS 2000-2002 Deadlock Situation Situation: • State of the art address data, 97 % with HQ geo codes • Very large potential for use; Could be joined with data from other public base registries • Large user demand from: emergency, police, county administration, transport sector, health … But: • Data owned by 275 individual municipalities; no common license agreement or data distribution Therefore: • Almost no re-use of data outside municipalities; but competing private sector collections/datasets ODI-UK, 08-08-2014DK Addresses and Address Data 43
  43. 43. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 44 Ministry of Finance comes to rescue
  44. 44. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 45 2002 …: Free of Charge Data Agreement  Prepared by Danish e-Government Taskforce in Ministry of Finance  Purpose: Increase use of address data including geo codes  Covers full public and private sector use and add-on valueing  Payment only of marginal costs of distribution  No license fee or any other payment based on IPR  Re-distribution to 3rd parties without payment  Economic compensation to municipalities; also for maintenance
  45. 45. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Drivers behind the agreement – and the Evaluation of the Socio-Economic Impact
  46. 46. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Public Transport Services ODI-UK, 08-08-2014 DK Addresses and Address Data 47 ”When we started our first ’Journey Planner project’we had to manage individual agreements with every single municipality on the use of their address data – in the long run this was not a feasible solution. Without the ”free-of-charge data agreement our project would have been almost impossible” Ulla Skjelbo, Project Manager ”Rejseplanen”/Journey Planner 1999-2000
  47. 47. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Public Safety and Crime Detection ODI-UK, 08-08-2014 DK Addresses and Address Data 48 ”Access to the official geo coded addresses proved to be one of the most important milestones in the implementation of GIS in the police force” Ole Jacobsen, National Investigation Center, Danish National Police
  48. 48. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Disease Monitoring and Control ODI-UK, 08-08-2014 DK Addresses and Address Data 49 Legionella Examples showing monitoring Legionella infections over a period of 2 decades and detection of the transmission source of a recent Campylobacter outbreak. ”Geo coded address data is a crucial tool to the national monitoring of infectious diseases and to the analysis for detection of transmission source of outbreaks.” Ivan Bæhr, GIS specialist, Statens Serum Institut – SSI (Danish Center for Disease Control) Campylobacter
  49. 49. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Cancer Research ODI-UK, 08-08-2014 DK Addresses and Address Data 50 “In studies of environmental pollutants and human health, the assessment of individual exposure to pollutants are a major challenge. Without geo coded addresses our recent estimations of radon in the homes of children with leukemia and air pollution at the residences of lung cancer patients, had not been possible.” Ole Raaschou-Nielsen. Institute of Cancer Epidemiology, Danish Cancer Society
  50. 50. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Postal Delivery Services ODI-UK, 08-08-2014 DK Addresses and Address Data 51 Address based planning of mail delivery (courtesy: Post Denmark) “Post Denmark assesses that the new route planning tool ’TOR’will reduce delivery costs by 7,5 millions EUR every year. This corresponds to 3,3% of the overall time used for delivery” (’TOR’ is based on geo coded address data) Lars Kristensen, Post Denmark in ”Fyens Stiftstidende” 03-12-2004
  51. 51. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Emergency Dispatch Services ODI-UK, 08-08-2014 DK Addresses and Address Data 52 “When people call 1-1-2, the first thing to know is where the accident happened. Address and street name is the most important tools to confirm the location – in order for us to dispatch the right ambulance.” Erling Larsen, Danish 112 Centers’ Secretariat (112 was one of the first address data users)
  52. 52. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Commercial use ODI-UK, 08-08-2014 DK Addresses and Address Data 53 “In the first year after the Free-of- Charge agreement, everybody thought they could make simple business just by re-selling the original address data. It very quickly became clear, though, that the opportunities for business was in value-adding and development of new, smart products based on the addresses as a common reference.” Martin Glarvig, Managing Director, Geomatic DK
  53. 53. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Assessing the Impact Estimated Socio-Economic Benefits 2005-2009 of the Free-of-Charge Agreement
  54. 54. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 55 2010: Assessment of Benefits 2005-2010 2000 2005 2010 2015 Good Better Best Average Start ’Zero’ Today How shall we assess the benefits of the increased address data re-use?
  55. 55. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 56 Chain of Address Data Re-use ADDR ‘Public Data Server’ (PDS) 2nd level Licensed Data Distributors 3rd 5th4th … End users Data distribution from a common hub managed by DECA (www.ois.dk) Municipalities Re-use and re-re-use
  56. 56. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 57 Increase in Re-use 2002-2009 Use of address data sets 25 1.250 0 200 400 600 800 1.000 1.200 1.400 2001 2009 Datasetsdistributed/year 2002 2009 Number of Address data sets distributed or updated to 3rd parties in 2002 and 2009 (of the 1250, approximately 300 was ’full cover Denmark’ 70% 20% 10% Private sector State, region Municipality
  57. 57. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 58 Result: Assessment of Benefits Direct, measurable economic benefits from re-use of public address data 2005-2009: ~ 63 mill. EUR (~471 mill. DKK) Assessed benefits in 2010: ~ 14 mill. EUR (~105 mill. DKK) Cost of data agreement 2003-2009: ~ 2.6 mill. EUR (~20 mill. DKK) ~ In 2010: 0.2 mill. EUR (~1.5 mill. DKK)
  58. 58. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 59 Results Confirmed by EU Commission Pricing of Public Sector Information Study (POPSIS) selected the Danish provision of address data as one of the case studies. The Study used another method, but the conclusion, that the Free-of- Charge agreement on address data had a significant positive socio- economic impact, was the same. EU DG InfSoc, October 2011
  59. 59. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS OSM Paris, 04-04-2014 DK Addresses and Address Data 60 Potential Cost-benefit of a Danish Address 1 1000 5.000.000 Address authority Industry Products The municipal address authority allocates and registers an address or a road name 1000 application developers or data producers integrates the address or road name in their product or service 5 mill. users now have access to the new address or road name in their it- system, GPS, smartphone or tablet Few cost Huge benefit
  60. 60. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Present time Initiatives, opportunities and challenges
  61. 61. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 62 We are in a New World > 50 % of all Households! (1,25 mill.) Antal husstande med GPS navigation og smartphone (Kilde: Danmarks Statistik) 0% 10% 20% 30% 40% 50% 60% 70% 2006 2007 2008 2009 2010 2011 2012 GPS navigation Smartphone *) Add to this number of GPS, smartphones and tablets used in private businesses and public sector
  62. 62. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 63 Where Emergency Response is Data-driven 500 times every day, an ambulance is dispatched to an incident where the response time is critical – i.e. few minutes delay could cause death or another serious situation
  63. 63. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 64 On the Political Agenda TV2/Fyn 8. oktober 2012”Unfortunately there are many places without an accurate address”
  64. 64. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 65
  65. 65. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 66 The Address Program
  66. 66. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS DK Addresses and Address Data 67 The data quality – E.g. timeliness, accuracy, coverage, harmonization, standardization The back end infrastructure – E.g. base register systems, coherence with other basic data sets etc. The services – E.g. by reliable, high-effect, open services for mapping, online access and download … and everything within the concept of Open Data and Open Services The Address Program shall Improve ODI-UK, 08-08-2014
  67. 67. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS External Interest in Improvement *) • Public sector – at all levels: – Waste of time in management of in-formal, local address registers – Waste of time to sort out data inconsistency from different sources • Business – Utilities, LBS service providers, transport sector: – Higher accuracy, better address coverage and improved timeliness – Improved data services, reduced costs of acquisition • Citizens: – Are worried if GPS and emergency service will not find them – Are troubled when services are poor because of bad addressing *) Based on several stakeholder reports and feed back from users and citizens DK Addresses and Address Data 68ODI-UK, 08-08-2014
  68. 68. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 69 National TV-spot from May 2014
  69. 69. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Benefits for Society Expected and experienced socio-economic benefits of the Address Program – and examples
  70. 70. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Benefits of the Address Program Improved Data Quality and timeliness Improved infrastructure Systematic Re-use IT-Infrastructure: (Implementation + operation) New address register Data Distribution/Services Improved Data Quality: (implementation costs) Extra FTE’s in municipalities and MBBL Address authority tasks: (operational costs) Extra FTE’s in municipalities and MBBL Benefits from digital self- service, electronic forms, applications, reporting Reduced cost of new it- applications and systems Reduced cost and time of present it and address data management Other business process benefits In total ~30 mill EUR/yr from 2015 ~ 5 mill EUR (one time) + 1 mill EUR/yr ~ 85 FTE (one time) ~ 40 FTE every year ODI-UK, 08-08-2014 DK Addresses and Address Data 71
  71. 71. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS The Address Program Business Case 2012 2016 2020 Even Better Almost perfect? Good Today ’Zero’ (Do nothing) Future situation Estimated annual net benefit: 30 mill. EUR/yr ODI-UK, 08-08-2014 DK Addresses and Address Data 72
  72. 72. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS DK Addresses and Address Data 73 • Because our address data are open they are widely in use for many applications • Because our data are in use and open, users see the mutual benefits in reporting errors • Because we receive error reports, we are able to improve our address data Note ODI-UK, 08-08-2014
  73. 73. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Any government wants to create new jobs, private innovation and entrepreneurship – and tax revenue ODI-UK, 08-08-2014 DK Addresses and Address Data 74
  74. 74. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Data is the new Gold – Open data is a great opportunity for pushing our economy Neelie Kroes, Vice President EC ODI-UK, 08-08-2014 DK Addresses and Address Data 75
  75. 75. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Joys Law "No matter who you are, most of the smartest people work for someone else.” Bill Joy, the co-founder of Sun Microsystems ODI-UK, 08-08-2014 DK Addresses and Address Data 76
  76. 76. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 77 Open Address Data: Business Opportunities
  77. 77. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS ODI-UK, 08-08-2014 DK Addresses and Address Data 78
  78. 78. MINISTRY FOR HOUSING, URBAN AND RURAL AFFAIRS Contact Information • Morten Lind, Ministry for Housing, Urban and Rural Affairs – Denmark, mli@mbbl.dk – Twitter: @mortlin • The Ministry (MBBL): www.mbbl.dk • Danish Geodata Agency: www.gst.dk • Danish Basic Data Program: http://uk.fm.dk/publications/2012/good-basic-data-for-everyone/ • The Address Program: www.adresseprogrammet.dk • Danish Address Website: www.danmarksadresser.dk • Address data services: www.aws.dk • The value of Danish address data: http://danmarksadresser.dk/file/389579/Value_Assessment_Danish_Address_Data_UK_2010-07-07.pdf • Twitter: Danmarks Adresser - @DKAdresser Address data services: @AWS_Suiten
  79. 79. An Open National Address Gazetteer Hugh Neffendorf
  80. 80. An Open National Address Gazetteer Open Addresses Symposium Vision for an Open Address Database 8 August 2014 Hugh Neffendorf
  81. 81. BIS feasibility review z Prompted by ODUG paper to Data Strategy Board z Request from Ministers z BIS review working with data owners, representative bodies and government officials z Independent report by Katalysis z Report and comments published https://www.gov.uk/government/publications/an-open-national-address-gazetteer z Now with BIS and Cabinet Office
  82. 82. Why Open Addressing? z Critical element of our identity for personal and business reasons z Open Data is changing attitudes and behaviours z Addresses are a key core reference and would be a big win for Open Data z The potential for innovation stimulated growth is the prize But, it was recognised that: z Costs may be high to government z Ownership is complex z Compelling and quantifiable benefits case is elusive
  83. 83. Definitive or Open? z Definitive addressing is the priority goal z Many users will pay reasonable prices for good data z But many are deterred by licensing and/or price z Open can support definitive – more usage, more feedback Can we achieve both?
  84. 84. Establishing evidence z Does Open mean growth? z Little hard evidence on Open Data y Tracking often stops when no licensing y APPSI seminar was inconclusive z Some good cases of ‘Open’ growth y Population census y PSMA y OS OpenData y Companies House z Considerable need for (good) evidence z Open Addresses should have monitoring
  85. 85. The address system today OS VOA LG LG LR NAG PAF SN&N + many roles Addresses UARN UPRN GeoPlace LLPGs NGRs Land parcels & addresses OWPAs TOIDs Users Postmen Royal Mail PSMA Commercial AddressBase Postal address Postcode UDPRN Aliases MultiRes. BS7666 address UPRN Linkage files TOID UARN UPDRN VARs Tax data links Provides new addresses Receives postcodes The Address System Today
  86. 86. Usage sector Open View Benefit H/M/L Open Lite OK? Notes Academics ✓✓✓ H Y Better quality research from more accurate data Individual citizens -- M Y/N Indirect benefit from improved identity authentication and service delivery; better e-products Devolved administrations ✓✓ H N Scotland strongly in favour; NI interested; Wales? Land Registry ✓ L N No great consequences. Can see wider benefits Local government ✓✓ H N Good for citizen engagement. Worried about any resource impacts Mail and delivery industry -- L N Some benefit from better quality addresses. Concerned to maintain quality Market research ✓✓ M Y Will save money on buying addresses; more consistent research Not for Profit Enterprises ✓✓ M Y Better quality use of data and data exchange Open data community ✓✓✓ H Y Open Addresses is one of their most important requirements PAF Solutions Providers ✓✓ M N Generally positive views from larger resellers. Smaller ones may feel threatened. Quality is a concern Private sector generally ✓✓ H Y Considerable saving and simpler licensing will free up activity Public sector generally ✓✓ M Y/N Already well covered by PSMA/PSL but can see merits in wider extension SME market ✓✓✓ H Y Considerable value for software developers Statistics users ✓✓ M Y Interested in wider data linkage benefits Vehicle navigation ✓ L Y Some gain from reliable benchmark updates Valuation Office ✓ L N No great consequences. Can see wider benefits Web search providers ✓✓✓ H Y Will open considerable growth opportunities
  87. 87. Review conclusions z Seven main options y Totally Open y Evolving status quo y Extended bulk purchases y New charging models y Addresses as an Open online service y Freemium (Free ‘Lite’ products) y Commissioned ‘basic’ Open product - recommended • Also considering scope for efficiencies y Hub operation y Shared intelligence y Less duplication
  88. 88. Address Hub vision
  89. 89. Open Addresses Project Vision Jeni Tennison
  90. 90. Wider context • Data culture is changing • long term, inexorable move to open • We have seen this before • software, music, books • changes in technical delivery • changes in cultural expectations
  91. 91. What can we learn? • Mixed economy persists • customer base for closed shrinks • Shift from products to services • new opportunities to make money • Existing providers can adapt • but it can be hard
  92. 92. "The sale of the PAF with the Royal Mail was a mistake. Public access to public sector data must never be sold or given away again. This type of information, like census information and many other data sets, is very expensive to collect and collate into useable form, but it also has huge potential value to the economy and society as a whole if it is kept as an open, public good." Bernard Jenkin, Chair of Public Administration Select Committee
  93. 93. “Open data is data that can be freely used, reused and redistributed by anyone – subject only, at most, to the requirement to attribute and share alike.” Opendefinition.org
  94. 94. Open is not equivalent to free open data free service
  95. 95. Hypothesis 1: closed address files are monopoly information assets, embedded in huge amounts of public data, but which cannot be reproduced to a usable quality Hypothesis 2: it is possible to build & maintain a sustainable open address database better suited to today's requirements using modern, collaborative approaches to data management
  96. 96. Open Addresses Project • Discovery Phase funded from Release of Data Fund • administered by Open Data User Group within Cabinet Office • Legal feasibility • Technical feasibility • Sustainability feasibility
  97. 97. Open Addresses Vision • Meeting the expectations of the modern information economy • Collaboratively maintained to benefit everyone • Providing plenty of scope for value-added products & services that avoid lock-in
  98. 98. Modern requirements • Addresses are not just for posting mail • Other requirements: • validation & auto-completion • geocoding for route finding • associating people with areas • classification of addresses for targeting interventions • linking datasets together
  99. 99. Modern maintenance • Through collaboration • professional / expert engagement • the wider crowd • Supplemented by • targeted (funded) activity • Addresses are well suited for this
  100. 100. Added value products open addresses subsetadd detail
  101. 101. Where we are • Legal feasibility • received legal opinion • doing due diligence on key open datasets • Technical feasibility • data integration & inference • architecture for service provision • Sustainability feasibility • customer needs & business model
  102. 102. What next • Pending approval • Alpha phase – Oct-Nov • incorporating Open Addresses Ltd • building minimum viable product • Beta phase – Dec-Mar • developing operational service • Independent operation – Mar
  103. 103. Unique opportunity • Green field development • do not need to be limited by legacy • You can help this succeed • contribute today • collaborate in the future • You can benefit from its success • reduce costs, build new products
  104. 104. Questions?
  105. 105. Requirements Introduction
  106. 106. Requirements Carousel • Six tables • you will visit four • Go to a table of your choice • listen to the presentation • ask questions & discuss • When whistle blows, move on
  107. 107. Requirements from: Table 1 BBC Chris Henden Table 2 GDS Paul Downey Table 3 Direct Marketing Assoc. Tim Drye Table 4 ONS Alistair Calder
  108. 108. BREAK returning at 11:35
  109. 109. Requirements Carousel
  110. 110. Requirements Carousel Table 1 BBC Chris Henden Table 2 GDS Paul Downey Table 3 Direct Marketing Assoc. Tim Drye Table 4 ONS Alistair Calder
  111. 111. LUNCH returning at 13:30
  112. 112. Meeting the Challenges Introduction
  113. 113. Meeting the Challenges • Lots of things to work out • green(ish) field development • Focus on five challenges • hear a talk from an expert • hear a little of our thoughts • discuss in the workshop • fill in your worksheets!
  114. 114. Meeting the Challenges Tracking provenance Francis Davey
  115. 115. Tracking provenance • Three types of sources • data project sources & processes • data contributed by third parties • data inferred from data already in database • Need to record each source • including licence made available for reuse • including information about processing
  116. 116. Due Diligence • Need certainty for reusers • Where did addresses originate? • in initial database • through subsequent additions • Is there any validation? • if so against what?
  117. 117. Recording Provenance
  118. 118. Calculating Certainty • More or less certainty about data • Supporting information • using known localities / streets • other addresses on same street • location of contributor • Bayesian network?
  119. 119. Meeting the Challenges Sourcing addresses John Murray
  120. 120. Open Addresses Symposium Meeting the Challenges Address inference from open data John Murray
  121. 121. Sources of Addresses • Land Registry • Companies House • National Social Housing Register (NROSH) • NHS – GP surgeries, hospitals etc • Lists of schools • Government department asset lists • Scottish gazetteers (are they really open?) 8 August 2014 Open Addresses Symposium 122
  122. 122. Sources of Spatial Information • Ordnance Survey: – Codepoint Open – OS Locator – OS Gazetteer – Street view – Named places, settlement seeds, DLUA boundaries, parishes. • ONS – ONSPD Postcode directory – Built up areas. – Census boundaries. • Land Registry – Cadestral Polygons (dispute about whether they are open) • DfT – National Public Transport Gazetteer. 8 August 2014 Open Addresses Symposium 123
  123. 123. Proposal • Build a street and places gazetteer, to which address points (PAON and SAON) may be attached. • Use spatial data to verify veracity of loaded data from open sources. • Apply confidence score to each record based on: – Spatial integrity – Frequency of appearance within and across sources. • Towns and localities inferred by filling gaps. • Street layout analysis: – Position of buildings by pixel analysis. – Postcode to numbering: e.g. odds and evens 8 August 2014 Open Addresses Symposium 124
  124. 124. Pixel Analysis • Overlay vector streets and postcode centroids on OS StreetView • Use in conjunction with OS locator for context and extent. • Analyse pixel colour within buffer either side of road to estimate buildings extent. • Can be used to: – Ensure veracity of other data – Infill missing properties – More accurately assign streets to postcodes 8 August 2014 Open Addresses Symposium 125
  125. 125. Pixel Analysis 8 August 2014 Open Addresses Symposium 126
  126. 126. Adding Land Registry 8 August 2014 Open Addresses Symposium 127
  127. 127. Maximising Available Data • Using ONSPD, correcting postcodes where there is an unambiguous coordinate match from a terminated postcode to new one. • Accounts for 50% of retired codes. • Correcting misspellings by reference to dictionaries using lexical analysis. • Reference earlier versions of the data. 8 August 2014 Open Addresses Symposium 128
  128. 128. Source Audits • Land Registry – Good quality, kept up to date, few errors. Covers England and Wales. • Companies House – Data quality issues, particularly older companies. Covers UK. • NROSH – Variable quality. Covers England 8 August 2014 Open Addresses Symposium 129
  129. 129. Prototype • Contains all current GB postcodes. • Streets added where possible. • Localities added where possible. • Corrects retired postcodes where possible. • Shows nearest postcodes if not. • Built from 4 sources, with gaps filled by inference. 8 August 2014 Open Addresses Symposium 130
  130. 130. Initial Results OS_Locator LandReg Companies NROSH Count Percent 0 0 0 1 5,042 0.29% 0 0 1 0 18,990 1.09% 0 0 1 1 606 0.03% 0 1 0 0 111,553 6.40% 0 1 0 1 25,514 1.46% 0 1 1 0 20,842 1.20% 0 1 1 1 5,574 0.32% 1 0 0 0 227,971 13.07% 1 0 0 1 41,773 2.40% 1 0 1 0 115,449 6.62% 1 0 1 1 7,065 0.41% 1 1 0 0 381,917 21.90% 1 1 0 1 166,608 9.55% 1 1 1 0 348,669 19.99% 1 1 1 1 122,299 7.01% Unmatched 144,218 8.27% 1,744,090 100.00% 8 August 2014 Open Addresses Symposium 131
  131. 131. Weaknesses • Lack of addresses for Scotland • Inference not always accurate due to: – Non-vehicular streets – Streets in close proximity – Not all addresses have a street – Address elements not unique at postcode sector • Questions about openness of some data 8 August 2014 Open Addresses Symposium 132
  132. 132. Conclusion • More study needed on veracity to: – Understand issues in data. – Ensure integrity of database. – Make more accurate assumptions. • Crowdsourcing: – Same methods could be used to ensure veracity. – Could be offered a free/low cost service to SMEs • Lobbying for more data to be made open. 8 August 2014 Open Addresses Symposium 133
  133. 133. Questions? Test drive the prototype.
  134. 134. Building Gazetteer • Existing open data • from OS (& Royal Mail) • from ONS • Areas & indicative points • OpenStreetMap • would require share-alike licence
  135. 135. Getting Addresses • General sources • Land Registry price point data • Companies House addresses • Specific lists of • NHS locations • schools • public buildings • Inference
  136. 136. Meeting the Challenges Structuring addresses Rob Walker
  137. 137. The BS7666 Approach to Structuring Data Rob Walker BSI IST/36 Geographic information 138Rob Walker 2014-08-08
  138. 138. 139 What is BS 7666? • A standard for gazetteers of geographic objects • Defines a system of spatial references based upon identifiable real-world locations • Specifies gazetteers of commonly used location types for spatial referencing • Provides a structure for creating addresses Rob Walker 2014-08-08
  139. 139. Overall purpose of BS 7666 • For defining common geo-referencing systems for entities within scope • Provides a standard way for identifying and defining geographic entities • Provides a way of sharing and accessing information about the geographic entities • Permits the creation of local datasets or gazetteers • Enables the creation of national datasets or gazetteers 140Rob Walker 2014-08-08
  140. 140. Multi-part standard • Part 0 – General model for gazetteers and spatial referencing • Part 1 – Specification for a street gazetteer • Part 2 – Specification for a land and property gazetteer • Part 5 – Specification for a delivery point gazetteer 141Rob Walker 2014-08-08
  141. 141. 142 Gazetteer • Record of locations of particular type or types with sufficient information to find and identify each uniquely • Does not contain detailed (attribute) data about the objects themselves Rob Walker 2014-08-08
  142. 142. Characteristics of a geographic object Geographic Object Position Identification Classification reference point extent descriptive location name reference number object type usage classification Address name/number street locality town country 143Rob Walker 2014-08-08
  143. 143. 144 Address • Identifies a real-world location (addressable object) • Type of Land and Property Identifier (LPI) • Provides a hierarchical structure of location types • Uses commonly understood names • Not routing instructions • Different from a unique key Rob Walker 2014-08-08
  144. 144. 145 Property Address Street Locality Town Admin Area Property address model Rob Walker 2014-08-08
  145. 145. Scope - entities Addressable object Land and property identifier Public right of way Street Basic land and property unit Address incorporates covers references has ofidentifies identified by Mandatory Optional Optional/mandatory One-One One-Many referenced by 146Rob Walker 2014-08-08
  146. 146. 147 Structure of Land and Property Gazetteer (Part 2) • Scope • Definition of terms • Conceptual schema for land and property • Conformance levels • Gazetteer requirements • BLPU identification, description and referencing • Coordinate referencing • Annex – Description of extents • Annex – Data Quality Report Rob Walker 2014-08-08
  147. 147. Issues beyond the Standard • Guidelines for creation of data • Property numbering and street naming • Data quality • Verification of conformance to specification • Scope creep • Ownership and access rights to data Rob Walker 2014-08-08 148
  148. 148. Summary • BS 7666 is a specification for gazetteers of geographic objects • Particularly for Basic Land and Property Units (BLPUs) • Applicable not just to occupied property • Addressing system based on streets • Address structure of: – Secondary addressable object – Primary addressable object – Street – Locality – Town – Administrative Area 149Rob Walker 2014-08-08
  149. 149. What is an Address? • What should the scope be? • Delivery points? • Buildings? • Households? • Rooms?
  150. 150. Addressable Locations room house street locality locality authority
  151. 151. Meeting the Challenges Measuring quality Bob Barr
  152. 152. Never mind the quality feel the width? Quality measures for a UK Open Address File Prof Robert Barr OBE Manchester Geomatics and The University of Liverpool Expert member APPSI and ODUG The SLA Forum - 8th August 2014 - ODI
  153. 153. Private!
  154. 154. Secrecy and Quality • Proprietary data sets are seldom available for comprehensive quality assurance • Where data has been made available for cross matching, results supressed • Internal quality control measures neither documented nor auditable • Customers seldom in a position to asses overall quality or fitness for purpose • As quality cannot be audited tested or checked there is little incentive to improve it – will not increase sales only costs
  155. 155. Quality
  156. 156. Domain • What is being addressed? • Postal delivery points • Dwellings • Taxable hereditaments • Buildings • Infrastructure • e.g: • Electricity sub-stations • Cashpoints
  157. 157. Completeness • When % completeness is claimed, how independent is the measure of the total number of addressable objects in the domain • Duplication can exaggerate completeness while missing addresses • Most likely to be achieved if: • Address required for certain activities and it is generated if missing • Public enabled and encouraged to identify missing addresses
  158. 158. Currency • When is an address added and how soon does it appear in the public file • When is an address deleted / archived • Most likely to be achieved if: • Address required for certain activities and it is generated if missing • Public enabled and encouraged to identify missing addresses
  159. 159. Positional Accuracy • Does any geocode (Lat.Long or OSGR) correctly identify the addressed object? • Are numbered properties correctly identified, order on street and side of street? • Do locational attributes of address lie within the correct bounded areas? • Are any objects ambiguously addressed with multiple different addresses? • Are any objects that should be addressed missing?
  160. 160. Attribute Accuracy • Address attributes such as residential non-residential flags need to be correct • Other address attributes such as the status of the position of the address also need checking
  161. 161. Address Content Accuracy • Is the right and correct information stored in each address field in the database • Does the address comply with published specifications for the file • Does the address comply with relevant standards e.g. BS7666
  162. 162. Open
  163. 163. Open Address Quality • By releasing address intelligence on an open platform quality can be checked and corrections made or suggested • This works for OpenStreet Map • Providing Open Access on a record by record basis from closed data sets, on a single platform,would at least allow the evidence from each source to be assessed • Open Addressing will not create a high quality by itself, however if the major maintainers and providers of address data made their data more open quality could and would be independently assessed and willingness to correct could be checked
  164. 164. Conclusions • Addressing in the UK is NOT: • Definitive • Authoritative • A Public Good • Of measurable quality • Fit for many specific purposes • Used as widely as it could be • Maintained cost effectively WHY?
  165. 165. Conclusions BECAUSE: • Since 1979 the primary motivation for maintaining national address files has been to make a profit or surplus through trading (often only loosely related to costs) • BIS (parts), The Treasury, Royal Mail PLC and the Public Data Group appear to have won the argument in government. • This is likely to be subject to a wide range of continuing challenges…. • One of which will be an Open Address File whose quality will be publicly checked and openly assessed
  166. 166. That’s It! Robert Barr r.barr@peartrees.com
  167. 167. Quality metrics • Number of addresses • Coverage • what baseline can we use? • estimate against census stats? • check against Open Street Map? • against Gazetteer? • Who can measure & how often?
  168. 168. Meeting the Challenges Organising effort Jerry Clough
  169. 169. Collaboration • Why contributors contribute? • self-interest • subversion • fun • What can we do to capitalise on these?
  170. 170. Correct Your Address • Let people control their address • new builds • house names • devotion to locality • Let look-ups be up to date • easing online sales means more customers
  171. 171. Sustainability • Core database open & free • Some lookups open & free • What can we charge for? • service-level agreement? • unlimited lookups? • Sponsorship opportunities?
  172. 172. BREAK returning at 15:00
  173. 173. Meeting the Challenges Workshop
  174. 174. Meeting the Challenges Workshop Table 1 Tracking provenance Table 2 Sourcing addresses Table 3 Structuring addresses Table 4 Measuring quality Table 5 Organizing effort
  175. 175. Wrap Up Jeni Tennison
  176. 176. Next Steps • We will write this up • we hope you do too! • tweet on #openaddresses • Discovery Phase documentation • mid September • Alpha & beta approval • during August
  177. 177. Get Involved • Hiring for Open Addresses • project lead • independent Board members • https://theodi.org/jobs • Complete the survey • tell us how you want to contribute

×