SlideShare a Scribd company logo
1 of 15
Download to read offline
The Open Postcode Finder
Matt Williams
Milliams
● Aiming to be a sort of 'replacement' of the Royal Mail
Postcode Finder using only open data.
● Allows search by postcode or address.
● By default only searches OpenStreetMap data.
●
Will search OS Code-Point®
Open if no match is found in
OSM.
Searching
● If you search for a valid postcode you receive a list
of all houses with the postcode as well as an inset
map showing the area
● If there's no matching OSM houses, you'll just get
the map (from OS Code-Point Open)
● Searching by address
works similarly
● All houses in results
list are hyperlinks to
an address page
Address Page
● There is an address page for each extracted address
from the OSM database showing the address map
and postal address
● The street name is a link to all houses on that street
● The postcode is a
link to all houses with
that postcode
● You can also get a
direct link to the
relevant object in
the OSM database
Technical
● Offline C++ processing tool
– Uses the fantastic Osmium
– Builds up logical street from the disparate nodes,
ways and relations
– Also tracks errors.
● A web application for the user interface
– http://milliams.dev.openstreetmap.org/postcodefin
der/
– Uses Django, GeoDjango, PostgreSQL and
PostGIS
Uses
● Aims to (one day) be a usable product for postcode
searches
– Very reliant on OSM data
● Provides a view into the OSM data which is normally
hidden
– This encourages people to add postcodes and
addresses to OSM
● Has proved handy for merging in external data
sources...
Land Registry House Price Data
● The Land Registry are publishing their 'price paid'
data sets under the Open Government License
● This includes the price paid for a house (obviously)
as well as a full address and postcode
● Using the postcode finder, we match up the entries
into:
– Address match, wrong postcode
– Address match, no postcode
– No match
– Perfect match
● Then add the postcodes to the database manually
Progress in OSM UK
c.f. 29 million in PAF; we're now at ~1.1%
2011-03-24 2011-06-24 2011-09-24 2011-12-24 2012-03-24 2012-06-24 2012-09-24 2012-12-24 2013-03-24 2013-06-24
0
50,000
100,000
150,000
200,000
250,000
300,000
350,000
Houses with post codes
Progress in OSM UK
● But two years ago we were at 0.25% - we've
quadrupled
● There's been no real coordinated effort in OSM to
add postcodes and addresses to OSM
– There's been a lack of usable data sources
● With the Land Registry data and perhaps soon the
Companies House data we can provide mappers
with the information they need
● With the right tools and input data, we could
increase coverage much more quickly
Thank you

More Related Content

Viewers also liked

Social media demographics for extension
Social media demographics for extensionSocial media demographics for extension
Social media demographics for extensionSarah Baughman
 
Chocolate, LEGO and Scrum Jambalaya at SGNOLA2014
Chocolate, LEGO and Scrum Jambalaya at SGNOLA2014Chocolate, LEGO and Scrum Jambalaya at SGNOLA2014
Chocolate, LEGO and Scrum Jambalaya at SGNOLA2014Dana Pylayeva
 
Combining Context with Signals in the IoT (longer version)
Combining Context with Signals in the IoT (longer version)Combining Context with Signals in the IoT (longer version)
Combining Context with Signals in the IoT (longer version)Andy Piper
 
Throttle and Debounce Patterns in Web Apps
Throttle and Debounce Patterns in Web AppsThrottle and Debounce Patterns in Web Apps
Throttle and Debounce Patterns in Web AppsAlmir Filho
 
Why Apps, Data and Mobile Converge in the Open Cloud
Why Apps, Data and Mobile Converge in the Open CloudWhy Apps, Data and Mobile Converge in the Open Cloud
Why Apps, Data and Mobile Converge in the Open CloudAndy Piper
 
F# for C# devs - NDC Oslo 2015
F# for C# devs - NDC Oslo 2015F# for C# devs - NDC Oslo 2015
F# for C# devs - NDC Oslo 2015Phillip Trelford
 
Instant LAMP Stack with Vagrant and Puppet
Instant LAMP Stack with Vagrant and PuppetInstant LAMP Stack with Vagrant and Puppet
Instant LAMP Stack with Vagrant and PuppetPatrick Lee
 
Lançando versões em um clique - deploy contínuo
Lançando versões em um clique - deploy contínuoLançando versões em um clique - deploy contínuo
Lançando versões em um clique - deploy contínuoHélio Medeiros
 
Rabbits, indians and... Symfony meets queueing brokers
Rabbits, indians and...  Symfony meets queueing brokersRabbits, indians and...  Symfony meets queueing brokers
Rabbits, indians and... Symfony meets queueing brokersGaetano Giunta
 
AfriGadget @ Webmontag Frankfurt, June 6, 2011
AfriGadget @ Webmontag Frankfurt, June 6, 2011AfriGadget @ Webmontag Frankfurt, June 6, 2011
AfriGadget @ Webmontag Frankfurt, June 6, 2011Juergen Eichholz
 
Introduction to Perl Best Practices
Introduction to Perl Best PracticesIntroduction to Perl Best Practices
Introduction to Perl Best PracticesJosé Castro
 
All out in the Cloud - CloudEast 2012
All out in the Cloud - CloudEast 2012All out in the Cloud - CloudEast 2012
All out in the Cloud - CloudEast 2012Jan Jongboom
 
STC Communities with Mentoring Programs
STC Communities with Mentoring ProgramsSTC Communities with Mentoring Programs
STC Communities with Mentoring ProgramsCindy Pao
 
Beyond php - it's not (just) about the code
Beyond php - it's not (just) about the codeBeyond php - it's not (just) about the code
Beyond php - it's not (just) about the codeWim Godden
 
About VisualDNA Architecture @ Rubyslava 2014
About VisualDNA Architecture @ Rubyslava 2014About VisualDNA Architecture @ Rubyslava 2014
About VisualDNA Architecture @ Rubyslava 2014Michal Harish
 
Prototyping in the cloud
Prototyping in the cloudPrototyping in the cloud
Prototyping in the cloudKirsten Hunter
 
Scott Chacon, GitHub, SXSW Lean Startup 2013
Scott Chacon, GitHub, SXSW Lean Startup 2013Scott Chacon, GitHub, SXSW Lean Startup 2013
Scott Chacon, GitHub, SXSW Lean Startup 2013500 Startups
 
Giving your programs pizzaz and professionalism!
Giving your programs pizzaz and professionalism!Giving your programs pizzaz and professionalism!
Giving your programs pizzaz and professionalism!Cindy Pao
 

Viewers also liked (20)

ChemSpider reactions – delivering a free community resource of chemical synth...
ChemSpider reactions – delivering a free community resource of chemical synth...ChemSpider reactions – delivering a free community resource of chemical synth...
ChemSpider reactions – delivering a free community resource of chemical synth...
 
Social media demographics for extension
Social media demographics for extensionSocial media demographics for extension
Social media demographics for extension
 
Chocolate, LEGO and Scrum Jambalaya at SGNOLA2014
Chocolate, LEGO and Scrum Jambalaya at SGNOLA2014Chocolate, LEGO and Scrum Jambalaya at SGNOLA2014
Chocolate, LEGO and Scrum Jambalaya at SGNOLA2014
 
Combining Context with Signals in the IoT (longer version)
Combining Context with Signals in the IoT (longer version)Combining Context with Signals in the IoT (longer version)
Combining Context with Signals in the IoT (longer version)
 
Throttle and Debounce Patterns in Web Apps
Throttle and Debounce Patterns in Web AppsThrottle and Debounce Patterns in Web Apps
Throttle and Debounce Patterns in Web Apps
 
Why Apps, Data and Mobile Converge in the Open Cloud
Why Apps, Data and Mobile Converge in the Open CloudWhy Apps, Data and Mobile Converge in the Open Cloud
Why Apps, Data and Mobile Converge in the Open Cloud
 
F# for C# devs - NDC Oslo 2015
F# for C# devs - NDC Oslo 2015F# for C# devs - NDC Oslo 2015
F# for C# devs - NDC Oslo 2015
 
Instant LAMP Stack with Vagrant and Puppet
Instant LAMP Stack with Vagrant and PuppetInstant LAMP Stack with Vagrant and Puppet
Instant LAMP Stack with Vagrant and Puppet
 
Lançando versões em um clique - deploy contínuo
Lançando versões em um clique - deploy contínuoLançando versões em um clique - deploy contínuo
Lançando versões em um clique - deploy contínuo
 
Rabbits, indians and... Symfony meets queueing brokers
Rabbits, indians and...  Symfony meets queueing brokersRabbits, indians and...  Symfony meets queueing brokers
Rabbits, indians and... Symfony meets queueing brokers
 
AfriGadget @ Webmontag Frankfurt, June 6, 2011
AfriGadget @ Webmontag Frankfurt, June 6, 2011AfriGadget @ Webmontag Frankfurt, June 6, 2011
AfriGadget @ Webmontag Frankfurt, June 6, 2011
 
Introduction to Perl Best Practices
Introduction to Perl Best PracticesIntroduction to Perl Best Practices
Introduction to Perl Best Practices
 
All out in the Cloud - CloudEast 2012
All out in the Cloud - CloudEast 2012All out in the Cloud - CloudEast 2012
All out in the Cloud - CloudEast 2012
 
STC Communities with Mentoring Programs
STC Communities with Mentoring ProgramsSTC Communities with Mentoring Programs
STC Communities with Mentoring Programs
 
Beyond php - it's not (just) about the code
Beyond php - it's not (just) about the codeBeyond php - it's not (just) about the code
Beyond php - it's not (just) about the code
 
About VisualDNA Architecture @ Rubyslava 2014
About VisualDNA Architecture @ Rubyslava 2014About VisualDNA Architecture @ Rubyslava 2014
About VisualDNA Architecture @ Rubyslava 2014
 
Prototyping in the cloud
Prototyping in the cloudPrototyping in the cloud
Prototyping in the cloud
 
Scott Chacon, GitHub, SXSW Lean Startup 2013
Scott Chacon, GitHub, SXSW Lean Startup 2013Scott Chacon, GitHub, SXSW Lean Startup 2013
Scott Chacon, GitHub, SXSW Lean Startup 2013
 
Giving your programs pizzaz and professionalism!
Giving your programs pizzaz and professionalism!Giving your programs pizzaz and professionalism!
Giving your programs pizzaz and professionalism!
 
Surge2012
Surge2012Surge2012
Surge2012
 

Recently uploaded

Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Neo4j
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksSoftradix Technologies
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsPrecisely
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDGMarianaLemus7
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 

Recently uploaded (20)

The transition to renewables in India.pdf
The transition to renewables in India.pdfThe transition to renewables in India.pdf
The transition to renewables in India.pdf
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other Frameworks
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power Systems
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDG
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptxVulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 

Find addresses and postcodes using open data with the Open Postcode Finder

  • 1. The Open Postcode Finder Matt Williams Milliams
  • 2.
  • 3.
  • 4. ● Aiming to be a sort of 'replacement' of the Royal Mail Postcode Finder using only open data. ● Allows search by postcode or address. ● By default only searches OpenStreetMap data. ● Will search OS Code-Point® Open if no match is found in OSM.
  • 5. Searching ● If you search for a valid postcode you receive a list of all houses with the postcode as well as an inset map showing the area ● If there's no matching OSM houses, you'll just get the map (from OS Code-Point Open) ● Searching by address works similarly ● All houses in results list are hyperlinks to an address page
  • 6. Address Page ● There is an address page for each extracted address from the OSM database showing the address map and postal address ● The street name is a link to all houses on that street ● The postcode is a link to all houses with that postcode ● You can also get a direct link to the relevant object in the OSM database
  • 7.
  • 8.
  • 9. Technical ● Offline C++ processing tool – Uses the fantastic Osmium – Builds up logical street from the disparate nodes, ways and relations – Also tracks errors. ● A web application for the user interface – http://milliams.dev.openstreetmap.org/postcodefin der/ – Uses Django, GeoDjango, PostgreSQL and PostGIS
  • 10. Uses ● Aims to (one day) be a usable product for postcode searches – Very reliant on OSM data ● Provides a view into the OSM data which is normally hidden – This encourages people to add postcodes and addresses to OSM ● Has proved handy for merging in external data sources...
  • 11. Land Registry House Price Data ● The Land Registry are publishing their 'price paid' data sets under the Open Government License ● This includes the price paid for a house (obviously) as well as a full address and postcode ● Using the postcode finder, we match up the entries into: – Address match, wrong postcode – Address match, no postcode – No match – Perfect match ● Then add the postcodes to the database manually
  • 12.
  • 13. Progress in OSM UK c.f. 29 million in PAF; we're now at ~1.1% 2011-03-24 2011-06-24 2011-09-24 2011-12-24 2012-03-24 2012-06-24 2012-09-24 2012-12-24 2013-03-24 2013-06-24 0 50,000 100,000 150,000 200,000 250,000 300,000 350,000 Houses with post codes
  • 14. Progress in OSM UK ● But two years ago we were at 0.25% - we've quadrupled ● There's been no real coordinated effort in OSM to add postcodes and addresses to OSM – There's been a lack of usable data sources ● With the Land Registry data and perhaps soon the Companies House data we can provide mappers with the information they need ● With the right tools and input data, we could increase coverage much more quickly