Postal address clean-up
Andrew Zolnai, Richard Mosley
Andrew Zolnai
Support Specialist, Lead
Development at Safe Software
helped with this project and is
kindly presenting this talk.
Richard Mosley
Geologist turned to GIS for over 30
years, covered all aspects of geo-
data, project and business
management in petroleum and
volunteered geography.
Two non-spatial Workbench uses:
1) postal address clean-up
2) & electoral list updates
The premise
Ø Help French 2017 presidential / parliamentary election
campaign
Ø Using nationbuilder.com for a London UK based
campaign
Ø Liste Electorale Consulaire is structured but
inconsistent
Ø Ergo normalise 4 address columns into a schema
Regex on Steroids
1Spatial FME WT 2015:
Øscrape 4 years worth
of playlists and tracks
off the StrayFM
website
Øand categorise and
rank the most played
artists and tracks
Inspired usage here:
ü StringSearcher
search address
components
ü AttributeSplitter split
them into similar parts
ü AttributeManager re-
order into one schema
THE WORKSPACE
Address normalization
Clean, rinse, repeat
Get the first matches of
address strings in the 4
address fields
If string is empty then assign
the next address string to it
Country name is constant last
string
Build normalised string sets
backward from it
01
02
04
03
THE OUTPUT
Address schema ready to upload
But that’s not all…
What about on-going updates to
Electoral Lists?
FeatureMerger non-spatial too!
Initial load:
Ø find rejected addresses
Ø repeat the procedure if possible
Ongoing updates:
Ø find the new entries as updated lists are received
Ø repeat the procedure on the “delta” only
THE WORKSPACE
Refresh mega-data lists
Place your screenshot here
Electoral lists for campaigns
Tame non-spatial mega-lists
Metadata is king
Data never come clean
Create schemas is key
THANK YOU!
www.zolnai.ca | aiz@zolnai.ca

Postal Address Clean-Up - Two Unusual FME Workbench Applications