Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Postal address
clean-up
Andrew Zolnai, Richard Mosley
Andrew Zolnai
Support Specialist, Lead
Development at Safe Software
helped with this.
Richard Mosley
Geologist turned to G...
Two non-spatial Workbench uses:
1) postal address clean-up
2) & electoral list updates
Help French 2017
presidential / parliamentary
election campaign
Using nationbuilder.com
for a London UK based
campaign
...
Regex on Steroids
1Spatial FME WT 2015:
scrape 4 years worth
of playlists and tracks
off the StrayFM
website
and categor...
Address normalization
Clean
Rinse
Repeat
Get the first matches of
address strings in the 4
address fields
If string is empty then
assign the nex...
Address schema ready to upload
But that’s not all…
What about on-going updates to
Electoral Lists?
FeatureMerger non-spatial too!
Initial load:
 find rejected addresses
 repeat the procedure if possible
Ongoing updates:...
Refresh mega-data lists
Place your screenshot here
Electoral lists for campaigns
Metadata is king
Data never come clean
Create schemas is key
Automate? Web service?
Tame
mega
lists
Thank you!
www.zolnai.ca
aiz@zolnai.ca
Upcoming SlideShare
Loading in …5
×

of

1Spatial: FME World Tour London: Postal address clean-up Slide 1 1Spatial: FME World Tour London: Postal address clean-up Slide 2 1Spatial: FME World Tour London: Postal address clean-up Slide 3 1Spatial: FME World Tour London: Postal address clean-up Slide 4 1Spatial: FME World Tour London: Postal address clean-up Slide 5 1Spatial: FME World Tour London: Postal address clean-up Slide 6 1Spatial: FME World Tour London: Postal address clean-up Slide 7 1Spatial: FME World Tour London: Postal address clean-up Slide 8 1Spatial: FME World Tour London: Postal address clean-up Slide 9 1Spatial: FME World Tour London: Postal address clean-up Slide 10 1Spatial: FME World Tour London: Postal address clean-up Slide 11 1Spatial: FME World Tour London: Postal address clean-up Slide 12 1Spatial: FME World Tour London: Postal address clean-up Slide 13 1Spatial: FME World Tour London: Postal address clean-up Slide 14
Upcoming SlideShare
What to Upload to SlideShare
Next
Download to read offline and view in fullscreen.

0 Likes

Share

Download to read offline

1Spatial: FME World Tour London: Postal address clean-up

Download to read offline

Presentation given at the FME WT London

Related Books

Free with a 30 day trial from Scribd

See all

Related Audiobooks

Free with a 30 day trial from Scribd

See all
  • Be the first to like this

1Spatial: FME World Tour London: Postal address clean-up

  1. 1. Postal address clean-up Andrew Zolnai, Richard Mosley
  2. 2. Andrew Zolnai Support Specialist, Lead Development at Safe Software helped with this. Richard Mosley Geologist turned to GIS for over 30 years, covered all aspects of geo-data, project and business management in petroleum and volunteered geography.
  3. 3. Two non-spatial Workbench uses: 1) postal address clean-up 2) & electoral list updates
  4. 4. Help French 2017 presidential / parliamentary election campaign Using nationbuilder.com for a London UK based campaign Liste Electorale Consulaire is structured but inconsistent Ergo normalise 4 address columns into a schema The premise
  5. 5. Regex on Steroids 1Spatial FME WT 2015: scrape 4 years worth of playlists and tracks off the StrayFM website and categorise and rank the most played artists and tracks Inspired usage here:  StringSearcher search address components  AttributeSplitter split them into similar parts  AttributeManager re- order into one schema
  6. 6. Address normalization
  7. 7. Clean Rinse Repeat Get the first matches of address strings in the 4 address fields If string is empty then assign the next address string to it Country name is constant last string Build normalised string sets backward from it 01 02 04 03
  8. 8. Address schema ready to upload
  9. 9. But that’s not all… What about on-going updates to Electoral Lists?
  10. 10. FeatureMerger non-spatial too! Initial load:  find rejected addresses  repeat the procedure if possible Ongoing updates:  find the new entries as updated lists are received  repeat the procedure on the “delta” only
  11. 11. Refresh mega-data lists
  12. 12. Place your screenshot here Electoral lists for campaigns
  13. 13. Metadata is king Data never come clean Create schemas is key Automate? Web service? Tame mega lists
  14. 14. Thank you! www.zolnai.ca aiz@zolnai.ca

Presentation given at the FME WT London

Views

Total views

346

On Slideshare

0

From embeds

0

Number of embeds

43

Actions

Downloads

1

Shares

0

Comments

0

Likes

0

×