Automating Data Management With
FME
Austin Hildreth
Task – Capture Address Data
Place your screenshot here
Washington State Counties
Data and Uses
Derived Products:
 Address (points)
 Parcels (boundaries)
 Streets (centerlines)
 Owner Information (tabular)
 Geocoding
 Land base
Challenges
 38 Counties
 All in different data schemas
 Source formats are different
Keeping data up to date
Tools
Safe Software
• Desktop 2017/16
• Server 2017
Microsoft
• Management Studio 2014
• Server 2012
ESRI
• Desktop 10.5.1
• AGS 10.5.1
• Portal 10.5.1
Proccess
Standardize Data
1 - Map Data
2 - Scheduler
FME Workbench(s)
Data Mapping
Attr1
Attr2
Attr3
Derived Prod Info
Attr1
Attr2
Attr3
3 – Download Data
County FTP
FME Workbench(s)
Map data to StandardFME Workbench(s)
Check data
WAMAS Data
Service
Derived Product
Attr1
Attr2
Attr3
4 – Data Validation
schedule
FME Workbench – Address Points
1 – Call workbenches for each County
FME Workbench – Address Points
1 – Call workbenches for each County
FME Workbench – Address Points
1 – Call workbenches for each County
1 – Call workbenches for each County
FME Workbench – Address Points
FME Workbench – Address Points
FME Workbench – Address Points
2 – Get attribute mapping for county schema
FME Workbench – Address Points
2 – Get attribute mapping for county schema
To next workbench
@Value(attrValue)
@Value(attrValue)
@Value(attrValue)
@Value(attrValue)
FME Workbench – Address Points
3 – Parse Address and validate
servernam
eservernam
e
FME Workbench – Address Points
3 – Parse Address and validate
FME Workbench – Address Points
3 – Parse Address and validate
@Value(attrValue)
FME Workbench – Address Points
3 – Parse Address and validate
servername
servername
FME Workbench – Address Points
4 – Validate and write to Prod
https://state-
wamas.wa.gov/webdirectory/pagename.asmx/Getstandardizedaddress?address=@Value(mADDR)&a
ddress2=@Value(mADDR2)&city=@Value(mCITY)&zip=@Value(mZIP)&zip4=@Value(mPLUS4)&state
=@Value(mSTATE)&company=&Consumer=@Value(mCONSUMER) HTTP/1.1
FME Workbench – HTML Reports
FME Workbench – HTML Reports
FME Workbench – HTML Reports
Transformers:
HTMLReportGenerator
Sorter
HTMLLayouter
Writer:
HTMLWriter
FME Workbench – HTML Reports
FME Workbench – HTML Reports
FME Server – Schedule
D.O.R. Internal Self Serve Portal
(ESRI Portal for ArcGIS Server)
Parcel and Owner Information
Street Information
Address Point Information
Address Point Information (City)
Data Counts and Usage
 Address Points – 2,167,403
 Parcels – 3,114,394
 Streets – 731,172
 Owner Information – 2,101,161
 PSAP Streets (911) – 566,910
Challenges
- FME 2017 – FMEServerJobSubmitter @Value(xxxx)
- FTP data moving to OpenData
Next Steps
- Environment adaptable workspaces (Projects)
- Email notifications (job completions and errors)
Store attributes/configuration in
database
Schedule Workbench Multiple
Workbenches
Log processes and generate
reports
Create Universal Custom
Transformers (re-usable)
THANK YOU!
Austin Hildreth
DORDLI.S.GISTeam@DOR.WA.GOV

Automating Data Management With FME