The BC Spatial Project – Integrating BC’s Cadastre with FME Server

The BC Spatial Project – Integrating BC’s Cadastre with FME Server Paul van Nieuwkuyk, CartoSmart GIS BC Spatial Project Coordinator, ICIS

ICIS ICIS’ Vision BC Spatial

BC Spatial ICIS’ Vision BC Spatial

Core Challenges Challenges Constraints Solutions Source Delivery / Integrated Datasets Sharing Products •  No uniform data •  Ad hoc •  Slow refresh model submission cycle •  Unknown / habits •  Manually anecdotal data •  Modest intensive quality operational process resources

Operational Constraints Challenges Constraints Solutions Integrated Source Delivery / Products Datasets Sharing •  Automate •  Existing •  Minimize integration models reflect impacts to •  Assess and report: business need data providers so that producers •  ICIS does not in sharing can enhance and alter member their data users can decide data*

Solutions Challenges Constraints Solutions Use the best ETL Tool! •  Transparent and repeatable data processes •  Eliminate the manual •  Deploy where needed •  Available to a distributed community… online •  Sensible standards •  Data standards based on integration needs •  Common processing pattern for all datasets

“Data Integration Engine” (DIE and Do!) Integrate Assess Statistics Report LG Integrated Data GeoBC QC Metadata BCA Utilities 1.  Extract/Publish 2.  Subscribe/Integrate 3.  Notify/Distribute

Data Provider: Extract & Publish

Delivering with Python   Publication Flavors   Web folder   FTP site   Python shutdown script   Automate zip and ship to ICIS   Scheduled Task   Delivery routine

ICIS: Scheduled Acquisition   Python Startup   Acquire FTP or web   Unzip   Archive   Standard processes   Load (not integrate)   Capture metadata   Log change

ICIS: Real-time reporting   shutdown.py   Calls FME service   Refreshes statistics   KML data footprints as index to current statistics   On-the-fly thematic rendering   Color spectrum from newer to older vintage

Coordinating Product Refresh   Nightly scheduled service   Analyzes ETL Log (populated in acquisition script)   Determines which integrated layers to refresh   Invokes layer refresh scripts

Layer Integration   Changed sources are refreshed:   DELETE / INSERT   Localized integration QC performed   Jurisdictional overlaps   Correlation reports: LTSA BCA   Stats Updated   ETL log   QC metadata

The Program   Activities   Pilot conducted 2009   CRD Beta Jan – June 2010   All municipalities and regional district   GeoBC   BC Assessment   Utilities   Infrastructure   FME Workbench & Server 2009   ArcGIS Server 9.3 on SQL Server

Thank You!   Questions? Portal • www.bcspatial.ca   For more information:   paul@cartosmart.com • Project Charter   www.bcspatial.ca Docs • Pilot Program Report Chat • www.bcspatial.ca/ blog

The BC Spatial Project – Integrating BC’s Cadastre with FME Server

by Safe Software on Mar 19, 2010

Accessibility

Categories

Tags

Upload Details

Usage Rights

1 Embed 14

Statistics

The BC Spatial Project – Integrating BC’s Cadastre with FME Server — Presentation Transcript