• Like
Using FME to support open data initiatives and INSPIRE
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

Using FME to support open data initiatives and INSPIRE

  • 129 views
Published

Presentation from IMGS on Using FME to support open data initiatives and INSPIRE from FME World Tour 2012 in Dublin. 10/09/2012

Presentation from IMGS on Using FME to support open data initiatives and INSPIRE from FME World Tour 2012 in Dublin. 10/09/2012

Published in Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
129
On SlideShare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
0
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide
  • http://en.wikipedia.org/wiki/Geospatial_metadatahttp://en.wikipedia.org/wiki/Metadata
  • Supports searchesAllows you to review content without having to read all the data firstDiscover what’s availableSupport data management and updatesprovides parameters for automating processingControl accessTrack ownership
  • Read metadata attributesXML reading, writing, updatingSchema readingReading from web sourcesIntegration with web servicesHarvest and validation capabilitiesCreation of your own web services

Transcript

  • 1. Using FME to support OpenData initiatives and INSPIRECiaran Kirk Tony KentTechnical Director GIS Technician 6th September 2012
  • 2. The Challenge You want to meet Open data requirements, but your data is organized rather differently ?
  • 3. What we do … ? We build data bridges – to your SDI
  • 4. Harmonization Core Concepts Harmonization: implied requirement for building an SDI Disparate sources must be mapped to a common destination data model Core to the harmonization workflow is a process called schema mapping. Delivered by services based on open standards
  • 5. INSPIRE Harmonization PrinciplesTypical stages:1. Evaluation2. Assembly3. Transformation4. Validation5. PublicationBased on the Spatial ETL concept (Extract,Transform and Load), as applied to INSPIRE SDI’s
  • 6. Evaluation Assess destination schema and data requirements Assess source datasets and schema Consider fundamental differences in representation, resolution Closely inspect actual representative datasets
  • 7. Data Assembly Assess the diversity of source data types:  vector, raster, CAD, GIS, database, text, XML, web, 3D, sensor and non-spatial Review format and semantic translation needs Decide how to perform necessary joins  ID joins, spatial relates, nearest neighbor, one to many relationshipsGoal is to build a data structure that correspondswith your published standard
  • 8. Metadata – Data about dataDescribes data structures• tables• geometry types• data types• fieldsDescribes data content• coordinate system• extent• modification date• quality, ownership, etc.
  • 9. Metadata - Purpose
  • 10. Key FME Metadata Capabilities• Reading• Writing• Updating• Harvesting• Validating• Integration with web services
  • 11. CSW: Catalog Service for the Web• Deegree• GeoNetwork• OpenGIS• TerraCatalog
  • 12. Metadata Services: CSW• Reading• Writing / Publishing• Updating
  • 13. Data Transformation - Schema Reshape source data to match required destination schema Schema mapping  feature type  attribute name  new attribute creation  code lists  conditional value mappings
  • 14. Schema Mapping in FME Feature Type Mapping in FME Workbench Attribute Mapping in FME Workbench
  • 15. FME Data Model Restructuring:Attribute Names & Values  Value Mapping
  • 16. FME SchemaMapper:INSPIRE geographic names FME Workspace Name mapping Name & value mapping
  • 17. Transformation: Geometry Non-spatial to spatial Geometry extraction (spatial to GML) Representation transform: CAD drawing lines with labels to GIS polygonal features with attributes Coordinate System Reprojection (ED50 to ETRF89) Simple to complex geometry  Source point and polygon data to multiple geometric representations (city as point / area, river as line / area) Generalization and interpolation  Highly granular national and regional datasets often require thinning to be usable on pan-European scales
  • 18. Validation Schema validation i.e. INSPIRE (xsds) Data integrity  Unique IDs  Geometric integrity (closed polygons)  Null values (nullable?)  Valid values: ranges and domain codes  Data gaps  Bounds  Network integrity Custom validity rules specific to domain Validation automation via FME Server uploadEnsure data quality throughout the data transformation process.
  • 19. Publication Produce INSPIRE compliant GML Provide discovery, view or download services, for WxS, GML and other desired formats Publish with FME Server or integrate with your geo web server of choice Spatial Data Services
  • 20. Publication with FME Server Publish workspace to FME Server  Store the workspace in a central repository Make your FME workspaces available to others – over the web Register the workspace with one or more services (Data Streaming, Data Download, etc.) 21
  • 21. Open Data Demonstration
  • 22. FME Tools for INSPIRE  Format translation  Schema mapping  String and list manipulation  Data validation  Database load and extract  XML,GML,WFS: reading, validation, publication  Web services: WFS, WMS, integration with others  Metadata support  Enterprise services with FME Server
  • 23. Summary  FME can provide all the tools to help you support your data sharing needs:  Integrate your data sources  Manage your meta data catalogues  Transform your data to standard schemas  Publish the data in the required formats
  • 24. Thank You! Questions? For more information:  Ciaran Kirk – ckirk@imgs.ie  Tony Kent – tkent@imgs.ie  support@imgs.ie