FME and MetadataMastering Metadata with FME 2012Don MurrayDean Hintz                                   FME ® Desktop 2012 ...
AgendaFMEMetadataMetadata StandardsReadingUpdatingWritingHarvestingValidatingPublishing
Safe Software Facts                Private company                Founded in 1993                Headquarters in       ...
IT Service Case Distribution        3
Introduction to FME      What is FME?      How Does FME Work?                      Centralized                      Se...
FME Moves Data
FME is all about …
Barriers to Interoperability      Data Types                                            WebData Translation Basics        ...
TranslationFME supports reading from a wide array of data  formats and types   275+ formats, with more added each year  ...
Poll Question #1: FMEHow long have you been using FME?                ?
Metadata – What is it?
Metadata – What it isMetadata provides information about whatever types of data you have:                                 ...
Metadata – Data about dataDescribes data structures• tables• geometry types• data types• fieldsDescribes data content• coo...
Metadata - Purpose
Common Metadata QuestionsWhat does the data set describe?                                            ?Who produced the dat...
Poll Question 2: MetadataHow often do you work with metadata?                  ?
Metadata StandardsFGDC & ISO 19115• describes geographical  information and services• contents, spatial-temporal,  data qu...
ISO / OGC StandardsISO/TS 19139• defines Geographic Meta Data XML (gmd)• XML Schema implementation derived from ISO  19115...
Poll Question #3: StandardsWhich metadata standards/types are interested in?                    ?
Key FME Metadata Capabilities• Reading• Writing• Updating• Harvesting• Validating• Integration with web services
DemosReadingWritingUpdatingHarvestingValidation (Syntax, Schema)
Demo: ReadingMetadata attributesXML Reader /  Fragmenter with  Feature Paths and  flatteningHTTPFetcherReading from database
Demo: Reading Metadata Attributes
Demo: Reading Geodatabase Metadata                  expose the geodb_metadata_string attribute
Demo: WritingXMLTemplaterTemplates for• FGDC• ISO 19115Database writemode:geodatabase
Demo: Harvesting and Writing
Demo: Writing Geodatabase MetadataGeometry:geodb_metadataExpose: geodb_metadata_string
Demo: UpdatingXMLUpdater, XQueryTimeStamperXMLFormatter
Demo: UpdatingXMLUpdater: Insert, Delete, Replace, Replace  Contents
Poll Question 4: XMLWhat XML tools do you use?                   ?
Validation – What to validate against?ISO 19139 with GML 3.2.0:http://schemas.opengis.net/iso/19139/20060504/gmd/gmd.xsdTo...
Demo: ValidationXMLValidator• Syntax• Schema
Validation Report – Bad Syntax
Validation Report – Bad Schema
Validation Report – Good Metadata
Validation Workspace
Other Validation Options• Tester    • Field names    • Data types (numeric, date etc)    • IDs•   CoordinateSystemExtracto...
CSW: Catalog Service for the Web• Deegree• GeoNetwork• OpenGIS• TerraCatalog
Metadata Services: CSW• Reading• Writing / Publishing• Updating
Poll Question #5: CSWWhat CSW tools do you use?                   ?
Arkansas Geostor: Download
Customer Implementations:LGII – Lithuania Geospatial PortalFile Formats:                     Coordinate systems:     Auto...
SummaryMetadata describes your dataHelps with searches and  managementFME can help drive your metadata:• Read / write and ...
Online Training                  Upcoming Online Courses in 2012                   Online FME Desktop:                   ...
Poll Question 6: TrainingWould you like to enter for a chance to win a freeseat of online FME training?                   ...
Twitter Hashtag: #FMEWTFME 2012 World Tourhttp://fme.safe.com/content/FME-2012-World-Tour
Thank YouQuestions?don@safe.com                 dean@safe.comwww.safe.com/supportwww.youtube.com/fmechannelfmepedia.safe.c...
Mastering Geospatial Metadata with FME
Upcoming SlideShare
Loading in …5
×

Mastering Geospatial Metadata with FME

3,989 views

Published on

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
3,989
On SlideShare
0
From Embeds
0
Number of Embeds
1,318
Actions
Shares
0
Downloads
75
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Mastering Geospatial Metadata with FME

  1. 1. FME and MetadataMastering Metadata with FME 2012Don MurrayDean Hintz FME ® Desktop 2012 Version
  2. 2. AgendaFMEMetadataMetadata StandardsReadingUpdatingWritingHarvestingValidatingPublishing
  3. 3. Safe Software Facts  Private company  Founded in 1993  Headquarters in Vancouver, BC, Canada  90+ employees  50+ value-added resellers & system integrators in 35 countries  ~100 FME Certified Professionals & Trainers around the globe  Thousands of customers across 116 countries
  4. 4. IT Service Case Distribution 3
  5. 5. Introduction to FME  What is FME?  How Does FME Work?  Centralized  Semantic  TransformationalData Translation Basics FME Desktop Training 2012
  6. 6. FME Moves Data
  7. 7. FME is all about …
  8. 8. Barriers to Interoperability Data Types WebData Translation Basics FME Desktop Training 2012
  9. 9. TranslationFME supports reading from a wide array of data formats and types  275+ formats, with more added each year  CAD, GIS, XML, raster, database, non-spatial, 3D 8
  10. 10. Poll Question #1: FMEHow long have you been using FME? ?
  11. 11. Metadata – What is it?
  12. 12. Metadata – What it isMetadata provides information about whatever types of data you have: 11
  13. 13. Metadata – Data about dataDescribes data structures• tables• geometry types• data types• fieldsDescribes data content• coordinate system• extent• modification date• quality, ownership, etc.
  14. 14. Metadata - Purpose
  15. 15. Common Metadata QuestionsWhat does the data set describe? ?Who produced the data set?Why was the data set created?How was the data set created?How reliable are the data; what problems remain in the data set?How can someone get a copy of the data set?Who wrote the metadata?geology.usgs.gov/tools/metadata/tools/doc/ctc/
  16. 16. Poll Question 2: MetadataHow often do you work with metadata? ?
  17. 17. Metadata StandardsFGDC & ISO 19115• describes geographical information and services• contents, spatial-temporal, data quality, access and rights to use• 400 metadata elements, 20 core
  18. 18. ISO / OGC StandardsISO/TS 19139• defines Geographic Meta Data XML (gmd)• XML Schema implementation derived from ISO 19115• Version "2007-04-17" uses GML 3.2.1 (http://www.opengis.net/gml/3.2)• Version "2006-06-04" use GML 3.2.0 (http://www.opengis.net/gml)• ISO 19119 – web servicesBottom line: need to know what GML version andwhat ISO standard you need to comply with
  19. 19. Poll Question #3: StandardsWhich metadata standards/types are interested in? ?
  20. 20. Key FME Metadata Capabilities• Reading• Writing• Updating• Harvesting• Validating• Integration with web services
  21. 21. DemosReadingWritingUpdatingHarvestingValidation (Syntax, Schema)
  22. 22. Demo: ReadingMetadata attributesXML Reader / Fragmenter with Feature Paths and flatteningHTTPFetcherReading from database
  23. 23. Demo: Reading Metadata Attributes
  24. 24. Demo: Reading Geodatabase Metadata expose the geodb_metadata_string attribute
  25. 25. Demo: WritingXMLTemplaterTemplates for• FGDC• ISO 19115Database writemode:geodatabase
  26. 26. Demo: Harvesting and Writing
  27. 27. Demo: Writing Geodatabase MetadataGeometry:geodb_metadataExpose: geodb_metadata_string
  28. 28. Demo: UpdatingXMLUpdater, XQueryTimeStamperXMLFormatter
  29. 29. Demo: UpdatingXMLUpdater: Insert, Delete, Replace, Replace Contents
  30. 30. Poll Question 4: XMLWhat XML tools do you use? ?
  31. 31. Validation – What to validate against?ISO 19139 with GML 3.2.0:http://schemas.opengis.net/iso/19139/20060504/gmd/gmd.xsdTo Validate XML against ISO 19139 with GML 3.2.1:http://standards.iso.org/ittf/PubliclyAvailableStandards/ISO_19139_Schemas/See page 13 of:http://inspire.jrc.ec.europa.eu/reports/ImplementingRules/metadata/MD_IR_and_IS O_20090218.pdfOr Google and click top link: “inspire metadata implementing rules technical guidelines”Key takeaway: to validate gmd:MD_Metadata you need to validate against gmd.xsd
  32. 32. Demo: ValidationXMLValidator• Syntax• Schema
  33. 33. Validation Report – Bad Syntax
  34. 34. Validation Report – Bad Schema
  35. 35. Validation Report – Good Metadata
  36. 36. Validation Workspace
  37. 37. Other Validation Options• Tester • Field names • Data types (numeric, date etc) • IDs• CoordinateSystemExtractor• GeometryFilter• GeometryOGCvalidator• SpatialFilter (check extents)
  38. 38. CSW: Catalog Service for the Web• Deegree• GeoNetwork• OpenGIS• TerraCatalog
  39. 39. Metadata Services: CSW• Reading• Writing / Publishing• Updating
  40. 40. Poll Question #5: CSWWhat CSW tools do you use? ?
  41. 41. Arkansas Geostor: Download
  42. 42. Customer Implementations:LGII – Lithuania Geospatial PortalFile Formats: Coordinate systems:  AutoCAD DXF / DWG  LKS94  ESRI Personal Geodatabase  WGS84  Shape  ETRS89  MapInfo TAB  1963  Microstation Design V8  Pulkovo 1942  GML  UTM (34, 35 zones)  GIF / PNG  JPEG Other data sources:  TIFF  WFS  ERDAS IMG  SDE  ECW  Files
  43. 43. SummaryMetadata describes your dataHelps with searches and managementFME can help drive your metadata:• Read / write and update• Harvest• Validate• Automate maintenance tasks• Integrate with CSWSwitch from manual to automatic by using FME to power your metadata
  44. 44. Online Training Upcoming Online Courses in 2012  Online FME Desktop:  May 16/17  June 20/21  Sept 19/20  Oct 17/18  Dec 5/6  FME Server Authoring:  May 24  Sept 27  Online Advanced FME Desktop:  XML Reading May 16 or 17  XML Writing May 23 or 24  Oracle Spatial June 7 or Sept 26  Esri (demo only) Sept 6  KML Nov 14  Raster Nov 29
  45. 45. Poll Question 6: TrainingWould you like to enter for a chance to win a freeseat of online FME training? ?
  46. 46. Twitter Hashtag: #FMEWTFME 2012 World Tourhttp://fme.safe.com/content/FME-2012-World-Tour
  47. 47. Thank YouQuestions?don@safe.com dean@safe.comwww.safe.com/supportwww.youtube.com/fmechannelfmepedia.safe.com/knowledgeSearch?k=metadata

×