Metadata Matters! What it is and How to Manage it

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Metadata Matters!
What it is and How
to Manage it

Meet the Presenters
Dale Lutz Dean Hintz Mark Ireland
Q&A

Agenda
Some questions to explore:
● What is metadata?
● Why do we need it?
● What are some of the barriers to making and
u...

Poll Question
How important is metadata in your work?

What is Metadata?

What is Metadata?
“Metadata is everywhere. It is all around us.”

Going Meta: What is Metadata?
Peel back the layers -> what is the data beneath the data? It’s all around us:
● Every web s...

Going Meta: What is Metadata?
Peel back the layers -> what is the data beneath the data? What’s really real?
We’ve all hea...

Glimpses of Metadata Through the Window of FME
Metadata via FME: JPEG, LIDAR, raster, geodatabase

Why do we need it? User’s View
Good metadata helps us find quality, relevant information:
● Supports search & discovery: T...

Why do we need it? Producer’s View
Metadata helps us manage data life cycles, from creation to publication:
● Quality cont...

Why do we need it? Metadata Properties
Data properties that are useful for determining relevance:
● Location: Position or ...

Poll Question
What metadata properties are you most interested in?

Data Properties: bbox, time, data quality
Landsat and Sentinel Selector:
● Date
● Provider
● Thumbnails
● Percent cloud co...

What barriers block metadata creation and use?
Barriers to metadata creation:
● Lack of automation - manual eﬀort required...

Metadata Standards
● ISO 19115, 19139
● OGC CSW
● OGC API Records
● Dublin core
● Esri shp.xml
● FGDC / NIEM

Combating the Metadata’s Challenges
● Who uses it? We all do (whether we know it or not)! Know your audience, what kind
of...

Poll Question
Where in your workflow do you use metadata?

Q&A

Our Mission
To help you maximize the value of
your data & metadata.

FME®
Integration Platform
Connect. Transform. Automate.
FME Desktop FME Server FME Cloud
Build & Run Data Workflows Automa...

Unrivaled Data Support

Flash Demo

Poll Question
Have you used FME with metadata?

Metadata Writing Approaches in FME
XMLTemplater
Pro: Easier to set up
Con: Working with xml fragments - not schema aware
X...

Metadata for Global Medic
The Goal
Use metadata to
help organize and
rapidly process UAV
imagery as part of
their disaster...

Data Retrieval and Organization: Global Medic

Global Medic: UAV Survey Data Filtering and Structuring
Project Folder
Structure:
ResponseName
/Country/Date
/MapNo/FileTy...

OpenDroneMap
ODMMosaicker
• Global Medic use case: problem
processing > 500 images
• FME ODMmosaicker –> RasterMosaicker
•...

More
Advanced
Demos

Metadata Demos
● Harvesting metadata Reading and writing geodatabase metadata
● Geodatabase metadata update
● Reading CSW ...

Harvesting Metadata
The Goal
Automatically
harvest metadata
from source
MapInfo TAB files
and write out one
ISO19115 xml
m...

Harvest Metadata
1. Read source datasets
2. Expose dataset name
3. Capture dataset
extents
4. Generate timestamp
and uniqu...

Harvest Metadata
Input data files
Output metadata XML

Geodatabase Metadata Update
The Goal
Update
geodatabase
metadata
The Obstacles
May not be obvious
which format
attributes ...

Geodatabase Metadata Update
Set geodatabase format attributes:
● geodb_metadata_string
● geodb_type
https://community.safe...

Geodatabase Metadata Update
Set geodatabase format attributes:
● geodb_metadata_string
● geodb_type
https://community.safe...

OGC CSW Custom Reader
The Goal
Access a CSW
metadata catalog
to support
workflows for the
OGC Maritimes
and Boundaries
Pil...

FME CSW Catalog Client for OGC MLB Pilot
Series of HTTPCallers send requests to CSW service for Entries, Details and then ...

CSW Client: Entries

CSW Client - Details: URI

CSW
Details
URI: WFS
Feature
Retrieval
S-121 GML

XML Metadata Writing
The Goal
A simple example
of how to write ISO
19115 XML
metadata
The Obstacles
ISO 19115 XML
metadata...

Write XML with XMLTemplater - Metadata
Insert attribute values using
fme:get-attribute{} functions
Write out XML document ...

Write XML with XMLTemplater - Metadata
Insert attribute values using
fme:get-attribute{} functions
Write out XML document ...

XSD based XML Metadata Writing
The Goal
Explore new
capabilities in FME
for working with
metadata using
XSD XML Reader /
W...

Metadata Revolutions
Revolutions! A
completely diﬀerent
way of working with
metadata.
With the XSD based
XML Reader / Writ...

XSD Based XML R/W: ISO 19115 Metadata
XSD based reader /
writer new in FME 2020
Updates contact{0}

XSD Based XML R/W: ISO 19115 Metadata
Reader settings: Feature Path Writer settings: Feature Path

XSD Based XML: ISO 19115 Metadata:
XMLTemplater

XSD Based XML R/W: ISO
19115 Metadata Result
source updated

STAC Custom Reader
The Goal
Select and Read
Satellite imagery
from STAC: Catalog
The Obstacles
No reader yet
available in ...

STAC: Spatial Temporal Asset Catalog
● A standard, unified language to talk about
geospatial data, making it easier to sea...

STAC: Spatial Temporal Asset Catalog
● Design is simple and extensible due to how
its structured.
● STAC is a network of j...

FME Custom STAC Reader:
USGS LANDSAT
Custom reader workspace: reads STAC service JSON and calls STAC API for each item and...

FME Custom STAC Reader: Query
Item Query and Item Asset Selection

FME Custom STAC Reader: View / Download
Item Asset Download / Rendering

AI: Vision Analysis - MS Cognitive Services API
FME Workspace reads directory of images and calls API for each

Test Results: Filter Conﬁguration

Computer Vision Analysis: Cognitive Services API

Computer Vision: SAR Target Search

Computer Vision: SAR Target Search

Drowning in Data: Data Management
● 94k pictures
● 1.5k video
● 200 LAS post processed

JPEG EXIF versus NFO metadata

Data Organization
Mission Data
Catalog in
Excel & HTML

Mission Overview: HTML Reports / Dashboard
● Mission Data Feature Service in web map

Mission Data Distribution and Dashboard
Mission details visualized in ESRI’s Dashboard and FME web maps

What’s New / Coming
OGC CSW Reader - Oct 2021
SchemaScanner - FME 2021.1
OGC API Records - Spring 2022
STAC - FME 2022
FME...

Automate Your Workflows
Deliver data in real-time or on a schedule with
FME Server Automations.
● Automate data integratio...

Resources
Blog
Active Metadata Platform for Spatial
Data and XML
https://www.safe.com/blog/2021/09/build-metada
ta-platfor...

XML
Resources
XSD XML Tutorial
https://community.safe.com/s/article/XSD-Driven-XML
XML Tutorial
https://knowledge.safe.com...

Knowledge
Base
FME & Metadata
https://community.safe.com/s/article/fme-and-metadata
Harvesting ISO 19115 Metadata
https://...

Active Metadata Review
● The platform is always on,
continually collecting metadata.
● Generate intelligence from
metadata...

Metadata Summary
● Metadata allows you to access the
most relevant information needed
to solve your problems
● Metadata dr...

Final Question
Which pill will you choose?

“One way or another, this
webinar is going to end.”
Thanks for attending!
Try FME for free at safe.com/trial
Contact: dean...

Q&A

Share Slideshare

LinkedIn
Facebook
Twitter

Embed

Size (px)

Show related Slideshows at end

WordPress Shortcode

Link

Share
Email

2024 Trend Updates: What Really Wor... by Search Engine Jou... 1007542 views
Storytelling For The Web: Integrate... by Chiara Aliotta 914748 views
Artificial Intelligence, Data and C... by OECD Directorate ... 811462 views
How to Leverage AI to Boost Employe... by SocialHRCamp 338516 views
2024 State of Marketing Report – by... by Marius Sescu 193631 views
Everything You Need To Know About C... by Expeed Software 217376 views

View on Slideshare

1 of 77 Ad

View on Slideshare

1 of 77 Ad