SlideShare a Scribd company logo
ISO Metadata and Granules
Ted Habermann, Director of Earth Science
The HDF Group
thabermann@hdfgroup.org
1
ISO Metadata Standards
ISO Standards come in two parts:
Concepts / Content Representations
The Goal
3
Include ISO concepts/content in [NASA]
Earth Science products in a
representation that is useful and
consistent across products and
missions.
SMAP Approach
Concepts / Content Representations
1) Identify ISO concepts important for SMAP users (ISO 19115-2).
2) Represent those concepts in standard XML (ISO 19139-2).
SMAP Granules Approach (1)
ISO XML
blob
included as
a string
attribute in
the
Metadata
group.
ISO 19139-2
SMAP Granules Approach (2)
As groups and attributes in Metadata Group.
Achieves the Goal?
7
The approach achieves the first part of the goal:
Include ISO concepts/content in NASA Earth Science
products
in a representation that is useful and consistent
across products and missions.
But… the representation is specific for the SMAP mission.
ISO Metadata as Information Hub
Citations are included in the ISO Metadata Standards as a way to reference resources
that provide details that are not included directly in the metadata.
Metadata
XML
dataset /
resource
source
keyword
thesaurus
& ontology
evaluation
procedure
standard
specification
algorithm associated
resource
application
schema
alternate
metadata
metadata
& service
standard
associated
resource
name/metadata
additional
documentation
constraints
reference
source
metadata
process
reference &
documentation
software
reference
feature
catalog
format
specification
ISO Dataset Titles
All ISO Citations include the concept of ”Title" which can be represented as a
CharacterString or a FileName. The ISO xPath to the dataset title is special.
/gmi:MI_Metadata
/gmd:identificationInfo/gmd:MD_DataIdentification
/gmd:citation/gmd:CI_Citation
/gmd:title/gco:CharacterString | gmx:FileName
I
S
O
SMAP Dataset Titles (1)
10
SMAP Dataset Titles (2)
11
Accessing Dataset Titles
We have the dataset titles in two locations: ISO and SMAP (HDF)
/gmi:MI_Metadata
/gmd:identificationInfo/gmd:MD_DataIdentification
/gmd:citation/gmd:CI_Citation
/gmd:title/gco:CharacterString | gmx:FileName
/Metadata/DatasetIdentification/fileName
This
mapping is
unique to
SMAP.
/gmi:MI_Metadata
/gmd:identificationInfo/gmd:MD_DataIdentification
/gmd:citation/gmd:CI_Citation
/gmd:title/gco:CharacterString | gmx:FileName
/Metadata
/DatasetIdentification
/fileName=/
I
S
O
S
M
A
P
Can HDF Paths = ISO Paths?
I
S
O
H
D
F
ISO: Roles and Types
Roles = lowerCamelCase / Types = AA_UpperCamelCase
ISO XML always alternates between roles and types.
Each hierarchy level is either a role level or a type level.
/gmi:MI_Metadata
/gmd:identificationInfo/gmd:MD_DataIdentification
/gmd:citation/gmd:CI_Citation
/gmd:title/gco:CharacterString | gmx:FileName
HDF: Groups and Attributes
HDF: Groups and Attributes
NcML: Groups and Attributes with XML attributes
The Goal
ISO Roles
and Types
NcML Groups
and Attributes
and XML
Attributes
Rules
The Workflow
17
SMAP
19115-2
(19139-2)
SMAP
19115-1
(19115-3)
SMAP
NcML
SMAP
19115-1
(19115-3)
Translation Proofing File Differencing
SMAP
HDF
Product
Designer
The method we use to develop and test this
approach involves several (standard) XSLT
transforms (solid arrows) and comparisons
between input metadata and metadata
transformed to NcML and back to ISO (grey
arrows). All of these transforms are lossless.
The Workflow
18
SMAP
19115-2
(19139-2)
SMAP
NcML
SMAP
19115-2
(19139-2)
File Differencing
The same transforms can be used to go
directly from ISO 19139-2 (the ISO version
currently used by NASA and NOAA) to NcML
and back.
SMAP
HDF
Product
Designer
ISO 19139-2 > NcML > HDF
19
/gmi:MI_Metadata
/gmd:identificationInfo/gmd:MD_DataIdentification
/gmd:citation/gmd:CI_Citation
/gmd:title/gco:CharacterString | gmx:FileName
/nc:netcdf
/nc:group[@name=“gmi:MI_Metadata]
/nc:group[@name=“gmd:identificationInfo]
/nc:group[@name=“gmd:citation]
/nc:group[@name=“gmd:title]
/nc:attribute[@name=“value”]/@value
I
S
O
N
C
M
L
/gmi:MI_Metadata/gmd:identificationInfo/gmd:citation/gmd:title/value
S
M
A
P
ISO 19115-3 > NcML > HDF
20
/nc:netcdf
/nc:group[@name=“mdb:MD_Metadata]
/nc:group[@name=“mdb:identificationInfo]
/nc:group[@name=“mri:citation]
/nc:group[@name=“mri:title]
/nc:attribute[@name=“value”]/@value
/mdb:MD_Metadata
/mdb:identificationInfo/mri:MD_DataIdentification
/mri:citation/cit:CI_Citation
/cit:title/gco:CharacterString | gcx:FileName
I
S
O
N
C
M
L
S
M
A
P
/mdb:MD_Metadata/mdb:identificationInfo/mri:citation/mri:title/value
ISO 19139-2 and 19115-3 = HDF
21
/gmi:MI_Metadata
/gmd:identificationInfo/gmd:MD_DataIdentification
/gmd:citation/gmd:CI_Citation
/gmd:title/gco:CharacterString | gmx:FileName
/gmi:MI_Metadata
/gmd:identificationInfo
/gmd:citation
/gmd:title
/value
/mdb:MD_Metadata
/mdb:identificationInfo/mri:MD_DataIdentification
/mri:citation/cit:CI_Citation
/cit:title/gco:CharacterString | gcx:FileName
/mdb:MD_Metadata
/mdb:identificationInfo
/mri:citation
/mri:title
/value
~
~
ISO 19115-2 HDF
ISO 19115-1 HDF
At least the transforms are consistent and the same!
What Does This Mean?
22
Any ISO conceptual model can be transformed into HDF and
extracted using standard transforms.
What Does This Mean?
1) We can write standard interoperable ISO metadata into
SWOT, NISAR, and PDS granules
2) They are all accessible with standard xPaths.
3) We can add standard ISO 19115 and 19115-1 groups to SMAP
without any impact on current metadata access.
The Goal
24
Include ISO concepts/content in NASA
Earth Science products in a
representation that is useful and
consistent across products and
missions.
Acknowledgements
25
This work was partially supported by contract number NNG10HP02C from NASA.
Any opinions, findings, conclusions, or recommendations expressed in this material are
those of the author and do not necessarily reflect the views of NASA or The HDF Group.

More Related Content

Similar to Granules and ISO Metadata

PMML - Predictive Model Markup Language
PMML - Predictive Model Markup LanguagePMML - Predictive Model Markup Language
PMML - Predictive Model Markup Language
aguazzel
 
Systems Modeling Language (SysML®) v2 Request For Proposal (RFP)
Systems Modeling Language (SysML®) v2 Request For Proposal (RFP)Systems Modeling Language (SysML®) v2 Request For Proposal (RFP)
Systems Modeling Language (SysML®) v2 Request For Proposal (RFP)
Massimo Talia
 
AIXM, WXXM, FIXM a unified approach to Modelling
AIXM, WXXM, FIXM a unified approach to ModellingAIXM, WXXM, FIXM a unified approach to Modelling
AIXM, WXXM, FIXM a unified approach to Modelling
Snowflake Software
 
Pilot Project for HDF5 Metadata Structures for SWOT
Pilot Project for HDF5 Metadata Structures for SWOTPilot Project for HDF5 Metadata Structures for SWOT
Pilot Project for HDF5 Metadata Structures for SWOT
The HDF-EOS Tools and Information Center
 
DCMI IEEE LTSC Joint taskforce at DC2007
DCMI IEEE LTSC Joint taskforce at DC2007DCMI IEEE LTSC Joint taskforce at DC2007
DCMI IEEE LTSC Joint taskforce at DC2007
Mikael Nilsson
 
Enhancing an atl transformation
Enhancing an atl transformationEnhancing an atl transformation
Enhancing an atl transformation
csandit
 
Practical Experiences Migrating Unified Modeling Language Models to IBM® Rati...
PracticalExperiences Migrating Unified Modeling Language Models to IBM® Rati...PracticalExperiences Migrating Unified Modeling Language Models to IBM® Rati...
Practical Experiences Migrating Unified Modeling Language Models to IBM® Rati...
Einar Karlsen
 
Advances in gml for geospatial applications slide
Advances in gml for geospatial applications slideAdvances in gml for geospatial applications slide
Advances in gml for geospatial applications slide
Vittoriano Muttillo
 
ILAP (held at the 3rd Digital Oilfield Summit)
ILAP (held at the 3rd Digital Oilfield Summit)ILAP (held at the 3rd Digital Oilfield Summit)
ILAP (held at the 3rd Digital Oilfield Summit)
André Torkveen
 
An Introduction to the SOLID Principles
An Introduction to the SOLID PrinciplesAn Introduction to the SOLID Principles
An Introduction to the SOLID Principles
Attila Bertók
 
CS587 Project - Raychaudhury,Shaalmali
CS587 Project - Raychaudhury,ShaalmaliCS587 Project - Raychaudhury,Shaalmali
CS587 Project - Raychaudhury,Shaalmali
sagar.247
 
Localization and Shared Preferences in android
Localization and Shared Preferences in androidLocalization and Shared Preferences in android
Localization and Shared Preferences in android
Aly Arman
 
LOM DCAM at LOM Meeting 2008-04-23
LOM DCAM at LOM Meeting 2008-04-23LOM DCAM at LOM Meeting 2008-04-23
LOM DCAM at LOM Meeting 2008-04-23
Mikael Nilsson
 
MO3.L10.5 - HDF5 FOR NPOESS SENSOR AND ENVIRONMENTAL DATA RECORDS
MO3.L10.5 - HDF5 FOR NPOESS SENSOR AND ENVIRONMENTAL DATA RECORDSMO3.L10.5 - HDF5 FOR NPOESS SENSOR AND ENVIRONMENTAL DATA RECORDS
MO3.L10.5 - HDF5 FOR NPOESS SENSOR AND ENVIRONMENTAL DATA RECORDS
grssieee
 
DC-2008 DCMI/IEEE workshop
DC-2008 DCMI/IEEE workshopDC-2008 DCMI/IEEE workshop
DC-2008 DCMI/IEEE workshop
Mikael Nilsson
 
Object Oriented Analysis and Design with UML2 part2
Object Oriented Analysis and Design with UML2 part2Object Oriented Analysis and Design with UML2 part2
Object Oriented Analysis and Design with UML2 part2
Haitham Raik
 
Presentazione jrc 24 ottobre
Presentazione jrc 24 ottobrePresentazione jrc 24 ottobre
Presentazione jrc 24 ottobre
smespire
 
Financial Industry Business Unified Model (FIBUM)
Financial Industry Business Unified Model (FIBUM)Financial Industry Business Unified Model (FIBUM)
Financial Industry Business Unified Model (FIBUM)
Jurgen Ziemer
 
IRJET- American Sign Language Classification
IRJET- American Sign Language ClassificationIRJET- American Sign Language Classification
IRJET- American Sign Language Classification
IRJET Journal
 
IM in Graph 2017-05.pdf
IM in Graph 2017-05.pdfIM in Graph 2017-05.pdf
IM in Graph 2017-05.pdf
Michal Miklas
 

Similar to Granules and ISO Metadata (20)

PMML - Predictive Model Markup Language
PMML - Predictive Model Markup LanguagePMML - Predictive Model Markup Language
PMML - Predictive Model Markup Language
 
Systems Modeling Language (SysML®) v2 Request For Proposal (RFP)
Systems Modeling Language (SysML®) v2 Request For Proposal (RFP)Systems Modeling Language (SysML®) v2 Request For Proposal (RFP)
Systems Modeling Language (SysML®) v2 Request For Proposal (RFP)
 
AIXM, WXXM, FIXM a unified approach to Modelling
AIXM, WXXM, FIXM a unified approach to ModellingAIXM, WXXM, FIXM a unified approach to Modelling
AIXM, WXXM, FIXM a unified approach to Modelling
 
Pilot Project for HDF5 Metadata Structures for SWOT
Pilot Project for HDF5 Metadata Structures for SWOTPilot Project for HDF5 Metadata Structures for SWOT
Pilot Project for HDF5 Metadata Structures for SWOT
 
DCMI IEEE LTSC Joint taskforce at DC2007
DCMI IEEE LTSC Joint taskforce at DC2007DCMI IEEE LTSC Joint taskforce at DC2007
DCMI IEEE LTSC Joint taskforce at DC2007
 
Enhancing an atl transformation
Enhancing an atl transformationEnhancing an atl transformation
Enhancing an atl transformation
 
Practical Experiences Migrating Unified Modeling Language Models to IBM® Rati...
PracticalExperiences Migrating Unified Modeling Language Models to IBM® Rati...PracticalExperiences Migrating Unified Modeling Language Models to IBM® Rati...
Practical Experiences Migrating Unified Modeling Language Models to IBM® Rati...
 
Advances in gml for geospatial applications slide
Advances in gml for geospatial applications slideAdvances in gml for geospatial applications slide
Advances in gml for geospatial applications slide
 
ILAP (held at the 3rd Digital Oilfield Summit)
ILAP (held at the 3rd Digital Oilfield Summit)ILAP (held at the 3rd Digital Oilfield Summit)
ILAP (held at the 3rd Digital Oilfield Summit)
 
An Introduction to the SOLID Principles
An Introduction to the SOLID PrinciplesAn Introduction to the SOLID Principles
An Introduction to the SOLID Principles
 
CS587 Project - Raychaudhury,Shaalmali
CS587 Project - Raychaudhury,ShaalmaliCS587 Project - Raychaudhury,Shaalmali
CS587 Project - Raychaudhury,Shaalmali
 
Localization and Shared Preferences in android
Localization and Shared Preferences in androidLocalization and Shared Preferences in android
Localization and Shared Preferences in android
 
LOM DCAM at LOM Meeting 2008-04-23
LOM DCAM at LOM Meeting 2008-04-23LOM DCAM at LOM Meeting 2008-04-23
LOM DCAM at LOM Meeting 2008-04-23
 
MO3.L10.5 - HDF5 FOR NPOESS SENSOR AND ENVIRONMENTAL DATA RECORDS
MO3.L10.5 - HDF5 FOR NPOESS SENSOR AND ENVIRONMENTAL DATA RECORDSMO3.L10.5 - HDF5 FOR NPOESS SENSOR AND ENVIRONMENTAL DATA RECORDS
MO3.L10.5 - HDF5 FOR NPOESS SENSOR AND ENVIRONMENTAL DATA RECORDS
 
DC-2008 DCMI/IEEE workshop
DC-2008 DCMI/IEEE workshopDC-2008 DCMI/IEEE workshop
DC-2008 DCMI/IEEE workshop
 
Object Oriented Analysis and Design with UML2 part2
Object Oriented Analysis and Design with UML2 part2Object Oriented Analysis and Design with UML2 part2
Object Oriented Analysis and Design with UML2 part2
 
Presentazione jrc 24 ottobre
Presentazione jrc 24 ottobrePresentazione jrc 24 ottobre
Presentazione jrc 24 ottobre
 
Financial Industry Business Unified Model (FIBUM)
Financial Industry Business Unified Model (FIBUM)Financial Industry Business Unified Model (FIBUM)
Financial Industry Business Unified Model (FIBUM)
 
IRJET- American Sign Language Classification
IRJET- American Sign Language ClassificationIRJET- American Sign Language Classification
IRJET- American Sign Language Classification
 
IM in Graph 2017-05.pdf
IM in Graph 2017-05.pdfIM in Graph 2017-05.pdf
IM in Graph 2017-05.pdf
 

More from Ted Habermann

Translation proofing
Translation proofingTranslation proofing
Translation proofing
Ted Habermann
 
New ISO Geospatial Metadata Capabilities
New ISO Geospatial Metadata CapabilitiesNew ISO Geospatial Metadata Capabilities
New ISO Geospatial Metadata Capabilities
Ted Habermann
 
The HDF Product Designer – Interoperability in the First Mile
The HDF Product Designer – Interoperability in the First MileThe HDF Product Designer – Interoperability in the First Mile
The HDF Product Designer – Interoperability in the First Mile
Ted Habermann
 
Hdf Augmentation: Interoperability in the Last Mile
Hdf Augmentation: Interoperability in the Last MileHdf Augmentation: Interoperability in the Last Mile
Hdf Augmentation: Interoperability in the Last Mile
Ted Habermann
 
Citations in ISO Metadata
Citations in ISO MetadataCitations in ISO Metadata
Citations in ISO Metadata
Ted Habermann
 
Can ISO 19157 support current NASA data quality metadata?
Can ISO 19157 support current NASA data quality metadata?Can ISO 19157 support current NASA data quality metadata?
Can ISO 19157 support current NASA data quality metadata?
Ted Habermann
 
Translation proofing
Translation proofingTranslation proofing
Translation proofing
Ted Habermann
 
Wikis, Rubrics and Views: An Integrated Approach to Improving Documentation
Wikis, Rubrics and Views: An Integrated Approach to Improving DocumentationWikis, Rubrics and Views: An Integrated Approach to Improving Documentation
Wikis, Rubrics and Views: An Integrated Approach to Improving Documentation
Ted Habermann
 
Hdf Inside
Hdf InsideHdf Inside
Hdf Inside
Ted Habermann
 
Metadata Evaluation and Improvement
Metadata Evaluation and ImprovementMetadata Evaluation and Improvement
Metadata Evaluation and Improvement
Ted Habermann
 
Metadata For Humans and Machines
Metadata For Humans and MachinesMetadata For Humans and Machines
Metadata For Humans and Machines
Ted Habermann
 
ESDIS Metadata Archive
ESDIS Metadata ArchiveESDIS Metadata Archive
ESDIS Metadata Archive
Ted Habermann
 
Earth Science Platform
Earth Science PlatformEarth Science Platform
Earth Science Platform
Ted Habermann
 

More from Ted Habermann (13)

Translation proofing
Translation proofingTranslation proofing
Translation proofing
 
New ISO Geospatial Metadata Capabilities
New ISO Geospatial Metadata CapabilitiesNew ISO Geospatial Metadata Capabilities
New ISO Geospatial Metadata Capabilities
 
The HDF Product Designer – Interoperability in the First Mile
The HDF Product Designer – Interoperability in the First MileThe HDF Product Designer – Interoperability in the First Mile
The HDF Product Designer – Interoperability in the First Mile
 
Hdf Augmentation: Interoperability in the Last Mile
Hdf Augmentation: Interoperability in the Last MileHdf Augmentation: Interoperability in the Last Mile
Hdf Augmentation: Interoperability in the Last Mile
 
Citations in ISO Metadata
Citations in ISO MetadataCitations in ISO Metadata
Citations in ISO Metadata
 
Can ISO 19157 support current NASA data quality metadata?
Can ISO 19157 support current NASA data quality metadata?Can ISO 19157 support current NASA data quality metadata?
Can ISO 19157 support current NASA data quality metadata?
 
Translation proofing
Translation proofingTranslation proofing
Translation proofing
 
Wikis, Rubrics and Views: An Integrated Approach to Improving Documentation
Wikis, Rubrics and Views: An Integrated Approach to Improving DocumentationWikis, Rubrics and Views: An Integrated Approach to Improving Documentation
Wikis, Rubrics and Views: An Integrated Approach to Improving Documentation
 
Hdf Inside
Hdf InsideHdf Inside
Hdf Inside
 
Metadata Evaluation and Improvement
Metadata Evaluation and ImprovementMetadata Evaluation and Improvement
Metadata Evaluation and Improvement
 
Metadata For Humans and Machines
Metadata For Humans and MachinesMetadata For Humans and Machines
Metadata For Humans and Machines
 
ESDIS Metadata Archive
ESDIS Metadata ArchiveESDIS Metadata Archive
ESDIS Metadata Archive
 
Earth Science Platform
Earth Science PlatformEarth Science Platform
Earth Science Platform
 

Recently uploaded

Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
University of Maribor
 
Phenomics assisted breeding in crop improvement
Phenomics assisted breeding in crop improvementPhenomics assisted breeding in crop improvement
Phenomics assisted breeding in crop improvement
IshaGoswami9
 
Oedema_types_causes_pathophysiology.pptx
Oedema_types_causes_pathophysiology.pptxOedema_types_causes_pathophysiology.pptx
Oedema_types_causes_pathophysiology.pptx
muralinath2
 
8.Isolation of pure cultures and preservation of cultures.pdf
8.Isolation of pure cultures and preservation of cultures.pdf8.Isolation of pure cultures and preservation of cultures.pdf
8.Isolation of pure cultures and preservation of cultures.pdf
by6843629
 
Micronuclei test.M.sc.zoology.fisheries.
Micronuclei test.M.sc.zoology.fisheries.Micronuclei test.M.sc.zoology.fisheries.
Micronuclei test.M.sc.zoology.fisheries.
Aditi Bajpai
 
Authoring a personal GPT for your research and practice: How we created the Q...
Authoring a personal GPT for your research and practice: How we created the Q...Authoring a personal GPT for your research and practice: How we created the Q...
Authoring a personal GPT for your research and practice: How we created the Q...
Leonel Morgado
 
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốtmô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
HongcNguyn6
 
EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...
EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...
EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...
Sérgio Sacani
 
Deep Software Variability and Frictionless Reproducibility
Deep Software Variability and Frictionless ReproducibilityDeep Software Variability and Frictionless Reproducibility
Deep Software Variability and Frictionless Reproducibility
University of Rennes, INSA Rennes, Inria/IRISA, CNRS
 
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
David Osipyan
 
The binding of cosmological structures by massless topological defects
The binding of cosmological structures by massless topological defectsThe binding of cosmological structures by massless topological defects
The binding of cosmological structures by massless topological defects
Sérgio Sacani
 
Randomised Optimisation Algorithms in DAPHNE
Randomised Optimisation Algorithms in DAPHNERandomised Optimisation Algorithms in DAPHNE
Randomised Optimisation Algorithms in DAPHNE
University of Maribor
 
20240520 Planning a Circuit Simulator in JavaScript.pptx
20240520 Planning a Circuit Simulator in JavaScript.pptx20240520 Planning a Circuit Simulator in JavaScript.pptx
20240520 Planning a Circuit Simulator in JavaScript.pptx
Sharon Liu
 
Bob Reedy - Nitrate in Texas Groundwater.pdf
Bob Reedy - Nitrate in Texas Groundwater.pdfBob Reedy - Nitrate in Texas Groundwater.pdf
Bob Reedy - Nitrate in Texas Groundwater.pdf
Texas Alliance of Groundwater Districts
 
Basics of crystallography, crystal systems, classes and different forms
Basics of crystallography, crystal systems, classes and different formsBasics of crystallography, crystal systems, classes and different forms
Basics of crystallography, crystal systems, classes and different forms
MaheshaNanjegowda
 
The debris of the ‘last major merger’ is dynamically young
The debris of the ‘last major merger’ is dynamically youngThe debris of the ‘last major merger’ is dynamically young
The debris of the ‘last major merger’ is dynamically young
Sérgio Sacani
 
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
AbdullaAlAsif1
 
Describing and Interpreting an Immersive Learning Case with the Immersion Cub...
Describing and Interpreting an Immersive Learning Case with the Immersion Cub...Describing and Interpreting an Immersive Learning Case with the Immersion Cub...
Describing and Interpreting an Immersive Learning Case with the Immersion Cub...
Leonel Morgado
 
NuGOweek 2024 Ghent programme overview flyer
NuGOweek 2024 Ghent programme overview flyerNuGOweek 2024 Ghent programme overview flyer
NuGOweek 2024 Ghent programme overview flyer
pablovgd
 
waterlessdyeingtechnolgyusing carbon dioxide chemicalspdf
waterlessdyeingtechnolgyusing carbon dioxide chemicalspdfwaterlessdyeingtechnolgyusing carbon dioxide chemicalspdf
waterlessdyeingtechnolgyusing carbon dioxide chemicalspdf
LengamoLAppostilic
 

Recently uploaded (20)

Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
 
Phenomics assisted breeding in crop improvement
Phenomics assisted breeding in crop improvementPhenomics assisted breeding in crop improvement
Phenomics assisted breeding in crop improvement
 
Oedema_types_causes_pathophysiology.pptx
Oedema_types_causes_pathophysiology.pptxOedema_types_causes_pathophysiology.pptx
Oedema_types_causes_pathophysiology.pptx
 
8.Isolation of pure cultures and preservation of cultures.pdf
8.Isolation of pure cultures and preservation of cultures.pdf8.Isolation of pure cultures and preservation of cultures.pdf
8.Isolation of pure cultures and preservation of cultures.pdf
 
Micronuclei test.M.sc.zoology.fisheries.
Micronuclei test.M.sc.zoology.fisheries.Micronuclei test.M.sc.zoology.fisheries.
Micronuclei test.M.sc.zoology.fisheries.
 
Authoring a personal GPT for your research and practice: How we created the Q...
Authoring a personal GPT for your research and practice: How we created the Q...Authoring a personal GPT for your research and practice: How we created the Q...
Authoring a personal GPT for your research and practice: How we created the Q...
 
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốtmô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
 
EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...
EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...
EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...
 
Deep Software Variability and Frictionless Reproducibility
Deep Software Variability and Frictionless ReproducibilityDeep Software Variability and Frictionless Reproducibility
Deep Software Variability and Frictionless Reproducibility
 
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
 
The binding of cosmological structures by massless topological defects
The binding of cosmological structures by massless topological defectsThe binding of cosmological structures by massless topological defects
The binding of cosmological structures by massless topological defects
 
Randomised Optimisation Algorithms in DAPHNE
Randomised Optimisation Algorithms in DAPHNERandomised Optimisation Algorithms in DAPHNE
Randomised Optimisation Algorithms in DAPHNE
 
20240520 Planning a Circuit Simulator in JavaScript.pptx
20240520 Planning a Circuit Simulator in JavaScript.pptx20240520 Planning a Circuit Simulator in JavaScript.pptx
20240520 Planning a Circuit Simulator in JavaScript.pptx
 
Bob Reedy - Nitrate in Texas Groundwater.pdf
Bob Reedy - Nitrate in Texas Groundwater.pdfBob Reedy - Nitrate in Texas Groundwater.pdf
Bob Reedy - Nitrate in Texas Groundwater.pdf
 
Basics of crystallography, crystal systems, classes and different forms
Basics of crystallography, crystal systems, classes and different formsBasics of crystallography, crystal systems, classes and different forms
Basics of crystallography, crystal systems, classes and different forms
 
The debris of the ‘last major merger’ is dynamically young
The debris of the ‘last major merger’ is dynamically youngThe debris of the ‘last major merger’ is dynamically young
The debris of the ‘last major merger’ is dynamically young
 
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
 
Describing and Interpreting an Immersive Learning Case with the Immersion Cub...
Describing and Interpreting an Immersive Learning Case with the Immersion Cub...Describing and Interpreting an Immersive Learning Case with the Immersion Cub...
Describing and Interpreting an Immersive Learning Case with the Immersion Cub...
 
NuGOweek 2024 Ghent programme overview flyer
NuGOweek 2024 Ghent programme overview flyerNuGOweek 2024 Ghent programme overview flyer
NuGOweek 2024 Ghent programme overview flyer
 
waterlessdyeingtechnolgyusing carbon dioxide chemicalspdf
waterlessdyeingtechnolgyusing carbon dioxide chemicalspdfwaterlessdyeingtechnolgyusing carbon dioxide chemicalspdf
waterlessdyeingtechnolgyusing carbon dioxide chemicalspdf
 

Granules and ISO Metadata

  • 1. ISO Metadata and Granules Ted Habermann, Director of Earth Science The HDF Group thabermann@hdfgroup.org 1
  • 2. ISO Metadata Standards ISO Standards come in two parts: Concepts / Content Representations
  • 3. The Goal 3 Include ISO concepts/content in [NASA] Earth Science products in a representation that is useful and consistent across products and missions.
  • 4. SMAP Approach Concepts / Content Representations 1) Identify ISO concepts important for SMAP users (ISO 19115-2). 2) Represent those concepts in standard XML (ISO 19139-2).
  • 5. SMAP Granules Approach (1) ISO XML blob included as a string attribute in the Metadata group. ISO 19139-2
  • 6. SMAP Granules Approach (2) As groups and attributes in Metadata Group.
  • 7. Achieves the Goal? 7 The approach achieves the first part of the goal: Include ISO concepts/content in NASA Earth Science products in a representation that is useful and consistent across products and missions. But… the representation is specific for the SMAP mission.
  • 8. ISO Metadata as Information Hub Citations are included in the ISO Metadata Standards as a way to reference resources that provide details that are not included directly in the metadata. Metadata XML dataset / resource source keyword thesaurus & ontology evaluation procedure standard specification algorithm associated resource application schema alternate metadata metadata & service standard associated resource name/metadata additional documentation constraints reference source metadata process reference & documentation software reference feature catalog format specification
  • 9. ISO Dataset Titles All ISO Citations include the concept of ”Title" which can be represented as a CharacterString or a FileName. The ISO xPath to the dataset title is special. /gmi:MI_Metadata /gmd:identificationInfo/gmd:MD_DataIdentification /gmd:citation/gmd:CI_Citation /gmd:title/gco:CharacterString | gmx:FileName I S O
  • 12. Accessing Dataset Titles We have the dataset titles in two locations: ISO and SMAP (HDF) /gmi:MI_Metadata /gmd:identificationInfo/gmd:MD_DataIdentification /gmd:citation/gmd:CI_Citation /gmd:title/gco:CharacterString | gmx:FileName /Metadata/DatasetIdentification/fileName This mapping is unique to SMAP. /gmi:MI_Metadata /gmd:identificationInfo/gmd:MD_DataIdentification /gmd:citation/gmd:CI_Citation /gmd:title/gco:CharacterString | gmx:FileName /Metadata /DatasetIdentification /fileName=/ I S O S M A P
  • 13. Can HDF Paths = ISO Paths? I S O H D F
  • 14. ISO: Roles and Types Roles = lowerCamelCase / Types = AA_UpperCamelCase ISO XML always alternates between roles and types. Each hierarchy level is either a role level or a type level. /gmi:MI_Metadata /gmd:identificationInfo/gmd:MD_DataIdentification /gmd:citation/gmd:CI_Citation /gmd:title/gco:CharacterString | gmx:FileName
  • 15. HDF: Groups and Attributes HDF: Groups and Attributes NcML: Groups and Attributes with XML attributes
  • 16. The Goal ISO Roles and Types NcML Groups and Attributes and XML Attributes Rules
  • 17. The Workflow 17 SMAP 19115-2 (19139-2) SMAP 19115-1 (19115-3) SMAP NcML SMAP 19115-1 (19115-3) Translation Proofing File Differencing SMAP HDF Product Designer The method we use to develop and test this approach involves several (standard) XSLT transforms (solid arrows) and comparisons between input metadata and metadata transformed to NcML and back to ISO (grey arrows). All of these transforms are lossless.
  • 18. The Workflow 18 SMAP 19115-2 (19139-2) SMAP NcML SMAP 19115-2 (19139-2) File Differencing The same transforms can be used to go directly from ISO 19139-2 (the ISO version currently used by NASA and NOAA) to NcML and back. SMAP HDF Product Designer
  • 19. ISO 19139-2 > NcML > HDF 19 /gmi:MI_Metadata /gmd:identificationInfo/gmd:MD_DataIdentification /gmd:citation/gmd:CI_Citation /gmd:title/gco:CharacterString | gmx:FileName /nc:netcdf /nc:group[@name=“gmi:MI_Metadata] /nc:group[@name=“gmd:identificationInfo] /nc:group[@name=“gmd:citation] /nc:group[@name=“gmd:title] /nc:attribute[@name=“value”]/@value I S O N C M L /gmi:MI_Metadata/gmd:identificationInfo/gmd:citation/gmd:title/value S M A P
  • 20. ISO 19115-3 > NcML > HDF 20 /nc:netcdf /nc:group[@name=“mdb:MD_Metadata] /nc:group[@name=“mdb:identificationInfo] /nc:group[@name=“mri:citation] /nc:group[@name=“mri:title] /nc:attribute[@name=“value”]/@value /mdb:MD_Metadata /mdb:identificationInfo/mri:MD_DataIdentification /mri:citation/cit:CI_Citation /cit:title/gco:CharacterString | gcx:FileName I S O N C M L S M A P /mdb:MD_Metadata/mdb:identificationInfo/mri:citation/mri:title/value
  • 21. ISO 19139-2 and 19115-3 = HDF 21 /gmi:MI_Metadata /gmd:identificationInfo/gmd:MD_DataIdentification /gmd:citation/gmd:CI_Citation /gmd:title/gco:CharacterString | gmx:FileName /gmi:MI_Metadata /gmd:identificationInfo /gmd:citation /gmd:title /value /mdb:MD_Metadata /mdb:identificationInfo/mri:MD_DataIdentification /mri:citation/cit:CI_Citation /cit:title/gco:CharacterString | gcx:FileName /mdb:MD_Metadata /mdb:identificationInfo /mri:citation /mri:title /value ~ ~ ISO 19115-2 HDF ISO 19115-1 HDF At least the transforms are consistent and the same!
  • 22. What Does This Mean? 22 Any ISO conceptual model can be transformed into HDF and extracted using standard transforms.
  • 23. What Does This Mean? 1) We can write standard interoperable ISO metadata into SWOT, NISAR, and PDS granules 2) They are all accessible with standard xPaths. 3) We can add standard ISO 19115 and 19115-1 groups to SMAP without any impact on current metadata access.
  • 24. The Goal 24 Include ISO concepts/content in NASA Earth Science products in a representation that is useful and consistent across products and missions.
  • 25. Acknowledgements 25 This work was partially supported by contract number NNG10HP02C from NASA. Any opinions, findings, conclusions, or recommendations expressed in this material are those of the author and do not necessarily reflect the views of NASA or The HDF Group.