ISO Metadata in HDF Data Files
•Download as PPTX, PDF•
0 likes•822 views
We are interested in developing a standard method for writing ISO TC211 compliant metadata into HDF data files. This presentation shows some initial workflows for this using the HDF Product Designer.
Recommended
More Related Content
Similar to ISO Metadata in HDF Data Files
Similar to ISO Metadata in HDF Data Files (20)
More from Ted Habermann
More from Ted Habermann (12)
Recently uploaded
Recently uploaded (20)
ISO Metadata in HDF Data Files
- 1. Product Designer Workflow ISO-Compliant Metadata in HDF Products The Product Designer Team
- 2. 1. Base Metadata Requirements Guidance https://wiki.earthdata.nasa.gov/display/ NASAISO/NASA+Base+Metadata+Require ments
- 3. 2. Guidance Requirements 1. Use Case 2. Overview 3. Recommendations 4. Conceptual Model (UML) 5. Implementation (XML) 6. Implementation (NcML) HPD Design Name 7. Usage (UMM) 8. Crosswalks https://wiki.earthdata.nas a.gov/display/NASAISO/Ke ywords
- 4. 3. HPD – Select Project Open Project ISO Project
- 5. 4. Select Design (and Version) Open Design ISO Project ISO Project MD_KeywordPaths
- 6. 5. Metadata Template In Design All groups in the ISO design have default role and type attributes. Do not change these! The values of the keywords in the sample are the paths to those keywords in the original ISO record. Note the identifier added to the second keyword to ensure unique attribute names.
- 7. 6. Design Export Options JSON Export python HDF5
- 8. 6a. Metadata in JSON
- 9. 6b. Metadata in Python keyword values in python
- 10. keyword values in python 6c. Metadata in HDF5 HDF5 file viewed in HDFCompass Keyword values in HDF5
- 11. 7. Copy Metadata Design to Your Project JSON HDF5 Import Export ISO design in new project with new values for the keywords
- 12. This is a work in progress. Suggestions / questions thabermann@hdfgroup.org
- 13. Acknowledgements 13 This work was partially supported by contract number NNG15HZ39C from NASA. Any opinions, findings, conclusions, or recommendations expressed in this material are those of the author and do not necessarily reflect the views of NASA or The HDF Group.
Editor's Notes
- We have recently developed an approach to transforming ISO metadata into NcML in a way that preserves all of the content necessary to re-create the complete ISO metadata record from the HDF. We are now starting to explore how that approach can be used with HDF Product Designer. These slides outline our initial ideas.
- We start with a set of metadata requirements – here represented by NASA Base Metadata Requirements. Our goal is to provide guidance to help data producers understand and implement metadata that addresses these requirements. Consider the MD_Keywords requirement. Clicking on MD_Keywords leads to a guidance page.
- Providing usable and understandable metadata guidance is always difficult for various reasons. Our current approach includes several standard kinds of information listed here: Use Case – a brief statement of a need that can be addressed using a particular documentation concept. In this case: I want to enable users to easily discover my data set or service by adding keywords to my metadata. Overview – A brief description of the concept and it’s role in documentation. Recommendations – specific recommendations regarding implementing the concept in ISO metadata dialects. Conceptual Model (UML) – a UML Class Diagram for the concept. Implementation (XML) – a sample of the XML that implements this concept in ISO dialects. Implementation (NcML) – a sample of the NcML (NetCDF Markup Language) that implements this documentation concept. The NcML is important because it is an XML dialect that is immediately transferable to HDF (or netCDF). This section will also provide the name of the Design for this element in HDF Product Designer. This is the link to the next step. Usage – descriptions of where in the ISO standard the concept is used and (optionally) a link to an evaluation of the completeness of the concept in the Common Metadata Repository. Crosswalks – xPaths for elements of the concept in several common metadata dialects.
- HDF Product Designer - a tool for designing HDF Products being developed at The HDF Group. Information and downloads are at https://wiki.earthdata.nasa.gov/display/HPD/HDF+Product+Designer. When you start Product Designer you need to select a Project. The ISO examples are in the ISO project. Select Open > Project and then select ISO.
- Select a Design – The ISO Project includes a number of examples. Find the one with the name you are looking for and open it. The most recent version is named HEAD.
- This screenshot shows the MD_KeywordPaths design in the Product Designer window. The design includes a number of groups (shown as folders) underneath a group called gmd:MD:Keywords. These groups have names that include namespace prefixes (gmd) and are the names of the classes in the original ISO metadata (except for repeating names that include an _identifier on the end). Note the namespace_N groups at the bottom of the design. These groups are added to the file so that the original ISO namespaces can be preserved. Each group has several default attributes: role and type that give the role and type of the group in the ISO metadata. These should not be changed. In addition, the groups include metadata content (e.g. gmd:keyword) or other groups (e.g. gmd:thesaurusName). The values of the keywords in this case (gmd:keyword and gmd:keyword_dle6) are the paths to the keywords in the original metadata we used to create the example (this is the reason for the Paths in the example name).
- This example design can be exported from the ISO Project as JSON, python, HDF5 or several other formats. In order to use it in one of your projects you must export as JSON or HDF5.
- The exported HDF5 or JSON files can now be imported into the project where you expect to use them. You must export the design from the ISO project, close the ISO Project, and open your project to do this. Once this is done you can edit the values of the keywords and other metadata content.
- This is a work in progress. Comments / suggestions / questions thabermann@hdfgroup.org
- Thanks to the Product Designer User Group and to NASA ESDIS for help and support.