EOS

DATA INFORMATION SYSTEM

EARTH PROBES

NASA'S MISSION TO PLANET EARTH

EARTH OBSERVING SYSTEM

HDF-EOS Development Status and
Maintenance Support
Larry Klein
Space Applications Corp.
September 23, 1998
NASA'S MISSION TO PLANET EARTH

EARTH PROBES

DATA INFORMATION SYSTEM

Features Added Since Last
Workshop

EOS
EARTH OBSERVING SYSTEM

• Vertical subsetting for Point structure: PTdefvrtregion()
• Additional capability for handling indexed swaths (Landsat 7
overapping scenes): enhancements to SWextractregion() and
SWregionindex()
• Access for index map for subsetted swath: SWupdateindexmap()
• Function to return dimension-mapping information between Geo
and Data dimensions: SWgeomapinfo()
• Increased limit of simultaneous open swath files to 200.
• Reduction in overhead (10X) in reading grid points:
GDgetpixvalues()
• Added capability to support HDF tiling with compression.

LK-2
NASA'S MISSION TO PLANET EARTH

EARTH PROBES

DATA INFORMATION SYSTEM

Related Development

EOS
EARTH OBSERVING SYSTEM

• GUI-based HDF-EOS skeleton file creation: HDF-EOS
Configuration Record
- Developed by NCSA, released by ECS spring, 1998.
• Reduced ECS Science Data Processing Toolkit/HDF-EOS package
- Uses same metadata and time tool interface as standard toolkit.
- Intended for application developers and for data production
outside ECS, but archival inside.
- Will work on Windows, Macs, as well as standard UNIX
platforms.
- Is available by request on Sun, SGI, HP, Windows (95 & NT).
• EOSView V3.0 released August, 1998. Added:
- Plot filters.
- Image display for 24-bit graphics card.
- Plotting for tables larger than 1000 X 1000.
LK-3
NASA'S MISSION TO PLANET EARTH

EARTH PROBES

DATA INFORMATION SYSTEM

Near-Future Development

EOS
EARTH OBSERVING SYSTEM

• Intensive testing on-going with instrument data processing
software.
• Expect improvements in efficiency as system is stressed. eg.
possible simplification of metadata checking.
• Data production software and test data are nearing final launch
versions. We expect several bug fixes and regression testing.
• Final ECS version to support EOS-AM1 launch: December, 98.
• Launch currently June, 1999.

LK-4
NASA'S MISSION TO PLANET EARTH

EARTH PROBES

DATA INFORMATION SYSTEM

Potential Enhancements

EOS
EARTH OBSERVING SYSTEM

• Structures to accommodate other data types:
- Vertical profilers vs. imagers.
- More complex indexing schemes and services to support:
Non-sequencial scanners, e.g. helical scanners,
Multiple viewing geometries for a single sensor.
• Incorporation of HDF5.
• Optional simplified interface, e.g. file copy, write file
• Add additional projections: Currently, the toolkit supports 32
USGS projections; HDF-EOS supports 10, plus Integerized
Sinusiodal Projection. Gridded-swath added for MISR.

LK-5
NASA'S MISSION TO PLANET EARTH

EARTH PROBES

DATA INFORMATION SYSTEM

Potential Enhancements (cont.)

EOS
EARTH OBSERVING SYSTEM

• Add more sophisticated subsetting:
- Return data within a lat/long box rather than whole scanlines.
- Polygonal subsetting.
• Combination of graphical user interfaces for ECS inventory
metadata definition and for HDF-EOS configuration (i.e.
coordinate structural and inventory metadata).
• Your enhancement here.....

LK-6
NASA'S MISSION TO PLANET EARTH

EARTH PROBES

DATA INFORMATION SYSTEM

Maintenance and User Support
Responsibility

EOS
EARTH OBSERVING SYSTEM

• ECS (SAC) has the responsibility for HDF-EOS and toolkit maintenance
and user support, until October, 2002.
• We expect future releases which accommodate EOS-PM1, EOS-CHEM
instruments.
• User interaction is provided through email: pgstlkit@eos.hitc.com or
listserver: sdptoolkit@listserv.gsfc.nasa.gov or
eostools@gsfc.nasa.gov.
• Software fixes go through a formal process:
- Tracked through Non-Conformance Reports, Gov’t and DAACs have
access.
- Fixes regression-tested through configuration controlled test drivers.
- Independent Test and Quality Assurance organizations.
- Patches are released through a control board.

LK-7

HDF-EOS Development Status and Maintenance Support

  • 1.
    EOS DATA INFORMATION SYSTEM EARTHPROBES NASA'S MISSION TO PLANET EARTH EARTH OBSERVING SYSTEM HDF-EOS Development Status and Maintenance Support Larry Klein Space Applications Corp. September 23, 1998
  • 2.
    NASA'S MISSION TOPLANET EARTH EARTH PROBES DATA INFORMATION SYSTEM Features Added Since Last Workshop EOS EARTH OBSERVING SYSTEM • Vertical subsetting for Point structure: PTdefvrtregion() • Additional capability for handling indexed swaths (Landsat 7 overapping scenes): enhancements to SWextractregion() and SWregionindex() • Access for index map for subsetted swath: SWupdateindexmap() • Function to return dimension-mapping information between Geo and Data dimensions: SWgeomapinfo() • Increased limit of simultaneous open swath files to 200. • Reduction in overhead (10X) in reading grid points: GDgetpixvalues() • Added capability to support HDF tiling with compression. LK-2
  • 3.
    NASA'S MISSION TOPLANET EARTH EARTH PROBES DATA INFORMATION SYSTEM Related Development EOS EARTH OBSERVING SYSTEM • GUI-based HDF-EOS skeleton file creation: HDF-EOS Configuration Record - Developed by NCSA, released by ECS spring, 1998. • Reduced ECS Science Data Processing Toolkit/HDF-EOS package - Uses same metadata and time tool interface as standard toolkit. - Intended for application developers and for data production outside ECS, but archival inside. - Will work on Windows, Macs, as well as standard UNIX platforms. - Is available by request on Sun, SGI, HP, Windows (95 & NT). • EOSView V3.0 released August, 1998. Added: - Plot filters. - Image display for 24-bit graphics card. - Plotting for tables larger than 1000 X 1000. LK-3
  • 4.
    NASA'S MISSION TOPLANET EARTH EARTH PROBES DATA INFORMATION SYSTEM Near-Future Development EOS EARTH OBSERVING SYSTEM • Intensive testing on-going with instrument data processing software. • Expect improvements in efficiency as system is stressed. eg. possible simplification of metadata checking. • Data production software and test data are nearing final launch versions. We expect several bug fixes and regression testing. • Final ECS version to support EOS-AM1 launch: December, 98. • Launch currently June, 1999. LK-4
  • 5.
    NASA'S MISSION TOPLANET EARTH EARTH PROBES DATA INFORMATION SYSTEM Potential Enhancements EOS EARTH OBSERVING SYSTEM • Structures to accommodate other data types: - Vertical profilers vs. imagers. - More complex indexing schemes and services to support: Non-sequencial scanners, e.g. helical scanners, Multiple viewing geometries for a single sensor. • Incorporation of HDF5. • Optional simplified interface, e.g. file copy, write file • Add additional projections: Currently, the toolkit supports 32 USGS projections; HDF-EOS supports 10, plus Integerized Sinusiodal Projection. Gridded-swath added for MISR. LK-5
  • 6.
    NASA'S MISSION TOPLANET EARTH EARTH PROBES DATA INFORMATION SYSTEM Potential Enhancements (cont.) EOS EARTH OBSERVING SYSTEM • Add more sophisticated subsetting: - Return data within a lat/long box rather than whole scanlines. - Polygonal subsetting. • Combination of graphical user interfaces for ECS inventory metadata definition and for HDF-EOS configuration (i.e. coordinate structural and inventory metadata). • Your enhancement here..... LK-6
  • 7.
    NASA'S MISSION TOPLANET EARTH EARTH PROBES DATA INFORMATION SYSTEM Maintenance and User Support Responsibility EOS EARTH OBSERVING SYSTEM • ECS (SAC) has the responsibility for HDF-EOS and toolkit maintenance and user support, until October, 2002. • We expect future releases which accommodate EOS-PM1, EOS-CHEM instruments. • User interaction is provided through email: pgstlkit@eos.hitc.com or listserver: sdptoolkit@listserv.gsfc.nasa.gov or eostools@gsfc.nasa.gov. • Software fixes go through a formal process: - Tracked through Non-Conformance Reports, Gov’t and DAACs have access. - Fixes regression-tested through configuration controlled test drivers. - Independent Test and Quality Assurance organizations. - Patches are released through a control board. LK-7