SlideShare a Scribd company logo
1 of 15
Download to read offline
Introduction to HDFLook_MODIS

Louis Gonzalez² and Dimitar Ouzounov ¹
¹ NASA GSFC, Goddard Earth Sciences DAAC, Greenbelt, MD
²Laboratoire d'Optique Atmospherique, University of Science and Technology
Lille, France

Sep 25, 2003

HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook

1
MSPHINX/HDFLook philosophy

In 2002-2003, together GES
DAAC and LOA- UL, France
distributed more than 3000
copies of the new
HDFLook_MODIS around the
world.

Sep 25, 2003

HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook

2
What is HDFLook
• What is HDFLook - Is a X-Motif based reader and viewer
of NCSA HDF v.4.x and HDF-EOS 2.x science datasets
• HDFLook-MODIS is a result of joint collaboration
between LOA USTL, France, and GES DAAC
• Main HDFLook developers are Louis Gonzalez and
Christine Deroo, Laboratoire d'Optique Atmosphérique,
USTL, France
• Main HDFLook science and data support: D.Ouzounov,
S.Ahmad, J.Li (GES DAAC), E.Vermote (University of
Maryland / MODLAND) , N.Saleous and R.Wolfe
(LTP/GSFC )

Sep 25, 2003

HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook

3
HDFLook_MODIS Overview
HDFLook-MODIS is a result of joint collaboration between LOA USTL, France, and GES DAAC and is
based on the very popular MSPHINX(Motif satellite Process Handling Images uNder XWindows) tool
philosophy (http://www-loa.univ-lille1.fr/Msphinx/Msphinx_gb.html). Created as a flexible modular tool, is
easy to update, add new features, and is free to users obtaining it from the GES DAAC
HDF-EOS Visualization – MODIS: L1B, Land L2,L3; Atmospheric L2, L3,L4; Ocean L2,L3,L4 mapped,
Ocean L3, L4;
Mapping and projections - Geo-projection conversion utility.L2, L3, and L4 products.
LINEAR.GOODE’S,MOLLWEIDE,HAMMER, AZIMUTHAL, LAMBERT, MILLER, MOLLWEIDE,
ORTHOGRAPHIC, SINUSOIDAL, VAN DER GRINTEN,WAGNER 7, ISIN, POLDER
Subsetting - Channel, Parameter, Spatial; Subsampling
Multi granule processing - Mosaic and Stitch
Data Conversion- HDF-EOS to ASCII, Binary, JPEG, GeoTIFF
AERONET data bank accesses - Aerosol and other ancillary data is available from the ground based sun
photometer measurements (AERONET data bank).
Running modes - All current capabilities are available in interactive, operational and command line modes
XWindows CE – SGI, HP, IBM-AIX, DEC, SUN, Linux, Macintosh and MS Windows (via Cygwin)
Sep 25, 2003

HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook

4
Mapping and projections

Type of Mapping:
Level1B RGB standard atmospheric corrected image or a single plane.
Level1B RGB thermal anomalies corrected image .
Level1B RGB thermal image.
Mod09 RGB standard atmospheric corrected image or single plane.
Other products (with latitude, longitude SDS records) a single plane.
Other products (reprojected SDS records) a single plane.
Sep 25, 2003

HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook

5
Subsetting - parameter, band and spatial

Sep 25, 2003

HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook

6
Mapping and projections L2 and L3
Mapping L3 Ocean mapped 4KM DailyProduct
(Mean) Calcite concentration day 25, 2001

Mapping Atmospheric Daily Global L3 gridded
(1x1 degree grid mean)
Water Vapor Near Infrared clear

Sep 25, 2003

HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook

Cloud Top Temperature

7
AERONET data base

Data type menu
Select the data which you want to subset:
Optical thickness
Size distribution
Refraction index
Polarization
All data

Sep 25, 2003

HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook

8
Interactive, operational and batch mode

Multi granule processing -Mosaic and Stitch

verbose
MODIS/Aqua Day-time 5km Global RGB Browse 10.06.2002
clear_data
set_home_directory /var/scratch
set_tmp_directory /var/scratch
set_map_directory /usr/modis/HDFLOOK/Maps
set_output_directory
/var/scratch/dimitar/test
set_input_directory
/ftp/datapool/OPS/user/MOGA/MYD021KM.003/2002.10.06
set_projection_to_geometry ProjectionTo="LINEAR" WidthTo=2000 HeightTo=1000 
LatitudeMinTo=-90. LatitudeMaxTo=90.0 LongitudeMinTo=-180. LongitudeMaxTo=180.0
set_image_background
color=White
add_maps Coastlines=yes CoastlineColor=Green
set_misc_options OnlyDay=Yes
#set_image_RGB_composite THERMAL
set_image_RGB_composite VISIBLE
#add_grids
color=Red LatitudeMin=-90 LatitudeMax=90 LatitudeStep=5 
#
LongitudeMin=-180 LongitudeMax=180 LongitudeStep=40
set_input_hdf_file
/ftp/datapool/OPS/user/MOGA/MYD021KM.003/2002.10.06/MYD021KM*.hdf
create_MODIS_RGB_Mosaic
FileName="MYD021KM_day_aqua_2002.10.06" RGBMode="Log" CreateJPEG=yes

Sep 25, 2003

HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook

9
The Global MODIS/Terra and Aqua Browse

HDFLook

The Global Browse 5 km pixel resolution image in the foreground (with polar regions omitted) was generated with
MODIS/Terra daytime data over MODIS/Aqua daytime data using visible bands 1, 4 and 3. This is the first time the MODIS
Data Support Team (MDST) has generated combined images with data from the Terra and Aqua satellites. The background
image, also the first of its kind, was generated with MODIS/Terra nighttime data using infrared bands 31, 29 and 20. These
images are generated with HDFLook from MODIS/Terra and MODIS/Aqua data that was acquired on September 16, 2002.
Images courtesy of the MDST at the GES DAAC.

Sep 25, 2003

HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook

10
HDFLook on the fly
Level1B visible and thermal anomalies over la Reunion

Sep 25, 2003

HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook

11
Night time Thermal composite
These are thermal RGB images acquired during nightime 2002 141 (Brazil, Nile Delta) using these
settings:band 31 Red 290K-275K, band 29 Green 280K-270K, band 20 B 300K-285K. the clouds which
appear white (note the scale is reversed, the highest temperature is the lowest intensity and the lowest
temperature is the highest intensity). The water appears very dark as the thermal inertia of water is so big that
the warmest objects in the night data are the water bodies.[ Petitcolin F. and Vermote E. F. 2002]

Sep 25, 2003

HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook

12
Human activities
Desert Mali (Along the river)

Composite surface reflectance (MOD09) 250m

Sep 25, 2003

HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook

13
Operational use and system integration
of HDFLook
• It is a main programs to routinely generate Level 1B
browse images (true-color for daytime, and brightness
temperature for nighttime) for MODIS data from the Terra
and Aqua satellites.(GES DAAC)
• Spatial on-the-fly subsetting of MODIS Level 3 Ocean
products from the Data Pool (GES DAAC)
• On-demand parameter subsetting of MODIS Ocean Level
2 products (GES DAAC)
• Operational Terra Modis preprocessing system (Yasuoka
Lab, Institute of Industrial Science, University of Tokyo)
Sep 25, 2003

HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook

14
HDFLook SUMMARY
Accessing and visualization of all swath (level-1, and 2) and gridded (level-3
and 4) MODIS radiometric and geolocation, atmosphere, land, and ocean
products, AIRS L1B and CERES data.
Re-mapping of swath data to world map
Reprojection from one projection to a different one
Interactive, operational and batch mode capabilities
Subsetting features - availability of parameter, band, and spatial subsetting
Multi-granule processing - Mosaic and stitch capabilities
Displays ancillary/data attributes
Data conversion- from scaled quantities to physical units
Format conversion- HDF-EOS to ASCII, Binary, JPEG, and Geo Tiff
Where to get HDFLook :GES DAAC daac.gsfc.nasa.gov/MODIS/HDFlook
LOA, UL, France www-loa.univ-lille1.fr/Hdflook/hdflook_gb.html
This presentation described methods and tools implemented or planned for
the Goddard DAAC that are intended to optimize access to MODIS data
for the Earth Science community.

Sep 25, 2003

HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook

15

More Related Content

What's hot

Scalable Deep Learning in ExtremeEarth-phiweek19
Scalable Deep Learning in ExtremeEarth-phiweek19Scalable Deep Learning in ExtremeEarth-phiweek19
Scalable Deep Learning in ExtremeEarth-phiweek19ExtremeEarth
 
SX Aurora TSUBASA (Vector Engine) a Brand-new Vector Supercomputing power in...
SX Aurora TSUBASA  (Vector Engine) a Brand-new Vector Supercomputing power in...SX Aurora TSUBASA  (Vector Engine) a Brand-new Vector Supercomputing power in...
SX Aurora TSUBASA (Vector Engine) a Brand-new Vector Supercomputing power in...inside-BigData.com
 
위성이미지 객체 검출 대회 - 2등
위성이미지 객체 검출 대회 - 2등위성이미지 객체 검출 대회 - 2등
위성이미지 객체 검출 대회 - 2등DACON AI 데이콘
 
Enabling Access to Big Geospatial Data with LocationTech and Apache projects
Enabling Access to Big Geospatial Data with LocationTech and Apache projectsEnabling Access to Big Geospatial Data with LocationTech and Apache projects
Enabling Access to Big Geospatial Data with LocationTech and Apache projectsRob Emanuele
 
Pleiades - satellite imagery - very high resolution
Pleiades - satellite imagery - very high resolutionPleiades - satellite imagery - very high resolution
Pleiades - satellite imagery - very high resolutionSpot Image
 
Mars CubeSat Telecom Relay Constellation_JPL Final
Mars CubeSat Telecom Relay Constellation_JPL FinalMars CubeSat Telecom Relay Constellation_JPL Final
Mars CubeSat Telecom Relay Constellation_JPL FinalRohan Deshmukh
 
Using Pleiades Very High Resolution Images for planning activities in feasib...
Using Pleiades  Very High Resolution Images for planning activities in feasib...Using Pleiades  Very High Resolution Images for planning activities in feasib...
Using Pleiades Very High Resolution Images for planning activities in feasib...Argongra Gis
 
Processing Geospatial Data At Scale @locationtech
Processing Geospatial Data At Scale @locationtechProcessing Geospatial Data At Scale @locationtech
Processing Geospatial Data At Scale @locationtechRob Emanuele
 
Remotesensingandgisapplications
RemotesensingandgisapplicationsRemotesensingandgisapplications
Remotesensingandgisapplicationsimaduddin91
 
2018 first break-landnodes
2018 first break-landnodes2018 first break-landnodes
2018 first break-landnodesLeventAkcaylar1
 
NICE_DRS_presentation_060710 (1)
NICE_DRS_presentation_060710 (1)NICE_DRS_presentation_060710 (1)
NICE_DRS_presentation_060710 (1)Stefano Coltellacci
 
FR1.L09.2 - ONBOARD RADAR PROCESSING CONCEPTS FOR THE DESDYNI MISSION
FR1.L09.2 - ONBOARD RADAR PROCESSING CONCEPTS FOR THE DESDYNI MISSIONFR1.L09.2 - ONBOARD RADAR PROCESSING CONCEPTS FOR THE DESDYNI MISSION
FR1.L09.2 - ONBOARD RADAR PROCESSING CONCEPTS FOR THE DESDYNI MISSIONgrssieee
 
TU2.T10.1.pptx
TU2.T10.1.pptxTU2.T10.1.pptx
TU2.T10.1.pptxgrssieee
 
Visualisation of Big Imaging Data
Visualisation of Big Imaging DataVisualisation of Big Imaging Data
Visualisation of Big Imaging DataSlava Kitaeff, PhD
 
Loader and Tester Swarming Drones for Cellular Phone Network Loading and Fiel...
Loader and Tester Swarming Drones for Cellular Phone Network Loading and Fiel...Loader and Tester Swarming Drones for Cellular Phone Network Loading and Fiel...
Loader and Tester Swarming Drones for Cellular Phone Network Loading and Fiel...Amir MirzaeiNia
 
Adam Lewis–SPEDDEXES 2014
Adam Lewis–SPEDDEXES 2014Adam Lewis–SPEDDEXES 2014
Adam Lewis–SPEDDEXES 2014aceas13tern
 

What's hot (20)

Scalable Deep Learning in ExtremeEarth-phiweek19
Scalable Deep Learning in ExtremeEarth-phiweek19Scalable Deep Learning in ExtremeEarth-phiweek19
Scalable Deep Learning in ExtremeEarth-phiweek19
 
SX Aurora TSUBASA (Vector Engine) a Brand-new Vector Supercomputing power in...
SX Aurora TSUBASA  (Vector Engine) a Brand-new Vector Supercomputing power in...SX Aurora TSUBASA  (Vector Engine) a Brand-new Vector Supercomputing power in...
SX Aurora TSUBASA (Vector Engine) a Brand-new Vector Supercomputing power in...
 
위성이미지 객체 검출 대회 - 2등
위성이미지 객체 검출 대회 - 2등위성이미지 객체 검출 대회 - 2등
위성이미지 객체 검출 대회 - 2등
 
Enabling Access to Big Geospatial Data with LocationTech and Apache projects
Enabling Access to Big Geospatial Data with LocationTech and Apache projectsEnabling Access to Big Geospatial Data with LocationTech and Apache projects
Enabling Access to Big Geospatial Data with LocationTech and Apache projects
 
Pleiades - satellite imagery - very high resolution
Pleiades - satellite imagery - very high resolutionPleiades - satellite imagery - very high resolution
Pleiades - satellite imagery - very high resolution
 
Mars CubeSat Telecom Relay Constellation_JPL Final
Mars CubeSat Telecom Relay Constellation_JPL FinalMars CubeSat Telecom Relay Constellation_JPL Final
Mars CubeSat Telecom Relay Constellation_JPL Final
 
Using Pleiades Very High Resolution Images for planning activities in feasib...
Using Pleiades  Very High Resolution Images for planning activities in feasib...Using Pleiades  Very High Resolution Images for planning activities in feasib...
Using Pleiades Very High Resolution Images for planning activities in feasib...
 
Processing Geospatial Data At Scale @locationtech
Processing Geospatial Data At Scale @locationtechProcessing Geospatial Data At Scale @locationtech
Processing Geospatial Data At Scale @locationtech
 
Remotesensingandgisapplications
RemotesensingandgisapplicationsRemotesensingandgisapplications
Remotesensingandgisapplications
 
2018 first break-landnodes
2018 first break-landnodes2018 first break-landnodes
2018 first break-landnodes
 
NICE_DRS_presentation_060710 (1)
NICE_DRS_presentation_060710 (1)NICE_DRS_presentation_060710 (1)
NICE_DRS_presentation_060710 (1)
 
FR1.L09.2 - ONBOARD RADAR PROCESSING CONCEPTS FOR THE DESDYNI MISSION
FR1.L09.2 - ONBOARD RADAR PROCESSING CONCEPTS FOR THE DESDYNI MISSIONFR1.L09.2 - ONBOARD RADAR PROCESSING CONCEPTS FOR THE DESDYNI MISSION
FR1.L09.2 - ONBOARD RADAR PROCESSING CONCEPTS FOR THE DESDYNI MISSION
 
CLIWOC Attributes
CLIWOC AttributesCLIWOC Attributes
CLIWOC Attributes
 
Modis 2010
Modis 2010Modis 2010
Modis 2010
 
TU2.T10.1.pptx
TU2.T10.1.pptxTU2.T10.1.pptx
TU2.T10.1.pptx
 
Cstp project
Cstp projectCstp project
Cstp project
 
Visualisation of Big Imaging Data
Visualisation of Big Imaging DataVisualisation of Big Imaging Data
Visualisation of Big Imaging Data
 
Loader and Tester Swarming Drones for Cellular Phone Network Loading and Fiel...
Loader and Tester Swarming Drones for Cellular Phone Network Loading and Fiel...Loader and Tester Swarming Drones for Cellular Phone Network Loading and Fiel...
Loader and Tester Swarming Drones for Cellular Phone Network Loading and Fiel...
 
ORNL DAAC MODIS Land Product Subsets
ORNL DAAC MODIS Land Product SubsetsORNL DAAC MODIS Land Product Subsets
ORNL DAAC MODIS Land Product Subsets
 
Adam Lewis–SPEDDEXES 2014
Adam Lewis–SPEDDEXES 2014Adam Lewis–SPEDDEXES 2014
Adam Lewis–SPEDDEXES 2014
 

Similar to Introduction to HDFLook_MODIS

Generalized EOS Data Converter: Making Data Products Accessible to GIS Tools
Generalized EOS Data Converter: Making Data Products Accessible to GIS ToolsGeneralized EOS Data Converter: Making Data Products Accessible to GIS Tools
Generalized EOS Data Converter: Making Data Products Accessible to GIS ToolsThe HDF-EOS Tools and Information Center
 
WE1.L10 - IMPLEMENTATION OF THE LAND, ATMOSPHERE NEAR-REAL-TIME CAPABILITY FO...
WE1.L10 - IMPLEMENTATION OF THE LAND, ATMOSPHERE NEAR-REAL-TIME CAPABILITY FO...WE1.L10 - IMPLEMENTATION OF THE LAND, ATMOSPHERE NEAR-REAL-TIME CAPABILITY FO...
WE1.L10 - IMPLEMENTATION OF THE LAND, ATMOSPHERE NEAR-REAL-TIME CAPABILITY FO...grssieee
 

Similar to Introduction to HDFLook_MODIS (20)

HDF and HDF-EOS Experiences and Applications
HDF and HDF-EOS Experiences and ApplicationsHDF and HDF-EOS Experiences and Applications
HDF and HDF-EOS Experiences and Applications
 
Generalized EOS Data Converter: Making Data Products Accessible to GIS Tools
Generalized EOS Data Converter: Making Data Products Accessible to GIS ToolsGeneralized EOS Data Converter: Making Data Products Accessible to GIS Tools
Generalized EOS Data Converter: Making Data Products Accessible to GIS Tools
 
MODIS Land and HDF-EOS
MODIS Land and HDF-EOSMODIS Land and HDF-EOS
MODIS Land and HDF-EOS
 
Status of HDF-EOS, Related Software, and Tools
Status of HDF-EOS, Related Software, and ToolsStatus of HDF-EOS, Related Software, and Tools
Status of HDF-EOS, Related Software, and Tools
 
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFViewHDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
 
Facilitating Access to EOS Data at the NSIDC DAAC
Facilitating Access to EOS Data at the NSIDC DAACFacilitating Access to EOS Data at the NSIDC DAAC
Facilitating Access to EOS Data at the NSIDC DAAC
 
Hdf eos status-workshp_xi_nov_2007
Hdf eos status-workshp_xi_nov_2007Hdf eos status-workshp_xi_nov_2007
Hdf eos status-workshp_xi_nov_2007
 
HDF-EOS Tools
HDF-EOS ToolsHDF-EOS Tools
HDF-EOS Tools
 
HDF & HDF-EOS Data & Support at NSIDC
HDF & HDF-EOS Data & Support at NSIDCHDF & HDF-EOS Data & Support at NSIDC
HDF & HDF-EOS Data & Support at NSIDC
 
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFViewHDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
 
Geoscience Data Analysis and Visualization Tools from NCAR
Geoscience Data Analysis and Visualization Tools from NCARGeoscience Data Analysis and Visualization Tools from NCAR
Geoscience Data Analysis and Visualization Tools from NCAR
 
ESDIS Status (2002)
ESDIS Status (2002)ESDIS Status (2002)
ESDIS Status (2002)
 
Status of HDF-EOS, Related Software and Tools
Status of HDF-EOS, Related Software and ToolsStatus of HDF-EOS, Related Software and Tools
Status of HDF-EOS, Related Software and Tools
 
HDF-EOS to GeoTIFF Conversion Tool and HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool and HDF-EOS Plug-in for HDFViewHDF-EOS to GeoTIFF Conversion Tool and HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool and HDF-EOS Plug-in for HDFView
 
EOSDIS Status
EOSDIS StatusEOSDIS Status
EOSDIS Status
 
GES DISC Eexperiences with HDF Formats for MEaSUREs Projects
GES DISC Eexperiences with HDF Formats for MEaSUREs ProjectsGES DISC Eexperiences with HDF Formats for MEaSUREs Projects
GES DISC Eexperiences with HDF Formats for MEaSUREs Projects
 
HDF-EOS Development - Current Status and Schedule
HDF-EOS Development - Current Status and ScheduleHDF-EOS Development - Current Status and Schedule
HDF-EOS Development - Current Status and Schedule
 
HDF-EOS APIs, tools, etc.
HDF-EOS APIs, tools, etc.HDF-EOS APIs, tools, etc.
HDF-EOS APIs, tools, etc.
 
WE1.L10 - IMPLEMENTATION OF THE LAND, ATMOSPHERE NEAR-REAL-TIME CAPABILITY FO...
WE1.L10 - IMPLEMENTATION OF THE LAND, ATMOSPHERE NEAR-REAL-TIME CAPABILITY FO...WE1.L10 - IMPLEMENTATION OF THE LAND, ATMOSPHERE NEAR-REAL-TIME CAPABILITY FO...
WE1.L10 - IMPLEMENTATION OF THE LAND, ATMOSPHERE NEAR-REAL-TIME CAPABILITY FO...
 
EOS MLS software
EOS MLS softwareEOS MLS software
EOS MLS software
 

More from The HDF-EOS Tools and Information Center

STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...The HDF-EOS Tools and Information Center
 

More from The HDF-EOS Tools and Information Center (20)

Cloud-Optimized HDF5 Files
Cloud-Optimized HDF5 FilesCloud-Optimized HDF5 Files
Cloud-Optimized HDF5 Files
 
Accessing HDF5 data in the cloud with HSDS
Accessing HDF5 data in the cloud with HSDSAccessing HDF5 data in the cloud with HSDS
Accessing HDF5 data in the cloud with HSDS
 
The State of HDF
The State of HDFThe State of HDF
The State of HDF
 
Highly Scalable Data Service (HSDS) Performance Features
Highly Scalable Data Service (HSDS) Performance FeaturesHighly Scalable Data Service (HSDS) Performance Features
Highly Scalable Data Service (HSDS) Performance Features
 
Creating Cloud-Optimized HDF5 Files
Creating Cloud-Optimized HDF5 FilesCreating Cloud-Optimized HDF5 Files
Creating Cloud-Optimized HDF5 Files
 
HDF5 OPeNDAP Handler Updates, and Performance Discussion
HDF5 OPeNDAP Handler Updates, and Performance DiscussionHDF5 OPeNDAP Handler Updates, and Performance Discussion
HDF5 OPeNDAP Handler Updates, and Performance Discussion
 
Hyrax: Serving Data from S3
Hyrax: Serving Data from S3Hyrax: Serving Data from S3
Hyrax: Serving Data from S3
 
Accessing Cloud Data and Services Using EDL, Pydap, MATLAB
Accessing Cloud Data and Services Using EDL, Pydap, MATLABAccessing Cloud Data and Services Using EDL, Pydap, MATLAB
Accessing Cloud Data and Services Using EDL, Pydap, MATLAB
 
HDF - Current status and Future Directions
HDF - Current status and Future DirectionsHDF - Current status and Future Directions
HDF - Current status and Future Directions
 
HDFEOS.org User Analsys, Updates, and Future
HDFEOS.org User Analsys, Updates, and FutureHDFEOS.org User Analsys, Updates, and Future
HDFEOS.org User Analsys, Updates, and Future
 
HDF - Current status and Future Directions
HDF - Current status and Future Directions HDF - Current status and Future Directions
HDF - Current status and Future Directions
 
H5Coro: The Cloud-Optimized Read-Only Library
H5Coro: The Cloud-Optimized Read-Only LibraryH5Coro: The Cloud-Optimized Read-Only Library
H5Coro: The Cloud-Optimized Read-Only Library
 
MATLAB Modernization on HDF5 1.10
MATLAB Modernization on HDF5 1.10MATLAB Modernization on HDF5 1.10
MATLAB Modernization on HDF5 1.10
 
HDF for the Cloud - Serverless HDF
HDF for the Cloud - Serverless HDFHDF for the Cloud - Serverless HDF
HDF for the Cloud - Serverless HDF
 
HDF5 <-> Zarr
HDF5 <-> ZarrHDF5 <-> Zarr
HDF5 <-> Zarr
 
HDF for the Cloud - New HDF Server Features
HDF for the Cloud - New HDF Server FeaturesHDF for the Cloud - New HDF Server Features
HDF for the Cloud - New HDF Server Features
 
Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3
Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3
Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3
 
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
 
HDF5 and Ecosystem: What Is New?
HDF5 and Ecosystem: What Is New?HDF5 and Ecosystem: What Is New?
HDF5 and Ecosystem: What Is New?
 
HDF5 Roadmap 2019-2020
HDF5 Roadmap 2019-2020HDF5 Roadmap 2019-2020
HDF5 Roadmap 2019-2020
 

Recently uploaded

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businesspanagenda
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?Igalia
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdflior mazor
 

Recently uploaded (20)

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 

Introduction to HDFLook_MODIS

  • 1. Introduction to HDFLook_MODIS Louis Gonzalez² and Dimitar Ouzounov ¹ ¹ NASA GSFC, Goddard Earth Sciences DAAC, Greenbelt, MD ²Laboratoire d'Optique Atmospherique, University of Science and Technology Lille, France Sep 25, 2003 HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook 1
  • 2. MSPHINX/HDFLook philosophy In 2002-2003, together GES DAAC and LOA- UL, France distributed more than 3000 copies of the new HDFLook_MODIS around the world. Sep 25, 2003 HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook 2
  • 3. What is HDFLook • What is HDFLook - Is a X-Motif based reader and viewer of NCSA HDF v.4.x and HDF-EOS 2.x science datasets • HDFLook-MODIS is a result of joint collaboration between LOA USTL, France, and GES DAAC • Main HDFLook developers are Louis Gonzalez and Christine Deroo, Laboratoire d'Optique Atmosphérique, USTL, France • Main HDFLook science and data support: D.Ouzounov, S.Ahmad, J.Li (GES DAAC), E.Vermote (University of Maryland / MODLAND) , N.Saleous and R.Wolfe (LTP/GSFC ) Sep 25, 2003 HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook 3
  • 4. HDFLook_MODIS Overview HDFLook-MODIS is a result of joint collaboration between LOA USTL, France, and GES DAAC and is based on the very popular MSPHINX(Motif satellite Process Handling Images uNder XWindows) tool philosophy (http://www-loa.univ-lille1.fr/Msphinx/Msphinx_gb.html). Created as a flexible modular tool, is easy to update, add new features, and is free to users obtaining it from the GES DAAC HDF-EOS Visualization – MODIS: L1B, Land L2,L3; Atmospheric L2, L3,L4; Ocean L2,L3,L4 mapped, Ocean L3, L4; Mapping and projections - Geo-projection conversion utility.L2, L3, and L4 products. LINEAR.GOODE’S,MOLLWEIDE,HAMMER, AZIMUTHAL, LAMBERT, MILLER, MOLLWEIDE, ORTHOGRAPHIC, SINUSOIDAL, VAN DER GRINTEN,WAGNER 7, ISIN, POLDER Subsetting - Channel, Parameter, Spatial; Subsampling Multi granule processing - Mosaic and Stitch Data Conversion- HDF-EOS to ASCII, Binary, JPEG, GeoTIFF AERONET data bank accesses - Aerosol and other ancillary data is available from the ground based sun photometer measurements (AERONET data bank). Running modes - All current capabilities are available in interactive, operational and command line modes XWindows CE – SGI, HP, IBM-AIX, DEC, SUN, Linux, Macintosh and MS Windows (via Cygwin) Sep 25, 2003 HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook 4
  • 5. Mapping and projections Type of Mapping: Level1B RGB standard atmospheric corrected image or a single plane. Level1B RGB thermal anomalies corrected image . Level1B RGB thermal image. Mod09 RGB standard atmospheric corrected image or single plane. Other products (with latitude, longitude SDS records) a single plane. Other products (reprojected SDS records) a single plane. Sep 25, 2003 HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook 5
  • 6. Subsetting - parameter, band and spatial Sep 25, 2003 HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook 6
  • 7. Mapping and projections L2 and L3 Mapping L3 Ocean mapped 4KM DailyProduct (Mean) Calcite concentration day 25, 2001 Mapping Atmospheric Daily Global L3 gridded (1x1 degree grid mean) Water Vapor Near Infrared clear Sep 25, 2003 HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook Cloud Top Temperature 7
  • 8. AERONET data base Data type menu Select the data which you want to subset: Optical thickness Size distribution Refraction index Polarization All data Sep 25, 2003 HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook 8
  • 9. Interactive, operational and batch mode Multi granule processing -Mosaic and Stitch verbose MODIS/Aqua Day-time 5km Global RGB Browse 10.06.2002 clear_data set_home_directory /var/scratch set_tmp_directory /var/scratch set_map_directory /usr/modis/HDFLOOK/Maps set_output_directory /var/scratch/dimitar/test set_input_directory /ftp/datapool/OPS/user/MOGA/MYD021KM.003/2002.10.06 set_projection_to_geometry ProjectionTo="LINEAR" WidthTo=2000 HeightTo=1000 LatitudeMinTo=-90. LatitudeMaxTo=90.0 LongitudeMinTo=-180. LongitudeMaxTo=180.0 set_image_background color=White add_maps Coastlines=yes CoastlineColor=Green set_misc_options OnlyDay=Yes #set_image_RGB_composite THERMAL set_image_RGB_composite VISIBLE #add_grids color=Red LatitudeMin=-90 LatitudeMax=90 LatitudeStep=5 # LongitudeMin=-180 LongitudeMax=180 LongitudeStep=40 set_input_hdf_file /ftp/datapool/OPS/user/MOGA/MYD021KM.003/2002.10.06/MYD021KM*.hdf create_MODIS_RGB_Mosaic FileName="MYD021KM_day_aqua_2002.10.06" RGBMode="Log" CreateJPEG=yes Sep 25, 2003 HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook 9
  • 10. The Global MODIS/Terra and Aqua Browse HDFLook The Global Browse 5 km pixel resolution image in the foreground (with polar regions omitted) was generated with MODIS/Terra daytime data over MODIS/Aqua daytime data using visible bands 1, 4 and 3. This is the first time the MODIS Data Support Team (MDST) has generated combined images with data from the Terra and Aqua satellites. The background image, also the first of its kind, was generated with MODIS/Terra nighttime data using infrared bands 31, 29 and 20. These images are generated with HDFLook from MODIS/Terra and MODIS/Aqua data that was acquired on September 16, 2002. Images courtesy of the MDST at the GES DAAC. Sep 25, 2003 HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook 10
  • 11. HDFLook on the fly Level1B visible and thermal anomalies over la Reunion Sep 25, 2003 HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook 11
  • 12. Night time Thermal composite These are thermal RGB images acquired during nightime 2002 141 (Brazil, Nile Delta) using these settings:band 31 Red 290K-275K, band 29 Green 280K-270K, band 20 B 300K-285K. the clouds which appear white (note the scale is reversed, the highest temperature is the lowest intensity and the lowest temperature is the highest intensity). The water appears very dark as the thermal inertia of water is so big that the warmest objects in the night data are the water bodies.[ Petitcolin F. and Vermote E. F. 2002] Sep 25, 2003 HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook 12
  • 13. Human activities Desert Mali (Along the river) Composite surface reflectance (MOD09) 250m Sep 25, 2003 HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook 13
  • 14. Operational use and system integration of HDFLook • It is a main programs to routinely generate Level 1B browse images (true-color for daytime, and brightness temperature for nighttime) for MODIS data from the Terra and Aqua satellites.(GES DAAC) • Spatial on-the-fly subsetting of MODIS Level 3 Ocean products from the Data Pool (GES DAAC) • On-demand parameter subsetting of MODIS Ocean Level 2 products (GES DAAC) • Operational Terra Modis preprocessing system (Yasuoka Lab, Institute of Industrial Science, University of Tokyo) Sep 25, 2003 HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook 14
  • 15. HDFLook SUMMARY Accessing and visualization of all swath (level-1, and 2) and gridded (level-3 and 4) MODIS radiometric and geolocation, atmosphere, land, and ocean products, AIRS L1B and CERES data. Re-mapping of swath data to world map Reprojection from one projection to a different one Interactive, operational and batch mode capabilities Subsetting features - availability of parameter, band, and spatial subsetting Multi-granule processing - Mosaic and stitch capabilities Displays ancillary/data attributes Data conversion- from scaled quantities to physical units Format conversion- HDF-EOS to ASCII, Binary, JPEG, and Geo Tiff Where to get HDFLook :GES DAAC daac.gsfc.nasa.gov/MODIS/HDFlook LOA, UL, France www-loa.univ-lille1.fr/Hdflook/hdflook_gb.html This presentation described methods and tools implemented or planned for the Goddard DAAC that are intended to optimize access to MODIS data for the Earth Science community. Sep 25, 2003 HDF/HDF-EOS Workshop VII –Sep 23-25, 2003 : HDFLook 15