Subsetting

225 views

Published on

Source: http://hdfeos.org/workshops/ws04/presentations/Pedro/work4.ppt

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
225
On SlideShare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
1
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • My name is Matt Smith
    Many of you have heard parts of this talk before, I presented a talk 3 years ago about a dataset-independent subsetter. But this time I want to explain something that some people have missed before.
  • HEW2K is latest version of the front-end GUI
    Prototype – originally designed for use at data centers, but anyone wanting to subset large HDF-EOS files can use (even in a command line mode).
    Back-end first – it’s the main part. Some environment variables need to be set, but THAT’S IT!!!!
    Front-end GUI is icing on the cake. Data center-specific. You don’t have to have a UI at all. Ours can be used or another used/created. Any UI simply needs to generate a subset criteria file in ODL format – to hand to the back-end.
    ++++Javascript map applet is in HEW2K
    Check out the web site http://subset.itsc.uah.edu
  • + HDF only for metadata/attribute issues
    +
    + mult. Files: 1-to-1 file correspondence
    + No point data
    +
  • Javascript written by Bruce Beaumont
    Dyn-duo library created by Dan Steinman
    demo- (HEW knows nothing about TMI –> in HDF-EOS)
    TMI data ----- select most recent complete day
    ---- set Create Interactive => for Java maplet
    ---- set Scan all => to show all swaths
    Object Select ----- Select ALL
    Java maplet ----- Select North America
    Parameter ----- Select Columnar Water Vapor / give e-mail
    Check status – once – then let it check automatically
    Back to “subset” tab and look at the output (with map)
  • Subsetting

    1. 1. Subsetting University of Alabama in Huntsville Information Technology and Systems Center Matt Smith http://subset.itsc.uah.edu for The 4th HDF-EOS Vendor Workshop 19-21 September 2000
    2. 2. Outline  HEW – – – Definition Subsetting criteria file Demo HEW2K  Subsetting plans – – – Subsetting Portal Integration with ECS Other plans UAH The University of Alabama in Huntsville 19 HDF-EOS
    3. 3. HEW - What is it?  HDF-EOS Web-based Subsetter – Prototype software designed to be datasetindependent (i.e., HDF-EOS) – Back-end (C) • needs subset criteria file & HDF-EOS data – Front-end/GUI • HTML forms & Javascript – http://subset.itsc.uah.edu UAH The University of Alabama in Huntsville 19 HDF-EOS
    4. 4. HEW back-end       Uses HDF-EOS (and HDF) library Instructions via a subset criteria file (ODL) Handles multiple similar files Handles Swath and/or Grid data Unix (SGI & Sun) executables available Subsetted output files contain: – – – – StructMetadata (HDF-EOS) ArchiveMetadata* ProductMetadata (added by HEW ODL file) CoreMetadata* (w/ modified bounding box & time info) • optionally placed in .met file * if present in parent file UAH The University of Alabama in Huntsville 19 HDF-EOS
    5. 5. HEW GUI demo/JavaScript  Demo of http://subset.itsc.uah.edu/hew2k  Uses Dynduo JavaScript library  Works on Netscape and Explorer UAH The University of Alabama in Huntsville 19 HDF-EOS
    6. 6. Subset criteria file – contains: • • • • File(s) to subset Parameters/channels E-mail address Bounding box Req’d Req’d Req’d Opt. – Latitude/Longitude bounds – Row/Column bounds (grids only) UAH The University of Alabama in Huntsville • • • • • • Time range Subsampling stride Non-geolocated objects Output file prefix .met file Sub-scan subsetting (swaths only) 19 Opt. Req’d Opt. Opt. Opt. Opt. HDF-EOS
    7. 7. Sample subset criteria file (ODL) GROUP = SUBSET PARENT_FILE =(“/AQUA/AMSR/AE_L2A.hdfeos”) LATITUDE_RANGE = (35.000000, 40.000000) LONGITUDE_RANGE = (-77.000000, -72.000000) EMAIL = “user@company.com” OUTPUT_PREFIX = “NC_coast” MET_FILE = “YES” GROUP = SPOG NAME = “swath_1” TYPE = “SWATH” PARAMETERS = “89.0V_Res.1_TB”, “89.0V_Res.2_TB”) SUBSAMPLING = (“GeoTrack”, 1, “GeoXtrack”, 1) END_GROUP = SPOG END_GROUP = SUBSET END UAH The University of Alabama in Huntsville 19 HDF-EOS
    8. 8. Subsetting Portal    http://subset.org Up in December, 2000 For everyone involved in subsetting – – – – – – – Advertising Forums Data Software Glossary Tutorials Links to specialized subsetters UAH The University of Alabama in Huntsville 19 HDF-EOS
    9. 9. Other Tools  SPOT – Subsettability Checker  eospeek – HDF-EOS file display  hdfpeek – HDF file display  HDF-EOS user’s manual (in work) UAH The University of Alabama in Huntsville 19 HDF-EOS
    10. 10. Plans  HEW – – – Integration with ECS Special implementations at data centers Subsetting Portal • http://subset.org  ADaM  Subsetter/Format Converter  ESML UAH The University of Alabama in Huntsville 19 HDF-EOS

    ×