The HDF Group

Using visualization tools to
access HDF data via
OPeNDAP
Joe Lee and Kent Yang
The HDF Group
The 13th HDF a...
HDF-OPeNDAP Tutorial Outline

• Why OPeNDAP?
• OPeNDAP Client Tools
o Visualization and Analysis

• OPeNDAP Servers
• View...
Why So Difficult?

• Getting and Listening to MP3 song
o Yesterday - Beatles

• Getting and Viewing HDF-EOS dataset
o Yest...
Mirador – Data Access Made Simple

November 3-5, 2009

HDF/HDF-EOS Workshop XIII

4

www.hdfgroup.org
Access HDF via FTP/HTTP

Users

Tool (IDL)

All I want is x-region data but data is
missing.

Aura

All I want is a datase...
Why MP3?
Why OPeNDAP?
• MP3 over CD
• Pick one song, not album (Quick)
• Listen now and Buy later (Right)

• OPeNDAP over ...
OPeNDAP Concept
Typical Remote Access
OPeNDAP client
Visualization
Visualization
View Data
tools
(e.g. grads)
(User)
Tools...
Access HDF via FTP/HTTP
Aura
Users

HDF Tool

OMI
FTP/
HTTP

Local HDF
Files
November 3-5, 2009

FTP / HTTP
Clients

FTP /...
Access HDF via OPeNDAP
Aura

Users

OMI
DAP

OPeNDAP
Client Tool
November 3-5, 2009

OPeNDAP
Servers
HDF/HDF-EOS Workshop ...
OPeNDAP – Why Not?

November 3-5, 2009

HDF/HDF-EOS Workshop XIII

10

www.hdfgroup.org
How toHow to HDF via OPeNDAP
Enjoy Enjoy MP3

MP3

HDF via OPeNDAP

1. Install MP3 player

1. Install OPeNDAP tool

2. Sea...
OPeNDAP Tools
1.
2.
3.
4.
5.
6.
7.
8.

Panoply
GrADS
IDV
IDL
NCL
ODC
Ferret
ncBrowse

http://www.giss.nasa.gov/tools/panop...
Install Panoply

• http://www.giss.nasa.gov/tools/panoply/
• Java 5 Runtime Environment

November 3-5, 2009

HDF/HDF-EOS W...
Search Web for Data
• Open Web Browser
• Search omi opendap (or Enter URL)
• http://acdisc.gsfc.nasa.gov/opendap/
(http://...
Search Web for OPeNDAP Data
• Pick the Date
• Select & Copy the DATA URL (Ctrl-C)

November 3-5, 2009

HDF/HDF-EOS Worksho...
View Data

•
•
•
•
•

November 3-5, 2009

Start Application
Enter URL (Album)
Pick Dataset (Track)
Set Projection (Equaliz...
Examples and Demo Pages

November 3-5, 2009

HDF/HDF-EOS Workshop XIII

17

www.hdfgroup.org
The HDF Group

Thank You!
• More Tools Examples:
http://hdfeos.org/software/idv.php
http://hdfeos.org/examples/using_grads...
Acknowledgements
This work was supported by cooperative agreement
number NNX06AC83A, NNX08AO77A and
NNX06AG75A from the Na...
The HDF Group

Questions/comments?
HDF-EOS to MP3?
Earth Music??

November 3-5, 2009

HDF/HDF-EOS Workshop XIII

20

www.h...
Upcoming SlideShare
Loading in …5
×

Using visualization tools to access HDF data via OPeNDAP

665 views
493 views

Published on

This slide will demonstrate how to use visualization and analysis tools such as IDV and GrADS to access HDF data via OPeNDAP.

To see animation in some slides, please visit:

http://hdfeos.org/workshops/ws13/presentations/day1/jxl_opendap_tutorial.ppt

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
665
On SlideShare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
Downloads
1
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Hi, my name is Joe Lee and I am a software developer at The HDF Group.
    For the last two years, I’ve been working on HDF-OPeNDAP project.
    In this talk, I’ll give you a tutorial how to access HDF through OPeNDAP.
  • Here’s the outline of my talk.
    First, I’ll give an introduction to OPeNDAP and explain why OPeNDAP is useful.
    Next, I’ll go over the available OPeNDAP client tools.
    They are primarily used for visualization of data and some of them allow you to do analysis.
    Then, I’ll talk about how to find OPeNDAP servers and data.
    Finally, I’ll present a live demo for viewing OPeNDAP ata.
  • Before I begin, I want to ask you a simple question.
    Compared to enjoying MP3 song from the internet, how do you feel about enjoying HDF-EOS dataset?
    For example, if you search for the song Yesterday by Beatles, you can easily listen to a sample in less than 10 seconds.
    However, how about viewing the NASA OMI data collected yesterday?
  • If you search for NASA OMI ozone data, you’ll find GES DISC site as a top result
    since NASA has made a great effort to make data accessible simple and easy.
    You’ll see three choices - FTP/HTTP and OPeNDAP.
    Normally users pick FTP or HTTP over OPeNDAP since they are familiar with them.
  • Here’s how it works with FTP/HTTP.
    However, there are at least two problems for accessing HDF in this manner.
  • If you are not still convinced the inconvenience, think why MP3 became so popular over compact discs.
    You like MP3 because you can pick one song at a time.
    You can examine the content first and then buy it later if you like.
    Same for data access.
  • This is how remote data can be accessed via OPeNDAP.
    Normally, users can view local data file “after download” using scientific data using visualization tools like GrADS.
    In DAP, this can be done remotely and on-demand.
    The benefit of OPeNDAP is clear when you want to view a small dataset; you don’t have to download the entire data from the server.
    DAP is a kind of value-added service on top of HTTP.
  • For people who are not familiar with OPeNDAP, I’ll explain how OPeNDAP works with HDF.
    OPeNDAP is an open implementation of easy data access through visualization tools like IDV.
    Our work bridges the existing OPeNDAP framework and HDF so that visualization is possible over the Internet.
  • As you can see, OPeNDAP simplifies the access of the remote data.
  • As long as data service provider supports OPeNDAP servers, so why not use OPeNDAP?
    Let’s try it now.
  • This is how you enjoy internet music.
    Same 3 easy steps for OPeNDAP.
  • There are many choices for OPeNDAP tools.
    Some of them can do analysis.
  • If you download and unzip panoply, you’ll see this.
  • It’s time to locate OPeNDAP servers and search for data.
  • The key thing to remember is the Data URL.
  • Here are some sneak previews of the new HDF-EOS website.
    I’m showing these because we have more opendap examples.
  • Thank you for listening.
    Here are the URLS that I’ve mentioned during the tutorial.
  • Supported by NASA for last two years.
  • Any questions?
    Wouldn’t it be cool to convert HDF-EOS to mp3? 
  • Using visualization tools to access HDF data via OPeNDAP

    1. 1. The HDF Group Using visualization tools to access HDF data via OPeNDAP Joe Lee and Kent Yang The HDF Group The 13th HDF and HDF-EOS Workshop November 3-5, 2009 November 3-5, 2009 HDF/HDF-EOS Workshop XIII 1 www.hdfgroup.org
    2. 2. HDF-OPeNDAP Tutorial Outline • Why OPeNDAP? • OPeNDAP Client Tools o Visualization and Analysis • OPeNDAP Servers • Viewing Data with Panoply November 3-5, 2009 HDF/HDF-EOS Workshop XIII 2 www.hdfgroup.org
    3. 3. Why So Difficult? • Getting and Listening to MP3 song o Yesterday - Beatles • Getting and Viewing HDF-EOS dataset o Yesterday’s Ozone - OMI November 3-5, 2009 HDF/HDF-EOS Workshop XIII 3 www.hdfgroup.org
    4. 4. Mirador – Data Access Made Simple November 3-5, 2009 HDF/HDF-EOS Workshop XIII 4 www.hdfgroup.org
    5. 5. Access HDF via FTP/HTTP Users Tool (IDL) All I want is x-region data but data is missing. Aura All I want is a dataset, not the entire file. OMI FTP Local HDF Files November 3-5, 2009 FTP / HTTP Clients FTP / HTTP Servers HDF/HDF-EOS Workshop XIII HDF Files 5 www.hdfgroup.org
    6. 6. Why MP3? Why OPeNDAP? • MP3 over CD • Pick one song, not album (Quick) • Listen now and Buy later (Right) • OPeNDAP over FTP/HTTP • Pick one dataset, not file (Quick) • View now and Download later (Right) • Benefit: Save Time and Resource! November 3-5, 2009 HDF/HDF-EOS Workshop XIII 6 www.hdfgroup.org
    7. 7. OPeNDAP Concept Typical Remote Access OPeNDAP client Visualization Visualization View Data tools (e.g. grads) (User) Tools Remote Data (HDF4/5) Local Data (HDF4/5) OPeNDAP FTP Server FTP Client DataTransfer Protocol (DAP) via Internet File Access (FTP) November 3-5, 2009 HDF/HDF-EOS Workshop XIII 7 www.hdfgroup.org
    8. 8. Access HDF via FTP/HTTP Aura Users HDF Tool OMI FTP/ HTTP Local HDF Files November 3-5, 2009 FTP / HTTP Clients FTP / HTTP Servers HDF/HDF-EOS Workshop XIII HDF Files 8 www.hdfgroup.org
    9. 9. Access HDF via OPeNDAP Aura Users OMI DAP OPeNDAP Client Tool November 3-5, 2009 OPeNDAP Servers HDF/HDF-EOS Workshop XIII HDF Files 9 www.hdfgroup.org
    10. 10. OPeNDAP – Why Not? November 3-5, 2009 HDF/HDF-EOS Workshop XIII 10 www.hdfgroup.org
    11. 11. How toHow to HDF via OPeNDAP Enjoy Enjoy MP3 MP3 HDF via OPeNDAP 1. Install MP3 player 1. Install OPeNDAP tool 2. Search web for MP3 2. Search web for data 3. Listen to your MP3 3. View data November 3-5, 2009 HDF/HDF-EOS Workshop XIII 11 www.hdfgroup.org
    12. 12. OPeNDAP Tools 1. 2. 3. 4. 5. 6. 7. 8. Panoply GrADS IDV IDL NCL ODC Ferret ncBrowse http://www.giss.nasa.gov/tools/panoply/ http://www.iges.org/grads/ http://www.unidata.ucar.edu/software/idv/ http://www.ittvis.com/ProductServices/IDL.aspx http://www.ncl.ucar.edu/ http://opendap.org/ODC/ http://ferret.wrc.noaa.gov/Ferret/ http://www.epic.noaa.gov/java/ncBrowse/ November 3-5, 2009 HDF/HDF-EOS Workshop XIII 12 www.hdfgroup.org
    13. 13. Install Panoply • http://www.giss.nasa.gov/tools/panoply/ • Java 5 Runtime Environment November 3-5, 2009 HDF/HDF-EOS Workshop XIII 13 www.hdfgroup.org
    14. 14. Search Web for Data • Open Web Browser • Search omi opendap (or Enter URL) • http://acdisc.gsfc.nasa.gov/opendap/ (http://www.hdfgroup.org/projects/opendap4/opendap4_demo.html) • (Click HDF-EOS5) • (Click Aura OMI Level 3) • Click OMTO3d.003 November 3-5, 2009 HDF/HDF-EOS Workshop XIII 14 www.hdfgroup.org
    15. 15. Search Web for OPeNDAP Data • Pick the Date • Select & Copy the DATA URL (Ctrl-C) November 3-5, 2009 HDF/HDF-EOS Workshop XIII 15 www.hdfgroup.org
    16. 16. View Data • • • • • November 3-5, 2009 Start Application Enter URL (Album) Pick Dataset (Track) Set Projection (Equalizer) Enter Lat / Lon (FF/REW) HDF/HDF-EOS Workshop XIII 16 www.hdfgroup.org
    17. 17. Examples and Demo Pages November 3-5, 2009 HDF/HDF-EOS Workshop XIII 17 www.hdfgroup.org
    18. 18. The HDF Group Thank You! • More Tools Examples: http://hdfeos.org/software/idv.php http://hdfeos.org/examples/using_grads.php • More Demo Servers and Data: http://hdfgroup.org/projects/opendap http://hdfgroup.org/projects/opendap4 November 3-5, 2009 HDF/HDF-EOS Workshop XIII 18 www.hdfgroup.org
    19. 19. Acknowledgements This work was supported by cooperative agreement number NNX06AC83A, NNX08AO77A and NNX06AG75A from the National Aeronautics and Space Administration (NASA). Any opinions, findings, conclusions, or recommendations expressed in this material are those of the author[s] and do not necessarily reflect the views of the National Aeronautics and Space Administration. November 3-5, 2009 HDF/HDF-EOS Workshop XIII 19 www.hdfgroup.org
    20. 20. The HDF Group Questions/comments? HDF-EOS to MP3? Earth Music?? November 3-5, 2009 HDF/HDF-EOS Workshop XIII 20 www.hdfgroup.org

    ×