• Share
  • Email
  • Embed
  • Like
  • Private Content
Adding new servicees for HDF in THREDDS Data Server (TDS)
 

Adding new servicees for HDF in THREDDS Data Server (TDS)

on

  • 53 views

HDF and HDF-EOS Workshop XVII (2014)

HDF and HDF-EOS Workshop XVII (2014)
H. Joe Lee

Statistics

Views

Total Views
53
Views on SlideShare
29
Embed Views
24

Actions

Likes
0
Downloads
1
Comments
0

3 Embeds 24

http://hdfeos.org 19
http://localhost 3
http://www.hdfeos.org 2

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • This is not a new idea. <br /> Remember the old days of Apache cgi-bin. <br /> You can implement it in Node.js or lighty web frame work. <br />
  • I’d like to call it DataBox. It’s a nice platform that everybody can run and share data easily.
  • Here’s what I did to add a new service. <br /> If there is a better way to handle this problem in THREDDS, please let me know.
  • Right now, we hard code the names of command line tools. <br />

Adding new servicees for HDF in THREDDS Data Server (TDS) Adding new servicees for HDF in THREDDS Data Server (TDS) Presentation Transcript

  • The HDF Group www.hdfgroup.orgJuly 8, 2014 2014 Summer ESIP Federation Meeting / HDF and HDF-EOS Workshop XVII Adding new services for HDF in THREDDS Data Server (TDS) Hyo-Kyung Joe Lee and Ted Habermann The HDF Group 1
  • www.hdfgroup.org2014 Summer ESIP Federation Meeting A User Story 2 I would like to examine a big HDF file X with command line tool Y that runs on platform Z. However, my mobile platform is not Z. So, I can’t run Y. X is too big for my device as well.
  • www.hdfgroup.org2014 Summer ESIP Federation Meeting Web Service is the answer. 3 Almost all platforms support web browser.
  • www.hdfgroup.org2014 Summer ESIP Federation Meeting Web Service Solution 4 Run web server on Z. The server executes command Y on X. Send output over the web. THREDDS Data Server is a good candidate.
  • www.hdfgroup.org2014 Summer ESIP Federation Meeting Why THREDDS Data Server? 5 Portable – 100% Java Easy to add a new service Data and services go together. Maximum control on services with data
  • www.hdfgroup.org2014 Summer ESIP Federation Meeting How to add a new service 6 1. Create a YServiceController class (e.g., H4MapServiceController.java) 2. handleRequest() method Invokes runtime.exec(command). 3. Read stdout and build a string outStr. 4. Return ResponseEntity<string>(outStr,…) 5. Set up catalog for Y service for X data. 6. Run the custom TDS on Z.
  • www.hdfgroup.org2014 Summer ESIP Federation Meeting New HDF Services for non-Java apps 7 • HDF4 File Content Map (h4map) • For HDF4 files only • C / Linux & Mac • HDF5 JSON (h5json) • For HDF5 files only • C++ • NCO/CF checker (ncdismember) • For both HDF4 and HDF5 • C/C++/Python
  • www.hdfgroup.org2014 Summer ESIP Federation Meeting Quick Demo 8 http://eosdap.hdfgroup.uiuc.edu:8887/thred ds/catalog.html Some files are located at FTP server and mounted via NFS, not at TDS. Services are triggered based on file extension.
  • www.hdfgroup.org2014 Summer ESIP Federation Meeting Benefit 9 Try URLs with online XML / JSON browser. • xmlgrid.net • jsonviewer.stack.hu You can develop your own XML/JSON apps on top of the new HDF web services. Run command while browsing data – a good testbed for a new product.
  • www.hdfgroup.org2014 Summer ESIP Federation Meeting Future Work 10 Supplying command line options? Generalization of CLI services through Catalog? What other HDF services do you want to see? (e.g., GeoJSON)
  • www.hdfgroup.org2014 Summer ESIP Federation Meeting Acknowledgement 11 This work was supported by Subcontract number 114820 under Raytheon Contract number NNG10HP02C, funded by the National Aeronautics and Space Administration (NASA). Any opinions, findings, conclusions, or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of Raytheon or the National Aeronautics and Space Administration.