• Share
  • Email
  • Embed
  • Like
  • Private Content
HDF-EOS Datablade: Efficiently Serving Earth Science Data
 

HDF-EOS Datablade: Efficiently Serving Earth Science Data

on

  • 143 views

HDF AND HDF-EOS WORKSHOP II (1998)

HDF AND HDF-EOS WORKSHOP II (1998)

Statistics

Views

Total Views
143
Views on SlideShare
135
Embed Views
8

Actions

Likes
0
Downloads
0
Comments
0

3 Embeds 8

http://hdfeos.org 5
http://localhost 2
http://www.hdfeos.org 1

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • &lt;number&gt; <br />
  • &lt;number&gt; <br />
  • Features of the HDFEOS Datablade Software Architecture <br /> The HDF-EOS library, although non-reentrant, still runs unchanged in the database, with no code modifications. <br /> The File-I/O-Emulator (FIOE) catches HDF-EOS I/O calls, and is optimized to handle subsetting I/O patterns. Potential to optimize for other patterns as well. <br /> The FIOE allows us to manage the data inside the database, or allow visibility to the data outside. User is not forced into one world or the other. Advantage of putting it inside is that you get extra safety features such as transaction management and recovery. Legacy science software can continue to run on the data if left outside. <br /> Can expose valuable indexable data inside the database as necessary. (Vdata example) <br /> So how does this architecture perform?…. <br />
  • This picture goes with demo #2. <br />

HDF-EOS Datablade: Efficiently Serving Earth Science Data HDF-EOS Datablade: Efficiently Serving Earth Science Data Presentation Transcript

  • HDF-EOS Datablade: Efficiently Serving Earth Science Data http://heineken.gsfc.nasa.gov/hdfeos/
  • What is a Datablade? Image HDF-EOS Spatial DataBlade API Text Web Extending the server by adding DataBlades: new Types and new functions Extensible OR Engine Scaleable Data Manager INFORMIX-Universal Server http://heineken.gsfc.nasa.gov/hdfeos/
  • What does the HDF-EOS Datablade provide? • Inventory management of large volume data and metadata • Flexible access to the data as a file or BinaryLarge-Object inside the database. • Cross-granule searching and subsetting • Re-use other datablades such as spatial search tools from Informix • Implements Grid subsetting operations in the Database http://heineken.gsfc.nasa.gov/hdfeos/
  • Plans for the Second Year • • • • Implement Swath, Point, HDF datatypes General subsetting tool: stored queries Metadata search and query tools Implement MISR Quality-Assessment database http://heineken.gsfc.nasa.gov/hdfeos/
  • HDF-EOS Datablade Software Architecture Informix DB SQL SQL InterInterface face and API HDF-EOS C library (Unchanged) Valuable Data Exposed in Searchable Tables File I/O Emulator http://heineken.gsfc.nasa.gov/hdfeos/ Granules in File System Granules in Informix
  • Overlapping Granule Scenario Latitude 90 80 70 60 50 40 30 20 10 Subset: Lat: 65 to 75 Lon: 15 to 25 0 1 2 3 4 10 30 50 70 90 Longitude http://heineken.gsfc.nasa.gov/hdfeos/
  • Overlapping Granule Scenario Latitude 90 80 70 60 50 40 30 20 10 Subset: Lat: 65 to 75 Lon: 15 to 25 0 1 2 3 4 10 30 50 70 90 Longitude http://heineken.gsfc.nasa.gov/hdfeos/