0
HDF-EOS Datablade:
Efficiently Serving Earth Science Data

http://heineken.gsfc.nasa.gov/hdfeos/
What is a Datablade?
Image
HDF-EOS

Spatial

DataBlade API

Text

Web

Extending the server by
adding DataBlades: new Type...
What does the HDF-EOS Datablade
provide?
• Inventory management of large volume data and
metadata
• Flexible access to the...
Plans for the Second Year
•
•
•
•

Implement Swath, Point, HDF datatypes
General subsetting tool: stored queries
Metadata ...
HDF-EOS Datablade Software Architecture
Informix DB

SQL
SQL
InterInterface
face
and
API

HDF-EOS
C library
(Unchanged)

V...
Overlapping Granule Scenario

Latitude

90
80
70
60
50
40
30
20
10

Subset: Lat: 65 to 75
Lon: 15 to 25

0
1
2
3
4
10

30
...
Overlapping Granule Scenario

Latitude

90
80
70
60
50
40
30
20
10

Subset: Lat: 65 to 75
Lon: 15 to 25

0
1
2
3
4
10

30
...
Upcoming SlideShare
Loading in...5
×

HDF-EOS Datablade: Efficiently Serving Earth Science Data

178

Published on

HDF AND HDF-EOS WORKSHOP II (1998)

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
178
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
1
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • <number>
  • <number>
  • Features of the HDFEOS Datablade Software Architecture
    The HDF-EOS library, although non-reentrant, still runs unchanged in the database, with no code modifications.
    The File-I/O-Emulator (FIOE) catches HDF-EOS I/O calls, and is optimized to handle subsetting I/O patterns. Potential to optimize for other patterns as well.
    The FIOE allows us to manage the data inside the database, or allow visibility to the data outside. User is not forced into one world or the other. Advantage of putting it inside is that you get extra safety features such as transaction management and recovery. Legacy science software can continue to run on the data if left outside.
    Can expose valuable indexable data inside the database as necessary. (Vdata example)
    So how does this architecture perform?….
  • This picture goes with demo #2.
  • Transcript of "HDF-EOS Datablade: Efficiently Serving Earth Science Data"

    1. 1. HDF-EOS Datablade: Efficiently Serving Earth Science Data http://heineken.gsfc.nasa.gov/hdfeos/
    2. 2. What is a Datablade? Image HDF-EOS Spatial DataBlade API Text Web Extending the server by adding DataBlades: new Types and new functions Extensible OR Engine Scaleable Data Manager INFORMIX-Universal Server http://heineken.gsfc.nasa.gov/hdfeos/
    3. 3. What does the HDF-EOS Datablade provide? • Inventory management of large volume data and metadata • Flexible access to the data as a file or BinaryLarge-Object inside the database. • Cross-granule searching and subsetting • Re-use other datablades such as spatial search tools from Informix • Implements Grid subsetting operations in the Database http://heineken.gsfc.nasa.gov/hdfeos/
    4. 4. Plans for the Second Year • • • • Implement Swath, Point, HDF datatypes General subsetting tool: stored queries Metadata search and query tools Implement MISR Quality-Assessment database http://heineken.gsfc.nasa.gov/hdfeos/
    5. 5. HDF-EOS Datablade Software Architecture Informix DB SQL SQL InterInterface face and API HDF-EOS C library (Unchanged) Valuable Data Exposed in Searchable Tables File I/O Emulator http://heineken.gsfc.nasa.gov/hdfeos/ Granules in File System Granules in Informix
    6. 6. Overlapping Granule Scenario Latitude 90 80 70 60 50 40 30 20 10 Subset: Lat: 65 to 75 Lon: 15 to 25 0 1 2 3 4 10 30 50 70 90 Longitude http://heineken.gsfc.nasa.gov/hdfeos/
    7. 7. Overlapping Granule Scenario Latitude 90 80 70 60 50 40 30 20 10 Subset: Lat: 65 to 75 Lon: 15 to 25 0 1 2 3 4 10 30 50 70 90 Longitude http://heineken.gsfc.nasa.gov/hdfeos/
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×