1July 8 – 11, 2014
HDF and
Augmentation
Mike Folk
The HDF Group
ESIP 2014
www.hdfgroup.orgESIP Summer MeetingJuly 8 – 11, 2014 2
*
*shoes that remove
ice and snow
www.hdfgroup.orgESIP Summer MeetingJuly 8 – 11, 2014 3
*
*shoes that remove
ice and snow
Augment:
Add to, amplify, extend,...
www.hdfgroup.orgESIP Summer Meeting
Augmentation
An HDF design philosophy
July 8 – 11, 2014 4
www.hdfgroup.orgESIP Summer Meeting
Why we augment
July 8 – 11, 2014 5
• Serve intended purpose better.
• Whole new purpos...
www.hdfgroup.orgESIP Summer Meeting
HDF augmentation
• Preserve the original use
• Add needed extra information
• Rename t...
July 8 – 11, 2014 7
AUGMENTING
HDF-EOS5 FILES
FOR NETCDF-4
ACCESS
www.hdfgroup.orgESIP Summer Meeting
HDF5
HDF-EOS5
HDF-EOS5
file
netCDF4 to access HDF-EOS5 files
• HDF-EOS5 uses HDF5 as
i...
www.hdfgroup.orgESIP Summer Meeting
HDF5
HDF-EOS5
HDF-EOS5
file HDF5
NetCDF4
NetCDF-4
file
netCDF4 to access HDF-EOS5 file...
www.hdfgroup.orgESIP Summer Meeting
HDF5
HDF-EOS5
HDF-EOS5
file HDF5
NetCDF4
NetCDF-4
file
Augmented
HDF-EOS5
file
netCDF4...
July 8 – 11, 2014 11
H5AUGJPSS
www.hdfgroup.orgESIP Summer Meeting
IDV
• IDV
• Based on netCDF classic model (no groups)
• IDV required attributes and va...
www.hdfgroup.orgESIP Summer Meeting
H5augjpss will …
• Make a JPSS HDF5 file look like netCDF-4
• Hide HDF5 elements not s...
HDF4 FILE CONTENT MAPS
www.hdfgroup.orgESIP Summer Meeting
HDF4 File Contents – User View
July 8 – 11, 2014 15
www.hdfgroup.orgESIP Summer Meeting
HDF4 File Contents – User View
Objects & Relationships
July 8 – 11, 2014 16
www.hdfgroup.orgESIP Summer Meeting
HDF4 File Contents – User View
User Metadata
July 8 – 11, 2014 17
www.hdfgroup.orgESIP Summer Meeting
HDF4 File Contents – User View
Object Data
July 8 – 11, 2014 18
www.hdfgroup.orgESIP Summer Meeting
HDF4 files are complex
July 8 – 11, 2014 19
www.hdfgroup.orgESIP Summer Meeting
Project Motivation
HDF4 file
HDF4
Library
HDFView
www.hdfgroup.orgESIP Summer Meeting
Project Motivation
HDF4 file
HDF4
Library
HDFView
X
www.hdfgroup.orgESIP Summer Meeting
HDF4 mapping workflow
HDF4 File
HDF4 Mapping File
(XML document)
hmap
linked with
HDF4...
www.hdfgroup.orgESIP Summer Meeting
HDF4 mapping workflow
HDF4 File
HDF4 Mapping File
(XML document)
hmap
linked with
HDF4...
July 8 – 11, 2014 24
Upcoming SlideShare
Loading in...5
×

HDF and Augmentation

329

Published on

HDF and HDF-EOS Workshop XVII (2014)
Mike Folk

Published in: Technology, Art & Photos
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
329
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

HDF and Augmentation

  1. 1. 1July 8 – 11, 2014 HDF and Augmentation Mike Folk The HDF Group ESIP 2014
  2. 2. www.hdfgroup.orgESIP Summer MeetingJuly 8 – 11, 2014 2 * *shoes that remove ice and snow
  3. 3. www.hdfgroup.orgESIP Summer MeetingJuly 8 – 11, 2014 3 * *shoes that remove ice and snow Augment: Add to, amplify, extend, enhance. thesaurus.com
  4. 4. www.hdfgroup.orgESIP Summer Meeting Augmentation An HDF design philosophy July 8 – 11, 2014 4
  5. 5. www.hdfgroup.orgESIP Summer Meeting Why we augment July 8 – 11, 2014 5 • Serve intended purpose better. • Whole new purpose. • Available to new tools and applications • More “standard,” hence more widely accessible. • Preservation
  6. 6. www.hdfgroup.orgESIP Summer Meeting HDF augmentation • Preserve the original use • Add needed extra information • Rename things • Move things around • Reduce complexity • Hide things July 8 – 11, 2014 6
  7. 7. July 8 – 11, 2014 7 AUGMENTING HDF-EOS5 FILES FOR NETCDF-4 ACCESS
  8. 8. www.hdfgroup.orgESIP Summer Meeting HDF5 HDF-EOS5 HDF-EOS5 file netCDF4 to access HDF-EOS5 files • HDF-EOS5 uses HDF5 as its storage layer • Adds EOS structural and content metadata July 8 – 11, 2014 8
  9. 9. www.hdfgroup.orgESIP Summer Meeting HDF5 HDF-EOS5 HDF-EOS5 file HDF5 NetCDF4 NetCDF-4 file netCDF4 to access HDF-EOS5 files • netCDF-4 uses HDF5 as its storage layer • Adds netCDF-4 structural and content metadata July 8 – 11, 2014 9
  10. 10. www.hdfgroup.orgESIP Summer Meeting HDF5 HDF-EOS5 HDF-EOS5 file HDF5 NetCDF4 NetCDF-4 file Augmented HDF-EOS5 file netCDF4 to access HDF-EOS5 files • netCDF-4 metadata added to HDF-EOS5 file • EOS5 use not affected. July 8 – 11, 2014 10
  11. 11. July 8 – 11, 2014 11 H5AUGJPSS
  12. 12. www.hdfgroup.orgESIP Summer Meeting IDV • IDV • Based on netCDF classic model (no groups) • IDV required attributes and variables • Scale factors, offsets • Geolocation metadata • “Radiance” variable July 8 – 11, 2014 12
  13. 13. www.hdfgroup.orgESIP Summer Meeting H5augjpss will … • Make a JPSS HDF5 file look like netCDF-4 • Hide HDF5 elements not supported by netCDF • Add coordinate variables • Remove groups from view to conform to netCDF classic • Add information needed by tools such as IDV • Geolocation metadata • “Radiance” variable July 8 – 11, 2014 13
  14. 14. HDF4 FILE CONTENT MAPS
  15. 15. www.hdfgroup.orgESIP Summer Meeting HDF4 File Contents – User View July 8 – 11, 2014 15
  16. 16. www.hdfgroup.orgESIP Summer Meeting HDF4 File Contents – User View Objects & Relationships July 8 – 11, 2014 16
  17. 17. www.hdfgroup.orgESIP Summer Meeting HDF4 File Contents – User View User Metadata July 8 – 11, 2014 17
  18. 18. www.hdfgroup.orgESIP Summer Meeting HDF4 File Contents – User View Object Data July 8 – 11, 2014 18
  19. 19. www.hdfgroup.orgESIP Summer Meeting HDF4 files are complex July 8 – 11, 2014 19
  20. 20. www.hdfgroup.orgESIP Summer Meeting Project Motivation HDF4 file HDF4 Library HDFView
  21. 21. www.hdfgroup.orgESIP Summer Meeting Project Motivation HDF4 file HDF4 Library HDFView X
  22. 22. www.hdfgroup.orgESIP Summer Meeting HDF4 mapping workflow HDF4 File HDF4 Mapping File (XML document) hmap linked with HDF4 library July 8 – 11, 2014 22
  23. 23. www.hdfgroup.orgESIP Summer Meeting HDF4 mapping workflow HDF4 File HDF4 Mapping File (XML document) hmap linked with HDF4 library Reader program Object Data Groups, Data Objects, Structural and Application Metadata; Locations of Object Data July 8 – 11, 2014 23
  24. 24. July 8 – 11, 2014 24
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×