Support for NPP/NPOESS by The HDF Group Mike Folk The HDF Group HDF and HDF-EOS Workshop XII October 17, 2008 Oct. 17 2008HDF and HDF-EOS Workshop XII1.

HDF and HDF-EOS Workshop XII 1

Support for NPP/NPOESS by The HDF Group

Mike Folk

The HDF Group

HDF and HDF-EOS Workshop XII

October 17, 2008

Oct. 17 2008

HDF and HDF-EOS Workshop XII 2

Goal

Oct. 17 2008

To develop and adapt HDF5 software and provide HDF5 support for NPP/NPOESS.

3HDF and HDF-EOS Workshop XII

NPOESS Priorities and HDF5

• Data calibration/validation• Data accessibility and usability• Tool development• System maintenance• User support

Oct. 17 2008

4HDF and HDF-EOS Workshop XII

Areas of immediate need

1. Ensure easy and intuitive access and use by diverse communities

2. Enable producers and consumers to view content, manage metadata, and convert data to other formats.

3. Provide high-quality, rapid-response support of HDF5 for NPOESS users at all levels.

Oct. 17 2008

HDF and HDF-EOS Workshop XII 5

1. Ensure easy and intuitive data access and use by

diverse communities

Oct. 17 2008

HDF and HDF-EOS Workshop XII 6

Region references

Oct. 17 2008

Root -/

Root - /

Data Array

Product Group Agg

Gran N

ReferenceObject

ReferenceRegion

ReferenceRegion

7HDF and HDF-EOS Workshop XII

New routines to facilitate data access

• Access data pointed to by region references - Retrieving data pointed to by region references

requires a series of complex function calls. - New API would encapsulate these into a few routines.

• Rewrite region references in datasets- When a dataset with region references is moved from

one file to another, the references of the datasets are invalid in the new file.

- The process of updating reference values is complex and error prone.

- New functions can address both of these concerns.

Oct. 17 2008

8HDF and HDF-EOS Workshop XII

• Access individual quality flags. - NPOESS quality flags are packed into an integer. - In HDF5, integer types are “atomic” – any I/O

operation access an entire integer.- To access individual NPOESS quality flags in a

convenient and consistent manner, routines are needed that can unpack and return individual quality flags represented by bits packed in an HDF5 integer.

Oct. 17 2008

HDF and HDF-EOS Workshop XII 9

2. Enable producers and consumers to view content,

manage metadata, and convert data to other formats.

Oct. 17 2008

10HDF and HDF-EOS Workshop XII

Tools enhancements

• There is interest in tools to view and export packed quality flag values, as well as data pointed to by region references.

• Tools of particular interest:- h5dump – a command line utility for dumping

information from an HDF5 file.- HDFView – a graphical tool for displaying and

editing the contents of HDF5 files.

Oct. 17 2008

11HDF and HDF-EOS Workshop XII

Tool enhancements

• H5dump modifications- Extract, display, and export a subset of packed

bits corresponding to NPOESS quality flags.- Extract, display, and export data pointed to by

region references.• HDFView modifications

- Display a rectangular region of data in a dataset corresponding to set of region references.

- Display packed bits corresponding to the NPOESS quality flags.

Oct. 17 2008

HDF and HDF-EOS Workshop XII 12

3. Provide high-quality, rapid-response support of HDF5 for NPOESS users at all levels.

Oct. 17 2008

13HDF and HDF-EOS Workshop XII

Support enhancements

• Assign high priority to helpdesk requests from the NPOESS user community, and ensure a one business-day response to all queries known to be NPOESS-related.

• Support HDF5 on AIX 5.2.

Oct. 17 2008

HDF and HDF-EOS Workshop XII 14

Thank You!

This report is based upon work to be supported by a Cooperative Agreement with NASA under NASA contract NNG08HZ14C. Any opinions, findings, and conclusions or

recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the

National Aeronautics and Space Administration.

Oct. 17 2008

HDF and HDF-EOS Workshop XII 15

Questions/comments?

Oct. 17 2008