Loading HDF5 Files

Global Mapper has definitions for over 80 different types of HDF5 file formats from various scientific projects including: 

• ASTER GED (Global Emissivity Database) Files (GDEM, emissivity, temperature, etc.)
• CMIP5 HDF5 data sets with sea surface temperatures
• NDVI (MODIS Normalized Difference Vegetation Index) HDF5 Files
• CORTAD (Coral Reef Temperature Anomaly) data
• Digital Bathymetric Database Variable Resolution (DBDB-V) files
• Cosmo-SkyMed SCS Radar Data
• VIIRS data
• CMIP5 HDF5
• Landsat Imagery, ESA CCI Soil Moisture, and Gravity Grids in HDF5/NetCDF
• NSIDC Ice Velocity Extraction (GoLIVE) data
• GMT 5 grid files
• NASA Greenland ice thickness data in HDF5/NetCDF
• National Snowfall Analysis HDF5 data grid
• Aquaveo mesh definition and simulation results HDF5 format files
• Copernicus Global Land Service (Valid data sets include LAI, FCOVER, FAPAR, LCCS, NDVI, SSM, GDMP, DMP, LST, LSWT)
• HEC-RAS plan HDF5 files (*.Pxx.HDF)to show 'Depth' and 'Water Surface' data
• GEBCO including HDF5 GEBCO 2019 and NETCDF GEBCO 2020

Additional HDF5 file formats can be custom added using the HDF5 Definition tool.

Import HDF5 File

If the definition of the HDF5 file matches the tables of one of the built in a definitions or a custom added one, the HDF5 file will load directly.

When multiple z values within the file have been defined, there will be a prompt to specify which value to load from the file:

Data with a 3rd Dimension

If the selected layer has multiple time slices in a 3rd dimension, there may also be a selection of the time slice, layer, or resolution to load:

Check individual time slices, or highlight multiple with the SHIFT key and then check one to check the highlighted times.

Undefined HDF5 Files

When the file does not match an existing HDF5 definition, the following dialog will appear:

Press Yes to bring up the HDF Definition Editor described below to create a new HDF5 definition.

Edit HDF5 Definition

The HDF5 Creator tool is used to create a definition for an HDF5 file so that Global Mapper will know how to open it. HDF5 is a standard for storing large amounts of data into a compressed set of tables. The structure of an HDF5 file is determined by the organization that generates the file. An organization may design the representation and storage of geolocated scientific data in many different ways, and within a single HDF5 file, there may be multiple data tables to choose from. The HDF5 Creator tool lets the user specify which tables to use. For more information see Requirements.

Open the HDF5 Creator from the Tools menu option HDF5 Definition Manager.... Or, when attempting to open an unrecognized HDF5 file, answer Yes to the prompt:
Unsupported HDF5 data set. Would you like to try to create a definition for this file?

Press the New...button to create a new HDF5 definition. The first step is to load a relevant file to use as a template to create the definition.

An existing definition can be edited by selecting the Edit... button and selecting from a list of user- created HDF5 definitions. Editing an existing definition without changing the description overwrites the previous definition, whereas a new description creates a new definition. This would be useful, for example, if the geolocation tables remained the same and only the data table was changed.

Use the Delete button to remove highlighted existing custom definitions.

Requirements

There are many ways to relate and store data using the HDF5 format, however, for Global Mapper, the file must have two grid-based geolocation (latitude and longitude) tables and one or more data tables representing a value at each location.

The dimensions of the geolocation tables must match the dimensions of the data table. Latitude and longitude tables can be either 1 or 2 dimensions. In the example above the data table (Soil_Moisture_Retrieval_Data/soil_moisture) is 1624 rows x 3856 columns, matching the size of the geographic tables. Table dimensions do not have to be square.

Latitude and longitude tables can be either 1 or 2 dimensions. One dimensional geographic tables imply that each row of data values corresponds to a single longitude, and each column to a single latitude. Two dimensional geographic tables imply that each data value corresponds to a single longitude and latitude pair. Data tables must be at least 2 dimensions.

Template and Tables

The Template field will list the name of the loaded template file. The list on the left shows all tables in the loaded template file.

Use the Filter text field to limit the tables and groups shown to those containing the text entered. The filter is case sensitive. This is useful when an HDF5 file contains many tables and groups, to limit the list to just those of interest.

The Show Groups checkbox will show or hide groups in the file. The structure of an HDF file is hierarchical with a structure like a computer filing system. Groups are similar to computer file folders. In an HDF5 file there is sometimes metadata attached to a group that may be of interest. While viewing groups and their metadata might be useful, it can also clutter up the list of tables, so the listing of groups can be toggled on or off. When shown, group names are displayed inside angle brackets.

The metadata and table Dimensions for the selected table will display on the bottom left. Metadata are additional information about the selected table. Dimensions are shown as number of rows by number of columns.

Definition

Definition Description is description of the HDF5 definition. It will show as an option when loading a file matching multiple data definitions, so typically help identify the Data (z) value being loaded.

The user selected table names for Latitude, Longitude, and Datashould be populated by dragging corresponding table names, or highlighting them in the list on the right and using the arrow buttons.

The Data Layer is an additional option when the z Data contains a 3rd Dimension (for data tables containing more than one third dimension). This is most often used to store data over various time slices. Select which layer to load, or uncheck the load layer option to provide a selection prompt each time the data is loaded. See Data with a 3rd Dimension for an example.

The Scale Factor and Offsetvalues will be applied to the data. These values are usually be found by looking at the data tables metadata. When imported into Global Mapper, data values are multiplied by the Scale Factor and the Offset is added to it.

Buttons to Save the current and Open an existing definition.

Attempting to open the HDF5 file Global Mapper will check if the file contains all three tables and if so open them and read and display the data.

Format Updates

Below is a summary of recent changes to HDF5 format support: