Generic Earth Observation Metadata Standard

GEOMS – Generic Earth Observation Metadata Standard ^[1] is a metadata standard used for archiving data from groundbased networks, like the Network for the Detection of Atmospheric Composition Change (NDACC),^[2] and for using this kind of data for the validation of NASA^[3] and ESA^[4] satellite data.

Introduction

The Generic Earth Observation Metadata Standard (GEOMS)^[5] outlines the metadata and data structure requirements developed to facilitate the use of geophysical datasets by improving their portability and accessibility, and by making their contents self-describing. This approach was originally selected to deal with atmospheric ^[6] and oceanographic datasets, but has been recently expanded to support all measurements from Earth observation instruments. The definitions have been carefully chosen to allow applicability to other scientific endeavors. GEOMS metadata and data structure requirements may be applied to any project where data are to be exchanged.

Motivation

For geophysical validation, independent observations are performed by a large number of in-situ, remote sensing, and satellite instruments for comparison with satellite based geophysical data products. To enhance the usability of the diverse correlative datasets collected for the EOS-Aura validation program ^[7] and the Envisat calibration and validation campaign (Cal/Val),^[8]^[9]^[10] metadata definitions, covering a broad range of instrument types and geophysical parameters, have been established. In support of these efforts, relational databases have been designed to store the metadata and to allow extensive quality assurance (QA) and quality control (QC) of the submitted files, while enabling easy data mining and retrieval of selected datasets. This development was initiated in 1998 through the European Commission (EC) project COSE, Compilation of Atmospheric Observations in Support of Satellite Measurements over Europe,^[11] and extended in collaboration with ESA, NASA, principal investigators (PI) of the Envisat and Aura validation campaign, and selected PIs from NDACC, for the implementation of a uniform data exchange standard.

Application

The current GEOMS guidelines describe the standard metadata definitions adopted for the correlative, experimental and model data archived for the EOS-Aura validation program, the Envisat calibration and validation efforts, data from NDACC, and the GECA project, which supports existing and future ESA calibration and validation programs.

The first application for earlier versions of GEOMS was the definition of metadata requirements for the calibration and validation activities of the Advanced Along Track Scanning Radiometer (AATSR), the Global Ozone Monitoring by Occultation of Stars (GOMOS), the MEdium Resolution Imaging Spectrometer (MERIS), the Michelson Interferometer for Passive Atmospheric Sounding (MIPAS) and the SCanning Imaging Absorption SpectroMeter for Atmospheric CHartographY (SCIAMACHY) sensors flying on the European Space Agency (ESA) Envisat platform.^[12] These metadata requirements are as well applied to the validation program of the National Aeronautics and Space Administration (NASA) Earth Observing System (EOS) Aura mission ^[13] carrying the High Resolution Dynamic Limb Sounder (HIRDLS), the Microwave Limb Sounder (MLS), the Ozone Monitoring Experiment (OMI) and the Tropospheric Emission Spectrometer (TES) atmospheric instruments. The scope of GEOMS has been broadened to NASA A-train satellite instruments, to data from the Network for the Detection of Atmospheric Composition Change (NDACC) and additional ESA Earth observation missions. The latter are supported by the Generic Environment for Calibration/Validation Analysis (GECA) project.

Supported Instruments

As of summer 2011 the GEOMS format has been completely defined via templates for the following instrument data:

OMI - Ozone monitoring instrument^[14] (selected datasets)
LIDAR - Light Detection And Ranging^[15]
MWR - Microwave radiometer^[16]
FTIR - Fourier Transform Infrared Spectroscopy^[17]
Radio occultation (RO) (selected datasets)
UVVIS.DOAS - UV/Vis Differential Optical Absorption Spectroscopy
Sondes (selected datasets)
Buoys (selected datasets)

^[5]

Implementation

In recent years, the Hierarchical Data Format^[18] has become the de facto satellite data exchange format for the ESA and the NASA Earth observation missions. HDF was originally developed by the National Center for Supercomputing Applications (NCSA) and is currently supported by the non-profit HDF Group. Next to HDF, another hierarchical data format, netCDF, is extensively used in Earth observation. The netCDF format is maintained by Unidata.^[19] To facilitate the validation of space borne measurements by correlative data from heterogeneous sources, the use of a common file format becomes a necessity. The metadata guidelines defined in this document are implemented using the HDF4, HDF5 or netCDF file formats, but are not limited to these formats. Special care must be given to the submission of files to GEOMS supporting data centers. Some data centers may not have native support to all discussed data formats.

Members

Currently, the GEOMS group consists of representatives of NASA, ESA, the NDACC and related universities and organizations. The GEOMS group invites interested persons to subscribe to the GEOMS email list.^[5]

References

^ Retscher, C., De Mazière, M., Meijer, Y., Vik, A.F., Boyd, I., Niemeijer, S., Koopman, R.M., Bojkov, B., The Generic Earth Observation Metadata Standard (GEOMS), 2011: (PDF document)
^ CPC NDACC Web Team (2018-11-14). "Network for the Detection of Atmospheric Composition Change (NDACC)". Ndsc.ncep.noaa.gov. Retrieved 2022-08-20.
^ "NASA". NASA. Archived from the original on 2022-04-23. Retrieved 2023-06-21.
^ "European Space Agency". Esa.int. Retrieved 2022-08-20.
^ ^a ^b ^c http://avdc.gsfc.nasa.gov/GEOMS ^{[bare URL]}
^ De Mazière, M., Van Roozendael, M., Bojkov, B.R., de la Noë, J., Mahieu, E., and Neuber, R., "Archiving of atmospheric data: Data formats and database", in IRS 2000: Current Problems in Atmospheric Radiation, W. L. Smith and Yu. M. Timofeyev (Eds.). A. Deepak Publishing, Hampton, Virginia. pp. 1019–1022, (2002)
^ Bojkov, B.R., Boyd, I., De Mazière, M., and Koopman, R.M., Addendum to the "Generic metadata guidelines on atmospheric and oceanographic datasets for the Envisat Calibration and Validation Project" as implemented by the Aura Validation Data Center (AVDC), (2006): (PDF document)
^ Bojkov, B.R., De Mazière, M., and Koopman, R.M., Generic metadata guidelines on atmospheric and oceanographic datasets for the Envisat Calibration and Validation Project, (2002): (PDF document)
^ Bojkov, B.R., Koopman, R.M., and De Mazière, M., "The Envisat Cal/Val Data Centre", presented at the NDSC 2001 Symposium – Celebrating 10 years of atmospheric research. September 24 – 27, 2001, Arcachon, France.
^ Koopman, R.M., Bojkov, B.R. and De Mazière, M, "The ENVISAT Cal/Val Data center", in Proceedings of the 2002 IEEE Geoscience and Remote Sensing Symposium (IGARSS) and the 24th Canadian Symposium on Remote Sensing, Toronto, Ontario. Published on CD-ROM, (2002)
^ De Mazière, M., "Final Report of the EC-COSE Project (contract ENV4-CT98-0750)", BIRA-IASB, Brussels, Belgium, (2001)
^ ESA, "Envisat - Caring for the Earth", European Space Agency, Paris, France, (2001)
^ Schoeberl, M.R., Douglass, A.R., Hilsenrath, E., Bhartia, P.K., Beer, R., Waters, J.W., Gunson, M.R., Froidevaux, L., Gille, J.C., Barnett, J.J., Levelt, P.F., and DeCola, P., "Overview of the EOS aura mission", in Geoscience and Remote Sensing, IEEE Transactions on, Volume 44, Issue 5, pp. 1066–1074, (2006), doi:10.1109/TGRS.2005.861950
^ ". . Aura ." aura.gsfc.nasa.gov. Archived from the original on 23 August 2011. Retrieved 13 January 2022.
^ "NDACC lidar working group - Welcome to NDACC lidar working group website!". Archived from the original on 2011-08-23. Retrieved 2011-08-23.
^ "NDACC - Microwave Group Homepage".
^ "NDACC - IRWG Homepage". www.acd.ucar.edu. Archived from the original on 23 March 2011. Retrieved 13 January 2022.
^ HDF Group – HDF home page: http://www.hdfgroup.org/
^ The Unidata netCDF data format: http://www.unidata.ucar.edu/software/netcdf/

External links

[geomspdf-1] Retscher, C., De Mazière, M., Meijer, Y., Vik, A.F., Boyd, I., Niemeijer, S., Koopman, R.M., Bojkov, B., The Generic Earth Observation Metadata Standard (GEOMS), 2011: (PDF document)

[2] CPC NDACC Web Team (2018-11-14). "Network for the Detection of Atmospheric Composition Change (NDACC)". Ndsc.ncep.noaa.gov. Retrieved 2022-08-20.

[3] "NASA". NASA. Archived from the original on 2022-04-23. Retrieved 2023-06-21.

[4] "European Space Agency". Esa.int. Retrieved 2022-08-20.

[GEOMS-5] ttp://avdc.gsfc.nasa.gov/GEOMS ^{[bare URL]}

[6] De Mazière, M., Van Roozendael, M., Bojkov, B.R., de la Noë, J., Mahieu, E., and Neuber, R., "Archiving of atmospheric data: Data formats and database", in IRS 2000: Current Problems in Atmospheric Radiation, W. L. Smith and Yu. M. Timofeyev (Eds.). A. Deepak Publishing, Hampton, Virginia. pp. 1019–1022, (2002)

[7] Bojkov, B.R., Boyd, I., De Mazière, M., and Koopman, R.M., Addendum to the "Generic metadata guidelines on atmospheric and oceanographic datasets for the Envisat Calibration and Validation Project" as implemented by the Aura Validation Data Center (AVDC), (2006): (PDF document)

[8] Bojkov, B.R., De Mazière, M., and Koopman, R.M., Generic metadata guidelines on atmospheric and oceanographic datasets for the Envisat Calibration and Validation Project, (2002): (PDF document)

[9] Bojkov, B.R., Koopman, R.M., and De Mazière, M., "The Envisat Cal/Val Data Centre", presented at the NDSC 2001 Symposium – Celebrating 10 years of atmospheric research. September 24 – 27, 2001, Arcachon, France.

[10] Koopman, R.M., Bojkov, B.R. and De Mazière, M, "The ENVISAT Cal/Val Data center", in Proceedings of the 2002 IEEE Geoscience and Remote Sensing Symposium (IGARSS) and the 24th Canadian Symposium on Remote Sensing, Toronto, Ontario. Published on CD-ROM, (2002)

[11] De Mazière, M., "Final Report of the EC-COSE Project (contract ENV4-CT98-0750)", BIRA-IASB, Brussels, Belgium, (2001)

[12] ESA, "Envisat - Caring for the Earth", European Space Agency, Paris, France, (2001)

[13] Schoeberl, M.R., Douglass, A.R., Hilsenrath, E., Bhartia, P.K., Beer, R., Waters, J.W., Gunson, M.R., Froidevaux, L., Gille, J.C., Barnett, J.J., Levelt, P.F., and DeCola, P., "Overview of the EOS aura mission", in Geoscience and Remote Sensing, IEEE Transactions on, Volume 44, Issue 5, pp. 1066–1074, (2006), doi:10.1109/TGRS.2005.861950

[14] ". . Aura ." aura.gsfc.nasa.gov. Archived from the original on 23 August 2011. Retrieved 13 January 2022.

[15] "NDACC lidar working group - Welcome to NDACC lidar working group website!". Archived from the original on 2011-08-23. Retrieved 2011-08-23.

[16] "NDACC - Microwave Group Homepage".

[17] "NDACC - IRWG Homepage". www.acd.ucar.edu. Archived from the original on 23 March 2011. Retrieved 13 January 2022.

[18] HDF Group – HDF home page: http://www.hdfgroup.org/

[19] The Unidata netCDF data format: http://www.unidata.ucar.edu/software/netcdf/

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[11]

[12]

[13]

[14]

[15]

[16]

[17]

[18]

[19]