Downloader & cmorizer for NOAA GML surface flask trace gases

[jlenh]

Description

• Closes Add CMORized NOAA Global Monitoring Lab surface flask concentration measurements of trace gases (CH4, CO2, N2O) #3839
• Link to documentation:

This work adds a downloader and a formatter to ESMValTool to download and CMORize surface flask measurements of trace gases (CH4, CO2, and N2O) from the Global Monitoring Lab (GML) of NOAA. This work contributes to the ongoing development of a recipe and diagnostic to evaluate model output of surface concentrations of trace gases against the NOAA GML station measurements #3838.

The downloader retrieves event-based and monthly station averages of surface flask measurements of CH4, CO2 and N2O (see NOAA-GML) as an archive. Only the monthly averages of each station are CMORized here and are already computed following the methodology described on NOAA's GML website from the event-based files also present in the downloaded archive. The dataset archives are downloaded separately for each trace gas.

The formatter CMORizes the station monthly averages for a given trace gas by creating a NetCDF file containing all stations for which a location was available in the corresponding event files. The NetCDF file holds a time series for each station with the coordinates station_id, latitude and longitude. The general dataset architecture is taken from #3227 which implemented a CMORizer for time series of surface station observations. This allows the access to all stations data in a single file, speeding up loading times and processing operations. The general formatting functions are implemented in a separate file from which a single function is then imported and called in the respective trace gases formatter files.

Note: the CMORized variables produced here (ch4s, co2s, n2os) are not available in the CMOR table CMIP6 - Amon. However, in the case of model outputs, they need to be derived from their 3D counterparts (ch4, co2, n2o, see #2611) which are present in the corresponding CMOR table.

---

Before you get started

• ☝ Create an issue to discuss what you are going to do

Checklist

It is the responsibility of the author to make sure the pull request is ready to review. The icons indicate whether the item will be subject to the 🛠 Technical or 🧪 Scientific review.

• 🛠 This pull request has a descriptive title
• 🛠 Code is written according to the code quality guidelines
• 🛠 Documentation is available
• 🛠 Tests run successfully
• 🛠 The list of authors is up to date
• 🛠 Any changed dependencies have been added or removed correctly
• 🛠 All checks below this pull request were successful

New or updated data reformatting script

• 🛠 Documentation is available
• 🛠 The dataset has been added to the CMOR check recipe
• 🛠 The dataset has been added to the shared data pools of DKRZ and Jasmin by the @ESMValGroup/OBS-maintainers team
• 🧪 Numbers and units of the data look physically meaningful

[hb326]

Hey @jlenh,
is this ready for review? If yes, please change the status from "draft pull request" to normal "pull request". Thanks!

[jlenh]

Hey @jlenh, is this ready for review? If yes, please change the status from "draft pull request" to normal "pull request". Thanks!

I am still wondering if this should be included as is or if one could adapt the ESRL cmorizer mentioned in the related issue #3839. I haven't had the time to look into more detail but I think I can still adapt 2-3 things before this is ready for proper review.