Checksums for request

,

Hi,
sometimes data on CDS gets updated with fixes and/or the variables change names (such as the upgrade from netcdf3 to netcdf4).

I would like to know that the data I have downloaded is up-to-date, without having to download everything again. In other words, I would like to confirm that issuing the exact same request gives me the exact same data that I downloaded previously.

Some ideas of what that could look like:

  • an API endpoint that, instead of preparing data for the request, returns a checksum for the data returned by the request.
    or
  • an API endpoint that, instead of preparing data for the request, returns some sort of ID that is a combination of the underlying data being requested/exact conversion software version (grib → netcdf)/etc. This ID would have to be part of the downloaded data grib/netcdf file as an attribute.

That way I can make sure that data I already have downloaded is up-to-date, and update any that are, and make sure that data has been downloaded in a reproducible manner.

I hope that makes sense
Thanks!

Kind regards
Peter

1 Like