I have downloaded one month of data using the API as well as the Web Interface in two different accounts. In both cases, I cannot unzip the downloaded zip file. I have tried this in three computers (Windows, MacOS and Linux). Some months ago, I had no problems.
When unzipping I receive always an error message that indicates that the zip file is not a zip file. Here an example:
Archive: 3dd89c3040020710fe49455087edb4d4.zip
End-of-central-directory signature not found. Either this file is not
a zipfile, or it constitutes one disk of a multi-part archive. In the
latter case the central directory and zipfile comment will be found on
the last disk(s) of this archive.
unzip: cannot find zipfile directory in one of 3dd89c3040020710fe49455087edb4d4.zip or
3dd89c3040020710fe49455087edb4d4.zip.zip, and cannot find 3dd89c3040020710fe49455087edb4d4.zip.ZIP, period.
If I try to unzip it with Python zipfile package, I get a BadZipFile exception.
I tested in the Windows machine with 7zip and it can uncompress the file but shows that there is an unexpected end-of-file and that there is a data error.
Another colleague tried to open the netcdf files coming from different requests, one for CO2 and another CH4. In the methane case, she was successful to open it and plot something. In the other case, she received a netCDF HDF error. Apparently, the file is corrupted.
There is a problem with the file compression process on the server side and this error is breaking our workflow to ingest the inversion-optimised product, as we use the Python zipfile package to automatise the decompression. In case the problem with the decompression is solved from our side, the integrity of the netCDF file is not assured.
Unfortunately we’ve been hit by a bug in an underlying library that has corrupted some of our dynamically constructed output files. It only affects files of certain sizes, hence why the majority of requests still work. We’re applying a fix now and you should find your request works again within an hour or two.
Hello, I’m unable to open few netcdf files with panoply or python (xarray) even though I download them with the datastore.
For exemple I can’t open the 2m temperature of April 2000. But it’s working for January 2000.
Here is the panoply error message : There was an error opening the dataset: Unable to acquire dataset in either enhanced or unenhanced mode.
I’d like to know if this has been resolved in today’s patch?
The release is being rolled out right now. If your request doesn’t already give a valid file, it should do within the next hour. That is, if it’s caused by the same problem.
I have had similar issues with recently downloaded data and I am wondering, if I am affected by the same issue. I did notice, that my downloaded files appear to be in grib format, but trying to open them with xarray and cfgrib also raises errors about an unsupported Edition. Is that related, or another issue?
It affected all requests from any dataset from approximately Oct 30 10:00 UTC until Nov 6 17:00 UTC, so possibly. Files whose sizes were in certain very specific, narrow ranges may have been truncated. If you have an error opening a file and it was downloaded in this period, it’s worth downloading it again to see if this was the cause.
