Issue: CDS API with Python breaks when downloading several datasets

Joan_Saladich
Wed, 12 Feb 2025 09:31:41 +0000
C3S - Datasets and Usage

hi,

I am trying to download several years of CERRA with hourly observations. The script is use (I can’t share here unfortunately) works the following way:

For every month it downloads a single variable (eg. temperature) netCDF file.

This way I can guarantee files are small enough. The download works, but it always crashes after 20-30 netCDF files with the following traceback:

requests.exceptions.SSLError: HTTPSConnectionPool(host=‘cds.climate.copernicus.eu’, port=443): Max retries exceeded with url: /api/retrieve/v1/jobs/aca98c28-a120-4ddb-91cc-e29567d0c996?log=True&request=True (Caused by SSLError(SSLEOFError(8, ‘[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1000)’)))

The file the causes this break is generated in the C3S, as i can see by your GUI.

Could you help on this error? It bothers quite a lot to get random crashes

Thanks!

1 post - 1 participant