Tc_h2o in CAMS cams-global-atmospheric-composition-forecasts doesn't work anymore

Datasets and Usage CAMS - Datasets and Usage
,
1

I systematically retrieve CAMS data that I update daily in my service.
However, from yesterday, the tc_h20 and h2o cannot be downloaded anymore.
I get different errors:

  1. For h2o
Could not retrieve data from CDS with {'time': ['00:00'], 'param': ['water_vapour_chemistry'], 'name': 'h2o', 'time_interval': 'PT3H', 'steps': ['0', '3', '6', '9', '12', '15', '18', '21', '24', '27', '30', '33', '36', '39', '42', '45', '48', '51', '54', '57', '60', '63', '66', '69', '72', '75', '78', '81', '84', '87', '90', '93', '96', '99', '102', '105', '108', '111', '114', '117', '120']}. Reason: 400 Client Error: Bad Request for url: https://ads.atmosphere.copernicus.eu/api/retrieve/v1/jobs/a919c29f-203d-44ff-8d7c-0dbd1228831a/results
The job has failed.
MARS has returned an error, please check your selection.
Request submitted to the MARS server:
[{'date': ['2024-11-19'], 'step': ['0', '3', '6', '9', '12', '15', '18', '21', '24', '27', '30', '33', '36', '39', '42', '45', '48', '51', '54', '57', '60', '63', '66', '69', '72', '75', '78', '81', '84', '87', '90', '93', '96', '99', '102', '105', '108', '111', '114', '117', '120'], 'levelist': ['1000', '925', '850', '700', '500', '300', '250', '200', '50'], 'time': ['00:00:00'], 'type': ['fc'], 'param': ['217059'], 'grid': ['0.4/0.4'], 'class': ['mc'], 'expect': ['off'], 'expver': ['0001'], 'number': ['all'], 'stream': ['oper'], 'levtype': ['pl'], 'database': ['cdsfdb/external']}]
Full error message:
mars - ERROR  - 20241119.095511 - Receive end of request from server without data. Retrying 1
mars - ERROR  - 20241119.095745 - Last error is -43
mars - ERROR  - 20241119.095745 - Expected 369, got 234.
mars - ERROR  - 20241119.095745 - Request failed
mars - ERROR  - 20241119.095745 - Some errors reported (last error -1)

The job failed with: MarsRuntimeError
  1. For the tc_h2o:
Recovering from connection error [HTTPSConnectionPool(host='ads.atmosphere.copernicus.eu', port=443): Max retries exceeded with url: /api/retrieve/v1/jobs/2b944c66-4eb9-4c7f-b982-983952a68900?log=True&request=True (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x7f08e1832fd0>, 'Connection to ads.atmosphere.copernicus.eu timed out. (connect timeout=60)'))], attemps 2 of 500 (http.py:487)

The counter of connection attempts restarts from 3 to 1 so that I have my pipeline stuck on that part. It is possible to set a maximum number of Connection trials? Why the counter restarts?

Most important, what happened to h2o and tc_h2o?

2

Hi Monica,

Your first issue is only to do with the time of day. The data is still in a state of being published at that time which can mean you get the error you’re seeing. If you try again later you should find it succeeds. We plan to improve this error message soon.

Your second issue is because the ADS (and CDS) are experiencing problems today (as can be seen by the orange colour for Data Stores on https://status.ecmwf.int). Analysts are working on the problem to try to restore normal service. Apologies for the inconvenience.

Luke.

1 Like
3

Thanks for the update!