MarsRuntimeError when downloading specific dates from reanalysis-era5-complete. Are these dates available or is there something that I am missing in my request?
The specific missing dates from July until Today (19th Sept)
2024-07-04
2024-07-29
2024-07-30
2024-07-31
2024-08-01
2024-08-04
2024-09-02
2024-09-04
2024-09-09
- Failing using both the old cds and new cds-beta
- I have tried using a newly created account with different url and keys
- I have nocache enabled
- I can successfully download the data for the days in between the above dates
- I am usually trying to run the cds query for a day at a time but when I tried to run for 3 days with one of the problematic days in the middle (i.e. “date”: “2024-07-03/to/2024-07-05”) the request fails with the same error
- I was successfully able to download the data for these files last week
- I am using cdsapi==0.7.2
Example request:
import cdsapi
import random
cds = cdsapi.Client()
dataset = "reanalysis-era5-complete"
cds_request = {
"class": "ea",
"date": "2024-07-04",
"expver": "1",
"levtype": "sfc",
"param": "167.128",
"stream": "oper",
"time": "00/to/23/by/1",
"type": "an",
"grid": "N320",
"nocache": f"{random.randrange(1000):03d}"
}
cds_response = cds.retrieve(
"reanalysis-era5-complete", cds_request, "era_5.grb"
)
Example API ERROR
response = <Response [400]>
def cads_raise_for_status(response: requests.Response) -> None:
if 400 <= response.status_code < 500:
try:
error_json = response.json()
except Exception:
pass
else:
message = "\n".join(
[
f"{response.status_code} Client Error: {response.reason} for url: {response.url}",
error_json_to_message(error_json),
]
)
> raise requests.exceptions.HTTPError(message, response=response)
E requests.exceptions.HTTPError: 400 Client Error: Bad Request for url: https://cds-beta.climate.copernicus.eu/api/retrieve/v1/jobs/9e108f1e-ca9a-48ec-a533-1abc6a7f0799/results
E The job has failed.
E MARS has returned an error, please check your selection.
E Request submitted to the MARS server:
E [{'class': ['ea'], 'date': '2024-07-04', 'expver': ['1'], 'grid': 'N320', 'levtype': 'sfc', 'nocache': '088', 'param': '167.128', 'stream': 'oper', 'time': '00/to/23/by/1', 'type': 'an', 'database': 'fdbmarser'}]
E Full error message:
E mars - ERROR - 20240919.142127 - Expected 24, got 0.
E mars - ERROR - 20240919.142127 - Request failed
E mars - ERROR - 20240919.142127 - Some errors reported (last error -1)
E
E The job failed with: MarsRuntimeError
Example error from CDS Requests page
MARS has returned an error, please check your selection.
Request submitted to the MARS server:
[{'class': ['ea'], 'date': '2024-07-04', 'expver': ['1'], 'grid': 'N320', 'levtype': 'sfc', 'nocache': '088', 'param': '167.128', 'stream': 'oper', 'time': '00/to/23/by/1', 'type': 'an', 'database': 'fdbmarser'}]
Full error message:
mars - ERROR - 20240919.142127 - Expected 24, got 0.
mars - ERROR - 20240919.142127 - Request failed
mars - ERROR - 20240919.142127 - Some errors reported (last error -1)