Internal error when downloading data from era5-complete

This occurs when I try to download relative data from reanalysis-era5-complete. When I download the data for one day (e.g. 20240101), it works without problem. However, when I try to retrieve 1 month or more months, it failed and here is my request and the resulting mars errors.

2024-05-30 13:28:44,328 INFO Request is queued
2024-05-30 13:30:45,530 INFO Request is running
2024-05-30 13:32:46,666 INFO Request is failed
2024-05-30 13:32:46,666 ERROR Message: an internal error occurred processing your request
2024-05-30 13:32:46,666 ERROR Reason:
2024-05-30 13:32:46,666 ERROR Traceback (most recent call last):
2024-05-30 13:32:46,666 ERROR File “/opt/cdstoolbox/cdscompute/cdscompute/cdshandlers/services/handler.py”, line 59, in handle_request
2024-05-30 13:32:46,666 ERROR result = cached(context.method, proc, context, context.args, context.kwargs)
2024-05-30 13:32:46,666 ERROR File “/opt/cdstoolbox/cdscompute/cdscompute/caching.py”, line 108, in cached
2024-05-30 13:32:46,666 ERROR result = proc(context, *context.args, **context.kwargs)
2024-05-30 13:32:46,666 ERROR File “/opt/cdstoolbox/cdscompute/cdscompute/services.py”, line 124, in call
2024-05-30 13:32:46,666 ERROR return p(*args, **kwargs)
2024-05-30 13:32:46,666 ERROR File “/opt/cdstoolbox/cdscompute/cdscompute/services.py”, line 60, in call
2024-05-30 13:32:46,667 ERROR return self.proc(context, *args, **kwargs)
2024-05-30 13:32:46,667 ERROR File “/home/cds/cdsservices/services/mars/mars.py”, line 53, in external
2024-05-30 13:32:46,667 ERROR return mars(context, request, **kwargs)
2024-05-30 13:32:46,667 ERROR File “/home/cds/cdsservices/services/mars/mars.py”, line 20, in mars
2024-05-30 13:32:46,667 ERROR execute_mars(context, requests, info)
2024-05-30 13:32:46,667 ERROR File “/home/cds/cdsservices/services/mars/execute_mars.py”, line 74, in execute_mars
2024-05-30 13:32:46,667 ERROR raise Exception(error_lines)
2024-05-30 13:32:46,667 ERROR Exception
marsclass: EA
dataset: None
type: AN
levtype: ML
levelist: 1/to/137
repres:
date: 20230104/to/20230106
resol: 159
stream: OPER
area: 90.0/-179.0/-90.0/180.0
time: 00/03/06/09/12/15/18/21
step: 00
expver: 1
number: OFF
accuracy: 24
grid: 1.0/1.0
gaussian:
target: /data2/LitingHu/flex_extract/flex_extract_v7.1.2/Run/ERA5public01//ANOG__ML.20230104.213003.213004.grb
param: 130.128/133.128/131.128/132.128/077.128/246.128/247.128
target: /data2/LitingHu/flex_extract/flex_extract_v7.1.2/Run/ERA5public01//ANOG__ML.20230104.213003.213004.grb
RETRIEVE ERA5 WITH CDS API!

MARS Request failed!
an internal error occurred processing your request. .
Traceback (most recent call last):
File “/data2/LitingHu/flex_extract/flex_extract_v7.1.2/Source/Python/Classes/MarsRetrieval.py”, line 578, in data_retrieve
attrs, target)
File “/home/LitingHu/.local/lib/python3.6/site-packages/cdsapi/api.py”, line 381, in retrieve
result = self._api(“%s/resources/%s” % (self.url, name), request, “POST”)
File “/home/LitingHu/.local/lib/python3.6/site-packages/cdsapi/api.py”, line 538, in _api
% (reply[“error”].get(“message”), reply[“error”].get(“reason”))
Exception: an internal error occurred processing your request. .

Does somebody know what’s happening or what I can do?

Hi, Just want to chime in and tell that I’m getting same error, sometimes also “Request disappeared from running requests”. I hope this is just due to migration. I’ve also tried with exact same requests that were working 6 months ago.