Time to get request is becoming very high

Access and Login C3S - Access and Login
,
1

Hi

due to impossibility to connect from intranet to copernicus website I have to download many data from the website and I began with time to get data for each chunk of around 10minutes... Now I may have up to 10 hours to wait. Do you have some limits I have to respect?

Thanks in advance

Bruno

2

Hi Bruno,

if there are a lot of requests on the CDS, it can take longer for your request to be processed:

https://cds.climate.copernicus.eu/live/queue

you should also make sure your requests are structured efficiently. To retrieve data efficiently using the CDS API please have a look at the efficiency tips section on CDS documentation.

Thanks,

Kevin

3

Hi,

I am currently facing the same issue with the ERA5 hourly data on single levels from 1979 to present, even if by following the guidelines and dividing the requests in small chunks of data. 

Thanks in advance for your help,

Alexandre

4

Hi Alexandre

Can you share the request you are submitting?

(Note that request may be processed faster if they are submitted at 'quiet' times e.g. evenings/weekends)

Thanks,

Kevin

5

Hi Kevin,

Thanks for your reply. It went indeed much faster last night than yesterday. Here is the request I am submitting: 

c.retrieve(
        'reanalysis-era5-single-levels',
        {
            'product_type': 'reanalysis',
            'format': 'grib',
            'variable': '10m_u_component_of_wind',
            'year': year_str,
            'month': month_str,
            'time': [
                '00:00', '01:00', '02:00',
                '03:00', '04:00', '05:00',
                '06:00', '07:00', '08:00',
                '09:00', '10:00', '11:00',
                '12:00', '13:00', '14:00',
                '15:00', '16:00', '17:00',
                '18:00', '19:00', '20:00',
                '21:00', '22:00', '23:00',
            ],
            'day': day_str,
        },
        path_to_file)

Thanks,

Alexandre

6

Same issue here, trying to pull C3S data to NCEP as input to the seasonal outlooks.

This is a relatively small request, and it's been in queue for 20 minutes.   This was NOT a problem before the datacenter switch.

c = cdsapi.Client()

c.retrieve(

‘seasonal-monthly-single-levels’,

{

‘originating_centre’: ‘ukmo’,

‘system’: ‘600’,

‘variable’: ‘sea_surface_temperature’,

‘product_type’: ‘monthly_mean’,

‘year’: ‘2016’,

‘month’: ‘06’,

‘leadtime_month’: [

‘1’, ‘2’,

],

‘format’: ‘grib’,

},

‘download.grib’)

7

Hi Matthew,

I think there was an issue with the CDS connection to the archive which resulted in longer than expected processing times for some requests,

Thanks,

Kevin

8

it seems you solved this isssue. time got back to ~10mns (however sometimes it is slightly lonnger) and download bandwidth became largely correct. Thus case closed for me at least.

Thanks

Bruno

9

unhappily, I was wrong. My requests are now taking from 1 hour to 3 hours to complete.