Need help downloading globally ERA5-Land hourly/daily data faster (CDS too slow)

Datasets and Usage C3S - Datasets and Usage
1

Please, can anyone help me?

I’m trying to download ERA5-Land data (hourly and daily), but I’m facing serious issues. I have checked many sources, but I still haven’t been able to get the complete dataset.

I tried downloading from the Climate Data Store (CDS), but it is extremely slow. I’ve been downloading for the last 3 days, and I’ve only managed to get about 5 years of data :sob:
I even wrote scripts to download all years automatically, but still only around five years of data were downloaded.

Another problem is that it doesn’t allow downloading all years at once. For example, I can only download small chunks like one month (e.g., January 1950), then I have to repeat the process again and again.

Can anyone recommend a reliable and faster source where I can download ERA5-Land hourly or daily data more efficiently?

Any help would be really appreciated!

2

I am currently facing the same issue, I need ERA5-Land data covering large areas(17 countries) for 5 variables on daily basis but download process is sooo slow. @Bacha_khan did you find a way out?

3

One of the design failures is, you get null values for the locations not on land. I think I’ll be a month busy to find out what are the land locations. Could someone please provide a file with only the locations that give valid data. Thank You.

4

Hi Robert,
The ERA5-Land land-sea mask is available under “Invariants” from the CDS download page at:

Hope that helps,
Kevin

5

Hi Bacha, did you manage to figure out a way to download your data faster? I am currently facing a similar issue and was wondering if I have to continue obtaining data the way I am doing now or if there is a faster way to do so…The approval of my datasets is taking a lot of time the more data requests I submit. Hope to hear a reply soon!

Thanks, Navii

6

Hello, facing the same issues here. More than 4 hours to retrieve 30 Mb of data is quite slow.. :confused: I feel like it’s the queues that is too long. Tried Parallelising and do 10 requests at a time but does not seem to work. Please reach out to me if you found a solution. Thanks!

7

Hi Alexis,

I did manage to contact them and they let me know there is no solution, so now I have put in about 20 requests each day and keep track of which turns green to download (usually after a day?). I had no idea they expire after download so do keep an eye out for that if you haven’t. On my side, the requests have been downloading fast but nevertheless some take a while (some are still not green after like five days). Good luck!

Best,

Navii

8

I get back at least 1 request / min, but it can also be 20. The request is all parameters for 1 lat/lon. 28 000 rows.