# ERA-5 products of 20240907-20240912 still incomplete **URL:** \ **Category:** Datasets and Usage\ **Tags:** era5\ **Created:** [17 September 2024 11:42 UTC](https://forum.ecmwf.int/t/era-5-products-of-20240907-20240912-still-incomplete/5655 "2024-09-17T11:42:35Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![Richard\_van\_Hees](https://forum.ecmwf.int/letter_avatar_proxy/v4/letter/r/ee59a6/32.png) [@Richard\_van\_Hees](https://forum.ecmwf.int/u/Richard_van_Hees)\ **Post date:** [17 September 2024 11:42 UTC](https://forum.ecmwf.int/t/era-5-products-of-20240907-20240912-still-incomplete/5655/1 "2024-09-17T11:42:35Z")
Hi, I have moved to the new CDS-beta without any serious problems. Thank you. However, I noticed that with the old interface I could download complete products with 5 days delay, now this has become 10 days. This is the request dictionary for the products: ```auto { "product_type": "reanalysis", "format": "grib", "variable": [ "100m_u_component_of_wind", "100m_v_component_of_wind", "10m_u_component_of_wind", "10m_v_component_of_wind", ], "year": f"{self.idate.year:04d}", "month": f"{self.idate.month:02d}", "day": f"{self.idate.day:02d}", "time": [f"{i:02d}:00" for i in range(24)], } ``` Then today I can download products of 2024-09-06 and older, but not products of 2024-09-07 until 2024-09-12. Is there a problem with the generation of these products? Greetings, Richard ---
**Author:** ![Kevin\_Marsh](https://forum.ecmwf.int/user_avatar/forum.ecmwf.int/kevin_marsh/32/368_2.png) [@Kevin\_Marsh](https://forum.ecmwf.int/u/Kevin_Marsh)\ **Post date:** [17 September 2024 16:01 UTC](https://forum.ecmwf.int/t/era-5-products-of-20240907-20240912-still-incomplete/5655/2 "2024-09-17T16:01:20Z")
Hi Richard, I can download ERA5 data for 10/9/2024 from CDS-Beta web and cds api: % more request\_latest.py import cdsapi dataset = “reanalysis-era5-single-levels” request = { ‘product\_type’: [‘reanalysis’], ‘variable’: [‘10m\_u\_component\_of\_wind’, ‘10m\_v\_component\_of\_wind’, ‘100m\_u\_component\_of\_wind’, ‘100m\_v\_component\_of\_wind’], ‘year’: [‘2024’], ‘month’: [‘09’], ‘day’: [‘10’], ‘time’: [‘00:00’, ‘01:00’, ‘02:00’, ‘03:00’, ‘04:00’, ‘05:00’, ‘06:00’, ‘07:00’, ‘08:00’, ‘09:00’, ‘10:00’, ‘11:00’, ‘12:00’, ‘13:00’, ‘14:00’, ‘15:00’, ‘16:00’, ‘17:00’, ‘18:00’, ‘19:00’, ‘20:00’, ‘21:00’, ‘22:00’, ‘23:00’], ‘data\_format’: ‘grib’, ‘download\_format’: ‘unarchived’ } client = cdsapi.Client() client.retrieve(dataset, request).download() gives % grib\_ls c92182e55d477834232b1e843e1c8345.grib c92182e55d477834232b1e843e1c8345.grib edition centre typeOfLevel level dataDate stepRange dataType shortName packingType gridType 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 10v grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100u grid\_simple regular\_ll 1 ecmf surface 0 20240910 0 an 100v grid\_simple regular\_ll 96 of 96 messages in c92182e55d477834232b1e843e1c8345.grib 96 of 96 total messages in 1 files I suspect you may be encountering the CDS cache issue: > [@How to avoid the CDS cache issue](https://prod.ecmwf-forum-prod.compute.cci2.ecmwf.int/t/how-to-avoid-the-cds-cache-issue/905): > > If a user runs exactly the same CDS API request several times, and the data from the first time the request is submitted is still in the CDS cache. then the same data are retrieved from the cache, rather than being re-extracted from the dataset. For datasets which are updated on a daily basis (such as ERA5T), this can cause issues, as the later request may not be returned the data as expected. To avoid this, we suggest users to add the keyword 'nocache' in their CDS API request, with a rando… ---
**Author:** ![Richard\_van\_Hees](https://forum.ecmwf.int/letter_avatar_proxy/v4/letter/r/ee59a6/32.png) [@Richard\_van\_Hees](https://forum.ecmwf.int/u/Richard_van_Hees)\ **Post date:** [18 September 2024 05:39 UTC](https://forum.ecmwf.int/t/era-5-products-of-20240907-20240912-still-incomplete/5655/3 "2024-09-18T05:39:03Z")
Hi Kevin, Many thanks for your help. I was not aware of the potential CDS cache issue. I run my script once a day, only when I try to debug my script I encounter this problem. I have added “nocache”: f"{random.randrange(1000):03d}" to the request, and my scripts downloads the products correctly. Greetings, Richard ---
**Author:** ![Matteo\_De\_Felice12](https://forum.ecmwf.int/user_avatar/forum.ecmwf.int/matteo_de_felice12/32/413_2.png) [@Matteo\_De\_Felice12](https://forum.ecmwf.int/u/Matteo_De_Felice12)\ **Post date:** [18 September 2024 06:56 UTC](https://forum.ecmwf.int/t/era-5-products-of-20240907-20240912-still-incomplete/5655/4 "2024-09-18T06:56:50Z")
Another good reason to start creating a proper documentation for the CDS API! ---
**Author:** ![Kevin\_Marsh](https://forum.ecmwf.int/user_avatar/forum.ecmwf.int/kevin_marsh/32/368_2.png) [@Kevin\_Marsh](https://forum.ecmwf.int/u/Kevin_Marsh)\ **Post date:** [18 September 2024 08:48 UTC](https://forum.ecmwf.int/t/era-5-products-of-20240907-20240912-still-incomplete/5655/5 "2024-09-18T08:48:13Z")
Glad to help, Richard! Glad it is working for you now!