# Informative page in readiness for new CDS-beta!

**URL:** <https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985>\
**Category:** C3S - Announcements\
**Tags:** c3s\
**Created:** [10 June 2024 14:44 UTC](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985 "2024-06-10T14:44:37Z")\
**Posts on this page:** 20\
**Page:** 2

<div class="post-metadata">

**Author:** ![Fergus\_Keatinge](https://forum.ecmwf.int/letter_avatar_proxy/v4/letter/f/7ea924/32.png) [@Fergus\_Keatinge](https://forum.ecmwf.int/u/Fergus_Keatinge)\
**Post date:** [9 August 2024 14:18 UTC](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985/21 "2024-08-09T14:18:49Z")

</div>

What is the time period after a data request that is successful expires?

---

<div class="post-metadata">

**Author:** ![Karsten\_Bolding](https://forum.ecmwf.int/letter_avatar_proxy/v4/letter/k/ad7895/32.png) [@Karsten\_Bolding](https://forum.ecmwf.int/u/Karsten_Bolding)\
**Post date:** [14 August 2024 14:27 UTC](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985/22 "2024-08-14T14:27:28Z")

</div>

Hi

Don’t know if this is the right place …

I’ve done the transition and can use the scripts we used before - but - the format of the downloaded NetCDF file is quite different from the old one.

I can see that the version of the grib to NetCDF program has been changed: fromgrib\_to\_netcdf-2.28.1 to cfgrib-0.9.14.0/ecCodes-2.36.0 .

This has a least the following impacts:

1. The time units changed from “hours since 1900-01-01 00:00:00.0” to “seconds since 1970-01-01”
2. The coordinate attribute of variables changed from not being included to string u10:coordinates = “number valid\_time latitude longitude expver”

The first point might be solved by libraries - but xarray chokes on the latter as the variables are defined by 3 dimensions e.g. float u10(valid\_time, latitude, longitude) - similar to the old version (but with different naming).  
Should the coordinates attribute and the number of dimensions not agree?

Reading the new version with xarray results in:  
…/python3.12/site-packages/xarray/core/concat.py  
xarray.core.merge.MergeError: conflicting values for variable ‘expver’ on objects to be combined. You can skip this check by specifying compat=‘override’.

if I try specifying compat=‘override’ I get:  
numpy.\_core.\_exceptions.\_ArrayMemoryError: Unable to allocate 27.5 GiB for an array with shape (17544, 3, 2, 35066) and data type float64

where the shape somehow does not at all match the field I want to read.

Am I missing something? Using a wrong version or?

Best regards,  
Karsten

---

<div class="post-metadata">

**Author:** ![Joao\_Macalos](https://forum.ecmwf.int/letter_avatar_proxy/v4/letter/j/7ab992/32.png) [@Joao\_Macalos](https://forum.ecmwf.int/u/Joao_Macalos)\
**Post date:** [16 August 2024 08:50 UTC](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985/23 "2024-08-16T08:50:46Z")

</div>

Hi @Anabelle , it certainly helps! Do you know if the feature will be available before the discontinuation of the current API and toolbox? otherwise I’ll have to find a temporary solution…

Best,  
Joao

---

<div class="post-metadata">

**Author:** ![Fergus\_Keatinge](https://forum.ecmwf.int/letter_avatar_proxy/v4/letter/f/7ea924/32.png) [@Fergus\_Keatinge](https://forum.ecmwf.int/u/Fergus_Keatinge)\
**Post date:** [16 August 2024 15:07 UTC](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985/24 "2024-08-16T15:07:42Z")

</div>

They deployed a new .netcdf builder and it seems to have a bunch of problems (or differences). We’ve switched to the .grib, seems more stable.

---

<div class="post-metadata">

**Author:** ![Anusha\_T\_S](https://forum.ecmwf.int/letter_avatar_proxy/v4/letter/a/ac91a4/32.png) [@Anusha\_T\_S](https://forum.ecmwf.int/u/Anusha_T_S)\
**Post date:** [19 August 2024 06:49 UTC](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985/25 "2024-08-19T06:49:07Z")

</div>

Hi @Anabelle ,  
I don’t find any api key or url in my beta login. How do i create the .cdsapirc file? The installation documentation addresses the older version. I am confused.

---

<div class="post-metadata">

**Author:** ![Nicolas\_Seiller](https://forum.ecmwf.int/letter_avatar_proxy/v4/letter/n/edb3f5/32.png) [@Nicolas\_Seiller](https://forum.ecmwf.int/u/Nicolas_Seiller)\
**Post date:** [20 August 2024 15:30 UTC](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985/26 "2024-08-20T15:30:35Z")

</div>

Hello @Anabelle, I am doing the same observation, is that the expected behaviour ? Is this the new standard for the data format ? Is it going to change any further ? Is it documented somewhere ?

---

<div class="post-metadata">

**Author:** ![COG\_Data](https://forum.ecmwf.int/letter_avatar_proxy/v4/letter/c/71c47a/32.png) [@COG\_Data](https://forum.ecmwf.int/u/COG_Data)\
**Post date:** [23 August 2024 17:13 UTC](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985/27 "2024-08-23T17:13:30Z")

</div>

I noticed the same. Also @Anabelle I’ve noticed that the same request with the new api is rounding the metric result to 4 decimal places whereas with the old api I get the full amount of decimal places. How can I switch this off/change this?

---

<div class="post-metadata">

**Author:** ![Victor\_Borda](https://forum.ecmwf.int/letter_avatar_proxy/v4/letter/v/958977/32.png) [@Victor\_Borda](https://forum.ecmwf.int/u/Victor_Borda)\
**Post date:** [27 August 2024 03:41 UTC](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985/28 "2024-08-27T03:41:47Z")

</div>

The informative page appears to be hosted on confluence, which at least at this moment, trying to load from California in the USA, does not work. Confluence just dies and fails to serve anything but a blank page. Not sure why, maybe it’s temporary. I might suggest also making a static export of that page available as a regular web page?

---

<div class="post-metadata">

**Author:** ![Victor\_Borda](https://forum.ecmwf.int/letter_avatar_proxy/v4/letter/v/958977/32.png) [@Victor\_Borda](https://forum.ecmwf.int/u/Victor_Borda)\
**Post date:** [27 August 2024 03:50 UTC](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985/29 "2024-08-27T03:50:31Z")

</div>

Hi Anusha - I just got this to work, so see if this helps:

1. Create account on ECMWF site.
2. Create new beta account on CDS site.
3. On the CDS site, in the upper right, under your username, hover and in the dropdown it should say “Profile”.
4. Under profile, scroll down and look for “Personal Access Token”. Copy it.
5. Locally (this is on Mac), create/edit the ~/.cdsapirc file. You can do this in any text editor.
6. Add this to the file:

```auto
url: https://cds-beta.climate.copernicus.eu/api
key: <personal_access_token_pasted_value>

```

1. Save it
2. Try and hit the api with that. If you are pulling ERA data, you may see an error indicating that you have to accept the license - in which case you have to go back to the UI, find the ERA data page and click the “Accept” button for the terms and conditions.

---

<div class="post-metadata">

**Author:** ![Anabelle](https://forum.ecmwf.int/user_avatar/forum.ecmwf.int/anabelle/32/360_2.png) [@Anabelle](https://forum.ecmwf.int/u/Anabelle)\
**Post date:** [4 September 2024 09:35 UTC](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985/30 "2024-09-04T09:35:17Z")

</div>

Migration date to CDS-Beta has been extended to 26 September 2024 but this is final! 🙂

We posted a separate announcement earlier this morning: [Decommissioning of CDS and ADS on September 26, 2024 - Final](https://prod.ecmwf-forum-prod.compute.cci2.ecmwf.int/t/decommissioning-of-cds-and-ads-on-september-26-2024-final/4877)

---

<div class="post-metadata">

**Author:** ![Scott\_LeBow](https://forum.ecmwf.int/user_avatar/forum.ecmwf.int/scott_lebow/32/509_2.png) [@Scott\_LeBow](https://forum.ecmwf.int/u/Scott_LeBow)\
**Post date:** [4 September 2024 22:07 UTC](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985/31 "2024-09-04T22:07:02Z")

</div>

Thank you so much Victor… this is another case where I can’t believe anybody has actually ever gotten something to work without added input like yours. As an IT novice I find that people who write help files make a lot of assumptions about the blanks that users will be able to fill in on their own.

---

<div class="post-metadata">

**Author:** ![Joao\_Macalos](https://forum.ecmwf.int/letter_avatar_proxy/v4/letter/j/7ab992/32.png) [@Joao\_Macalos](https://forum.ecmwf.int/u/Joao_Macalos)\
**Post date:** [5 September 2024 07:36 UTC](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985/32 "2024-09-05T07:36:40Z")

</div>

Hi @Anabelle , I hope you are doing great!  
Do you have any news on the daily means feature?

---

<div class="post-metadata">

**Author:** ![Salvatore\_Spinosa](https://forum.ecmwf.int/letter_avatar_proxy/v4/letter/s/bb73d2/32.png) [@Salvatore\_Spinosa](https://forum.ecmwf.int/u/Salvatore_Spinosa)\
**Post date:** [5 September 2024 16:06 UTC](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985/33 "2024-09-05T16:06:02Z")

</div>

Dear Victor,

thank you for your guidelines. I’m looking for the “Accept” buttom, but I’m not finding the correct webpage. Can you attach here the link?

Best Regards  
Salvatore

---

<div class="post-metadata">

**Author:** ![COG\_Data](https://forum.ecmwf.int/letter_avatar_proxy/v4/letter/c/71c47a/32.png) [@COG\_Data](https://forum.ecmwf.int/u/COG_Data)\
**Post date:** [6 September 2024 13:56 UTC](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985/34 "2024-09-06T13:56:09Z")

</div>

Also I’ve noticed this. First the maximum number of requests - 250 means that requests are queuing for a long time and now we’re limited to 2 per user requests which also means that when I need to get multiple metrics at once, I’ll be queuing for a long time.

How can this be more restrictive than the old api? Will these restrictions be removed when the CDS is moved from beta?

 ![image](https://forum.ecmwf.int/uploads/default/original/1X/48a59db09be75bc4e83d367f451dc35237a5d62a.png)

---

<div class="post-metadata">

**Author:** ![Tien-Yiao\_Hsu](https://forum.ecmwf.int/letter_avatar_proxy/v4/letter/t/f9ae1b/32.png) [@Tien-Yiao\_Hsu](https://forum.ecmwf.int/u/Tien-Yiao_Hsu)\
**Post date:** [9 September 2024 18:02 UTC](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985/35 "2024-09-09T18:02:48Z")

</div>

Does anyone know where to sign the license?

CDS-beta API keeps returning this error message:  
`required licences not accepted; please accept the following licences to proceed: [{'id': 'licence-to-use-copernicus-products', 'revision': 12}]`

I thought it was referring to this document below,  
[https://apps.ecmwf.int/datasets/licences/copernicus/](https://apps.ecmwf.int/datasets/licences/copernicus/)

I have accepted the term but it does not solve the issue.

Can anyone help with this? Thanks in advance.

---

<div class="post-metadata">

**Author:** ![Sahar\_Dehnavi](https://forum.ecmwf.int/letter_avatar_proxy/v4/letter/s/ee59a6/32.png) [@Sahar\_Dehnavi](https://forum.ecmwf.int/u/Sahar_Dehnavi)\
**Post date:** [10 September 2024 14:43 UTC](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985/36 "2024-09-10T14:43:28Z")

</div>

Thanks a lot Victor. That’s the most helpful answer and instruction I found on this webpage. Normally my code was running perfectly fine with CDS. However now having the CDS-Beta, if I run the same code I get python error messages like attrs module is missing. I tried to install and re-install attrs modules, but that did not help me to make the beta version work. switching the url inside .cdsapirc file to the old CDS, make everything works again as normal. Do you have any suggestions how I can solve this problem?

---

<div class="post-metadata">

**Author:** ![Odil\_Dasturlovchi](https://forum.ecmwf.int/user_avatar/forum.ecmwf.int/odil_dasturlovchi/32/508_2.png) [@Odil\_Dasturlovchi](https://forum.ecmwf.int/u/Odil_Dasturlovchi)\
**Post date:** [13 September 2024 13:59 UTC](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985/37 "2024-09-13T13:59:39Z")

</div>

I posted [Tutorial on Using the CDS-beta with PyCharm on Windows](https://prod.ecmwf-forum-prod.compute.cci2.ecmwf.int/t/tutorial-using-the-cds-beta-with-pycharm-on-windows/5496). In this post I published the revised version of the official Observing floods with GloFAS tutorial ([link](https://ecmwf-projects.github.io/copernicus-training-c3s/glofas-bangladesh-floods.html)).  
Compare the the part of the revised code followed by `download_file = f"{DATADIR}/glofas-2012_2024.grib"` related to data download from the new CDS-beta with original and you can see what you should change in your own scripts.

---

<div class="post-metadata">

**Author:** ![Yi\_Wu](https://forum.ecmwf.int/letter_avatar_proxy/v4/letter/y/b5e925/32.png) [@Yi\_Wu](https://forum.ecmwf.int/u/Yi_Wu)\
**Post date:** [15 September 2024 09:03 UTC](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985/38 "2024-09-15T09:03:36Z")

</div>

Hi @Anabelle, I am also using the toolbox to download the ERA5 daily means, look forward to hearing from you about the new feature!!!

---

<div class="post-metadata">

**Author:** ![Otilia\_Diaconu](https://forum.ecmwf.int/letter_avatar_proxy/v4/letter/o/e19b73/32.png) [@Otilia\_Diaconu](https://forum.ecmwf.int/u/Otilia_Diaconu)\
**Post date:** [22 September 2024 14:55 UTC](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985/39 "2024-09-22T14:55:13Z")

</div>

Hi, I get the same error. I accepted the license…but I still have the error. I work on atos at ecmwf. No one has any solution. Thank you in advance

---

<div class="post-metadata">

**Author:** ![Anabelle](https://forum.ecmwf.int/user_avatar/forum.ecmwf.int/anabelle/32/360_2.png) [@Anabelle](https://forum.ecmwf.int/u/Anabelle)\
**Post date:** [26 September 2024 15:01 UTC](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985/40 "2024-09-26T15:01:18Z")

</div>

Today, 26th September 2024, CDS-Beta has officially become the new CDS: [https://cds.climate.copernicus.eu/](https://cds.climate.copernicus.eu/)

Please see separate announcement for details: [Goodbye legacy Climate Data Store, Hello New Climate Data Store (CDS)!](https://prod.ecmwf-forum-prod.compute.cci2.ecmwf.int/t/goodbye-legacy-climate-data-store-hello-new-climate-data-store-cds/6380)

Our [Informative page](https://confluence.ecmwf.int/x/uINmFw) has been updated accordingly.

[Previous page](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985.md?page=1)

[Next page](https://forum.ecmwf.int/t/informative-page-in-readiness-for-new-cds-beta/2985.md?page=3)
