I get error “dataset derived-fire-fuel-biomass not found” while downloading with API provided, or failed process after submitted on website.
Dataset URL is: Observation and ERA5-Land derived 9 km global daily fire fuel characteristics since 2003
I would be very grateful if there is any solution.
Hi,
Can you check your .cdsapirc file has the correct URL for the EWDS?
Unfortunately it has to be changed for the correct instance of the DS.
For cds the URL is:
url: https://cds.climate.copernicus.eu/api
for EWDS:
url: https://ewds.climate.copernicus.eu/api
For ADS:
url : https://ads.atmosphere.copernicus.eu/api
Thanks,
Chris
An alternative is:
As you are using the cds api you can set:
URL = ‘https://ewds.climate.copernicus.eu/api’
KEY = ‘YOUR_KEY’
cdsapi_kwargs = {
‘url’: URL,
‘key’: KEY,
}
When you call the cds api:
c = cdsapi.Client(**cdsapi_kwargs)
Thanks,
Chris
Yeah, that works for me! Thank you very very much!
Unfortunately, a new problem has arisen as the process has failed with error:
Your request has not found some of the data expected to be present.
This may be due to temporary connectivity issues with the source data.
If this problem persists, please contact user support.
The job failed with: UrlNoDataError
And what should I do?
Hi, I have seen this happen on occasion due to a timeout internally.
So you can just try the request again.
Otherwise post the API request here so I can check it.
Thanks,
Chris
I have tried many times but all failed. The API request is:
import cdsapi
dataset = “derived-fire-fuel-biomass”
request = {
“variable”: [“fuel_group”],
“version”: [“1”],
“year”: [“2020”],
“month”: [
“01”, “02”, “03”,
“04”, “05”, “06”,
“07”, “08”, “09”,
“10”, “11”, “12”
]
}
client = cdsapi.Client()
client.retrieve(dataset, request).download()
Thank you very much for your check.
Hi,
I am having similar issues here.
Only thing I can suggest is to run an individual request for each month as the request does eventually work but the files are large so the full year will be around 150GB.
Chris
1 Like
I have completed the download by requesting for each month.
Thank you very much for your help!
1 Like
This dataset seems to be missing the last few days.
Any comments on that?
Thank you in advance.
Hi all, hate to revive an old threat that supposedly provided a fix. However, I am running into a very similar error as the original commenter, yet the previously provided fix does not appear to work.
I am able to download a month of data from Observation and ERA5-Land derived 9 km global daily fire fuel characteristics since 2003 when I submit the process via the web interface. However, when I use the api I get the original error: “dataset derived-fire-fuel-biomass not found”.
Changing to the EWDS or ADS does not solve the problem (and yes, I have accepted all the license agreements).
I have also tried to use ecmwf.datastores.Client() rather than cdsapi.Client() and have checked that I have authenticated correctly via client.check_authentication(). And still no success.
Attached is a somewhat minimal example reproducing the error (attempting with ewds).
SOLVED (by Christopher Barnard in a help ticket):
The issue is that the data is actually located on url='ht tps://xds-preprod.ecmwf.int/api%E2%80%99 which needs its own separate API key (as opposed to CDS/ADS/EWDS which share a key afaik)? You obtain the key via CDSAPI setup - ECMWF Cross Data Store. Note that the textual description on this page is copy-pasted verbatim from CDSAPI setup - Climate Data Store. As such, the text for the XDS-preprod page describes the process for the CDS/ADS/EWDS. However, if you are on the cross data store page (XDS) and go to profile, you will find the correct, separate, api key. This could be further obfuscated if you are still using the cdsapi package for .Client() rather than ecmwf.datastores for .Client()
(I am a “new user,“ so I can only put two links in a post… so I broke the first link with a space on purpose)!