Dear all,
Those registered to the AI Weather Quest should have now received their new password for operations using the AI Weather Quest Python Package, and our new Terms and Conditions:
Terms and Conditions for the AI Weather Quest.pdf (139.9 KB)
If you have not received these via email, and would like to, please contact us at aiweatherquest@ecmwf.int.
Just a reminder, and as highlighted during the What’s Next? webinar, the AI Weather Quest is transitioning from the current FTP-based submission system to ECBox. To continue submitting forecasts from this week onwards, as well as downloading relevant training and evaluation data, please complete the following steps:
- Upgrade the AI-WQ-package:
python3 -m pip install --upgrade AI-WQ-package
Please ensure you are using AI-WQ-Package version 3.28 or later.
- Install the ECMWF sites-toolkit package:
python3 -m pip install sites-toolkit –i https://get.ecmwf.int/repository/pypi-all/simple
This package enables interactions with ECBox in a Python environment.
- Update your password:
PASSWORD SENT VIA EMAIL
Once these steps have been completed, your system should be ready to continue participating in AI Weather Quest using the new infrastructure.
If you encounter any issues or have any questions, please don’t hesitate to contact us.
Additionally, we encourage all active participants to review the new terms and conditions (found above).
Thanks,
Josh
Hi Josh!
I upgraded the AI-WQ-package, installed the ECMWF sites-toolkit package, and updated my password for my submission this week. It seems like the forecast submission ran as expected, however, I got a new error when I check whether my submission was successful using AI_WQ_check_submission('tas',initdate,'1',teamname,modelname,password)
I get the following error. Is this a problem on my end?
... line 526, in AI_WQ_check_submission
filenames = [os.path.basename(path) for path in entries['files']] # only want filename (no leading directories)
^^^^^^^^^^^^^^^^^^^^^^
File "", line 171, in basename
TypeError: expected str, bytes or os.PathLike object, not dict
Dear @Kirsten_Mayer !
Thanks for the message. The first thing to say, I can see submissions from teamname: NSFNCAR modelname: subCESMulator, so well done for submitting forecasts to our new system!
I completely dropped the ball with testing the check_fc_submission function. Sorry. If you update the python package to > v3.29:
python3 -m pip install --upgrade AI_WQ_package
then you should be able to successfully check forecast submission. I’ve also updated the GitHub repository and changes can be found at: correcting error when checking forecast submission on ecbox · ecmwf/AI_weather_quest@3819965 · GitHub .
Apologies for the inconvenience, and thanks for your continued interest/participation in the Quest.
Thanks,
Josh
Dear Josh,
after updating and installing the packages, I have been receiving Connection time out errors. In general the submission upload has taken quite a long time. When I wanted to check if the submission was successful I have received the following error message, even after updating AI_WQ_package to > v3.29.
line 27, in AI_WQ_check_submission('pr', '20260713', '1', teamname, modelname, password)
line 491, in AI_WQ_check_submission session = ftplib.FTP('``ftp.ecmwf.int``','ai_weather_quest',password) # open FTP session
line 123, in init self.login(user, passwd, acct)
line 414, in login resp = self.sendcmd('PASS ' + passwd)
line 281, in sendcmd return self.getresp()
line 244, in getresp resp = self.getmultiline()
line 230, in getmultiline line = self.getline()
line 212, in getline line = self.file.readline(self.maxline + 1)
line 720, in readinto return self._sock.recv_into(b)
TimeoutError: [Errno 110] Connection timed out
Do you know the cause of this problem? Thanks in advance!
Hi Rebecca,
I notice in your function call that you’re using 13th July rather than 13th August. Can you try using 13th August instead.
Just for peace of mind, I can see precipitation forecasts for model name IFUAIHydromet .
Thanks,
Josh
Dear Joshua,
sorry that was a mistake on my side!
Thanks for the info on the successful submission of our group especially since the notification below seems to present a different story.
After changing the date to the correct one, I am now receiving the notification:
FileNotFoundError: Could not find 'pr_20260813_p1_IFUAIHydromet_ProAFNOS2St.nc' after upload. Please try resubmitting to the AI Weather Quest.
with the following versions
AI-WQ: 3.29
sites-toolkit: 20260402.1
That is bizarre. Investigating. At the moment I can see:
Hi @Rebecca_Wiegels ,
So, I’ve found out that when listing files within a chosen directory on ecBOX it will only list the first 100 entries. Therefore, when you were trying to find your forecast, it wasn’t found as it wasn’t within the first 100 forecast files sent!
I’ve updated the code accordingly. Could you please upgrade the package to v3.31 and try again.
I had success when trying to find one of your submissions. Output included:
IFUAIHydromet is registered to the AI Weather Quest. You may submit your forecast.
ProAFNOS2St is registered to the AI Weather Quest. You may submit your forecast.
File ‘pr_20260813_p1_IFUAIHydromet_ProAFNOS2St.nc’ exists. You have successfully submitted to the AI Weather Quest.
Thanks,
Josh
Dear Josh,
the new update works perfectly, thanks for the quick fix!
Best regards,
Rebecca
Thanks! And sorry for the inconvenience.
Josh
Hi Josh,
We noticed while using the new submission system that we also had issues with the upload taking a long time. The initial AI_WQ_create_empty_dataarraytook several hours to complete. Is there anything we can do on our end to potentially speed this up?
Hi David,
Not that I can think of. Did it take several hours for multiple variables?
Josh
Hi Josh,
I’m not sure. The first variable too over an hour for forecasting window 1 and then again for forecasting window 2. Once I saw the submission wasn’t frozen it was left running, I didn’t get timing information for the rest of the variables. I’ll log the submission for this week to see if it happens again.
It took 1 hour 10m for our case.
To make an empty data array and submit a forecast. I will investigate!
