# AI Weather Quest **URL:** https://forum.ecmwf.int/c/workshop-and-events/ai-weather-quest/41.md?page=1 [Latest](https://forum.ecmwf.int/latest.md) · [Categories](https://forum.ecmwf.int/categories.md) · [Tags](https://forum.ecmwf.int/tags.md) **Page:** 2 --- ## [Error with creation of historical quintile bounds (Jan-Jun '25 & Jan-Jun '26)](https://forum.ecmwf.int/t/error-with-creation-of-historical-quintile-bounds-jan-jun-25-jan-jun-26/14458)
**Author:** [@Joshua\_Talib](https://forum.ecmwf.int/u/Joshua_Talib)\ **Replies:** 0\ **Last updated:** [25 November 2025 09:20 UTC](https://forum.ecmwf.int/t/error-with-creation-of-historical-quintile-bounds-jan-jun-25-jan-jun-26/14458 "2025-11-25T09:20:32Z")
Dear all, As many of you know, the final version of ERA5 is released with a three-month latency. To keep things running smoothly, I had set up an automated suite to upload the latest historical quintile bounds and poten… --- ## [Discrepancy between computed and downloaded quintiles](https://forum.ecmwf.int/t/discrepancy-between-computed-and-downloaded-quintiles/14442)
**Author:** [@Jonathan\_Weyn](https://forum.ecmwf.int/u/Jonathan_Weyn)\ **Replies:** 5\ **Last updated:** [25 November 2025 09:03 UTC](https://forum.ecmwf.int/t/discrepancy-between-computed-and-downloaded-quintiles/14442 "2025-11-25T09:03:08Z")
Hi ECMWF team, @Joshua\_Talib , Our team has noticed a discrepancy between quintiles computed with AI\_WQ\_package.compute\_20yr\_quintile\_climatology.complete\_20yr\_quintiles and the data downloaded from the server with AI\_W… --- ## [Suggestion for displaying Dynamical\_S2S Multimodel-Mean Results in the Period-Aggregated RPSS section](https://forum.ecmwf.int/t/suggestion-for-displaying-dynamical-s2s-multimodel-mean-results-in-the-period-aggregated-rpss-section/14417)
**Author:** [@Peng\_Lu](https://forum.ecmwf.int/u/Peng_Lu)\ **Replies:** 2\ **Last updated:** [15 November 2025 02:45 UTC](https://forum.ecmwf.int/t/suggestion-for-displaying-dynamical-s2s-multimodel-mean-results-in-the-period-aggregated-rpss-section/14417 "2025-11-15T02:45:44Z")
Dear Joshua, I would like to suggest a small but valuable improvement to the leaderboards interface. Currently, when selecting Weekly RPSS, users can view the Dynamical\_S2S multimodel\_mean results. However, this feature… --- ## [Help us improve the Quest: please complete the registrants’ survey](https://forum.ecmwf.int/t/help-us-improve-the-quest-please-complete-the-registrants-survey/14413)
**Author:** [@Olga\_Loegel](https://forum.ecmwf.int/u/Olga_Loegel)\ **Replies:** 0\ **Last updated:** [13 November 2025 11:04 UTC](https://forum.ecmwf.int/t/help-us-improve-the-quest-please-complete-the-registrants-survey/14413 "2025-11-13T11:04:01Z")
Dear participants, A short reminder to everyone who has not yet filled in the AI Weather Quest registrants’ survey: your input is very valuable to us! Please complete the short feedback survey here, it takes about 10 mi… --- ## [Benchmark with dynamical models now visible on the Leaderboards!](https://forum.ecmwf.int/t/benchmark-with-dynamical-models-now-visible-on-the-leaderboards/14344)
**Author:** [@Olga\_Loegel](https://forum.ecmwf.int/u/Olga_Loegel)\ **Replies:** 5\ **Last updated:** [11 November 2025 11:04 UTC](https://forum.ecmwf.int/t/benchmark-with-dynamical-models-now-visible-on-the-leaderboards/14344 "2025-11-11T11:04:51Z")
You can now see how the competing AI-based forecasts compare to leading dynamical models on the leaderboards page. Both the leaderboards and model score evolution graphs have been updated to include dynamical model resul… --- ## [Collab on Hydrology Model Inputs?](https://forum.ecmwf.int/t/collab-on-hydrology-model-inputs/14236)
**Author:** [@Zachary\_McEachran](https://forum.ecmwf.int/u/Zachary_McEachran)\ **Replies:** 2\ **Last updated:** [28 October 2025 16:18 UTC](https://forum.ecmwf.int/t/collab-on-hydrology-model-inputs/14236 "2025-10-28T16:18:50Z")
Hello! I am working to expand subseasonal to seasonal hydrologic forecasting capabilities for large navigable rivers, with a focus on the Upper Mississippi River in the US, using AI/ML hydrologic models. I am based at th… --- ## [Connection timed out](https://forum.ecmwf.int/t/connection-timed-out/14279)
**Author:** [@George\_Gousios](https://forum.ecmwf.int/u/George_Gousios)\ **Replies:** 2\ **Last updated:** [24 October 2025 07:37 UTC](https://forum.ecmwf.int/t/connection-timed-out/14279 "2025-10-24T07:37:53Z")
Hello, I am trying to submit today and i receive: quintile\_clim = retrieve\_evaluation\_data.retrieve\_20yr\_quintile\_clim(init\_date,‘tas’, CODE) ../AI\_WQ\_package/retrieve\_evaluation\_data.py", line 91, in retrieve\_20yr\_qu… --- ## [Contributions related to the AI Weather Quest encouraged at EGU 2026!](https://forum.ecmwf.int/t/contributions-related-to-the-ai-weather-quest-encouraged-at-egu-2026/14269)
**Author:** [@Olga\_Loegel](https://forum.ecmwf.int/u/Olga_Loegel)\ **Replies:** 0\ **Last updated:** [22 October 2025 09:42 UTC](https://forum.ecmwf.int/t/contributions-related-to-the-ai-weather-quest-encouraged-at-egu-2026/14269 "2025-10-22T09:42:44Z")
The EGU 2026 General Assembly will host Session AS1.4 – “Subseasonal prediction, processes and warning capabilities (EDI)”. This session welcomes contributions on all aspects of subseasonal-to-seasonal (S2S) prediction, … --- ## [Competition week 4 leaderboards are out](https://forum.ecmwf.int/t/competition-week-4-leaderboards-are-out/14248)
**Author:** [@Joshua\_Talib](https://forum.ecmwf.int/u/Joshua_Talib)\ **Replies:** 0\ **Last updated:** [10 October 2025 07:48 UTC](https://forum.ecmwf.int/t/competition-week-4-leaderboards-are-out/14248 "2025-10-10T07:48:21Z")
Good morning all, It’s exciting to see four week’s worth of evaluation scores on the AI Weather Quest website: Leaderboards • AI Weather Quest . Something I’ve noticed is that several variable-averaged scores are drama… --- ## [WGSIP Webinar Series on Data-Driven Modelling for Subseasonal to Interdecadal Predictions](https://forum.ecmwf.int/t/wgsip-webinar-series-on-data-driven-modelling-for-subseasonal-to-interdecadal-predictions/14207)
**Author:** [@Joshua\_Talib](https://forum.ecmwf.int/u/Joshua_Talib)\ **Replies:** 1\ **Last updated:** [2 October 2025 11:36 UTC](https://forum.ecmwf.int/t/wgsip-webinar-series-on-data-driven-modelling-for-subseasonal-to-interdecadal-predictions/14207 "2025-10-02T11:36:10Z")
All, please see below an invitation to join WGSIP webinar. Dear all, We are pleased to invite you to the first webinar in the new WGSIP Webinar Series on Data-Driven Modelling for Subseasonal to Interdecadal Prediction… --- ## [A Quick Question About the SON 2025 Week 2(first forecast window)](https://forum.ecmwf.int/t/a-quick-question-about-the-son-2025-week-2-first-forecast-window/14215)
**Author:** [@Peng\_Lu](https://forum.ecmwf.int/u/Peng_Lu)\ **Replies:** 3\ **Last updated:** [1 October 2025 10:50 UTC](https://forum.ecmwf.int/t/a-quick-question-about-the-son-2025-week-2-first-forecast-window/14215 "2025-10-01T10:50:38Z")
Dear Organizers, Thank you for your hard work. We are looking at the RPSS for Week 2 of SON 2025 (first forecast window). We found that some model scores are not shown. Could you please check this? We would be very gr… --- ## [First AI Weather Quest leaderboards are live!](https://forum.ecmwf.int/t/first-ai-weather-quest-leaderboards-are-live/14181)
**Author:** [@Olga\_Loegel](https://forum.ecmwf.int/u/Olga_Loegel)\ **Replies:** 0\ **Last updated:** [19 September 2025 07:12 UTC](https://forum.ecmwf.int/t/first-ai-weather-quest-leaderboards-are-live/14181 "2025-09-19T07:12:43Z")
We are very happy to share that the very first Leaderboards of the AI Weather Quest are now online, displaying the outcome of Competition Week 1: :link: View the Leaderboards The page shows Ranked Probability Skill Sco… --- ## [Checking in: how’s the Quest going so far?](https://forum.ecmwf.int/t/checking-in-how-s-the-quest-going-so-far/14123)
**Author:** [@Olga\_Loegel](https://forum.ecmwf.int/u/Olga_Loegel)\ **Replies:** 0\ **Last updated:** [28 August 2025 08:58 UTC](https://forum.ecmwf.int/t/checking-in-how-s-the-quest-going-so-far/14123 "2025-08-28T08:58:25Z")
We’re really happy with the level of engagement so far, great to see so many teams submitting forecasts and following along! As we head into the third competition week, we’d be happy to hear from you: • How is it going… --- ## [Visualisation of oceanic/desert points on forecast portal](https://forum.ecmwf.int/t/visualisation-of-oceanic-desert-points-on-forecast-portal/14115)
**Author:** [@Joshua\_Talib](https://forum.ecmwf.int/u/Joshua_Talib)\ **Replies:** 0\ **Last updated:** [27 August 2025 10:53 UTC](https://forum.ecmwf.int/t/visualisation-of-oceanic-desert-points-on-forecast-portal/14115 "2025-08-27T10:53:30Z")
Hello all, Currently the forecast portal visualises all grid points regardless of evaluation only taking place over land for t2m and pr. This is helpful for those teams that use oceanic sources of predictability, but no… --- ## [The Quest starts off with 28 Teams and 48 Models – Visualise Forecasts and Teams](https://forum.ecmwf.int/t/the-quest-starts-off-with-28-teams-and-48-models-visualise-forecasts-and-teams/14063)
**Author:** [@Olga\_Loegel](https://forum.ecmwf.int/u/Olga_Loegel)\ **Replies:** 0\ **Last updated:** [19 August 2025 08:53 UTC](https://forum.ecmwf.int/t/the-quest-starts-off-with-28-teams-and-48-models-visualise-forecasts-and-teams/14063 "2025-08-19T08:53:56Z")
The AI Weather Quest is off to a strong start! In the very first week of the Competition Phase, 28 teams with 48 models have already joined the Quest! :magnifying\_glass\_tilted\_right: You can now explore the current lis… --- ## [Upper bound of probability map legend shows 2 instead of 1](https://forum.ecmwf.int/t/upper-bound-of-probability-map-legend-shows-2-instead-of-1/14055)
**Author:** [@Anuj\_Shetty](https://forum.ecmwf.int/u/Anuj_Shetty)\ **Replies:** 1\ **Last updated:** [19 August 2025 07:48 UTC](https://forum.ecmwf.int/t/upper-bound-of-probability-map-legend-shows-2-instead-of-1/14055 "2025-08-19T07:48:17Z")
Fyi --- ## [Connect Timeout](https://forum.ecmwf.int/t/connect-timeout/13995)
**Author:** [@Hitachi\_Wang](https://forum.ecmwf.int/u/Hitachi_Wang)\ **Replies:** 6\ **Last updated:** [13 August 2025 20:09 UTC](https://forum.ecmwf.int/t/connect-timeout/13995 "2025-08-13T20:09:23Z")
Hi there, Quick Question~ I’m having some issues when uploading the prediction results—it shows a connection timeout. requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host=‘aiweatherquest.ecmwf.int’, port=443):… --- ## [Skill scores from traditional dynamical forecast models](https://forum.ecmwf.int/t/skill-scores-from-traditional-dynamical-forecast-models/13526)
**Author:** [@Joshua\_Talib](https://forum.ecmwf.int/u/Joshua_Talib)\ **Replies:** 9\ **Last updated:** [13 August 2025 12:29 UTC](https://forum.ecmwf.int/t/skill-scores-from-traditional-dynamical-forecast-models/13526 "2025-08-13T12:29:31Z")
As promised, we are sharing the Ranked Probability Skill Scores (RPSSs) for dynamical forecast models. These scores will be updated weekly, throughout the training period, and the latest data is available in the attached… --- ## [Update to AI Weather Quest Python package](https://forum.ecmwf.int/t/update-to-ai-weather-quest-python-package/14000)
**Author:** [@Joshua\_Talib](https://forum.ecmwf.int/u/Joshua_Talib)\ **Replies:** 0\ **Last updated:** [11 August 2025 12:43 UTC](https://forum.ecmwf.int/t/update-to-ai-weather-quest-python-package/14000 "2025-08-11T12:43:25Z")
In light of the competition period beginning this Thursday, I have just updated the AI Weather Quest Python Package. It is now at version 3.0.0. To upgrade the python package, please use the following command: python3 … --- ## [Successful submissions during the Testing Period](https://forum.ecmwf.int/t/successful-submissions-during-the-testing-period/13122)
**Author:** [@Olga\_Loegel](https://forum.ecmwf.int/u/Olga_Loegel)\ **Replies:** 0\ **Last updated:** [19 May 2025 08:21 UTC](https://forum.ecmwf.int/t/successful-submissions-during-the-testing-period/13122 "2025-05-19T08:21:46Z")
Thank you to all teams who have participated in the Testing Period! On this topic, we will update weekly the Excel file listing all successful submissions. Currently, the attached Excel file lists all successful submi… --- ## [Final submission of testing period complete](https://forum.ecmwf.int/t/final-submission-of-testing-period-complete/13998)
**Author:** [@Joshua\_Talib](https://forum.ecmwf.int/u/Joshua_Talib)\ **Replies:** 0\ **Last updated:** [11 August 2025 10:39 UTC](https://forum.ecmwf.int/t/final-submission-of-testing-period-complete/13998 "2025-08-11T10:39:59Z")
:white\_check\_mark: We have now completed the final submission period within the testing period. :military\_medal: On Thursday the competition begins! In total, 25 teams submitted a forecast at some point of the testing… --- ## [Potential initialisation data](https://forum.ecmwf.int/t/potential-initialisation-data/13782)
**Author:** [@Joshua\_Talib](https://forum.ecmwf.int/u/Joshua_Talib)\ **Replies:** 6\ **Last updated:** [11 August 2025 10:34 UTC](https://forum.ecmwf.int/t/potential-initialisation-data/13782 "2025-08-11T10:34:38Z")
Hi all, As we continue with the testing phase of the AI Weather Quest, we wanted to highlight ECMWF’s open data catalogue. Here you have access the most recent IFS and AIFS operational forecasts. Data is available for t… --- ## [Overwriting Previous Submission](https://forum.ecmwf.int/t/overwriting-previous-submission/13967)
**Author:** [@Asena\_Karolin\_Ozdemir](https://forum.ecmwf.int/u/Asena_Karolin_Ozdemir)\ **Replies:** 1\ **Last updated:** [7 August 2025 14:05 UTC](https://forum.ecmwf.int/t/overwriting-previous-submission/13967 "2025-08-07T14:05:19Z")
Hello Everyone! Quick question. If we submit for the same model, variable and lead time twice within a single submission window is the second submission going to overwrite the first one? Or is the first one locked in an… --- ## [Last week of the JJA testing period!](https://forum.ecmwf.int/t/last-week-of-the-jja-testing-period/13934)
**Author:** [@Joshua\_Talib](https://forum.ecmwf.int/u/Joshua_Talib)\ **Replies:** 1\ **Last updated:** [7 August 2025 07:31 UTC](https://forum.ecmwf.int/t/last-week-of-the-jja-testing-period/13934 "2025-08-07T07:31:42Z")
We are now in the final week of the testing JJA period. 24 teams(:double\_exclamation\_mark:) have trialled submitting a forecast over the past twelve weeks ( Successful submissions during the Testing Period ). This Thur… --- ## [Suitable initialisation data](https://forum.ecmwf.int/t/suitable-initialisation-data/12015)
**Author:** [@Joshua\_Talib](https://forum.ecmwf.int/u/Joshua_Talib)\ **Replies:** 7\ **Last updated:** [31 July 2025 00:27 UTC](https://forum.ecmwf.int/t/suitable-initialisation-data/12015 "2025-07-31T00:27:19Z")
A clarification has been posted on the website: Participants may use any data with a timestamp strictly prior or equal to Thursday 00 UTC to initialise their models, regardless of when the data becomes available . The f… --- ## [Checking for successful forecast submission](https://forum.ecmwf.int/t/checking-for-successful-forecast-submission/13862)
**Author:** [@Joshua\_Talib](https://forum.ecmwf.int/u/Joshua_Talib)\ **Replies:** 9\ **Last updated:** [30 July 2025 08:39 UTC](https://forum.ecmwf.int/t/checking-for-successful-forecast-submission/13862 "2025-07-30T08:39:50Z")
Dear all, I have created a function that enables you to check whether your forecast has been successfully submitted. To use this function you must first upgrade the AI Weather Quest Python package: python3 -m pip insta… --- ## [Clarification on using daily climatological quintile boundaries for weekly forecasts](https://forum.ecmwf.int/t/clarification-on-using-daily-climatological-quintile-boundaries-for-weekly-forecasts/13829)
**Author:** [@yanyan\_tan](https://forum.ecmwf.int/u/yanyan_tan)\ **Replies:** 10\ **Last updated:** [29 July 2025 08:59 UTC](https://forum.ecmwf.int/t/clarification-on-using-daily-climatological-quintile-boundaries-for-weekly-forecasts/13829 "2025-07-29T08:59:46Z")
Dear ECMWF team, I am currently using the climatological quintile boundaries data available from the AI Weather Quest resources, and I would appreciate your guidance on two points regarding how to apply this data correc… --- ## [Forecast evaluation - masking of grid points where all quintile climatologies are equal to zero](https://forum.ecmwf.int/t/forecast-evaluation-masking-of-grid-points-where-all-quintile-climatologies-are-equal-to-zero/13897)
**Author:** [@Joshua\_Talib](https://forum.ecmwf.int/u/Joshua_Talib)\ **Replies:** 0\ **Last updated:** [28 July 2025 14:22 UTC](https://forum.ecmwf.int/t/forecast-evaluation-masking-of-grid-points-where-all-quintile-climatologies-are-equal-to-zero/13897 "2025-07-28T14:22:05Z")
Hi all, To improve the evaluation of forecasts, I’ve made a small update to the way Ranked Probability Scores (RPS) are calculated for precipitation. Specifically, grid points where all quintile climatology values are … --- ## [Error in downloading retrieve\_evaluation\_data](https://forum.ecmwf.int/t/error-in-downloading-retrieve-evaluation-data/13841)
**Author:** [@Mengxuan\_Chen](https://forum.ecmwf.int/u/Mengxuan_Chen)\ **Replies:** 6\ **Last updated:** [21 July 2025 15:13 UTC](https://forum.ecmwf.int/t/error-in-downloading-retrieve-evaluation-data/13841 "2025-07-21T15:13:30Z")
Hi, I am using obs = retrieve\_evaluation\_data.retrieve\_weekly\_obs('20250519', variable, password) to download weekly observation data. The password is the given password in the registered email. however, I encountered f… --- ## [Question about RPSS Evaluation](https://forum.ecmwf.int/t/question-about-rpss-evaluation/13039)
**Author:** [@Peng\_Lu](https://forum.ecmwf.int/u/Peng_Lu)\ **Replies:** 7\ **Last updated:** [15 July 2025 18:16 UTC](https://forum.ecmwf.int/t/question-about-rpss-evaluation/13039 "2025-07-15T18:16:24Z")
Dear Josh When I simulate using the first-week forecast data initialized on 2025-03-06 to calculate the RPSS value, both the observation data and the climatology data are set to 2025-03-24. I test Probabilities predict… [Previous page](https://forum.ecmwf.int/c/workshop-and-events/ai-weather-quest/41.md) [Next page](https://forum.ecmwf.int/c/workshop-and-events/ai-weather-quest/41.md?page=2)