Dear all,
I am struggling to create a dataset using anemoi-datasets. I aim to create a dataset starting from daily forecasts (00 UTC initialisation) at 3h step from step 3 to 90. My dataset should contain the overlapping of all these forecasts (I have a 2-3 years of daily forecasts), so it should be a hypercube with 4 dimensions, I suppose, (valid-date, step, params, latlon). In detail, I have a grib file for each calendar date containing the forecasts of 2t up to 90 h. The analysis step is always missing. How can I configure the .yaml to achieve my goal? And is it possible with Anemoi (I hope so!!)?
My project is to create many other datasets (I have 6 different meteorological models), and an observation dataset, then create a GNN and train it over this period. Afterwards, deploy the model to predict 2t (and in the future expand to 2td, wind, tp, etc) up to 90-96 h over a regular grid. Am I missing something about the framework. Any help is appreciated!