Weather and Climate
The Weather & Climate Use Case focused on a complex system, to provide a diverse set of forecasts: weather, flood, fire, energy, air pollution.
- This system exploited Copernicus and GEOSS data services, supplemented and complemented by global and local in-situ unstructured observations,
- Data was filtered and pre-processed before assimilation to ensure quality,
- Each layer in the use case produced large data set of forecast data (from 100+TB global weather models, to MB at the decision maker level),
- Both the assimilated data (inputs) and data produced by each layer (outputs) were available through a cloud-based Weather and Climate Data API (WCDA) between layers (model chains) for further analysis and industrial exploitation during the project.
The system has been applied to several test cases, such as renewable energy forecast and urban air quality in cities forecast, spanning all the available forecasts, to fine tune the system and demonstrate the innovative value.
In the Weather and Climate Large-Scale Pilot, well-proven HPC models as well as preprocessing and application/postprocessing codes have been virtualised and prepared as ready-to-run containers and virtual machines compatible with the LEXIS Platform. The procedures for handling workflows and data from different sources have been completely revised from ground up and made ready for next-generation model. Runs of the respective workflows on the platform have been presented on SC20 conference; meanwhile the model management has reached production quality and utilises a wealth of HPC and Cloud resources integrated by LEXIS Platform, as well as the newly-designed Weather and Climate Data API (WCDA) by ECMWF.