Summary
Today, developers lack tools that enable the development of complex workflows involving HPC simulation and modelling with data analytics (DA) and machine learning (ML). TheFlows4HPC aims to deliver a workflow software stack and an additional set of services to enable the integration of HPC simulation and modelling with big data analytics and machine learning in scientific and industrial applications. The software stack will allow to develop innovative adaptive workflows that efficiently use the computing resources and also considering innovative storage solutions.
To widen the access to HPC to newcomers, the project will provide HPC Workflows as a Service (HPCWaaS), an environment for sharing, reusing, deploying and executing existing workflows on HPC systems. The workflow technologies, associated machine learning and big data libraries used in the project leverages previous open source European initiatives. Specific optimization tasks for the use of accelerators (FPGAs, GPUs) and the EPI will be performed in the project use cases.
To demonstrate the workflow software stack, use cases from three thematic pillars have been selected. Pillar I focuses on the construction of DigitalTwins for the prototyping of complex manufactured objects integrating state-of-the-art adaptive solvers with machine learning and data-mining, contributing to the Industry 4.0 vision. Pillar II develops innovative adaptive workflows for climate and for the study of Tropical Cyclones (TC) in the context of the CMIP6 experiment, including in-situ analytics. Pillar III explores the modelling of natural catastrophes - in particular, earthquakes and their associated tsunamis- shortly after such an event is recorded. Leveraging two existing workflows, the Pillar will work of integrating them with the eFlows4HPC software stack and on producing policies for urgent access to supercomputers. The pillar results will be demonstrated in the target community CoEs to foster adoption and get feedback.
To widen the access to HPC to newcomers, the project will provide HPC Workflows as a Service (HPCWaaS), an environment for sharing, reusing, deploying and executing existing workflows on HPC systems. The workflow technologies, associated machine learning and big data libraries used in the project leverages previous open source European initiatives. Specific optimization tasks for the use of accelerators (FPGAs, GPUs) and the EPI will be performed in the project use cases.
To demonstrate the workflow software stack, use cases from three thematic pillars have been selected. Pillar I focuses on the construction of DigitalTwins for the prototyping of complex manufactured objects integrating state-of-the-art adaptive solvers with machine learning and data-mining, contributing to the Industry 4.0 vision. Pillar II develops innovative adaptive workflows for climate and for the study of Tropical Cyclones (TC) in the context of the CMIP6 experiment, including in-situ analytics. Pillar III explores the modelling of natural catastrophes - in particular, earthquakes and their associated tsunamis- shortly after such an event is recorded. Leveraging two existing workflows, the Pillar will work of integrating them with the eFlows4HPC software stack and on producing policies for urgent access to supercomputers. The pillar results will be demonstrated in the target community CoEs to foster adoption and get feedback.
Unfold all
/
Fold all
More information & hyperlinks
| Web resources: | https://cordis.europa.eu/project/id/955558 |
| Start date: | 01-01-2021 |
| End date: | 29-02-2024 |
| Total budget - Public funding: | 7 663 216,00 Euro - 3 576 656,00 Euro |
Cordis data
Original description
Today, developers lack tools that enable the development of complex workflows involving HPC simulation and modelling with data analytics (DA) and machine learning (ML). TheFlows4HPC aims to deliver a workflow software stack and an additional set of services to enable the integration of HPC simulation and modelling with big data analytics and machine learning in scientific and industrial applications. The software stack will allow to develop innovative adaptive workflows that efficiently use the computing resources and also considering innovative storage solutions.To widen the access to HPC to newcomers, the project will provide HPC Workflows as a Service (HPCWaaS), an environment for sharing, reusing, deploying and executing existing workflows on HPC systems. The workflow technologies, associated machine learning and big data libraries used in the project leverages previous open source European initiatives. Specific optimization tasks for the use of accelerators (FPGAs, GPUs) and the EPI will be performed in the project use cases.
To demonstrate the workflow software stack, use cases from three thematic pillars have been selected. Pillar I focuses on the construction of DigitalTwins for the prototyping of complex manufactured objects integrating state-of-the-art adaptive solvers with machine learning and data-mining, contributing to the Industry 4.0 vision. Pillar II develops innovative adaptive workflows for climate and for the study of Tropical Cyclones (TC) in the context of the CMIP6 experiment, including in-situ analytics. Pillar III explores the modelling of natural catastrophes - in particular, earthquakes and their associated tsunamis- shortly after such an event is recorded. Leveraging two existing workflows, the Pillar will work of integrating them with the eFlows4HPC software stack and on producing policies for urgent access to supercomputers. The pillar results will be demonstrated in the target community CoEs to foster adoption and get feedback.
Status
CLOSEDCall topic
EuroHPC-02-2019Update Date
27-10-2022
Images
No images available.
Geographical location(s)
Structured mapping
Unfold all
/
Fold all
H2020-EU.2.1.1. INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)
Search
Organisations
-
| BARCELONA SUPERCOMPUTING CENTER - CENTRO NACIONAL DE SUPERCOMPUTACION (BSC) (Coördinator)
-
| ALFRED-WEGENER-INSTITUT HELMHOLTZ-ZENTRUM FUR POLAR- UND MEERESFORSCHUNG
-
| Bull SAS
-
| CENTRE INTERNACIONAL DE METODES NUMERICS EN ENGINYERIA (CIMNE)
-
| DTOK LAB SRL
-
| EIDGENOESSISCHE TECHNISCHE HOCHSCHULE ZUERICH
-
| FONDAZIONE CENTRO EURO-MEDITERRANEOSUI CAMBIAMENTI CLIMATICI
-
| FORSCHUNGSZENTRUM JULICH GMBH (JUELICH)
-
| INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE
-
| INSTITUT POLYTECHNIQUE DE BORDEAUX (Bordeaux INP)
-
| INSTYTUT CHEMII BIOORGANICZNEJ POLSKIEJ AKADEMII NAUK
-
| ISTITUTO NAZIONALE DI GEOFISICA E VULCANOLOGIA
-
| SCUOLA INTERNAZIONALE SUPERIORE DI STUDI AVANZATI DI TRIESTE
-
| STIFTELSEN NORGES GEOTEKNISKE INSTITUTT
-
| Siemens AG