MALIN | Model-aware learning for imaging inverse problems in fluorescence microscopy

Summary
This project will develop model-aware, i.e. physics-informed, learning methods for solving imaging inverse problems (IIPs) in fluorescence microscopy imaging (FMI). IIPs are frequently encountered in FMI whenever a visual representation of a biological sample needs to be reconstructed from incomplete and noisy input measurements. Such IIPs are typically ill-posed: their solution (if it exists) is unstable to perturbations. Classical model-based approaches reformulate the IIP at hand as an energy minimisation task. Such approaches rely both on the (approximate) knowledge of the complex physical processes involved and on the mathematical design of hand-crafted optimisation methods whose tuning is often very time-consuming. Concurrently, the impressive development of machine and deep learning methods has enabled the applied imaging community with new data-driven methodologies providing unprecedented results in tasks such as image classification. The performance of data-driven methods for solving IIPs in FMI, however, is halted by their intrinsic unstable behaviour. In MALIN, I propose an integrative paradigm where the stable performance of model-based approaches is combined with the effectiveness of data-driven techniques by means of shallow model-constrained learning and deep physics-informed generative approaches. The reliability of the model-aware methods proposed will be justified by theoretical results providing reconstruction and convergence guarantees. The study will further account for possible geometric invariances and imperfect physical modelling, showing robustness to modelling errors which are frequent when standard (low-cost) equipment is used. Algorithmic acceleration strategies and inexact/stochastic algorithms will be devised to guarantee efficient performance also under limited computational resources and training data. The methodologies will be deployed on several IIPs in FMI and democratised through the release of open software and plug-ins.
Unfold all
/
Fold all
More information & hyperlinks
Web resources: https://cordis.europa.eu/project/id/101117133
Start date: 01-11-2024
End date: 31-10-2029
Total budget - Public funding: 1 432 734,00 Euro - 1 432 734,00 Euro
Cordis data

Original description

This project will develop model-aware, i.e. physics-informed, learning methods for solving imaging inverse problems (IIPs) in fluorescence microscopy imaging (FMI). IIPs are frequently encountered in FMI whenever a visual representation of a biological sample needs to be reconstructed from incomplete and noisy input measurements. Such IIPs are typically ill-posed: their solution (if it exists) is unstable to perturbations. Classical model-based approaches reformulate the IIP at hand as an energy minimisation task. Such approaches rely both on the (approximate) knowledge of the complex physical processes involved and on the mathematical design of hand-crafted optimisation methods whose tuning is often very time-consuming. Concurrently, the impressive development of machine and deep learning methods has enabled the applied imaging community with new data-driven methodologies providing unprecedented results in tasks such as image classification. The performance of data-driven methods for solving IIPs in FMI, however, is halted by their intrinsic unstable behaviour. In MALIN, I propose an integrative paradigm where the stable performance of model-based approaches is combined with the effectiveness of data-driven techniques by means of shallow model-constrained learning and deep physics-informed generative approaches. The reliability of the model-aware methods proposed will be justified by theoretical results providing reconstruction and convergence guarantees. The study will further account for possible geometric invariances and imperfect physical modelling, showing robustness to modelling errors which are frequent when standard (low-cost) equipment is used. Algorithmic acceleration strategies and inexact/stochastic algorithms will be devised to guarantee efficient performance also under limited computational resources and training data. The methodologies will be deployed on several IIPs in FMI and democratised through the release of open software and plug-ins.

Status

SIGNED

Call topic

ERC-2023-STG

Update Date

29-09-2024
Images
No images available.
Geographical location(s)
Structured mapping
Unfold all
/
Fold all
Horizon Europe
HORIZON.1 Excellent Science
HORIZON.1.1 European Research Council (ERC)
HORIZON.1.1.0 Cross-cutting call topics
ERC-2023-STG ERC STARTING GRANTS
HORIZON.1.1.1 Frontier science
ERC-2023-STG ERC STARTING GRANTS