CORaL | Correlations-Oriented Representation Learning

Summary
Deep learning methods have propelled many of the recent remarkable achievements of artificial intelligence, yet their inner workings remain enigmatic. How do these methods represent the training examples in their multiple processing layers? How are these representations used to make decisions on previously unseen data? The Correlation-Oriented Representation Learning (CORaL) project delves into the intricate relationship between data correlations and the hidden representations of deep neural networks. CORaL's core objectives encompass: i) characterizing the structure of data correlations in tasks where deep learning methods excel; ii) providing a theoretical description of the interplay between the learning dynamics of deep networks and data correlations; and iii) validating these theoretical insights on benchmark machine-learning datasets. The Researcher will approach these objectives with an effective mix of numerical experiments, scaling descriptions and rigorous arguments, inspired by statistical physics and fostered by the unique interdisciplinary scientific community of SISSA. By describing the impact of data correlations on representation learning, CORaL holds the potential to enhance the interpretability and efficiency of deep learning methods across diverse domains, while also enhancing our general understanding of the principles of learning from examples.
Unfold all
/
Fold all
More information & hyperlinks
Web resources: https://cordis.europa.eu/project/id/101154584
Start date: 01-10-2024
End date: 30-09-2026
Total budget - Public funding: - 172 750,00 Euro
Cordis data

Original description

Deep learning methods have propelled many of the recent remarkable achievements of artificial intelligence, yet their inner workings remain enigmatic. How do these methods represent the training examples in their multiple processing layers? How are these representations used to make decisions on previously unseen data? The Correlation-Oriented Representation Learning (CORaL) project delves into the intricate relationship between data correlations and the hidden representations of deep neural networks. CORaL's core objectives encompass: i) characterizing the structure of data correlations in tasks where deep learning methods excel; ii) providing a theoretical description of the interplay between the learning dynamics of deep networks and data correlations; and iii) validating these theoretical insights on benchmark machine-learning datasets. The Researcher will approach these objectives with an effective mix of numerical experiments, scaling descriptions and rigorous arguments, inspired by statistical physics and fostered by the unique interdisciplinary scientific community of SISSA. By describing the impact of data correlations on representation learning, CORaL holds the potential to enhance the interpretability and efficiency of deep learning methods across diverse domains, while also enhancing our general understanding of the principles of learning from examples.

Status

SIGNED

Call topic

HORIZON-MSCA-2023-PF-01-01

Update Date

25-11-2024
Images
No images available.
Geographical location(s)
Structured mapping
Unfold all
/
Fold all
Horizon Europe
HORIZON.1 Excellent Science
HORIZON.1.2 Marie Skłodowska-Curie Actions (MSCA)
HORIZON.1.2.0 Cross-cutting call topics
HORIZON-MSCA-2023-PF-01
HORIZON-MSCA-2023-PF-01-01 MSCA Postdoctoral Fellowships 2023