MINDSEYE | Reading the mind’s eye: AI-inspired personalised brain models of mental imagery

Summary
How do we create mental images? Despite extensive research, we still miss an overarching mechanistic understanding of mental imagery: How do the various brain regions involved in mental imagery contribute to the unified percept in our mind's eye? Why do we experience imagery so differently ranging from no to extremely vivid mental images? In this project, we propose a novel perspective on mental imagery, viewing it as a personalised computational process that takes into account individual brain characteristics. The task of this computational process is to progressively transform abstract object descriptions (input) into sensory-like visual representations (output) through feedback connections in the brain’s processing hierarchy. To unravel the stages of this conversion process, we will employ advanced fMRI techniques to measure neural activity across the entire brain at an unparalleled level of detail. Using sophisticated analysis methods, we will decode topographic and semantic information about the content of mental images from activated brain areas. To investigate the causal involvement of specific areas, we will transiently disrupt their activity using transcranial magnetic stimulation (TMS). Informed by the fMRI and TMS data, we will develop the first personalized AI-inspired neural network model of mental imagery. This model will simulate the emergence of sensory representations backwards through the processing hierarchy and predict the perceived vividness of generated images for each individual. By implementing the model into a Brain Computer Interface, we will enable participants to see imagined objects on a screen during fMRI scanning. This opens up new applications, such as training the strength of mental imagery by providing neurofeedback based on predicted vividness. This interdisciplinary project, at the intersection of psychology, neuroscience, and AI, will provide an integrative framework of the generation of subjective experiences in the mind's eye.
Unfold all
/
Fold all
More information & hyperlinks
Web resources: https://cordis.europa.eu/project/id/101141800
Start date: 01-09-2024
End date: 31-08-2029
Total budget - Public funding: 2 498 288,00 Euro - 2 498 288,00 Euro
Cordis data

Original description

How do we create mental images? Despite extensive research, we still miss an overarching mechanistic understanding of mental imagery: How do the various brain regions involved in mental imagery contribute to the unified percept in our mind's eye? Why do we experience imagery so differently ranging from no to extremely vivid mental images? In this project, we propose a novel perspective on mental imagery, viewing it as a personalised computational process that takes into account individual brain characteristics. The task of this computational process is to progressively transform abstract object descriptions (input) into sensory-like visual representations (output) through feedback connections in the brain’s processing hierarchy. To unravel the stages of this conversion process, we will employ advanced fMRI techniques to measure neural activity across the entire brain at an unparalleled level of detail. Using sophisticated analysis methods, we will decode topographic and semantic information about the content of mental images from activated brain areas. To investigate the causal involvement of specific areas, we will transiently disrupt their activity using transcranial magnetic stimulation (TMS). Informed by the fMRI and TMS data, we will develop the first personalized AI-inspired neural network model of mental imagery. This model will simulate the emergence of sensory representations backwards through the processing hierarchy and predict the perceived vividness of generated images for each individual. By implementing the model into a Brain Computer Interface, we will enable participants to see imagined objects on a screen during fMRI scanning. This opens up new applications, such as training the strength of mental imagery by providing neurofeedback based on predicted vividness. This interdisciplinary project, at the intersection of psychology, neuroscience, and AI, will provide an integrative framework of the generation of subjective experiences in the mind's eye.

Status

SIGNED

Call topic

ERC-2023-ADG

Update Date

24-11-2024
Images
No images available.
Geographical location(s)
Structured mapping
Unfold all
/
Fold all
Horizon Europe
HORIZON.1 Excellent Science
HORIZON.1.1 European Research Council (ERC)
HORIZON.1.1.1 Frontier science
ERC-2023-ADG ERC ADVANCED GRANTS