NeuCoDe | Neural & Computational Principles of Multisensory Integration during Active Sensing and Decision-Making

Summary
Perceptual decisions rely on the integration of information from the environment, which typically involves the combination of stimuli from different senses. The quality of sensory evidence depends highly on our actions that affect how we acquire information from the external world. Importantly, the processing of this multisensory information requires the interaction of multiple neural processes over time. However, the neural mechanisms underlying this complex human behaviour remain elusive. In this project, I will employ a novel active sensing paradigm coupled with state-of-the-art neuroimaging and computational modelling to probe how the brain samples, processes and integrates multisensory information in order to make fast and accurate decisions. I will devise a reaction-time task where human subjects will actively sense and discriminate the amplitude of two texture stimuli a) using only visual information, b) using only haptic information and c) combining the two sensory cues, while electroencephalograms (EEG) will be recorded. To study this, I will develop a novel computational methodology for the joint analysis of brain activity (EEG), sensorimotor signals (movement kinematics) and behavioural measurements (choice and response time). First, behavioural modelling will provide a mechanistic account of the constituent processes underlying decision fomation. Then, model predictions will inform the joint analysis of neural and sensorimotor signals, to characterize the neural and behavioural basis of active multi-sensing and decision-making. To achieve this, I will devise an information-theoretic methodology that quantifies a) the contribution of each sensory modality to perception and b) the interaction of their neural representations to drive perceptual decisions. Ultimately, this project will elucidate the brain networks involved in active multisensory decision-making and characterize their respective functional roles in behavioural performance.
Unfold all
/
Fold all
More information & hyperlinks
Web resources: https://cordis.europa.eu/project/id/845884
Start date: 01-04-2019
End date: 31-03-2021
Total budget - Public funding: 224 933,76 Euro - 224 933,00 Euro
Cordis data

Original description

Perceptual decisions rely on the integration of information from the environment, which typically involves the combination of stimuli from different senses. The quality of sensory evidence depends highly on our actions that affect how we acquire information from the external world. Importantly, the processing of this multisensory information requires the interaction of multiple neural processes over time. However, the neural mechanisms underlying this complex human behaviour remain elusive. In this project, I will employ a novel active sensing paradigm coupled with state-of-the-art neuroimaging and computational modelling to probe how the brain samples, processes and integrates multisensory information in order to make fast and accurate decisions. I will devise a reaction-time task where human subjects will actively sense and discriminate the amplitude of two texture stimuli a) using only visual information, b) using only haptic information and c) combining the two sensory cues, while electroencephalograms (EEG) will be recorded. To study this, I will develop a novel computational methodology for the joint analysis of brain activity (EEG), sensorimotor signals (movement kinematics) and behavioural measurements (choice and response time). First, behavioural modelling will provide a mechanistic account of the constituent processes underlying decision fomation. Then, model predictions will inform the joint analysis of neural and sensorimotor signals, to characterize the neural and behavioural basis of active multi-sensing and decision-making. To achieve this, I will devise an information-theoretic methodology that quantifies a) the contribution of each sensory modality to perception and b) the interaction of their neural representations to drive perceptual decisions. Ultimately, this project will elucidate the brain networks involved in active multisensory decision-making and characterize their respective functional roles in behavioural performance.

Status

CLOSED

Call topic

MSCA-IF-2018

Update Date

28-04-2024
Images
No images available.
Geographical location(s)
Structured mapping
Unfold all
/
Fold all
Horizon 2020
H2020-EU.1. EXCELLENT SCIENCE
H2020-EU.1.3. EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions (MSCA)
H2020-EU.1.3.2. Nurturing excellence by means of cross-border and cross-sector mobility
H2020-MSCA-IF-2018
MSCA-IF-2018