PRINNEVOT | Towards Primate-like Artificial Neural Networks for Visual Object Tracking

Summary
The PRINNEVOT project embarks on a mission to bridge the gap between computer vision and the primate visual system in the context of Visual Object Tracking (VOT). VOT is the task of maintaining focus The PRINNEVOT project embarks on a mission to bridge the gap between computer vision and the primate visual system in the context of Visual Object Tracking (VOT). VOT is the task of maintaining focus on a specific object amidst a dynamic visual environment. Our brains excel at it but replicating this ability in artificial vision systems remains a challenge. This project seeks to develop a novel class of VOT algorithms inspired by the primate visual system's prowess. Despite notable advancements in deep learning-based VOT over the past decade, these algorithms still fall short in emulating the robustness exhibited by primate vision. PRINNEVOT will address this gap through a multi-faceted approach. Firstly, PRINNEVOT will construct a comprehensive reference dataset, investigating both primate behavior and neural recordings. Secondly, among the existing artificial neural network (ANN)-based VOT methodologies, the project aims to identify those that align most closely with the primate brain's mechanisms. Lastly, PRINNEVOT will leverage the discovered inductive biases to develop a new ANN architecture for VOT that closely mirrors the primate's way of continuous object recognition and localization. By merging computer vision and computational neuroscience research, PRINNEVOT aspires to contribute to the development of more accurate and robust VOT algorithms. These algorithms, in alignment with the European Union's pursuit of safer and ethically grounded Artificial Intelligence, promise to enhance human-centric and trustworthy technologies. Furthermore, the project's outcomes will not only benefit AI and computer vision but also advance our understanding of the primate visual system, offering new empirical models of how the brain tracks objects in dynamic visual environments.
Unfold all
/
Fold all
More information & hyperlinks
Web resources: https://cordis.europa.eu/project/id/101151834
Start date: 01-11-2024
End date: 31-10-2027
Total budget - Public funding: - 256 442,00 Euro
Cordis data

Original description

The PRINNEVOT project embarks on a mission to bridge the gap between computer vision and the primate visual system in the context of Visual Object Tracking (VOT). VOT is the task of maintaining focus The PRINNEVOT project embarks on a mission to bridge the gap between computer vision and the primate visual system in the context of Visual Object Tracking (VOT). VOT is the task of maintaining focus on a specific object amidst a dynamic visual environment. Our brains excel at it but replicating this ability in artificial vision systems remains a challenge. This project seeks to develop a novel class of VOT algorithms inspired by the primate visual system's prowess. Despite notable advancements in deep learning-based VOT over the past decade, these algorithms still fall short in emulating the robustness exhibited by primate vision. PRINNEVOT will address this gap through a multi-faceted approach. Firstly, PRINNEVOT will construct a comprehensive reference dataset, investigating both primate behavior and neural recordings. Secondly, among the existing artificial neural network (ANN)-based VOT methodologies, the project aims to identify those that align most closely with the primate brain's mechanisms. Lastly, PRINNEVOT will leverage the discovered inductive biases to develop a new ANN architecture for VOT that closely mirrors the primate's way of continuous object recognition and localization. By merging computer vision and computational neuroscience research, PRINNEVOT aspires to contribute to the development of more accurate and robust VOT algorithms. These algorithms, in alignment with the European Union's pursuit of safer and ethically grounded Artificial Intelligence, promise to enhance human-centric and trustworthy technologies. Furthermore, the project's outcomes will not only benefit AI and computer vision but also advance our understanding of the primate visual system, offering new empirical models of how the brain tracks objects in dynamic visual environments.

Status

SIGNED

Call topic

HORIZON-MSCA-2023-PF-01-01

Update Date

25-12-2024
Images
No images available.
Geographical location(s)
Structured mapping
Unfold all
/
Fold all
Horizon Europe
HORIZON.1 Excellent Science
HORIZON.1.2 Marie Skłodowska-Curie Actions (MSCA)
HORIZON.1.2.0 Cross-cutting call topics
HORIZON-MSCA-2023-PF-01
HORIZON-MSCA-2023-PF-01-01 MSCA Postdoctoral Fellowships 2023