ReTouch | Physics-based Remote Touch

Summary
Humans rely on their sense of touch to achieve fine manipulation tasks and interact with their surroundings. However, feeling the tactile properties of a remote environment remains a challenge for two main reasons: first, current robotic systems are rarely equipped with tactile sensing and second, only forces are fed back to the users. In this project, the final goal is to create a bilateral tactile telemanipulation system, bridging the gap for touch over a distance. To cope with the large bandwidth required for this tactile interaction, I propose a new encoding of the tactile information, inspired by human touch. First, I will acquire a large database of robotic mechanical interactions in order to extract primitives of spatio-temporal deformation. Second, this dictionary will allow me to distill tactile features from any interaction and render tactile properties to a remote user.
The robotic decoding part will be carried out under the supervision of Prof. Adelson in the Massachusetts Institute of Technology, using the GelSight tactile sensor. In the return phase, I will integrate humans in-the-loop by designing a novel haptic device and studying the effect of applied skin deformation on the perception of tactile properties. This integration will be done under the supervision of Dr. Wiertlewski from Delft University of Technology. This interdisciplinary project requires skills in biomechanics, perception, robotics and control as well as modeling and machine learning, which will be part of the applicant training.
If granted, this project will for the first time encode the tactile information in a dictionary of primitives, essential for sensing, compression, and reproduction of rich tactile stimuli. In addition, the remote touch platform will have applications in a wide range of the fields where delicate touch is necessary, such as healthcare, or remote exploration and navigation in environments such as nuclear reactors or space.
Unfold all
/
Fold all
More information & hyperlinks
Web resources: https://cordis.europa.eu/project/id/101108904
Start date: 01-06-2023
End date: 31-05-2026
Total budget - Public funding: - 272 536,00 Euro
Cordis data

Original description

Humans rely on their sense of touch to achieve fine manipulation tasks and interact with their surroundings. However, feeling the tactile properties of a remote environment remains a challenge for two main reasons: first, current robotic systems are rarely equipped with tactile sensing and second, only forces are fed back to the users. In this project, the final goal is to create a bilateral tactile telemanipulation system, bridging the gap for touch over a distance. To cope with the large bandwidth required for this tactile interaction, I propose a new encoding of the tactile information, inspired by human touch. First, I will acquire a large database of robotic mechanical interactions in order to extract primitives of spatio-temporal deformation. Second, this dictionary will allow me to distill tactile features from any interaction and render tactile properties to a remote user.
The robotic decoding part will be carried out under the supervision of Prof. Adelson in the Massachusetts Institute of Technology, using the GelSight tactile sensor. In the return phase, I will integrate humans in-the-loop by designing a novel haptic device and studying the effect of applied skin deformation on the perception of tactile properties. This integration will be done under the supervision of Dr. Wiertlewski from Delft University of Technology. This interdisciplinary project requires skills in biomechanics, perception, robotics and control as well as modeling and machine learning, which will be part of the applicant training.
If granted, this project will for the first time encode the tactile information in a dictionary of primitives, essential for sensing, compression, and reproduction of rich tactile stimuli. In addition, the remote touch platform will have applications in a wide range of the fields where delicate touch is necessary, such as healthcare, or remote exploration and navigation in environments such as nuclear reactors or space.

Status

SIGNED

Call topic

HORIZON-MSCA-2022-PF-01-01

Update Date

31-07-2023
Images
No images available.
Geographical location(s)
Structured mapping
Unfold all
/
Fold all
Horizon Europe
HORIZON.1 Excellent Science
HORIZON.1.2 Marie Skłodowska-Curie Actions (MSCA)
HORIZON.1.2.0 Cross-cutting call topics
HORIZON-MSCA-2022-PF-01
HORIZON-MSCA-2022-PF-01-01 MSCA Postdoctoral Fellowships 2022