CAPTAIN Coach Assistant via Projected and Tangible Interface

Summary

Older adults typically prefer living at their homes as long as possible. However, they often need to be institutionalized due to the age related problems. Homecare can benefit today from a range of existing technologies including smartphones, sensors, etc., however, their effectiveness is limited by the sense of fear and uncomfortableness that many older adults feel. Most current technologies, in fact, are often not designed for older adults, least of all for users with memory impairments. The derivative limitations become a major barrier, severely limiting use of technological assistance in a home environment. CAPTAIN proposes a “transparent” technology designed to turn the home of the older adult into a ubiquitous assistant specifically designed to compensate for their physical and memory impairments during their daily living. To do so, it leverages on a few state of the art technologies, as follows: “Projected augmented reality” to project, through use of micro-projectors, contextualised (directly on walls, floor, tables, etc.) information and instructions on top of the real environment. Real-time 3D sensing technologies to comprehend the “indoor space” (nature and position of objects and actions of the persons) and to allow transforming it into a ubiquitous tangible interface. 3D sensing, together with speech analysis, will allow device-free comprehension of the environment and of the behaviour of the adults (including its changes). Non-invasive physiological and emotional data analysis from facial micro-expressions and human body pose thanks to scalable, robust, and accurate deep learning and artificial intelligence. The coach will leverage on a motivational engine to promote correct nutrition, physical activity, cognitive and physical training, risk avoidance, and social participation. To achieve this CAPTAIN will foster a truly user-centered co-design philosophy -based on constant involvement of older adult in the design, development, and testing stages.

Resources Show all and search (58)

Unfold all

Fold all

More information & hyperlinks

Web resources:	https://cordis.europa.eu/project/id/769830
Start date:	01-12-2017
End date:	30-06-2021
Total budget - Public funding:	3 990 200,00 Euro - 3 990 200,00 Euro