SpeechXRays | Multi-channel biometrics combining acoustic and machine vision analysis of speech, lip movement and face

Summary
The SpeechXRays project will develop and test in real-life environments a user recognition platform based on voice acoustics analysis and audio-visual identity verification. SpeechXRays will outperform state-of-the-art solutions in the following areas:
· Security: high accuracy solution (cross over accuracy of 1/100 i.e. twice the commercial voice/face solutions)
· Privacy: biometric data stored in the device (or in a private cloud under the responsibility of the data subject)
· Usability: text-independent speaker identification (no pass phrase), low sensitivity to surrounding noise
· Cost-efficiency: use of standard embedded microphone and cameras (smartphones, laptops).
The project will combine and pilot two proven techniques: acoustic driven voice recognition (using acoustic rather than statistical only models) and multi-channel biometrics incorporating dynamic face recognition (machine vision analysis of speech, lip movement and face). The vision of the SpeechXRays project is to provide a solution combining the convenience and cost-effectiveness of voice biometrics, achieving better accuracies by combining it with video, and bringing superior anti-spoofing capabilities. The technology will be deployed on 2000 users in 3 pilots: a workforce use case, an eHealth use case and a consumer use case. The project lasts 36 months and is coordinated by world leader in digital security solutions for the mobility space.
Unfold all
/
Fold all
More information & hyperlinks
Web resources: https://cordis.europa.eu/project/id/653586
Start date: 01-05-2015
End date: 30-04-2019
Total budget - Public funding: 5 278 189,82 Euro - 4 102 467,00 Euro
Cordis data

Original description

The SpeechXRays project will develop and test in real-life environments a user recognition platform based on voice acoustics analysis and audio-visual identity verification. SpeechXRays will outperform state-of-the-art solutions in the following areas:
· Security: high accuracy solution (cross over accuracy of 1/100 i.e. twice the commercial voice/face solutions)
· Privacy: biometric data stored in the device (or in a private cloud under the responsibility of the data subject)
· Usability: text-independent speaker identification (no pass phrase), low sensitivity to surrounding noise
· Cost-efficiency: use of standard embedded microphone and cameras (smartphones, laptops).
The project will combine and pilot two proven techniques: acoustic driven voice recognition (using acoustic rather than statistical only models) and multi-channel biometrics incorporating dynamic face recognition (machine vision analysis of speech, lip movement and face). The vision of the SpeechXRays project is to provide a solution combining the convenience and cost-effectiveness of voice biometrics, achieving better accuracies by combining it with video, and bringing superior anti-spoofing capabilities. The technology will be deployed on 2000 users in 3 pilots: a workforce use case, an eHealth use case and a consumer use case. The project lasts 36 months and is coordinated by world leader in digital security solutions for the mobility space.

Status

CLOSED

Call topic

DS-02-2014

Update Date

27-10-2022
Images
No images available.
Geographical location(s)
Structured mapping
Unfold all
/
Fold all
Horizon 2020
H2020-EU.3. SOCIETAL CHALLENGES
H2020-EU.3.7. Secure societies - Protecting freedom and security of Europe and its citizens
H2020-EU.3.7.0. Cross-cutting call topics
H2020-DS-2014-1
DS-02-2014 Access Control