CROWDMERSE | CAPTURING AND REPRODUCTION OF CROWDED ACOUSTIC ENVIRONMENTS FOR IMMERSIVE APPLICATIONS

Summary
CROWDMERSE enables real-time capture, processing, and reproduction of an immersive audio experience to the user of any event of interest, focusing on “crowded” acoustic events. Acoustic scenes with large audiences, such as sports events or music concerts, present significant challenges for immersive reproduction which have not been so far adequately considered in the signal processing community. Technological breakthrough in sports events broadcasting has a strong potential impact on media providers, and consequently on the European and global economy. The challenges of capturing and reproducing crowded acoustic events include the need to spatially capture and reproduce numerous sound sources, such as the applause and yells of the spectators, in addition to the “main” sounds of the event. Concerns regarding the privacy of the spectators must not be overlooked: the conversations of the audience members sitting near the microphone sensors must be eliminated. In order to spatially sample large venues, the acoustic sensors should be low-cost, small-sized, and support wireless operation. The developed algorithms should respect the limited sensor resources, while operating in real-time to enable commercial applications. Our final objective is to enable real-time delivery of crowded acoustic events so that the designed platform can be integrated with today’s High-Definition TV programs. CROWDMERSE focuses on sound capturing using multiple closely placed microphones forming a microphone array. The audio content is rendered through a home entertainment system equipped with multiple loudspeakers, accompanying the content of a typical HDTV broadcast. Addressing the scientific challenges and proposing a solution which can be integrated with current broadcasting principles is guaranteed given the previous involvement of the experienced researcher in sports broadcasting projects. The proposed methods are expected to have impact in the general area of immersive sound environments.
Unfold all
/
Fold all
More information & hyperlinks
Web resources: https://cordis.europa.eu/project/id/745677
Start date: 01-10-2017
End date: 28-02-2021
Total budget - Public funding: 254 457,00 Euro - 254 457,00 Euro
Cordis data

Original description

CROWDMERSE enables real-time capture, processing, and reproduction of an immersive audio experience to the user of any event of interest, focusing on “crowded” acoustic events. Acoustic scenes with large audiences, such as sports events or music concerts, present significant challenges for immersive reproduction which have not been so far adequately considered in the signal processing community. Technological breakthrough in sports events broadcasting has a strong potential impact on media providers, and consequently on the European and global economy. The challenges of capturing and reproducing crowded acoustic events include the need to spatially capture and reproduce numerous sound sources, such as the applause and yells of the spectators, in addition to the “main” sounds of the event. Concerns regarding the privacy of the spectators must not be overlooked: the conversations of the audience members sitting near the microphone sensors must be eliminated. In order to spatially sample large venues, the acoustic sensors should be low-cost, small-sized, and support wireless operation. The developed algorithms should respect the limited sensor resources, while operating in real-time to enable commercial applications. Our final objective is to enable real-time delivery of crowded acoustic events so that the designed platform can be integrated with today’s High-Definition TV programs. CROWDMERSE focuses on sound capturing using multiple closely placed microphones forming a microphone array. The audio content is rendered through a home entertainment system equipped with multiple loudspeakers, accompanying the content of a typical HDTV broadcast. Addressing the scientific challenges and proposing a solution which can be integrated with current broadcasting principles is guaranteed given the previous involvement of the experienced researcher in sports broadcasting projects. The proposed methods are expected to have impact in the general area of immersive sound environments.

Status

CLOSED

Call topic

MSCA-IF-2016

Update Date

28-04-2024
Images
No images available.
Geographical location(s)
Structured mapping
Unfold all
/
Fold all
Horizon 2020
H2020-EU.1. EXCELLENT SCIENCE
H2020-EU.1.3. EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions (MSCA)
H2020-EU.1.3.2. Nurturing excellence by means of cross-border and cross-sector mobility
H2020-MSCA-IF-2016
MSCA-IF-2016