Summary
The automated analysis of visual data is a key enabler for industrial and consumer technologies and of immense economic
and social importance. Its main challenge is in the inherent ambiguity of images due to the very mechanism of image
capture: light reaching a pixel on different paths or at different times is mixed irreversibly. Consequently, even after
decades of extensive research, problems like deblurring or descattering, geometry/material estimation or motion tracking
are still largely unsolved and will remain so in the foreseeable future.
Transient imaging (TI) tackles this problem by recording ultrafast optical echoes that unmix light contributions by the total
pathlength. So far, TI used to require high-end measurement setups. By introducing computational TI (CTI), we paved the
way for a lightweight capture of transient data using consumer hardware. We showed the potential of CTI in scenarios like
robust range measurement, descattering and imaging of objects outside the line of sight – tasks that had been considered
difficult to impossible so far.
The ECHO project is rooted in computer graphics and computational imaging. In it, we will overcome the practical limitations that are hampering a large-scale deployment of TI: the time required for data capture and to reconstruct the
desired information, both in the order of seconds to minutes, a lack of dedicated image priors and of quality guarantees for
the reconstruction, the limited accuracy and performance of forward models and the lack of ground-truth data and
benchmark methods.
Over the course of ECHO, we will pioneer advanced capture setups and strategies, signal formation models, priors and numerical
methods, for the first time enabling real-time reconstruction and analysis of transient light transport in complex and dynamic
scenes. The methodology developed in this far-reaching project will turn TI from a research technology into a family of
practical tools that will immediately benefit many applications.
and social importance. Its main challenge is in the inherent ambiguity of images due to the very mechanism of image
capture: light reaching a pixel on different paths or at different times is mixed irreversibly. Consequently, even after
decades of extensive research, problems like deblurring or descattering, geometry/material estimation or motion tracking
are still largely unsolved and will remain so in the foreseeable future.
Transient imaging (TI) tackles this problem by recording ultrafast optical echoes that unmix light contributions by the total
pathlength. So far, TI used to require high-end measurement setups. By introducing computational TI (CTI), we paved the
way for a lightweight capture of transient data using consumer hardware. We showed the potential of CTI in scenarios like
robust range measurement, descattering and imaging of objects outside the line of sight – tasks that had been considered
difficult to impossible so far.
The ECHO project is rooted in computer graphics and computational imaging. In it, we will overcome the practical limitations that are hampering a large-scale deployment of TI: the time required for data capture and to reconstruct the
desired information, both in the order of seconds to minutes, a lack of dedicated image priors and of quality guarantees for
the reconstruction, the limited accuracy and performance of forward models and the lack of ground-truth data and
benchmark methods.
Over the course of ECHO, we will pioneer advanced capture setups and strategies, signal formation models, priors and numerical
methods, for the first time enabling real-time reconstruction and analysis of transient light transport in complex and dynamic
scenes. The methodology developed in this far-reaching project will turn TI from a research technology into a family of
practical tools that will immediately benefit many applications.
Unfold all
/
Fold all
More information & hyperlinks
| Web resources: | https://cordis.europa.eu/project/id/802192 |
| Start date: | 01-12-2018 |
| End date: | 30-11-2023 |
| Total budget - Public funding: | 1 525 840,00 Euro - 1 525 840,00 Euro |
Cordis data
Original description
The automated analysis of visual data is a key enabler for industrial and consumer technologies and of immense economicand social importance. Its main challenge is in the inherent ambiguity of images due to the very mechanism of image
capture: light reaching a pixel on different paths or at different times is mixed irreversibly. Consequently, even after
decades of extensive research, problems like deblurring or descattering, geometry/material estimation or motion tracking
are still largely unsolved and will remain so in the foreseeable future.
Transient imaging (TI) tackles this problem by recording ultrafast optical echoes that unmix light contributions by the total
pathlength. So far, TI used to require high-end measurement setups. By introducing computational TI (CTI), we paved the
way for a lightweight capture of transient data using consumer hardware. We showed the potential of CTI in scenarios like
robust range measurement, descattering and imaging of objects outside the line of sight – tasks that had been considered
difficult to impossible so far.
The ECHO project is rooted in computer graphics and computational imaging. In it, we will overcome the practical limitations that are hampering a large-scale deployment of TI: the time required for data capture and to reconstruct the
desired information, both in the order of seconds to minutes, a lack of dedicated image priors and of quality guarantees for
the reconstruction, the limited accuracy and performance of forward models and the lack of ground-truth data and
benchmark methods.
Over the course of ECHO, we will pioneer advanced capture setups and strategies, signal formation models, priors and numerical
methods, for the first time enabling real-time reconstruction and analysis of transient light transport in complex and dynamic
scenes. The methodology developed in this far-reaching project will turn TI from a research technology into a family of
practical tools that will immediately benefit many applications.
Status
CLOSEDCall topic
ERC-2018-STGUpdate Date
27-04-2024
Images
No images available.
Geographical location(s)
