ENVISION | Enabling Visual IoT Applications with Advanced Network Coding Algorithms

Summary
The latest advances and integration of several key technologies such as wireless communications, low-power sensing, embedded systems, Internet protocols and cloud computing, have enabled the emergence of the Internet of Things (IoT) paradigm. However, the ever-growing deployment of the visual sensing applications within IoT deployments is expected to strain the network and cloud infrastructures used to deliver and store massive amounts of visual data. To partly address these challenges, prototypes of neuromorphic visual sensors, a.k.a. dynamic vision sensors (DVS), have been produced in the last two years. Instead of the conventional raster scan of video cameras, DVS devices record pixel coordinates and timestamps of reflectance events in an asynchronous manner, thereby offering substantial improvements in sampling speed and power consumption. ENVISION argues that, in order to fully exploit the advantages of neuromorphic sensing for IoT applications, such devices should be coupled with appropriate transmission and storage mechanisms that would take advantage of the visual data properties to achieve even higher bandwidth, power and storage efficiency. The ENVISION project aims at developing such data-driven delivery and storage algorithms based on advanced network coding techniques for data acquired by both conventional frame-based video cameras and DVS devices. Specifically, ENVISION is pursuing three interconnected research objectives: (i) designing advanced content-driven network codes for efficient transmission of the visual content captured by neuromorphic and conventional visual sensors to the cloud service under bandwidth and power constraints, (ii) developing novel content-aware network codes for storage of the visual content under the cost-performance optimisation framework, and (iii) investigating approximate decoding techniques including both the theoretical analysis of the performance and the implementation of practical low-complexity decoders.
Unfold all
/
Fold all
More information & hyperlinks
Web resources: https://cordis.europa.eu/project/id/750254
Start date: 15-01-2018
End date: 14-01-2020
Total budget - Public funding: 195 454,80 Euro - 195 454,00 Euro
Cordis data

Original description

The latest advances and integration of several key technologies such as wireless communications, low-power sensing, embedded systems, Internet protocols and cloud computing, have enabled the emergence of the Internet of Things (IoT) paradigm. However, the ever-growing deployment of the visual sensing applications within IoT deployments is expected to strain the network and cloud infrastructures used to deliver and store massive amounts of visual data. To partly address these challenges, prototypes of neuromorphic visual sensors, a.k.a. dynamic vision sensors (DVS), have been produced in the last two years. Instead of the conventional raster scan of video cameras, DVS devices record pixel coordinates and timestamps of reflectance events in an asynchronous manner, thereby offering substantial improvements in sampling speed and power consumption. ENVISION argues that, in order to fully exploit the advantages of neuromorphic sensing for IoT applications, such devices should be coupled with appropriate transmission and storage mechanisms that would take advantage of the visual data properties to achieve even higher bandwidth, power and storage efficiency. The ENVISION project aims at developing such data-driven delivery and storage algorithms based on advanced network coding techniques for data acquired by both conventional frame-based video cameras and DVS devices. Specifically, ENVISION is pursuing three interconnected research objectives: (i) designing advanced content-driven network codes for efficient transmission of the visual content captured by neuromorphic and conventional visual sensors to the cloud service under bandwidth and power constraints, (ii) developing novel content-aware network codes for storage of the visual content under the cost-performance optimisation framework, and (iii) investigating approximate decoding techniques including both the theoretical analysis of the performance and the implementation of practical low-complexity decoders.

Status

CLOSED

Call topic

MSCA-IF-2016

Update Date

28-04-2024
Images
No images available.
Geographical location(s)
Structured mapping
Unfold all
/
Fold all
Horizon 2020
H2020-EU.1. EXCELLENT SCIENCE
H2020-EU.1.3. EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions (MSCA)
H2020-EU.1.3.2. Nurturing excellence by means of cross-border and cross-sector mobility
H2020-MSCA-IF-2016
MSCA-IF-2016