VISIONS | Neural Video Processing and Streaming for Real-time Traffic Monitoring

Summary
With the rapid development of urbanization and continuous increase of vehicles on roadways, Intelligent Transportation Systems (ITS) play a key role in revolutionizing the way people commute. To make our cities safer and smarter, real-time traffic monitoring systems are deployed to help operators with observing traffic flows and identifying emergency situations.

This project aims to achieve real-time traffic monitoring with high-quality video transmission in smart cities, leveraging the emerging Artificial Intelligence methods in video processing and video streaming. Firstly, the features of human visual systems will be referred on video quality allocation to reduce the required bandwidth for video transmission. Next, an innovative method for end-to-end video processing based on Deep Neural Networks will be developed to allow the video rendering and streaming at a lower resolution and also restore/improve the quality at the user ends. Finally, a new bitrate adaption scheme based on Reinforcement Learning will be designed to accommodate the unexpected network dynamics, guaranteeing the Quality-of-Experience to be perceived by users. The expected outcome can promote safer and more efficient travel for millions of users in Europe and billions of users all over the world. Moreover, the results of this project can be used in other multimedia applications, such as cloud virtual reality, distance education, smart transportation, and healthcare where video processing and video streaming are needed.

To broaden the fellow’s knowledge horizon, a series of research, training, and knowledge transfer activities are planned. The new knowledge and skills imparted in these activities will further promote his academic portfolio and significantly enhance his career prosperity. The project will also play a solid foundation for the long-term and wide-range collaborations and eventually lead to more extensive impact of project results, from which both EU and China will benefit.
Unfold all
/
Fold all
More information & hyperlinks
Web resources: https://cordis.europa.eu/project/id/898588
Start date: 01-08-2021
End date: 31-07-2023
Total budget - Public funding: 224 933,76 Euro - 224 933,00 Euro
Cordis data

Original description

With the rapid development of urbanization and continuous increase of vehicles on roadways, Intelligent Transportation Systems (ITS) play a key role in revolutionizing the way people commute. To make our cities safer and smarter, real-time traffic monitoring systems are deployed to help operators with observing traffic flows and identifying emergency situations.

This project aims to achieve real-time traffic monitoring with high-quality video transmission in smart cities, leveraging the emerging Artificial Intelligence methods in video processing and video streaming. Firstly, the features of human visual systems will be referred on video quality allocation to reduce the required bandwidth for video transmission. Next, an innovative method for end-to-end video processing based on Deep Neural Networks will be developed to allow the video rendering and streaming at a lower resolution and also restore/improve the quality at the user ends. Finally, a new bitrate adaption scheme based on Reinforcement Learning will be designed to accommodate the unexpected network dynamics, guaranteeing the Quality-of-Experience to be perceived by users. The expected outcome can promote safer and more efficient travel for millions of users in Europe and billions of users all over the world. Moreover, the results of this project can be used in other multimedia applications, such as cloud virtual reality, distance education, smart transportation, and healthcare where video processing and video streaming are needed.

To broaden the fellow’s knowledge horizon, a series of research, training, and knowledge transfer activities are planned. The new knowledge and skills imparted in these activities will further promote his academic portfolio and significantly enhance his career prosperity. The project will also play a solid foundation for the long-term and wide-range collaborations and eventually lead to more extensive impact of project results, from which both EU and China will benefit.

Status

CLOSED

Call topic

MSCA-IF-2019

Update Date

28-04-2024
Images
No images available.
Geographical location(s)
Structured mapping
Unfold all
/
Fold all
Horizon 2020
H2020-EU.1. EXCELLENT SCIENCE
H2020-EU.1.3. EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions (MSCA)
H2020-EU.1.3.2. Nurturing excellence by means of cross-border and cross-sector mobility
H2020-MSCA-IF-2019
MSCA-IF-2019