Multiple Cars Remote Monitoring System using AI-based Video Streaming and Alert

Autonomous driving is attracting attention. Though related technologies are evolving, it is forecasted that Level 5 autonomous driving (full driving automation) would be ordinary in the 2040s to 2060s. Until the epoch, remote human support is necessary to deal with the cases in which an autonomous car cannot decide by itself. For the remote human support, live video streaming and user interface for effective monitoring are significant challenges. This paper proposes a live video streaming method that minimizes video bitrate while keeping the required video quality (video analytics accuracy) and AI-assisted monitoring GUI (graphical user interface) to monitor multiple cars effectively. First, the authors evaluated the GUI through simulation. The result shows that it improves efficiency and reduces mental and physical loads. Then, the authors conducted field tests in which an operator monitored two cars. The operators said that the proposed system is much better than the conventional systems they usually use and can monitor and control at least two cars simultaneously employing the system.