Performance Analysis of Applying Deep Learning for Virtual Background of WebRTC-based Video Conferencing System

With the advancement of artificial intelligence(AI) technology, AI is being used in various industries such as factory automation and autonomous driving. Video conferencing systems have also added functions that use AI to overcome the limitations of existing algorithms, for example, super resolution and virtual background functions using image segmentation. However, web-based video conferencing limits the application of these features due to a limited web browser environment. In this paper, we introduce several approaches to apply deep learning in a web browser environment to provide the features that use deep learning models, and introduce image segmentation models used for virtual background functions in each method and evaluate their performance. Finally, we discuss areas that need to be considered to apply deep learning models to web-based video conferencing.