Quality-aware CNN-based In-Loop Filter for Video Coding

The state‐of‐the‐art video coding standard, Versatile Video Coding (VVC) or H.266, has demonstrated its superior coding efficiency over its predecessor HEVC/H.265. In this paper, a novel in‐loop filter based on convolutional neural network (CNN) is illustrated to further improve the coding efficiency over VVC. In this filter, one single NN model is used to process multiple video components simultaneously. In addition, with a quality map generated for each video component as network input, the same single NN model is capable of processing videos in different qualities and resolutions while maintaining coding efficiency, which reduces the overall network complexity significantly. Simulation results show that the proposed approach provides average BD‐rate savings of 6.27%, 18.78% and 20.42% under AI configuration, and average BD-rate savings of 5.18%, 21.95% and 22.13% under RA configuration, respectively for Y, Cb and Cr components.