Deep Kalman Filtering Network for Video Compression Artifact Reduction

Guo Lu, Wanli Ouyang, Dong Xu, Xiaoyun Zhang, Zhiyong Gao, Ming-Ting Sun; The European Conference on Computer Vision (ECCV), 2018, pp. 568-584


When lossy video compression algorithms are applied, compression artifacts often appear in videos, making decoded videos unpleasant for human visual systems. In this paper, we model the video artifact reduction task as a Kalman filtering procedure and restore decoded frames through a deep Kalman filtering network. Different from the existing works using the noisy previous decoded frames as the temporal information in restoration problem, we utilize the less noisy previous restored frame and build a recursive filtering scheme based on Kalman model. This strategy can provide more accurate and consistent temporal information, which produces higher quality restoration. In addition, the strong prior information of the prediction residual is also exploited for restoration through a well designed neural network. These two components are combined under the Kalman framework and optimized through the deep Kalman filtering network. Our approach can well bridge the gap between the model-based methods and learning-based methods by integrating the recursive nature of the Kalman model and highly non-linear transformation ability of deep neural network. Experimental results on the benchmark dataset demonstrate the effectiveness of our proposed method.

Related Material

author = {Lu, Guo and Ouyang, Wanli and Xu, Dong and Zhang, Xiaoyun and Gao, Zhiyong and Sun, Ming-Ting},
title = {Deep Kalman Filtering Network for Video Compression Artifact Reduction},
booktitle = {The European Conference on Computer Vision (ECCV)},
month = {September},
year = {2018}