Multichannel Color Image Denoising via Weighted Schatten p-norm Minimization
IJCAI, pp. 637-644, 2020.
EI
Weibo:
Abstract:
The R, G and B channels of a color image generally have different noise statistical properties or noise strengths. It is thus problematic to apply grayscale image denoising algorithms to color image denoising. In this paper, based on the non-local self-similarity of an image and the different noise strength across each channel, we propose...More
Code:
Data:
Introduction
- Noise corruption is inevitable during the image acquisition process and may heavily degrade the visual quality of an acquired image.
- The first kind involves applying grayscale image denoising algorithms to each channel in a channel-wise manner.
- These methods ignore the correlations between R, G and B channels, meaning that unsatisfactory results may be obtained.
- The second method is to transform the RGB color image into other color spaces [Dabov et al, 2007a]
- This transform, may change the noise distribution of the original observation data and introduce artifacts.
- The third type of method involves making full use of the correlation information across each channel and conduct the denoising task on R, G and B channels simultaneously [Zhang et al, 2017a]
Highlights
- Noise corruption is inevitable during the image acquisition process and may heavily degrade the visual quality of an acquired image
- In this paper, based on the low-rank property of the nonlocal self-similar patches and the different noise strength across each channel, we propose a multi-channel weighted Schatten p-norm minimization (MCWSNM) model for RGB color image denoising
- In this paper, based on the low-rank property of the non-local self-similarity, we propose a MultiChannel Weighted Schatten p-Norm Minimization method for color image denoising
- For noisy color images, which generally hold different noise strength in each band, a weight matrix assigned to the noise level of each channel is introduced in order balance each channel’s the contribution to the final estimation result
- MultiChannel Weighted Schatten p-Norm Minimization can be efficiently solved via alternating direction method of multipliers optimization framework
- Experiments on synthetic and real datasets demonstrate that the proposed method can obtain satisfactory results on the color image denoising task
Methods
- The image denoising task involves recovering a clean image xc from its noisy observation data yc, where c = {r, g, b}.
- The authors assume that the noisy image is corrupted by additive white Gaussian noise nc with σc =, where σr, σg, σb denote the noise standard deviation in the R, G, B channels, respectively.
- As a nonconvex surrogate of the rank function, the weighted Schatten p-norm of a matrix Z ∈ Rm×n is defined as Z w,Sp = (.
Conclusion
- In this paper, based on the low-rank property of the non-local self-similarity, the authors propose a MCWSNM method for color image denoising.
- For noisy color images, which generally hold different noise strength in each band, a weight matrix assigned to the noise level of each channel is introduced in order balance each channel’s the contribution to the final estimation result.
- Experiments on synthetic and real datasets demonstrate that the proposed method can obtain satisfactory results on the color image denoising task
Summary
Introduction:
Noise corruption is inevitable during the image acquisition process and may heavily degrade the visual quality of an acquired image.- The first kind involves applying grayscale image denoising algorithms to each channel in a channel-wise manner.
- These methods ignore the correlations between R, G and B channels, meaning that unsatisfactory results may be obtained.
- The second method is to transform the RGB color image into other color spaces [Dabov et al, 2007a]
- This transform, may change the noise distribution of the original observation data and introduce artifacts.
- The third type of method involves making full use of the correlation information across each channel and conduct the denoising task on R, G and B channels simultaneously [Zhang et al, 2017a]
Methods:
The image denoising task involves recovering a clean image xc from its noisy observation data yc, where c = {r, g, b}.- The authors assume that the noisy image is corrupted by additive white Gaussian noise nc with σc =, where σr, σg, σb denote the noise standard deviation in the R, G, B channels, respectively.
- As a nonconvex surrogate of the rank function, the weighted Schatten p-norm of a matrix Z ∈ Rm×n is defined as Z w,Sp = (.
Conclusion:
In this paper, based on the low-rank property of the non-local self-similarity, the authors propose a MCWSNM method for color image denoising.- For noisy color images, which generally hold different noise strength in each band, a weight matrix assigned to the noise level of each channel is introduced in order balance each channel’s the contribution to the final estimation result.
- Experiments on synthetic and real datasets demonstrate that the proposed method can obtain satisfactory results on the color image denoising task
Tables
- Table1: PSNR results (dB) of real color image CC Dataset
Funding
- This work was supported in part by the National Natural Science Foundation of China under Grants 61822113, 61976161, 62041105, the Science and Technology Major Project of Hubei Province (Next-Generation AI Technologies) under Grant 2019AEA170, the Natural Science Foundation of Hubei Province under Grants 2018CFA050, the Fundamental Research Funds for the Central Universities under Grant 413000092 and 413000082
Reference
- [Buades et al., 2005] Antoni Buades, Bartomeu Coll, and Jean-Michel Morel. A non-local algorithm for image denoising. In CVPR, pages 60–65, 2005.
- [Chatterjee and Milanfar, 2010] Priyam Chatterjee and Peyman Milanfar. Is denoising dead? IEEE Transactions on Image Processing, 19(4):895–911, 2010.
- [Chen et al., 2015] Guangyong Chen, Fengyuan Zhu, and Pheng-Ann Heng. An efficient statistical method for image noise level estimation. In ICCV, pages 447–485, 2015.
- [Dabov et al., 2007a] K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian. Color image denoising via sparse 3D collaborative filter with grouping constraint in LuminanceChrominance space. In ICIP, pages 313–316, 2007.
- [Dabov et al., 2007b] Kostadin Dabov, Alessandro Foi, Vladimir Katkovnik, and Karen O. Egiazarian. Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Transactions on Image Processing, 16(8):2080–2095, 2007.
- [Dong et al., 2013a] Weisheng Dong, Guangming Shi, and Xin Li. Nonlocal image restoration with bilateral variance estimation: A low-rank approach. IEEE Transactions on Image Processing, 22(2):700–711, 2013.
- [Dong et al., 2013b] Weisheng Dong, Lei Zhang, Guangming Shi, and Xin Li. Nonlocally centralized sparse representation for image restoration. IEEE Transactions on Image Processing, 22(4):1620–1630, 2013.
- [Fang et al., 2020a] Yixiang Fang, Xin Huang, Lu Qin, Ying Zhang, Wenjie Zhang, Reynold Cheng, and Xuemin Lin. A survey of community search over big graphs. The VLDB Journal, 29:353–392, 2020.
- [Fang et al., 2020b] Yixiang Fang, Yixing Yang, Wenjie Zhang, Xuemin Lin, and Xin Gao. Effective and efficient community search over large heterogeneous information networks. Proceedings of the VLDB Endowment, 13(6):854–867, 2020.
- [Gu et al., 2017] Shuhang Gu, Qi Xie, Deyu Meng, Wangmeng Zuo, Xiangchu Feng, and Lei Zhang. Weighted nuclear norm minimization and its applications to low level vision. International Journal of Computer Vision, 121(2):183–208, 2017.
- [Hu et al., 2019] Zhentao Hu, Zhiqiang Huang, Xinjian Huang, Fulin Luo, and Renzhen Ye. An adaptive nonlocal gaussian prior for hyperspectral image denoising. IEEE Geoscience and Remote Sensing Letters, 16(9):1487– 1491, 2019.
- [Lebrun et al., 2015] Marc Lebrun, Miguel Colom, and Jean-Michel Morel. The noise clinic: A blind image denoising algorithm. IPOL Journal, 5:1–54, 2015.
- [Liu et al., 2017] Weiwei Liu, Ivor W. Tsang, and KlausRobert Muller. An easy-to-hard learning paradigm for multiple classes and multiple labels. Journal of Machine Learning Research, 18(94):1–38, 2017.
- [Liu et al., 2018] Ding Liu, BihanWen, Xianming Liu, Zhangyang Wang, and Thomas S. Huang. When image denoising meets high-level vision tasks: A deep learning approach. In IJCAI, pages 842–848, 2018.
- [Liu et al., 2019] Weiwei Liu, Donna Xu, Ivor W. Tsang, and Wenjie Zhang. Metric learning for multi-output tasks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42(2):408–422, 2019.
- [Mairal et al., 2008] Julien Mairal, Michael Elad, and Guillermo Sapiro. Sparse representation for color image restoration. IEEE Transactions on Image Processing, 17(1):53–69, 2008.
- [Mairal et al., 2012] Julien Mairal, Francis R. Bach, and Jean Ponce. Task-driven dictionary learning. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(4):791–804, 2012.
- [Marsousi et al., 2014] Mahdi Marsousi, Kaveh Abhari, Paul Babyn, and Javad Alirezaie. An adaptive approach to learn overcomplete dictionaries with efficient numbers of elements. IEEE Transactions on Signal Processing, 62(12):3272–3283, 2014.
- [Nam et al., 2016] Seonghyeon Nam, Youngbae Hwang, Yasuyuki Matsushita, and Seon Joo Kim. A holistic approach to cross-channel image noise modeling and its application to image denoising. In CVPR, pages 1683–1691, 2016.
- [Roth and Black, 2005] Stefan Roth and Michael J. Black. Fields of experts: A framework for learning image priors. In CVPR, volume 2, pages 860–867, 2005.
- [Starck et al., 2002] Jean-Luc Starck, Emmanuel J. Candes, and David L. Donoho. The curvelet transform for image denoising. IEEE Transactions on Image Processing, 11(6):670–684, 2002.
- [Wang et al., 2018a] Zengmao Wang, Yuhong Guo, and Bo Du. Matrix completion with preference ranking for top-N recommendation. In IJCAI, pages 3585–3591, 2018.
- [Wang et al., 2018b] Zheng Wang, Xiang Bai, Mang Ye, and Shin’ichi Satoh. Incremental deep hidden attribute learning. In ACM MM, pages 72–80, 2018.
- [Xie et al., 2016] Yuan Xie, Shuhang Gu, Yan Liu, Wangmeng Zuo, Wensheng Zhang, and Lei Zhang. Weighted Schatten p-norm minimization for image denoising and background subtraction. IEEE Transactions on Image Processing, 25(10):4842–4857, 2016.
- [Xu et al., 2015] Jun Xu, Lei Zhang, Wangmeng Zuo, David Zhang, and Xiangchu Feng. Patch group based nonlocal self-similarity prior learning for image denoising. In ICCV, pages 244–252, 2015.
- [Xu et al., 2017a] Chen Xu, Zhouchen Lin, and Hongbin Zha. A unified convex surrogate for the Schatten-p norm. In AAAI, pages 926–932, 2017.
- [Xu et al., 2017b] Jun Xu, Lei Zhang, David Zhang, and Xiangchu Feng. Multi-channel weighted nuclear norm minimization for real color image denoising. In ICCV, pages 1096–1104, 2017.
- [Ye et al., 2018] Mang Ye, Zheng Wang, Xiangyuan Lan, and Pong C. Yuen. Visible thermal person re-identification via dual-constrained top-ranking. In IJCAI, pages 1092– 1099, 2018.
- [Zhang and Aeron, 2016] Zemin Zhang and Shuchin Aeron. Denoising and completion of 3D data via multidimensional dictionary learning. In IJCAI, pages 2371–2377, 2016.
- [Zhang et al., 2013] Min Zhang, Zheng-Hai Huang, and Ying Zhang. Restricted p-isometry properties of nonconvex matrix recovery. IEEE Transactions on Information Theory, 59(7):4316–4323, 2013.
- [Zhang et al., 2017a] Kai Zhang, Wangmeng Zuo, Yunjin Chen, Deyu Meng, and Lei Zhang. Beyond a Gaussian denoiser: Residual learning of deep CNN for image denoising. IEEE Transactions on Image Processing, 26(7):3142– 3155, 2017.
- [Zhang et al., 2017b] Kai Zhang, Wangmeng Zuo, Shuhang Gu, and Lei Zhang. Learning deep CNN denoiser prior for image restoration. In CVPR, pages 2808–2817, 2017.
- [Zhang et al., 2018] Kai Zhang, Wangmeng Zuo, and Lei Zhang. FFDNet: Toward a fast and flexible solution for CNN-based image denoising. IEEE Transactions on Image Processing, 27(9):4608–4622, 2018.
- [Zhu et al., 2016] Fengyuan Zhu, Guangyong Chen, and Pheng-Ann Heng. From noise modeling to blind image denoising. In CVPR, pages 420–429, 2016.
Full Text
Tags
Comments