Browse > Article
http://dx.doi.org/10.3837/tiis.2011.02.009

A Perception-based Color Correction Method for Multi-view Images  

Shao, Feng (Faculty of Information Science and Engineering, Ningbo University)
Jiang, Gangyi (Faculty of Information Science and Engineering, Ningbo University)
Yu, Mei (Faculty of Information Science and Engineering, Ningbo University)
Peng, Zongju (Faculty of Information Science and Engineering, Ningbo University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.5, no.2, 2011 , pp. 390-407 More about this Journal
Abstract
Three-dimensional (3D) video technologies are becoming increasingly popular, as it can provide users with high quality and immersive experiences. However, color inconsistency between the camera views is an urgent problem to be solved in multi-view imaging. In this paper, a perception-based color correction method for multi-view images is proposed. In the proposed method, human visual sensitivity (VS) and visual attention (VA) models are incorporated into the correction process. Firstly, the VS property is used to reduce the computational complexity by removing these visual insensitive regions. Secondly, the VA property is used to improve the perceptual quality of local VA regions by performing VA-dependent color correction. Experimental results show that compared with other color correction methods, the proposed method can greatly promote the perceptual quality of local VA regions greatly and reduce the computational complexity, and obtain higher coding performance.
Keywords
Free viewpoint video; multi-view images; color correction; visual attention; visual sensitivity;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
Times Cited By Web Of Science : 0  (Related Records In Web of Science)
Times Cited By SCOPUS : 0
연도 인용수 순위
1 K. Muller, A. Smolic, K. Dix, P. Merkle, P. Kauff and T. Wiegand, "View synthesis for advanced 3D video system," EURASIP Journal on Image and Video Processing, vol. 2008, Article ID 438148, 11 pages, 2008.
2 S. H. Lee and J. H. Choi, "Design and implementation of color correction system for images captured by digital camera," IEEE Transactions on Consumer Electronics, vol. 54, no. 2, pp. 268-276, 2008.   DOI
3 Y. Morvan, D. Farin and P. H. N. de With, "System architecture for free-viewpoint video and 3D-TV," IEEE Transactions on Consumer Electronics, vol. 54, no. 2, pp. 925-932, 2008.   DOI
4 ISO/IEC JTC1/SC29/WG11, "Joint multiview video model (JMVM) 7.0," JVT-Z207, Antalya, Turkey, Jan. 2008.
5 Y. Zhang, G. Jiang, M. Yu, Y. Yang, Z. Peng and K. Chen, "Depth perceptual region-of-interest based multiview video coding," Journal of Visual Communication and Image Representation, vol. 21, no. 5-6, pp. 498-512, 2010.   DOI
6 J. Lubin, M. Brill and R. Crane, "Vision model-based assessment of distortion magnitudes in digital video," Available: http://www.mpeg.org/MPEG/JND.
7 R. Achanta, S. Hemami, F. Estrada and S. Süsstrunk, "Frequency-tuned salient region detection," in Proc. of International Conference on Computer Vision and Pattern Recognition, Miami, U.S.A., 2009.
8 J. Hur, S. Cho and Y. Lee, "Adaptive local illumination change compensation method for H.264/AVC-based multiview video coding," IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, no. 11, pp. 1496-1505, 2007.   DOI
9 ISO/IEC JTC1/SC29/WG11, "KDDI multi-view video sequences for MPEG 3DAV use," Doc. M10533, Munich, Germany, 2004.
10 A. Rizzi and C. Gatta, "From retinex to automatic color equalization: issues in developing a new algorithm for unsupervised color equalization," Journal of Electronics Imaging, vol. 13, no. 1, pp. 75-84, 2004.   DOI
11 M. Bertalmio, V. Caselles, E. Provenzi and A. Rizzi, "Perceptual Color correction through variational techniques," IEEE Transactions on Image Processing, vol. 16, no. 4, pp. 1058-1072, 2007.   DOI
12 R. Palma-Amestoy, E. Provenzi, M. Bertalmio and V. Caselles, "A perceptually inspired variational framework for color enhancement," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 3, pp. 458-474, March 2009.   DOI
13 F. W. M. Stentiford and A. Bamidele, "Attention-based colour correction," in Proc. of the SPIE, vol. 6057, pp. 158-167, 2006.
14 ISO/IEC JTC1/SC29/WG11, "Available Technologies for FTV," Doc. M15088, Antalya, Turkey, January 2008.
15 T. Lanrence and A. Brian, "Color constancy: A method for recovering surface spectral reflectance," Journal of Optical Society of America(A), vol. 3, no. 1, pp. 29-33, 1986.   DOI
16 F. Shao, G. Jiang, M. Yu and Y. Ho, "Fast color correction for multi-view video by modeling spatio-temporal variation," Journal of Visual Communication and Image Representation, vol. 21, no. 5-6, pp. 392-403, 2010.   DOI
17 F. Shao, G. Jiang, M. Yu and Y. Ho, "Highlight-detection-based color correction method for multi-view images," ETRI Journal, vol. 31, no. 4, pp. 448-450, 2009.   DOI
18 U. Fecker, M. Markowsky and A. Kaup, "Histogram-based pre-filtering for luminance and chrominance compensation of multi-view video," IEEE Transactions on Circuits and Systems for Video Technology, vol. 18, no. 9, pp. 1258-1267, 2008.   DOI
19 K. Yamamoto, M. Kitahara, H. Kimata, T. Yendo, T. Fujii, M. Tanimoto, S. Shimizu, K. Kamikura and Y. Yashima, "Multiview video coding using view interpolation and color correction," IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, no. 11, pp. 1436-1449, 2007.   DOI
20 Y. Chen, J. Chen and C. Cai, "Luminance and chrominance correction for multi-view video using simplified color error model," in Proc. of Picture Coding Symposium, Beijing, China, April 2006.
21 F. Shao, G. Jiang and M. Yu, "Multi-view video color correction using dynamic programming," Journal of System Engineering and Electronics, vol. 19, no. 6, pp. 1115-1120, 2008.   DOI
22 Z. Lu, W. lin, X. Yang, E. Ong and S. Yao, "Modelling visual attention's modulatory aftereffects on visual sensitivity and quality evaluation," IEEE Transactions on Image Processing, vol. 14, no. 11, pp. 1928-1942, 2005.   DOI
23 X. Yang, W. Lin, Z. Lu, E. Ong and S. Yao, "Motion-compensated residue preprocessing in video coding based on just-noticeable-distortion profile," IEEE Transactions on Circuits and Systems for Video Technology, vol. 15, no. 6, pp. 742-751, 2005.   DOI
24 K. Barnard, V. Cardei and B. Funt, "A comparison of computational color constancy algorithms - Part 1: methodology and experiments with synthesized data," IEEE Transactions on Image Processing, vol. 11, no. 9, pp. 972-983, 2002.   DOI
25 P. Merkle, A. Smolic, K. Muller and T. Wiegand, "Efficient prediction structures for multiview video coding," IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, no. 11, pp. 1461-1473, 2007.   DOI
26 A. Kubota, A. Smolic, M. Magnor, M. Tanimoto, T. Chen and C. Zhang, "Multiview imaging and 3DTV," IEEE Signal Processing Magazine, vol. 24, no. 6, pp. 10-21, 2007.