Browse > Article

JND based Illumination and Color Restoration Using Edge-preserving Filter  

Han, Hee-Chul (DMC R&D Center Samsung Electronics, School of Electrical and Electronic Engineering Yonsei University)
Sohn, Kwan-Hoon (School of Electrical and Electronic Engineering, Yonsei University, Yonsei University)
Publication Information
Journal of the Institute of Electronics Engineers of Korea SP / v.46, no.6, 2009 , pp. 132-145 More about this Journal
Abstract
We present the framework for JND based Illumination and Color Restoration Using Edge-preserving filter for restoring distorted images taken under the arbitrary lighting conditions. The proposed method is effective for appropriate illumination compensation, vivid color restoration, artifacts suppression, automatic parameter estimation, and low computation cost for HW implementation. We show the efficiency of the mean shift filter and sigma filter for illumination compensation with small spread parameter while considering the processing time and removing the artifacts such as HALO and noise amplification. The suggested CRF (color restoration filter) can restore the natural color and correct color distortion artifact more perceptually compared with current solutions. For the automatic processing, the image statistics analysis finds suitable parameter using JND and all constants are pre-defined. We also introduce the ROI-based parameter estimation dealing with small shadow area against spacious well-exposed background in an image for the touch-screen camera. The object evaluation is performed by CMC, CIEde2000, PSNR, SSIM, and 3D CIELAB gamut with state-of-the-art research and existing commercial solutions.
Keywords
휘도 보상;색상 복원;경계 보호 평탄화 필터;디지털 카메라;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 D. J. Jobson, Z. Rahman, and G. A. Woodell, "A multi-Scale Retinex for bridging the gap between color images and the human observation of scenes," IEEE Trans. on Image Processing, no. 7, pp. 965-976, Jul. 1997
2 M. Elad, "Retinex by two bilateral filters," in Proc. 5th Int. Conf. Scale-Space, pp. 217–229, Apr 2005   DOI   ScienceOn
3 W. Wang, B. Li, J. Zheng, S. Xian, and J. Wang,"A fast multi-scale retinex algorithm for color image enhancement," Int. Conf. on Wavelet Analysis and Pattern Recognition, pp80-85, Sep. 2008
4 Z. Buyue and A. Jan P., "Adaptive bilateral filter for sharpness enhancement and noise removal," IEEE Trans. Image Process, vol. no.5, pp. 664-78, 2008
5 A. Beoldo, A. Regazzoni, and C. S. Regazzoni, "Multiple cue adaptive tracking of deformable objects with particle filter dore", International Conference on Image Processing, pp. 237-240, 2008
6 D. Comaniciu and P. Meer, "Mean shift analysis and applications," IEEE Int. Conf. Computer Vision, pp. 1197-1203, 1999
7 M. R. Luo, G. Cui, and B. Rigg, "The development of the CIE 2000 colour-difference formula: CIEDE2000," Color Res. Appl. vol. 26, pp. 340-350, 2001   DOI   ScienceOn
8 C. Vyacheslav, "Image processing method and computer software for image processing", WO 2006/018658 A2
9 V. Vonikakis, I. Andreadis and A. Gasteratos, " Fast centre-surround contrast modification," IET Image Processing, vol.2, issue 1, pp. 19-34, Feb. 2008   DOI   ScienceOn
10 주명호, 강행봉, "레티넥스를 이용한 조명 변화 이미지 보상 기법", 대한전자공학회 하계종합 학술 대회 논문집 제2호, pp. 555-556, 2007년
11 F. Durand and J. Dorsey, "Fast bilateral filtering for the display of high-dynamic-range images , " ACM Trans. Graph. Vol. 21, issue 3, pp257–266, Jul. 2002   DOI
12 C. Tomasi and R. Manduchi, "Bilateral filtering for gray and color images," In Proc. Int. Conf. Computer Vis., pp. 839–846, 1998   DOI
13 S. Bo, T. Wenjing, C. Weifang, L. Hongyu, L. Jiang, and G. Wei, "Luminance based MSR for color image enhancement," Image and Signal Processing, vol. 3, pp. 358 - 362,May. 2008
14 A. Rizzi, C. Gatta, and D. Marini, "From Retinex to ACE: Issues in digital images unsupervised color equalization", Journal of Electronic Imaging, vol. 13, no. 1, pp. 15-28, Jan. 2004   DOI   ScienceOn
15 R. Bergman, H. Nachlieli, G. Ruckenstein, M. Shaw, and R. Bhaskar, "Perceptual segmentation: combining image segmentation with object tagging," HPL-2008-185, 2008
16 A. G. Rempel, M. Trentacoste, H. Seetzen, H. David Young, W. Heidrich, L. Whitehead, and G. Ward, "Ldr2Hdr: on-the-fly reverse tone mapping of legacy video and photographs," ACM Transactions on Graphics vol. 26 issue 3, pp 39-es, Aug. 2007   DOI   ScienceOn
17 장인수, 박기현, 하영호, "이미지의 색도 분포를 고려한 다중 Retinex 기반의 칼라 향상 기법", 전자공학회 하계 종합 학술 대회 논문집, 제 31권 제 1호, pp.845-846, 2008년   과학기술학회마을
18 H. Han and K. Sohn, "Automatic Illumination and Color Compensation Using Mean Shift and Sigma Filter," IEEE Trans. on Consumer Electronics , submitted for publication, 2009
19 Z. Farbman, R. Fattal, D. Lischinski, and R. Szeliski, "Edge-preserving decompositions for multi-scale tone and detail manipulation," ACM Trans. on Graphics, vol. 27, no.67, Aug. 2008
20 E. Eisemann and F. Durand, "Flash photography enhancement via intrinsic relighting," ACM Trans. Graph., vol. 23, no. 3, pp. 673–678, 2004   DOI
21 www.adobe.com
22 A. Iranli, W. Lee, and M. Pedram, "HVS-aware dynamic backlight scaling in TFT-LCDs," IEEE Trans. Very Large Scale Integration Systems, vol. 14, pp. 1103–1116, Oct. 2006   DOI   ScienceOn
23 E. Provenzi, C. Gatta, M. Fierro, and A. Rizzi, "A spatially variant white-patch and gray-world method for color image enhancement driven by local contrast," IEEE Trans. Pattern Anal. Machine Intell., vol. 30, no. 10, pp 1757-1770, 2008   DOI   ScienceOn
24 L. Meylan and S. Süsstrunk, "Bio-inspired color image enhancement," SPIE Electronic Imaging, vol. 5292, P46-56, 2004.
25 Z. Rahman, G. A. Woodell, and D. J. Jobson, "A comparison of the multiscale Retinex with other image enhancement techniques," Proc. of the IS&T 50th Anniversary Conference, pp. 426–431 May. 1997
26 D. Comaniciu and P. Meer. "Mean shift: a robust approach toward feature space analysis," IEEE Trans. Pattern Anal. Machine Intell., vol. 24, no. 5, pp. 603–619, 2002   DOI   ScienceOn
27 D. Lischinski, Z. Farbman, M. Uyttendaele, and R. Szeliski, "Interactive local adjustment of tonal values," ACM Trans. Graph., vol.25, no. 3, pp. 646–653, 2006   DOI   ScienceOn
28 www.gimp.org
29 D. J. Jobson, Z. Rahman, and G. A. Woodell, "Properties and performance of a center/surround Retinex," IEEE Trans. on Image Processing, vol. 6, no. 3, pp. 451-462. Mar. 1997   DOI   ScienceOn
30 E. Provenzi, M. Fierro, A. Rizzi, L. D. Carli, D. Gadia, and D. Marini, "Random spray retinex: a new Retinex implementation to investigate the local properties of the model," IEEE TIP, vol.16, pp162-171, 2007
31 H. Y. Liu, S.Q. Jiang, Q.M. Huang, C.S. Xu and W. Gao., "Region-based visual attention analysis with its application in. image browsing on small displays," ACM International Conference on Multimedia, pp: 815-824, Oct. 2006
32 G. Petschnigg, R. Szeliski, M. Agrawala, M. Cohen, H. Hoppe, and K. Toyama, "Digital photography with flash and. no-flash image pairs," ACM Trans. Graph., vol.23, no. 3, pp. 664–672, 2004   DOI   ScienceOn
33 C. Gatta, A. Rizzi and D. Marini, "Perceptually inspired HDR images tone mapping with color correction," International Journal of Imaging Systems and Technology, pp285-294, 2007   DOI   ScienceOn
34 M. Ghazal, A. Amer, and A. Ghrayeb, "A fast directional sigma filter for noise reduction in digital TV signals," IEEE Trans. on Consumer Electronics, vol.53, no.4, pp. 1500-1507, 2007   DOI   ScienceOn
35 http://imaging.nikon.com/products/imaging/ technology /d-technology /expeed /d_lighting /index.htm
36 D. H. Choi and I. H. Jang, M. H. Kim, and N. C. Kim, "Color image enhancement using single-scale Retinex based on an improved image formation model," European Signal Processing Conference, Aug. 2008
37 J. S. Lee, "Digital image smoothing and the sigma filter, "Computer Graphics Image Processing, vol. 24, pp. 255-269, 1983   DOI
38 I. V. Safonov, "Automatic correction of amateur photos damaged by backlighting, " Graphicon, 2006
39 H. C, Han and K. H. Sohn, "Face relighting based on virtual irradiance sphere and reflection coefficient," Optical Engineering, vol.47, no.2, Feb 2008   DOI   ScienceOn
40 S. Paris, "Edge-preserving smoothing and mean-shift segmentation of video streams," European Conference on Computer Vision, vol. 2, pp. 460-473, 2008   DOI   ScienceOn
41 www.hdrsoft.com
42 L. Meylan and S. Süsstrunk, "Color image enhancement using a Retinex based adaptive filter," European Conference on. Color in Graphics, Image, and Vision, vol. 2, pp. 359-363, 2004
43 E. Land, "An alternative technique for the computation of the designator in the Retinex theory of color vision," Proc. Nat. Acad, Sci., vol.83, pp. 3078-3080, 1986   DOI   ScienceOn
44 V. Vonikakis and I. Andreadis, "Fast automatic compensation of under/over-exposured image regions", PSIVT, 2007
45 AATCC Test Method 173-1998, "CMC: calculation of small color differences for acceptability," AATCC Technical Manual, pp. 311-315, 2005
46 R. Fattal, M. Agrawala, and S. Rusinkiewicz, "Multiscale shape and detail enhancement from multi-light image collections," ACM Trans. Graph. 26, 3 (July), Article 51.,2007   DOI   ScienceOn
47 Y. Wong, "Image enhancement by edge-preserving filtering," Int. Conf. on Image Processing , vol. 2, pp. 522-524, Nov. 1994
48 Y. M.Baek, H. J. Kim, J. A. Lee, Sang-Guen Oh, and W. Y. Kim, "Color image enhancement using the laplacian pyramid," Advances in Multimedia Information Processing - PCM, pp 760-769, 2006   DOI   ScienceOn