대한전자공학회논문지SP (Journal of the Institute of Electronics Engineers of Korea SP)

대한전자공학회 (The Institute of Electronics and Information Engineers)
권호 표지

JND와 경계 보호 평탄화 필터를 이용한 휘도 및 색상 복원

JND based Illumination and Color Restoration Using Edge-preserving Filter

  • 한희철 (삼성전자 DMC 연구소, 연세대학교 전기전자공학과) ;
  • 손광훈 (연세대학교 전기전자 공학과)
  • Han, Hee-Chul (DMC R&D Center Samsung Electronics, School of Electrical and Electronic Engineering Yonsei University) ;
  • Sohn, Kwan-Hoon (School of Electrical and Electronic Engineering, Yonsei University, Yonsei University)
  • 발행 : 2009.11.25
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

본 논문에서는 임의의 조명 상황에서 왜곡된 영상을 JND(Just noticeable difference)와 경계 보호 평탄화 필터(edge-preserving smoothing filter)를 사용하여 자동적으로 휘도 및 색상을 복원하는 기법을 제안한다. 제안된 방법은 최적의 휘도 보상, 선명한 색상 복원, 휘도 보상 시 발생되는 여러 가지 문제점의 최소화, 자동화된 매개변수 추정 그리고 하드웨어 구현을 위한 고속화 등을 목적으로 하고 있다. 이를 위하여 본 논문에서는 후광효과(HALO)나 노이즈 증폭 등의 눈에 거슬리는 결함을 제거하기 위하여 경계 보호 평탄화 필터의 효용성에 대해 보인다. 또한 제안된 색상 복원 함수는 인간시각에 근거해 자연스러운 색상의 복원과 왜곡된 색상의 보정을 수행한다. 자동화된 처리를 위하여 영상의 통계적 분석과 JND를 이용해 적합한 매개변수를 찾으며 모든 상수는 미리 정의되어 사용된다. 또한 터치스크린 카메라를 이용한 관심영역(ROI : Region of Interest) 기반 매개변수 추정기법을 사용하여 역광 사진 보정을 좀 더 효율적으로 수행한다. 객관적 평가를 위해 CMC, CIEde2000, PSNR, SSIM, 그리고 3D CIELAB 색역을 기존의 연구나 상업 제품들과 비교하였다.

We present the framework for JND based Illumination and Color Restoration Using Edge-preserving filter for restoring distorted images taken under the arbitrary lighting conditions. The proposed method is effective for appropriate illumination compensation, vivid color restoration, artifacts suppression, automatic parameter estimation, and low computation cost for HW implementation. We show the efficiency of the mean shift filter and sigma filter for illumination compensation with small spread parameter while considering the processing time and removing the artifacts such as HALO and noise amplification. The suggested CRF (color restoration filter) can restore the natural color and correct color distortion artifact more perceptually compared with current solutions. For the automatic processing, the image statistics analysis finds suitable parameter using JND and all constants are pre-defined. We also introduce the ROI-based parameter estimation dealing with small shadow area against spacious well-exposed background in an image for the touch-screen camera. The object evaluation is performed by CMC, CIEde2000, PSNR, SSIM, and 3D CIELAB gamut with state-of-the-art research and existing commercial solutions.

키워드

참고문헌

  1. S. Bo, T. Wenjing, C. Weifang, L. Hongyu, L. Jiang, and G. Wei, "Luminance based MSR for color image enhancement," Image and Signal Processing, vol. 3, pp. 358 - 362,May. 2008
  2. E. Land, "An alternative technique for the computation of the designator in the Retinex theory of color vision," Proc. Nat. Acad, Sci., vol.83, pp. 3078-3080, 1986 https://doi.org/10.1073/pnas.83.10.3078
  3. D. J. Jobson, Z. Rahman, and G. A. Woodell, "Properties and performance of a center/surround Retinex," IEEE Trans. on Image Processing, vol. 6, no. 3, pp. 451-462. Mar. 1997 https://doi.org/10.1109/83.557356
  4. D. J. Jobson, Z. Rahman, and G. A. Woodell, "A multi-Scale Retinex for bridging the gap between color images and the human observation of scenes," IEEE Trans. on Image Processing, no. 7, pp. 965-976, Jul. 1997
  5. Z. Rahman, G. A. Woodell, and D. J. Jobson, "A comparison of the multiscale Retinex with other image enhancement techniques," Proc. of the IS&T 50th Anniversary Conference, pp. 426–431 May. 1997
  6. Y. Wong, "Image enhancement by edge-preserving filtering," Int. Conf. on Image Processing , vol. 2, pp. 522-524, Nov. 1994
  7. M. Elad, "Retinex by two bilateral filters," in Proc. 5th Int. Conf. Scale-Space, pp. 217–229, Apr 2005 https://doi.org/10.1007/11408031_19
  8. A. G. Rempel, M. Trentacoste, H. Seetzen, H. David Young, W. Heidrich, L. Whitehead, and G. Ward, "Ldr2Hdr: on-the-fly reverse tone mapping of legacy video and photographs," ACM Transactions on Graphics vol. 26 issue 3, pp 39-es, Aug. 2007 https://doi.org/10.1145/1276377.1276426
  9. Z. Farbman, R. Fattal, D. Lischinski, and R. Szeliski, "Edge-preserving decompositions for multi-scale tone and detail manipulation," ACM Trans. on Graphics, vol. 27, no.67, Aug. 2008
  10. F. Durand and J. Dorsey, "Fast bilateral filtering for the display of high-dynamic-range images , " ACM Trans. Graph. Vol. 21, issue 3, pp257–266, Jul. 2002 https://doi.org/10.1145/566570.566574
  11. R. Fattal, M. Agrawala, and S. Rusinkiewicz, "Multiscale shape and detail enhancement from multi-light image collections," ACM Trans. Graph. 26, 3 (July), Article 51.,2007 https://doi.org/10.1145/1276377.1276441
  12. E. Eisemann and F. Durand, "Flash photography enhancement via intrinsic relighting," ACM Trans. Graph., vol. 23, no. 3, pp. 673–678, 2004 https://doi.org/10.1145/1186562.1015778
  13. G. Petschnigg, R. Szeliski, M. Agrawala, M. Cohen, H. Hoppe, and K. Toyama, "Digital photography with flash and. no-flash image pairs," ACM Trans. Graph., vol.23, no. 3, pp. 664–672, 2004 https://doi.org/10.1145/1015706.1015777
  14. I. V. Safonov, "Automatic correction of amateur photos damaged by backlighting, " Graphicon, 2006
  15. L. Meylan and S. Süsstrunk, "Bio-inspired color image enhancement," SPIE Electronic Imaging, vol. 5292, P46-56, 2004.
  16. D. H. Choi and I. H. Jang, M. H. Kim, and N. C. Kim, "Color image enhancement using single-scale Retinex based on an improved image formation model," European Signal Processing Conference, Aug. 2008
  17. E. Provenzi, M. Fierro, A. Rizzi, L. D. Carli, D. Gadia, and D. Marini, "Random spray retinex: a new Retinex implementation to investigate the local properties of the model," IEEE TIP, vol.16, pp162-171, 2007
  18. E. Provenzi, C. Gatta, M. Fierro, and A. Rizzi, "A spatially variant white-patch and gray-world method for color image enhancement driven by local contrast," IEEE Trans. Pattern Anal. Machine Intell., vol. 30, no. 10, pp 1757-1770, 2008 https://doi.org/10.1109/TPAMI.2007.70827
  19. C. Gatta, A. Rizzi and D. Marini, "Perceptually inspired HDR images tone mapping with color correction," International Journal of Imaging Systems and Technology, pp285-294, 2007 https://doi.org/10.1002/ima.20118
  20. A. Rizzi, C. Gatta, and D. Marini, "From Retinex to ACE: Issues in digital images unsupervised color equalization", Journal of Electronic Imaging, vol. 13, no. 1, pp. 15-28, Jan. 2004 https://doi.org/10.1117/1.1635366
  21. W. Wang, B. Li, J. Zheng, S. Xian, and J. Wang,"A fast multi-scale retinex algorithm for color image enhancement," Int. Conf. on Wavelet Analysis and Pattern Recognition, pp80-85, Sep. 2008
  22. 장인수, 박기현, 하영호, "이미지의 색도 분포를 고려한 다중 Retinex 기반의 칼라 향상 기법", 전자공학회 하계 종합 학술 대회 논문집, 제 31권 제 1호, pp.845-846, 2008년
  23. C. Tomasi and R. Manduchi, "Bilateral filtering for gray and color images," In Proc. Int. Conf. Computer Vis., pp. 839–846, 1998 https://doi.org/10.1109/ICCV.1998.710815
  24. Z. Buyue and A. Jan P., "Adaptive bilateral filter for sharpness enhancement and noise removal," IEEE Trans. Image Process, vol. no.5, pp. 664-78, 2008
  25. J. S. Lee, "Digital image smoothing and the sigma filter, "Computer Graphics Image Processing, vol. 24, pp. 255-269, 1983 https://doi.org/10.1016/0734-189X(83)90047-6
  26. M. Ghazal, A. Amer, and A. Ghrayeb, "A fast directional sigma filter for noise reduction in digital TV signals," IEEE Trans. on Consumer Electronics, vol.53, no.4, pp. 1500-1507, 2007 https://doi.org/10.1109/TCE.2007.4429244
  27. Y. M.Baek, H. J. Kim, J. A. Lee, Sang-Guen Oh, and W. Y. Kim, "Color image enhancement using the laplacian pyramid," Advances in Multimedia Information Processing - PCM, pp 760-769, 2006 https://doi.org/10.1007/11922162_87
  28. A. Beoldo, A. Regazzoni, and C. S. Regazzoni, "Multiple cue adaptive tracking of deformable objects with particle filter dore", International Conference on Image Processing, pp. 237-240, 2008
  29. S. Paris, "Edge-preserving smoothing and mean-shift segmentation of video streams," European Conference on Computer Vision, vol. 2, pp. 460-473, 2008 https://doi.org/10.1007/978-3-540-88688-4_34
  30. D. Comaniciu and P. Meer. "Mean shift: a robust approach toward feature space analysis," IEEE Trans. Pattern Anal. Machine Intell., vol. 24, no. 5, pp. 603–619, 2002 https://doi.org/10.1109/34.1000236
  31. D. Comaniciu and P. Meer, "Mean shift analysis and applications," IEEE Int. Conf. Computer Vision, pp. 1197-1203, 1999
  32. AATCC Test Method 173-1998, "CMC: calculation of small color differences for acceptability," AATCC Technical Manual, pp. 311-315, 2005
  33. M. R. Luo, G. Cui, and B. Rigg, "The development of the CIE 2000 colour-difference formula: CIEDE2000," Color Res. Appl. vol. 26, pp. 340-350, 2001 https://doi.org/10.1002/col.1049
  34. L. Meylan and S. Süsstrunk, "Color image enhancement using a Retinex based adaptive filter," European Conference on. Color in Graphics, Image, and Vision, vol. 2, pp. 359-363, 2004
  35. H. Y. Liu, S.Q. Jiang, Q.M. Huang, C.S. Xu and W. Gao., "Region-based visual attention analysis with its application in. image browsing on small displays," ACM International Conference on Multimedia, pp: 815-824, Oct. 2006
  36. R. Bergman, H. Nachlieli, G. Ruckenstein, M. Shaw, and R. Bhaskar, "Perceptual segmentation: combining image segmentation with object tagging," HPL-2008-185, 2008
  37. D. Lischinski, Z. Farbman, M. Uyttendaele, and R. Szeliski, "Interactive local adjustment of tonal values," ACM Trans. Graph., vol.25, no. 3, pp. 646–653, 2006 https://doi.org/10.1145/1141911.1141936
  38. C. Vyacheslav, "Image processing method and computer software for image processing", WO 2006/018658 A2
  39. H. C, Han and K. H. Sohn, "Face relighting based on virtual irradiance sphere and reflection coefficient," Optical Engineering, vol.47, no.2, Feb 2008 https://doi.org/10.1117/1.2857451
  40. H. Han and K. Sohn, "Automatic Illumination and Color Compensation Using Mean Shift and Sigma Filter," IEEE Trans. on Consumer Electronics , submitted for publication, 2009
  41. www.gimp.org
  42. www.hdrsoft.com
  43. www.adobe.com
  44. http://imaging.nikon.com/products/imaging/ technology /d-technology /expeed /d_lighting /index.htm
  45. V. Vonikakis and I. Andreadis, "Fast automatic compensation of under/over-exposured image regions", PSIVT, 2007
  46. A. Iranli, W. Lee, and M. Pedram, "HVS-aware dynamic backlight scaling in TFT-LCDs," IEEE Trans. Very Large Scale Integration Systems, vol. 14, pp. 1103–1116, Oct. 2006 https://doi.org/10.1109/TVLSI.2006.884151
  47. V. Vonikakis, I. Andreadis and A. Gasteratos, " Fast centre-surround contrast modification," IET Image Processing, vol.2, issue 1, pp. 19-34, Feb. 2008 https://doi.org/10.1049/iet-ipr:20070012
  48. 주명호, 강행봉, "레티넥스를 이용한 조명 변화 이미지 보상 기법", 대한전자공학회 하계종합 학술 대회 논문집 제2호, pp. 555-556, 2007년