Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Image Enhancement Using Human Visual Perception

인간 시각의 인지 특성을 이용한 영상 화질 향상 방법

  • Bang, Seangbae (College of Electronics & Information, Kyung Hee University) ;
  • Kim, Wonha (College of Electronics & Information, Kyung Hee University)
  • 방성배 (경희대학교 전자정보대학) ;
  • 김원하 (경희대학교 전자정보대학)
  • Received : 2017.12.26
  • Accepted : 2018.03.08
  • Published : 2018.03.30
Download PDF
⟨ Previous Next ⟩

Abstract

We develop the signal processing method for adaptive implementing direction of signal and the frequency sensitivity of human visual system(HVS). Existing multiband energy scaling method makes ringing artifact because it does not consider signal direction. To solve this problem, we use block gradient for signal direction in addition to existing method. And we use the fact that frequency component of signal is more sensitive than value of signal over human eyes. we enhance the signal according to contrast sensitivity function(CSF) which is the model of frequency sensitivity of human eye. Compared that the existing analysis models only improve the efficiencies in the existing systems, the developed method can process the image signals to be more desirable and suitable to HVS.

본 논문은 영상 신호의 방향을 고려하여 기존의 multiband energy scaling 방법의 문제점을 보완하면서 human visual system(HVS)에 적합한 영상 local contrast 향상 방법을 개발하였다. 기존의 multiband energy scaling 방법은 신호 방향에 대한 고려 없이 화질을 향상시켜 ringing artifact가 발생하였으나 본 논문에서는 block gradient를 사용하여 신호의 방향을 측정하고 측정된 신호 방향에 따라 주파수 신호를 향상시켜 ringing artifact의 발생 없이 화질을 향상시켰다. 또한 본 논문은 human visual system(HVS)은 각 신호의 값 하나하나 보다는 각 신호가 가지는 주파수에 성분에 민감하게 반응한다는 것을 이용하여 주파수 성분에 대한 인간 시각의 민감도를 모델링한 contrast sensitivity function(CSF)에 따라 영상의 화질을 향상시켰다. 결국 본 논문에서 제안하는 방법은 신호의 특성과 인간 시각의 특성을 모두 고려하여 영상의 화질을 향상시키기 때문에 기존의 화질 향상 방법들에 비해 영상 신호와 인간 시각 특성에 더욱 적합하게 화질을 향상시킬 수 있다.

Keywords

References

  1. B. Spehar, S. Wong, S. Klundert, J. Lui, C. W. G. Clifford, and R. P. Taplor, "Beauty and the beholder: the role of visual sensitivity in visual preference," Original Research, Sep 2015.
  2. A. M. Haun, and E. Peil, "Perceived contrast in complex images," Journal of Vision, Nov 2013.
  3. A. M. Haun, and E. A. Essock, "Contrast Sensitivity for Oriented Patterns in 1/f Noise : Contrast Response and The Horizontal effect," Journal of Vision, Aug 2010.
  4. J. M. Foley, "Human Luminance Pattern-vision Mechanisms : Masking Experiments Require a New Model," Optical Society of America, vol.11, no.6, June 1994.
  5. M. W. Cannon, and S. C. Fullenkamp, "A Transducer Model fore Contrast Perception," Vision Res. vol.31, no.6, 1991.
  6. Z. Wei, and K. N. Ngan, "Spatio-Temporal Just Noticeable Distortion Profile for Grey Image/Video in DCT Domain," IEEE Transactions on Circuits and Systems for Video Technology, vol.19, no.3, Mar 2009.
  7. S. H. Bas, and M. Kim, "A DCT-based Total JND Profile for Spatio-Temporal and Foveated Masking Effects," IEEE Transaction, on Circuits and Systems for Video Technology, 2015.
  8. S. H. Base, and M. Kim, "A Novel-DCT based JND Model for Luminance Adaptation Effect in DCT Frequency," IEEE Signal Processing Letters, vol.20, no.9, Sep 2013.
  9. S. H. Bae, and M. Kim, "A Novel Generalized DCT-Based JND Profile Based on an Elaborate CM-JND Model for Variable Block-Sized Transforms in Monochrome Images," IEEE Transactions on Image Processing, vol.23, no.8, Aug 2014.
  10. M. Eom, and Y. Choe, "Fast Extraction of Edge Histogram in DCT Domain based on MPEG7," Proceedings of World Academy of Science Engineering and Technology, vol.9, Nov 2005.
  11. H. S. Chang, and K. Kang, "A Compressed Domain Scheme for Classifying Block Edge Patterns," IEEE Transactions on Image Processing, vol.14, no.2, Feb 2005.
  12. D. K. Choi, L. H. Jang, M. H. Kim, and N. C. Kim, "Color Image Enhancement Based on Single-Scale Retinex With a JND-Based Nonlinear Filter," Circuits and Systems, IEEE International Symposium on, 2007.
  13. S. C. Nercessian, K. A. Panetta, and S. S. Agaian, "Non-Linear Direct Multi-Scale Image Enhancement Based on the Luminance and Contrast Masking Characteristics of the Human Visual System," IEEE Transactions on Image Processing, vol.22, no.9, Sep 2013.
  14. J. Tang, E. Peli, and S. Acton, "Image Enhancement Using A Contrast Measure in the Compressed Domain," IEEE Signal Processing Letters, vol.10, no.10, Oct 2003.
  15. S. Lee, "An Efficient Content-Based Image Enhancement in the Compressed Domain Using Retinex Theory," IEEE Transactions on Circuits and Systems for Video Technology, vol.17, no.2, Feb 2007.
  16. T. Celik, "Spatial Entropy-Based Global and Local Image Contrast Enhancement," IEEE Transactions on Image Processing, vol.23, no.12, Dec 2014.
  17. ITU-R Recommendation BT.500-11, M. for the Subjective Assessment of the Quality of Television Pictures 2002, 2002.
  18. The New Image Compression Test Set - Jan 2008, http://imagecompression.info/test_images/ (accessed Mar. 13, 2018).