Journal of the Institute of Electronics Engineers of Korea SP (대한전자공학회논문지SP)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

Reconstruction of Transmitted Images from Images Displayed on Video Terminals

영상 단말에 전송된 이미지를 이용한 전송 영상 복원

  • Park, Su-Kyung (Dept. of Computer Engineering, Kwangwoon University) ;
  • Lee, Seon-Oh (Dept. of Computer Engineering, Kwangwoon University) ;
  • Sim, Dong-Gyu (Dept. of Computer Engineering, Kwangwoon University)
  • 박수경 (광운대학교 컴퓨터공학과) ;
  • 이선오 (광운대학교 컴퓨터공학과) ;
  • 심동규 (광운대학교 컴퓨터공학과)
  • Received : 2011.08.08
  • Accepted : 2011.12.05
  • Published : 2012.01.25
Download PDF
⟨ Previous Next ⟩

Abstract

An image reconstruction algorithm is proposed to estimate transmitted original images from images displayed on a video terminal. The proposed algorithm acquires images that are displayed on video terminal screens by using a camera. The transmitted images are then estimated with the acquired images. However, camera-acquired images exhibit geometric and color distortions caused by characteristics of the camera and display devices. We make use of a geometric distortion correction algorithm that exploits homography and color distortions using a weighted-linear model. The experimental results show that the proposed algorithm yields promising estimation performance with respect to the peak signal-to-noise ratio (PSNR). PSNR values of the estimated images with respect to the corresponding original images range from 28-29 dB.

본 논문에서는 영상 단말에 디스플레이되는 영상들을 이용하여 전송된 영상의 원본 상태를 예측하는 복원 알고리듬을 제안한다. 제안한 알고리듬은 카메라를 이용하여 비디오 단말 스크린에 나타나는 영상들을 취득한다. 전송된 영상들은 카메라를 통해 획득된 영상들을 이용하여 예측해야 하지만, 일반적으로 카메라를 통해 획득된 영상들은 영상 출력 장치와 카메라의 특성에 의해 기하학적 왜곡과 컬러 왜곡을 포함하게 된다. 우리는 가중치 선형 모델을 이용하는 컬러 왜곡과 호모그라피를 이용하는 기하 왜곡 보정 알고리듬을 이용하여 이러한 왜곡들을 보정하는 알고리듬을 제안한다. 실험결과, 제안한 알고리듬이 예측한 영상과 원본 영상과의 PSNR이 28 ~ 29 정도로 나타났다.

Keywords

References

  1. T. Tsang, "Modelling and performance evaluation of mobile multimedia systems using QoS-GSPN," Wireless Networks, vol. 9, pp. 575-584, Nov. 2003. https://doi.org/10.1023/A:1025900316983
  2. Video Quality Experts Group (VQEG). (2000, Mar.). Final report from the Video Quality Experts Group on the validation of objective models of video quality assessment [online] available: http://www.vqeg.org/
  3. Z. Wang, A.C. Bovik, H.R. Sheikh, and E.P. Simoncelli, "Image quality assessment: from error visibility to structural similarity," IEEE Trans. on Image Processing, vol. 13, no. 4, pp. 600-612, April 2004. https://doi.org/10.1109/TIP.2003.819861
  4. H.R. Sheikh, Z. Wang, L. Cormack, and A.C. Bovik, "Blind quality assessment for JPEG2000 compressed images," In Proc. IEEE Asilomar Conf. on Signals, Systems, and Computers, vol. 2, pp. 1403-1407, Nov. 2002.
  5. R. Sukthankar, R.G. Stockton, M.D. Mullin, "Smarter Presentations: Exploiting Homography in Camera-Projector System," Proc. IEEE Conf. Computer Vision 1, pp. 247-253, 2001.
  6. K. Okatani, K. Dequchi, "Autocalibration of a projector-screen-camera system: theory and algorithm for screen-to-camera homography estimation," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 2, pp. 774-78, Oct. 2003.
  7. C. Harris and M. J. Stephens, "A Combined corner and edge detector," In Alvey Vision Conference, pp. 147-152, 1988.
  8. C. Schmid, R. Mohr, and C. Bauckhage, "Evaluation of interest point detectors," International Journal of Computer Vision, vol. 37, no. 2, pp. 151-172, June 2000. https://doi.org/10.1023/A:1008199403446
  9. Z. Zhang "On the epipolar geometry between two images with lens distortions," Proc. Int. Conf. Pattern Recognition, vol. 1, pp. 407-411, 1996.
  10. F. Graham, D.H. Steven, M.H. Paul, "Color by correlation: A simple, unifying framework for color constancy," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 23, pp. 1209-1221, 2001. https://doi.org/10.1109/34.969113
  11. Recommendation ITU-R BT.500-11, Methodology for the Subjective Assessment of the Quality of Television Pictures, International Telecommunication Union, Jan. 2002.
  12. Seon-Oh Lee, Su-Kyung Park, Dong-Gyu Sim, "Objective Video Quality Evaluation Method Based on Subjective Visual Features," ICUCT 2007, Beijing, China, pp.87-92,Nov.2007.
  13. 박수경, 심동규, "스트리밍 비디오 화질 평가를 위한 수신 영상 복원," 대한전자공학회, SP편, 제 49권, 6호, 2009.