Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Picture Quality Control Method for Region of Interest by Using Depth Information

깊이정보를 이용한 관심영역의 화질 제어 방법

  • Kwon, Soon-Kak (Dept. of Computer Software Engineering, Dongeui University) ;
  • Park, Yoo-Hyun (Dept. of Computer Software Engineering, Dongeui University)
  • 권순각 (동의대학교 컴퓨터소프트웨어공학과) ;
  • 박유현 (동의대학교 컴퓨터소프트웨어공학과)
  • Received : 2012.05.14
  • Accepted : 2012.06.13
  • Published : 2012.07.30
Download PDF
⟨ Previous Next ⟩

Abstract

If the region of interest (ROI) is set within the picture of image and video and the high quality is provided in ROI compared to Non ROI, then overall subjective picture quality can be increased. ROI extracted by the color camera only increases the calculation complexity and reduces the extraction accuracy. In this paper, we use depth camera to set the ROI and calculate the object distance from camera, then propose a method that the different picture quality is controlled by depending on the distance of an object. That is, we apply a high quantization step size to the far object, but relatively a low quantization step size to the close object, so better picture quality can be provided. Simulation results show that applying the differential quantization step size to the distance of objects by the proposed method can improve the subjective picture quality.

정지영상 및 동영상내의 화면에서 관심영역이 설정되고, 비관심영역에 비하여 관심영역에 높은 화질이 제공되면 전체적으로 주관적 화질이 증대하게 된다. 관심영역은 색상 카메라만을 이용하여 추출하게 되면 계산이 복잡해질 뿐만아니라 추출의 정확도도 떨어지게 된다. 따라서 본 논문에서는 관심영역을 설정하기 위하여 깊이 카메라를 이용하며, 카메라와 관심영역 객체별 거리를 산출하고, 거리에 따라 객체의 화질을 차별적으로 제어하는 방법을 제안한다. 즉, 거리가 먼 객체에는 높은 양자화 계단크기를 적용하지만, 상대적으로 거리가 가까운 객체에는 낮은 양자화 계단크기를 적용하여 화질을 좋게 한다. 본 논문에서 제안된 방법에 의해 객체의 거리별로 양자화계단의 크기를 차등적으로 적용함으로써 주관적 화질의 개선이 이루어졌으며 모의실험을 바탕으로 확인할 수 있다.

Keywords

References

  1. S.-k. Kwon, A. Tamhankar, K. R. Rao, "Overview of H.264/MPEG-4 Part 10", Journal of Visual Communications and Image Representation, Vol. 17, No. 2, pp. 186-216, 2006. https://doi.org/10.1016/j.jvcir.2005.05.010
  2. K. Ugur, K. Andersson, A. Fuldseth, G. Bjontegaard, L. P. Endresen, J. Lainema, A. Hallapuro, J. Ridge, D. Rusanovskyy, C. Zhang, A. Norkin, C. Priddle, T. Rusert, J. Samuelsson, R. Sjoberg, Z. Wu, "High Performance, Low Complexity Video Coding and the Emerging HEVC Standard", IEEE Trans. Circuit Syst. Video Technology, Vol. 20, No. 12, pp.1688-1697, 2010. https://doi.org/10.1109/TCSVT.2010.2092613
  3. W.-J. Han, J. Min, I.-K. Kim, E. Alshina, A. Alshin, T. Lee, J. Chen, V. Seregin, S. Lee, Y. M. Hong, M.-S. Cheon, N. Shlyakhov, K. McCann, T. Davies, J.-H. Park, "Improved Video Compression Efficiency through Flexible Unit Representation and Corresponding Extension of Coding Tools", IEEE Trans. Circuit Syst. Video Technology, Vol. 20, No. 12, pp.1709-1720, 2010. https://doi.org/10.1109/TCSVT.2010.2092612
  4. F. Bossen, V. Drugeon, E. Francois, J. Jung, S. Kanumuri, M. Narroschke, H. Sasai, J. Sole, Y. Suzuki, T. K. Tan, T. Wedi, S. Wittmann, P. Yin, Y. Zheng, "Video Coding using a Simplified Block Structure and Advanced Coding Techniques", IEEE Trans. Circuit Syst. Video Technology, Vol. 20, No. 12, pp.1667-1675, 2010. https://doi.org/10.1109/TCSVT.2010.2092616
  5. H. Song, C.-C. J. Kuo, "A Region-Based H.263+ Codec and its Rate Control for Low VBR Video", IEEE Trans. Multimedia, Vol. 6, No. 3, pp.489-500, 2004. https://doi.org/10.1109/TMM.2004.827488
  6. L. Tong, K. R. Rao, "Region of Interest Based H.263 Compatible Codec and its Rate Control for Low Bit Rate Video Conferencing", International Symposium on Intelligent Signal Processing and Communication Systems, pp.249-252, Dec. 2005.
  7. Y. Liu, Z. G. Li, and Y. C. Soh, "Region-of-Interest Based Resource Allocation for Conversational Video Communication of H.264/AVC", IEEE Trans. Circuit Syst. Video Technology, Vol. 18, No. 1, pp. 134-139, 2008. https://doi.org/10.1109/TCSVT.2007.913754
  8. M.-C. Chi, C.-H. Yeh, and M.-J. Chen, "Robust Region-of-Interest Determination Based on User Attention Model through Visual Rhythm Analysis", IEEE Trans. Circuit Syst. Video Technology, Vol. 19, No. 7, pp. 1025-1038, 2009. https://doi.org/10.1109/TCSVT.2009.2022822
  9. S.-k. Kwon, A. Punchihewa, D. G. Bailey, S.-W. Kim, J. Lee, "Adaptive Simplification of Prediction Modes for H.264 Intra-Picture Coding", IEEE Trans. Broadcasting, Vol. 58, No. 1, pp. 125-129, 2012. https://doi.org/10.1109/TBC.2011.2174894
  10. Y. Zhang, G. Jiang, M. Yu, Y. Yang, Z. Peng, and K. Chen, "Depth Perceptual Region-of-Interest Based Multiview Video Coding", Journal of Visual Communication and Image Representation, Vol. 21, No. 5-6, pp. 498-512, 2010. https://doi.org/10.1016/j.jvcir.2010.03.002
  11. http://www.microsoft.com/en-us/default.aspx
  12. http://openni.org
  13. JM Reference Software Version 10.2, http://iphome.hhi.de/suehring/tml/download.