한국통신학회논문지 (The Journal of Korean Institute of Communications and Information Sciences)

  • 제37권6A호
  • /
  • Pages.464-472
  • /
  • 2012
  • /
  • 1226-4717(pISSN)
  • /
  • 2287-3880(eISSN)
한국통신학회 (The Korean Institute of Commucations and Information Sciences)
권호 표지
DOI QR코드

DOI QR Code

6-Tap FIR 필터를 이용한 부화소 단위 움직임 추정을 통한 초해상도 기법

Super-Resolution Algorithm by Motion Estimation with Sub-Pixel Accuracy using 6-Tap FIR Filter

  • 권순찬 (광운대학교 전자공학과 디지털 미디어 연구실) ;
  • 유지상 (광운대학교 전자공학과 디지털 미디어 연구실)
  • 투고 : 2012.10.20
  • 심사 : 2012.05.03
  • 발행 : 2012.06.30
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

본 논문에서는 연속된 프레임을 갖는 영상의 프레임간 움직임 추정 기법을 응용하여 고해상도 영상을 생성하는 초해상도 기법을 제안한다. 단일 영상을 이용한 초해상도 기법의 경우 영상에서의 고주파 대역을 찾기 위해 확률 및 이산 웨이블릿 변환(discrete wavelet transform: DWT) 기반 등 다양한 방법이 제시되었으나, 연산에 사용할 수 있는 정보가 제한적이라는 문제가 존재한다. 이러한 문제를 해결하기 위해 연속된 프레임을 이용한 초해상도 기법이 다양하게 제안되었다. 연속 프레임 기반 초해상도 기법의 핵심인 입력 저해상도 영상 간 정합(registration)의 정확도는 초해상도 기법의 결과에 큰 영향을 갖는다. 본 논문에서는 영상 간 정합의 정확도를 높이기 위하여 6-tap FIR(finite impulse response) 필터를 부화소(sub-pixel) 단위의 정합에 사용한다. 실험을 통하여 제안하는 기법의 결과영상이 기존의 최단입점(nearest neighborhood), 이중선형(bi-linear), 고등차수(bi-cubic) 보간법 보다는 우수하고 DWT 기반의 초해상도 기법과는 비슷한 성능을 가진다는 것을 확인할 수 있었다.

In this paper, we propose a new super-resolution algorithm that uses successive frames by applying the block matching motion estimation algorithm. Usually, single frame super-resolution algorithms are based on probability or discrete wavelet transform (DWT) approach to extract high-frequency components of the input image, but only limited information is available for these algorithms. To solve this problem, various multiple-frame based super-resolution algorithms are proposed. The accuracy of registration between frames is a very important factor for the good performance of an algorithm. We therefore propose an algorithm using 6-Tap FIR filter to increase the accuracy of the image registration with sub-pixel unit. Proposed algorithm shows better performance than other conventional interpolation based algorithms such as nearest neighborhood, bi-linear and bi-cubic methods and results in about the same image quality as DWT based super-resolution algorithm.

키워드

참고문헌

  1. Freeman W. T., Jones, T. R., and Pasztor E. C. "Example-based super-resolution", IEEE, trans. on Computer Graphics and Applications, vol. 22, pp. 56-65, Mar/Apr. 2002.
  2. Fengung Qin., "An improved super resolution reconstruction method based on initial value estimation", CISP, 2010 3rd International Congress, vol. 2, pp. 826-829, Oct. 2010.
  3. G.B Kang, Y.S. Yang, J.H Kim, "A study on Interpolation for Enlarged Still Image", KIICE Conference, May. 2001.
  4. J.H. Hyun, J.M. Lim and J.S. Yoo, "Wavelet based Super-Resolution method", KOSBE Conference, Jun. 2011.
  5. S.C Kwon, J.S. Yoo, "Super-Resolution Algorithm by Motion Estimation with Sub-pixel Accuracy using 6-Tap FIR Filter", KOSBE Conference, Oct. 2011.
  6. Nimish R. Shah, and Avideh Zakhor "Multi-frame spatial resolution enhancement of color video", IEEE trans. on Image Processing, vol. 1, pp. 985-988, Sep. 1996. https://doi.org/10.1109/ICIP.1996.559666
  7. Nimish R. Shah, and Avideh Zakhor "Resolution enhancement of color video sequences", IEEE trans. on Image Processing, vol. 8, pp. 879-885, Jun. 1999. https://doi.org/10.1109/83.766865
  8. S.C. Park, M.K. Park, and M.G. Kang "Super-resolution image reconstruction: a technical overview", IEEE Signal Processing Magazine, vol. 20, pp. 21-36, May 2003. https://doi.org/10.1109/MSP.2003.1203207
  9. Y.M. Seong, H.W. Park, "Super Resolution Image Reconstruction Using Phase Correlation Based Subpixel Registration from of a Sequence of Frames", IEEK Conference, Nov. 2005.
  10. Thomas Wiegand, Gary J. Sullivan, Gisle Bjontegaard, and Ajay Luthra "Overview of the H.264/AVC Video Coding Standard", IEEE trans. on circuits and systems for video technology, Jul. 2003
  11. D. Shepard "A two-dimensional interpolation function for irregularly-spaced data", ACM in Proceedings of the 23rd ACM national conference, pp. 517-524, 1968.
  12. Hidenori Takeshima, and Toshimitsu Kaneko "Image registration using subpixel-shifted images for super-resolution", IEEE trans. on Image Processing, 15th IEEE International Conference on. pp. 2404-2407, Oct. 2008.
  13. T.H. Kim, Y.S. Moon, C.S. Han, "Estimation of Real Boundary with Subpixel Accuracy in Digital Imagery", KSPE Journals, Vol. 16, pp. 16-22. Aug. 1999.
  14. H.S. Bae, "Block Based Motion Estimation for Reducing Discontinuity Artifact", KIEEME Journals, Vol. 6, pp. 94-101. Jul. 2002.
  15. Naoyuki Hirai, Takahiro Kato, Tian Song, Takashi Shimamoto "An Efficient Architecture for Spiral-Type Motion Estimation for H.264/AVC", IEEK Conference, Jul. 2009.
  16. A. Gilman, and D.G. Bailey "Near optimal non-uniform interpolation for image super-resolution from multiple images", Image and Vision Computing New Zealand, Great Barrier Island New Zealand. pp. 31-35. 2006.

피인용 문헌

  1. Hybrid Super-Resolution Algorithm Robust to Cut-Change vol.17, pp.7, 2013, https://doi.org/10.6109/jkiice.2013.17.7.1672
  2. Enhanced Multi-Frame Based Super-Resolution Algorithm by Normalizing the Information of Registration vol.9, pp.1, 2014, https://doi.org/10.5370/JEET.2014.9.1.363