Journal of the Institute of Electronics Engineers of Korea SD (대한전자공학회논문지SD)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

A 3-stage Pipelined Architecture for Multi-View Images Decoder3

단계 파이프라인 구조를 갖는 Multi-View 영상 디코더

  • Bae, Chang-Ho (Nokia tmc Ltd. Manufacturing Engineering Team) ;
  • Yang, Yeong-Yil (GyeongSang National University, Division of Electric and Electronics Engineering)
  • Published : 2002.04.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we proposed the architecture of the decoder which implements the multi-view images decoding algorithm. The study of the hardware structure of the multi-view image processing has not been accomplished. The proposed multi-view images decoder operates in a three stage pipelined manner and extracts the depth of the pixels of the decoded image every clock. The multi-view images decoder consists of three modules, Node selector which transfers the value of the nodes repeatedly and Depth Extractor which extracts the depth of each pixel from the four values of the nodes and Affine transformer which generates the projecting position on the image plane from the values of the pixels and the specified viewpoint. The proposed architecture is designed and simulated by the Max+plus II design tool and the operating frequency is 30MHz. The image can be constructed in a real time by the decoder with the proposed architecture.

본 논문에서는 multi-view 영상 디코딩 알고리듬을 구현하는 디코더의 구조를 제안하였다. 현재까지 multi-view 영상 처리를 위한 하드웨어 구조에 관한 연구는 이루어지지 않았다. 제안한 multi-view) 영상디코더는 3 단계 파이프라인 방식으로 동작하며, 매 클럭마다 디코드된 영상의 화소 값을 추출한다. Multi-view 영상 디코더는 3 부분으로 구성된다. 노드의 값을 반복적으로 전송하는 Node Selector, 4개의 노드 값으로부터 각 화소의 값을 추출하는 Depth Extractor와 주어진 시점과 화소의 깊이 값으로부터 영상평면에 투영되는 위치를 생성하는 Affine Transformer로 구성되어 있다. 제안된 구조는 MAX+PLUS II 설계 툴로 설계되었고 시뮬레이션을 수행하였으며, 동작 주파수는 30㎒이다. 제안된 구조를 갖는 디코더로 영상을 실시간으로 복원할 수 있다.

Keywords

References

  1. R. C. Gonzalez and R. E. Woods, Digital Image Processing, Addison Wesley, pp. 68-71, 1993
  2. I. J. Cox, S. L. Hingorani and S. B. Rao, 'A Maximum likelihood stereo algorithm,' Computer Vision and Image Understanding, Vol. 63, No. 3, pp. 542-567, May 1996 https://doi.org/10.1006/cviu.1996.0040
  3. U. R. Dhond and J. K. Aggarrwal, 'Structure from Stereo - A Review,' IEEE Trans Systems, Man, Cybernetics, Vol. 19, No. 6, pp. 1489-1510, 1989 https://doi.org/10.1109/21.44067
  4. M. E. Lukas, 'Predictive Cording of Multi-Viewpoint Image Sets,' IEEE ICASSP'86, pp. 521-524, 1996
  5. M. G. Perkins, 'Data Compression of Stereopaire,' IEEE Trans. Commun.40, pp.684-696, 1992 https://doi.org/10.1109/26.141424
  6. H. Aydinoglu and M. H. Hayes III, 'Compression of Multi-View Images,' IEEE ICIP'94, pp. 385-389, 1994
  7. T. Fujii and H. Harashima, 'Data Compression and Interpolation of Multi-View Image Set,' IEICE Trans. Inf. & Syst., E77-D, 9, pp. 987-995, 1994
  8. D. H. Kim and Y. Y. Yang, 'An Advanced Image Coding Algorithm for the Representation of the Set of Multi-View Images,' IEEK, Vol. 35-S, No.7, 1998
  9. N. Grammalidis, M. G. Strintzis, 'Disparity and Occlusion Estimation in Multiocular Systems and Their Coding for the Communication of MultiView Image Sequence,' IEEE Trans. Circuits and Systems, pp. 328-344, 1998 https://doi.org/10.1109/76.678630