Browse > Article

Real-time Disparity Acquisition Algorithm from Stereoscopic Image and its Hardware Implementation  

Shin, Wan-Soo (광운대학교 실감미디어 연구소)
Choi, Hyun-Jun (광운대학교 실감미디어 연구소)
Seo, Young-Ho (광운대학교 실감미디어 연구소)
Kim, Dong-Wook (광운대학교 실감미디어 연구소)
Abstract
In this paper, the existing disparity aquisition algorithms were analyzed, on the bases of which a disparity generation technique that is superior in accuracy to the generation time was proposed. Basically it uses a pixel-by-pixel motion estimation technique. It has a merit of possibility of a high-speed operation. But the motion estimation technique has a disadvantage of lower accuracy because it depends on the similarity of the matching window regardless of the distribution characteristics of the texture in an image. Therefore, an enhanced technique to increase the accuracy of the disparity is required. This paper introduced a variable-sized window matching technique for this requirement. By the proposed technique, high accuracies could be obtained at the homogeneous regions and the object edges. A hardware to generate disparity image was designed, which was optimized to the processing speed so that a high throughput is possible. The hardware was designed by Verilog-HDL and synthesized using Hynix $0.35{\mu}m$ CMOS cell library. The designed hardware was operated stably at 120MHz using Cadence NC-VerilogTM and could process 15 frames per second at this clock frequency.
Keywords
stereo matching; disparity; hardware design; multi-view; 3D;
Citations & Related Records
연도 인용수 순위
  • Reference
1 C. J. Tsa and A. K. Katsaggelos, 'Dense disparity estimation with a divide-and-conquer disparity space image technique,' IEEE Transactions on Multimedia, Vol. 1, Issue 1, pp. 18-29, March 1999   DOI   ScienceOn
2 M. Z. Brown, D. Burschka, and G. D. Hager, 'Advances in computational stereo,' IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 25, Issue 8, pp. 993-1008 Aug. 2003   DOI   ScienceOn
3 ISO/IEC 11172-2, 'Information technology coding of moving picture and associated audio for digital storage media at up to about 1.5Mbps,' International Standard, 1993
4 D. I. Han, B. M. Lee, J. I. Cho, and D. H. Hwang, 'Real-time object segmentation using disparity map of stereo matching,' Applied Mathematics and Computation, Vol. 205, Issue 2, pp. 770-777, Nov. 2008   DOI   ScienceOn
5 P. N. Belhumeur, 'A Bayesian approach to binocular stereopsis,' International Journal of Computer Vision, Vol. 19, Issue 3, pp. 237-260, Aug. 1996   DOI   ScienceOn
6 D. Scharstein and R. Szeliski, 'A taxonomy and evaluation of dense two-frame stereo correspondence algorithms,' International Journal of Computer Vision, Vol. 47, Issue 1-3, pp. 7-42, April 2002   DOI   ScienceOn
7 I. Gallo, E. Binaghi, and M. Raspanti, 'Neural disparity computation for dense two-frame stereo correspondence,' Pattern Recognition Letters, Vol. 29, Issue 5, pp. 673-687, April 2008   DOI   ScienceOn
8 ISO/IEC 14496-2, 'Information technology coding of audio-visual object,' International Standard, 2001
9 ISO/IEC 11172-2, 'Information technology coding of moving picture and associated : video,' International Standard, 1995
10 J. Sun, N. N. Zheng, and H. Y. Shum, 'Stereo matching using belief propagation,' IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 27, Issue 25, pp. 787-800, July 2003
11 H. Niitsuma, and T. Maruyama, 'Real-time detection of moving object,' Lecture Notes in Computer Science, Vol. 3203, pp.1155-1157, 2004   DOI   ScienceOn
12 ISO/IEC MPEG & ITU-T VCEG, 'Multiview video plus depth (MVD) format for advanced 3D video systems,' JVT-W100, April 2007
13 ISO/IEC, 'ISO/IEC JTC1/SC29/WG11 Coding of Moving Picture and Audio,' Draft of version 4 of ISO/IEC 14496-10 (E) MPEG05/N7081, April 2005
14 R. C. Gonzales and R. E. Woods, 'Digital image processing,' Prentice Hall, 2nd edtion, 2001
15 http://vision.middlebury.edu/stereo
16 Y. Wang, J. Ostermann, and Y. Q. Zhang, 'Video Processing and Communications,' Prentice hall, 2002
17 Y. Ohta and T. Kanade, 'Stereo by intra- and inter-scanline search using dynamic programming,' IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. PAMI-7, March 1985   DOI   ScienceOn
18 C. Georgoulas, L. Kotoulas, G. Ch. Sirakoulis, I. Andreadis, and A. Gasteratos, 'Real-time disparity map computation module,' Microprocessors and Microsystems, Vol. 32, Issue 3, pp. 159-170, May 2008   DOI   ScienceOn