Browse > Article

Autonomous Mobile Robot System Using Adaptive Spatial Coordinates Detection Scheme based on Stereo Camera  

Ko Jung-Hwan (광운대학교 차세대 3D 디스플레이 연구센터)
Kim Sung-Il (경원대학교 전자공학과)
Kim Eun-Soo (광운대학교 차세대 3D 디스플레이 연구센터)
Abstract
In this paper, an automatic mobile robot system for a intelligent path planning using the detection scheme of the spatial coordinates based on stereo camera is proposed. In the proposed system, face area of a moving person is detected from a left image among the stereo image pairs by using the YCbCr color model and its center coordinates are computed by using the centroid method and then using these data, the stereo camera embedded on the mobile robot can be controlled for tracking the moving target in real-time. Moreover, using the disparity map obtained from the left and right images captured by the tracking-controlled stereo camera system and the perspective transformation between a 3-D scene and an image plane, depth information can be detected. Finally, based-on the analysis of these calculated coordinates, a mobile robot system is derived as a intelligent path planning and a estimation. From some experiments on robot driving with 240 frames of the stereo images, it is analyzed that error ratio between the calculated and measured values of the distance between the mobile robot and the objects, and relative distance between the other objects is found to be very low value of $2.19\%$ and $1.52\%$ on average, respectably.
Keywords
mobile robot; stereo vision; stereo camera; disparity; spatial map;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 S. B. Gokturk, J. Y. Bouguet, R. Grzeszczuk, 'A data-driven model for monocular face tracking', International Conference on Computer Vision, vol.2, pp.701-708, 2001
2 D. Tzovaras, N. Grmmaiidis and M. G. Strintzis, 'Three-dimensional camera motion estimation and foreground/background seperation for stereoscopic image sequences', Optical Engineering, vol.36, no.2, pp.574-579, 1997   DOI   ScienceOn
3 K. Fujimoto, H. Muro, N. Shimomura, T. Oki, K. Maeda, Y. Kishi and M. Hagino, 'A study on pedestrian detection technologyh using stereo images', JASE Review, vol.1, pp.1-3, 2002
4 J. S. Lee, J. H. Ko, E. S. Kim, 'Real-time stereo object tracking system by using block matching algorithm and optical binary phase extraction joint transform correlator', Optics Communication, vol. 191, pp.191-202, 2001   DOI   ScienceOn
5 James Black, Tim Ellis, 'Multi-camera image measurement and correspondence', Measureme nt, vol. 32, pp.61-71, 2002   DOI   ScienceOn
6 T. Darrell, G. Gordon, M. Harville, J. Woodfill, 'Integrated person tracking using stereo, color, and pattern detection,' IEEE Conference on Computer Vision and Pattern Recognition, pp. 601-608, 1998
7 K. H. Bae, J. S. Koo, E. S. Kim, 'A New Stereo Object Tracking System using Disparity Motion Vector', Optics Communications, vol.221, no 13, pp.23-35, 2003   DOI
8 D. Murray and Anuo Basu 'Motion tracking with an active camera', IEEE Transaction on Pattern Analysis and Machine Intelligence, vol. 16, no. 5, pp. 449-459, 1994   DOI   ScienceOn
9 T. Kanade, A. Yoshida, K. ada, H. Kano, and M. Tanaka, 'A stereo machine for video- rate dense depth mapping and its new applications', Proc. of IEEE CVPR '96, pp. 196-202, 1966
10 Douglas Chai, 'Face segmentation using skin-color map in videophone applications,' IEEE Trans. on Circuits and Systems for Video Technology, vol.9, no.4, pp.551-564, 1999   DOI   ScienceOn
11 J. S. Lee, C. W. Seo, E. S. Kim, 'Implementation of opto-digital stereo object tracking system', Optics Communications, vol. 200, pp.73-85, 2001   DOI   ScienceOn
12 박창주, 고정환, 김은수, '스테레오 영상 보정 알고리즘에 기반한 새로운 중간시점 영상합성 기법', 한국 통신학회 논문지, vol.29, no.5C, pp.632-641, 2004