The KIPS Transactions:PartB (정보처리학회논문지B)

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Multiple Pedestrians Detection and Tracking using Color Information from a Moving Camera

이동 카메라 영상에서 컬러 정보를 이용한 다수 보행자 검출 및 추적

  • 임종석 (영남대학교 대학원 컴퓨터공학과) ;
  • 김욱현 (영남대학교 전자정보공학부)
  • Published : 2004.06.01
Download PDF
⟨ Previous Next ⟩

Abstract

This paper presents a new method for the detection of multiple pedestrians and tracking of a specific pedestrian using color information from a moving camera. We first extract motion vector on the input image using BMA. Next, a difference image is calculated on the basis of the motion vector. The difference image is converted to a binary image. The binary image has an unnecessary noise. So, it is removed by means of the proposed noise deletion method. Then, we detect pedestrians through the projection algorithm. But, if pedestrians are very adjacent to each other, we separate them using RGB color information. And we track a specific pedestrian using RGB color information in center region of it. The experimental results on our test sequences demonstrated the high efficiency of our approach as it had shown detection success ratio of 97％ and detection failure ratio of 3％ and excellent tracking.

본 논문에서는 이동 카메라에서 취득한 영상에서 컬러 정보를 이용하여 다수의 보행자를 검출하고 특정 보행자를 추적하는 방법을 제안한다. 먼저 연속한 동영상 입력에 대해 BMA(Block Matching Algorithm)을 이용하여 움직임 벡터를 추출하고 움직임 보상을 한 후 차 영상을 생성한다. 다음은 이진 영상으로 변환한 후 불필요한 잡음 능을 제거하친, 프로젝션을 수행하여 보행자를 검출한다. 만약 검출된 보행자가 서로 인접하거나 겹쳐졌을 경우 RGB 컬러 정보를 이용하여 분리시킨다. 검출된 다수의 보행자로부터 특정 보행자를 추적하기 위해 보행자 가운데 영역의 RGB 컬러 정보를 이용하여 추적한다. 제안된 방법에 대하여 비디오 카메라로 녹화한 영상을 컴퓨터에서 입력받아 검출과 추적 실험을 수행한 결과, 검출 성공률이 97％, 검출 실패율이 3％로 나타났고 추적 또한 우수함을 입증하였다.

Keywords

References

  1. U. Franke, D. Gavrila and S. Goerzig, 'Autonomous Driving Approaches Downtown to Appear,' IEEE Expert (special issue on Vision-based Driving Assistance in Vehicles of the Future), 1997
  2. C. Wohler, J. K. Aulaf and T. Portner, U. Franke, 'A Time Delay Neural Network Algorithm for Real-time Pedestrian Detection,' Proc. of the IEEE Intelligent Vehicles Symposium '98, (stuttgart, Germany), pp.247-251, Oct., 1998
  3. M. yachida, M. Asada and S. Tsuji, 'Automatic Analysis of Moving Image,' IEEE Trans. Pattern Anal. Mach. Intell, Vol.PAMI-3, No.1, pp.12-20, 1981 https://doi.org/10.1109/TPAMI.1981.4767046
  4. J. Agbinya and D. Rees, 'Multi-object Tracking in Video,' Real-Time Imaging 5, pp.295-304, 1999 https://doi.org/10.1006/rtim.1998.0174
  5. L. Zhao and C. Thorpe, 'Stereo-and Neural Network-Based Pedestrian Detection,' Proc. ITSC '99, pp.5-10, 1999
  6. H. Inoue, T. Tachikawa and M. Inaba, 'Robot Vision System with a Correlation Chip for Real-time Tracking, Optical flow and Depth Map Generation,' Proc. of the IEEE International Conference on Robotics and Automation, pp.1621-1626, 1992 https://doi.org/10.1109/ROBOT.1992.220020
  7. S. Yamamoto, Y. Mae and Y. Shirai, 'Real-time Multiple Object Tracking based on Optical Flows,' Proc. of the Robotics and Automation, Vol.3, pp.2328-2333, 1995 https://doi.org/10.1109/ROBOT.1995.525608
  8. A. Broggi, M. Bertozzi and A. Fascioli, 'Shape-based Pedestrian Detection,' Proc. of the IEEE Intelligent Vehicles Symposium 2000, pp.215-220, 2000 https://doi.org/10.1109/IVS.2000.898344
  9. H. Mori, N. M. Charkari and T. Matsushita, 'On-Line Vehicle and Pedestrian Detection based on Sign Pattern,' IEEE Trans. on Industrial Electronics, Vol.41, No.4, pp.384-391, Aug., 1994 https://doi.org/10.1109/41.303788
  10. S. A. Niyogi and E. H. Adelson, 'Analyzing and Recognizing Walking Figures in xyt,' Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, pp.469-474, 1994 https://doi.org/10.1109/CVPR.1994.323868
  11. S. A. Niyogi and E. H. Adelson, 'Analyzing Gait with Spatiotemporal Surfaces,' IEEE Workshop on Motion of Non-Rigid and Articulated Objects, pp.64-69, Austin, 1994 https://doi.org/10.1109/MNRAO.1994.346253
  12. J. S. Lim and W. H. Kim, 'Multiple Pedestrians Tracking Using Difference Image and Projection Histogram,' Proc. of the International Conf. on Imaging Science, Systems and Technology(CISST '02), Vol.1, pp.329-334, 2002 https://doi.org/10.1109/ICIP.2002.1038027
  13. 조영석;이주신, '부분 외곽선 정보를 이용한 이동물체 추적 알고리즘', 정보처리학회논문지B, 제8-B권 제5호, pp.539-548
  14. D. M. Gavrila and V. Philomin, 'Real-time Object Detection Using Distance Transforms,' Proc. of IEEE ICIV, Stuttgart, Germany, pp.274-279, 1998
  15. D. M. Gavrila, 'Pedestrian Detection from a Moving Vehicle,' Proc. of European Conference on Computer Vision, Dublin, Ireland, pp.37-49, 2000
  16. D. Huttenlocher, D. Klanderman and A. Rucklidge, 'Comparing Images using the Hausdorff Distance,' IEEE Trans. on PAMI, Vol.15, No.9, pp.850-863, Sep., 1993 https://doi.org/10.1109/34.232073
  17. D. Huttenlocher, R. H. Lilien and C. F. Olson, 'View-based Recognition using an Eigenspace Approximation to the Hausdorff Measure,' IEEE Trans. on PAMI, Vol.21, No.9, Sep., 1999 https://doi.org/10.1109/34.790437