Browse > Article
http://dx.doi.org/10.5391/JKIIS.2007.17.4.519

Audio-Visual Localization and Tracking of Sound Sources Using Kalman Filter  

Song, Min-Gyu (전남대학교 전자컴퓨터공학부)
Kim, Jin-Young (전남대학교 전자컴퓨터공학부)
Na, Seung-You (전남대학교 전자컴퓨터공학부)
Publication Information
Journal of the Korean Institute of Intelligent Systems / v.17, no.4, 2007 , pp. 519-525 More about this Journal
Abstract
With the high interest on robot technology and application, the research on artificial auditory systems for robot is very active. In this paper we discuss sound source localization and tracing based on audio-visual information. For video signals we use face detection based on skin color model. Also, binaural-based DOA is used as audio information. We integrate both informations using Kalman filter. The experimental results show that audio-visual person tracking Is useful, specially in the case that some informations are not observed.
Keywords
개인추적;얼굴색;상관함수;칼만필터;청각모델;
Citations & Related Records
연도 인용수 순위
  • Reference
1 P. S. Chang, 'Performance of 3D Speaker Localization Using a Small Array of Microphones,' In Proc.. of IEEE International Conference on Thirty-First Asilomar, Vol. 1, pp. 2-5, 1997
2 J. Vermaak and A. Blake, 'Nonlinear filtering for speaker tracking in noisy and reverberant environment,' In Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing (ICASSP-01), Salt Lake City, UT, USA, May 2001
3 J. Vermaak and A. Blake, 'Sequential monte carlo fusion of sound and vision for speaker tracking,' In International Conference on computer Vision, 2001
4 H. A. Rowley, S. Baluja, T. Kanade, 'Human face detection in visual scenes,' CMU-CS-95-158, Carnegie Mellon University, November, 1995
5 M. Isard and A. Blake, 'Condensation-Conditional density propagation for visual tracking,' In Int. J. Computer Vision, Vol. 29, no1, pp5-28, 1998   DOI   ScienceOn
6 D. J. Beymer and K. Konolige, 'Real-time tracking of multiple people using stereo,' In Frame-rate99, 1999
7 S. Kawato and J. Ohva, 'Automatic Skin-color Distribution Extraction for Face Detection and Tracking,' In ICDSP2000 : The 5th Int. Conf. on Signal Processing, Vol. II, pp 1415-1418, 2000
8 F. Tomaz, T. Candeias and H. Shahbazkia, 'Improved Automatic Skin Detection in color Inages,' In Proc. VIIth Digital Image Compution : Techniques and Applications, Sun C. Talbot H. Ourselin S. and Adriaansen T., pp 10-12, 2003
9 A. Harma. (2000, March 7). THTear Matlab Toolbox(version2.0) Available http://www.asustic.hut.fi/software/HUTear/HUTear.html
10 J. Segen and S. Pingali, 'A camera-based system for tracking people in real time,' in International Conference on Pattern Recognition, Vol. 3 pp. 63-67, 1996