Implementation of Sound Source Localization Based on Audio-visual Information for Humanoid Robots

휴모노이드 로봇을 위한 시청각 정보 기반 음원 정위 시스템 구현

  • 박정욱 (전남대학교 공과대학 전자정보통신학과) ;
  • 나승유 (전남대학교 공과대학 전자정보통신학과) ;
  • 김진영 (전남대학교 공과대학 전자정보통신학과)
  • Published : 2004.12.01

Abstract

This paper presents an implementation of real-time speaker localization using audio-visual information. Four channels of microphone signals are processed to detect vertical as well as horizontal speaker positions. At first short-time average magnitude difference function(AMDF) signals are used to determine whether the microphone signals are human voices or not. And then the orientation and distance information of the sound sources can be obtained through interaural time difference. Finally visual information by a camera helps get finer tuning of the angles to speaker. Experimental results of the real-time localization system show that the performance improves to 99.6% compared to the rate of 88.8% when only the audio information is used.

Keywords