Journal of the Korean Institute of Intelligent Systems (한국지능시스템학회논문지)

Korean Institute of Intelligent Systems (한국지능시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Speech Emotion Recognition Using Confidence Level for Emotional Interaction Robot

감정 상호작용 로봇을 위한 신뢰도 평가를 이용한 화자독립 감정인식

  • Received : 2009.06.30
  • Accepted : 2009.12.10
  • Published : 2009.12.25
Download PDF
⟨ Previous Next ⟩

Abstract

The ability to recognize human emotion is one of the hallmarks of human-robot interaction. Especially, speaker-independent emotion recognition is a challenging issue for commercial use of speech emotion recognition systems. In general, speaker-independent systems show a lower accuracy rate compared with speaker-dependent systems, as emotional feature values depend on the speaker and his/her gender. Hence, this paper describes the realization of speaker-independent emotion recognition by rejection using confidence measure to make the emotion recognition system be homogeneous and accurate. From comparison of the proposed methods with conventional method, the improvement and effectiveness of proposed methods were clearly confirmed.

인간의 감정을 인식하는 기술은 인간-로봇 상호작용 분야의 중요한 연구주제 중 하나이다. 특히, 화자독립 감정인식은 음성감정인식의 상용화를 위해 꼭 필요한 중요한 이슈이다. 일반적으로, 화자독립 감정인식 시스템은 화자종속 시스템과 비교하여 감정특징 값들의 화자 그리고 성별에 따른 변화로 인하여 낮은 인식률을 보인다. 따라서 본 논문에서는 신뢰도 평가방법을 이용한 감정인식결과의 거절 방법을 사용하여 화자독립 감정인식 시스템을 일관되고 정확하게 구현할 수 있는 방법을 제시한다. 또한, 제안된 방법과 기존 방법의 비교를 통하여 제안된 방법의 효율성 및 가능성을 검증한다.

Keywords

References

  1. E. H. Kim, Kwak, S.S., Hyun, K.H., Kim, S.H., Kwak, Y.K., 'Design and Development of an Emotional Iteraction Robot, Mung,' Advanced Robotics, Vol. 23, pp. 767-784, 2009 https://doi.org/10.1163/156855309X431712
  2. M. Pantic, L. Rothkrantz, 'Toward an Affect-Sensitive Multimodal Human-Computer Interaction,' Proceeding of the IEEE, Vol. 91, No. 9, pp. 1370-1390, Sep. 2003 https://doi.org/10.1109/JPROC.2003.817122
  3. B.Schuller, D.Seppi, A.Batliner, A.Maier, S.Steidl, 'Towards More Reality in the Recognition of Emotional Speech,' IEEE International Conference on Acoustics, Speech, and Signal Processing, 2007
  4. C. E. Williams, K. N. Stevens, 'Emotions and Speech: Some Acoustical Correlates,' The Journal of the Acoustical Society of America, Vol. 52, pp. 1238, 1972 https://doi.org/10.1121/1.1913238
  5. R. V. Bezooijen, 'The Characteristics and Reconcilability of Vocal Expression of Emotions.' The Netherlands. Foris, Drodrecht, 1984
  6. R. Banse, K. R. Scherer, 'Acoustic profiles in vocal emotion expression,' Journal of Personality and Social Psychology, Vol. 70, pp. 614-636, 1996 https://doi.org/10.1037/0022-3514.70.3.614
  7. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellenz, J. G. Taylor, 'Emotion recognition in human-computer interaction,' Signal Processing Magazine, IEEE, Vol. 18, pp. 32-80, 2001 https://doi.org/10.1109/79.911197
  8. R. W. Frick, 'Communicating emotion: the role of prosodic features,' Psychological bulletin., Vol. 97, pp. 412-429, 1985 https://doi.org/10.1037/0033-2909.97.3.412
  9. P. Y. Oudeyer, 'The production and recognition of emotions in speech: features and algorithms,' International Journal of Human-Computer Studies, Vol. 59, pp. 157-183, 2003 https://doi.org/10.1016/S1071-5819(02)00141-6
  10. N. Sebe, I. Cohen, T. S. Huang, 'Multimodal emotion recognition,' Handbook of Pattern Recognition and Computer Vision, pp. 981-256, 2005
  11. B. Schuller, R. J. Villar, G. Villar, M. Lang, 'Meta-Classifiers in Acoustic and Linguistic Feature Fusion-Based Affect Recognition,' IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005
  12. E. H. Kim, K. H. Hyun, S. H. Kim, Y. K. Kwak, 'Improved Emotion Recognition with a Novel Speaker-Independent Feature', IEEE/ASME Trans. on Mechatronics, 2009
  13. D. Ververidis, C. Kotropoulos, I. Pitas, 'Automatic emotional speech classification,' IEEE International Conference on Acoustics, Speech, and Signal Processing, 2004
  14. B. S. Kang, 'Text Independent Emotion Recognition Using Speech Signals,' Yonsei Univ. pp.35-40, 2000
  15. http://www.gamsung.or.kr
  16. S. Marukatat, T. Artieres, P. Gallinari, B. Dorizzi, P. Lip, 'Rejection measures for handwriting sentence recognition,' Proceedings of 8th International Workshop on Frontiers in Handwriting Recognition, 2002
  17. G. Bouwman, L. Boves, J. Koolwaaij, 'Weighting phone confidence measures for automatic speech recognition,' presented at Workshop on Voice Operated Telecom Services, Ghent, Belgium, 2000
  18. H. Jiang, 'Confidence measures for speech recognition: A survey,' Speech Communication, Vol. 45, pp. 455-470, 2005 https://doi.org/10.1016/j.specom.2004.12.004
  19. T. Okada, S. Tomita, 'An optimal orthonormal system for discriminant analysis,' Pattern Recognition, vol. 18, pp. 139-144, 1985 https://doi.org/10.1016/0031-3203(85)90037-8

Cited by

  1. A Human-Robot Interaction Entertainment Pet Robot vol.24, pp.2, 2014, https://doi.org/10.5391/JKIIS.2014.24.2.179