Browse > Article
http://dx.doi.org/10.5391/JKIIS.2005.15.2.173

Virtual Dialog System Based on Multimedia Signal Processing for Smart Home Environments  

Kim, Sung-Ill (Division of Electronic and Electrical Engineering, Kyungnam University)
Oh, Se-Jin (Radio Astronomy Division, Korea Astronomy and Space Science Institute)
Publication Information
Journal of the Korean Institute of Intelligent Systems / v.15, no.2, 2005 , pp. 173-178 More about this Journal
Abstract
This paper focuses on the use of the virtual dialog system whose aim is to build more convenient living environments. In order to realize this, the main emphasis of the paper lies on the description of the multimedia signal processing on the basis of the technologies such as speech recognition, speech synthesis, video, or sensor signal processing. For essential modules of the dialog system, we incorporated the real-time speech recognizer based on HM-Net(Hidden Markov Network) as well as speech synthesis into the overall system. In addition, we adopted the real-time motion detector based on the changes of brightness in pixels, as well as the touch sensor that was used to start system. In experimental evaluation, the results showed that the proposed system was relatively easy to use for controlling electric appliances while sitting in a sofa, even though the performance of the system was not better than the simulation results owing to the noisy environments.
Keywords
Smart Home; Dialog System; Speech Recognition; Motion Detection; Multimedia Signals;
Citations & Related Records
연도 인용수 순위
  • Reference
1 S-J Oh, C-J Hwang, B-K Kim, H-Y Chung, and A. Ito, 'New state clustering of hidden Markovnetwork with Korean phonological rules for speech recognition,' IEEE 4th work. on Multimedia Signal Processing, pp. 39-44, 2001
2 S-J Oh, C-J Hwang, B-K Kim, H-Y Chung, 'Performance Evaluation of HM-Nets Speech Recognition System using the Large Vocabulary Korean Speech Databases,' Proc. Kyushu- Youngnam Joint Conf. on Acoustics, pp. 49-52, 2003
3 P. M. Corcoran, F. Papai, A.Zoldi, 'User Interface Technologies for Home Appliances and Networks', IEEE Trans. on Consumer Electronics, August 1998
4 M. Mozer, 'The neural network house: An environment that adapts to its inhabitants', Proc. AAAI Sym. on Intelligent Environments, pp.110-114, 1998
5 M. Kohler, 'Special Topics of Gesture Recognition Applied in Intelligent Home Environments', Lecture Notes in Computer Science, Vol.1371, pp.285-233, 1998
6 D. J. Cook, M. Youngblood, E. Heierman, K. Gopalratnam, S. Rao, A. Litvin, and F. Khawaja, 'MavHome: An Agent-Based Smart Home', Proc. IEEE Int. Conf. on Pervasive Computing and Communications, pp.521-524, 2003
7 J. Takami and S. Sagayama, 'A Successive State Splitting Algorithm for Efficient Allophone Modeling,' Proc. ICASSP'92, Vol. 1, pp. 573-576, 1992
8 M. Ostendoft and H. Singer, 'HMM Topology design Using Maximum Likelihood Successive State Splitting', Computer Speech and Language Vol. 11, pp. 17-41, 1997   DOI   ScienceOn
9 M. Suzuki, S. Makino, A. Ito, H. Aso and H. Shimodaira, 'A new HMnet construction algorithm requiring no contextual factors,' IEICE Trans. Inf. & Syst., Vol. E78-D, No. 6, pp. 662-669, 1995
10 J. Machate, 'Being natural - on the use of multimodal interaction concepts in smart homes', HCI(2), pp.937-941, 1999