Browse > Article

The Sensory-Motor Fusion System for Object Tracking  

Lee, Sang-Hee (인하대학 공대 정보통신공학과)
Wee, Jae-Woo (인하대학 공대 전자과)
Lee, Chong-Ho (인하대학 공대 정보통신공학부)
Publication Information
The Transactions of the Korean Institute of Electrical Engineers D / v.52, no.3, 2003 , pp. 181-187 More about this Journal
Abstract
For the moving objects with environmental sensors such as object tracking moving robot with audio and video sensors, environmental information acquired from sensors keep changing according to movements of objects. In such case, due to lack of adaptability and system complexity, conventional control schemes show limitations on control performance, and therefore, sensory-motor systems, which can intuitively respond to various types of environmental information, are desirable. And also, to improve the system robustness, it is desirable to fuse more than two types of sensory information simultaneously. In this paper, based on Braitenberg's model, we propose a sensory-motor based fusion system, which can trace the moving objects adaptively to environmental changes. With the nature of direct connecting structure, sensory-motor based fusion system can control each motor simultaneously, and the neural networks are used to fuse information from various types of sensors. And also, even if the system receives noisy information from one sensor, the system still robustly works with information from other sensors which compensates the noisy information through sensor fusion. In order to examine the performance, sensory-motor based fusion model is applied to object-tracking four-foot robot equipped with audio and video sensors. The experimental results show that the sensory-motor based fusion system can tract moving objects robustly with simpler control mechanism than model-based control approaches.
Keywords
Neural network; Sensory-motor; Sensor fusion; Fusion system; Object tracking;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Jinji Chen, Mukai, T. , Takeuchi, Y. , Matsumoto, T., Kudo, H., Yamamura, T., Ohnishi, N, Tsuyoshi Yamamura, Noboru Ohnishi, 'Relating audio-visual events caused by multiple movements: in the case of entire object movement' ,Information Fusion, 2002 Proceedings of the Fifth International Conference on, vol.1, pp. 213-219, 2002   DOI
2 Joey Rogers, 'Object-Oriented Neural Networks in C++', Academic Press. 1997
3 Chi-Tsong Chen, 'Linear system theory and design', Holt, Rinehart and Winston, Inc., 1984
4 Timothy Masters, 'Practical Neural Network Recipes in C++', Academic Press, 1993
5 Barbara Webb, Reid Harrison, 'Eyes and Ears: Combining Sensory Motor Systems Modelled on Insect Physiology', ICRA '00. IEEE International Conference on, Volume: 4, pp. 3913 -3918, 2000   DOI
6 Rodney A. Brooks, 'Cambrian Intelligence: The Early History of the New AI', MIT Press, 1999
7 M. Ishikawa, 'Sensor fusion:The state of the art,' J. Robot. Mechatron., vol.2-4, pp. 235-244, 1991
8 Hiromi Takeuchi, Koichiro Yamauchi and Naohiro Ishii, 'Self-Supervised Learning and Recognition by Integrating Information from Several Sensors', IECON 2000. 26th Annual Confjerence of the IEEE, vol.2, pp. 1195 - 1200, 2000   DOI
9 Ren C. Luo, S.H.Henry Phang, and Kuo L. Su.,'Multilevel Multisensor Based Decision Fusion for Intelligent Animal Robot', IEEE International Conference on, Volume: 4, pp. 4226 -4231, 2001
10 Hiromi takeuchi, Koichiro Yamauchi and Naohiro Ishii, 'Supervised learning method for integrating information from several sensors-Integration of inconsistent sensory inputs-', IEEE SMC '99 Conference Proceedings, vol.3, pp. 459 -464, 1999   DOI
11 Koichiro Yamauchi, Mikiya Oota, Naohiro Ishii, 'A self-supervised learning system for category detection by integrating information from several sensors', Proceedings of IEEE International Conference, pp. 694-699, 1996   DOI
12 Namiki, A., Nakabo, Y., Ishii, I., Ishikawa, M. '1-ms Senssory-Motor Fusion System', Mechatronics, IEEE/ASME Transactions on , Volume: 5 Issue: 3 , 244-252, Sept. 2000   DOI   ScienceOn
13 Valentino Braitenberg, 'Vehicles:Experiments in Synthetic Psychology', MIT Pressj, 1984
14 Koball, B.R., Wharton, J.H. 'A test vehicle for Braitenberg control structures', Compcin Spring '88. Thirth-Third IEEE Computer Society International Conference, Digest of Papers, 394 -398, 1988   DOI