Browse > Article

Intelligent Wheelchair System using Face and Mouth Recognition  

Ju, Jin-Sun (건국대학교 대학원 신기술융합학과)
Shin, Yun-Hee (건국대학교 대학원 신기술융합학과)
Kim, Eun-Yi (건국대학교 대학원 신기술융합학과)
Publication Information
Journal of KIISE:Software and Applications / v.36, no.2, 2009 , pp. 161-168 More about this Journal
Abstract
In this paper, we develop an Intelligent Wheelchair(IW) control system for the people with various disabilities. The aim of the proposed system is to increase the mobility of severely handicapped people by providing an adaptable and effective interface for a power wheelchair. To facilitate a wide variety of user abilities, the proposed system involves the use of face-inclination and mouth-shape information, where the direction of an Intelligent Wheelchair(IW) is determined by the inclination of the user's face, while proceeding and stopping are determined by the shape of the user's mouth. To analyze these gestures, our system consists of facial feature detector, facial feature recognizer, and converter. In the stage of facial feature detector, the facial region of the intended user is first obtained using Adaboost, thereafter the mouth region detected based on edge information. The extracted features are sent to the facial feature recognizer, which recognize the face inclination and mouth shape using statistical analysis and K-means clustering, respectively. These recognition results are then delivered to a converter to control the wheelchair. When assessing the effectiveness of the proposed system with 34 users unable to utilize a standard joystick, the results showed that the proposed system provided a friendly and convenient interface.
Keywords
Intelligent Wheelchair; Intelligent Interface; Facial Feature Recognition; Mouth shapes recognition; Face recognition;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Y.Morere and A.Pruski, 'A multi-agent control structure for intelligent wheelchair and aided navigation for disabled people,' First French-Spanish Workshop on Assistive Technology, pp. 35-46, 2003
2 R.Simpson, E.LoPresti S.Hayashi, I. Nourbakhsh and D.Miller, 'The smart wheelchair component system,' Journal of Rehabilitation Research and Development (JRRD), Vol.41, No.3B, pp.429-442, 2004   DOI   ScienceOn
3 Sarangi P.Parikh, Valdir Grassi Jr, Jun Okamoto Jr, 'Usability Study of a Control Framework for an Intelligent Wheelchair,' International Conference on Robotics and Automation Barcelona, 2005
4 H.A.Yanco, 'Shared user-computer control of a robotic wheelchair system,' Ph.D. dissertation, Department of Electrical Engineering and Computer Science, MIT, 2008
5 Gabriel Pires, Rui Araujo, Urbano Nunes, A.T.de Almeida, 'ROBCHAIR A semi autonomouse wheelchair for disabled people,' 3rd IFAC Symposium on Intelligent Autonomous Vehicles(IAV'98), Madrid, pp. 648-652. 1998
6 Yoshinori Kuno, Nobutaka Shimada, And Yoshiaki Shirai, 'A robotic wheelchair based on the integration of human and environmental observations,' IEEE robotic & Automation Magazine, 2003
7 Eun Yi Kim, Sin Kuk Kang.: Eye Tracking using Neural Network and Mean-shift. LNCS, volume 3982, pp. 1200-1209 (2006)   과학기술학회마을
8 H.Mori, T. Nakata and Y.kamiyama, 'Next-Generation Intellignet wheelchair asdevelopmed by ROTA,' Proc. of 36th Int. Symposium on Robotics (ISR2005), pp.39, 2005
9 J.M.Park, J.Song, Y.J. Cho and S.R.Oh, 'A hybrid control architecture using a reactive sequencing startegy for mobile robot navigation,' proc. IROS 99, Vol.3, pp. 1279-1284, 1999
10 Paul viola, Micheal Jones, 'Rapid Object Detection using a Boosted Cascade of Simple Features,' Conference on Computer Vision and Pattern Recognition, 2001
11 Jin Sun Ju, Yunhee Shin, Eun Yi Kim, 'Intelligent Wheelchair using face and mouth shape recognition,' International Conference on Consumer Electronics. 2008   DOI   ScienceOn
12 Simon P. Levine, David A. Bell, Lincoln A. Jaros, Richard C. Simpson, Yoram Koren, 'The Nav-Chair Assistive Wheelchair Navigation System,' IEEE Transaction on rehabilitation engineering, Vol.7, No.4.1999
13 Y.-L.CHEN, S.-C.CHEN, W.-L.CHEN and J.-F.LIN, 'A head orientated wheelchair for people with disabilities,' DISABILITY AND REHABILITATION, Vol.25, No.6, pp. 249-253. 2003   DOI   ScienceOn
14 Pei JIA and Huosheng HU, 'Head gesture recognition for hands-free control of an Intelligent Wheelchair,' Industrial robot Vol.34, No.1, pp.60-68, 2007   DOI   ScienceOn
15 A. Lankenau and T. Rofer, 'Smart Wheelchairs state o the art in an Emerging Market,' Kunstliche Intelligenz, Vol.14, No.4, pp. 37-39, 2000
16 Paul Viola, Michael J.Jones, Robust real-time face detection, International Journal of Computer Vision, pp.137-154, 2004
17 Tao Lu, Kui Yuan, Haibing Zhu, Huosheng Hu, 'An Embedded Control system for Intelligent Wheelchair,' IEEE engineering in Medicine & Biology Society. Proceedings of 27th pp. 1-4, 2005
18 Rafael Barea, Luciano boquete, Elenalopez, Manuel Mazo. 'SIAMO Project(CICYT). Electronics Department. University of Alcala.Madrid.Spain