Browse > Article
http://dx.doi.org/10.9717/kmms.2013.16.2.254

An Implementation of Table-top based Augmented Reality System for Motor Rehabilitation of the Paretic Hand  

Lee, Seokjun (경북대학교 컴퓨터학부)
Park, Kil Houm (경북대학교 전자공학부)
Lee, Yang Soo (경북대학교 의학전문대학원)
Kwak, Ho Wan (경북대학교 심리학과)
Moon, Gye Wan (경북대학교 경영학부)
Choi, Jae Hun (경북대학교 영어영문학과)
Jung, Soon Ki (경북대학교 컴퓨터학부)
Publication Information
Journal of Korea Multimedia Society / v.16, no.2, 2013 , pp. 254-268 More about this Journal
Abstract
This paper presents an augmented reality (AR) based rehabilitation exercise system to enhance the motor function of the hands for the paretic/hemi-paretic patient. The existing rehabilitation systems rely on mechanical apparatus for palsy rehabilitation, but we aim to use the rehabilitation system at home with easy configuration and minimized equipment by the computer vision based approach. The proposed method evaluates the interaction status of the fingertip action by using the position and the contact of the fingertip markers. We obtain the 2D positions of the fingertip markers from a single camera, and then transform the 3D positions from the calibrated camera space by using an ARToolKit marker. We adopt simple geometric calculation by the conversion of the 2D interest points into the 3D interaction points for the simple interactive task in AR environment. Some experimental results show that the proposed method is practical and simply applicable to the applications with personal AR interaction.
Keywords
Motor Rehabilitation; Human Motion Capture; Augmented Reality;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 P. Milgram and F. Kishino, "A Taxonomy of Mixed Reality Visual Displays," IEICE Trans. Information Systems, Vol. E77-D, No. 12, pp. 1321-1329, 1994. (호 기입 요함!)
2 P. Milgram, H. Takemura, A. Utsumi, and F. Kishino, "Augmented Reality: A Class of Displays on the Reality-virtuality Continuum," Tele-manipulator and Tele-presence Technologies, Vol. 2351, pp. 282-292, 1994.(호 기입 요함!-호 없음)
3 F.P. Brooks, Jr., "The Computer Scientist as Toolsmith II," Communications of the ACM, Vol.39, No. 3, pp. 61-68, 1996.(호 기입 요함!)
4 J.H. Carr and R.B. Shephered, Stroke Rehabilitation, Butterworth-Heinemann, London, 2003.
5 H.M. Feys, W.J. De Weerdt, B.E. Selz, G.A. Cox Steck, R. Spichiger, L.E. Vereeck, K.D. Putman, and G.A. Van Hoydonck, "Effect of a Therapeutic Intervention for the Hemiplegic Upper Limb in the Acute Phase After Stroke," A Single-Blind, Randomized, Controlled Multicenter Trial, Vol. 29, No. 4, pp. 785-792, 1998.   DOI   ScienceOn
6 L. Oujamaa, I. Relave, J. Froger, D. Mottet, and J.Y. Pelissier, "Rehabilitation of Arm Function After Stroke," Literature Review, Annals of Physical and Rehabilitation Medicine, Vol. 52, No. 3, pp. 269-293, 2009.   DOI   ScienceOn
7 박수현, 유은영, "강제유도운동치료에 관한 고찰," 대한작업치료학회지, 제12권, 제1호, pp. 123-137, 2004.
8 박지원, 김식현, 남기석, 김연희, 배성수, "상지 신경 가동기법이 뇌졸중 후 편마비 환자의 기능 회복에 미치는 영향," 한국전문물리치료학회 지, 제8권, 제2호, pp. 29-39, 2001.
9 L.F. Lucca, "Virtual Reality and Motor Rehabilitation of the Upper Limb After Stroke: A Generation of Progress?," Journal of Rehabilitation Medicine , Vol. 41, No. 12, pp. 1003-1006, 2009.   DOI   ScienceOn
10 F.D. Rose, E.A. Attree, B.M. Brooks, D.M. Parslow, P.R. Penn, and N. Ambihaipahan, "Training in Virtual Environments: Transfer to Real World Tasks and Equivalence to Real Task Training," Ergonomics, Vol. 43, No. 4, pp. 494-511, 2000.   DOI   ScienceOn
11 S.R. Sharar, G.J. Carrougher, D. Nakamura, H.G. Hoffman, D.K. Blough, and D.R. Patterson, "Factors Influencing the Efficacy of Virtual Reality Distraction Analgesia during Postburn Physical Therapy: Preliminary Results from 3 Ongoing Studies," Archives of Physical Medicine and Rehabilitation, Vol. 88, No. 12, pp. 43-49, 2007.   DOI   ScienceOn
12 임명재, 정희웅, 이기영, "증강현실 기반의 물체 인식을 통한 게임형 인지 재활 시스템," 한국인터넷방송통신학회논문지, 제11권, 제3호, pp. 93- 98, 2011.   과학기술학회마을
13 이병희, 김성렬, 서현두, 유하나, "뇌성마비아동의 시공간적 보행능력에 미치는 증강 현실기반 운동 프로그램의 임상적 유용성 연구," 특수교육재활과학연구, 제48권, 제4호, pp. 211-230, 2009.
14 최완, 김태영, 임철수, "재활 훈련 서비스를 위한 실시간 모션인식 알고리즘," 멀티미디어학회논문지, 제10권, 제9호, pp. 1143-1152, 2007.   과학기술학회마을
15 M. Kolsch and M. Turk, "Robust Hand Detection," Proc. Int. Conf. Autom. Face and Gesture Recognition, pp. 614-619, 2004.
16 Y. Wu and T.S. Huang, "View-Independent Recognition of Hand Postures," Proc. Computer Vision and Pattern Recognition, Vol. 2, pp. 88-94, 2000.
17 Y. Wu, Q. Liu, and T.S. Huang, "An Adaptive Self-organizing Color Segmentation Algorithm with Application to Robust Real-time Human Hand Localization," Proc. Asian Conf. on Computer Vision, pp. 1106-1111, 2000.
18 X. Zhu, J. Yang, and A. Waibel, "Segmenting Hands of Arbitrary Color," Proc. Int. Conf. Autom. Face and Gesture Recognition, pp. 446-453, 2000.
19 E.J. Ong and R. Bowden, "A Boosted Classifier Tree for Hand Shape Detection," Proc. Int. Conf. Automatic Face and Gesture Recognition, pp. 889-894, 2004.
20 P. Viola and M. Jones, "Rapid Object Detection using a Boosted Cascade of Simple Features," Proc. Computer Vision and Pattern Recognition, pp. 511-518, 2001.
21 P. Buehler, M. Everingham, D.P. Huttenlocher, and A. Zisserman, "Long Term Arm and Hand Tracking for Continuous Sign Language TV Broadcasts," Proc. British Machine Vision Conference, Vol. 110, pp. 1-10, 2008.
22 L. Karlinsky, M. Dinerstein, D. Harari, and S. Ullman, "The Chains Model for Detecting Parts by Their Context," Proc. Computer Vision and Pattern Recognition, pp. 25-32, 2010.
23 M.P. Kumar, P.H.S. Torr, and A. Zisserman, "Efficient Discriminative Learning of Partsbased Models," Proc. IEEE International Conference on Computer Vision, pp. 552-559, 2009.
24 RelayHealth, http://www.relayhealth.com/
25 ARToolKit, HIT Lab., http://www.artoolworks.com/.
26 Optitrack, NaturalPoint, http://www.naturalpoint.com/optitrack/, 1996.
27 R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, USA: Cambridge University Press, New York, NY 2003.
28 T. Horprasert, D. Harwood, and L.S. Davis, "A Statistical Approach for Real-time Robust Background Subtraction and Shadow Detection," IEEE International Conference on Computer Vision, Vol. 99, pp. 1-19, 1999.
29 R.C. Gonzalez and R.E. Woods, Digital Image Processing, Prentice Hall, New Jersey, 2002.
30 M.S. Cameirao, S.B. Badia, E.D. Oller, and P.F. Verschure, "Neurorehabilitation using the Virtual Reality based Rehabilitation Gaming System: Methodology, Design, Psychometrics, Usability and Validation," Journal of Neuroengineering Rehabilitation, Vol. 7, pp. 48-62, 2010.   DOI   ScienceOn
31 S.K. Charles, H.I. Krebs, B.T. Volpe, D. Lynch, and N. Hogan, "Wrist Rehabilitation Following Stroke: Initial Clinical Results," Proc. International Conference on Rehabilitation Robotics, pp. 13-16, 2005.