Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

A Situational Training System based on Augmented Reality for Developmentally Disabled People

발달 장애인을 위한 증강현실 기반 상황훈련 시스템

  • 최재인 (서경대학교 컴퓨터공학과) ;
  • 김경래 (서경대학교 컴퓨터공학과) ;
  • 김태영 (서경대학교 컴퓨터공학과)
  • Received : 2012.11.22
  • Accepted : 2013.03.22
  • Published : 2013.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

Nowadays, many interface devices or training systems have been developed with recent developments in IT technology but only a few training systems for developmentally disabled people have been introduced. In this paper, we present a real-time, interactional and situational training system based on augmented reality in order to improve cognitive capability and adaptive ability in the daily life of developmentally disabled people. Our system is specifically based on serving food in restaurants. This augmented reality based system provides them to experience various different situations safely and take the training session as much as they want under any circumstances. When they use our system, they are able to look around with Head Mounted Display(HMD) and take training sessions easily based on various situational scenarios. After experimenting on our system for 3 months, we found they had no aversion about wearing HMD and learned quicker as they practiced over and over and improved their cognitive capability and adaptive ability. We also got a positive feedback that it had an excellent educational value from teachers in special-education-school.

최근 정보통신 기술과 복지수준이 발전함에 따라 일반인들을 위한 여러 인터페이스 장비나 훈련 시스템들이 개발되고 있으나 발달 장애인을 위한 훈련 시스템은 미흡한 실정이다. 본 논문에서는 발달 장애인이 일상생활에 잘 적응할 수 있도록 인지능력과 상황대처 능력의 향상을 위한 증강현실 기반 실시간 상황 훈련시스템을 제안한다. 본 시스템은 '음식점 서빙'이라는 주제에 기반을 두고 있다. 이 시스템은 증강현실 기술을 기반으로 훈련자에게 다양한 상황에 대한 경험을 안전하게 반복 훈련 가능하도록 한다. 훈련자는 HMD를 착용하고 훈련 공간 주위를 볼 수 있으며, 시나리오에 따른 상황 훈련을 수행한다. 본 시스템을 3개월간 특수학교에서 실시한 결과 발달 장애 학생들은 HMD 착용에 대한 거부감 없이 흥미를 가지고 훈련에 참여했으며 점차 인지속도가 빨라지고 상황대처 능력이 향상됨을 알 수 있었다. 또한 특수학교 교사들로부터 본 시스템이 교육적 효과가 매우 뛰어나다는 피드백을 받았다.

Keywords

References

  1. 최희선, 정다운, 최종수, "손의 기하학적인 특성을 정용한 실시간 비전 기반 증강현실 시스템," 멀티미디어학회논문지, 제15권, 제3호, pp. 323- 335, 2012.
  2. 이강훈, 조세홍, "증강현실을 이용한 건축문화 유산 구현," 멀티미디어학회논문지, 제15권, 제4 호, pp. 425-438, 2012.
  3. 나민영, 김현정, 김태영, "조명과 배경에 강인한 동적임계값 기반 손 영상 분할 기법," 멀티미디어학회논문지, 제14권, 제5호, pp. 607-613, 2011.
  4. H. Kaufmann, "Dynamic Differential Geometry in Education," Journal for Geometry and Graphics, Vol. 13, No. 2, pp. 131-144, 2009.
  5. F. Liarokapis, N. Mourkoussis, M. White, J. Darcy, M. Sifniotis, P. Petridis, A. Basu, and P.F. Lister, "Web3D and Augmented Reality to Support Engineering Education," World Transactions on Engineering and Technology Education, UICEE, Vol. 3, No. 1, pp. 11-14, 2004.
  6. Behrang Parhizkar, Mohammad RabiulL Arash HabibiI Lashkari, MD. Abdullah-ALJubair, Zahra Mohana GebrilL and Mohsen Zarrabi, "Simulation of Investigating the Earth and Universe Using Interactive Mobile Augmented Reality Based On Smart Evaluation," International Multi Conference of Engineers and Computer Scientists (IMECS), Vol. 1, pp. 668-691, 2012.
  7. Billaudeau. V, Richard. P, and Gaudin. G, "Augmented Reality for Rehabilitation of Cognitive Disabled Children: A Preliminary Study," International Conference on Virtual Rehabilitation (ICVR) , pp. 102-108, 2007.
  8. Claudio, Tereza G., "Development of an Interactive Artifact for Cognitive Rehabilitation Based on Augmented Reality," International Conference on Virtual Rehabilitation (ICVR) , pp. 1-7, 2011.
  9. F. Chang, C.J. Chen, and C.J. Lu, "A Lineartime Component-labeling Algorithm using Contour Tracing Technique," Computer Vision and Image Understanding, Vol. 93, No. 2, pp. 206-220, 2004. https://doi.org/10.1016/j.cviu.2003.09.002
  10. Andreas Ess, Tinne Tuytelaars, and Luc Van Gool, "SURF: Speeded Up Robust Features," Computer Vision and Image Understanding, Vol. 110, No. 3, pp. 346-359, 2008. https://doi.org/10.1016/j.cviu.2007.09.014
  11. J.J. Foo, J. Zobel, R. Sinha, and S. Tahaghoghi, "Detection of Near-duplicate Images for Web Search," Proc. the 6th ACM International Conference on Image and Video Retrieval , pp. 557-564, 2007.
  12. David Gossow, Peter Decker, and Dietrich Paulus, "An Evaluation of Open Source SURF Implementations," Lecture Notes in Computer Science , Vol. 6556, pp. 169-179, 2011.
  13. J. Abdullah and K. Marteniz, "Camera Self-Calibration for the ARTollKit," Proc. of First International Augmented Reality Toolkit Workshop, pp. 84-88, 2002.

Cited by

  1. Developing a Simulator on the Manufacturing Process of Electrical Substation System vol.18, pp.1, 2015, https://doi.org/10.9717/kmms.2015.18.1.081
  2. A Study on the Effect of Education Method for Adolescent's Suicide Prevention Using HMD and Virtual Reality vol.19, pp.2, 2016, https://doi.org/10.9717/kmms.2016.19.2.495
  3. Development of a Platform for Augmented Reality-Based Speech Language Therapy vol.23, pp.2, 2018, https://doi.org/10.12963/csd.18504
  4. 지적장애 학생을 위한 증강현실 과학교육 콘텐츠구현 및 적용 가능성 탐색 vol.16, pp.1, 2013, https://doi.org/10.5392/jkca.2016.16.01.720
  5. The Effects of Augmented Reality based Guiding Inquiry Intervention on Science of Students with Learning Disabilities vol.12, pp.2, 2013, https://doi.org/10.26592/ksie.2017.12.2.251
  6. Visualizing Behavior Characteristics of Developmental Disabilities During Virtual Reality Training vol.19, pp.2, 2013, https://doi.org/10.14801/jkiit.2021.19.2.123
  7. 가상현실기반 훈련 콘텐츠에서 발달장애인의 시각적 주의집중도 분석 vol.24, pp.2, 2013, https://doi.org/10.9717/kmms.2020.24.2.328