DOI QR코드

DOI QR Code

Image Recognition and Clustering for Virtual Reality based on Cognitive Rehabilitation Contents

가상현실 기반 인지재활 콘텐츠를 위한 영상 인식 및 군집화

  • 최권택 (강남대학교 소프트웨어응용학부 가상현실전공)
  • Received : 2017.10.31
  • Accepted : 2017.11.25
  • Published : 2017.11.30

Abstract

Due to the 4th industrial revolution and an aged society, many studies are being conducted to apply virtual reality to medical field. Research on dementia is especially active. This paper proposes virtual reality based on cognitive rehabilitation contents using image recognition and clustering method to improve cognitive and physical disabilities caused by dementia. Unlike the existing cognitive rehabilitation system, this paper uses travel photos that reflect the memories of the subjects to be treated. In order to generate automated cognitive rehabilitation contents, we extract face information, food pictures, place information, and time information from photographs, and normalization is performed for clustering. And we present scenarios that can be used as cognitive rehabilitation contents using travel photos in virtual reality space.

4차 산업혁명과 초고령 시대로 인해, 가상현실을 의료 분야에 적용하려는 많은 연구가 진행되고 있다. 특히 치매에 대한 논의가 활발히 이루어지고 있다. 본 논문은 치매로 인해 발생하는 인지 및 신체 장애를 개선하기 위해 영상 인식 및 군집화 방법을 사용한 가상현실 인지재활 콘텐츠를 제안한다. 기존 인지재활 시스템과는 달리 본 논문에서는 치료 대상자의 추억이 반영되어 있는 여행사진을 사용한다. 자동화된 인지재활 콘텐츠 생성을 위해 사진으로부터 인물정보, 음식사진 여부, 장소 정보, 시간 정보를 추출하고, 군집화를 위해 정규화가 수행된다. 그리고 가상현실 공간에서 여행 사진을 활용해 인지재활 및 신체재활을 강화할 수 있는 시나리오를 제시한다.

Keywords

References

  1. Mansik Kim, Jungho Kang and Moon-seong Jun, 2016, "Market and Technical Trends of VR Technologies," The Korea Contents Association Review, Vol. 14, No. 4, pp. 14-16.
  2. K.-E. Chang, J. Zhang, T.-C. Liu, "Workshop on Virtual, Augmented and Mixed Reality in Education (VAMrE 2017) Summary", 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), Pages: 293 - 293.
  3. Jiyoung Kang, 2017, "Study on Characteristics of Digital Realism Aspect for HMD based Virtual Reality Films," Journal of Digital Contents Society, Vol. 18, No. 5, pp. 849-858. https://doi.org/10.9728/DCS.2017.18.5.849
  4. C. S. Kim, Y. H. Kwon, 2005, "Therapeutic Virtual Reality Program in Chronic Stroke Patients Recovery of Upper Extremity and Neuronal Reorganization", Journal of Special Education & Rehabilitation Science, 44(1), 87-106.
  5. Flynn, D., Van Schaik P., Blackman, T., and Femcott, C., 2003, "Developing a Virtual Reality-Based Methodology for People with Dementia: A Feasibility Study", CyberPsychology, 6(6), 591-611. https://doi.org/10.1089/109493103322725379
  6. Larson EB, Feigon M, Gagliardo P3, Dvorkin AY, "Virtual reality and cognitive rehabilitation: a review of current outcome research", NeuroRehabilitation. 2014;34(4):759-72.
  7. M. I. Khan, A. Prado, S. K. Agrawal, "Effects of Virtual Reality Training With Trunk Support Trainer (TruST) on Postural Kinematics Sign In or Purchase", IEEE Robotics and Automation Letters ( Volume: 2, Issue: 4, Oct. 2017.
  8. Y. G. Kim, 2011, Development of a Korean Computer-based Cognitive Rehabilitation Program (CoTras) for Patients with Cognitive Disabilities and the Validation of it's Effects. Pusan National University in South Korea, 34-9.
  9. W. H. Kim, J. H. Chang, 2017, "A system for efficient checkup and management of dementia using a smart-phone", Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology, 7(1): 577-585.
  10. H. R. Lee, J. Y. Kim, and D. S. Han, 2012, "A Survey on the Cognitive Rehabilitation of Occupational Therapy in Korea", Journal of Korean Society of Occupational Therapy, 20(2): 73-84.
  11. S.-H. Han, E.-J. Jo, D.-h. Noh, K.-Y. Kam, "Effects of Korean Computer-Based Cognitive Rehabilitation Program (CoTras) on Frontal-Executive Functions in Patients with Traumatic Brain Injury", Journal of the Korea Academia-Industrial cooperation Society, Vol. 16, No. 5 pp. 3344-3352, 2015 https://doi.org/10.5762/KAIS.2015.16.5.3344
  12. Lee Gayoung and Kim Sunhee K., "A literature review on the use of photography and digital images in art therapy," The Korean Journal of Arts Studies, No. 13, pp. 219-241.
  13. S. Xia, H. Pan, A.K. Qin, "Face Clustering in Photo Album", ICPR 2014.
  14. C. Otto, B. Klare, A. K. Jain, "An Efficient Approach for Clustering Face Images", IAPR International Conference on Biometrics 2015.