Journal of the Korea Academia-Industrial cooperation Society (한국산학기술학회논문지)

The Korea Academia-Industrial cooperation Society (한국산학기술학회)
권호 표지
DOI QR코드

DOI QR Code

Implementation of Smart Device-Based on Platform for the Visually Impaired

시각 장애인을 위한 스마트 장치 기반 플랫폼 구현

  • Lee, Ook (Division of Information System, Hanyang University) ;
  • Choi, Jung-Woon (Division of Information System, Hanyang University)
  • 이욱 (한양대학교 정보시스템학과) ;
  • 최정운 (한양대학교 정보시스템학과)
  • Received : 2019.01.03
  • Accepted : 2019.05.03
  • Published : 2019.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

This study suggests a new platform in which VI can communicate with their guardians who serve as a system administrator optimizing personal characteristics. In terms of interaction between platform components, this study can contribute to enhancing stability of walking by giving substantial information to VI through server processing and setups of guardians with real-time interaction to VI through server processing and setups of guardians with real-time interaction. Therefore, developing smart phone applications can facilitate both portability and cost effectiveness, by the users' downloading the application and registration. In terms of guardians' cost, this system is cost-effective because they can access to the administration system through personal computers or smart phones, not through specialized system devices. This system is web-based, which automatically communicates with the surroundings of, such as provides the guardians with the necessary information or approaches to the danger through IoT devices, which results in enhancing safety. Moreover, it is possible for guardians to utilize the personalized platform since the system not only senses personal characteristics but also sends a number of information to VI. a new platform makes it possible for guardians to provide electronic support and interaction with the application with the application users, which contributes to systematic and safe walk for VI.

본 논문은 시각장애인의 개인적 특성을 최적화하는 시스템을 관리하는 보호자와 통신 할 수 있는 새로운 플랫폼을 제안한다. 플랫폼 구성 요소 간의 상호 작용 측면에서 서버 처리 및 실시간 상호 작용을 통해 보호자 설정을 한다. 이로써 시각장애인에 상당한 정보를 제공하여 이들의 보행 안정성을 향상시키는 데 기여할 수 있다. 따라서 스마트 폰 애플리케이션 개발은 사용자가 애플리케이션을 다운로드함으로써 휴대성과 비용 효율성을 모두 향상시킬 수 있다. 보호자 비용 측면에서 이 시스템은 특수 시스템 장치가 아닌 개인 컴퓨터 또는 스마트 폰을 통해 관리 시스템에 액세스할 수 있기 때문에 비용 효율적이다. 이 시스템은 건물 위치, 위험, 장애물까지의 거리, 신호등 및 단계를 알려주는 것과 같이 시각장애인의 주변 환경과 자동으로 통신하는 웹 기반이다. IOT 장치를 통한 위험 접근과 같은 필요한 정보를 보호자에게 제공하여 안전을 향상시킨다. 또한 시스템이 개인적 특성을 감지 할뿐만 아니라 시각장애인에 많은 정보를 전송하기 때문에 보호자가 개인화 된 플랫폼을 활용할 수 있다. 새로운 플랫폼을 통해 보호자가 응용 프로그램 사용자와 전자 지원 및 상호 작용을 제공 할 수 있으므로 시각장애인에 대한 체계적이고 안전한 보행에 기여할 수 있다.

Keywords

SHGSCZ_2019_v20n5_538_f0001.png 이미지

Fig 1. Overall platform architecture

SHGSCZ_2019_v20n5_538_f0002.png 이미지

Fig 2. Process diagram of entire platform

SHGSCZ_2019_v20n5_538_f0003.png 이미지

Fig 3. Screenshots of informing function(a) List page (b) Page of detailed information

SHGSCZ_2019_v20n5_538_f0004.png 이미지

Fig 4. Screenshots of the function of registering dangerous area.(a) List page (b) Page of detailed information

SHGSCZ_2019_v20n5_538_f0005.png 이미지

Fig 5. Screenshots of the function of registering routes.(a) List page (b) Page of detailed information

SHGSCZ_2019_v20n5_538_f0006.png 이미지

Fig 6. Screenshots of the function of registering IOT information (a) List page (b) Page of detailed information

Table 1. Sensors of the IoT devices

SHGSCZ_2019_v20n5_538_t0001.png 이미지

Table 2. Statistical results of travel simulation experiment

SHGSCZ_2019_v20n5_538_t0002.png 이미지

Table 3. The advantage unit survey by analyzing unit concepts

SHGSCZ_2019_v20n5_538_t0003.png 이미지

Table 4. The disadvantage unit survey by analyzing unit concepts

SHGSCZ_2019_v20n5_538_t0004.png 이미지

Table 5. Performance Test of Each Function Category

SHGSCZ_2019_v20n5_538_t0005.png 이미지

References

  1. World Health Organization (WHO) "The Survey of the Visual impairment and blindness". Available From: http://www.who.int/mediacentre/factsheets/fs282/en/ (last accessed 2014)
  2. The Ministry of health and welfare, Government of Korea "The Survey of Disabled Persons 2014". Available From: http://www.mohw.go.kr/front_new/jb/sjb030301vw.jsp (last accessed 2014)
  3. Korea Assistive Technology Center. "The Personal Assistant Service by Activity Assistant for People with Disabilities". Available From: http://www.knat.go.kr/ (last accessed 2017)
  4. Assistive Technology Service Center, Seoul Metropolitan Government "The Rental Service of Assistive Devices". Available From: http://www.seoulats.or.kr/Business/Rental (last accessed 2017)
  5. Cook AM, and Polgar JM. "Assistive technologies: Principles and practice". Elsevier Health Sciences : Philadelphia 2014.
  6. Cuturi LF, Aggius-Vella E, Campus C, Parmiggiani A, and Gori M. "From science to technology: Orientation and mobility in blind children and adults". Neurosci Biobehav Rev (71). pp240-251. Dec 2016. DOI: http://dx/doi.org/10.1016/j.neubiorev.2016.08.019
  7. Aladren A, Lopez-Nicolas G, Puig L, and Guerrero JJ. "Navigation assistance for the visually impaired using RGB-D sensor with range expansion". IEEE Systems Journal (10:3). pp922-932. 2106. DOI: http://dx.doi.org/10.1109/JSYST.2014.2320639
  8. Ghaderi VS, Mulas M, pereira VFS, Everding L, Weikersdorfer D, Conradt J, et al. "A wearable mobility device for the blind using retina-inspired dynamic vision sensors. Engineering in Medicine and Biology Society(EMBC)". 37th Annual International Conference of the IEEE. pp.3371-3374. 2015. DOI: http://dx.doi.org/10.1109/EMBC.2015.7319115
  9. Kanwal N, Bostanci E, Currie K, and Clark AF. "A navigation system for the visually impaired: a fusion of vision and depth sensor". Applied bionics and biomechanics 2015 . DOI: http://dx.doi.org/10.1155/2015/479857
  10. Mekhalfi ML, Melgani F, Zeggada A, De Natale FG, Salem MAM, Khamis A, et al. "Recovering the sight to blind people in indoor environments with smart technologies". Expert Systems with Applications (46). pp129-138.2016. DOI: http://dx.doi.org/10.1016/j.eswa.2015.09.054
  11. Yang K, Wang K, Hu W, and Bai J. "Expanding the Detection of Traversable Area with RealSense for the Visually Impaired". Sensors (16:11). p1954. 2016. https://doi.org/10.3390/s16111954
  12. Kammoun S, Parseihian G, Gutierrez O, Brilhault A, Serpa A, Raynal M, Oriola B, Mace MM, Auvray M, Denis M, et al. "Navigation and space perception assistance for the visually impaired: The NAVIG project". Irbm (33:2).pp182-189.2012. DOI: http://dx.doi.org/10.1016/j.irbm.2012.01.009
  13. Kassim A, Yasuno T, Suzuki H, Jaafar H, and Aras M. "Indoor Navigation System based on Passive RFID Transponder with Digital Compass for Bisually Impaired People". INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS (7:2). pp604-611.2016.
  14. Loomis JM, Colledge RG, and Klatzky R. "Navigation system for the blind: Auditory display modes and guidance". Presence:Teleoperators and Virtual Environments (7:2).pp193-203.1998. https://doi.org/10.1162/105474698565677
  15. Martinez-Sala AS, Losilla F, Sanchez-Aarnoutse JC, and Garcia-Haro J. "Design, Implementation and Evaluation of an Indoor Navigation System for Visually Impaired People". Sensors(Basel)(15:12). pp32168-32187. Dec212015. DOI: http://dx.doi.org/10.3390/s151229912
  16. Tsirmpas C, Rompas A, Fokou O, and Koutsouris D. "An indoor navigation system for visually impaired and elderly people based on Radio Frequency Identificaion(RFID)". Information Sciences(320).pp288-305. 2015.
  17. Chan KY, Engelke U, and Abhayasinghe N. "An edge detection framework conjoinig with IMU data for assisting indoor navigation of visually impaired persons". Expert Systems with Applications (67). pp272-284.2017.
  18. Neto LB, Grijalva F, Maike VRML, Martini LC, Florencio D, Baranuskas MCC, Rocha A, Goldenstein S, et al. "A Kinect-Based Wearable Face Recognition System to Aid Visually Impaired Users". IEEE Transactions on Human-Machine Systems 2016. DOI: http://dx.doi.org/10.1109/THMS.2016.2604367
  19. Pradeep V, Medioni G, and Weiland J. "A wearable system for the visually impaired". Conf Proc IEEE Eng Med Biol Soc .pp 6233-6236.2010. DOI: http://dx.doi.org/10.1109/IEMBS.2010.5627715
  20. Al-Khalifa S, Al-Razgan, M. "Ebsar: Indoor guidance for the visually impaired". Computers& ElectricalEngineering(54).pp 26-39.2016. DOI: http://dx.doi.org/10.1016/j.compeleceng.2016.07.015
  21. Bhatlawande S, Sunkari A, Mahadevappa M, Mukhopadhyay J, Biswas M, Das D, Gupta S, et al. "Electronic bracelet and vision-enabled waist-belt for mobility of visually impaired people". AssistTechnol(26:4) Winter.pp186-195.2014. DOI: http://dx.doi.org/10.1080/10400435.2014.915896
  22. Salminen AL, and Karhula ME. "Young persons with visual impairment: Challenges of participation". Scandinavianjournalofoccupationaltherapy (21:4).pp267-276.2014. DOI: http://dx.doi.org/10.3109/11038128.2014.899622
  23. Pivotal Software "Spring Web Services". Available From: http://spring.io/docs/reference (lastaccessed2017)
  24. Johnson R. "Expert one-on-one J2EE design and development". John Wiley & Sons: Hoboken 2014.
  25. Forouzan BA. "Data Communications and Networking". McGraw-Hill:NewYorkCity 2013.
  26. Oracle "Mysql database management system". Available From: http://dev.mysql.com/doc/ (last accessed 2015)
  27. Android "Android SDK and documentation". Available From: http://developer.android.com/studio/index.html (last accessed 2017)
  28. SK planet " T map Location Platform API" Available From: http://developers.skplanetx.com/apidoc/kor/tmap/(last accessed 2016)
  29. NHN "Naver map Location Platform API". Available From: http://developers.naver.com/products/map/(last accessed 2016)
  30. Google "Push fo mobile applications". Available From: http://firebase.google.com/ (last accessed 2017)
  31. Arduino "The open-source Arduino Software". Available From: http://www.arduino.cc (last accessed 2017)
  32. Roentgen UR, Geldervlom GJ, and de Witte LP. "The development of an indoor mobility course for the evaluation of electronic mobility aids for persons who are visually impaired". AssistiveTechnology (24:3). pp143-154.2012. DOI: http://dx.doi.org/10.1080/10400435.2012.659954
  33. Roentgen UR, Geldervlom GJ, and de Witte LP. "user evaluation of electronic mobility aids for persons who are visually impaired: a quasi-experimental study using a standardized mobility course". Assistive Technology (24:2).pp110-120.2012. DOI: http://dx.doi.org/10.1080/10400435.2012.659794
  34. Warrian KJ, Katz LJ, Myers JS, Moster MR, Pro MJ, Wizov SS, and Spaeth GL, et al. "A comparison of methods used to evaluate mobility performance in the visually impaired". British Journal of Ophthalmolog. ppbjophthalmol-2014-305324.2014 DOI: http://dx.doi.org/10.1136/bjophthalmol-2014-305324
  35. Patton MQ. Qualitative Research & Evaluation Methods: Integrating Theory and Practice. (SAGE Publications: Thousand Oaks 2014.
  36. Ma S, Lawpoolsri S, Soonthornworasiri N, Khamsiriwatchara A, Jandee K, Taweeseneepitch K, Pawarana R, Jaiklaew S, Kijsanayotin B, Kaewkungwal J, et al. "Effectiveness of Implementation of Electronic Malaria Information System as the National Malaria Surveillance System in Thailand". JMIR public health and surveillance (2:1)2016. DOI: http://dx.doi.org/10.2196/publichealth.5347
  37. Xiao L, Huang Q, Yank V, and Ma J. "An easily accessible web-based minimization random allocation system for clinical trials". Journal of medical Internet research (15:7).p e139.2013. DOI: http://dx.doi.org/10.2196/jmir.2392
  38. Yamada KC, Inoue S, and Sakamoto Y. "An effective support system of emergency medical services with tablet computers". JMIRmHealthanduHealth (3:1)2015. DOI: http://dx.doi.org/10.2196/mhealth.3293
  39. Maillot P, Dommes A, Dang NT, and Vienne F. "Training the elderly in pedestrian safety: transfer effect between two virtual reality simulation devices". Accident Analysis & Prevention (99).pp161-170.2017. DOI: http://dx.doi.org/10.1016/j.aap.2016.11.017
  40. Morrongiello BA, Corbett M, Milanovic M, Pyne S, and Vierich R. "Innovations in using virtual reality to study how children cross streets in traffic: evidence for evasive action skills". Injury prevention . ppinjuryprev- 2014-041357.2015. DOI: http://dx.doi.org/10.1136/injuryprev-2014-041357
  41. Schwebel DC, Severson J, He Y, and McClure LA. "Virtual reality by mobile smartphone: improving child pedestrian safety". Injury prevention .ppinjuryprev- 2016-042168.2016. DOI: http://dx.doi.org/10.1136/injuryprev-2016-042168
  42. Witten IH, Frank E, Hall MA, and Pal CJ. "DataMining:Practicalmachinelearningtoolsand techniques".MorganKaufmann:Burlington,MA2016.