전자통신동향분석 (Electronics and Telecommunications Trends)

한국전자통신연구원 (Electronics and Telecommunications Research Institute)
권호 표지
DOI QR코드

DOI QR Code

감각치환 기술 동향

Technological Trends in Sensory Substitution

  • 발행 : 2019.08.01
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

Sensory substitution involves mapping the characteristics of one sensory modality to the stimuli of another sensory modality. In general, when a person is visually impaired or deaf, they do not actually lose their ability to see or hear completely; however, they only lose their ability to transmit sensory signals from the periphery to the brain. It has been experimentally proven that a person who has lost the ability to retrieve data from the retina can still visualize subjective images by using data transferred from other sensory modalities such as tactile or auditory modalities. This is because vision processing pathways are still intact in most cases. Therefore, sensory substitution uses human perception and the plasticity of the human brain to transmit sensory signals through pathways that have not been lost. In this study, we analyze the characteristics and problems of various devices used for sensory substitution and summarize the recent technological trends in these devices.

키워드

과제정보

연구 과제번호 : 인간의 감각.지각 능력을 증강하는 다중 감각 융합 기술 개발 사업

연구 과제 주관 기관 : 한국전자통신연구원(ETRI)

참고문헌

  1. 통계청, "2018 고령자 통계," 2018.
  2. 한국장애인재단, "WHO세계장애보고서," 2012.
  3. P. Bach-Y-Rita et al., "Vision substitution by tactile image projection," Nature, vol. 221, no. 1, 1969, pp. 963-964. https://doi.org/10.1038/221963a0
  4. C. Poirier et al., "Pattern recognition using a device substituting audition for vision in blindfolded sighted subjects," Neuropsychologia, vol. 45, no. 5, 2007, pp. 1108-1121. https://doi.org/10.1016/j.neuropsychologia.2006.09.018
  5. I. J. Hirsh, "Auditory perception and speech," in R. C. Atkinson et al. (ed)., Handbook of experimental psychology, John Wiley: New York, USA, 1988, pp. 377-408.
  6. C. Capelle et al., "A real-time experimental prototype for enhancement of vision rehabilitation using auditory substitution," IEEE Trans. Biomed. Eng., vol. 45, no. 10, 1998, pp. 1279-1293. https://doi.org/10.1109/10.720206
  7. P. B. L. Meijer, "An experimental system for auditory image representations," IEEE Trans. Biomed. Eng., vol. 39, no. 2, 1992, pp. 112-121. https://doi.org/10.1109/10.121642
  8. S. Abboud et al., "EyeMusic:Introudcing a "visual" colorful experience for the blind using auditory sensory substitution." Restor. Neurol. Neurosci., vol. 32, no. 2, 2014, pp. 247-257.
  9. L. Reich, A. Amedi, "Visual parsing can be taught quickly without visual experience during critical periods." Scientific Reports, vol. 5, 2015, pp. 15359:1-12.
  10. S. Caraiman et al., "Computer vision for the visually impaired: the sound of vision system." in Proc. IEEE Int. Conf. Comput. Vision., Venice, Italy, Oct. 2017, pp. 1480-1489.
  11. S. Hanneton, M. Auvray, B. Durette, "The Vibe: a versatile vision-to-audition sensory substitution device," Appl. Bionics Biomechanics, vol. 7, no. 4, 2010, pp. 269-276. https://doi.org/10.1155/2010/282341
  12. V. Fristot et al., "Depth-Melody substitution." In Proc. Eur. Signal Process. Conf. (EUSIPCO), Bucharest, Romania, Aug. 27-31, 2012, pp. 1990-1994.
  13. F. Ashwin et al., "Brainport Vision Technology" Int. Research J. Eng. Technol., vol. 3, no. 03, 2016, pp. 475-483.
  14. BrainPort Technologies, "Brainport Vision Pro," https://www.wicab.com/brainport-vision-pro
  15. S. D. Novich, D. M. Eagleman, "Using space and time to encode vibrotactile information: toward an estimate of the skin's achievable throughput." Experimental Brain Research, vol. 233, no. 10, 2015, pp. 2777-2788. https://doi.org/10.1007/s00221-015-4346-1
  16. S. Zhao et al., F. "Coding tactile symbols for phonemic communication." In Proc. CHI Conf. Human Factors Comput. Syst., Montreal, Canada, Apr. 2018, pp. 392:1-12.
  17. A. Rupert, "Tactile interface to improve situation awareness," Aerospace Medical Association, 1996.