• The Journal of the Korea institute of electronic communication sciences
• /
• v.16 no.6
• /
• pp.1329-1338
• /
• 2021

There are rarely effective methods to help visually impaired people when they want to know the expiration date of products excepted to only Braille. In this study, we developed an expiration date notification system based on YOLO and OCR for visually impaired people. The handicapped people can automatically know the expiration date of a specific product by using our system without the help of a caregiver, fast and accurately. The proposed system is worked by four different steps: (1) identification of a target product by scanning its barcode; (2) segmentation of an image area with the expiration date using YOLO; (3) classification of the expiration date by OCR: (4) notification of the expiration date by TTS. Our system showed an average classification accuracy of about 86.00% when blindfolded subjects used the proposed system in real-time. This result validates that the proposed system can be potentially used for visually impaired people.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2021.07a
• /
• pp.697-698
• /
• 2021

본 논문에서는 시각 장애우의 식품 안전성 증진을 위해 광학 문자 인식 (optical character recognition, OCR) 및 실시간 객체 인식 (you only look once, YOLO) 알고리즘에 기반한 식품의 유통기한 자동 알림 시스템을 제안한다. 제안하는 시스템은 1) 스마트폰 카메라를 통해 실시간으로 입력되는 영상에서 YOLO 알고리즘을 활용하여 유통기한으로 예측되는 이미지 영역을 검출하고, 2) 검출된 영역에서 OCR 알고리즘을 활용하여 유통기한 데이터를 추출하며, 3) 최종 추출된 유통기한 데이터를 음성으로 변환하여 시각 장애우에게 전달한다. 개발된 시스템은 유통기한 정보를 추출해서 사용자에게 전달하기까지 평균 약 7초 이내의 빠른 응답 속도를 보였으며, 62.8%의 객체 인식 정확도와 93.6%의 문자 인식 정확도를 보였다. 이러한 결과들은 제안하는 시스템을 시각 장애우들이 실용적으로 활용할 수 있다는 가능성을 보여준다.

• Annual Conference on Human and Language Technology
• /
• 2009.10a
• /
• pp.266-270
• /
• 2009

IT 관련 산업의 발전에 의한 저변의 확대로 장애우들의 IT 사용 수요가 늘고 있다. 본 논문에서는 IT분야에서 가장 기초적으로 활용되는 E-Mail을 시각 장애우가 활용 하는 데에 불편함이 없도록 하는 이메일 매니저 개발에 관련된 기법에 대해 논하고자 한다. TTS(Text-To Speech : 문자 텍스트를 음성으로 전환하여 들려줌)와 음성키보드(키보드 입력 시 입력한 문자를 음성으로 알려줌) 기능으로 시각 장애우가 이메일을 사용함에 있어 불편함을 느끼지 않도록 하였으며 본 시스템의 TTS 알고리즘은 국어 표준발음법을 참고로 하여 자바로 구현 하였다.

• Journal of Korea Game Society
• /
• v.19 no.5
• /
• pp.143-150
• /
• 2019

Deaf subtitles provide the hearing impaired with visual elements, commentary, and enjoyment of TV programs. Subtitles in game play are a great help to the game play for the hearing impaired as well as the average user. This paper aims at the academic research on the BIT subtitle system BIT, and is intended to help game play and game broadcasting of the hearing impaired.

• Science of Emotion and Sensibility
• /
• v.14 no.4
• /
• pp.537-544
• /
• 2011

Tactile acuity was assessed in groups of control, blind, deaf, and blind caused by complication to investigate the effective tactile stimuli on tactile sensory substitution studies when tactile display is applied to persons with sensory loss of vision or hearing. Two-point discrimination and grating resolution were assessed by compass and JVP dome, respectively, in the hand, arm, neck, lumbar, and knee. In two-point discrimination by compass, control group showed the highest sensitivity in fingers among assessed body areas but did not show any significant difference between male and female. Blind group and deaf group compared to control group did not show any significant difference in fingers but showed lower sensitivity in arm and knee. In grating resolution by JVP dome, control group did not show any significant difference among five fingers as well as between male and female. Blind group showed higher sensitivity in five fingers compared to control group, but deaf group did not show any significant difference from control group. Blind caused by complication group showed lower sensitivity in two-point discrimination and grating resolution compared to control group and blind group. These results suggest that the body area and method of tactile stimulation, and difference in tactile acuity depending on underlying disease of sensory loss should be considered when tactile display is applied for sensory substitution.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2018.05a
• /
• pp.143-144
• /
• 2018

Generally, to operate the IT devices, a user should exploit his eye and hand. It is so difficult for the most disabled user with the limited vision or hand to manipulate a personal computer and to buy devices assisting the manipulation due to the expensive price. In this paper, we propose the voice system manipulating the personal computer using the Amazon echo. The proposed system controls the mouse of the personal computer and activates functions of the personal computer using the skill stored in the Amazon web service.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2019.07a
• /
• pp.135-136
• /
• 2019

일반적으로 컴퓨터에서 문서 작업을 하기 위해서는 사용자는 컴퓨터 화면을 볼 수 있는 시각과 키보드와 마우스를 조작하기 위하여 손을 사용해야 한다. 시각과 손이 불편한 대부분 장애우는 컴퓨터를 조작하기 어렵다. 장애우들을 보조해주는 정보통신 보조기기의 가격은 비싸며 기기 보급을 지원해주는 사업이 있지만, 사업에 선정되기 어렵다는 문제가 있다. 이 논문에서는 구글 홈을 이용하여 텍스트, 워드, 엑셀, 한글 등 다양한 응용프로그램을 음성을 이용하여 제어하기 위한 시스템을 제안한다. 제안한 시스템은 구글 어시스턴트가 다이어로그플로우로 설계한 인텐트를 웹 훅을 이용해 서버에서 컴퓨터로 접근하여 응용프로그램을 제어한다.

• 프린팅코리아
• /
• v.7 no.8
• /
• pp.114-118
• /
• 2008

옛말에 '우리 몸이 백냥이면 우리 눈은 구십 냥이다'란 말이 있다. 그만큼 시력이 삶에 차지하는 중요성을 피력한 것이다. 눈을 통해 정보를 받아들이는 정도는 거의 90%다. 시각장애우들은 책에 박혀있는 한 점 한 점을 통해 세상을 받아들인다. 잃어버린 90%를 찾기 위해 9배 이상의 노력을 기울일 수밖에 없다.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2015.10a
• /
• pp.522-525
• /
• 2015

In this paper, we propose a walking aid system that guides route to visually impaired people in order to recognize uncertain obstacles based on tactile stimulation. The proposed system is composed of the touch-based obstacle detection module, the obstacle height detection module, and the route guidance algorithms. The touch-based obstacle detection module detects each obstacle, which is located at left, right, and front of a visually impaired person by stimulating his thumb with the rotational force of the servomotor. The obstacle height detection module integrates detected data by the linear arrangement of ultrasonic sensors to identify the height of an obstacle about 3 of-phase(i.e., high, medium, low). The proposed route guidance algorithm guides an optimized path to the visually impaired person by updating his current position information based on the signal of the built-in GPS receiver in smartphone. In addition, the route guidance algorithm delivers information with speech to a visually impaired person through Bluetooth commuination in the developed route guidance app. The proposed system can create a path to avoid the obstacles by recognizing the placed situation of the obstacles with exploring the uncertain path.

• Proceedings of the Korean Institute of Communication Sciences Conference
• /
• 2004.07a
• /
• pp.46-46
• /
• 2004