• Journal of Korea Society of Industrial Information Systems
• /
• v.28 no.4
• /
• pp.1-9
• /
• 2023

In this paper, we propose a method to recognize the braille blocks for embedded devices in real time through deep learning. First, a deep learning model for braille block recognition is trained on a high-performance computer, and the learning model is applied to a lightweight tool to apply to an embedded device. To recognize the walking information of the braille block, an algorithm is used to determine the path using the distance from the braille block in the image. After detecting braille blocks, bollards, and crosswalks through the YOLOv8 model in the video captured by the embedded device, the walking information is recognized through the braille block path discrimination algorithm. We apply the model lightweight tool to YOLOv8 to detect braille blocks in real time. The precision of YOLOv8 model weights is lowered from the existing 32 bits to 8 bits, and the model is optimized by applying the TensorRT optimization engine. As the result of comparing the lightweight model through the proposed method with the existing model, the path recognition accuracy is 99.05%, which is almost the same as the existing model, but the recognition speed is reduced by 59% compared to the existing model, processing about 15 frames per second.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.20 no.6
• /
• pp.41-50
• /
• 2020

This paper deals with the Braille Education System which complements the shortcomings of the existing Braille Learning Products. An application dedicated to the blind is configured to perform full functions through touch gestures and voice guidance for user convenience. Braille kit is produced for educational purposes through Arduino and 3D printing. The system supports the following functions. First, the learning of the most basic braille, such as initial consonants, final consonant, vowels, abbreviations, etc. Second, the ability to check learned braille by solving step quizzes. Third, translation of braille. Through the experiment, the recognition rate of touch gestures and the accuracy of braille expression were confirmed, and in case of translation, the translation was done as intended. The system allows blind people to learn braille efficiently.

• Journal of the Ergonomics Society of Korea
• /
• v.30 no.6
• /
• pp.739-747
• /
• 2011

Objective: The present study evaluated information presentation methods applicable to a wearable Braille display in terms of performance and satisfaction measures. Background: A Braille display wearable at a finger can improve accessibility of information for the blind by presenting information in real time. Method: A Braille display with six pins operated by DC servomotors was developed to simulate four information presentation methods(active, stationary, simultaneous, and sequential methods). An evaluation experiment was conducted with 16 participants(8 normal and 8 blind participants) by using three objective measures(reaction time, RT, unit: sec; recognition time, CT, unit: sec; correct response percentage, CP) and two subjective measures(overall satisfaction, OS; perception easiness, PE) with a 7-point scale. Results: The average RTs and CTs of the active and stationary methods were significantly shorter than those of the simultaneous and sequential methods for the blind participants. Also, the average CPs, OSs, and PEs of the active and sequential methods were significantly higher than those of the stationary and simultaneous methods. Conclusion: The active and sequential methods were preferred to the other methods for the blind. Application: The performance characteristics identified in the present study for the four braille display methods can be utilized to develop an effective wearable Braille display system.

• Science of Emotion and Sensibility
• /
• v.10 no.4
• /
• pp.571-581
• /
• 2007

This Braille System for color recognition was designed for those who have lost eye sight after birth. This system was based on the idea that these people had the understanding of colours before they went blind. So when they touch the braille, they can feel and recognize colours. This system adopted the Munsell's hue circle system which is used worldwide for its simple way of colour identification. It also used some texture to help people in need identify the brightness and saturation of colors. In spite of its simple structure, this system has a range of up to 153 different colours. For a friendly use, minimal changes were made by modifying location and height of dots of the braille system which blind people are already accustomed to. Because of it's simplicity, this colour braille system can be used easily and broadly. I believe that many acquired blind people can feel colour again through using this system and get benefits of social and cultural communication.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2022.07a
• /
• pp.447-448
• /
• 2022

본 논문에서는 대중의 참여를 통해 캔 음료 제품의 점자 표기 실태를 파악하고, 음료 제조사가 이를 개선하도록 유도하는 방안을 제안한다. 캔 음료 상단에 표기된 점자를 촬영한 이미지에서 OpenCV를 통해 점자의 윤곽을 검출하고, 검출된 윤곽의 좌표를 계산하여 점자를 국문으로 번역하는 모듈을 개발한 후 서버에 이식한다. 서버와 통신하는 모바일 애플리케이션을 개발하여 소비자가 점자 이미지를 서버에 업로드하고, 점자의 인식결과를 확인할 수 있도록 한다. 점자 표기가 적절하지 않다고 판단하는 경우 해당 제품에 대한 정보를 기록하도록 하고, 제조사 별로 제보된 횟수의 순위를 제공한다. 이를 통해 소비자는 올바른 점자 표기를 제공하지 않는 제조사를 파악할 수 있으며, 제조사는 이를 의식하고 점자 표기를 개선할 수 있는 효과를 기대한다.

• Journal of Internet of Things and Convergence
• /
• v.9 no.3
• /
• pp.87-92
• /
• 2023

As times develop, information becomes more diverse and methods of obtaining it become more diverse. About 80% of the amount of information gained in life is acquired through the visual sense. However, visually impaired people have limited ability to interpret visual materials. That's why Braille, a text for the blind, appeared. However, the Braille decoding rate of the blind is only 5%, and as the demand of the blind who want various forms of platforms or materials increases over time, development and product production for the blind are taking place. An example of product production is braille books, which seem to have more disadvantages than advantages, and unlike non-disabled people, it is true that access to information is still very difficult. In this paper, we designed a CNN-based Braille conversion and voice output device to make it easier for visually impaired people to obtain information than conventional methods. The device aims to improve the quality of life by allowing books, text images, or handwritten images that are not made in Braille to be converted into Braille through camera recognition, and designing a function that can be converted into voice according to the needs of the blind.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.48 no.2
• /
• pp.1-8
• /
• 2011

In this paper, we propose a haptic display system that can convert Braille and tactual map(braille map) to tactile information recognizable through sense of touch almost in real-time. The proposed system consists of a haptic display hardware device, which actually delivers tactile signal to visually impaired people, and a device control software program, which converts Braille and tactile information to tactile signal and transfers it to the hardware device. Experimental evaluations of the proposed system were performed with 10 visually impaired persons. Experimental results show that the proposed system can provide similar Braille recognition rate and speed to those of existing Braille information devices. In addition, the proposed system converts tactile information to tactile signal under maximum 1.1 seconds, so that it can provide graphic information in almost real-time which is not possible with existing tactile devices, such as Braille printer.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.21 no.5
• /
• pp.53-60
• /
• 2021

The number of visually impaired and blind people is increasing, but braille translation textbooks for them are insufficient, which violates their rights to education despite their will. In order to guarantee their rights, this paper develops a learning system, HunMinJeomUm, that helps them access textbooks, documents, and photographs that are not available in braille, without the assistance of others. In our system, a smart phone app and web pages are designed to promote the accessibility of the blind, and a braille kit is produced using Arduino and braille modules. The system supports the following functions. First, users select documents or pictures that they want, and the system extracts the text using OCR. Second, the extracted text is converted into voice and braille. Third, a membership registration function is provided so that the user can view the extracted text. Experiments have confirmed that our system generates braille and audio outputs successfully, and provides high OCR recognition rates. The study has also found that even completely blind users can easily access the smart phone app.

• The Journal of the Korea Contents Association
• /
• v.13 no.4
• /
• pp.452-458
• /
• 2013

In this paper, we propose the method for automatically transfers images into tactile maps information based on cognition characteristics of visually impaired persons to more easily provide various image information for visually impaired persons. The proposed method automatically classify color images into row complexity and high complexity based on intensity information and transfer images into tactile map information using each different transformation process. Experimental evaluation, We performed with visually impaired five persons experiments for evaluating the recognition and satisfaction that tactile maps of the proposed automatic transforming method and the manually generated tactile maps of braille textbooks. Experimental results, the recognition and satisfaction that the tactile maps of the proposed method generated are very similar to those of the tactile maps of braille textbooks. Therefore, it could hugely be reduced the time and money of production education materials, and it could greatly improved educative results because it can add more easily that many image data of education materials.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.19 no.1
• /
• pp.119-127
• /
• 2023

Recently, deep learning has been used in the development of various institutional devices and services to help the visually impaired people in their daily lives. This is because not only are there few products and facility guides written in braille, but less than 10% of the visually impaired can use braille. In this paper, we propose a system that recognizes beverage cans in real time and outputs the beverage can name with sound for the convenience of the visually impaired. Five commercially available beverage cans were selected, and a CNN model and a YOLO model were designed to recognize the beverage cans. After augmenting the image data, model training was performed. The accuracy of the proposed CNN model and YOLO model is 91.2% and 90.8%, respectively. For practical verification, a system was built by attaching a camera and speaker to a Raspberry Pi. In the system, the YOLO model was applied. It was confirmed that beverage cans were recognized and output as sound in real time in various environments.