• Title/Summary/Keyword: Learning System for the Blind

Search Result 42, Processing Time 0.028 seconds

A Study on Design and Implementation of Driver's Blind Spot Assist System Using CNN Technique (CNN 기법을 활용한 운전자 시선 사각지대 보조 시스템 설계 및 구현 연구)

  • Lim, Seung-Cheol;Go, Jae-Seung
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.20 no.2
    • /
    • pp.149-155
    • /
    • 2020
  • The Korea Highway Traffic Authority provides statistics that analyze the causes of traffic accidents that occurred since 2015 using the Traffic Accident Analysis System (TAAS). it was reported Through TAAS that the driver's forward carelessness was the main cause of traffic accidents in 2018. As statistics on the cause of traffic accidents, 51.2 percent used mobile phones and watched DMB while driving, 14 percent did not secure safe distance, and 3.6 percent violated their duty to protect pedestrians, representing a total of 68.8 percent. In this paper, we propose a system that has improved the advanced driver assistance system ADAS (Advanced Driver Assistance Systems) by utilizing CNN (Convolutional Neural Network) among the algorithms of Deep Learning. The proposed system learns a model that classifies the movement of the driver's face and eyes using Conv2D techniques which are mainly used for Image processing, while recognizing and detecting objects around the vehicle with cameras attached to the front of the vehicle to recognize the driving environment. Then, using the learned visual steering model and driving environment data, the hazard is classified and detected in three stages, depending on the driver's view and driving environment to assist the driver with the forward and blind spots.

A Study on the Development of Industrial Robot Workplace Safety System (산업용 로봇 작업장 안전시스템 개발에 대한 연구)

  • Jin-Bae Kim;Sun-Hyun Kwon;Man-Soo Lee
    • Journal of the Korea Safety Management & Science
    • /
    • v.25 no.3
    • /
    • pp.17-22
    • /
    • 2023
  • As the importance of artificial intelligence grows rapidly and emerges as a leader in technology, it is becoming an important variable in the next-generation industrial system along with the robot industry. In this study, a safety system was developed using deep learning technology to provide worker safety in a robot workplace environment. The implemented safety system has multiple cameras installed with various viewing directions to avoid blind spots caused by interference. Workers in various scenario situations were detected, and appropriate robot response scenarios were implemented according to the worker's risk level through IO communication. For human detection, the YOLO algorithm, which is widely used in object detection, was used, and a separate robot class was added and learned to compensate for the problem of misrecognizing the robot as a human. The performance of the implemented system was evaluated by operator detection performance by applying various operator scenarios, and it was confirmed that the safety system operated stably.

The Edge Computing System for the Detection of Water Usage Activities with Sound Classification (음향 기반 물 사용 활동 감지용 엣지 컴퓨팅 시스템)

  • Seung-Ho Hyun;Youngjoon Chee
    • Journal of Biomedical Engineering Research
    • /
    • v.44 no.2
    • /
    • pp.147-156
    • /
    • 2023
  • Efforts to employ smart home sensors to monitor the indoor activities of elderly single residents have been made to assess the feasibility of a safe and healthy lifestyle. However, the bathroom remains an area of blind spot. In this study, we have developed and evaluated a new edge computer device that can automatically detect water usage activities in the bathroom and record the activity log on a cloud server. Three kinds of sound as flushing, showering, and washing using wash basin generated during water usage were recorded and cut into 1-second scenes. These sound clips were then converted into a 2-dimensional image using MEL-spectrogram. Sound data augmentation techniques were adopted to obtain better learning effect from smaller number of data sets. These techniques, some of which are applied in time domain and others in frequency domain, increased the number of training data set by 30 times. A deep learning model, called CRNN, combining Convolutional Neural Network and Recurrent Neural Network was employed. The edge device was implemented using Raspberry Pi 4 and was equipped with a condenser microphone and amplifier to run the pre-trained model in real-time. The detected activities were recorded as text-based activity logs on a Firebase server. Performance was evaluated in two bathrooms for the three water usage activities, resulting in an accuracy of 96.1% and 88.2%, and F1 Score of 96.1% and 87.8%, respectively. Most of the classification errors were observed in the water sound from washing. In conclusion, this system demonstrates the potential for use in recording the activities as a lifelog of elderly single residents to a cloud server over the long-term.

Development of artificial intelligent system for visual assistance to the Visually Handicapped (시각장애인을 위한 시각 도움 서비스를 제공하는 인공지능 시스템 개발)

  • Oh, Changhyeon;Choi, Gwangyo;Lee, Hoyoung
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2021.11a
    • /
    • pp.1290-1293
    • /
    • 2021
  • Currently, blind people are experiencing a lot of inconvenience in their daily lives. In order to provide helpful service for the visually impaired, this study was carried out to make a new smart glasses that transmit information monitoring walking environment in real-time object recognition. In terms of object recognition, YOLOv4 was used as the artificial intelligence model. The objects, that should be identified during walking of the visually impaired, were selected, and the learning data was populated from them and re-learning of YOLOv4 was performed. As a result, the accuracy was average of 68% for all objects, but for essential objects (Person, Bus, Car, Traffic_light, Bicycle, Motorcycle) was measured to be 84%. In the future, it is necessary to secure the learning data in more various ways and conduct CNN learning with various parameters using darkflow rather than YOLOv4 to perform comparisons in the various ways.

Nuclear Power Plant Severe Accident Diagnosis Using Deep Learning Approach (딥러닝 활용 원전 중대사고 진단)

  • Sung-yeop, Kim;Yun Young, Choi;Soo-Yong, Park;Okyu, Kwon;Hyeong Ki, Shin
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.27 no.6
    • /
    • pp.95-103
    • /
    • 2022
  • Quick and accurate understanding of the situation in a severe accident is essential for conducting the appropriate accident management and response using the accident diagnosis information. This study employed deep learning technology to diagnose severe accidents through the major safety parameters transferred from a nuclear power plant (NPP) to AtomCARE. After selecting the major accident scenarios to consider, a learning database was established for particular scenarios affiliated with major scenarios by performing a large number of severe accident analyses using MAAP5 code. The severe accident diagnosis technology, which classifies detailed accident scenarios using the major safety parameters from NPPs, was developed by training it with the established database . Verification and validation were conducted by blind test and principal component analysis. The technology developed in this study is expected to be extended and applied to all severe accident scenarios and be utilized as a base technology for quick and accurate severe accident diagnosis.

Analysis and Implications of Private-led Library Services for the Disabled in Major Advanced Countries (주요 선진국 민간주도형 도서관 장애인서비스 분석과 시사점)

  • Yoon, Hee-Yoon
    • Journal of Korean Library and Information Science Society
    • /
    • v.53 no.2
    • /
    • pp.1-23
    • /
    • 2022
  • Access to knowledge and information is a universal human right. However, even after the Marrakesh Treaty was adopted on June 27, 2013, only 1-7% of standard printed materials are accessible to people with reading disabilities, including the visually impaired, and library services are very weak. As a result, the book famine of people with reading disabilities continues. This study, focusing on such severe access gaps and inequalities, analyzes Learning Ally and Bookshare in the US, the Royal National Institute of Blind People (RNIB) in the UK, Bibliothèque Numérique Francophone Accessible (BNFA) in France, and SAPIE in Japan, which are considered private organizations leading library services for the disabled in major developed countries. And based on the derived implications and the Marrakesh Treaty, a strategic plan was proposed to strengthen the services of the disabled in domestic libraries. It is urgent to enact the 'Act to Resolve Reading Barriers', amend the provisions related to the Copyright Act that restrict library services, strengthen the organizational capacity of the National Library for the Disabled, raise the service index for the disabled in library evaluation, and establish a library cooperation system centered on regional representative libraries and expand services, etc.

Performance Evaluation of DSE-MMA Blind Equalization Algorithm in QAM System (QAM 시스템에서 DSE-MMA 블라인드 등화 알고리즘의 성능 평가)

  • Kang, Dae-Soo
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.13 no.6
    • /
    • pp.115-121
    • /
    • 2013
  • This paper related with the DSE-MMA (Dithered Sign-Error MMA) that is the simplification of computational arithmetic number in blind equalization algorithm in order to compensates the intersymbol interference which occurs the passing the nonlinear communication channel in the presence of the band limit and phase distortion. The SE-MMA algorithm has a merit of H/W implementation for the possible to reduction of computational arithmetic number using the 1 bit quantizer in stead of multiplication in the updating the equalizer tap weight. But it degradates the overall blind equalization algorithm performance by the information loss at the quantization process compare to the MMA. The DSE-MMA which implements the dithered signed-error concepts by using the dither signal before qualtization are added to MMA, then the improved SNR performance which represents the roburstness of equalization algorithm are obtained. It has a concurrently compensation capability of the amplitude and phase distortion due to intersymbol interference like as the SE-MMA and MMA algorithm. The paper uses the equalizer output signal, residual isi, MD, MSE learning curve and SER curve for the performance index of blind equalization algorithm, and the computer simulation were performed in order to compare the SE-MMA and DSE-MMA applying the same performance index. As a result of simulation, the DSE-MMA can improving the roburstness and the value of every performance index after steady state than the SE-MMA, and confirmed that the DSE-MMA has slow convergence speed which meaning the reaching the seady state from initial state of adaptive equalization filter.

Wardrobe System for Blind Based On Image Processing and Deep Learning (영상처리 및 딥러닝 기반 시각장애인 옷장 시스템)

  • Lee, Yun Jik;Hwnag, Young Joon;Lee, Tae Ho;Kang, Han Byoul;Lee, Ki Young
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2019.10a
    • /
    • pp.962-964
    • /
    • 2019
  • 본 논문에서는 시각적 정보를 인지 할 수 없는 시각장애인들의 기본적인 의생활을 도와 줄 수 있게 의류의 시각적 정보를 영상처리 및 딥러닝을 활용하여 청각적 정보로 변환하고 음성으로 사용자에게 알려 줄 수 있는 스마트 옷장 시스템을 개발하였다.

Currency Recognition System for Blind People (시각장애인을 위한 화폐 인식 시스템)

  • Dong-Jun Yoo;Sung-Jun Kim;Jun-Yeong Lee;Hyeon-Su Kang;Jun-Ho Son;Se-Jin Oh
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2024.01a
    • /
    • pp.257-258
    • /
    • 2024
  • 현재 시각장애인들이 현금을 사용하게 될 시 지폐가 얼마인지 확인할 방법이 없어 불편을 겪거나 금전적 사기를 당할 위험이 잦다. 한국은행에서는 이러한 사고를 막기 위해 점자 지폐를 만들어 발부하고 있지만 시각장애인 91%가 식별하지 못해 많은 불편을 겪고 있다. 본 논문에서는 딥러닝을 활용하여 화폐를 인식하고 TTS 기술을 사용하여 지폐의 값이 얼마인지 소리로 알려주는 시스템을 개발하였다. 지폐 인식을 위해 데이터를 직접 수집하여 YOLOv5 알고리즘을 활용하여 학습시킨 Weights 파일을 사용하였다. 이를 활용하여 시각장애인들은 더 안전하게 현금을 사용하고, 금전적인 문제를 예방할 수 있다.

  • PDF

Post-Processing for JPEG-Coded Image Deblocking via Sparse Representation and Adaptive Residual Threshold

  • Wang, Liping;Zhou, Xiao;Wang, Chengyou;Jiang, Baochen
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.11 no.3
    • /
    • pp.1700-1721
    • /
    • 2017
  • The problem of blocking artifacts is very common in block-based image and video compression, especially at very low bit rates. In this paper, we propose a post-processing method for JPEG-coded image deblocking via sparse representation and adaptive residual threshold. This method includes three steps. First, we obtain the dictionary by online dictionary learning and the compressed images. The dictionary is then modified by the histogram of oriented gradient (HOG) feature descriptor and K-means cluster. Second, an adaptive residual threshold for orthogonal matching pursuit (OMP) is proposed and used for sparse coding by combining blind image blocking assessment. At last, to take advantage of human visual system (HVS), the edge regions of the obtained deblocked image can be further modified by the edge regions of the compressed image. The experimental results show that our proposed method can keep the image more texture and edge information while reducing the image blocking artifacts.