• Title/Summary/Keyword: Learning System for the Blind

Search Result 42, Processing Time 0.025 seconds

Detection of Marine Oil Spills from PlanetScope Images Using DeepLabV3+ Model (DeepLabV3+ 모델을 이용한 PlanetScope 영상의 해상 유출유 탐지)

  • Kang, Jonggu;Youn, Youjeong;Kim, Geunah;Park, Ganghyun;Choi, Soyeon;Yang, Chan-Su;Yi, Jonghyuk;Lee, Yangwon
    • Korean Journal of Remote Sensing
    • /
    • v.38 no.6_2
    • /
    • pp.1623-1631
    • /
    • 2022
  • Since oil spills can be a significant threat to the marine ecosystem, it is necessary to obtain information on the current contamination status quickly to minimize the damage. Satellite-based detection of marine oil spills has the advantage of spatiotemporal coverage because it can monitor a wide area compared to aircraft. Due to the recent development of computer vision and deep learning, marine oil spill detection can also be facilitated by deep learning. Unlike the existing studies based on Synthetic Aperture Radar (SAR) images, we conducted a deep learning modeling using PlanetScope optical satellite images. The blind test of the DeepLabV3+ model for oil spill detection showed the performance statistics with an accuracy of 0.885, a precision of 0.888, a recall of 0.886, an F1-score of 0.883, and a Mean Intersection over Union (mIOU) of 0.793.

A Research on V2I-based Accident Prevention System for the Prevention of Unexpected Accident of Autonomous Vehicle (자율주행 차량의 돌발사고 방지를 위한 V2I 기반의 사고 방지체계 연구)

  • Han, SangYong;Kim, Myeong-jun;Kang, Dongwan;Baek, Sunwoo;Shin, Hee-seok;Kim, Jungha
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.20 no.3
    • /
    • pp.86-99
    • /
    • 2021
  • This research proposes the Accident Prevention System to prevent collision accident that can occur due to blind spots such as crossway or school zone using V2I communication. Vision sensor and LiDAR sensor located in the infrastructure of crossway somewhere like that recognize objects and warn vehicles at risk of accidents to prevent accidents in advance. Using deep learning-based YOLOv4 to recognize the object entering the intersection and using the Manhattan Distance value with LiDAR sensors to calculate the expected collision time and the weight of braking distance and secure safe distance. V2I communication used ROS (Robot Operating System) communication to prevent accidents in advance by conveying various information to the vehicle, including class, distance, and speed of entry objects, in addition to collision warning.

Design of Port Security System Using Deep Learning and Object Features (딥러닝과 객체 특징점을 활용한 항만 보안시스템 설계)

  • Wang, Tae-su;Kim, Minyoung;Jang, Jongwook
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2022.05a
    • /
    • pp.50-53
    • /
    • 2022
  • Recently, there have been cases in which counterfeit foreign ships have entered and left domestic ports several times. Vessels have a ship-specific serial number given by the International Maritime Organization (IMO) to identify the vessel, and IMO marking is mandatory on all ships built since 2004. In the case of airports and ports, which are representative logistics platforms, a security system is essential, but it is difficult to establish a security system at a port and there are many blind spots, which can cause security problems due to insufficient security systems. In this paper, a port security system is designed using deep learning object recognition and OpenCV. The security system process extracts the IMO number of the ship after recognizing the object when entering the ship, determines whether it is the same ship through feature point matching for ships with entry records, and stores the ship image and IMO number in the entry/exit DB for the first arrival vessel. Through the system of this paper, port security can be strengthened by improving the efficiency and system of port logistics by increasing the efficiency of port management personnel and reducing incidental costs caused by unauthorized entry.

  • PDF

Automatic Anatomical Classification Model of Esophagogastroduodenoscopy Images Using Deep Convolutional Neural Networks for Guiding Endoscopic Photodocumentation

  • Park, Jung-Whan;Kim, Yoon;Kim, Woo-Jin;Nam, Seung-Joo
    • Journal of the Korea Society of Computer and Information
    • /
    • v.26 no.3
    • /
    • pp.19-28
    • /
    • 2021
  • Esophagogastroduodenoscopy is a method commonly used for early diagnosis of upper gastrointestinal lesions. However, 10-20 percent of the gastric lesions are reported to be missed, due to human error. And countries including the US, the UK, and Japan, the World Endoscopy Organization (WEO) suggested guidelines about essential gastrointestinal parts to take pictures of so that all gastric lesions are observed. In this paper, we propose deep learning techniques for classification of anatomical sites, aiming for the system that informs practitioners whether they successfully did the gastroscopy without blind spots. The proposed model uses pre-processing modules and data augmentation techniques suitable for gastroscopy images. Not only does the experiment result with a maximum F1 score of 99.6%, but it also shows a error rate of less than 4% based on the actual data. Given the performance results, we found the model to be explainable with the potential to be utilized in the clinical area.

U-Net Cloud Detection for the SPARCS Cloud Dataset from Landsat 8 Images (Landsat 8 기반 SPARCS 데이터셋을 이용한 U-Net 구름탐지)

  • Kang, Jonggu;Kim, Geunah;Jeong, Yemin;Kim, Seoyeon;Youn, Youjeong;Cho, Soobin;Lee, Yangwon
    • Korean Journal of Remote Sensing
    • /
    • v.37 no.5_1
    • /
    • pp.1149-1161
    • /
    • 2021
  • With a trend of the utilization of computer vision for satellite images, cloud detection using deep learning also attracts attention recently. In this study, we conducted a U-Net cloud detection modeling using SPARCS (Spatial Procedures for Automated Removal of Cloud and Shadow) Cloud Dataset with the image data augmentation and carried out 10-fold cross-validation for an objective assessment of the model. Asthe result of the blind test for 1800 datasets with 512 by 512 pixels, relatively high performance with the accuracy of 0.821, the precision of 0.847, the recall of 0.821, the F1-score of 0.831, and the IoU (Intersection over Union) of 0.723. Although 14.5% of actual cloud shadows were misclassified as land, and 19.7% of actual clouds were misidentified as land, this can be overcome by increasing the quality and quantity of label datasets. Moreover, a state-of-the-art DeepLab V3+ model and the NAS (Neural Architecture Search) optimization technique can help the cloud detection for CAS500 (Compact Advanced Satellite 500) in South Korea.

Development a Meal Support System for the Visually Impaired Using YOLO Algorithm (YOLO알고리즘을 활용한 시각장애인용 식사보조 시스템 개발)

  • Lee, Gun-Ho;Moon, Mi-Kyeong
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.16 no.5
    • /
    • pp.1001-1010
    • /
    • 2021
  • Normal people are not deeply aware of their dependence on sight when eating. However, since the visually impaired do not know what kind of food is on the table, the assistant next to them holds the blind spoon and explains the position of the food in a clockwise direction, front and rear, left and right, etc. In this paper, we describe the development of a meal assistance system that recognizes each food image and announces the name of the food by voice when a visually impaired person looks at their table using a smartphone camera. This system extracts the food on which the spoon is placed through the YOLO model that has learned the image of food and tableware (spoon), recognizes what the food is, and notifies it by voice. Through this system, it is expected that the visually impaired will be able to eat without the help of a meal assistant, thereby increasing their self-reliance and satisfaction.

Detection of Zebra-crossing Areas Based on Deep Learning with Combination of SegNet and ResNet (SegNet과 ResNet을 조합한 딥러닝에 기반한 횡단보도 영역 검출)

  • Liang, Han;Seo, Suyoung
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.39 no.3
    • /
    • pp.141-148
    • /
    • 2021
  • This paper presents a method to detect zebra-crossing using deep learning which combines SegNet and ResNet. For the blind, a safe crossing system is important to know exactly where the zebra-crossings are. Zebra-crossing detection by deep learning can be a good solution to this problem and robotic vision-based assistive technologies sprung up over the past few years, which focused on specific scene objects using monocular detectors. These traditional methods have achieved significant results with relatively long processing times, and enhanced the zebra-crossing perception to a large extent. However, running all detectors jointly incurs a long latency and becomes computationally prohibitive on wearable embedded systems. In this paper, we propose a model for fast and stable segmentation of zebra-crossing from captured images. The model is improved based on a combination of SegNet and ResNet and consists of three steps. First, the input image is subsampled to extract image features and the convolutional neural network of ResNet is modified to make it the new encoder. Second, through the SegNet original up-sampling network, the abstract features are restored to the original image size. Finally, the method classifies all pixels and calculates the accuracy of each pixel. The experimental results prove the efficiency of the modified semantic segmentation algorithm with a relatively high computing speed.

An Artificial Intelligence Method for the Prediction of Near- and Off-Shore Fish Catch Using Satellite and Numerical Model Data

  • Yoon, You-Jeong;Cho, Subin;Kim, Seoyeon;Kim, Nari;Lee, Soo-Jin;Ahn, Jihye;Lee, Eunjeong;Joh, Seongeok;Lee, Yang-Won
    • Korean Journal of Remote Sensing
    • /
    • v.36 no.1
    • /
    • pp.41-53
    • /
    • 2020
  • The production of near- and off-shore fisheries in South Korea is decreasing due to rapid changes in the fishing environment, particularly including higher sea temperature in recent years. To improve the competitiveness of the fisheries, it is necessary to provide fish catch information that changes spatiotemporally according to the sea state. In this study, artificial intelligence models that predict the CPUE (catch per unit effort) of mackerel, anchovies, and squid (Todarodes pacificus), which are three major fish species in the near- and off-shore areas of South Korea, on a 15-km grid and daily basis were developed. The models were trained and validated using the sea surface temperature, rainfall, relative humidity, pressure,sea surface wind velocity, significant wave height, and salinity as input data, and the fish catch statistics of Suhyup (National Federation of Fisheries Cooperatives) as observed data. The 10-fold blind test results showed that the developed artificial intelligence models exhibited accuracy with a corresponding correlation coefficient of 0.86. It is expected that the fish catch models can be actually operated with high accuracy under various sea conditions if high-quality large-volume data are available.

Study on the Characteristics and Quality Level of Single Subject Researches in the Sensory Integration Therapy Field of Korean Occupational Therapy (감각통합치료효과에 대한 단일대상연구의 특성과 질적 수준에 대한 고찰)

  • Kwag, Sung-Won;Sim, Je-Muang;Roh, Hyo-Lyun
    • The Journal of Korean Academy of Sensory Integration
    • /
    • v.12 no.2
    • /
    • pp.25-36
    • /
    • 2014
  • Objective : The purpose of this study is learning the characteristics of literature applying single subject researches in the field of sensory integration therapy of Korean occupational therapy and evaluating the quality level of them. Methods : Analyzed the characteristics of 17 single subject research papers (independent variable, study design, study subject, total number of session, study period, intervention time, intervention place, dependent variable, measuring tool and result) published between 2002 and 2013 using the document delivery service of Korean Society of Occupational Therapy, National Discovery for Science Leaders (NDSL), Nuri Media (DBpia), Research Information Sharing Service (RISS), Korean Studies Information Service System (KISS) and National Assembly Library and evaluated the literatures using quality evaluation scale. Results : According to the analysis result on the literature characteristics, reversal design was the most used study method. Total number of session was 10 sessions to 34 sessions. Study period was 4 weeks to 16 weeks. Intervention time was 8 minutes to 70 minutes and most interventions were done in occupational therapy room or sensory integration therapy room. According to the result of quality level evaluation, 4 papers out of 17 papers were on high level and remaining papers were on intermediate level. However, there was no study which included intervention blind. Conclusion : Suggested standards that need to be supplemented and discussions on qualitative improvement including repetitive research on the mediation effect during the application of the single subject research methodology, the securement of adequate data sections, and processing of a mediation blind. It is expected to be used as basic data for conducting a better qualitative research in the future.

Development of a Acoustic Acquisition Prototype device and System Modules for Fire Detection in the Underground Utility Tunnel (지하 공동구 화재재난 감지를 위한 음향수집 프로토타입 장치 및 시스템 모듈 개발)

  • Lee, Byung-Jin;Park, Chul-Woo;Lee, Mi-Suk;Jung, Woo-Sug
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.22 no.5
    • /
    • pp.7-15
    • /
    • 2022
  • Since the direct and indirect damage caused by the fire in the underground utility tunnel will cause great damage to society as a whole, it is necessary to make efforts to prevent and control it in advance. The most of the fires that occur in cables are caused by short circuits, earth leakage, ignition due to over-current, overheating of conductor connections, and ignition due to sparks caused by breakdown of insulators. In order to find the cause of fire at an early stage due to the characteristics of the underground utility tunnel and to prevent disasters and safety accidents, we are constantly managing it with a detection system using image analysis and making efforts. Among them, a case of developing a fire detection system using CCTV-based deep learning image analysis technology has been reported. However, CCTV needs to be supplemented because there are blind spots. Therefore, we would like to develop a high-performance acoustic-based deep learning model that can prevent fire by detecting the spark sound before spark occurs. In this study, we propose a method that can collect sound in underground utility tunnel environments using microphone sensor through development and experiment of prototype module. After arranging an acoustic sensor in the underground utility tunnel with a lot of condensation, it verifies whether data can be collected in real time without malfunction.