• Title/Summary/Keyword: Sensor Fusion System

Search Result 435, Processing Time 0.026 seconds

The Comparison of the SIFT Image Descriptor by Contrast Enhancement Algorithms with Various Types of High-resolution Satellite Imagery

  • Choi, Jaw-Wan;Kim, Dae-Sung;Kim, Yong-Min;Han, Dong-Yeob;Kim, Yong-Il
    • Korean Journal of Remote Sensing
    • /
    • v.26 no.3
    • /
    • pp.325-333
    • /
    • 2010
  • Image registration involves overlapping images of an identical region and assigning the data into one coordinate system. Image registration has proved important in remote sensing, enabling registered satellite imagery to be used in various applications such as image fusion, change detection and the generation of digital maps. The image descriptor, which extracts matching points from each image, is necessary for automatic registration of remotely sensed data. Using contrast enhancement algorithms such as histogram equalization and image stretching, the normalized data are applied to the image descriptor. Drawing on the different spectral characteristics of high resolution satellite imagery based on sensor type and acquisition date, the applied normalization method can be used to change the results of matching interest point descriptors. In this paper, the matching points by scale invariant feature transformation (SIFT) are extracted using various contrast enhancement algorithms and injection of Gaussian noise. The results of the extracted matching points are compared with the number of correct matching points and matching rates for each point.

Forest Fire Damage Assessment Using UAV Images: A Case Study on Goseong-Sokcho Forest Fire in 2019

  • Yeom, Junho;Han, Youkyung;Kim, Taeheon;Kim, Yongmin
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.37 no.5
    • /
    • pp.351-357
    • /
    • 2019
  • UAV (Unmanned Aerial Vehicle) images can be exploited for rapid forest fire damage assessment by virtue of UAV systems' advantages. In 2019, catastrophic forest fire occurred in Goseong and Sokcho, Korea and burned 1,757 hectares of forests. We visited the town in Goseong where suffered the most severe damage and conducted UAV flights for forest fire damage assessment. In this study, economic and rapid damage assessment method for forest fire has been proposed using UAV systems equipped with only a RGB sensor. First, forest masking was performed using automatic elevation thresholding to extract forest area. Then ExG (Excess Green) vegetation index which can be calculated without near-infrared band was adopted to extract damaged forests. In addition, entropy filtering was applied to ExG for better differentiation between damaged and non-damaged forest. We could confirm that the proposed forest masking can screen out non-forest land covers such as bare soil, agriculture lands, and artificial objects. In addition, entropy filtering enhanced the ExG homogeneity difference between damaged and non-damaged forests. The automatically detected damaged forests of the proposed method showed high accuracy of 87%.

Attention based Feature-Fusion Network for 3D Object Detection (3차원 객체 탐지를 위한 어텐션 기반 특징 융합 네트워크)

  • Sang-Hyun Ryoo;Dae-Yeol Kang;Seung-Jun Hwang;Sung-Jun Park;Joong-Hwan Baek
    • Journal of Advanced Navigation Technology
    • /
    • v.27 no.2
    • /
    • pp.190-196
    • /
    • 2023
  • Recently, following the development of LIDAR technology which can detect distance from the object, the interest for LIDAR based 3D object detection network is getting higher. Previous networks generate inaccurate localization results due to spatial information loss during voxelization and downsampling. In this study, we propose an attention-based convergence method and a camera-LIDAR convergence system to acquire high-level features and high positional accuracy. First, by introducing the attention method into the Voxel-RCNN structure, which is a grid-based 3D object detection network, the multi-scale sparse 3D convolution feature is effectively fused to improve the performance of 3D object detection. Additionally, we propose the late-fusion mechanism for fusing outcomes in 3D object detection network and 2D object detection network to delete false positive. Comparative experiments with existing algorithms are performed using the KITTI data set, which is widely used in the field of autonomous driving. The proposed method showed performance improvement in both 2D object detection on BEV and 3D object detection. In particular, the precision was improved by about 0.54% for the car moderate class compared to Voxel-RCNN.

Pattern Recognition Improvement of an Ultrasonic Sensor System Using Neuro-Fuzzy Signal Processing (초음파센서 시스템의 패턴인식 개선을 위한 뉴로퍼지 신호처리)

  • Na, Seung-You;Park, Min-Sang
    • Journal of the Korean Institute of Telematics and Electronics S
    • /
    • v.35S no.12
    • /
    • pp.17-26
    • /
    • 1998
  • Ultrasonic sensors are widely used in various applications due to advantages of low cost, simplicity in construction, mechanical robustness, and little environmental restriction in usage. But for the application of object recognition, ultrasonic sensors exhibit several shortcomings of poor directionality which results in low spatial resolution of objects, and specularity which gives frequent erroneous range readings. The time-of-flight(TOF) method generally used for distance measurement can not distinguish small object patterns of plane, corner or edge. To resolve the problem, an increased number of the sensors in the forms of a linear array or 2-dimensional array of the sensors has been used. Also better resolution has been obtained by shifting the array in several steps using mechanical actuators. Also simple patterns are classified based on analyzing signal reflections. In this paper we propose a method of a sensor array system with improved capability in pattern distinction using electronic circuits accompanying the sensor array, and intelligent algorithm based on neuro-fuzzy processing of data fusion. The circuit changes transmitter output voltages of array elements in several steps. A set of different return signals from neighborhood sensors is manipulated to provide enhanced pattern recognition in the aspects of inclination angle, size and shift as well as distance of objects. The results show improved resolution of the measurements for smaller targets.

  • PDF

A Study on the Fog Detecting System Using Photo Sensor (광센서를 이용한 안개 탐지 시스템 연구)

  • No, Byeang-Su;Kim, Kab-Ki
    • Journal of the Korean Society of Marine Environment & Safety
    • /
    • v.19 no.6
    • /
    • pp.643-648
    • /
    • 2013
  • In this paper, we developed a system which can detect and can alarm about the sailing provocative climate by using a photo. The research on domestic shipbuilding industry and in IT fusion technology is under construction, but a reliable safety device which can alarm a sailor about the circumstances of the fog and rain during ship operation as soon as possible due to the constant state in domestic. In this paper, a compact, for system low-power transceiver and data processing equipment for sensing were developed, also a performance evaluation got accomplished with simulation analysis. In results, it is operating normally at least 32.36[dB] and maximum values f 89.20[dB] in the domestic, and 32.55 to 60.66[dB] in the outdoors.

Development of Smart Wheelchair System and Navigation Technology For Stable Driving Performance In Indoor-Outdoor Environments (실내외 환경에서 안정적인 자율 주행을 위한 스마트 휠체어 시스템 및 주행 기술 개발)

  • Lee, Lae-Kyoung;Oh, Se-Young
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.52 no.7
    • /
    • pp.153-161
    • /
    • 2015
  • In the present study, as part of the technology development (Quality of Life Technology, QoLT) to improve the socio-economic status of people with disabilities as an extension of these studies, we propose the development of the smart wheelchair system and navigation technology for stable and safe driving in various environments. For the disabled and the elderly make driving easy and convenient with manual/autonomous driving condition, we firstly develop the user-oriented smart wheelchair system with optimized sensors for environment recognition, and then we propose a navigation framework of a hierarchical structure to ensure real-time response, as well as driving stability when traveling to various environmental changes, and to enable a more efficient operation. From the result of several independent experiments, we ensure efficiency and safety of smart wheelchair and its navigation system.

IoT Open-Source and AI based Automatic Door Lock Access Control Solution

  • Yoon, Sung Hoon;Lee, Kil Soo;Cha, Jae Sang;Mariappan, Vinayagam;Young, Ko Eun;Woo, Deok Gun;Kim, Jeong Uk
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.12 no.2
    • /
    • pp.8-14
    • /
    • 2020
  • Recently, there was an increasing demand for an integrated access control system which is capable of user recognition, door control, and facility operations control for smart buildings automation. The market available door lock access control solutions need to be improved from the current level security of door locks operations where security is compromised when a password or digital keys are exposed to the strangers. At present, the access control system solution providers focusing on developing an automatic access control system using (RF) based technologies like bluetooth, WiFi, etc. All the existing automatic door access control technologies required an additional hardware interface and always vulnerable security threads. This paper proposes the user identification and authentication solution for automatic door lock control operations using camera based visible light communication (VLC) technology. This proposed approach use the cameras installed in building facility, user smart devices and IoT open source controller based LED light sensors installed in buildings infrastructure. The building facility installed IoT LED light sensors transmit the authorized user and facility information color grid code and the smart device camera decode the user informations and verify with stored user information then indicate the authentication status to the user and send authentication acknowledgement to facility door lock integrated camera to control the door lock operations. The camera based VLC receiver uses the artificial intelligence (AI) methods to decode VLC data to improve the VLC performance. This paper implements the testbed model using IoT open-source based LED light sensor with CCTV camera and user smartphone devices. The experiment results are verified with custom made convolutional neural network (CNN) based AI techniques for VLC deciding method on smart devices and PC based CCTV monitoring solutions. The archived experiment results confirm that proposed door access control solution is effective and robust for automatic door access control.

Determination of 3D Object Coordinates from Overlapping Omni-directional Images Acquired by a Mobile Mapping System (모바일매핑시스템으로 취득한 중첩 전방위 영상으로부터 3차원 객체좌표의 결정)

  • Oh, Tae-Wan;Lee, Im-Pyeong
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.28 no.3
    • /
    • pp.305-315
    • /
    • 2010
  • This research aims to develop a method to determine the 3D coordinates of an object point from overlapping omni-directional images acquired by a ground mobile mapping system and assess their accuracies. In the proposed method, we first define an individual coordinate system on each sensor and the object space and determine the geometric relationships between the systems. Based on these systems and their relationships, we derive a straight line of the corresponding object point candidates for a point of an omni-directional image, and determine the 3D coordinates of the object point by intersecting a pair of straight lines derived from a pair of matched points. We have compared the object coordinates determined through the proposed method with those measured by GPS and a total station for the accuracy assessment and analysis. According to the experimental results, with the appropriate length of baseline and mutual positions between cameras and objects, we can determine the relative coordinates of the object point with the accuracy of several centimeters. The accuracy of the absolute coordinates is ranged from several centimeters to 1 m due to systematic errors. In the future, we plan to improve the accuracy of absolute coordinates by determining more precisely the relationship between the camera and GPS/INS coordinates and performing the calibration of the omni-directional camera

Enhancement Techniques of Color Segmentation for Detecting Missing Persons in Smart Lighting System using Radar and Camera Sensors (레이다 및 카메라 내장형 스마트 조명에서 실종자 탐지용 색상 검출 향상 기법)

  • Song, Seungeon;Kim, Sangdong;Jin, Young-Seok;Lee, Jonghun
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.25 no.3
    • /
    • pp.53-59
    • /
    • 2020
  • This paper proposes color segmentation for detecting missing persons in a smart lighting system using radar and camera sensors. Recently, smart lighting systems built-in radar and cameras have been efficient in saving energy and searching for missing persons, simultaneously. In smart lighting systems, radar detects moving objects and then the lights turn on and camera records. The video recorded is useful to find out missing persons. The color of their clothes worn in missing persons is one of critical hints to look for missing persons. Therefore, color segmentation is an effective means for detecting the color of their clothes. In this paper, during the color segmentation step, the ROI(Region of interest) setting based on the size of an object is applied and the background is reduced. According to experimental results, the color segmentation has good accuracy of more than 97%.

Applicability of Optical Flow Information for UAV Navigation under GNSS-denied Environment (위성항법 불용 환경에서의 무인비행체 항법을 위한 광류 정보 활용)

  • Kim, Dongmin;Kim, Taegyun;Jeaong, Hoijo;Suk, Jinyoung;Kim, Seungkeun;Kim, Younsil;Han, Sanghyuck
    • Journal of Advanced Navigation Technology
    • /
    • v.24 no.1
    • /
    • pp.16-27
    • /
    • 2020
  • This paper investigates the applicability of optical flow information for unmanned aerial vehicle (UAV) navigation under environments where global navigation satellite system (GNSS) is unavailable. Since the optical flow information is one of important measurements to estimate horizontal velocity and position, accuracy of the optical flow information must be guaranteed. So a navigation algorithm, which can estimate and cancel biases that the optical flow information may have, is suggested to improve the estimation performance. In order to apply and verify the proposed algorithm, an integrated simulation environment is built by designing a guidance, navigation, and control (GNC) system. Numerical simulations are implemented to analyze the navigation performance using this environment.