• Title/Summary/Keyword: 다중 센서 융합

Search Result 170, Processing Time 0.026 seconds

Visible and SWIR Satellite Image Fusion Using Multi-Resolution Transform Method Based on Haze-Guided Weight Map (Haze-Guided Weight Map 기반 다중해상도 변환 기법을 활용한 가시광 및 SWIR 위성영상 융합)

  • Taehong Kwak;Yongil Kim
    • Korean Journal of Remote Sensing
    • /
    • v.39 no.3
    • /
    • pp.283-295
    • /
    • 2023
  • With the development of sensor and satellite technology, numerous high-resolution and multi-spectral satellite images have been available. Due to their wavelength-dependent reflection, transmission, and scattering characteristics, multi-spectral satellite images can provide complementary information for earth observation. In particular, the short-wave infrared (SWIR) band can penetrate certain types of atmospheric aerosols from the benefit of the reduced Rayleigh scattering effect, which allows for a clearer view and more detailed information to be captured from hazed surfaces compared to the visible band. In this study, we proposed a multi-resolution transform-based image fusion method to combine visible and SWIR satellite images. The purpose of the fusion method is to generate a single integrated image that incorporates complementary information such as detailed background information from the visible band and land cover information in the haze region from the SWIR band. For this purpose, this study applied the Laplacian pyramid-based multi-resolution transform method, which is a representative image decomposition approach for image fusion. Additionally, we modified the multiresolution fusion method by combining a haze-guided weight map based on the prior knowledge that SWIR bands contain more information in pixels from the haze region. The proposed method was validated using very high-resolution satellite images from Worldview-3, containing multi-spectral visible and SWIR bands. The experimental data including hazed areas with limited visibility caused by smoke from wildfires was utilized to validate the penetration properties of the proposed fusion method. Both quantitative and visual evaluations were conducted using image quality assessment indices. The results showed that the bright features from the SWIR bands in the hazed areas were successfully fused into the integrated feature maps without any loss of detailed information from the visible bands.

A Target Segmentation Method Based on Multi-Sensor/Multi-Frame (다중센서-다중프레임 기반 표적분할기법)

  • Lee, Seung-Youn
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.13 no.3
    • /
    • pp.445-452
    • /
    • 2010
  • Adequate segmentation of target objects from the background plays an important role for the performance of automatic target recognition(ATR) system. This paper presents a new segmentation algorithm using fuzzy thresholding to extract a target. The proposed algorithm consists of two steps. In the first step, the region of interest(ROI) including the target can be automatically selected by the proposed robust method based on the frame difference of each image sensor. In the second step, fuzzy thresholding with a proposed membership function is performed within the only ROI selected in the first step. The proposed membership function is based on the similarity of intensity and the adjacency of target area on each image. Experimental results applied to real CCD/IR images show a good performance and the proposed algorithm is expected to enhance the performance of ATR system using multi-sensors.

Design of Fusion Multilabeling System Controlled by Wi-Fi Signals (Wi-Fi신호로 제어되는 융합형 다중라벨기 설계)

  • Lim, Joong-Soo
    • Journal of the Korea Convergence Society
    • /
    • v.6 no.1
    • /
    • pp.1-5
    • /
    • 2015
  • In this paper, we describe the design of a fusion labeling system which is controlled by the Wi-Fi signals. The Current labeling system which is used in the industry is designed to work independently on the production line not connected with internet network services. For such reasons, it is very inconvenient for the labeling system to transfer such labeling data of the production line to the server computer. We propose a labeling system connected to the Wi-Fi service being able to send real-time transmission of labeling data. This system can supply the labeling data of production line to the server computer in realtime and improve the production quality than the existing system.

Development of Multi-sensor Image Fusion software(InFusion) for Value-added applications (고부가 활용을 위한 이종영상 융합 소프트웨어(InFusion) 개발)

  • Choi, Myung-jin;Chung, Inhyup;Ko, Hyeong Ghun;Jang, Sumin
    • Journal of Satellite, Information and Communications
    • /
    • v.12 no.3
    • /
    • pp.15-21
    • /
    • 2017
  • Following the successful launch of KOMPSAT-3 in May 2012, KOMPSAT-5 in August 2013, and KOMPSAT-3A in March 2015 have succeeded in launching the integrated operation of optical, radar and thermal infrared sensors in Korea. We have established a foundation to utilize the characteristics of each sensors. In order to overcome limitations in the range of application and accuracy of the application of a single sensor, multi-sensor image fusion techniques have been developed which take advantage of multiple sensors and complement each other. In this paper, we introduce the development of software (InFusion) for multi-sensor image fusion and valued-added product generation using KOMPSAT series. First, we describe the characteristics of each sensor and the necessity of fusion software development, and describe the entire development process. It aims to increase the data utilization of KOMPSAT series and to inform the superiority of domestic software through creation of high value-added products.

A Study on High Speed Visible Light Communication System Using Non-orthogonal Multiple Modulation Scheme (비직교 다중변조 방식을 이용한 고속 가시광통신 시스템에 대한 연구)

  • Han, Doo-Hee;Lee, Kyu-Jin
    • Journal of Convergence for Information Technology
    • /
    • v.10 no.2
    • /
    • pp.32-38
    • /
    • 2020
  • In this paper, we analyze the modulation scheme for high speed transmission in visible light communication system, and study non-orthogonal multiplexing, dimming level and transmission power ratio. Conventional visible light communication has a disadvantage in that it is difficult to multi-transmit to increase the transmission speed. Multi-transmission technique is necessary for high-speed transmission at the transmitter. Since general visible light communication has a limitation in multiple transmission, various researches for high-speed transmission have been conducted. In order to solve this problem, this paper proposes a multiple modulation scheme for high-speed visible light communication using non-orthogonal multiplex transmission scheme and a future research direction.

Scaling Attack Method for Misalignment Error of Camera-LiDAR Calibration Model (카메라-라이다 융합 모델의 오류 유발을 위한 스케일링 공격 방법)

  • Yi-ji Im;Dae-seon Choi
    • Journal of the Korea Institute of Information Security & Cryptology
    • /
    • v.33 no.6
    • /
    • pp.1099-1110
    • /
    • 2023
  • The recognition system of autonomous driving and robot navigation performs vision work such as object recognition, tracking, and lane detection after multi-sensor fusion to improve performance. Currently, research on a deep learning model based on the fusion of a camera and a lidar sensor is being actively conducted. However, deep learning models are vulnerable to adversarial attacks through modulation of input data. Attacks on the existing multi-sensor-based autonomous driving recognition system are focused on inducing obstacle detection by lowering the confidence score of the object recognition model.However, there is a limitation that an attack is possible only in the target model. In the case of attacks on the sensor fusion stage, errors in vision work after fusion can be cascaded, and this risk needs to be considered. In addition, an attack on LIDAR's point cloud data, which is difficult to judge visually, makes it difficult to determine whether it is an attack. In this study, image scaling-based camera-lidar We propose an attack method that reduces the accuracy of LCCNet, a fusion model (camera-LiDAR calibration model). The proposed method is to perform a scaling attack on the point of the input lidar. As a result of conducting an attack performance experiment by size with a scaling algorithm, an average of more than 77% of fusion errors were caused.

Physical Offset of UAVs Calibration Method for Multi-sensor Fusion (다중 센서 융합을 위한 무인항공기 물리 오프셋 검보정 방법)

  • Kim, Cheolwook;Lim, Pyeong-chae;Chi, Junhwa;Kim, Taejung;Rhee, Sooahm
    • Korean Journal of Remote Sensing
    • /
    • v.38 no.6_1
    • /
    • pp.1125-1139
    • /
    • 2022
  • In an unmanned aerial vehicles (UAVs) system, a physical offset can be existed between the global positioning system/inertial measurement unit (GPS/IMU) sensor and the observation sensor such as a hyperspectral sensor, and a lidar sensor. As a result of the physical offset, a misalignment between each image can be occurred along with a flight direction. In particular, in a case of multi-sensor system, an observation sensor has to be replaced regularly to equip another observation sensor, and then, a high cost should be paid to acquire a calibration parameter. In this study, we establish a precise sensor model equation to apply for a multiple sensor in common and propose an independent physical offset estimation method. The proposed method consists of 3 steps. Firstly, we define an appropriate rotation matrix for our system, and an initial sensor model equation for direct-georeferencing. Next, an observation equation for the physical offset estimation is established by extracting a corresponding point between a ground control point and the observed data from a sensor. Finally, the physical offset is estimated based on the observed data, and the precise sensor model equation is established by applying the estimated parameters to the initial sensor model equation. 4 region's datasets(Jeon-ju, Incheon, Alaska, Norway) with a different latitude, longitude were compared to analyze the effects of the calibration parameter. We confirmed that a misalignment between images were adjusted after applying for the physical offset in the sensor model equation. An absolute position accuracy was analyzed in the Incheon dataset, compared to a ground control point. For the hyperspectral image, root mean square error (RMSE) for X, Y direction was calculated for 0.12 m, and for the point cloud, RMSE was calculated for 0.03 m. Furthermore, a relative position accuracy for a specific point between the adjusted point cloud and the hyperspectral images were also analyzed for 0.07 m, so we confirmed that a precise data mapping is available for an observation without a ground control point through the proposed estimation method, and we also confirmed a possibility of multi-sensor fusion. From this study, we expect that a flexible multi-sensor platform system can be operated through the independent parameter estimation method with an economic cost saving.

Multi-Sensor Image Alignment By Statistical Correlation (통계적 Correlation을 이용한 다중센서 영상 정합)

  • 고진신;박영태
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2003.10b
    • /
    • pp.586-588
    • /
    • 2003
  • 현재 많이 연구되는 영상융합(Image fusion)에서는 필히 두 영상의 정합(alignment)이 이루어져야만 수행된다. 각기 다른 특징을 갖는 센서(EO.IR.Radar등)로부터 얻는 영상에서는 각각 다른 특징점 정보를 가지므로, 특징점을 이용한 영상 정합 구현에는 전처리 과정이 매우 복잡하고 까다롭게 이루어져야 한다. 본 논문에서는 Correlation에 대한 통계적 상관 관계를 이용하여. 전처리 과정을 단순하게 수행 하여도 매우 강건한 영상 정합이 이루어지도록 구현 하였다. 또한, 통계적 기법에 적합하도록, 효율적인 전처리 과정을 통해 계산량이 적어 지는 방법을 제안 한다.

  • PDF

A Novel Method of Basic Probability Assignment Calculation with Signal Variation Rate (구간변화율을 고려한 기본확률배정함수 결정)

  • Suh, Dong-Hyok;Park, Chan-Bong
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.8 no.3
    • /
    • pp.465-470
    • /
    • 2013
  • Dempster-Shafer Evidence Theory is available for multi-sensor data fusion. Basic Probability Assignment is essential for multi-sensor data fusion using Dempster-Shafer Theory. In this paper, we proposed a novel method of BPA calculation with signal assessment. We took notice of the signal that reported from the sensor mote at the time slot. We assessed the variation rate of the reported signal from the terminal. The trend of variation implies significant component of the context. We calculated the variation rate of signal for reveal the relation of the variation and the context. We could reach context inference with BPA that calculated with the variation rate of signal.

A Way of Advanced Life Safety with State Inference in the Internet of Things (사물인터넷 환경에서 보행자 상태추정을 포함하는 생활안전 보장)

  • Suh, Dong-Hyok;Kim, Sung-Gil
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.11 no.2
    • /
    • pp.237-244
    • /
    • 2016
  • There are two destinations to aware the risk of common life. Recognition of the condition of pedestrian's own and the environmental factor awareness both are beneficial for risk awareness. It is good way of advancing the crime prevention effectivity that including IoT technology at the crime prevention research. The purpose of this research is that advanced way of crime prevention with multi-sensor data fusion of the condition of pedestrian and environmental factors. The 3-axis acceleration sensor is available to recognize the gait and the illumination sensor also useful to infer the road state. This research suggest a novel way of assess these factors and the result is the degree of danger.