• Title/Summary/Keyword: multi-sensor fusion

Search Result 204, Processing Time 0.029 seconds

Experimental validation of Kalman filter-based strain estimation in structures subjected to non-zero mean input

  • Palanisamy, Rajendra P.;Cho, Soojin;Kim, Hyunjun;Sim, Sung-Han
    • Smart Structures and Systems
    • /
    • v.15 no.2
    • /
    • pp.489-503
    • /
    • 2015
  • Response estimation at unmeasured locations using the limited number of measurements is an attractive topic in the field of structural health monitoring (SHM). Because of increasing complexity and size of civil engineering structures, measuring all structural responses from the entire body is intractable for the SHM purpose; the response estimation can be an effective and practical alternative. This paper investigates a response estimation technique based on the Kalman state estimator to combine multi-sensor data under non-zero mean input excitations. The Kalman state estimator, constructed based on the finite element (FE) model of a structure, can efficiently fuse different types of data of acceleration, strain, and tilt responses, minimizing the intrinsic measurement noise. This study focuses on the effects of (a) FE model error and (b) combinations of multi-sensor data on the estimation accuracy in the case of non-zero mean input excitations. The FE model error is purposefully introduced for more realistic performance evaluation of the response estimation using the Kalman state estimator. In addition, four types of measurement combinations are explored in the response estimation: strain only, acceleration only, acceleration and strain, and acceleration and tilt. The performance of the response estimation approach is verified by numerical and experimental tests on a simply-supported beam, showing that it can successfully estimate strain responses at unmeasured locations with the highest performance in the combination of acceleration and tilt.

Comparison of Multi-Static Sonar Target Positioning Performance (다중상태 소나망 위치 추정 성능 비교)

  • Park, Chee-Hyun;Ko, Han-Seok
    • The Journal of the Acoustical Society of Korea
    • /
    • v.26 no.4
    • /
    • pp.166-172
    • /
    • 2007
  • In this paper, we address the target positioning performance of Multi-Static sonar with respect to target positioning method and measurement error. Based on the analysis on two candidate solution approaches, namely, Least Square (LS) using range and angular information simultaneously and Maximum Likelihood (ML) using only range information as the existing information fusion methods for possible application to Multi-Static sonar, we propose to employ ML using range and angular information. Assuming that each sensor can receive range and angular information, we conduct representative comparison experiments over the existing and proposed methods under various measurement noise scenarios. We also investigate the target positioning performance according to number of sensors, distance between transmitter and receiver. According to the experimental results, RMSE of the proposed ML with distance and direction information is found to be more superior to ML using distance alone and to LS in case distance between transmitter and receiver is longer and number of receiver is smaller.

Enhanced Indoor Localization Scheme Based on Pedestrian Dead Reckoning and Kalman Filter Fusion with Smartphone Sensors (스마트폰 센서를 이용한 PDR과 칼만필터 기반 개선된 실내 위치 측위 기법)

  • Harun Jamil;Naeem Iqbal;Murad Ali Khan;Syed Shehryar Ali Naqvi;Do-Hyeun Kim
    • Journal of Internet of Things and Convergence
    • /
    • v.10 no.4
    • /
    • pp.101-108
    • /
    • 2024
  • Indoor localization is a critical component for numerous applications, ranging from navigation in large buildings to emergency response. This paper presents an enhanced Pedestrian Dead Reckoning (PDR) scheme using smartphone sensors, integrating neural network-aided motion recognition, Kalman filter-based error correction, and multi-sensor data fusion. The proposed system leverages data from the accelerometer, magnetometer, gyroscope, and barometer to accurately estimate a user's position and orientation. A neural network processes sensor data to classify motion modes and provide real-time adjustments to stride length and heading calculations. The Kalman filter further refines these estimates, reducing cumulative errors and drift. Experimental results, collected using a smartphone across various floors of University, demonstrate the scheme's ability to accurately track vertical movements and changes in heading direction. Comparative analyses show that the proposed CNN-LSTM model outperforms conventional CNN and Deep CNN models in angle prediction. Additionally, the integration of barometric pressure data enables precise floor level detection, enhancing the system's robustness in multi-story environments. Proposed comprehensive approach significantly improves the accuracy and reliability of indoor localization, making it viable for real-world applications.

Intelligent Abnormal Situation Event Detections for Smart Home Users Using Lidar, Vision, and Audio Sensors (스마트 홈 사용자를 위한 라이다, 영상, 오디오 센서를 이용한 인공지능 이상징후 탐지 알고리즘)

  • Kim, Da-hyeon;Ahn, Jun-ho
    • Journal of Internet Computing and Services
    • /
    • v.22 no.3
    • /
    • pp.17-26
    • /
    • 2021
  • Recently, COVID-19 has spread and time to stay at home has been increasing in accordance with quarantine guidelines of the government such as recommendations to refrain from going out. As a result, the number of single-person households staying at home is also increasingsingle-person households are less likely to be notified to the outside world in times of emergency than multi-person households. This study collects various situations occurring in the home with lidar, image, and voice sensors and analyzes the data according to the sensors through their respective algorithms. Using this method, we analyzed abnormal patterns such as emergency situations and conducted research to detect abnormal signs in humans. Artificial intelligence algorithms that detect abnormalities in people by each sensor were studied and the accuracy of anomaly detection was measured according to the sensor. Furthermore, this work proposes a fusion method that complements the pros and cons between sensors by experimenting with the detectability of sensors for various situations.

Radiometric Cross Calibration of KOMPSAT-3 and Lnadsat-8 for Time-Series Harmonization (KOMPSAT-3와 Landsat-8의 시계열 융합활용을 위한 교차검보정)

  • Ahn, Ho-yong;Na, Sang-il;Park, Chan-won;Hong, Suk-young;So, Kyu-ho;Lee, Kyung-do
    • Korean Journal of Remote Sensing
    • /
    • v.36 no.6_2
    • /
    • pp.1523-1535
    • /
    • 2020
  • In order to produce crop information using remote sensing, we use classification and growth monitoring based on crop phenology. Therefore, time-series satellite images with a short period are required. However, there are limitations to acquiring time-series satellite data, so it is necessary to use fusion with other earth observation satellites. Before fusion of various satellite image data, it is necessary to overcome the inherent difference in radiometric characteristics of satellites. This study performed Korea Multi-Purpose Satellite-3 (KOMPSAT-3) cross calibration with Landsat-8 as the first step for fusion. Top of Atmosphere (TOA) Reflectance was compared by applying Spectral Band Adjustment Factor (SBAF) to each satellite using hyperspectral sensor band aggregation. As a result of cross calibration, KOMPSAT-3 and Landsat-8 satellites showed a difference in reflectance of less than 4% in Blue, Green, and Red bands, and 6% in NIR bands. KOMPSAT-3, without on-board calibrator, idicate lower radiometric stability compared to ladnsat-8. In the future, efforts are needed to produce normalized reflectance data through BRDF (Bidirectional reflectance distribution function) correction and SBAF application for spectral characteristics of agricultural land.

Attention based Feature-Fusion Network for 3D Object Detection (3차원 객체 탐지를 위한 어텐션 기반 특징 융합 네트워크)

  • Sang-Hyun Ryoo;Dae-Yeol Kang;Seung-Jun Hwang;Sung-Jun Park;Joong-Hwan Baek
    • Journal of Advanced Navigation Technology
    • /
    • v.27 no.2
    • /
    • pp.190-196
    • /
    • 2023
  • Recently, following the development of LIDAR technology which can detect distance from the object, the interest for LIDAR based 3D object detection network is getting higher. Previous networks generate inaccurate localization results due to spatial information loss during voxelization and downsampling. In this study, we propose an attention-based convergence method and a camera-LIDAR convergence system to acquire high-level features and high positional accuracy. First, by introducing the attention method into the Voxel-RCNN structure, which is a grid-based 3D object detection network, the multi-scale sparse 3D convolution feature is effectively fused to improve the performance of 3D object detection. Additionally, we propose the late-fusion mechanism for fusing outcomes in 3D object detection network and 2D object detection network to delete false positive. Comparative experiments with existing algorithms are performed using the KITTI data set, which is widely used in the field of autonomous driving. The proposed method showed performance improvement in both 2D object detection on BEV and 3D object detection. In particular, the precision was improved by about 0.54% for the car moderate class compared to Voxel-RCNN.

Multi Point Cloud Integration based on Observation Vectors between Stereo Images (스테레오 영상 간 관측 벡터에 기반한 다중 포인트 클라우드 통합)

  • Yoon, Wansang;Kim, Han-gyeol;Rhee, Sooahm
    • Korean Journal of Remote Sensing
    • /
    • v.35 no.5_1
    • /
    • pp.727-736
    • /
    • 2019
  • In this paper, we present how to create a point cloud for a target area using multiple unmanned aerial vehicle images and to remove the gaps and overlapping points between datasets. For this purpose, first, IBA (Incremental Bundle Adjustment) technique was applied to correct the position and attitude of UAV platform. We generate a point cloud by using MDR (Multi-Dimensional Relaxation) matching technique. Next, we register point clouds based on observation vectors between stereo images by doing this we remove gaps between point clouds which are generated from different stereo pairs. Finally, we applied an occupancy grids based integration algorithm to remove duplicated points to create an integrated point cloud. The experiments were performed using UAV images, and our experiments show that it is possible to remove gaps and duplicate points between point clouds generated from different stereo pairs.

Adjustment of Exterior Orientation Parameters Geometric Registration of Aerial Images and LIDAR Data (항공영상과 라이다데이터의 기하학적 정합을 위한 외부표정요소의 조정)

  • Hong, Ju-Seok;Lee, Im-Pyeong
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.27 no.5
    • /
    • pp.585-597
    • /
    • 2009
  • This research aims to develop a registration method to remove the geometric inconsistency between aerial images and LIDAR data acquired from an airborne multi-sensor system. The proposed method mainly includes registration primitives extraction, correspondence establishment, and EOP(Exterior Orientation Parameters) adjustment. As the registration primitives, we extracts planar patches and intersection edges from the LIDAR data and object points and linking edges from the aerial images. The extracted primitives are then categorized into horizontal and vertical ones; and their correspondences are established. These correspondent pairs are incorporated as stochastic constraints into the bundle block adjustment, which finally precisely adjusts the exterior orientation parameters of the images. According to the experimental results from the application of the proposed method to real data, we found that the attitude parameters of EOPs were meaningfully adjusted and the geometric inconsistency of the primitives used for the adjustment is reduced from 2 m to 2 cm before and after the registration. Hence, the results of this research can contribute to data fusion for the high quality 3D spatial information.

A Time Synchronization Scheme for Vision/IMU/OBD by GPS (GPS를 활용한 Vision/IMU/OBD 시각동기화 기법)

  • Lim, JoonHoo;Choi, Kwang Ho;Yoo, Won Jae;Kim, La Woo;Lee, Yu Dam;Lee, Hyung Keun
    • Journal of Advanced Navigation Technology
    • /
    • v.21 no.3
    • /
    • pp.251-257
    • /
    • 2017
  • Recently, hybrid positioning system combining GPS, vision sensor, and inertial sensor has drawn many attentions to estimate accurate vehicle positions. Since accurate multi-sensor fusion requires efficient time synchronization, this paper proposes an efficient method to obtain time synchronized measurements of vision sensor, inertial sensor, and OBD device based on GPS time information. In the proposed method, the time and position information is obtained by the GPS receiver, the attitude information is obtained by the inertial sensor, and the speed information is obtained by the OBD device. The obtained time, position, speed, and attitude information is converted to the color information. The color information is inserted to several corner pixels of the corresponding image frame. An experiment was performed with real measurements to evaluate the feasibility of the proposed method.

Time Synchronization Error and Calibration in Integrated GPS/INS Systems

  • Ding, Weidong;Wang, Jinling;Li, Yong;Mumford, Peter;Rizos, Chris
    • ETRI Journal
    • /
    • v.30 no.1
    • /
    • pp.59-67
    • /
    • 2008
  • The necessity for the precise time synchronization of measurement data from multiple sensors is widely recognized in the field of global positioning system/inertial navigation system (GPS/INS) integration. Having precise time synchronization is critical for achieving high data fusion performance. The limitations and advantages of various time synchronization scenarios and existing solutions are investigated in this paper. A criterion for evaluating synchronization accuracy requirements is derived on the basis of a comparison of the Kalman filter innovation series and the platform dynamics. An innovative time synchronization solution using a counter and two latching registers is proposed. The proposed solution has been implemented with off-the-shelf components and tested. The resolution and accuracy analysis shows that the proposed solution can achieve a time synchronization accuracy of 0.1 ms if INS can provide a hard-wired timing signal. A synchronization accuracy of 2 ms was achieved when the test system was used to synchronize a low-grade micro-electromechanical inertial measurement unit (IMU), which has only an RS-232 data output interface.

  • PDF