• Title/Summary/Keyword: Sensor fusion

Search Result 815, Processing Time 0.027 seconds

Performance Evaluation of a Compressed-State Constraint Kalman Filter for a Visual/Inertial/GNSS Navigation System

  • Yu Dam Lee;Taek Geun Lee;Hyung Keun Lee
    • Journal of Positioning, Navigation, and Timing
    • /
    • v.12 no.2
    • /
    • pp.129-140
    • /
    • 2023
  • Autonomous driving systems are likely to be operated in various complex environments. However, the well-known integrated Global Navigation Satellite System (GNSS)/Inertial Navigation System (INS), which is currently the major source for absolute position information, still has difficulties in accurate positioning in harsh signal environments such as urban canyons. To overcome these difficulties, integrated Visual/Inertial/GNSS (VIG) navigation systems have been extensively studied in various areas. Recently, a Compressed-State Constraint Kalman Filter (CSCKF)-based VIG navigation system (CSCKF-VIG) using a monocular camera, an Inertial Measurement Unit (IMU), and GNSS receivers has been studied with the aim of providing robust and accurate position information in urban areas. For this new filter-based navigation system, on the basis of time-propagation measurement fusion theory, unnecessary camera states are not required in the system state. This paper presents a performance evaluation of the CSCKF-VIG system compared to other conventional navigation systems. First, the CSCKF-VIG is introduced in detail compared to the well-known Multi-State Constraint Kalman Filter (MSCKF). The CSCKF-VIG system is then evaluated by a field experiment in different GNSS availability situations. The results show that accuracy is improved in the GNSS-degraded environment compared to that of the conventional systems.

Study on Priority Selection of Export Strategic Core Technologies for IT Fusion Next Generation Agricultural Machines (IT융합 차세대 농기계 수출전략형 핵심기술 우선순위 선정에 관한 연구)

  • Chang, Dong-Il;Cho, Byoung-Kwan;Lee, Hoon-Soo;Chung, Sun-Ok;Park, Seung-Jae;Kim, Chul-Soo;Lee, Young-Hee
    • Journal of Biosystems Engineering
    • /
    • v.36 no.6
    • /
    • pp.491-499
    • /
    • 2011
  • The objective of this study was to develop the export strategic core technologies for IT fusion next generation agricultural machines by the analysis of comprehensive and cooperative systems of industries, universities, and institutes. In order to achieve the objective of this study, an expert panel was formed and operated. The first survey was conducted by the Delphi method. For this the export strategic core technologies were surveyed and analyzed using the questionnaire. Based on the results of the first survey, the second survey was conducted. The questionnaire used for the second survey was designed by results of the first survey. The results of the second survey was analyzed by AHP method. The third survey was conducted based on the second one, and the final results were analyzed and the export strategic core technologies were developed through the expert meeting. The study results showed six export strategic core technologies as the followings : 1) environment-friendly engine technology for high performance 2) high performance/high efficiency power transmission system technology 3) development of measurement system technology for safety of agricultural products 4) field application of sensor networks 5) large size combine development technology for high performance 6) quality evaluation technology for agricultural products.

FLIR and CCD Image Fusion Algorithm Based on Adaptive Weight for Target Extraction (표적 추출을 위한 적응적 가중치 기반 FLIR 및 CCD 센서 영상 융합 알고리즘)

  • Gu, Eun-Hye;Lee, Eun-Young;Kim, Se-Yun;Cho, Woon-Ho;Kim, Hee-Soo;Park, Kil-Houm
    • Journal of Korea Multimedia Society
    • /
    • v.15 no.3
    • /
    • pp.291-298
    • /
    • 2012
  • In automatic target recognition(ATR) systems, target extraction techniques are very important because ATR performance depends on segmentation result. So, this paper proposes a multi-sensor image fusion method based on adaptive weights. To incorporate the FLIR image and CCD image, we used information such as the bi-modality, distance and texture. A weight of the FLIR image is derived from the bi-modality and distance measure. For the weight of CCD image, the information that the target's texture is more uniform than the background region is used. The proposed algorithm is applied to many images and its performance is compared with the segmentation result using the single image. Experimental results show that the proposed method has the accurate extraction performance.

Analysis of Efficient Health Data Transmission Methods based on the Fusion of WBAN and FANET (WBAN과 FANET 융합 기반의 효율적인 신체 데이터 전송 방법 분석)

  • Ha, Il-Kyu
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.21 no.2
    • /
    • pp.386-394
    • /
    • 2017
  • FANET is an ad hoc network formed among the unmanned aircraft in the three-dimensional space for data transfer. Most of the research on FANET application has focused on the use of the camera sensor mounted on the unmanned aircraft to collect data from the ground, and process and delivery of the data for a specific purpose. However, the research on the fusion of WBAN and FANET that collects the data of the human body and passes through the FANET has not been studied much until now. Therefore, in this study, we study the data transmission system that collects the human body data of people working in the areas that are vulnerable to communication difficulties and passes the collected data through the FANET. In particular we analyze the possible methods to transfer the emergency data of the body in the fusion network of WBAN and FANET and provide a data transfer model that can be transmitted most efficiently.

Estimation of Stroke Volume Based on Air Pressure in Air Tube with Pneumatic Pulsatile Ventricular Assist Device (공압식 박동형 심실보조장치에서 공압관 내 공기압에 따른 박출량 추정)

  • Kang, Yu Min;Lee, Jin Hong;Her, Keun;Choi, Seong Wook
    • Transactions of the Korean Society of Mechanical Engineers B
    • /
    • v.38 no.12
    • /
    • pp.971-974
    • /
    • 2014
  • A ventricular assist device (VAD) is used for bridge to heart transplantation and heart diseases. Knowing the status of a pneumatic pulsatile VAD when implanting it into the body is important: when the velocity of blood flow through the VAD is slow, a thrombus may occur, and thrombosis can be fatal to a patient. In order to determine the state of a VAD, various sensors need to be implanted. Because this introduces the risk of infection and difficulties with sensor management, we developed a method for estimating the state of a VAD indirectly via the pressure in an air tube that can be measured in vitro. We compared the measured values to in vitro experimental results. The estimated and measured values showed some errors, but the accuracy can be improved by refining the estimation process to minimize the risk of infection.

A Robust Depth Map Upsampling Against Camera Calibration Errors (카메라 보정 오류에 강건한 깊이맵 업샘플링 기술)

  • Kim, Jae-Kwang;Lee, Jae-Ho;Kim, Chang-Ick
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.48 no.6
    • /
    • pp.8-17
    • /
    • 2011
  • Recently, fusion camera systems that consist of depth sensors and color cameras have been widely developed with the advent of a new type of sensor, time-of-flight (TOF) depth sensor. The physical limitation of depth sensors usually generates low resolution images compared to corresponding color images. Therefore, the pre-processing module, such as camera calibration, three dimensional warping, and hole filling, is necessary to generate the high resolution depth map that is placed in the image plane of the color image. However, the result of the pre-processing step is usually inaccurate due to errors from the camera calibration and the depth measurement. Therefore, in this paper, we present a depth map upsampling method robust these errors. First, the confidence of the measured depth value is estimated by the interrelation between the color image and the pre-upsampled depth map. Then, the detailed depth map can be generated by the modified kernel regression method which exclude depth values having low confidence. Our proposed algorithm guarantees the high quality result in the presence of the camera calibration errors. Experimental comparison with other data fusion techniques shows the superiority of our proposed method.

Matching and Geometric Correction of Multi-Resolution Satellite SAR Images Using SURF Technique (SURF 기법을 활용한 위성 SAR 다중해상도 영상의 정합 및 기하보정)

  • Kim, Ah-Leum;Song, Jung-Hwan;Kang, Seo-Li;Lee, Woo-Kyung
    • Korean Journal of Remote Sensing
    • /
    • v.30 no.4
    • /
    • pp.431-444
    • /
    • 2014
  • As applications of spaceborne SAR imagery are extended, there are increased demands for accurate registrations for better understanding and fusion of radar images. It becomes common to adopt multi-resolution SAR images to apply for wide area reconnaissance. Geometric correction of the SAR images can be performed by using satellite orbit and attitude information. However, the inherent errors of the SAR sensor's attitude and ground geographical data tend to cause geometric errors in the produced SAR image. These errors should be corrected when the SAR images are applied for multi-temporal analysis, change detection applications and image fusion with other sensor images. The undesirable ground registration errors can be corrected with respect to the true ground control points in order to produce complete SAR products. Speeded Up Robust Feature (SURF) technique is an efficient algorithm to extract ground control points from images but is considered to be inappropriate to apply to SAR images due to high speckle noises. In this paper, an attempt is made to apply SURF algorithm to SAR images for image registration and fusion. Matched points are extracted with respect to the varying parameters of Hessian and SURF matching thresholds, and the performance is analyzed by measuring the imaging matching accuracies. A number of performance measures concerning image registration are suggested to validate the use of SURF for spaceborne SAR images. Various simulations methodologies are suggested the validate the use of SURF for the geometric correction and image registrations and it is shown that a good choice of input parameters to the SURF algorithm should be made to apply for the spaceborne SAR images of moderate resolutions.

The Estimation of Hand Pose Based on Mean-Shift Tracking Using the Fusion of Color and Depth Information for Marker-less Augmented Reality (비마커 증강현실을 위한 색상 및 깊이 정보를 융합한 Mean-Shift 추적 기반 손 자세의 추정)

  • Lee, Sun-Hyoung;Hahn, Hern-Soo;Han, Young-Joon
    • Journal of the Korea Society of Computer and Information
    • /
    • v.17 no.7
    • /
    • pp.155-166
    • /
    • 2012
  • This paper proposes a new method of estimating the hand pose through the Mean-Shift tracking algorithm using the fusion of color and depth information for marker-less augmented reality. On marker-less augmented reality, the most of previous studies detect the hand region using the skin color from simple experimental background. Because finger features should be detected on the hand, the hand pose that can be measured from cameras is restricted considerably. However, the proposed method can easily detect the hand pose from complex background through the new Mean-Shift tracking method using the fusion of the color and depth information from 3D sensor. The proposed method of estimating the hand pose uses the gravity point and two random points on the hand without largely constraints. The proposed Mean-Shift tracking method has about 50 pixels error less than general tracking method just using color value. The augmented reality experiment of the proposed method shows results of its performance being as good as marker based one on the complex background.

Aircraft Velocity and Altitude Estimation through Time Offset Calculation of KOMPSAT-3 Satellite (KOMPSAT-3 위성의 Time Offset 계산을 통한 항공기 속력 및 고도 추정)

  • Jung, Sejung;Shin, Hyeongil;Kim, Dohoon;Song, Ahram;Lee, Won Hee
    • Korean Journal of Remote Sensing
    • /
    • v.38 no.6_4
    • /
    • pp.1879-1887
    • /
    • 2022
  • In this study, a method of estimating the velocity and altitude of aircrafts photographed in a KOMPSAT-3 satellite was proposed. In the proposed method, parallax effect, which is a time offset between bands due to the photographing method of the KOMPSAT-3 satellite, the structure of the sensor, and the movement of the satellite's orbit, was calculated, and in this process, trucks running on the highway were used. In addition, the actual direction and the direction by parallax effect of the aircraft were calculated using the coordinates of the aircraft in the image, and the attitude information of the KOMPSAT-3 satellite was calculated using metadata to estimate the velocity and altitude of the aircraft. The estimated value through the proposed method was compared with the actual value, automatic dependent surveillance-broadcast (ADS-B), and the error rate was calculated here. As a result, it was confirmed that the velocity and altitude error rate of large aircraft (I1, I3, S2) were lower than that of light aircraft (I2, S2), and the estimated velocity and altitude were relatively high in large aircraft using the proposed method.

Design of Multi-Sensor-Based Open Architecture Integrated Navigation System for Localization of UGV

  • Choi, Ji-Hoon;Oh, Sang Heon;Kim, Hyo Seok;Lee, Yong Woo
    • Journal of Positioning, Navigation, and Timing
    • /
    • v.1 no.1
    • /
    • pp.35-43
    • /
    • 2012
  • The UGV is one of the special field robot developed for mine detection, surveillance and transportation. To achieve successfully the missions of the UGV, the accurate and reliable navigation data should be provided. This paper presents design and implementation of multi-sensor-based open architecture integrated navigation for localization of UGV. The presented architecture hierarchically classifies the integrated system into four layers and data communications between layers are based on the distributed object oriented middleware. The navigation manager determines the navigation mode with the QoS information of each navigation sensor and the integrated filter performs the navigation mode-based data fusion in the filtering process. Also, all navigation variables including the filter parameters and QoS of navigation data can be modified in GUI and consequently, the user can operate the integrated navigation system more usefully. The conventional GPS/INS integrated system does not guarantee the long-term reliability of localization when GPS solution is not available by signal blockage and intentional jamming in outdoor environment. The presented integration algorithm, however, based on the adaptive federated filter structure with FDI algorithm can integrate effectively the output of multi-sensor such as 3D LADAR, vision, odometer, magnetic compass and zero velocity to enhance the accuracy of localization result in the case that GPS is unavailable. The field test was carried out with the UGV and the test results show that the presented integrated navigation system can provide more robust and accurate localization performance than the conventional GPS/INS integrated system in outdoor environments.