• Title/Summary/Keyword: Data fusion

Search Result 1,574, Processing Time 0.025 seconds

A Vehicle Recognition Method based on Radar and Camera Fusion in an Autonomous Driving Environment

  • Park, Mun-Yong;Lee, Suk-Ki;Shin, Dong-Jin
    • International journal of advanced smart convergence
    • /
    • v.10 no.4
    • /
    • pp.263-272
    • /
    • 2021
  • At a time when securing driving safety is the most important in the development and commercialization of autonomous vehicles, AI and big data-based algorithms are being studied to enhance and optimize the recognition and detection performance of various static and dynamic vehicles. However, there are many research cases to recognize it as the same vehicle by utilizing the unique advantages of radar and cameras, but they do not use deep learning image processing technology or detect only short distances as the same target due to radar performance problems. Radars can recognize vehicles without errors in situations such as night and fog, but it is not accurate even if the type of object is determined through RCS values, so accurate classification of the object through images such as cameras is required. Therefore, we propose a fusion-based vehicle recognition method that configures data sets that can be collected by radar device and camera device, calculates errors in the data sets, and recognizes them as the same target.

Indoor Localization for Mobile Robot using Extended Kalman Filter (확장 칼만 필터를 이용한 로봇의 실내위치측정)

  • Kim, Jung-Min;Kim, Youn-Tae;Kim, Sung-Shin
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.18 no.5
    • /
    • pp.706-711
    • /
    • 2008
  • This paper is presented an accurate localization scheme for mobile robots based on the fusion of ultrasonic satellite (U-SAT) with inertial navigation system (INS), i.e., sensor fusion. Our aim is to achieve enough accuracy less than 100 mm. The INS consist of a yaw gyro, two wheel-encoders. And the U-SAT consist of four transmitters, a receiver. Besides the localization method in this paper fuse these in an extended Kalman filter. The performance of the localization is verified by simulation and two actual data(straight, curve) gathered from about 0.5 m/s of driving actual driving data. localization methods used are general sensor fusion and sensor fusion through Kalman filter using data from INS. Through the simulation and actual data studies, the experiment show the effectiveness of the proposed method for autonomous mobile robots.

Comparison of Image Fusion Methods to Merge KOMPSAT-2 Panchromatic and Multispectral Images (KOMPSAT-2 전정색영상과 다중분광영상의 융합기법 비교평가)

  • Oh, Kwan-Young;Jung, Hyung-Sup;Lee, Kwang-Jae
    • Korean Journal of Remote Sensing
    • /
    • v.28 no.1
    • /
    • pp.39-54
    • /
    • 2012
  • The objective of this study is to propose efficient data fusion techniques feasible to the KOMPSAT-2 satellite images. The most widely used image fusion techniques, which are the high-pass filter (HPF), the intensity-hue-saturation-based (modified IHS), the pan-sharpened, and the wavelet-based methods, was applied to four KOMPSAT - 2 satellite images having different regional and seasonal characteristics. Each fusion result was compared and analyzed in spatial and spectral features, respectively. Quality evaluation of image fusion techniques was performed in both quantitative and visual analysis. The quantitative analysis methods used for this study were the relative global dimensional error (spatial and spectral ERGAS), the spectral angle mapper index (SAM), and the image quality index (Q4). The results of quantitative and visual analysis indicate that the pan-sharpened method among the fusion methods used for this study relatively has the suitable balance between spectral and spatial information. In the case of the modified IHS method, the spatial information is well preserved, while the spectral information is distorted. And also the HPF and wavelet methods do not preserve the spectral information but the spatial information.

Hyperspectral Image Fusion Algorithm Based on Two-Stage Spectral Unmixing Method (2단계 분광혼합기법 기반의 하이퍼스펙트럴 영상융합 알고리즘)

  • Choi, Jae-Wan;Kim, Dae-Sung;Lee, Byoung-Kil;Yu, Ki-Yun;Kim, Yong-Il
    • Korean Journal of Remote Sensing
    • /
    • v.22 no.4
    • /
    • pp.295-304
    • /
    • 2006
  • Image fusion is defined as making new image by merging two or more images using special algorithms. In case of remote sensing, it means fusing multispectral low-resolution remotely sensed image with panchromatic high-resolution image. Generally, hyperspectral image fusion is accomplished by utilizing fusion technique of multispectral imagery or spectral unmixing model. But, the former may distort spectral information and the latter needs endmember data or additional data, and has a problem with not preserving spatial information well. This study proposes a new algorithm based on two stage spectral unmixing model for preserving hyperspectral image's spectral information. The proposed fusion technique is implemented and tested using Hyperion and ALI images. it is shown to work well on maintaining more spatial/spectral information than the PCA/GS fusion algorithms.

Bio-inspired neuro-symbolic approach to diagnostics of structures

  • Shoureshi, Rahmat A.;Schantz, Tracy;Lim, Sun W.
    • Smart Structures and Systems
    • /
    • v.7 no.3
    • /
    • pp.229-240
    • /
    • 2011
  • Recent developments in Smart Structures with very large scale embedded sensors and actuators have introduced new challenges in terms of data processing and sensor fusion. These smart structures are dynamically classified as a large-scale system with thousands of sensors and actuators that form the musculoskeletal of the structure, analogous to human body. In order to develop structural health monitoring and diagnostics with data provided by thousands of sensors, new sensor informatics has to be developed. The focus of our on-going research is to develop techniques and algorithms that would utilize this musculoskeletal system effectively; thus creating the intelligence for such a large-scale autonomous structure. To achieve this level of intelligence, three major research tasks are being conducted: development of a Bio-Inspired data analysis and information extraction from thousands of sensors; development of an analytical technique for Optimal Sensory System using Structural Observability; and creation of a bio-inspired decision-making and control system. This paper is focused on the results of our effort on the first task, namely development of a Neuro-Morphic Engineering approach, using a neuro-symbolic data manipulation, inspired by the understanding of human information processing architecture, for sensor fusion and structural diagnostics.

Application of Bayesian Statistical Analysis to Multisource Data Integration

  • Hong, Sa-Hyun;Moon, Wooil-M.
    • Proceedings of the KSRS Conference
    • /
    • 2002.10a
    • /
    • pp.394-399
    • /
    • 2002
  • In this paper, Multisource data classification methods based on Bayesian formula are considered. For this decision fusion scheme, the individual data sources are handled separately by statistical classification algorithms and then Bayesian fusion method is applied to integrate from the available data sources. This method includes the combination of each expert decisions where the weights of the individual experts represent the reliability of the sources. The reliability measure used in the statistical approach is common to all pixels in previous work. In this experiment, the weight factors have been assigned to have different value for all pixels in order to improve the integrated classification accuracies. Although most implementations of Bayesian classification approaches assume fixed a priori probabilities, we have used adaptive a priori probabilities by iteratively calculating the local a priori probabilities so as to maximize the posteriori probabilities. The effectiveness of the proposed method is at first demonstrated on simulations with artificial and evaluated in terms of real-world data sets. As a result, we have shown that Bayesian statistical fusion scheme performs well on multispectral data classification.

  • PDF

Performance Evaluation of Track-to-track Association and fusion in Distributed Multiple Radar Tracking (다중레이다 분산형 추적의 항적연관 및 융합 성능정가)

  • Choi, Won-Yong;Hong, Sun-Mog;Lee, Dong-Gwan;Jung, Jae-Kyung;Cho, Kil-Seok
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.11 no.6
    • /
    • pp.38-46
    • /
    • 2008
  • A distributed system for tracking multiple targets with a pair of multifunction radars is proposed and implemented. The system performs track-to-track association and track-to-track fusion at the fusion center to form fused tracks. The association and fusion are performed using target state information linked via communication nodes from a radar at a remote location. Many factors can affect the track-to-track association and fusion performances. They include delays in data transmission buffer of the remote radar, the error in estimating time-stamp of the remote radar, and the gating in track-to-track association. The effects on association and fusion performances due to these factors are investigated through extensive numerical simulations.

Incomplete Cholesky Decomposition based Kernel Cross Modal Factor Analysis for Audiovisual Continuous Dimensional Emotion Recognition

  • Li, Xia;Lu, Guanming;Yan, Jingjie;Li, Haibo;Zhang, Zhengyan;Sun, Ning;Xie, Shipeng
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.13 no.2
    • /
    • pp.810-831
    • /
    • 2019
  • Recently, continuous dimensional emotion recognition from audiovisual clues has attracted increasing attention in both theory and in practice. The large amount of data involved in the recognition processing decreases the efficiency of most bimodal information fusion algorithms. A novel algorithm, namely the incomplete Cholesky decomposition based kernel cross factor analysis (ICDKCFA), is presented and employed for continuous dimensional audiovisual emotion recognition, in this paper. After the ICDKCFA feature transformation, two basic fusion strategies, namely feature-level fusion and decision-level fusion, are explored to combine the transformed visual and audio features for emotion recognition. Finally, extensive experiments are conducted to evaluate the ICDKCFA approach on the AVEC 2016 Multimodal Affect Recognition Sub-Challenge dataset. The experimental results show that the ICDKCFA method has a higher speed than the original kernel cross factor analysis with the comparable performance. Moreover, the ICDKCFA method achieves a better performance than other common information fusion methods, such as the Canonical correlation analysis, kernel canonical correlation analysis and cross-modal factor analysis based fusion methods.

Operational Data Storage and Retrieval for KSTAR Large Scale Experimental Machine (대형 연구실험장치인 KSTAR에서 운전 데이터의 저장 및 추출)

  • Lee, Sangil;Kim, MK.;Baek, S.;Park, MK.;Lee, T.G.;Park, J.S.;Hong, J.
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2009.04a
    • /
    • pp.278-281
    • /
    • 2009
  • KSTAR(Korea Superconducting Tokamak Advanced Research)는 고성능 플라즈마 연구를 위한 대형 연구실험 장치이다. 이러한 거대 장치에는 많은 시스템이 분산되어 연결되어 있으며 그 구조 역시 매우 복잡하여 시스템간의 인터페이스에 많은 제약과 어려움이 따른다. 이러한 복잡하고 다양한 시스템을 통합하고 여기서 발생하는 여러 종류의 데이터를 획득하기 위해서 KSTAR는 EPICS(Experimental Physics and Industrial Control System)라는 오픈소스 기반의 분산 제어용 미들웨어를 구축하였고 이를 기반으로 KSTAR 통합 제어 시스템을 개발 하였다. 2008년 KSTAR 최초 플라즈마 실험 기간 동안의 운전을 통해 EPICS 미들웨어와 EPICS channel archiver를 이용하여 다양한 24시간 연속 운전데이터를 안정적으로 저장하고 추출할 수 있음을 확인하였다. 논문에서는 시스템의 구축 방법 및 운전결과에 대해 기술하고자 한다.

IKONOS Image Fusion Using a Fast Intensity-Hue-Saturation Fusion Technique (빠른 IHS 기법을 이용한 IKONOS 영상융합)

  • Yun, Kong-Hyun
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.14 no.1 s.35
    • /
    • pp.21-27
    • /
    • 2006
  • Among various image fusion methods, intensity-hue-saturation(IHS) technique is capable of quickly merging the massive volumes of data. For IKONOS imagery, IHS can yield satisfactory 'spatial' enhancement but may introduce 'spectral' distortion, appearing as a change in colors between compositions of resampled and fused multispectral bands. To solve this problem a fast IHS fusion technique with spectral adjustment is presented. The experimental results demonstrate that the proposed approach can provide better performance than the conventional IHS method, in both processing speed and image quality.

  • PDF