• Title/Summary/Keyword: Fusion Model

Search Result 952, Processing Time 0.029 seconds

The emotional evaluation of color pattern based on information fusion (정보융합 기법을 이용한 칼라 패턴의 감성 평가)

  • 김성환;엄경배;이준환
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2000.11a
    • /
    • pp.23-27
    • /
    • 2000
  • In this paper, we propose an emotional evaluation model based on information fusion. This model can transform the physical features of a color pattern to the emotional features. Our proposed model consists of the fuzzy logic system and neural network model. The evaluation values produced by them were fused. The model shows comparable performances to the neural network and fuzzy logic system for the approximation of the nonlinear transforms. We believe the evaluated results of a color pattern can be used to the emotion-based color image retrievals.

  • PDF

Multi-focus Image Fusion using Fully Convolutional Two-stream Network for Visual Sensors

  • Xu, Kaiping;Qin, Zheng;Wang, Guolong;Zhang, Huidi;Huang, Kai;Ye, Shuxiong
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.5
    • /
    • pp.2253-2272
    • /
    • 2018
  • We propose a deep learning method for multi-focus image fusion. Unlike most existing pixel-level fusion methods, either in spatial domain or in transform domain, our method directly learns an end-to-end fully convolutional two-stream network. The framework maps a pair of different focus images to a clean version, with a chain of convolutional layers, fusion layer and deconvolutional layers. Our deep fusion model has advantages of efficiency and robustness, yet demonstrates state-of-art fusion quality. We explore different parameter settings to achieve trade-offs between performance and speed. Moreover, the experiment results on our training dataset show that our network can achieve good performance with subjective visual perception and objective assessment metrics.

Applicability Evaluation of Spatio-Temporal Data Fusion Using Fine-scale Optical Satellite Image: A Study on Fusion of KOMPSAT-3A and Sentinel-2 Satellite Images (고해상도 광학 위성영상을 이용한 시공간 자료 융합의 적용성 평가: KOMPSAT-3A 및 Sentinel-2 위성영상의 융합 연구)

  • Kim, Yeseul;Lee, Kwang-Jae;Lee, Sun-Gu
    • Korean Journal of Remote Sensing
    • /
    • v.37 no.6_3
    • /
    • pp.1931-1942
    • /
    • 2021
  • As the utility of an optical satellite image with a high spatial resolution (i.e., fine-scale) has been emphasized, recently, various studies of the land surface monitoring using those have been widely carried out. However, the usefulness of fine-scale satellite images is limited because those are acquired at a low temporal resolution. To compensate for this limitation, the spatiotemporal data fusion can be applied to generate a synthetic image with a high spatio-temporal resolution by fusing multiple satellite images with different spatial and temporal resolutions. Since the spatio-temporal data fusion models have been developed for mid or low spatial resolution satellite images in the previous studies, it is necessary to evaluate the applicability of the developed models to the satellite images with a high spatial resolution. For this, this study evaluated the applicability of the developed spatio-temporal fusion models for KOMPSAT-3A and Sentinel-2 images. Here, an Enhanced Spatial and Temporal Adaptive Fusion Model (ESTARFM) and Spatial Time-series Geostatistical Deconvolution/Fusion Model (STGDFM), which use the different information for prediction, were applied. As a result of this study, it was found that the prediction performance of STGDFM, which combines temporally continuous reflectance values, was better than that of ESTARFM. Particularly, the prediction performance of STGDFM was significantly improved when it is difficult to simultaneously acquire KOMPSAT and Sentinel-2 images at a same date due to the low temporal resolution of KOMPSAT images. From the results of this study, it was confirmed that STGDFM, which has relatively better prediction performance by combining continuous temporal information, can compensate for the limitation to the low revisit time of fine-scale satellite images.

Multimodal Medical Image Fusion Based on Double-Layer Decomposer and Fine Structure Preservation Model (복층 분해기와 상세구조 보존모델에 기반한 다중모드 의료영상 융합)

  • Zhang, Yingmei;Lee, Hyo Jong
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.11 no.6
    • /
    • pp.185-192
    • /
    • 2022
  • Multimodal medical image fusion (MMIF) fuses two images containing different structural details generated in two different modes into a comprehensive image with saturated information, which can help doctors improve the accuracy of observation and treatment of patients' diseases. Therefore, a method based on double-layer decomposer and fine structure preservation model is proposed. Firstly, a double-layer decomposer is applied to decompose the source images into the energy layers and structure layers, which can preserve details well. Secondly, The structure layer is processed by combining the structure tensor operator (STO) and max-abs. As for the energy layers, a fine structure preservation model is proposed to guide the fusion, further improving the image quality. Finally, the fused image can be achieved by performing an addition operation between the two sub-fused images formed through the fusion rules. Experiments manifest that our method has excellent performance compared with several typical fusion methods.

Analysis and Optimization of Cooperative Spectrum Sensing with Noisy Decision Transmission

  • Liu, Quan;Gao, Jun;Guo, Yunwei;Liu, Siyang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.5 no.4
    • /
    • pp.649-664
    • /
    • 2011
  • Cooperative spectrum sensing (CSS) with decision fusion is considered as a key technology for tackling the challenges caused by fading/shadowing effects and noise uncertainty in spectrum sensing in cognitive radio. However, most existing solutions assume an error-free decision transmission, which is obviously not the case in realistic scenarios. This paper extends the general decision-fusion-based CSS scheme by considering the fading/shadowing effects and noise corruption in the common control channels. With this more practical model, the fusion centre first estimates the local decisions using a binary minimum error probability detector, and then combines them to get the final result. Theoretical analysis and simulation of this CSS scheme are performed over typical channels, which suggest some performance deterioration compared with the pure case that assumes an error-free decision transmission. Furthermore, the fusion strategy optimization in the proposed cooperation model is also investigated using the Bayesian criteria. The numerical results show that the total error rate of noisy CSS is higher than that of the pure case, and the optimal values of fusion parameter in the counting rule under both cases decrease as the local detection threshold increases.

A Multi Radar Fusion Algorithm for Reliable Maneuvering Target Tracking (신뢰성 있는 기동 항적 추적을 위한 다중 레이더 융합 알고리즘)

  • Cho, Tae-Hwan;Lee, Chang-Ho;Kim, Jin-Wook;Won, In-Su;Jo, Yun-Hyun;Park, Hyo-Dal;Choi, Sang-Bang
    • Journal of Advanced Navigation Technology
    • /
    • v.15 no.4
    • /
    • pp.487-494
    • /
    • 2011
  • Data Fusion algorithm is essential in Target Detection using radar, and it has more reliability. In this paper, Multi Radar Fusion algorithm using IMM(Interacting Multiple Model) filter is suggested. This well-known IMM filter has better performance than Kalman filter has. In this simulation, Distributed Data Fusion process was applied, and three sub-filters and one main filter were employed. In addition, this simulation was evaluated by virtual radar data which include constant velocity, constant accelerate, turn rate. The result of an evaluation shows better performance in the maneuvering section of aircraft.

A Study on the Fail Safety Logic of Smart Air Conditioner using Model based Design (모델 기반 설계 기법을 이용한 지능형 공조 장치의 이중 안전성 로직 연구)

  • Kim, Ji-Ho;Kim, Byeong-Woo
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.28 no.12
    • /
    • pp.1372-1378
    • /
    • 2011
  • The smart air condition system is superior to conventional air condition system in the aspect of control accuracy, environmental preservation and it is foundation for intelligent vehicle such as electric vehicle, fuel cell vehicle. In this paper, failure analyses of smart air condition system will be performed and then sensor fusion technique will be proposed for fail safety of smart air condition system. A sensor fusion logic of air condition system by using CO sensor, $CO_2$ sensor and VOC, $NO_x$ sensor will be developed and simulated by fault injection simulation. The fusion technology of smart air condition system is generated in an experiment and a performance analysis is conducted with fusion algorithms. The proposed algorithm adds the error characteristic of each sensor as a conditional probability value, and ensures greater accuracy by performing the track fusion with the sensors with the most reliable performance.

Virtual Environment Building and Navigation of Mobile Robot using Command Fusion and Fuzzy Inference

  • Jin, Taeseok
    • Journal of the Korean Society of Industry Convergence
    • /
    • v.22 no.4
    • /
    • pp.427-433
    • /
    • 2019
  • This paper propose a fuzzy inference model for map building and navigation for a mobile robot with an active camera, which is intelligently navigating to the goal location in unknown environments using sensor fusion, based on situational command using an active camera sensor. Active cameras provide a mobile robot with the capability to estimate and track feature images over a hallway field of view. In this paper, instead of using "physical sensor fusion" method which generates the trajectory of a robot based upon the environment model and sensory data. Command fusion method is used to govern the robot navigation. The navigation strategy is based on the combination of fuzzy rules tuned for both goal-approach and obstacle-avoidance. To identify the environments, a command fusion technique is introduced, where the sensory data of active camera sensor for navigation experiments are fused into the identification process. Navigation performance improves on that achieved using fuzzy inference alone and shows significant advantages over command fusion techniques. Experimental evidences are provided, demonstrating that the proposed method can be reliably used over a wide range of relative positions between the active camera and the feature images.

HQSAR Study of Tricyclic Azepine Derivatives as an EGFR (Epidermal Growth Factor Receptor) Inhibitors

  • Chung, Hwan-Won;Lee, Kyu-Whan;Oh, Jung-Soo;Cho, Seung-Joo
    • Molecular & Cellular Toxicology
    • /
    • v.3 no.3
    • /
    • pp.159-164
    • /
    • 2007
  • Stimulation of epidermal growth factor receptor (EGFR) is essential in signaling pathway of tumor cells. Thus, EGFR has intensely studied as an anticancer target. We developed hologram quantitative structure activity relationship (HQSAR) models for data set which consists of tricyclic azepine derivatives showing inhibitory activities for EGFR. The optimal HQSAR model was generated with fragment size of 6 to 7 while differentiating fragments having different atom and connectivity. The model showed cross-validated $q^2$ value of 0.61 and non-cross-validated $r^2$ value of 0.93. When the model was validated with an external set excluding one outlier, it gave predictive $r^2$ value of 0.43. The contribution maps generated from this model were used to interpret the atomic contribution of each atom to the overall inhibition activity. This can be used to find more efficient EGFR inhibitors.

Impact of Iron Scavenging and Desorption Parameters on Chlorophyll Simulation in the Tropical Pacific within NEMO-TOPAZ

  • Lee, Hyomee;Moon, Byung-Kwon;Park, Jong-Yeon;Kim, Han-Kyoung;Jung, Hyun-Chae;Wie, Jieun;Park, Hyo Jin;Byun, Young-Hwa;Lim, Yoon-Jin;Lee, Johan
    • Journal of the Korean earth science society
    • /
    • v.42 no.4
    • /
    • pp.390-400
    • /
    • 2021
  • Ocean biogeochemistry plays a crucial role in sustaining the marine ecosystem and global carbon cycle. To investigate the oceanic biogeochemical responses to iron parameters in the tropical Pacific, we conducted sensitivity experiments using the Nucleus for European Modelling of the Ocean-Tracers of Ocean Phytoplankton with Allometric Zooplankton (NEMO-TOPAZ) model. Compared to observations, the NEMO-TOPAZ model overestimated the concentrations of chlorophyll and dissolved iron (DFe). The sensitivity tests showed that with increasing (+50%) iron scavenging rates, chlorophyll concentrations in the tropical Pacific were reduced by approximately 16%. The bias in DFe also decreased by approximately 7%; however, the sea surface temperature was not affected. As such, these results can facilitate the development of the model tuning strategy to improve ocean biogeochemical performance using the NEMO-TOPAZ model.