• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제12권5호
• /
• pp.2253-2272
• /
• 2018

We propose a deep learning method for multi-focus image fusion. Unlike most existing pixel-level fusion methods, either in spatial domain or in transform domain, our method directly learns an end-to-end fully convolutional two-stream network. The framework maps a pair of different focus images to a clean version, with a chain of convolutional layers, fusion layer and deconvolutional layers. Our deep fusion model has advantages of efficiency and robustness, yet demonstrates state-of-art fusion quality. We explore different parameter settings to achieve trade-offs between performance and speed. Moreover, the experiment results on our training dataset show that our network can achieve good performance with subjective visual perception and objective assessment metrics.

• 센서학회지
• /
• 제26권1호
• /
• pp.1-6
• /
• 2017

The advanced driver assistant system (ADAS) requires the collection of a large amount of information including road conditions, environment, vehicle status, condition of the driver, and other useful data. In this regard, large-scale sensor networks can be an appropriate solution since they have been designed for this purpose. Recent advances in sensor network technology have enabled the management and monitoring of large-scale tasks such as the monitoring of road surface temperature on a highway. In this paper, we consider the estimation and fusion problems of the large-scale sensor networks used in the ADAS. Hierarchical fusion architecture is proposed for an arbitrary topology of the large-scale sensor network. A robust cluster estimator is proposed to achieve robustness of the network against outliers or failure of sensors. Lastly, a robust hierarchical data fusion scheme is proposed for the communication channel between the clusters and fusion center, considering the non-Gaussian channel noise, which is typical in communication systems.

• 한국통계학회:학술대회논문집
• /
• 한국통계학회 2003년도 춘계 학술발표회 논문집
• /
• pp.237-242
• /
• 2003

Various kinds of estimation methods have been developed for imputation of categorical missing data. They include modal category method, logistic regression, and association rule. In this study, we propose two imputation methods (neural network fusion and voting fusion) that combine the results of individual imputation methods. A Monte-Carlo simulation is used to compare the performance of these methods. Five factors used to simulate the missing data are (1) true model for the data, (2) data size, (3) noise size (4) percentage of missing data, and (5) missing pattern. Overall, neural network fusion performed the best while voting fusion is better than the individual imputation methods, although it was inferior to the neural network fusion. Result of an additional real data analysis confirms the simulation result.

• 정보처리학회논문지C
• /
• 제16C권1호
• /
• pp.83-90
• /
• 2009

무선 센서 네트워크(Wireless Sensor Network : WSN)는 자율적으로 라우팅 경로를 구성하여 물리적으로 떨어진 지역의 데이터를 수집하는 무선망이다. 본 논문은 주기적으로 수집한 모든 데이터를 하나의 기지 노드로 전달하는 convergecast 환경에서 퓨전(fusion)을 반영한 라우팅 방법을 제안한다. 지금까지 대부분의 연구는 무퓨전(no-fusion)과 전퓨전(full-fusion)의 두 경우만을 다루었다. 제안하는 Fusion rate based Spanning Tree(FST)는 임의의 퓨전율 f ($0{\leq}f{\leq}1$)에서 총 전송 에너지 비용을 줄이는 라우팅 경로를 제공 한다. FST는 무퓨전(f = 0)과 전퓨전(f = 1)의 convergecast에서 각각 최적의 토폴로지인 최소 경로 트리(Shortest Path spanning Tree : SPT)와 최소 스패닝 트리(Minimum Spanning Tree : MST)를 제공하며, 임의의 f (0 < f < 1)에 대해서도 SPT나 MST보다 우수한 토폴로지를 제공한다. 시뮬레이션은 100-노드 WSN에서 모든 f ($0{\leq}f{\leq}1$)에 대해 FST의 총 길이가 평균적으로 MST보다 약 31%, SPT보다 약 8% 절약 됨을 보여준다. 따라서 우리는 FST가 WSN에서 매우 유용한 토폴로지임을 확인하였다.

• 한국군사과학기술학회지
• /
• 제15권2호
• /
• pp.147-154
• /
• 2012

In this paper, we revise the JDL data fusion model to have an ability of distributed data fusion(DDF). Data fusion is a function that produces valuable information using data from multiple sources. After the network centric warfare concept was introduced, the data fusion was required to be expanded to DDF. We identify the data transfer and control between nodes is the core function of DDF. The previous data fusion models can not be used for DDF because they don't include that function. Therefore, we revise the previous JDL data fusion model by adding the core function of DDF and propose this new model as a model for DDF. We show that our model is adequate and useful for DDF by using several examples.

• 한국공작기계학회논문집
• /
• 제17권1호
• /
• pp.77-85
• /
• 2008

The objective of the study is to construct a sensor fusion system for tool-condition monitoring (TCM) that will lead to a more efficient and economical drill usage. Drill-wear monitoring has an important attribute in the automatic machining processes as it can help preventing the damage of tools and workpieces, and optimizing the drill usage. In this study, we present the architectures of a multi-layer feed-forward neural network with Levenberg-Marquardt training algorithm based on sensor fusion for the monitoring of drill-wear condition. The input features to the neural networks were extracted from AE, vibration and current signals using the wavelet packet transform (WPT) analysis. Training and testing were performed at a moderate range of cutting conditions in the dry drilling of steel plates. The results show good performance in drill- wear monitoring by the proposed method of sensor fusion and neural network analysis.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 2003년도 ICCAS
• /
• pp.2461-2466
• /
• 2003

This paper presents a simple sensor fusion algorithm using neural network for navigation of mobile robots with obstacle avoidance and trap recovery. The multiple sensors input sensor data to the input layer of neural network activating the input nodes. The multiple sensors used include optical encoders, ultrasonic sensors, infrared sensors, a magnetic compass sensor, and GPS sensors. The proposed sensor fusion algorithm is combined with the VFH(Vector Field Histogram) algorithm for obstacle avoidance and AGPM(Adaptive Goal Perturbation Method) which sets adaptive virtual goals to escape trap situations. The experiment results show that the proposed low-level fusion algorithm is effective for real-time navigation of mobile robot.

• 한국국방경영분석학회지
• /
• 제34권3호
• /
• pp.79-92
• /
• 2008

본 논문은 최근 개발되는 헬기의 생존성 보장을 위하여 장착되는 센서체계에서 상호 독립적으로 수집된 센서 데이터의 융합 알고리즘 개발을 위하여 다양한 지식 기반의 데이터 융합 기법 등을 검토하였다. 이 논문에서는 다양한 데이터 융합기법 중에서 헬기 생존 계통 센서 체계의 데이터 응함에 유효한 대안이 될 수 있는 Bayesian Network를 이용한 지식 기반의 데이터 융합 기법 알고리즘을 설계하고 구현하였다.

• 한국정보처리학회:학술대회논문집
• /
• 한국정보처리학회 2023년도 춘계학술발표대회
• /
• pp.493-495
• /
• 2023

Deep learning methods and attention mechanisms have been incorporated to improve facial emotion recognition, which has recently attracted much attention. The fusion approaches have improved accuracy by combining various types of information. This research proposes a fusion network with self-attention and local attention mechanisms. It uses a multi-layer perceptron network. The network extracts distinguishing characteristics from facial images using pre-trained models on RAF-DB dataset. We outperform the other fusion methods on RAD-DB dataset with impressive results.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제15권5호
• /
• pp.1761-1777
• /
• 2021

An image with infrared features and visible details is obtained by processing infrared and visible images. In this paper, a fusion method based on Laplacian pyramid and generative adversarial network is proposed to obtain high quality fusion images, termed as Laplacian-GAN. Firstly, the base and detail layers are obtained by decomposing the source images. Secondly, we utilize the Laplacian pyramid-based method to fuse these base layers to obtain more information of the base layer. Thirdly, the detail part is fused by a generative adversarial network. In addition, generative adversarial network avoids the manual design complicated fusion rules. Finally, the fused base layer and fused detail layer are reconstructed to obtain the fused image. Experimental results demonstrate that the proposed method can obtain state-of-the-art fusion performance in both visual quality and objective assessment. In terms of visual observation, the fusion image obtained by Laplacian-GAN algorithm in this paper is clearer in detail. At the same time, in the six metrics of MI, AG, EI, MS_SSIM, Q_abf and SCD, the algorithm presented in this paper has improved by 0.62%, 7.10%, 14.53%, 12.18%, 34.33% and 12.23%, respectively, compared with the best of the other three algorithms.