• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제13권6호
• /
• pp.3092-3107
• /
• 2019

Visible-infrared image fusion is a process of synthesizing an infrared image and a visible image into a fused image. This process synthesizes the complementary advantages of both images. The infrared image is able to capture a target object in dark or foggy environments. However, the utility of the infrared image is hindered by the blurry appearance of objects. On the other hand, the visible image clearly shows an object under normal lighting conditions, but it is not ideal in dark or foggy environments. In this paper, we propose a multi-guided filter and a real-time image fusion method. The proposed multi-guided filter is a modification of the guided filter for multiple guidance images. Using this filter, we propose a real-time image fusion method. The speed of the proposed fusion method is much faster than that of conventional image fusion methods. In an experiment, we compare the proposed method and the conventional methods in terms of quantity, quality, fusing speed, and flickering artifacts. The proposed method synthesizes 57.93 frames per second for an image size of $320{\times}270$. Based on our experiments, we confirmed that the proposed method is able to perform real-time processing. In addition, the proposed method synthesizes flicker-free video.

• 한국군사과학기술학회지
• /
• 제8권4호
• /
• pp.24-31
• /
• 2005

This paper presents an implementation of a real-time multi-sensor data fusion algorithm for Flight Test Computer. The sensor data consist of positional information of the target from a radar, a GPS receiver and an INS. The data fusion algorithm is designed by the 21st order distributed Kalman Filter which is based on the PVA model with sensor bias states. A fault detection and correction logics are included in the algorithm for bad measurements and sensor faults. The statistical parameters for the states are obtained from Monte Carlo simulations and covariance analysis using test tracking data. The designed filter is verified by using real data both in post processing and real-time processing.

• 전력전자학회:학술대회논문집
• /
• 전력전자학회 2019년도 추계학술대회
• /
• pp.128-129
• /
• 2019

ITER AC/DC Converter는 플라즈마 운전에서 기능적인 역할과 동작 모드에 따라 PF/CS, TF, CC Plant로 구분되어 동작하며 PF, CS, VS1 컨버터는 플라즈마 전류 발생, 증감, 형상제어, 위치제어를 하며 PCS(Plasma Control System), MRC(Master Controller)에 의해 제어된다. MRC는 상위 제어인 PCS와 LCC(Local Control Cubicle)의 Middle Ware Layer에서 여러 Linux Machine들과 복잡한 통신망으로 연결되어 초전도 코일 전류 Driver에 있어서 Control과 Soft Down을 위한 Real Time 제어 기능을 한다. 본 논문은 이러한 제어를 구현하기 위한 Linux Real Time Control Thread Design의 구성과 결과를 논의하고자 한다.

• 한국정보과학회논문지:데이타베이스
• /
• 제37권6호
• /
• pp.324-332
• /
• 2010

실시간 임베디드 센서 네트워크 시스템에서의 이벤트 감지는 대부분 현실세계에서 수집된 센서 데이터들의 조합에 기반한다. 이에 최근에 이루어진 연구들에선 센서 데이터들을 수집, 집계하는 낮은 수준의 다양한 메커니즘들을 제안하였다. 그러나 실시간에서 연속적으로 발생하는 복잡한 이벤트들의 감지와 다양한 종류의 센서들로부터 입력되는 실시간 데이터의 처리를 위한 시스템에 대한 솔루션은 보다 많은 연구를 필요로 한다. 즉, 경량의 데이터 혼합이 가능하고 많은 컴퓨팅 자원을 필요로 하지 않는 실시간 이벤트 감지 기법이 필요하다. 이벤트 감지 프레임워크는 실시간 모니터링과 센서 데이터의 도착으로 일어나는 데이터 융합 메커니즘을 통하여 적시성과 임베디드 센서 네트워크의 자원 요구량을 감소시킬 수 있는 잠재력을 지니고 있다. 또한 임베디드 센서 네트워크 시스템이 신뢰성을 지닐 수 있도록 하기 위한 기반 기술인 프라이버시를 보장할 수 있는 익명화 기술을 설명한다.

• 한국재난정보학회 논문집
• /
• 제5권2호
• /
• pp.40-48
• /
• 2009

DIS(Disaster Information System) is the information system supporting prevention, readiness, response, and recovery to disasters. DIS must monitor various disaster-related informations, keep various human resources and various material resources, and response real disasters. The conventional DISs are insufficient for integrated situation analysis, real-time report and operation, and utilizing the expertise of disaster personnels. In this study, the information-fusion based DIS framework is proposed for analysing various level informations, providing integrated situation informations and response plans, and processing real-time reports and operation according to field situations. The proposed DIS framework adopts information-fusion technologies and knowledge-based BRMS(Business Rule Management System).

• 한국인터넷방송통신학회논문지
• /
• 제23권4호
• /
• pp.79-84
• /
• 2023

최근 분산 및 병렬 처리 기술 중 빠른 처리 속도를 제공하는 Apache Spark는 실시간 기능 및 머신러닝 기능을 제공하고 있다. 이러한 기능에 대한 공식 문서 가이드가 제공되고 있지만, 기능들을 융합하여 실시간으로 특정 값을 예측하는 방안은 제공되고 있지 않다. 따라서 본 논문에서는 이러한 기능들을 융합하여 실시간으로 데이터의 값을 예측할 수 있는 연구를 진행했다. 전체적인 구성은 Python 프로그래밍 언어에서 제공하는 주가 데이터를 다운로드하여 수집한다. 그리고 머신러닝 기능을 통해 회귀분석의 모델을 생성하고, 실시간 스트리밍 기능을 머신러닝 기능과 융합하여 실시간으로 주가 데이터 중 조정종가를 예측한다.

• International Journal of Advanced Culture Technology
• /
• 제5권1호
• /
• pp.51-57
• /
• 2017

Digital signage is becoming part of daily life across a wide range of visual advertisements segments market used in stations, hotels, retail stores, hotels, etc. The current digital signage system used in market is generally works on limited user interactivity with static contents. In this paper, a new approach is proposed using computer vision based dynamic audience adaptive cost-effective digital signage system. The proposed design uses the Camera attached Raspberry Pi Open source platform to employ the real-time audience interaction using computer vision algorithms to extract facial features of the audience. The real-time facial features are extracted using Haar Cascade algorithm which are used for audience gender specific rendering of dynamic digital signage content. The audience facial characterization using Haar Cascade is evaluated on the FERET database with 95% accuracy for gender classification. The proposed system, developed and evaluated with male and female audiences in real-life environments camera embedded raspberry pi with good level of accuracy.

• 자동차안전학회지
• /
• 제13권4호
• /
• pp.7-13
• /
• 2021

This paper presents an vulnerable road user (VRU) classification and tracking algorithm using vision and LiDAR sensor fusion method for urban autonomous driving. The classification and tracking for vulnerable road users such as pedestrian, bicycle, and motorcycle are essential for autonomous driving in complex urban environments. In this paper, a real-time object image detection algorithm called Yolo and object tracking algorithm from LiDAR point cloud are fused in the high level. The proposed algorithm consists of four parts. First, the object bounding boxes on the pixel coordinate, which is obtained from YOLO, are transformed into the local coordinate of subject vehicle using the homography matrix. Second, a LiDAR point cloud is clustered based on Euclidean distance and the clusters are associated using GNN. In addition, the states of clusters including position, heading angle, velocity and acceleration information are estimated using geometric model free approach (GMFA) in real-time. Finally, the each LiDAR track is matched with a vision track using angle information of transformed vision track and assigned a classification id. The proposed fusion algorithm is evaluated via real vehicle test in the urban environment.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제14권10호
• /
• pp.3989-4006
• /
• 2020

The intelligent agriculture monitoring is based on the perception and analysis of environmental data, which enables the monitoring of the production environment and the control of environmental regulation equipment. As the scale of the application continues to expand, a large amount of data will be generated from the perception layer and uploaded to the cloud service, which will bring challenges of insufficient bandwidth and processing capacity. A fog-based offline and real-time hybrid data analysis architecture was proposed in this paper, which combines offline and real-time analysis to enable real-time data processing on resource-constrained IoT devices. Furthermore, we propose a data process-ing algorithm based on the incremental principal component analysis, which can achieve data dimensionality reduction and update of principal components. We also introduce the concept of Squared Prediction Error (SPE) value and realize the abnormal detection of data through the combination of SPE value and data fusion algorithm. To ensure the accuracy and effectiveness of the algorithm, we design a regular-SPE hybrid model update strategy, which enables the principal component to be updated on demand when data anomalies are found. In addition, this strategy can significantly reduce resource consumption growth due to the data analysis architectures. Practical datasets-based simulations have confirmed that the proposed algorithm can perform data fusion and exception processing in real-time on resource-constrained devices; Our model update strategy can reduce the overall system resource consumption while ensuring the accuracy of the algorithm.

• Smart Structures and Systems
• /
• 제17권6호
• /
• pp.903-915
• /
• 2016

The classical Kalman filter (KF) provides a practical and efficient state estimation approach for structural identification and vibration control. However, the classical KF approach is applicable only when external inputs are assumed known. Over the years, some approaches based on Kalman filter with unknown inputs (KF-UI) have been presented. However, these approaches based solely on acceleration measurements are inherently unstable which leads poor tracking and so-called drifts in the estimated unknown inputs and structural displacement in the presence of measurement noises. Either on-line regularization schemes or post signal processing is required to treat the drifts in the identification results, which prohibits the real-time identification of joint structural state and unknown inputs. In this paper, it is aimed to extend the classical KF approach to circumvent the above limitation for real time joint estimation of structural states and the unknown inputs. Based on the scheme of the classical KF, analytical recursive solutions of an improved Kalman filter with unknown excitations (KF-UI) are derived and presented. Moreover, data fusion of partially measured displacement and acceleration responses is used to prevent in real time the so-called drifts in the estimated structural state vector and unknown external inputs. The effectiveness and performance of the proposed approach are demonstrated by some numerical examples.