• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.13 no.6
• /
• pp.3092-3107
• /
• 2019

Visible-infrared image fusion is a process of synthesizing an infrared image and a visible image into a fused image. This process synthesizes the complementary advantages of both images. The infrared image is able to capture a target object in dark or foggy environments. However, the utility of the infrared image is hindered by the blurry appearance of objects. On the other hand, the visible image clearly shows an object under normal lighting conditions, but it is not ideal in dark or foggy environments. In this paper, we propose a multi-guided filter and a real-time image fusion method. The proposed multi-guided filter is a modification of the guided filter for multiple guidance images. Using this filter, we propose a real-time image fusion method. The speed of the proposed fusion method is much faster than that of conventional image fusion methods. In an experiment, we compare the proposed method and the conventional methods in terms of quantity, quality, fusing speed, and flickering artifacts. The proposed method synthesizes 57.93 frames per second for an image size of $320{\times}270$. Based on our experiments, we confirmed that the proposed method is able to perform real-time processing. In addition, the proposed method synthesizes flicker-free video.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.8 no.4 s.23
• /
• pp.24-31
• /
• 2005

This paper presents an implementation of a real-time multi-sensor data fusion algorithm for Flight Test Computer. The sensor data consist of positional information of the target from a radar, a GPS receiver and an INS. The data fusion algorithm is designed by the 21st order distributed Kalman Filter which is based on the PVA model with sensor bias states. A fault detection and correction logics are included in the algorithm for bad measurements and sensor faults. The statistical parameters for the states are obtained from Monte Carlo simulations and covariance analysis using test tracking data. The designed filter is verified by using real data both in post processing and real-time processing.

• Proceedings of the KIPE Conference
• /
• 2019.11a
• /
• pp.128-129
• /
• 2019

ITER AC/DC Converter는 플라즈마 운전에서 기능적인 역할과 동작 모드에 따라 PF/CS, TF, CC Plant로 구분되어 동작하며 PF, CS, VS1 컨버터는 플라즈마 전류 발생, 증감, 형상제어, 위치제어를 하며 PCS(Plasma Control System), MRC(Master Controller)에 의해 제어된다. MRC는 상위 제어인 PCS와 LCC(Local Control Cubicle)의 Middle Ware Layer에서 여러 Linux Machine들과 복잡한 통신망으로 연결되어 초전도 코일 전류 Driver에 있어서 Control과 Soft Down을 위한 Real Time 제어 기능을 한다. 본 논문은 이러한 제어를 구현하기 위한 Linux Real Time Control Thread Design의 구성과 결과를 논의하고자 한다.

• Journal of KIISE:Databases
• /
• v.37 no.6
• /
• pp.324-332
• /
• 2010

The majority of event detection in real-time embedded sensor network systems is based on data fusion that uses noisy sensor data collected from complicated real-world environments. Current research has produced several excellent low-level mechanisms to collect sensor data and perform aggregation. However, solutions that enable these systems to provide real-time data processing using readings from heterogeneous sensors and subsequently detect complex events of interest in real-time fashion need further research. We are developing real-time event detection approaches which allow light-weight data fusion and do not require significant computing resources. Underlying the event detection framework is a collection of real-time monitoring and fusion mechanisms that are invoked upon the arrival of sensor data. The combination of these mechanisms and the framework has the potential to significantly improve the timeliness and reduce the resource requirements of embedded sensor networks. In addition to that, we discuss about a privacy that is foundation technique for trusted embedded sensor network system and explain anonymization technique to ensure privacy.

• Journal of the Society of Disaster Information
• /
• v.5 no.2
• /
• pp.40-48
• /
• 2009

DIS(Disaster Information System) is the information system supporting prevention, readiness, response, and recovery to disasters. DIS must monitor various disaster-related informations, keep various human resources and various material resources, and response real disasters. The conventional DISs are insufficient for integrated situation analysis, real-time report and operation, and utilizing the expertise of disaster personnels. In this study, the information-fusion based DIS framework is proposed for analysing various level informations, providing integrated situation informations and response plans, and processing real-time reports and operation according to field situations. The proposed DIS framework adopts information-fusion technologies and knowledge-based BRMS(Business Rule Management System).

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.23 no.4
• /
• pp.79-84
• /
• 2023

Apache Spark, which provides the fastest processing speed among recent distributed and parallel processing technologies, provides real-time functions and machine learning functions. Although official documentation guides for these functions are provided, a method for fusion of functions to predict a specific value in real time is not provided. Therefore, in this paper, we conducted a study to predict the value of data in real time by fusion of these functions. The overall configuration is collected by downloading stock price data provided by the Python programming language. And it creates a model of regression analysis through the machine learning function, and predicts the adjusted closing price among the stock price data in real time by fusing the real-time streaming function with the machine learning function.

• International Journal of Advanced Culture Technology
• /
• v.5 no.1
• /
• pp.51-57
• /
• 2017

Digital signage is becoming part of daily life across a wide range of visual advertisements segments market used in stations, hotels, retail stores, hotels, etc. The current digital signage system used in market is generally works on limited user interactivity with static contents. In this paper, a new approach is proposed using computer vision based dynamic audience adaptive cost-effective digital signage system. The proposed design uses the Camera attached Raspberry Pi Open source platform to employ the real-time audience interaction using computer vision algorithms to extract facial features of the audience. The real-time facial features are extracted using Haar Cascade algorithm which are used for audience gender specific rendering of dynamic digital signage content. The audience facial characterization using Haar Cascade is evaluated on the FERET database with 95% accuracy for gender classification. The proposed system, developed and evaluated with male and female audiences in real-life environments camera embedded raspberry pi with good level of accuracy.

• Journal of Auto-vehicle Safety Association
• /
• v.13 no.4
• /
• pp.7-13
• /
• 2021

This paper presents an vulnerable road user (VRU) classification and tracking algorithm using vision and LiDAR sensor fusion method for urban autonomous driving. The classification and tracking for vulnerable road users such as pedestrian, bicycle, and motorcycle are essential for autonomous driving in complex urban environments. In this paper, a real-time object image detection algorithm called Yolo and object tracking algorithm from LiDAR point cloud are fused in the high level. The proposed algorithm consists of four parts. First, the object bounding boxes on the pixel coordinate, which is obtained from YOLO, are transformed into the local coordinate of subject vehicle using the homography matrix. Second, a LiDAR point cloud is clustered based on Euclidean distance and the clusters are associated using GNN. In addition, the states of clusters including position, heading angle, velocity and acceleration information are estimated using geometric model free approach (GMFA) in real-time. Finally, the each LiDAR track is matched with a vision track using angle information of transformed vision track and assigned a classification id. The proposed fusion algorithm is evaluated via real vehicle test in the urban environment.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.14 no.10
• /
• pp.3989-4006
• /
• 2020

The intelligent agriculture monitoring is based on the perception and analysis of environmental data, which enables the monitoring of the production environment and the control of environmental regulation equipment. As the scale of the application continues to expand, a large amount of data will be generated from the perception layer and uploaded to the cloud service, which will bring challenges of insufficient bandwidth and processing capacity. A fog-based offline and real-time hybrid data analysis architecture was proposed in this paper, which combines offline and real-time analysis to enable real-time data processing on resource-constrained IoT devices. Furthermore, we propose a data process-ing algorithm based on the incremental principal component analysis, which can achieve data dimensionality reduction and update of principal components. We also introduce the concept of Squared Prediction Error (SPE) value and realize the abnormal detection of data through the combination of SPE value and data fusion algorithm. To ensure the accuracy and effectiveness of the algorithm, we design a regular-SPE hybrid model update strategy, which enables the principal component to be updated on demand when data anomalies are found. In addition, this strategy can significantly reduce resource consumption growth due to the data analysis architectures. Practical datasets-based simulations have confirmed that the proposed algorithm can perform data fusion and exception processing in real-time on resource-constrained devices; Our model update strategy can reduce the overall system resource consumption while ensuring the accuracy of the algorithm.

• Smart Structures and Systems
• /
• v.17 no.6
• /
• pp.903-915
• /
• 2016

The classical Kalman filter (KF) provides a practical and efficient state estimation approach for structural identification and vibration control. However, the classical KF approach is applicable only when external inputs are assumed known. Over the years, some approaches based on Kalman filter with unknown inputs (KF-UI) have been presented. However, these approaches based solely on acceleration measurements are inherently unstable which leads poor tracking and so-called drifts in the estimated unknown inputs and structural displacement in the presence of measurement noises. Either on-line regularization schemes or post signal processing is required to treat the drifts in the identification results, which prohibits the real-time identification of joint structural state and unknown inputs. In this paper, it is aimed to extend the classical KF approach to circumvent the above limitation for real time joint estimation of structural states and the unknown inputs. Based on the scheme of the classical KF, analytical recursive solutions of an improved Kalman filter with unknown excitations (KF-UI) are derived and presented. Moreover, data fusion of partially measured displacement and acceleration responses is used to prevent in real time the so-called drifts in the estimated structural state vector and unknown external inputs. The effectiveness and performance of the proposed approach are demonstrated by some numerical examples.