• Journal of Korea Multimedia Society
• /
• v.15 no.2
• /
• pp.195-203
• /
• 2012

This paper proposes ground target classification algorithm based on decision fusion and feature extraction method using multi-sensor images. The decisions obtained from the individual classifiers are fused by applying a weighted voting method to improve target recognition rate. For classifying the targets belong to the individual sensors images, features robust to scale and rotation are extracted using the difference of brightness of CM images obtained from CCD image and the boundary similarity and the width ratio between the vehicle body and turret of target in FLIR image. Finally, we verity the performance of proposed ground target classification algorithm and feature extraction method by the experimentation.

• Korean Journal of Remote Sensing
• /
• v.38 no.6_4
• /
• pp.1901-1910
• /
• 2022

Arriving in the new space age, securing technology for fusion application of KOMPSAT-3·3A and global satellite images is becoming more important. In general, multi-sensor satellite images have relative geometric errors due to various external factors at the time of acquisition, degrading the quality of the satellite image outputs. Therefore, we propose a fine-image registration methodology to minimize the relative geometric error between KOMPSAT-3·3A and global satellite images. After selecting the overlapping area between the KOMPSAT-3·3A and foreign satellite images, the spatial resolution between the two images is unified. Subsequently, tie-points are extracted using a hybrid matching method in which feature- and area-based matching methods are combined. Then, fine-image registration is performed through iterative registration based on pyramid images. To evaluate the performance and accuracy of the proposed method, we used KOMPSAT-3·3A, Sentinel-2A, and PlanetScope satellite images acquired over Daejeon city, South Korea. As a result, the average RMSE of the accuracy of the proposed method was derived as 1.2 and 3.59 pixels in Sentinel-2A and PlanetScope images, respectively. Consequently, it is considered that fine-image registration between multi-sensor satellite images can be effectively performed using the proposed method.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.3 no.4
• /
• pp.344-365
• /
• 2009

The performance of a tracking system is greatly increased if multiple types of sensors are combined to achieve the objective of the tracking instead of relying on single type of sensor. To conduct the multi-modal tracking, we have previously developed a multi-modal sensor-based tracking model where acoustic sensors mainly track the objects and visual sensors compensate the tracking errors [1]. In this paper, we find a network synchronization problem appearing in the developed tracking system. The problem is caused by the different location and traffic characteristics of multi-modal sensors and non-synchronized arrival of the captured sensor data at a processing server. To effectively deliver the sensor data, we propose a time-based packet aggregation algorithm where the acoustic sensor data are aggregated based on the sampling time and sent to the server. The delivered acoustic sensor data is then compensated by visual images to correct the tracking errors and such a compensation process improves the tracking accuracy in ideal case. However, in real situations, the tracking improvement from visual compensation can be severely degraded due to the aforementioned network synchronization problem, the impact of which is analyzed by simulations in this paper. To resolve the network synchronization problem, we differentiate the service level of sensor traffic based on Weight Round Robin (WRR) scheduling at the routers. The weighting factor allocated to each queue is calculated by a proposed Delay-based Weight Allocation (DWA) algorithm. From the simulations, we show the traffic differentiation model can mitigate the non-synchronization of sensor data. Finally, we analyze expected traffic behaviors of the tracking system in terms of acoustic sampling interval and visual image size.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.16 no.3
• /
• pp.1076-1094
• /
• 2022

Technology for emotion recognition is an essential part of human personality analysis. To define human personality characteristics, the existing method used the survey method. However, there are many cases where communication cannot make without considering emotions. Hence, emotional recognition technology is an essential element for communication but has also been adopted in many other fields. A person's emotions are revealed in various ways, typically including facial, speech, and biometric responses. Therefore, various methods can recognize emotions, e.g., images, voice signals, and physiological signals. Physiological signals are measured with biological sensors and analyzed to identify emotions. This study employed two sensor types. First, the existing method, the binary arousal-valence method, was subdivided into four levels to classify emotions in more detail. Then, based on the current techniques classified as High/Low, the model was further subdivided into multi-levels. Finally, signal characteristics were extracted using a 1-D Convolution Neural Network (CNN) and classified sixteen feelings. Although CNN was used to learn images in 2D, sensor data in 1D was used as the input in this paper. Finally, the proposed emotional recognition system was evaluated by measuring actual sensors.

• Proceedings of the Korean Society of Surveying, Geodesy, Photogrammetry, and Cartography Conference
• /
• 2007.04a
• /
• pp.145-148
• /
• 2007

The Korea Multi-Purpose Satellite-2 (KOMPSAT-2) was launched in July 2006 and The main mission of the KOMPSAT-2 is a high resolution imaging for the cartography of Korea peninsula by utilizing Multi Spectral Camera (MSC) images. The camera resolutions are 1 m in panchromatic scene and 4 m in multi-spectral imaging. KOMPSAT-2 measure the position, velocity and attitude data of satellite using by star sensor, gyro sensor, and GPS sensor. This paper provides an initial geometric accuracy assessment of the KOMPSAT-2 high resolution image, both geometric Cal/Val overview.

• Korean Journal of Remote Sensing
• /
• v.28 no.3
• /
• pp.319-327
• /
• 2012

In this paper, we introduce a newly developed photogrammetric software for automatic generation of high quality geo-products and its performance assessment carried out using various satellite images. Our newly developed software provides the latest techniques of an optimized sensor modelling, ortho-image generation and automated Digital Elevation Model (DEM) generation for diverse remote sensing images. In particular, images from dual- and multi-sensor images can be integrated for 3D mapping. This can be a novel innovation toward a wider applicability of remote sensing data, since 3D mapping has been limited within only single-sensor so far. We used Kompsat-2, Ikonos, QuickBird, Spot-5 high resolution satellite images to test an accuracy of 3D points and ortho-image generated by the software. Outputs were assessed by comparing reliable reference data. From various sensor combinations 3D mapping were implemented and their accuracy was evaluated using independent check points. Model accuracy of 1~2 pixels or better was achieved regardless of sensor combination type. The high resolution ortho-image results are consistent with the reference map on a scale of 1:5,000 after being rectified by the software and an accuracy of 1~2 pixels could be achieved through quantitative assessment. The developed software offers efficient critical geo-processing modules of various remote sensing images and it is expected that the software can be widely used to meet the demand on the high-quality geo products.

• Proceedings of the Korean Society of Surveying, Geodesy, Photogrammetry, and Cartography Conference
• /
• 2004.11a
• /
• pp.143-152
• /
• 2004

Researchers seeking geological and environmental information, depend on remote sensing and aerial photographic datum from various commercial satellites and aircraft. However, adverse weather conditions as well as equipment expense limit the ability to collect data anywhere and anytime. To allow for better flexibility in geological and environmental data collection, we have developed a compact, multi-spectral automatic Aerial Photographic system (PKNU2). This system's Multi-spectral camera can record visible (RGB) and infrared (NIR) band (3032＊2008 Pixels) images Visible and infrared band images were obtained from each camera respectively and produced color-infrared composite images to be analyzed for the purpose of the environmental monitoring. However this did not provide quality data. Furthermore, it has the disadvantage of having the stereoscopic overlap area being 60% unsatisfied due to the 12 seconds of storage time of each data The PKNU2 system in contrast, photographed photos of great capacity Thus, with such results, we have been proceeding to develop the advanced PKNU2 (PKNU3) system that consists of a color-infrared spectral camera that can photograph in the visible and near-infrared bands simultaneously using a single sensor, a thermal infrared camera, two 40G computers to store images, and an MPEG board that can compress and transfer data to the computer in real time as well as be able to be mounted onto a helicopter platform.

• Journal of the Korea Society of Computer and Information
• /
• v.17 no.6
• /
• pp.37-48
• /
• 2012

Image registration is a process to establish the spatial correspondence between the images of same scene, which are acquired at different view points, at different times, or by different sensors. In this paper, we propose an effective registration method for images acquired by multi-sensors, such as EO (electro-optic) and IR (infrared) sensors. Image registration is achieved by extracting features and finding the correspondence between features in each input images. In the recent research, the multi-sensor image registration method that finds corresponding features by exploiting NMI (Normalized Mutual Information) was proposed. Conventional NMI-based image registration methods assume that the statistical correlation between two images should be global, however images from EO and IR sensors often cannot satisfy this assumption. Therefore the registration performance of conventional method may not be sufficient for some practical applications because of the low accuracy of corresponding feature points. The proposed method improves the accuracy of corresponding feature points by combining the gradient orientation as spatial information along with NMI attributes and provides more accurate and robust registration performance. Representative experimental results prove the effectiveness of the proposed method.

• Korean Journal of Remote Sensing
• /
• v.34 no.6_3
• /
• pp.1351-1367
• /
• 2018

Image registration is an essential process for image fusion, change detection and time series analysis using multi-sensor images. For this purpose, we need to detect accurately the difference of scale and rotation between the multi-sensor images with difference spatial resolution. In this paper, we propose a new feature matching method using variable circular template for image registration between multi-resolution images. The proposed method creates a circular template at the center of a feature point in a coarse scale image and also a variable circular template in a fine scale image, respectively. After changing the scale of the variable circular template, we rotate the variable circular template by each predefined angle and compute the mutual information between the two circular templates and then find the scale, the angle of rotation and the center location of the variable circular template, respectively, in fine scale image when the mutual information between the two circular templates is maximum. The proposed method was tested using Kompsat-2, Kompsat-3 and Kompsat-3A images with different spatial resolution. The experimental results showed that the error of scale factor, the error of rotation angle and the localization error of the control point were less than 0.004, $0.3^{\circ}$ and one pixel, respectively.

• Korean Journal of Remote Sensing
• /
• v.30 no.1
• /
• pp.37-45
• /
• 2014

This paper reports the geolocation accuracy of KOMPSAT-3 imagery. KOMPSAT-3 was launched successfully on May 18, 2012 and has been released last March. In this paper, we have checked the geolocation accuracy of initial sensor model, precise sensor model and stereo-and multi-image model using four KOMPSAT-3 images covering the same area. The KOMPSAT-3 images without GCPs provided the geolocation accuracy of about 30m and the geocorrected KOMPSAT-3 images provided the geolocation accuracy of about 1m or less. KOMPSAT-3 stereo- and multi-images models yield threedimensional points with sub-meter accuracy in horizontal and vertical direction. Overall, KOMPSAT-3 showed much improved performance in terms of the geolocation accuracy over KOMPSAT-2. KOMPSAT-3 is expected to be able to replace foreign satellite data with sub-meter accuracy level for achieving accurate geometric information.