• Journal of Institute of Control, Robotics and Systems
• /
• v.17 no.3
• /
• pp.229-235
• /
• 2011

To make a robust object tracking and identifying system for an intelligent robot and/or home system, heterogeneous sensor fusion between visible ray system and infrared ray system is proposed. The proposed system separates the object by combining the ROI (Region of Interest) estimated from two different images based on a heterogeneous sensor that consolidates the ordinary CCD camera and the IR (Infrared) camera. Human's body and face are detected in both images by using different algorithms, such as histogram, optical-flow, skin-color model and Haar model. Also the pose of human body is estimated from the result of body detection in IR image by using PCA algorithm along with AdaBoost algorithm. Then, the results from each detection algorithm are fused to extract the best detection result. To verify the heterogeneous sensor fusion system, few experiments were done in various environments. From the experimental results, the system seems to have good tracking and identification performance regardless of the environmental changes. The application area of the proposed system is not limited to robot or home system but the surveillance system and military system.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.21 no.6
• /
• pp.28-34
• /
• 2020

This paper proposes an approach to the fusion of two heterogeneous sensors with two different fields-of-view (FOV): LIDAR and an RGB camera. Registration between data captured by LIDAR and an RGB camera provided the fusion results. Registration was completed once a depthmap corresponding to a 2-dimensional RGB image was generated. For this fusion, RPLIDAR-A3 (manufactured by Slamtec) and a general digital camera were used to acquire depth and image data, respectively. LIDAR sensor provided distance information between the sensor and objects in a scene nearby the sensor, and an RGB camera provided a 2-dimensional image with color information. Fusion of 2D image and depth information enabled us to achieve better performance with applications of object detection and tracking. For instance, automatic driver assistance systems, robotics or other systems that require visual information processing might find the work in this paper useful. Since the LIDAR only provides depth value, processing and generation of a depthmap that corresponds to an RGB image is recommended. To validate the proposed approach, experimental results are provided.

• Proceedings of the KSRS Conference
• /
• 2005.10a
• /
• pp.505-508
• /
• 2005

Wavelet scheme can be applied to the various remote sensing problems: conventional multi-resolution image analysis, compression of large image sets, fusion of heterogeneous sensor image and segmentation of features. In this study, we attempted wavelet-based filtering and its analysis. Traditionally, statistical methods and adaptive filter are used to manipulate noises in the image processing procedure. While we tried to filter random noise from optical image and radar image using Discrete Wavelet Transform (DW1) and Stationary Wavelet Transform (SW1) and compared with existing methods such as median filter and adaptive filter. In result, SWT preserved boundaries and reduced noises most effectively. If appropriate thresholds are used, wavelet filtering will be applied to detect road boundaries, buildings, cars and other complex features from high-resolution imagery in an urban environment as well as noise filtering