• Journal of Auto-vehicle Safety Association
• /
• v.9 no.4
• /
• pp.32-37
• /
• 2017

For automated vehicles, the integrity and fault tolerance of environment perception sensor have been an important issue. This paper presents radar, vision, lidar(laser radar) fusion-based fault detection algorithm for autonomous vehicles. In this paper, characteristics of each sensor are shown. And the error of states of moving targets estimated by each sensor is analyzed to present the method to detect fault of environment sensors by characteristic of this error. Each estimation of moving targets isperformed by EKF/IMM method. To guarantee the reliability of fault detection algorithm of environment sensor, various driving data in several types of road is analyzed.

• Journal of Korea Multimedia Society
• /
• v.9 no.10
• /
• pp.1296-1303
• /
• 2006

The range-based method is easy to get the 3D data in detail, but the image-based is not. In this paper, I suggests the new approach to get the 3D data in detail from the magnified stereo image. Main idea is using the magnifying lens. The magnifying lens not only magnifies the object but also increases the depth resolution. The relation between the amplification of the disparity and the increase of the depth resolution is verified mathematically and the method to improve the original 3D data is suggested.

• Journal of Sensor Science and Technology
• /
• v.24 no.1
• /
• pp.54-61
• /
• 2015

In recent years, there has been increasing use of automatic surveillance and monitoring systems based on vision sensors. Humans are often the most important target in the systems, but processing human images is difficult due to the small sizes and flexible motions. Particularly, occlusion among pedestrians in camera images brings practical problems. In this paper, we propose a novel method to separate image regions of occluded pedestrians. A camera equipped with a wide angle lens is attached to the ceiling of a building corridor for sensing pedestrians with a wide field of view. The output images of the camera are processed for the human detection, tracking, identification, distortion correction, and occlusion handling. We resolve the occlusion problem adaptively depending on the angles and positions of their heads. Experimental results showed that the proposed method is more efficient and accurate compared with existing methods.

• Journal of Institute of Control, Robotics and Systems
• /
• v.22 no.8
• /
• pp.627-632
• /
• 2016

In this paper, we propose a new vision-based defect inspection system for the surface of hot slabs. To minimize the influence of self-emission from slab surfaces with high temperature, an optic method based on blue LED light and a blue pass filter is proposed. Because the slab surface is partially covered with scales, which are unavoidable oxidized substances caused during manufacturing, it is difficult to distinguish between vertical cracks and scale. In order to resolve this problem and to improve the detection performance, the use of a Gabor filter and dynamic programming are proposed. Finally, the effectiveness of the proposed method is shown by means of experiments conducted on images of hot slabs that were obtained from an actual slab production line.

• Structural Monitoring and Maintenance
• /
• v.5 no.1
• /
• pp.129-150
• /
• 2018

This paper presents the structural performance monitoring of an urban footbridge located in Hangzhou, China. The structural health monitoring (SHM) system is designed and implemented for the footbridge to monitor the structural responses of the footbridge and to ensure the structural safety during the period of operation. The monitoring data of stress and displacement measured by the fiber Bragg grating (FBG)-based sensors installed at the critical locations are used to analyze and assess the operation performance of the footbridge. A linear regression method is applied to separate the temperature effect from the stress monitoring data measured by the FBG-based strain sensors. In addition, the static vertical displacement of the footbridge measured by the FBG-based hydrostatic level gauges are presented and compared with the dynamic displacement remotely measured by a machine vision-based measurement system. Based on the examination of the monitored stress and displacement data, the structural safety evaluation is executed in combination with the defined condition index.

• Journal of the Computational Structural Engineering Institute of Korea
• /
• v.35 no.5
• /
• pp.259-266
• /
• 2022

In this study, we developed a deep learning and vision sensor-based assembly performance evaluation method isfor prefabricated steel structures. The assembly parts were segmented using a modified version of the receptive field block convolution module inspired by the eccentric function of the human visual system. The quality of the assembly was evaluated by detecting the bolt holes in the segmented assembly part and calculating the bolt hole positions. To validate the performance of the evaluation, models of standard and defective assembly parts were produced using a 3D printer. The assembly part segmentation network was trained based on the 3D model images captured from a vision sensor. The sbolt hole positions in the segmented assembly image were calculated using image processing techniques, and the assembly performance evaluation using the k-nearest neighbor algorithm was verified. The experimental results show that the assembly parts were segmented with high precision, and the assembly performance based on the positions of the bolt holes in the detected assembly part was evaluated with a classification error of less than 5%.

• Journal of the Ergonomics Society of Korea
• /
• v.29 no.6
• /
• pp.925-932
• /
• 2010

Most of the research on three-dimensional interaction field have showed different accuracy in terms of sensing, mode and method. Furthermore, implementation of interaction has been a lack of consistency in application field. Therefore, this study is to suggest research trends of three-dimensional interaction using meta-analysis. Searching relative keyword in database provided with 153 domestic papers and 188 international papers covering three-dimensional interaction. Analytical coding tables determined 18 domestic papers and 28 international papers for analysis. Frequency analysis was carried out on method of action, element, number, accuracy and then verified accuracy by effect size of the meta-analysis. As the results, the effect size of sensor-based was higher than vision-based, but the effect size was extracted to small as 0.02. The effect size of vision-based using hand motion was higher than sensor-based using hand motion. Therefore, implementation of three-dimensional sensor-based interaction and vision-based using hand motions more efficient. This study was significant to comprehensive analysis of three-dimensional motion recognition for interaction and suggest to application directions of three-dimensional interaction.

• Journal of the Institute of Electronics Engineers of Korea SC
• /
• v.48 no.3
• /
• pp.21-29
• /
• 2011

This paper presents a method that estimates distance and velocity of an object with reliability regardless of maneuver status of the target in stereo vision system. A stereo vision system can calculate a distance with disparity from left and right images. However, the distance estimation error may occur due to quantization error of image pixel. A sub-pixel interpolation method minimizes the quantization error and estimates accurate disparity with real value. Extended Kalman filter (EKF) was used to minimize the error covariance and estimate the object's velocity. However, divergence problem occurs due to model uncertainty when a target maneuvers highly, which makes the estimation error increase. In this paper, we propose a virtual model extended Kalman filter (VMEKF) method that minimizes the processing time and provides reliable estimation ability regardless of maneuver status. Computer simulations and experimental results in real road environments demonstrate that the proposed method gives a reliable estimation performance and reduces processing time under various maneuver status while comparing other estimation filters.

• Proceedings of the IEEK Conference
• /
• 2003.11a
• /
• pp.191-194
• /
• 2003

The recovery of 3D scene structure from multiple views has been long one of the central problems in computer vision. This paper presents a new projective reconstruction method based on factorization for un-calibrated image sequences. The proposed algorithm provides an effective measure to construct frame groups by using various information between frames. The experimental results show that the proposed method can reconstruct a more precise 3D structure than the precious methods such as the merging method.

• Journal of the Korean Society for Precision Engineering
• /
• v.28 no.9
• /
• pp.1094-1102
• /
• 2011

Recent trends for the miniaturization and weight reduction of portable electronic parts is the use of subminiature components. Assembly of the miniaturized components requires subminiature screws of which pitch sizes are in a micrometer scale. To produce such a subminiature screw with high precision threads, not only a precision forming technology but also high-precision measurement technique is required. In the present work, a vision inspection system is developed to measure the thread profile of a subminiature screw. Optical simulation based on a ray tracing method is used to design and analyze the optical system of the vision inspection apparatus. Through this simulation, optical performance of the developed vision inspection system is optimized. The image processing algorithm for the precision screw inspection is also discussed.