• Journal of the Korea institute for structural maintenance and inspection
• /
• v.28 no.3
• /
• pp.74-82
• /
• 2024

In this study, feature point detection and displacement measurement performance depending on feature extraction algorithms were compared and analyzed according to environmental changes and target types in the feature point-based displacement measurement algorithm. A three-story frame structure was designed for performance evaluation, and the displacement response of the structure was digitized into FHD (1920×1080) resolution. For performance analysis, the initial measurement distance was set to 10m, and increased up to 40m with an increment of 10m. During the experiments, illuminance was fixed to 450lux or 120lux. The artificial and natural targets mounted on the structure were set as regions of interest and used for feature point detection. Various feature detection algorithms were implemented for performance comparisons. As a result of the feature point detection performance analysis, the Shi-Tomasi corner and KAZE algorithm were found that they were robust to the target type, illuminance change, and increase in measurement distance. The displacement measurement accuracy using those two algorithms was also the highest. However, when using natural targets, the displacement measurement accuracy is lower than that of artificial targets. This indicated the limitation in extracting feature points as the resolution of the natural target decreased as the measurement distance increased.

• Smart Structures and Systems
• /
• v.5 no.4
• /
• pp.469-482
• /
• 2009

The emerging sensor-based structural health monitoring (SHM) technology has a potential for cost-effective maintenance of aging civil infrastructure systems. The author proposes to integrate continuous and global monitoring using on-structure sensors with targeted local non-destructive evaluation (NDE). Significant technical challenges arise, however, from the lack of cost-effective sensors for monitoring spatially large structures, as well as reliable methods for interpreting sensor data into structural health conditions. This paper reviews recent efforts and advances made in addressing these challenges, with example sensor hardware and health monitoring software developed in the author's research center. The hardware includes a novel fiber optic accelerometer, a vision-based displacement sensor, a distributed strain sensor, and a microwave imaging NDE device. The health monitoring software includes a number of system identification methods such as the neural networks, extended Kalman filter, and nonlinear damping identificaiton based on structural dynamic response measurement. These methods have been experimentally validated through seismic shaking table tests of a realistic bridge model and tested in a number of instrumented bridges and buildings.

• Journal of Institute of Control, Robotics and Systems
• /
• v.20 no.2
• /
• pp.218-222
• /
• 2014

In this paper, we introduce an autonomous calibration method for a 2D laser displacement sensor (e.g. laser vision sensor and laser range finder) by matching a single point on a flat structure. Many arc welding robots install a 2D laser displacement sensor to expand their application by recognizing their environment (e.g. base metal and seam). In such systems, sensing data should be transformed to the robot's coordinates, and the geometric relation (i.e. rotation and translation) between the robot's coordinates and sensor coordinates should be known for the transformation. Calibration means the inference process of geometric relation between the sensor and robot. Generally, the matching of more than 3 points is required to infer the geometric relation. However, we introduce a novel method to calibrate using only 1 point matching and use a specific flat structure (i.e. circular hole) which enables us to find the geometric relation with a single point matching. We make the rotation component of the calibration results as a constant to use only a single point by moving a robot to a specific pose. The flat structure can be installed easily in a manufacturing site, because the structure does not have a volume (i.e. almost 2D structure). The calibration process is fully autonomous and does not need any manual operation. A robot which installed the sensor moves to the specific pose by sensing features of the circular hole such as length of chord and center position of the chord. We show the precision of the proposed method by performing repetitive experiments in various situations. Furthermore, we applied the result of the proposed method to sensor based seam tracking with a robot, and report the difference of the robot's TCP (Tool Center Point) trajectory. This experiment shows that the proposed method ensures precision.

• Smart Structures and Systems
• /
• v.15 no.2
• /
• pp.335-353
• /
• 2015

Previous long-term measurements of the Uldolmok tidal current power plant showed that the structure's natural frequencies fluctuate with a constant cycle-i.e., twice a day with changes in tidal height and tidal current velocity. This study aims to improve structural health monitoring (SHM) techniques for offshore structures under a harsh tidal environment like the Uldolmok Strait. In this study, lab-scale experiments on a simplified offshore structure as a lab-scale test structure were conducted in a circulating water channel to thoroughly investigate the causes of fluctuation of the natural frequencies and to validate the displacement estimation method using multimetric data fusion. To this end, the numerical study was additionally carried out on the simplified offshore structure with damage scenarios, and the corresponding change in the natural frequency was analyzed to support the experimental results. In conclusion, (1) the damage that occurred at the foundation resulted in a more significant change in natural frequencies compared with the effect of added mass; moreover, the structural system became nonlinear when the damage was severe; (2) the proposed damage index was able to indicate an approximate level of damage and the nonlinearity of the lab-scale test structure; (3) displacement estimation using data fusion was valid compared with the reference displacement using the vision-based method.

• Journal of Computing Science and Engineering
• /
• v.11 no.3
• /
• pp.79-91
• /
• 2017

In this paper, the abdominal-deformation measurement scheme is conducted on a shape-flexible mannequin using the DIC technique in a stereo-vision system. Firstly, during the integer-pixel displacement search, a novel fractal dimension based on an adaptive-ellipse subset area is developed to track an integer pixel between the reference and deformed images. Secondly, at the subpixel registration, a new mutual-learning adaptive particle swarm optimization (MLADPSO) algorithm is employed to locate the subpixel precisely. Dynamic adjustments of the particle flight velocities that are according to the deformation extent of each interest point are utilized for enhancing the accuracy of the subpixel registration. A test is performed on the abdominal-deformation measurement of the shape-flexible mannequin. The experiment results indicate that under the guarantee of its measurement accuracy without the cause of any loss, the time-consumption of the proposed scheme is significantly more efficient than that of the conventional method, particularly in the case of a large number of interest points.

• The Journal of the Korea Contents Association
• /
• v.9 no.7
• /
• pp.159-170
• /
• 2009

It is very important to extract the expression data and capture a face image from a video for online-based 3D face animation. In recently, there are many researches on vision-based approach that captures the expression of an actor in a video and applies them to 3D face model. In this paper, we propose an automatic data extraction system, which extracts and traces a face and expression data from realtime video inputs. The procedures of our system consist of three steps: face detection, face feature extraction, and face tracing. In face detection, we detect skin pixels using YCbCr skin color model and verifies the face area using Haar-based classifier. We use the brightness and color information for extracting the eyes and lips data related facial expression. We extract 10 feature points from eyes and lips area considering FAP defined in MPEG-4. Then, we trace the displacement of the extracted features from continuous frames using color probabilistic distribution model. The experiments showed that our system could trace the expression data to about 8fps.

• Journal of the Korean Society for Precision Engineering
• /
• v.27 no.1
• /
• pp.125-133
• /
• 2010

A versatile micro-robotic platform for micro/nano scale assembly has been demanded in a variety of application areas such as micro-biology and nanotechnology. In the near future, a flexible and compact platform could be effectively used in a scanning electron microscope chamber. We are developing a platform that consists of miniature mobile robots and a compact positioning stage with multi degree-of-freedom. This paper presents the design and the implementation of a low-cost and compact multi degree of freedom position sensor that is capable of measuring absolute translational and rotational displacement. The proposed sensor is implemented by using a CMOS type image sensor and a target with specific hole patterns. Experimental design based on statistics was applied to finding optimal design of the target. Efficient algorithms for image processing and absolute position decoding are discussed. Simple calibration to eliminate the influence of inaccuracy of the fabricated target on the measuring performance also presented. The developed sensor was characterized by using a laser interferometer. It can be concluded that the sensor system has submicron resolution and accuracy of ${\pm}4{\mu}m$ over full travel range. The proposed vision-based sensor is cost-effective and used as a compact feedback device for implementation of a micro robotic platform.

• Journal of the Korea institute for structural maintenance and inspection
• /
• v.23 no.7
• /
• pp.87-94
• /
• 2019

Recently, the advance of accurate dynamic displacement measurement devices, such as GPS, computer vision, and optic laser sensor, has enhanced the structural monitoring technology. In this study, the dynamic displacement data was used to verify the applicability of the structural physical parameter estimation method through subspace system identification. The subspace system identification theory for estimating state-space model from measured data and physics-based interpretation for deriving the physical parameter of the estimated system are presented. Three-degree-freedom steel structures were fabricated for the experimental verification of the theory in this study. Laser displacement sensor and accelerometer were used to measure the displacement data of each floor and the acceleration data of the shaking table. Discrete state-space model generated from measured data was verified for precision. The discrete state-space model generated from the measured data extracted the floor stiffness of the building after accuracy verification. In addition, based on the story stiffness extracted from the state space model, five column stiffening and damage samples were set up to extract the change rate of story stiffness for each sample. As a result, in case of reinforcement and damage under the same condition, the stiffness change showed a high matching rate.

• Explosives and Blasting
• /
• v.38 no.2
• /
• pp.1-12
• /
• 2020

Digital Image Correlation is a well-established method for displacements, strains and shape measurements of engineering objects. Stereo-camera 3D Digital Image Correlation (3D-DIC) systems have been developed to match the specific requirements for measurements posed by material and mechanical industries. Although DIC method provides the capabilities of scaling a field-of-view(FOV), dimensions of Geotechnical structure objects in many cases are too big to be measured with DIC based on a single camera pair. It can be the most important issue with applying 3D DIC to the measurement of Geotechnical structures. In this paper, We were present stereo vision conditions in a 3D DIC system that can be measured for large FOV(30×20m) and high precisions(z-displacement 0.5mm) of the ground objects with Stereo-camera DIC systems.

• 제어로봇시스템학회:학술대회논문집
• /
• 1997.10a
• /
• pp.1617-1620
• /
• 1997

This paper describes the camera caliberation based-neural network with a camera modeling that accounts for major sources of camera distortion, namely, radial, decentering, and thin prism distortion. Radial distoriton causes an inward or outward displacement of a given image point from its ideal location. Actual optical systems are subject to various degrees of decentering, that is the optical centers of lens elements are not strictly collinear. Thin prism distortion arises from imperfection in lens design and manufacturing as well as camera assembly. It is our purpose to develop the vision system for the pattern recognition and the automatic test of parts and to apply the line of manufacturing. The performance of proposed camera aclibration is illustrated by simulation and experiment.