• Journal of Welding and Joining
• /
• v.8 no.2
• /
• pp.58-69
• /
• 1990

In conventional arc welding, position error of the weld torch with respect to the weld seam and variation of groove dimension are induced by inaccurate fitup and fixturing. In this study, a vision system has been developed to recognize and compensate the position error and dimensional inaccuracy. The system uses a structured laser light illuminated on the weld groove and perceived by a C.C.D camera. A new algorithm to detect the edge of the reflected laser light is introduced for real time processing. The developed system was applied to arbitarary weld paths with various types of joint in arc welding process. The experimental results show that the proposed system can detect the weld groove parameters within good accuracy and yield good tracking performance.

• Journal of Sensor Science and Technology
• /
• v.14 no.2
• /
• pp.109-115
• /
• 2005

Calibration is a prerequisite procedure for employing a camera as a 3D sensor in an automated machines like robots. As accurate sensing is possible only when the vision sensor is calibrated accurately, many different approaches and models have been proposed for increasing calibration accuracy. Particularly an important factor which greatly affects the calibration accuracy is the nonlinearity in the mapping between 3D world and corresponding 2D image. In this paper GMDH algorithm is used to learn the nonlinearity without physical modelling. The technique proposed can be effective in various situations where the levels of noises and characteristics of nonlinear distortion are different. In simulations and an experiment, the proposed technique showed good and reliable results.

• Journal of Sensor Science and Technology
• /
• v.32 no.5
• /
• pp.320-327
• /
• 2023

In this study, an FPGA-based sealer inspection system was developed to inspect the sealer applied to install vehicle glass on a car body. The sealer is a liquid or paste-like material that promotes adhesion such as sealing and waterproofing for mounting and assembling vehicle parts to a car body. The system installed in the existing vehicle design parts line does not detect the sealer in the glass rotation section and takes a long time to process. This study developed a line laser camera sensor and an FPGA vision signal processing module to solve this problem. The line laser camera sensor was developed such that the resolution and speed of the camera for data acquisition could be modified according to the irradiation angle of the laser. Furthermore, it was developed considering the mountability of the entire system to prevent interference with the sealer ejection machine. In addition, a vision signal processing module was developed using the Zynq-7020 FPGA chip to improve the processing speed of the algorithm that converted the profile to the sealer shape image acquired from a 2D camera and calculated the width and height of the sealer using the converted profile. The performance of the developed sealer application inspection system was verified by establishing an experimental environment identical to that of an actual automobile production line. The experimental results confirmed the performance of the sealer application inspection at a level that satisfied the requirements of automotive field standards.

• Transactions of the Korean Society of Mechanical Engineers A
• /
• v.41 no.10
• /
• pp.949-957
• /
• 2017

A laser-vision-based height measurement system is developed and implemented for the inspection of two-step variable valve lift module assemblies. The proposed laser-vision sensor module is designed based on the principle of laser triangulation. This paper summarizes the work on 3D point cloud data collection and height difference measurements. The configuration of the measurement system and the proposed height measurement algorithm are described and analyzed in detail. Additional measurement experiments on the height differences of valves and lash adjusters of a two-step variable valve lift module were implemented repeatedly to evaluate the accuracy and repeatability of the proposed measurement system. Experimental results show that the proposed laser-vision-based height measurement system achieves high accuracy, repeatability, and stabilization for the inspection of two-step variable valve lift module assemblies.

• Journal of Electrical Engineering and Technology
• /
• v.9 no.6
• /
• pp.2162-2167
• /
• 2014

Robots are widely used in various automation processes in industrial applications. Traditionally, it operated under fixed condition by teaching operating positions. Recently, diverse 2D/3D sensors are used together with robot to give more flexibility in operation. In this paper, we deal with automatic manipulation of tie rod in automotive production line. Sensor system consisted of a camera and slit laser is used for the acquisition of 3D information and it is used attached on the robot. Nut runner is used for the manipulation of stop nut and adjust bolt on the tie rod. Detailed procedures for the automatic manipulation of tie rod are presented. In the presented approach, we effectively use 3D information in whole procedure such as computing distance to the tie rod, rotation angle of bolt and nut. Experimental results show the feasibility of the proposed algorithm.

• Journal of the Computational Structural Engineering Institute of Korea
• /
• v.37 no.3
• /
• pp.173-178
• /
• 2024

This study presents a technique for assessing the dimensional quality of assembly parts in Prefabricated Steel Structures (PSS) using a stereo vision sensor. The stereo vision system captures images and point cloud data of the assembly area, followed by applying image processing algorithms such as fuzzy-based edge detection and Hough transform-based circular bolt hole detection to identify bolt hole locations. The 3D center positions of each bolt hole are determined by correlating 3D real-world position information from depth images with the extracted bolt hole positions. Principal Component Analysis (PCA) is then employed to calculate coordinate axes for precise measurement of distances between bolt holes, even when the sensor and structure orientations differ. Bolt holes are sorted based on their 2D positions, and the distances between sorted bolt holes are calculated to assess the assembly part's dimensional quality. Comparison with actual drawing data confirms measurement accuracy with an absolute error of 1mm and a relative error within 4% based on median criteria.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.17 no.5
• /
• pp.933-940
• /
• 2022

In this paper, the algorithm was developed to recognize hand 3D position through 2D image sensor and implemented a system to remotely control the 6 d.o.f. robot arm by using it. The system consists of a camera that acquires hand position in 2D, a computer that controls robot arm that performs movement by hand position recognition. The image sensor recognizes the specific color of the glove putting on operator's hand and outputs the recognized range and position by including the color area of the glove as a shape of rectangle. We recognize the velocity vector of end effector and control the robot arm by the output data of the position and size of the detected rectangle. Through the several experiments using developed 6 axis robot, it was confirmed that the 6 d.o.f. robot arm remote control was successfully performed.

• International Journal of Concrete Structures and Materials
• /
• v.10 no.2
• /
• pp.189-203
• /
• 2016

This paper investigates on the use of advanced optical measurement methods, i.e. 3D coordinate measurement machines (3D CMM) and stereo-vision digital image correlation (3D DIC), for the mechanical analysis of shear deficient prestressed concrete members. Firstly, the experimental program is elaborated. Secondly, the working principle, experimental setup and corresponding accuracy and precision of the considered optical measurement techniques are reported. A novel way to apply synthesised strain sensor patterns for DIC is introduced. Thirdly, the experimental results are reported and an analysis is made of the structural behaviour based on the gathered experimental data. Both techniques yielded useful and complete data in comparison to traditional mechanical measurement techniques and allowed for the assessment of the mechanical behaviour of the reported test specimens. The identified structural behaviour presented in this paper can be used to optimize design procedure for shear-critical structural concrete members.

• Proceedings of the IEEK Conference
• /
• 2003.11a
• /
• pp.183-186
• /
• 2003

A vision sensor should be calibrated prior to infer a Euclidian shape reconstruction. A point to point calibration. also referred to as a hard calibration, estimates calibration parameters by means of a set of 3D to 2D point pairs. We proposed a new method for determining a set of 3D to 2D pairs for the structured light hard calibration. It is simply determined based on epipolar geometry between camera image plane and projector plane, and a projector calibrating grid pattern. The projector calibration is divided two stages; world 3D data acquisition Stage and corresponding 2D data acquisition stage. After 3D data points are derived using cross ratio, corresponding 2D point in the projector plane can be determined by the fundamental matrix and horizontal grid ID of a projector calibrating pattern. Euclidian reconstruction can be achieved by linear triangulation. and experimental results from simulation are presented.

• The Journal of Korea Robotics Society
• /
• v.4 no.2
• /
• pp.139-146
• /
• 2009

This paper describes how a person extracts a unknown object with pointing gesture while interacting with a robot. Using a stereo vision sensor, our proposed method consists of two stages: the detection of the operators' face, the estimation of the pointing direction, and the extraction of the pointed object. The operator's face is recognized by using the Haar-like features. And then we estimate the 3D pointing direction from the shoulder-to-hand line. Finally, we segment an unknown object from 3D point clouds in estimated region of interest. On the basis of this proposed method, we implemented an object registration system with our mobile robot and obtained reliable experimental results.