• The Journal of Korea Robotics Society
• /
• v.4 no.4
• /
• pp.298-304
• /
• 2009

This paper describes an algorithm that improves 3D reconstruction result using a multi-sensor fusion disparity map. We can project LRF (Laser Range Finder) 3D points onto image pixel coordinatesusing extrinsic calibration matrixes of a camera-LRF (${\Phi}$, ${\Delta}$) and a camera calibration matrix (K). The LRF disparity map can be generated by interpolating projected LRF points. In the stereo reconstruction, we can compensate invalid points caused by repeated pattern and textureless region using the LRF disparity map. The result disparity map of compensation process is the multi-sensor fusion disparity map. We can refine the multi-sensor 3D reconstruction based on stereo vision and LRF using the multi-sensor fusion disparity map. The refinement algorithm of multi-sensor based 3D reconstruction is specified in four subsections dealing with virtual LRF stereo image generation, LRF disparity map generation, multi-sensor fusion disparity map generation, and 3D reconstruction process. It has been tested by synchronized stereo image pair and LRF 3D scan data.

• Journal of Institute of Control, Robotics and Systems
• /
• v.20 no.10
• /
• pp.1051-1056
• /
• 2014

In this paper, we introduce an intelligent robotic arc welding system which exploits sensors like as LVS (Laser Vision Sensor), Hall effect sensor, voltmeter and so on. The use of industrial robot is saturated because of its own limitation, and one of the major limitations is that industrial robot cannot recognize the environment. Lately, sensor-based environmental awareness research of the industrial robot is performed actively to overcome such limitation, and it can expand application field and improve productivity. We classify the sensor-based intelligent arc welding robot system by the goal and the sensing data. The goals can be categorized into detection of a welding start point, tracking of a welding line and correction of a torch deformation. The Sensing data can be categorized into welding data (i.e. current, voltage and short circuit detection) and displacement data (i.e. distance, position). This paper covers not only the explanation of the each category but also its advantage and limitation.

• IEMEK Journal of Embedded Systems and Applications
• /
• v.18 no.3
• /
• pp.117-124
• /
• 2023

In the machine vision inspection equipment, diameter measurement is important process in inspection of cylindrical object. However, machine vision inspection equipment requires complex algorithm processing such as camera distortion correction and perspective distortion correction, and the increase in processing time and cost required for precise diameter measurement. In this paper, we proposed the algorithm for diameter measurement of cylindrical object using the laser displacement sensor. In order to fit circle for given four input outer points, grid search algorithms using root-mean-square error and mean-absolute error are applied and compared. To solve the limitations of the grid search algorithm, we finally apply the singular-value-decomposition based circle fitting algorithm. In order to compare the performance of the algorithms, we generated the pseudo data of the outer points of the cylindrical object and applied each algorithm. As a result of the experiment, the grid search using root-mean-square error confirmed stable measurement results, but it was confirmed that real-time processing was difficult as the execution time was 10.8059 second. The execution time of mean-absolute error algorithm was greatly improved as 0.3639 second, but there was no weight according to the distance, so the result of algorithm is abnormal. On the other hand, the singular-value-decomposition method was not affected by the grid and could not only obtain precise detection results, but also confirmed a very good execution time of 0.6 millisecond.

• Journal of Biosystems Engineering
• /
• v.24 no.2
• /
• pp.159-166
• /
• 1999

A system to extract continuously the real 3-D geometric fearture information from 2-D image of an object, which is fed randomly via conveyor has been developed. Two sets of structured laser lightings were utilized. And the laser structured light projection image was acquired using the camera from the signal of the photo-sensor mounted on the conveyor. Camera coordinate calibration matrix was obtained, which transforms 2-D image coordinate information into 3-D world space coordinate using known 6 points. The maximum error after calibration showed 1.5 mm within the height range of 103mm. The correlation equation between the shift amount of the laser light and the height was generated. Height information estimated after correlation showed the maximum error of 0.4mm within the height range of 103mm. An interactive 3-D geometric feature extracting software was developed using Microsoft Visual C++ 4.0 under Windows system environment. Extracted 3-D geometric feature information was reconstructed into 3-D surface using MATLAB.

• Journal of the Korean Society for Precision Engineering
• /
• v.32 no.6
• /
• pp.537-542
• /
• 2015

The measurement of 3D shape is important in inspecting the quality of product. In this paper, we present a 3D shape measurement system of fastener using a camera and a slit laser. Calibration structure with slits is used in the extrinsic calibration of the camera and laser. The pose of the camera and laser is computed under the same world coordinate system in the calibration structure. Reflection of laser light on the metal surface causes many difficulties in the robust detection of them on image. We overcome this difficulty by using color and dynamic programming. Motor stage is used to rotate the fastener to recover the whole 3D shape of the surface of it.

• Journal of Sensor Science and Technology
• /
• v.27 no.4
• /
• pp.216-220
• /
• 2018

In this paper, we present visual sensing techniques that can be used to teach a robot using a laser pointer. The light spot of an off-the-shelf laser pointer is detected and its movement is tracked on consecutive images of a camera. The three-dimensional position of the spot is calculated using stereo cameras. The light spot on the image is detected based on its color, brightness, and shape. The detection results in a binary image, and morphological processing steps are performed on the image to refine the detection. The movement of the laser spot is measured using two methods. The first is a simple method of specifying the region of interest (ROI) centered at the current location of the light spot and finding the spot within the ROI on the next image. It is assumed that the movement of the spot is not large on two consecutive images. The second method is using a Kalman filter, which has been widely employed in trajectory estimation problems. In our simulation study of various cases, Kalman filtering shows better results mostly. However, there is a problem of fitting the system model of the filter to the pattern of the spot movement.

• Journal of Institute of Control, Robotics and Systems
• /
• v.17 no.6
• /
• pp.521-525
• /
• 2011

Lane marking detection is one of important issues in the field of autonomous mobile robot. Especially, in urban environment, like pavement roads of downtown or tour tracks of Science Park, which have continuous patterns on the surface of the road, the lane marking detection becomes more important ability. Although there were many researches about lane detection and lane tracing, many of them used vision sensors mainly to detect lane marking. In this paper, we obtain 2 dimensional library data of 'Intensity' and 'Distance' using one laser rangefinder only. We design a simple classifier and filtering algorithm for the lane detection which uses only one LRF (Laser Range Finder). Allowing extended usage of LRF, this research provides more functionality not only in range finding but also in lane detecting to mobile robots. This work will be technically helpful for robot developers to design more simple and efficient autonomous driving system using LRF.

• Journal of Auto-vehicle Safety Association
• /
• v.9 no.3
• /
• pp.24-30
• /
• 2017

This paper presents the development of laser scanner based static obstacle detection algorithm for vehicle localization on lane lost section. On urban autonomous driving, vehicle localization is based on lane information, GPS and digital map is required to ensure. However, in actual urban roads, the lane data may not come in due to traffic jams, intersections, weather conditions, faint lanes and so on. For lane lost section, lane based localization is limited or impossible. The proposed algorithm is designed to determine the lane existence by using reliability of front vision data and can be utilized on lane lost section. For the localization, the laser scanner is used to distinguish the static object through estimation and fusion process based on the speed information on radar data. Then, the laser scanner data are clustered to determine if the object is a static obstacle such as a fence, pole, curb and traffic light. The road boundary is extracted and localization is performed to determine the location of the ego vehicle by comparing with digital map by detection algorithm. It is shown that the localization using the proposed algorithm can contribute effectively to safe autonomous driving.

• Transactions of the Korean Society of Mechanical Engineers
• /
• v.19 no.4
• /
• pp.887-895
• /
• 1995

Considering that the laser range finder has the excellent resolution with respect to angular and distance measurements, a sophisticated local path planning algorithm is achieved by subgoal and sub-subgoal searching methods. The subgoal searching finds the passable ways between obstacles and selects the optimal pathway in order to reduce the moving distanced from start point to given to given goal. On the other hand, the sub-subgoal searching corrects the path given in subgoal searching in the case of which the mobile robot will collide with obstacles. Also, the effectiveness of the established local path planning and local minimum avoiding algorithm are estimated by computer simulation and experimentation in complex environment.

• 한국방재학회:학술대회논문집
• /
• 2007.02a
• /
• pp.53-56
• /
• 2007

It was previously introduced a new displacement measuring technique using terrestrial laser scanning (TLS) that remotely samples the surface of an object using laser pulses and generates the three-dimensional (3D) coordinates of numerous points on the surface. In this paper, for an assessment of the capabilities of the measuring technique about existing structures, the field tests for vertical displacement measurement of an existing long span steel box-girder are experimentally carried out. The performance of the technique is evaluated by comparing the displacements obtained from TLS system and displacements directly measured from linear variable displacement transducer (LVDT).