• The Journal of Korea Robotics Society
• /
• v.14 no.2
• /
• pp.87-93
• /
• 2019

This paper presents a 6-DOF relocalization using a 3D laser scanner and a monocular camera. A relocalization problem in robotics is to estimate pose of sensor when a robot revisits the area. A deep convolutional neural network (CNN) is designed to regress 6-DOF sensor pose and trained using both RGB image and 3D point cloud information in end-to-end manner. We generate the new input that consists of RGB and range information. After training step, the relocalization system results in the pose of the sensor corresponding to each input when a new input is received. However, most of cases, mobile robot navigation system has successive sensor measurements. In order to improve the localization performance, the output of CNN is used for measurements of the particle filter that smooth the trajectory. We evaluate our relocalization method on real world datasets using a mobile robot platform.

• Journal of Korean Society for Geospatial Information Science
• /
• v.16 no.2
• /
• pp.87-95
• /
• 2008

Ladar (Laser Detection And Ranging, Lidar) is a sensor to acquire precise distances to the surfaces of target region using laser signals, which can be suitably applied to ATD (Automatic Target Detection) for guided missiles or aerial vehicles recently. It provides a range image in which each measured distance is expressed as the brightness of the corresponding pixel. Since the precise 3D models can be generated from the Ladar range image, more robust identification and recognition of the targets can be possible. If we simulate the data of Ladar sensor, we can efficiently use this simulator to design and develop Ladar sensors and systems and to develop the data processing algorithm. The purposes of this study are thus to simulate the signals of a Ladar sensor based on linear frequency modulation and to create range images from the simulated Ladar signals. We first simulated the laser signals of a Ladar using FM chirp modulator and then computed the distances from the sensor to a target using the FFT process of the simulated signals. Finally, we created the range image using the distances set.

• Journal of Sensor Science and Technology
• /
• v.32 no.5
• /
• pp.320-327
• /
• 2023

In this study, an FPGA-based sealer inspection system was developed to inspect the sealer applied to install vehicle glass on a car body. The sealer is a liquid or paste-like material that promotes adhesion such as sealing and waterproofing for mounting and assembling vehicle parts to a car body. The system installed in the existing vehicle design parts line does not detect the sealer in the glass rotation section and takes a long time to process. This study developed a line laser camera sensor and an FPGA vision signal processing module to solve this problem. The line laser camera sensor was developed such that the resolution and speed of the camera for data acquisition could be modified according to the irradiation angle of the laser. Furthermore, it was developed considering the mountability of the entire system to prevent interference with the sealer ejection machine. In addition, a vision signal processing module was developed using the Zynq-7020 FPGA chip to improve the processing speed of the algorithm that converted the profile to the sealer shape image acquired from a 2D camera and calculated the width and height of the sealer using the converted profile. The performance of the developed sealer application inspection system was verified by establishing an experimental environment identical to that of an actual automobile production line. The experimental results confirmed the performance of the sealer application inspection at a level that satisfied the requirements of automotive field standards.

• Journal of Korea Multimedia Society
• /
• v.17 no.2
• /
• pp.132-142
• /
• 2014

Stereo camera is drawing attention as an essential sensor for future intelligence robot system since it has the advantage of acquiring not only distance but also other additive information for an object. However, it cannot match correlated point on target image for low textured region or periodic patterned region such as wall of building or room. In this paper, we propose a stereo matching technique that increase the matching performance by fusing belief propagation stereo matching algorithm and local distance measurements of 2D-laser range finder in order to overcome this kind of limitation. The proposed technique adds laser measurements by referring quad-tree based segment information on to the local-evidence of belief propagation stereo matching algorithm, and calculates compatibility function by reflecting over-segmented information. Experimental results of the proposed method using simulation and real test images show that the distance information for some low textured region can be acquired and the discontinuity of depth information is preserved by using segmentation information.

• Proceedings of the Korean Society of Precision Engineering Conference
• /
• 2005.06a
• /
• pp.950-955
• /
• 2005

This paper describes an intelligent filler wire feeding device which can control 3- dimensional seam tracking and the filler wire speed by measuring the gap position and the joint gap width in laser welding. By means of visual sensor controlled filling the missing material into the joint gap and 3 dimensional seam tracking, lineup errors from manufacturing tolerances and the repeatability of lineup jigs and weld robot can be balanced and at an even seam quality which avoids weld defects. In this paper, we assessed weld quality in 2mm sheets of A16061 which had various gap width by using the intelligent filler wire feeding device.

• Journal of Welding and Joining
• /
• v.8 no.2
• /
• pp.58-69
• /
• 1990

In conventional arc welding, position error of the weld torch with respect to the weld seam and variation of groove dimension are induced by inaccurate fitup and fixturing. In this study, a vision system has been developed to recognize and compensate the position error and dimensional inaccuracy. The system uses a structured laser light illuminated on the weld groove and perceived by a C.C.D camera. A new algorithm to detect the edge of the reflected laser light is introduced for real time processing. The developed system was applied to arbitarary weld paths with various types of joint in arc welding process. The experimental results show that the proposed system can detect the weld groove parameters within good accuracy and yield good tracking performance.

• Journal of Biomedical Engineering Research
• /
• v.28 no.3
• /
• pp.392-396
• /
• 2007

In this paper, we develop a new system to visualize the blood flow map in skin tissue, using the technique of Laser Speckle Flowgraphy (LSFG). The measuring unit consists of the laser diode, imaging system, line sensor, scanning mirror, and one-board microcomputer. The speckle signal is analyzed and sent to a PC, where the blood flow in a tissue area of $14mm{\times}26 mm$ is evaluated and displayed in a 2-D color map. It is demonstrated that the new LSFG instrument is useful to evaluate the degree of allergic reaction in patch test.

• 제어로봇시스템학회:학술대회논문집
• /
• 2004.08a
• /
• pp.499-503
• /
• 2004

This application-oriented paper describes an automated welding carriage system to weld a thin corrugated workpiece with welding seam tracking function. Hyundai Heavy Industries Corporation has developed an automatic welding carriage system, which utilizes pulsed plasma arc welding process for corrugated sheets. It can obtain high speed welding more than 2 times faster than traditional TIG based welding system. The aim of this development is to increase the productivity by using automatic plasma welding carriage systems, to track weld seam line using vision sensor automatically, and finally to provide a convenience to operator in order to carry out welding. In this paper a robust image processing and a distance based tracking algorithms are introduced for corrugated workpiece welding. The automatic welding carriage system is controlled by the programmable logic controller(PLC), and the automatic welding seam tracking system is controlled by the industrial personal computer(IPC) equipped with embedded OS. The system was tested at actual workpiece to show the feasibility and performance of proposed algorithm and to confirm the reliability of developed controller.

• Korean Journal of Construction Engineering and Management
• /
• v.10 no.1
• /
• pp.136-145
• /
• 2009

The objective of the Intelligent Excavation System (IES) is to recognize the work environment and produce work plan and automatically control the excavator through integrating sensor and robot technologies. This paper discusses one of the core technologies of IES development project, development of 3D work environment modeling. 3D laser scanner is used for 3-dimensional mathematical model that can be visualized in virtual space in 3D. This paper describes (1) how the most appropriate 3D imaging system has been chosen; (2) the development of user interface and customization of the s/w to control the scanner for IES project; (3) the development of the mobile station for the scanner; (4) and the algorithm for the automatic registration of laser scan segments for IES project. The development system has been tested on the construction field and lessons learned and future development requirements are suggested.

• Korean Journal of Construction Engineering and Management
• /
• v.24 no.2
• /
• pp.70-78
• /
• 2023

Inclinometer has several problems of 1)difficulty installing inclinometer casing, 2) measuring 2D local lateral displacement of retaining wall, 3) measurement by manpower. To solve such problems, a 2D LiDAR sensor-based retaining wall displacement measurement system was developed in previous studies. The purpose of this study is to select a displacement analysis algorithm to be applied in the retaining wall displacement measurement system. As a result of the displacement analysis algorithm selection, the M3C2 (Multiple Model to Model Cloud Comparison) algorithm with a displacement estimation error of 2mm was selected as the displacement analysis algorithm. If the M3C2 algorithm is applied in the system and the reliability of the displacement analysis result is secured through several field experiments. Convenient management of the displacement for the retaining wall is possible in comparison with the current measurement management.