• Proceedings of the IEEK Conference
• /
• 2005.11a
• /
• pp.1269-1272
• /
• 2005

In this paper, a new intelligent moving target tracking and surveillance system basing on the pan/tilt-embedded stereo camera system is suggested and implemented. In the proposed system, once the face area of a target is detected from the input stereo image by using a YCbCr color model and then, using this data as well as the geometric information of the tracking system, the distance and 3D information of the target are effectively extracted in real-time.

• Proceedings of the Korean Society of Precision Engineering Conference
• /
• 2004.10a
• /
• pp.1087-1090
• /
• 2004

stereo vision system is applied to a mobile manipulator for effective tasks. The robot can recognize a target and compute the position of the target using a stereo vision system. In this paper we persent a visual approach to the problem of object grasping. First we propose object recognization method which can find the object position and pose using feature points. A robot recognizes the feature point to Object. So a number of feature point is the more, the better, but if it is overly many, the robot have to process many data, it makes real-time image processing ability weakly. In other to avoid this problem, the robot selects only two point and recognize the object by line made by two points. Second we propose trajectory planing of the robot manipulator. Using grometry of between object and gripper, robot can find a goal point to translate the robot manipulator, and then it can grip the object successfully.

• Journal of the Optical Society of Korea
• /
• v.14 no.4
• /
• pp.451-457
• /
• 2010

Increasing demands on the safety of public train services have led to the development of various types of security monitoring systems. Most of the surveillance systems are focused on the estimation of crowd level in the platform, thereby yielding too many false alarms. In this paper, we present a novel security monitoring system to detect critically dangerous situations such as when a passenger falls from the station platform, or when a passenger walks on the rail tracks. The method is composed of two stages of detecting dangerous situations. Objects falling over to the dangerous zone are detected by motion tracking. 3D depth information retrieved by the stereo vision is used to confirm fallen events. Experimental results show that virtually no error of either false positive or false negative is found while providing highly reliable detection performance. Since stereo matching is performed on a local image only when potentially dangerous situations are found; real-time operation is feasible without using dedicated hardware.

• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.54 no.6
• /
• pp.366-371
• /
• 2005

For an autonomous mobile robot localization, it is very important for the robot to be able to recognize indoor environment and match a detected object to an object defined within a map developed either online or of offline. Given the map defining the locations of geometric beacons like wall and corner existing in the robot operation environment, this paper presents a stereo ultrasonic sensor based method practically applicable in recognizing the geometric beacons in real-time. The stereo ultrasonic sensor used in the experiment consists of an ultrasonic transmitter and two ultrasonic receivers placed symmetrically about the transmitter Experimental results are provided to demonstrate that the proposed method is more efficient in recognizing wall and coner than the conventional method of using multiple number of transmitter-receiver pairs.

• Journal of Institute of Control, Robotics and Systems
• /
• v.14 no.10
• /
• pp.998-1004
• /
• 2008

In this paper, a visual servoing control technique of humanoid robot arms is implemented for tracking a moving object. An embedded time-delayed controller is designed on an FPGA(Programmable field gate array) chip and implemented to control humanoid robot arms. The position of the moving object is detected by a stereo vision camera and converted to joint commands through the inverse kinematics. Then the robot arm performs visual servoing control to track a moving object in real time fashion. Experimental studies are conducted and results demonstrate the feasibility of the visual feedback control method for a moving object tracking task by the humanoid robot arms called the ROBOKER.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.51 no.2
• /
• pp.102-113
• /
• 2014

This paper suggests a novel hardware architecture of a real-time rectification which is to remove vertical parallax of an image occurred in the pre-processing stage of stereo matching. As an off-line step, Matlab Toolbox which was designed by J.Y Bouguet, was used to calculate calibration parameter of the image. Then, based on the Heikkila and Silven's algorithm, rectification hardware was designed. At this point, to enhance the precision of the rectified image, floating-point unit was generated by using Xilinx Core Generator. And, we confirmed that proposed hardware design had higher precision compared to other designs while having the ability to do rectification in real-time.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.45 no.1
• /
• pp.55-61
• /
• 2008

A real-time three-dimensional vision is a passive system, which would support various applications including collision avoidance, home networks. It is a good alternative of active systems, which are subject to interference in noisy environments. In this paper, we designed a SAD correlator with respect to resource usage for a real-time three-dimensional vision system. Regular structures, linear data flow and abundant parallelism make the correlation algorithm a good candidate for a reconfigurable hardware. We implemented two versions of SAD correlator in HDL and synthesized them to determine resource requirements and performance. From the experiment we show that the SAD correlator fits into reconfigurable hardware in marginal cost and can handle about 30 frames/sec with $640{\times}480$ images.

• Journal of the Korean Institute of Telematics and Electronics D
• /
• v.36D no.8
• /
• pp.68-78
• /
• 1999

In the typical stereo vision system, when the focus points of the left and right images are mismatched or the moving object is not in the center of the image, not only the observer can be fatigued & unconscious of three-dimensional effect, but also hard to track the moving object. Therefore, the stereo object tracking system can be used to track the moving object by controlling convergence angle to minimize stereo disparity and controlling pan/tilt to locate moving object in the center of the image. In this paper, as a new approach to stereo object tracking system we introduce a stereo object tracking simulator based on the optical JTC system capable of adaptive tracking. By using this simulator, any kinds of experimental results can be predicted & analyzed and the processing if real-time implementation of stereo object tracking system is suggested through some optical experiments even if background noises exist.

• 제어로봇시스템학회:학술대회논문집
• /
• 2005.06a
• /
• pp.610-615
• /
• 2005

Visual servoing is the fusion of results from many elemental areas including high-speed image processing, kinematics, dynamics, control theory, and real-time computing. It has much in common with research into active vision and structure from motion, but is quite different from the often described use of vision in hierarchical task-level robot control systems. We present a new approach to visual feedback control using image-based visual servoing with the stereo vision in this paper. In order to control the position and orientation of a robot with respect to an object, a new technique is proposed using a binocular stereo vision. The stereo vision enables us to calculate an exact image Jacobian not only at around a desired location but also at the other locations. The suggested technique can guide a robot manipulator to the desired location without giving such priori knowledge as the relative distance to the desired location or the model of an object even if the initial positioning error is large. This paper describes a model of stereo vision and how to generate feedback commands. The performance of the proposed visual servoing system is illustrated by the simulation and experimental results and compared with the case of conventional method for dual-arm robot made in Samsung Electronics Co., Ltd.

• 제어로봇시스템학회:학술대회논문집
• /
• 2005.06a
• /
• pp.735-739
• /
• 2005

This paper presents a new system to estimate the head pose of human in interactive indoor environment that has dynamic illumination change and large working space. The main idea of this system is to suggest a new morphological feature for estimating head angle from stereo disparity map. When a disparity map is obtained from stereo camera, the matching confidence value can be derived by measurements of correlation of the stereo images. Applying a threshold to the confidence value, we also obtain the specific morphology of the disparity map. Therefore, we can obtain the morphological shape of disparity map. Through the analysis of this morphological property, the head pose can be estimated. It is simple and fast algorithm in comparison with other algorithm which apply facial template, 2D, 3D models and optical flow method. Our system can automatically segment and estimate head pose in a wide range of head motion without manual initialization like other optical flow system. As the result of experiments, we obtained the reliable head orientation data under the real-time performance.