• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.60 no.6
• /
• pp.1245-1254
• /
• 2011

This paper proposes a target tracking algorithm for wheeled mobile robots using in various fields. For the stable tracking, we apply a vision system to a mobile robot which can extract targets through image processing algorithms. Furthermore, this paper presents an algorithm to position the mobile robot at the desired location from the target by estimating its relative position and attitude. We show the problem in the tracking method using the Position-Based Visual Servo(PBVS) control, and propose a tracking method, which can achieve the stable tracking performance by combining the PBVS control with Image-Based Visual Servo(IBVS) control. When the target is located around the outskirt of the camera image, the target can disappear from the field of view. Thus the proposed algorithm combines the control inputs with of the hyperbolic form the switching function to solve this problem. Through both simulations and experiments for the mobile robot we have confirmed that the proposed visual servo control method is able to enhance the stability compared to of the method using only either PBVS or IBVS control method.

• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.60 no.8
• /
• pp.1577-1585
• /
• 2011

This paper proposes a posture stabilization control algorithm for a wheeled mobile robot using hybrid visual servo control method with a position based and an image based visual servoing (PBVS and IBVS). To overcome chattering phenomena which were shown in the previous researches using a simple switching function based on a threshold, the proposed hybrid visual servo control law introduces the fusion function based on a blending function. Then, the chattering problem and rapid motion of the mobile robot can be eliminated. Also, we consider the nonlinearity of the wheeled mobile robot unlike the previous visual servo control laws using linear control methods to improve the performances of the visual servo control law. The proposed posture stabilization control law using hybrid visual servoing is verified by a theoretical analysis and simulation and experimental results.

• International Journal of Control, Automation, and Systems
• /
• v.6 no.4
• /
• pp.607-612
• /
• 2008

This paper proposes a robot visual servo approach based on image appearance and a wavelet function neural network. The inputs of the wavelet neural network are changes of image features or the elements of image appearance vector, and the outputs are changes of robot joint angles. Image appearance vector is calculated by using eigen subspace transform algorithm. The proposed approach does not need a priori knowledge of the robot kinematics, hand-eye geometry and camera models. The experiment results on a real robot system show that the proposed method is practical and simple.

• Proceedings of the KIEE Conference
• /
• 1994.11a
• /
• pp.299-301
• /
• 1994

Visual feedback has traditionally been used in robot manipulator control to a limited extent. However in varying environment, visual data is needed to control the manipulator to complete the desired task. In this paper we present a method of manipulator control scheme called image-based visual servo. In this scheme we use image data as feedback to control robot manipulator. And we also show the experimental results with an industrial robot manipulator.

• Journal of Power System Engineering
• /
• v.6 no.1
• /
• pp.96-101
• /
• 2002

In this paper, we address the problem of controlling an end-effector to track and grab a moving target using the visual servoing technique. A visual servo mechanism based on the image-based servoing principle, is proposed by using visual feedback to control an end-effector without calibrated robot and camera models. Firstly, we consider the control problem as a nonlinear least squares optimization and update the joint angles through the Taylor Series Expansion. And to track a moving target in real time, the Jacobian estimation scheme(Dynamic Broyden's Method) is used to estimate the combined robot and image Jacobian. Using this algorithm, we can drive the objective function value to a neighborhood of zero. To show the effectiveness of the proposed algorithm, simulation results for a six degree of freedom robot are presented.

• 제어로봇시스템학회:학술대회논문집
• /
• 1991.10a
• /
• pp.1012-1016
• /
• 1991

An effective visual servo control system for robotic manipulators based on neural networks is proposed. For this control system, firstly, one neural network is used to learn the mapping relationship between the robot's joint space and the video image space. However, in the proposed control scheme, this network is not used in itself, but its first and second derivatives are used to generate servo commands for the robot. Secondly, an adaptive Adaline network is used to identify the dynamics of the robot and also to generate the proper torque commands. Computer simulation has been performed indicating its superior performance. As far as the authors know, this is the first time attempt of the use of neural networks for a visual servo control of robots that compensates for their changing dynamics.

• Proceedings of the Korea Society of Information Technology Applications Conference
• /
• 2005.11a
• /
• pp.229-232
• /
• 2005

In this paper, an image-based "approach-align -grasp" visual servo control design is proposed for the problem of object grasping, which is based on the binocular stand-alone system. The basic idea consists of considering a vision system as a specific sensor dedicated a task and included in a control servo loop, and we perform automatic grasping follows the classical approach of splitting the task into preparation and execution stages. During the execution stage, once the image-based control modeling is established, the control task can be performed automatically. The proposed visual servoing control scheme ensures the convergence of the image-features to desired trajectories by using the Jacobian matrix, which is proved by the Lyapunov stability theory. And we also stress the importance of projective invariant object/gripper alignment. The alignment between two solids in 3-D projective space can be represented with view-invariant, more precisely; it can be easily mapped into an image set-point without any knowledge about the camera parameters. The main feature of this method is that the accuracy associated with the task to be performed is not affected by discrepancies between the Euclidean setups at preparation and at task execution stages. Then according to the projective alignment, the set point can be computed. The robot gripper will move to the desired position with the image-based control law. In this paper we adopt a constant Jacobian online. Such method describe herein integrate vision system, robotics and automatic control to achieve its goal, it overcomes disadvantages of discrepancies between the different Euclidean setups and proposes control law in binocular-stand vision case. The experimental simulation shows that such image-based approach is effective in performing the precise alignment between the robot end-effector and the object.

• 제어로봇시스템학회:학술대회논문집
• /
• 1994.10a
• /
• pp.566-571
• /
• 1994

This paper presents in image-based visual servo control scheme for tracking a workpiece with a hand-eye coordinated robotic system using the fuzzy-neural-network. The goal is to control the relative position and orientation between the end-effector and a moving workpiece using a single camera mounted on the end-effector of robot manipulator. We developed a fuzzy-neural-network that consists of a network-model fuzzy system and supervised learning rules. Fuzzy-neural-network is applied to approximate the nonlinear mapping which transforms the features and theire change into the desired camera motion. In addition a control strategy for real-time relative motion control based on this approximation is presented. Computer simulation results are illustrated to show the effectiveness of the fuzzy-neural-network method for visual servoing of robot manipulator.

• Journal of Mechanical Science and Technology
• /
• v.16 no.6
• /
• pp.762-769
• /
• 2002

This paper presents how effective it is to use many features for improving the speed and accuracy of visual servo systems. Some rank conditions which relate the image Jacobian to the control performance are derived. The focus is to describe that the accuracy of the camera position control in the world coordinate system is increased by utilizing redundant features in this paper. It is also proven that the accuracy is improved by increasing the number of features involved. Effectiveness of the redundant features is evaluated by the smallest singular value of the image Jacobian which is closely related to the accuracy with respect to the world coordinate system. Usefulness of the redundant features is verified by the real time experiments on a Dual-Arm robot manipulator made by Samsung Electronic Co. Ltd..

• Journal of the Korean Institute of Telematics and Electronics B
• /
• v.29B no.10
• /
• pp.37-45
• /
• 1992

For a precise manipulator control in the presence of environmental uncertainties, it has long been recognized that the robot should be controlled in a task-referenced space. In this respect, an effective visual servo control system for robot manipulators based on neural networks is proposed. In the proposed control system, a Backpropagation neural network is used first to learn the mapping relationship between the robot's joint space and the video image space. However, in the real control loop, this network is not used in itself, but its first and second derivatives are used to generate servo commands for the robot. Second, and Adaline neural network is used to identify the approximately linear dynamics of the robot and also to generate the proper joint torque commands. Computer simulation has been performed demonstrating the proposed method's superior performance. Futrhermore, the proposed scheme can be effectively utilized in a robot skill acquisition system where the robot can be taught by watching a human behavioral task.