• Journal of Mechanical Science and Technology
• /
• v.14 no.7
• /
• pp.782-788
• /
• 2000

In this paper, we present a new approach to visual feedback control using image-based visual servoing with stereo vision. In order to control the position and orientation of a robot with respect to an object, a new technique is proposed using binocular stereo vision. The stereo vision enables us to calculate an exact image Jacobian not only around a desired location but also at other locations. The suggested technique can guide a robot manipulator to the desired location without providing a priori knowledge such as the relative distance to the desired location or the model of an object even when the initial positioning error is large. This paper describes a model of stereo vision and how to generate feedback commands. The performance of the proposed visual servoing system is illustrated by experimental results and compared with conventional control methods for an assembly robot.

• Journal of Institute of Control, Robotics and Systems
• /
• v.6 no.6
• /
• pp.462-470
• /
• 2000

This paper proposes a visual servoing method based on QR decomposition and disturbance observer. The QR decomposition factors the image feature Jacobian into a unitary matrix and an upper triangular matrix. And it is shown that several performance indices such as measurement sensitivity of visual features, sensitivity of the control to noise and controllability can be improved for any general image feature Jacobian by QR decomposition and disturbance observer. To show the validity of the proposed approach, visual servoing with stereo vision is carried out for a Samsung FARAMAN 6-axis industrial robot manipulator.

• The Transactions of the Korean Institute of Electrical Engineers A
• /
• v.48 no.10
• /
• pp.1311-1316
• /
• 1999

A visual servoing method has been proposed based on disturbance observer to eliminate the effect of the off-diagonal component of image feature Jacobian, since performance indices such as measurement sensitivity of visual features, sensitivity of the control to noise and controllability could be improved when an image feature Jacobian was given as a block diagonal matrix. In this paper, experimental results of disturbance observer-based visual servoing are discussed where Samsung FARAMAN-AS1 6-axis industrial robot manipulator is employed. Also, the feature saturator is proposed to stabilize the disturbance observer loop by saturating the differential changes of the image features.

• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.49 no.1
• /
• pp.41-47
• /
• 2000

A better tracking performance can be achieved, if visual sensors such as CCD cameras are used in controling a robot manipulator, than when only relative sensors such as encoders are used. However, for precise visual servoing of a robot manipulator, an expensive vision system which has fast sampling rate must be used. Moreover, even if a fast vision system is implemented for visual servoing, one cannot get a reliable performance without use of robust and stable inner joint servo-loop. In this paper, we propose a dynamic control scheme for robot manipulators with eye-in-hand camera configuration, where a dynamic learning controller is designed to improve the tracking performance of robotic system. The proposed control scheme is implemented for tasks of tracking moving objects and shown to be robust to parameter uncertainty, disturbances, low sampling rate, etc.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.16 no.4
• /
• pp.454-459
• /
• 2006

The research and development for autonomous mobile robots has widely been reported. This paper describes a fuzzy logic based visual servoing system for an autonomous mobile robot. An existing system always needs to keep a moving object in overall image. This makes difficult to move the autonomous mobile robot spontaneously. In this paper we first explain an autonomous mobile robot and fuzzy logic system. And then we design a fuzzy logic based visual servoing system. We extract some features of the object from an overall image and then design a fuzzy logic system for controlling the visual servoing system to an exact position. We here introduce a shooting robot that can track an object and hit it. We show that the proposed system presents a desirable performance by a computer simulation and some experiments.

• Journal of the Korean Society of Industry Convergence
• /
• v.18 no.2
• /
• pp.90-98
• /
• 2015

This research propose with image-based visual a new approach to design a feedback control of mobile robot. because mobile robot must be recharged periodically, it is necessary to detect and move to docking station. Generally, laser scanner is used for detect of position of docking station. CCD Camera is also used for this purpose. In case of using camera, the position-based visual servoing method is widely used. But position-based visual servoing method requires the accurate calibration and it is hard and complex work. Another method using cameras is inmage-based visual feedback. Recently, image based visual feedback is widely used for robotic application. But it has a problem that cannot have linear trajectory in the 3-dimensional space. Because of this weak point, image-based visual servoing has a limit for real application. in case of 2-dimensional movement on the plane, it has also similar problem. In order to solve this problem, we point out the main reason of the problem of the resolved rate control method that has been generally used in the image-based visual servoing and we propose an image-based visual feedback method that can reduce the curved trajectory of mobile robot in th cartesian space.

• 제어로봇시스템학회:학술대회논문집
• /
• 1991.10a
• /
• pp.984-989
• /
• 1991

In this paper, a novel type of a visual servoing method is proposed for eye-in-hand robots by employing a self-organizing fuzzy controller. For this is there defined a new Jacobian riot to be the function of a relative position of the object but to be a function of the only image features. Instead of obtaining an analytic form of the proposed Jacobian, a self-organizing fuzzy controller is then proposed to alleviate difficulties in real-time implementation. To show the validities, the proposed method is applied to a 2-dimensional visual servoing task.

• Journal of Institute of Control, Robotics and Systems
• /
• v.19 no.3
• /
• pp.240-247
• /
• 2013

This paper proposes an optimal three-dimensional coordinate implementation of the vision sensor using two CCD cameras. The PBVS (Position based visual servoing) is implemented using the positional information obtained from images. Stereo vision by PBVS method that has enhanced every frame using calibration parameters is effective in the distance calculation. The IBVS (Image based visual servoing) is also implemented using the difference between reference and obtained images. Stereo vision by IBVS method calculates the distance using rotation angle of motors that correspond eyes and neck without enhanced images. The PBVS method is compared with the IBVS method in terms of advantages, disadvantages, computing time, and performances. Finally, the IBVS method is applied for the dual arm manipulator on the mobile inverted pendulum. The autonomous mobile inverted pendulum is successfully demonstrated using the center of the manipulator's mass.

• 제어로봇시스템학회:학술대회논문집
• /
• 2003.10a
• /
• pp.1121-1125
• /
• 2003

In this paper we deal with visual servoing that can control a robot arm with a camera using information of images only, without estimating 3D position and rotation of the robot arm. Here it is assumed that the robot arm is calibrated and the camera is uncalibrated. We use a pinhole camera model as the camera one. The essential notion can be show, that is, epipolar geometry, epipole, epipolar equation, and epipolar constrain. These play an important role in designing visual servoing. For easy understanding of the proposed method we first show a design in case of the calibrated camera. The design is constructed by 4 steps and the directional motion of the robot arm is fixed only to a constant direction. This means that an estimated epipole denotes the direction, to which the robot arm translates in 3D space, on the image plane.

• Proceedings of the KIEE Conference
• /
• 2007.04a
• /
• pp.322-324
• /
• 2007

In this paper, an eye-in-hand visual servoing strategy for keeping feature points within the FOV(field-of-view) is proposed. We first specify the FOV constraint which must be satisfied to keep the feature points within the FOV. It is expressed as the inequality relationship between (i) the LOS(jine-of-sight) angles of the center of the feature points from the optical axis of the camera and (ii) the distance between the object and the camera. We then design a nonlinear feedback controller which decouples linearly the translational and rotational control loops. Finally, we show that appropriate choice of the controller gains assures to satisfy the FOV constraint. The main advantage of our approach over the previous ones is that the trajectory of the camera is smooth and circular-like. Furthermore, ours can be applied to the large camera displacement problem.