• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.57 no.10
• /
• pp.1876-1882
• /
• 2008

Nano manipulator is used to manufacture Carbon NanoTube(CNT) tips. Using nano manipulator, operator attaches a CNT at the apex of Atomic Force Microscope(AFM) tip, which requires a mastery of mechanics and long manufacture time. Nano manipulator is installed inside a Scanning Electron Microscope(SEM) chamber to observe the operation. This paper presents a control scheme for horizontal axes of nano manipulator via processing SEM image. Edges of AFM tip and CNT are first detected, and the position information so obtained is fed to control horizontal axes of nano manipulator. That is, a visual servoing loop is realized to control the axes more precisely in nano scale.

• 제어로봇시스템학회:학술대회논문집
• /
• 1996.10b
• /
• pp.302-305
• /
• 1996

This paper presents a visual servoing combined by Neural Network with optimal structure and predictive control for robotic manipulators to tracking or grasping of the moving object. Using the four feature image information from CCD camera attached to end-effector of RV-M2 robot manipulator having 5 dof, we want to predict the updated position of the object. The Kalman filter is used to estimate the motion parameters, namely the state vector of the moving object in successive image frames, and using the multi layer feedforward neural network that permits the connection of other layers, evolutionary programming(EP) that search the structure and weight of the neural network, and evolution strategies(ES) which training the weight of neuron, we optimized the net structure of control scheme. The validity and effectiveness of the proposed control scheme and predictive control of moving object will be verified by computer simulation.

• 제어로봇시스템학회:학술대회논문집
• /
• 2000.10a
• /
• pp.226-226
• /
• 2000

This paper presents the control problem for the motion of sphere with robot manipulator. The robot manipulator is controlled to regulate the angle of plate for the sphere to track given trajectories on the plate. The center position of the sphere is measured with machine vision system and the advanced algorithm for center detection is proposed in which the change of shape is considered to solve the problem of image distortion. To cope with the variation of plate material and the structure of sphere (size, mass, etc.), sliding mode control, which has robustness to model uncertainty, is applied to the control of robot manipulator.

• The Journal of Korea Robotics Society
• /
• v.2 no.2
• /
• pp.129-136
• /
• 2007

This paper introduces a position-based robust visual servoing method which is developed for operation of a human-like robot with two arms. The proposed visual servoing method utilizes SIFT algorithm for object detection and CAMSHIFT algorithm for object tracking. While the conventional CAMSHIFT has been used mainly for object tracking in a 2D image plane, we extend its usage for object tracking in 3D space, by combining the results of CAMSHIFT for two image plane of a stereo camera. This approach shows a robust and dependable result. Once the robot's task is defined based on the extracted 3D information, the robot is commanded to carry out the task. We conduct several position-based visual servoing tasks and compare performances under different conditions. The results show that the proposed visual tracking algorithm is simple but very effective for position-based visual servoing.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 1997.11a
• /
• pp.259-262
• /
• 1997

This paper presents a visual servoing of RV-M2 robot manipulators to track and grasp moving object, using pruned dynamic recurrent neural networks(DRNN). The object is stationary in the robot work space and the robot is tracking and grasping the object by using CCD camera mounted on the end-effector. In order to optimize the structure of DRNN, we decide the node whether delete or add, by mutation probability, first in case of delete node, the node which have minimum sum of input weight is actually deleted, and then in case of add node, the weight is connected according to the number of case which added node can reach the other nodes. Using evolutionary programming(EP) that search the struture and weight of the DRNN, and evolution strategies(ES) which train the weight of neuron, we pruned the net structure of DRNN. We applied the DRNN to the Visual Servoing of a robot manipulators to control position and orientation of end-effector, and the validity and effectiveness of the pro osed control scheme will be verified by computer simulations.

• The Journal of Korea Robotics Society
• /
• v.1 no.2
• /
• pp.125-134
• /
• 2006

The problem of establishing the servo system to reach the desired location keeping all features in the field of view and following a straight line is considered. In addition, robustness of camera calibration parameters is considered in this paper. The proposed approach is based on switching from position-based visual servoing (PBVS) to image-based visual servoing (IBVS) and allows the camera path to follow a straight line. To achieve the objective, a pose estimation method is required; the camera's target pose is estimated from the obtained images without the knowledge of the object. A switched control law moves the camera equipped to a robot end-effector near the desired location following a straight line in Cartesian space and then positions it to the desired pose with robustness to camera calibration error. Finally simulation results show the feasibility of the proposed visual servoing technique.

• Proceedings of the KIEE Conference
• /
• 1996.07b
• /
• pp.1269-1271
• /
• 1996

This paper presents a visual servoing combined by evolutionary algorithms and neural network for a robotic manipulators to control position and orientation of the end-effector. Using the multi layer feedforward neural network that permits the connection of other layers, evolutionary programming(EP) that search the structure and weight of the neural network, and evolution strategies(ES) which training the weight of neuron, we optimized the net structure of control scheme. Using the four feature image information from CCD camera attached to end-effector of RV-M2 robot manipulator having 5 dof, we generate the control input to agree the target image, to realize the visual servoing. The validity and effectiveness of the proposed control scheme will be verified by computer simulations.

• The Journal of Korea Robotics Society
• /
• v.14 no.1
• /
• pp.1-7
• /
• 2019

Recently, smart factories have attracted much attention as a result of the 4th Industrial Revolution. Existing factory automation technologies are generally designed for simple repetition without using vision sensors. Even small object assemblies are still dependent on manual work. To satisfy the needs for replacing the existing system with new technology such as bin picking and visual servoing, precision and real-time application should be core. Therefore in our work we focused on the core elements by using deep learning algorithm to detect and classify the target object for real-time and analyzing the object features. We chose YOLO CNN which is capable of real-time working and combining the two tasks as mentioned above though there are lots of good deep learning algorithms such as Mask R-CNN and Fast R-CNN. Then through the line and inside features extracted from target object, we can obtain final outline and estimate object posture.

• Journal of Institute of Control, Robotics and Systems
• /
• v.19 no.3
• /
• pp.240-247
• /
• 2013

This paper proposes an optimal three-dimensional coordinate implementation of the vision sensor using two CCD cameras. The PBVS (Position based visual servoing) is implemented using the positional information obtained from images. Stereo vision by PBVS method that has enhanced every frame using calibration parameters is effective in the distance calculation. The IBVS (Image based visual servoing) is also implemented using the difference between reference and obtained images. Stereo vision by IBVS method calculates the distance using rotation angle of motors that correspond eyes and neck without enhanced images. The PBVS method is compared with the IBVS method in terms of advantages, disadvantages, computing time, and performances. Finally, the IBVS method is applied for the dual arm manipulator on the mobile inverted pendulum. The autonomous mobile inverted pendulum is successfully demonstrated using the center of the manipulator's mass.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2006.05a
• /
• pp.393-396
• /
• 2006

본 논문에서는 목표물 추적 및 목표물 명중을 위한 사격을 할 수 있는 자율이동로봇의 설계 및 제작에 관하여 기술한다. 여기서는 목표물의 이동을 추적할 수 있도록 팬-틸트(pan-tilt)를 제어한다. USB 웹갬(web cam)영상에서 대상체의 특징을 추출하고, 추출한 특징으로부터 시각구동장치의 이동 위치 및 방향을 결정하기 위한 퍼지논리시스템을 설계한다. 시뮬레이션을 통해 제안한 방법의 유용성을 검증하고, 이를 실제 자율이동로봇의 시각구동장치에 적용하여 타당성을 입증한다.