• Title/Summary/Keyword: Stereo Vision Sensor

Search Result 71, Processing Time 0.026 seconds

A Study on Robot OLP Compensation Based on Image Based Visual Servoing in the Virtual Environment (가상 환경에서의 영상 기반 시각 서보잉을 통한 로봇 OLP 보상)

  • Shin Chan-Bai;Lee Jeh-Woon;Kim Jin-Dae
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.12 no.3
    • /
    • pp.248-254
    • /
    • 2006
  • It is necessary to improve the exactness and adaptation of the working environment for the intelligent robot system. The vision sensor have been studied for a long time at this points. However, it has many processes and difficulties for the real usages. This paper proposes a visual servoing in the virtual environment to support OLP(Off-Line-Programming) path compensation and supplement the problem of complexity of the old kinematical calibration. Initial robot path could be compensated by pixel differences between real and virtual image. This method removes the varies calibrations and 3D reconstruction process in real working space. To show the validity of the proposed approach, virtual space servoing with stereo camera is carried out with WTK and openGL library for a KUKA-6R manipulator and updated real robot path.

Controlling robot by image-based visual servoing with stereo cameras

  • Fan, Jun-Min;Won, Sang-Chul
    • Proceedings of the Korea Society of Information Technology Applications Conference
    • /
    • 2005.11a
    • /
    • pp.229-232
    • /
    • 2005
  • In this paper, an image-based "approach-align -grasp" visual servo control design is proposed for the problem of object grasping, which is based on the binocular stand-alone system. The basic idea consists of considering a vision system as a specific sensor dedicated a task and included in a control servo loop, and we perform automatic grasping follows the classical approach of splitting the task into preparation and execution stages. During the execution stage, once the image-based control modeling is established, the control task can be performed automatically. The proposed visual servoing control scheme ensures the convergence of the image-features to desired trajectories by using the Jacobian matrix, which is proved by the Lyapunov stability theory. And we also stress the importance of projective invariant object/gripper alignment. The alignment between two solids in 3-D projective space can be represented with view-invariant, more precisely; it can be easily mapped into an image set-point without any knowledge about the camera parameters. The main feature of this method is that the accuracy associated with the task to be performed is not affected by discrepancies between the Euclidean setups at preparation and at task execution stages. Then according to the projective alignment, the set point can be computed. The robot gripper will move to the desired position with the image-based control law. In this paper we adopt a constant Jacobian online. Such method describe herein integrate vision system, robotics and automatic control to achieve its goal, it overcomes disadvantages of discrepancies between the different Euclidean setups and proposes control law in binocular-stand vision case. The experimental simulation shows that such image-based approach is effective in performing the precise alignment between the robot end-effector and the object.

  • PDF

Gesture Recognition Using Stereo Tracking Initiator and HMM for Tele-Operation (스테레오 영상 추적 자동초기화와 HMM을 이용한 원격 작업용 제스처 인식)

  • Jeong, Ji-Won;Lee, Yong-Beom;Jin, Seong-Il
    • The Transactions of the Korea Information Processing Society
    • /
    • v.6 no.8
    • /
    • pp.2262-2270
    • /
    • 1999
  • In this paper, we describe gesture recognition algorithm using computer vision sensor and HMM. The automatic hand region extraction has been proposed for initializing the tracking of the tele-operation gestures. For this, distance informations(disparity map) as results of stereo matching of initial left and right images are employed to isolate the hand region from a scene. PDOE(positive difference of edges) feature images adapted here have been found to be robust against noise and background brightness. The KNU/KAERI(K/K) gesture instruction set is defined for tele-operation in atomic electric power stations. The composite recognition model constructed by concatenating three gesture instruction models including pre-orders, basic orders, and post-orders has been proposed and identified by discrete HMM. Our experimental results showed that consecutive orders composed of more than two ones are correctly recognized at the rate of above 97%.

  • PDF

A Study on Development of a Smart Wellness Robot Platform (스마트 웰니스 로봇 플랫폼 개발에 관한 연구)

  • Lee, Byoungsu;Kim, Seungwoo
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.17 no.1
    • /
    • pp.331-339
    • /
    • 2016
  • This paper developed a home wellness robot platform to perform the roles in basic health care and life care in an aging society. A robotic platform and a sensory platform were implemented for an indoor wellness service. In the robotic platform, the precise mobility and the dexterous manipulation are not only developed in a symbiotic service-robot, but they also ensure the robot architecture of human friendliness. The mobile robot was made in the agile system, which consists of Omni-wheels. The manipulator was made in the anthropomorphic system to carry out dexterous handwork. In the sensing platform, RF tags and stereo camera were used for self and target localization. They were processed independently and cooperatively for accurate position and posture. The wellness robot platform was integrated in a real-time system. Finally, its good performance was confirmed through live indoor tests for health and life care.

Visual Sensing of the Light Spot of a Laser Pointer for Robotic Applications

  • Park, Sung-Ho;Kim, Dong Uk;Do, Yongtae
    • Journal of Sensor Science and Technology
    • /
    • v.27 no.4
    • /
    • pp.216-220
    • /
    • 2018
  • In this paper, we present visual sensing techniques that can be used to teach a robot using a laser pointer. The light spot of an off-the-shelf laser pointer is detected and its movement is tracked on consecutive images of a camera. The three-dimensional position of the spot is calculated using stereo cameras. The light spot on the image is detected based on its color, brightness, and shape. The detection results in a binary image, and morphological processing steps are performed on the image to refine the detection. The movement of the laser spot is measured using two methods. The first is a simple method of specifying the region of interest (ROI) centered at the current location of the light spot and finding the spot within the ROI on the next image. It is assumed that the movement of the spot is not large on two consecutive images. The second method is using a Kalman filter, which has been widely employed in trajectory estimation problems. In our simulation study of various cases, Kalman filtering shows better results mostly. However, there is a problem of fitting the system model of the filter to the pattern of the spot movement.

A Study on the Selection and Applicability Analysis of 3D Terrain Modeling Sensor for Intelligent Excavation Robot (지능형 굴삭 로봇의 개발을 위한 로컬영역 3차원 모델링 센서 선정 및 현장 적용성 분석에 관한 연구)

  • Yoo, Hyun-Seok;Kwon, Soon-Wook;Kim, Young-Suk
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.33 no.6
    • /
    • pp.2551-2562
    • /
    • 2013
  • Since 2006, an Intelligent Excavation Robot which automatically performs the earth-work without operator has been developed in Korea. The technologies for automatically recognizing the terrain of work environment and detecting the objects such as obstacles or dump trucks are essential for its work quality and safety. In several countries, terrestrial 3D laser scanner and stereo vision camera have been used to model the local area around workspace of the automated construction equipment. However, these attempts have some problems that require high cost to make the sensor system or long processing time to eliminate the noise from 3D model outcome. The objectives of this study are to analyze the advantages of the existing 3D modeling sensors and to examine the applicability for practical use by using Analytic Hierarchical Process(AHP). In this study, 3D modeling quality and accuracy of modeling sensors were tested at the real earth-work environment.

Development of a Low-cost Monocular PSD Motion Capture System with Two Active Markers at Fixed Distance (일정간격의 두 능동마커를 이용한 저가형 단안 PSD 모션캡쳐 시스템 개발)

  • Seo, Pyeong-Won;Kim, Yu-Geon;Han, Chang-Ho;Ryu, Young-Kee;Oh, Choon-Suk
    • Journal of the Institute of Electronics Engineers of Korea SC
    • /
    • v.46 no.2
    • /
    • pp.61-71
    • /
    • 2009
  • In this paper, we propose a low-cost and compact motion capture system which enables to play motion games in PS2(Play Station 2). Recently, motion capture systems which are being used as a part in film producing and making games are too expensive and enormous systems. Now days, motion games using common USB camera are slow and have two-dimension recognition. But PSD sensor has a few good points, such as fast and low-cost. In recently year, 3D motion capture systems using 2D PSD (Position Sensitive Detector) optic sensor for motion capturing have been developed. One is Multi-PSD motion capture system applying stereo vision and another is Single-PSD motion capture system applying optical theory ship. But there are some problems to apply them to motion games. The Multi-PSD is high-cost and complicated because of using two more PSD Camera. It is so difficult to make markers having omni-direction equal intensity in Single-PSD. In this research, we propose a new theory that solves aforementioned problems. It can measure 3D coordination if separated two marker's intensity is equal to. We made a system based on this theory and experimented for performance capability. As a result, we were able to develop a motion capture system which is a single, low-cost, fast, compact, wide-angle and an adaptable motion games. The developed system is expected to be useful in animation, movies and games.

Relative Navigation Study Using Multiple PSD Sensor and Beacon Module Based on Kalman Filter (복수 PSD와 비콘을 이용한 칼만필터 기반 상대항법에 대한 연구)

  • Song, Jeonggyu;Jeong, Junho;Yang, Seungwon;Kim, Seungkeun;Suk, Jinyoung
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.46 no.3
    • /
    • pp.219-229
    • /
    • 2018
  • This paper proposes Kalman Filter-based relative navigation algorithms for proximity tasks such as rendezvous/docking/cluster-operation of spacecraft using PSD Sensors and Infrared Beacon Modules. Numerical simulations are performed for comparative analysis of the performance of each relative-navigation technique. Based on the operation principle and optical modeling of the PSD Sensor and the Infrared Beacon Module used in the relative navigation algorithm, a measurement model for the Kalman filter is constructed. The Extended Kalman Filter(EKF) and the Unscented Kalman Filter(UKF) are used as probabilistic relative navigation based on measurement fusion to utilize kinematics and dynamics information on translational and rotation motions of satellites. Relative position and relative attitude estimation performance of two filters is compared. Especially, through the simulation of various scenarios, performance changes are also investigated depending on the number of PSD Sensors and IR Beacons in target and chaser satellites.

IoT Based Intelligent Position and Posture Control of Home Wellness Robots (홈 웰니스 로봇의 사물인터넷 기반 지능형 자기 위치 및 자세 제어)

  • Lee, Byoungsu;Hyun, Chang-Ho;Kim, Seungwoo
    • Journal of IKEEE
    • /
    • v.18 no.4
    • /
    • pp.636-644
    • /
    • 2014
  • This paper is to technically implement the sensing platform for Home-Wellness Robot. First, self-localization technique is based on a smart home and object in a home environment, and IOT(Internet of Thing) between Home Wellness Robots. RF tag is set in a smart home and the absolute coordinate information is acquired by a object included RF reader. Then bluetooth communication between object and home wellness robot provides the absolute coordinate information to home wellness robot. After that, the relative coordinate of home wellness robot is found and self-localization through a stereo camera in a home wellness robot. Second, this paper proposed fuzzy control methode based on a vision sensor for approach object of home wellness robot. Based on a stereo camera equipped with face of home wellness robot, depth information to the object is extracted. Then figure out the angle difference between the object and home wellness robot by calculating a warped angle based on the center of the image. The obtained information is written Look-Up table and makes the attitude control for approaching object. Through the experimental with home wellness robot and the smart home environment, confirm performance about the proposed self-localization and posture control method respectively.

Study on a Suspension of a Planetary Exploration Rover to Improve Driving Performance During Overcoming Obstacles

  • Eom, We-Sub;Kim, Youn-Kyu;Lee, Joo-Hee;Choi, Gi-Hyuk;Sim, Eun-Sup
    • Journal of Astronomy and Space Sciences
    • /
    • v.29 no.4
    • /
    • pp.381-387
    • /
    • 2012
  • The planetary exploration rover executes various missions after moving to the target point in an unknown environment in the shortest distance. Such missions include the researches for geological and climatic conditions as well as the existence of water or living creatures. If there is any obstacle on the way, it is detected by such sensors as ultrasonic sensor, infrared light sensor, stereo vision, and laser ranger finder. After the obtained data is transferred to the main controller of the rover, decisions can be made to either overcome or avoid the obstacle on the way based on the operating algorithm of the rover. All the planetary exploration rovers which have been developed until now receive the information of the height or width of the obstacle from such sensors before analyzing it in order to find out whether it is possible to overcome the obstacle or not. If it is decided to be better to overcome the obstacle in terms of the operating safety and the electric consumption of the rover, it is generally made to overcome it. Therefore, for the purpose of carrying out the planetary exploration task, it is necessary to design the proper suspension system of the rover which enables it to safely overcome any obstacle on the way on the surface in any unknown environment. This study focuses on the design of the new double 4-bar linkage type of suspension system applied to the Korea Aerospace Research Institute rover (a tentatively name) that is currently in the process of development by our institute in order to develop the planetary exploration rover which absolutely requires the capacity of overcoming any obstacle. Throughout this study, the negative moment which harms the capacity of the rover for overcoming an obstacle was induced through the dynamical modeling process for the rocker-bogie applied to the Mars exploration rover of the US and the improved version of rocker-bogie as well as the suggested double 4-bar linkage type of suspension system. Also, based on the height of the obstacle, a simulation was carried out for the negative moment of the suspension system before the excellence of the suspension system suggested through the comparison of responding characteristics was proved.