• Journal of the Korean Institute of Telematics and Electronics D
• /
• v.35D no.12
• /
• pp.99-107
• /
• 1998

A stereo vision system such as the structure of human's eyes has two cameras at separated positions from which we can obtain two input images and then put them together to create 3-D image. It can show more virtual effect than the conventional 2-D image system. But, the stereo image system has to control the convergence angle so that the stereo disparity could always be zero because observers can be fatigued and unconscious of stereo image in conditions that the stereo disparity is not zero for a long work. Therefore, in the paper, optical JTC system which can process adaptive tracking of a specific moving object is proposed as a new approach to keep the stereo disparity to be zero. In this method, optical JTC system obtains the values of the relative locations of a moving objects in left and right images and then these values are used for maintaining the stereo disparity to be zero. Through some optical experiments the proposed stereo vision system is proved to be insensitive to background noises and operate in real-time.

• Proceedings of the IEEK Conference
• /
• 1998.10a
• /
• pp.973-976
• /
• 1998

스테레오 물체추적 시스템은 스테레오 비젼 시스템의 입체 영상에서 나타나는 스테레오 시차를 없애 주는 주시각 제어와 이동 물체를 영상의 중앙에 위치시키기 위한 팬/틸트 제어를 통해 이동 물체를 추적하게 된다. 본 논문에서는 스테레오 물체추적 시스템의 새로운 접근방법으로 적응적 물체 추적이 가능한 광 JTC를 이용해 이동 물체를 추적하는 스테레오 물체추적 시뮬레이터를 구현하였다. 이를 이용하여 여러 종류의 입력 영상에 따른 광 JTC 의 추적 결과를 분석하여 실험 결과를 예측할 수 있었으며, 이를 광학적으로 구현할 경우 배경 잡음에 강하고 실 시간적 물체 추적이 가능한 스테레오 물체추적 시스템을 구현할 수 있음을 제시하였다.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.31 no.1C
• /
• pp.26-35
• /
• 2006

In this paper, an automatic mobile robot system for a intelligent path planning using the detection scheme of the spatial coordinates based on stereo camera is proposed. In the proposed system, face area of a moving person is detected from a left image among the stereo image pairs by using the YCbCr color model and its center coordinates are computed by using the centroid method and then using these data, the stereo camera embedded on the mobile robot can be controlled for tracking the moving target in real-time. Moreover, using the disparity map obtained from the left and right images captured by the tracking-controlled stereo camera system and the perspective transformation between a 3-D scene and an image plane, depth information can be detected. Finally, based-on the analysis of these calculated coordinates, a mobile robot system is derived as a intelligent path planning and a estimation. From some experiments on robot driving with 240 frames of the stereo images, it is analyzed that error ratio between the calculated and measured values of the distance between the mobile robot and the objects, and relative distance between the other objects is found to be very low value of $2.19\%$ and $1.52\%$ on average, respectably.

• Journal of Institute of Control, Robotics and Systems
• /
• v.22 no.8
• /
• pp.579-584
• /
• 2016

When surgical instruments are tracked in an image-guided surgical navigation system, a stereo vision system with high accuracy is generally used, which is called optical tracker. However, this optical tracker has the disadvantage that a line-of-sight between the tracker and surgical instrument must be maintained. Therefore, to complement the disadvantage of optical tracking systems, an internal vision sensor is attached to a surgical instrument in this paper. Monitoring the target marker pattern attached on patient with this vision sensor, this surgical instrument is possible to be tracked even when the line-of-sight of the optical tracker is occluded. To verify the system's effectiveness, a series of basic experiments is carried out. Lastly, an integration experiment is conducted. The experimental results show that rotational error is bounded to max $1.32^{\circ}$ and mean $0.35^{\circ}$, and translation error is in max 1.72mm and mean 0.58mm. Finally, it is confirmed that the proposed tool tracking method using an internal vision sensor is useful and effective to overcome the occlusion problem of the optical tracker.

• Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
• /
• v.21 no.8
• /
• pp.87-95
• /
• 2007

In this paper, we analyzed the mr detection and the stability of the object tracking system by an adaptive stereo object hacking using region-based MAD(Mean Absolute Difference) algorithm and the modified PID(Proportional Integral Derivative)-based pan/tilt controller. That is, in the proposed system, the location coordinates of the target object in the right and left images are extracted from the sequential stereo input image by applying a region-based MAD algorithm and the configuration parameter of the stereo camera, and then these values could effectively control to pan/tilt of the stereo camera under the noisy circumstances through the modified PID controller. Accordingly, an adaptive control effect of a moving object can be analyzed through the advanced system with the proposed 3D robot vision, in which the possibility of real-time implementation of the robot vision system is also confirmed.

• Journal of Power System Engineering
• /
• v.6 no.1
• /
• pp.96-101
• /
• 2002

In this paper, we address the problem of controlling an end-effector to track and grab a moving target using the visual servoing technique. A visual servo mechanism based on the image-based servoing principle, is proposed by using visual feedback to control an end-effector without calibrated robot and camera models. Firstly, we consider the control problem as a nonlinear least squares optimization and update the joint angles through the Taylor Series Expansion. And to track a moving target in real time, the Jacobian estimation scheme(Dynamic Broyden's Method) is used to estimate the combined robot and image Jacobian. Using this algorithm, we can drive the objective function value to a neighborhood of zero. To show the effectiveness of the proposed algorithm, simulation results for a six degree of freedom robot are presented.

• Proceedings of the Korean Institute of Communication Sciences Conference
• /
• 2004.07a
• /
• pp.230-230
• /
• 2004

• Journal of the Korea Computer Industry Society
• /
• v.3 no.9
• /
• pp.1145-1156
• /
• 2002

A method to measure the speed and distance of moving object is proposed using the stereo vision system. One of the most important factors for measuring the speed and distance of moving object is the accuracy of object tracking. Accordingly, the background image algorithm is adopted to track the rapidly moving object and the local opening operator algorithm is used to remove the shadow and noise of object. The extraction efficiency of moving object is improved by using the adaptive threshold algorithm independent to variation of brightness. Since the left and right central points are compensated, the more exact speed and distance of object can be measured. Using the background image algorithm and local opening operator algorithm, the computational processes are reduced and it is possible to achieve the real-time processing of the speed and distance of moving object. The simulation results show that background image algorithm can track the moving object more rapidly than any other algorithm. The application of adaptive threshold algorithm improved the extraction efficiency of the target by reducing the candidate areas. Since the central point of the target is compensated by using the binocular parallax, the error of measurement for the speed and distance of moving object is reduced. The error rate of measurement for the distance from the stereo camera to moving object and for the speed of moving object are 2.68% and 3.32%, respectively.

• Journal of Advanced Navigation Technology
• /
• v.13 no.5
• /
• pp.705-713
• /
• 2009

This paper proposes CORBA-based visual servoing system of humanoid robot. To effectively control the humanoid robot which is connected to network, it needs to define necessary services for visual servoing as distribution object, and realize them in the middleware. For realizing it following services should be addressed. Naming service for searching a necessary service with unique name assigned to each object, image service for supplying image obtained from stereo camera. In the experiment, we show the result of balloon tracking and bursting that the robot tracks balloons as target objects in the real time, and if a balloon stop for a certain time, then the robot bursts the balloon.

• Journal of Advanced Navigation Technology
• /
• v.14 no.4
• /
• pp.571-577
• /
• 2010

Driving aircraft requires extremely complicated and detailed information processing. Pilots perform their tasks by selecting the information relevant to them. In this processing, spatial information presented simultaneously through crossmodal link is advantageous over the one provided in singular sensory mode. In this paper, probability to apply providing visual spatial information along with auditory information to enemy tracking system in aircraft navigation is empirically investigated. The result shows that auditory spatial information, which is virtually created through HRTF is advantageous to visual spatial information alone in attention processing. The findings suggest auditory spatial information along with visual one can be presented through crossmodal link by utilizing stereophonic sound such as HRTF. which is available in the existing simple stereo system.