• International Journal of Internet, Broadcasting and Communication
• /
• 제7권2호
• /
• pp.1-8
• /
• 2015

Tracking of an object in 3D space performed in real-time is a significant task in different domains from autonomous robots to smart vehicles. In traditional methods, specific data acquisition equipments such as radars, lasers etc, are used. Contemporary computer technology development accelerates image processing, and it results in three-dimensional stereo vision to be used for localizing and object tracking in space. This paper describes a system for tracking three dimensional motion of an object using color information in real time. We create stereo images using pair of a simple web camera, raw data of an object positions are collected under realistic noisy conditions. The system has been tested using OpenCV and Matlab and the results of the experiments are presented here.

• 전자공학회논문지T
• /
• 제35T권2호
• /
• pp.28-34
• /
• 1998

본 논문에서는 3차원 영상 처리 시스템을 이용한 이동 물체 추적을 위한 경계선 추출 알고리즘을 제시하였다. 이동 물체의 검출은 입력 영상에서 차 영상 기법을 이용하였고, 이동 물체 검출을 위한 검출 윈도우는 처리시간을 줄이기 위하여 4개의 예상영역과 물체영역으로 구성하였으며, 크기는 이동 물체의 크기와 중심 좌표에 대한 예측 계수에 의해 정하였고, 추적 카메라는 직류 모터에 의해 X, Y 방향으로 이동하도록 하였다. 모형 자동차를 이용하여 알고리즘을 수행한 결과, 최대 추적 시간은 2초였고, 추적 에러는 물체 크기의 6% 이하였다.

• 대한전자공학회:학술대회논문집
• /
• 대한전자공학회 2008년도 하계종합학술대회
• /
• pp.1203-1204
• /
• 2008

In this paper, a new stereo object tracking system using the disparity motion vector is proposed. In the proposed method, the time-sequential disparity motion vector can be estimated from the disparity vectors which are extracted from the sequence of the stereo input image pair and then using these disparity motion vectors, the area where the target object is located and its location coordinate are detected from the input stereo image. Basing on this location data of the target object, the pan/tilt embedded in the stereo camera system can be controlled and as a result, 3D tracking of the target object can be possible.

• 대한기계학회논문집A
• /
• 제37권10호
• /
• pp.1219-1227
• /
• 2013

눈 움직임만으로 물건을 집고자 하는 사지장애자를 위한 웨어러블 로봇을 소개한다. 이 로봇에서는 시선위치추적 알고리즘을 적용하여 파지하고자 하는 물체를 보는 동공의 움직임을 확인하여 물체의 2차원 정보를 구하고 물체까지의 깊이는 로봇 어깨위에 올려져 있는 Kinect라는 장치를 사용하여 구한다. 물체와 로봇, 그리고 카메라간의 좌표변환과 매칭을 통하여 최종 물체의 3차원 정보를 추출하고 이 정보는 로봇제어기인 DSP로 전송되어 물체를 잡을 수 있도록 제어하게 되어 궁극적으로 사용자가 물체를 정확히 잡을 수 있도록 한다.

• Journal of Information Display
• /
• 제6권4호
• /
• pp.16-25
• /
• 2005

In this paper, a new 3D object tracking system using the disparity motion vector (DMV) is presented. In the proposed method, the time-sequential disparity maps are extracted from the sequence of the stereo input image pairs and these disparity maps are used to sequentially estimate the DMV defined as a disparity difference between two consecutive disparity maps Similarly to motion vectors in the conventional video signals, the DMV provides us with motion information of a moving target by showing a relatively large change in the disparity values in the target areas. Accordingly, this DMV helps detect the target area and its location coordinates. Based on these location data of a moving target, the pan/tilt embedded in the stereo camera system can be controlled and consequently achieve real-time stereo tracking of a moving target. From the results of experiments with 9 frames of the stereo image pairs having 256x256 pixels, it is shown that the proposed DMV-based stereo object tracking system can track the moving target with a relatively low error ratio of about 3.05 % on average.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제14권3호
• /
• pp.1121-1141
• /
• 2020

We propose a robust visual object tracking algorithm fusing a convolutional neural network tracker trained offline from a large number of video repositories and a color histogram based tracker to track objects for mixing immersive audio. Our algorithm addresses the problem of occlusion and large movements of the CNN based GOTURN generic object tracker. The key idea is the offline training of a binary classifier with the color histogram similarity values estimated via both trackers used in this method to opt appropriate tracker for target tracking and update both trackers with the predicted bounding box position of the target to continue tracking. Furthermore, a histogram similarity constraint is applied before updating the trackers to maximize the tracking accuracy. Finally, we compute the depth(z) of the target object by one of the prominent unsupervised monocular depth estimation algorithms to ensure the necessary 3D position of the tracked object to mix the immersive audio into that object. Our proposed algorithm demonstrates about 2% improved accuracy over the outperforming GOTURN algorithm in the existing VOT2014 tracking benchmark. Additionally, our tracker also works well to track multiple objects utilizing the concept of single object tracker but no demonstrations on any MOT benchmark.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 2004년도 ICCAS
• /
• pp.1458-1463
• /
• 2004

Tracking is one of the most important pre-required task for many application such as human-computer interaction through gesture and face recognition, motion analysis, visual servoing, augment reality, industrial assembly and robot obstacle avoidance. Recently, 3D information of object is required in realtime for many aforementioned applications. 3D tracking is difficult problem to solve because during the image formation process of the camera, explicit 3D information about objects in the scene is lost. Recently, many vision system use stereo camera especially for 3D tracking. The 3D feature based tracking(3DFBT) which is on of the 3D tracking system using stereo vision have many advantage compare to other tracking methods. If we assumed the correspondence problem which is one of the subproblem of 3DFBT is solved, the accuracy of tracking depends on the accuracy of camera calibration. However, The existing calibration method based on accurate camera model so that modelling error and weakness to lens distortion are embedded. Therefore, this thesis proposes 3D feature based tracking method using SVM which is used to solve reconstruction problem.

• 한국항행학회논문지
• /
• 제20권1호
• /
• pp.53-58
• /
• 2016

우리는 본 논문에서 이차 칼만 필터를 이용한 영상 기반 객체 추적분야의 새로운 알고리즘을 제안한다. 최근에 발표된 이차 칼만 필터는 영상 기반의 객체의 실제 3차원 공간의 위치를 추적하는 것에는 아직 적용되지 않았다. 2차원 영상 내의 위치를 3차원 공간상의 위치로 환원시키는 것은 비선형적 변환을 수반하기 때문에 그에 맞는 추적 알고리즘을 사용해야만 한다. 이러한 상황에서, 비선형 수식을 이차식으로 근사화하는 이차 칼만 필터가 선형으로 근사화하는 확장 칼만 필터보다 더 정확한 성능을 낼 수 있다. 우리는 동일한 상황을 가정하여 확장 칼만 필터, 무향 칼만 필터, 파티클 필터, 그리고 우리가 제안한 이차 칼만 필터를 이용하여 객체를 추적하고, 그 결과를 비교해 본다. 결론적으로 이차 칼만 필터가 발산율이 확장 칼만 필터에 비해 거의 절반가량 감소하며, 추적 정확도 측면에서 무향 칼만 필터에 비해 1% 가량 우수한 성능을 나타낸다.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 2003년도 ICCAS
• /
• pp.1377-1381
• /
• 2003

This paper describes real time object tracking of 3D objects in 2D image sequences. The moving objects are segmented from the image sequence using morphological operations. The moving objects are segmented by the method of differential image followed by the process of morphological dilation. The moving objects are recognized and tracked using statistical moments. The direction of moving objects are determined by the Hough transform. The straight lines in the moving objects are found with the help of Hough transform. The direction of the moving object is calculated from the orientation of the straight lines in the direction of the principal axes of the moving objects. The direction of the moving object and the displacement of the object in the image sequence is used to calculate the velocity of the moving objects. The simulation results of the proposed method are promising on the test images.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 2003년도 ICCAS
• /
• pp.798-802
• /
• 2003

The robustness and reliability of vision algorithms is the key issue in robotic research and industrial applications. In this paper, the robust real time visual tracking in complex scene is considered. A common approach to increase robustness of a tracking system is to use different models (CAD model etc.) known a priori. Also fusion of multiple features facilitates robust detection and tracking of objects in scenes of realistic complexity. Because voting is a very simple or no model is needed for fusion, voting-based fusion of cues is applied. The approach for this algorithm is tested in a 3D Cartesian robot which tracks a toy vehicle moving along 3D rail, and the Kalman filter is used to estimate the motion parameters, namely the system state vector of moving object with unknown dynamics. Experimental results show that fusion of cues and motion estimation in a tracking system has a robust performance.