• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.14 no.3
• /
• pp.1121-1141
• /
• 2020

We propose a robust visual object tracking algorithm fusing a convolutional neural network tracker trained offline from a large number of video repositories and a color histogram based tracker to track objects for mixing immersive audio. Our algorithm addresses the problem of occlusion and large movements of the CNN based GOTURN generic object tracker. The key idea is the offline training of a binary classifier with the color histogram similarity values estimated via both trackers used in this method to opt appropriate tracker for target tracking and update both trackers with the predicted bounding box position of the target to continue tracking. Furthermore, a histogram similarity constraint is applied before updating the trackers to maximize the tracking accuracy. Finally, we compute the depth(z) of the target object by one of the prominent unsupervised monocular depth estimation algorithms to ensure the necessary 3D position of the tracked object to mix the immersive audio into that object. Our proposed algorithm demonstrates about 2% improved accuracy over the outperforming GOTURN algorithm in the existing VOT2014 tracking benchmark. Additionally, our tracker also works well to track multiple objects utilizing the concept of single object tracker but no demonstrations on any MOT benchmark.

• Journal of Institute of Control, Robotics and Systems
• /
• v.21 no.1
• /
• pp.7-13
• /
• 2015

Unmanned air vehicles (UAVs) are getting popular not only as a private usage for the aerial photograph but military usage for the surveillance, reconnaissance and supply missions. For an UAV to successfully achieve these kind of missions, geolocation (localization) must be implied to track an interested target or fly by reference. In this research, we adopted multi-sensor fusion (MSF) algorithm to increase the accuracy of the geolocation and verified the algorithm using two multicopter UAVs. One UAV is equipped with an optical camera, and another UAV is equipped with an optical camera and a laser range finder. Throughout the experiment, we have obtained measurements about a fixed ground target and estimated the target position by a series of coordinate transformations and sequential Kalman filter. The result showed that the MSF has better performance in estimating target location than the case of using single sensor. Moreover, the experimental result implied that multi-sensor geolocation algorithm is able to have further improvements in localization accuracy and feasibility of other complicated applications such as moving target tracking and multiple target tracking.

• Journal of Korea Multimedia Society
• /
• v.22 no.2
• /
• pp.167-177
• /
• 2019

Even though so much progresses have been achieved in Multiple Object Tracking (MOT), most of reported MOT methods are not still satisfactory for commercial embedded products like Pan-Tilt-Zoom (PTZ) camera. In this paper, we propose a real-time multiple pedestrians tracking method for embedded environments. First, we design a new light weight convolutional neural network(CNN)-based pedestrian detector, which is constructed to detect even small size pedestrians, as well. For further saving of processing time, the designed detector is applied for every other frame, and Kalman filter is employed to predict pedestrians' positions in frames where the designed CNN-based detector is not applied. The pose orientation information is incorporated to enhance object association for tracking pedestrians without further computational cost. Through experiments on Nvidia's embedded computing board, Jetson TX2, it is verified that the designed pedestrian detector detects even small size pedestrians fast and well, compared to many state-of-the-art detectors, and that the proposed tracking method can track pedestrians in real-time and show accuracy performance comparably to performances of many state-of-the-art tracking methods, which do not target for operation in embedded systems.

• Journal of the Institute of Electronics Engineers of Korea TE
• /
• v.42 no.2
• /
• pp.1-6
• /
• 2005

Ryu et al. proposed a multiple target DOA tracking algorithm using a linear sensor array. In Ryu's algorithm first, the signal subspace is estimated using sensor output and the angular innovations of targets are extracted from the estimated signal subspace. Next, the DOA's of targets are tracked using the angular innovations as the inputs of Kalman filters. Ryu's algorithm has good features that it has no data association problem and is efficient. However, Ryu's algorithm can't be a lied to an arbitrarily shaped array because it was proposed using linear sensor array. Actually, when the sensor array is used in the various application fields, sensors have a position error. Therefore, the sensor array can be an arbitrarily shaped array. In this paper, we propose a multiple target DOA tracking algorithm applicable to an arbitrarily shaped array, and it sustains the good features of Ryu's algorithm.

• 제어로봇시스템학회:학술대회논문집
• /
• 2000.10a
• /
• pp.363-363
• /
• 2000

The conventional algorithms which identify and follow a moving target using a camera located at a fixed position are not appropriate for applying to the cases o( using mobile robots, due to their long processing time. This paper proposes a new tracking algorithm based on the sensing system which uses a line light with a single camera. The algorithm categirizes the motion patterns of a pair of mobile objects into parallel, branching, and merging motion, to decide of which objects the trajectories should be calculated to follow the reference object. Kalman Filter is used to estimate the trajectories of selected objects. The proposed algorithm has shown in the experiments that the mobile robot does not miss the target in most cases.

• Journal of Institute of Control, Robotics and Systems
• /
• v.20 no.8
• /
• pp.882-889
• /
• 2014

This paper deals with a filterbank based on the IMM (Interacting Multiple Model) that combines data from a sensor and uses them selectively depending on a level of maneuver. Furthermore, within the maneuver interval, the existing IMM filter has disadvantages such as unnecessary target estimation errors caused by using a constant velocity model and an increase of computation load because of a fixed structure. On the other hand, the proposed IMM filterbank overcomes these disadvantages by using three model groups and designs a filterbank to cope with a wideband-maneuvering target. The performances of the IMM filterbank was evaluated through comparison with the existing IMM via computer simulations. The results show good performances for a wideband-maneuvering target.

• Proceedings of the KIEE Conference
• /
• 2005.10b
• /
• pp.499-501
• /
• 2005

When the target maneuver occurs, the estimate of the standard Kalman filter is biased and its performance may be seriously degraded. To solve this problem, this paper proposes a new intelligent estimation algorithm for a maneuvering target. This algorithm is to estimate the unknown target maneuver by a fuzzy system using the relation between the filter residual and its variation. The detected acceleration input is regarded as an additive process noise. To optimize the employed fuzzy system, the genetic algorithm (GA) is utilized. And then, the modified filter is corrected by the new update equation method using the fuzzy system. The tracking performance of the proposed method is compared with those of an interacting multiple model (IMM).

• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.55 no.3
• /
• pp.98-109
• /
• 2006

Fire control system(FCS) errors can be classified as hardware errors, filter prediction errors, effective ballistic function errors, and aiming errors. Among these errors, the filter prediction errors are the most significant error sources. To reduce them, a target future position calculation method using the acceleration estimate is suggested and it is compared with the constant velocity target prediction method. Simulation results show that the suggested method has better performance than the constant velocity prediction method. Target tracking algorithm is established with multiple target tracking filters based on IMM structure.

• Proceedings of the KIEE Conference
• /
• 1998.07b
• /
• pp.657-659
• /
• 1998

In this paper we discuss an algorithm to discriminate a target under track against multiple acoustic counter-measure (ACM) sources, based on sequential testings of multiple hypotheses. The ACM sources are separated from the target under track and generate, while drifting, measurements with false range and Doppler information. The purpose of the ACM is to mislead the target tracking and to help the true target evade a pursuer. The proposed algorithm uses as a test statistic a function of both the sequences of processed waveform signature and the innovation sequences from extended Kalman filters to estimate the target dynamics and the drifting positions of the ACM sources. Numerical experiments on various scenarios show that the proposed algorithm discriminates the target faster with a higher probability of success than the algorithm using only the innovation sequences from extended Kalman filters.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.8 no.9
• /
• pp.3196-3210
• /
• 2014

This paper presents a novel video metrology approach based on robust tracking. From videos acquired by an uncalibrated stationary camera, the foreground likelihood map is obtained by using the Codebook background modeling algorithm, and the multiple moving objects are tracked by a combined tracking algorithm. Then, we compute vanishing line of the ground plane and the vertical vanishing point of the scene, and extract the head feature points and the feet feature points in each frame of video sequences. Finally, we apply a single view mensuration algorithm to each of the frames to obtain height measurements and fuse the multi-frame measurements using RANSAC algorithm. Compared with other popular methods, our proposed algorithm does not require calibrating the camera, and can track the multiple moving objects when occlusion occurs. Therefore, it reduces the complexity of calculation and improves the accuracy of measurement simultaneously. The experimental results demonstrate that our method is effective and robust to occlusion.