• The Transactions of the Korean Institute of Electrical Engineers P
• /
• v.60 no.2
• /
• pp.63-67
• /
• 2011

This paper presents the mobile robot control based on vision system. The proposed vision based controller consist of the camera tracking controller and the formation controller. Th e camera controller has the adaptive gain based on IBVS. The formation controller which is designed in the sense of the Lyapunov stability follows the leader. Simluation results show that the proposed vision based mobile robot control is validated for indoor mobile robot applications.

• Journal of the Korea Society of Computer and Information
• /
• v.27 no.10
• /
• pp.19-28
• /
• 2022

In this paper, we propose the Detector Scheduler which determines the best tracking-by-detection (TBD) mechanism to perform real-time high-accurate multi-object tracking (MOT). The Detector Scheduler determines whether to run a detector by measuring the dissimilarity of features between different frames. Furthermore, we propose a self-supervision method to learn the Detector Scheduler with tracking results since it is difficult to generate ground truth (GT) for learning the Detector Scheduler. Our proposed self-supervision method generates pseudo labels on whether to run a detector when the dissimilarity of the object cardinality or appearance between frames increases. To this end, we propose the Detector Scheduling Loss to learn the Detector Scheduler. As a result, our proposed method achieves real-time high-accurate multi-object tracking by boosting the overall tracking speed while keeping the tracking accuracy at most.

• Journal of the Korean Society for Aeronautical & Space Sciences
• /
• v.37 no.3
• /
• pp.267-274
• /
• 2009

Recently, UAVs (Unmanned Aerial Vehicles) are expected much as the Unmanned Systems for various missions. These missions are often based on the Vision System. Especially, missions such as surveillance and pursuit have a process which is carried on through the transmitted vision data from the UAV. In case of small UAVs, monocular vision is often used to consider weights and expenses. Research of missions performance using the monocular vision is continued but, actually, ground and target model have difference in distance from the UAV. So, 3D distance measurement is still incorrect. In this study, Mean-Shift Algorithm, Optical Flow and Subspace Method are posed to estimate the relative depth. Mean-Shift Algorithm is used for target tracking and determining Region of Interest (ROI). Optical Flow includes image motion information using pixel intensity. After that, Subspace Method computes the translation and rotation of image and estimates the relative depth. Finally, we present the results of this study using images obtained from the UAV experiments.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.10 no.1
• /
• pp.191-196
• /
• 2006

This paper presents the moving object tracking method using vision system. In order to track object in real time, the image of moving object have to be located the origin of the image coordinate axes. Accordingly, Fuzzy Control System is investigated for tracking the moving object, which control the camera module with Pan/Tilt mechanism. Hereafter, so the this system is applied to mobile robot, we design and implement image processing board for vision system. Also fuzzy controller is implemented to the StrongArm board. Finally, the proposed fuzzy controller is useful for the real-time moving object tracking system by experiment.

• 제어로봇시스템학회:학술대회논문집
• /
• 2004.08a
• /
• pp.678-681
• /
• 2004

In this paper, efficient tracking of a moving object using optimal representative blocks is implemented by a mobile robot with a pan-tilt camera. The key idea comes from the fact that when the image size of moving object is shrunk in an image frame according to the distance between the camera of mobile robot and the moving object, the tracking performance of a moving object can be improved by changing the size of representative blocks according to the object image size. Motion estimation using Edge Detection(ED) and Block-Matching Algorithm(BMA) is often used in the case of moving object tracking by vision sensors. However these methods often miss the real-time vision data since these schemes suffer from the heavy computational load. In this paper, the optimal representative block that can reduce a lot of data to be computed, is defined and optimized by changing the size of representative block according to the size of object in the image frame to improve the tracking performance. The proposed algorithm is verified experimentally by using a two degree-of-freedom active camera mounted on a mobile robot.

• Journal of the Ergonomics Society of Korea
• /
• v.19 no.1
• /
• pp.91-100
• /
• 2000

In this paper the intent recognition system which recognizes the human's head movements as a simple non-verbal intent representation is presented. The system recognizes five basic intent representations. i.e., strong/weak affirmation. strong/weak negation, and ambiguity by image processing of nodding or shaking movements of head. The vision system for tracking the head movements is composed of CCD camera, image processing board and personal computer. The modified template matching method which replaces the reference image with the searched target image in the previous step is used for the robust tracking of the head movements. For the improvement of the processing speed, the searching is performed in the pyramid representation of the original image. By inspecting the variance of the head movement trajectories. we can recognizes the two basic intent representations - affirmation and negation. Also, by focusing the speed of the head movements, we can see the possibility which recognizes the strength of the intent representation.

• Proceedings of the Korean Society of Precision Engineering Conference
• /
• 2004.10a
• /
• pp.600-603
• /
• 2004

UAV (Unmanned Aerial Vehicle) is an aerial vehicle that can accomplish the mission without pilot. UAV was developed for a military purpose such as a reconnaissance in an early stage. Nowadays usage of UAV expands into a various field of civil industry such as a drawing a map, broadcasting, observation of environment. These UAV, need vision system to offer accurate information to person who manages on ground and to control the UAV itself. Especially LOS(Line-of-Sight) system wants to precisely control direction of system which wants to tracking object using vision sensor like an CCD camera, so it is very important in vision system. In this paper, we propose a method to recognize object from image which is acquired from camera mounted on gimbals and offer information of displacement between center of monitor and center of object.

• 제어로봇시스템학회:학술대회논문집
• /
• 2002.10a
• /
• pp.99.4-99
• /
• 2002

A two-dimensional moving target is necessarily captured by a 5 dot robot system using a robot vision technique. Here, a robot vision system with a visual skill so that it can take information for a moving target or object, specially two dimensionally moving, is introduced and its algorithm and control strategy are presented associated with it. The tracking algorithm is proposed and its performance is verified by experiment. The camera first captures the object, then it captures again after certain second. The position difference generates the horizontal and vertical velocities of the moving target, hence the final destination is estimated at gripping line. At the same time, the robot s...

• Journal of the Institute of Electronics and Information Engineers
• /
• v.49 no.12
• /
• pp.265-274
• /
• 2012

In this paper, we propose a method for preceding vehicle detection and tracking with motion estimation by radar-vision sensor fusion. The motion estimation proposed results in not only correction of inaccurate lateral position error observed on a radar target, but also adaptive detection and tracking of a preceding vehicle by compensating the changes in the geometric relation between the ego-vehicle and the ground due to the driving. Furthermore, the feature-based motion estimation employed to lessen computational burden reduces the number of deployment of the vehicle validation procedure. Experimental results prove that the correction by the proposed motion estimation improves the performance of the vehicle detection and makes the tracking accurate with high temporal consistency under various road conditions.

• 제어로봇시스템학회:학술대회논문집
• /
• 2001.10a
• /
• pp.134.5-134
• /
• 2001

The capability of environment recognition is very important for mobile robot. Especially, a function of target tracking is necessary in monitoring and watching an object using mobile robot. In general, vision sensors such as CCD camera and laser range finder were used for tracking of a moving target. However, they are not only affected by intensity of illumination in environment but also require high performance processors to process large amount of data. Therefore, in this paper, we propose the construction of target tracking system for mobile robot using only ultrasonic sensors to cope with these problems.