• Journal of the Korean Society for Precision Engineering
• /
• v.30 no.4
• /
• pp.383-389
• /
• 2013

Demand for high-rising building has arisen. However, its maintenance is usually executed by labour. It could have a severe problem. We proposed a gondola robot to solve it. In this paper, we designed a height estimation sensor for this gondola. It is consist of pan-tilt unit, ARS sensor, and laser sensor. The pan-tilt unit keeps the laser sensor to indicate the gravity direction by referencing the ARS. The laser sensor's range is vertical distance from gondola to ground. However, if there is an obstacle under the gondola, the distance includes its height. To filter it out, we apply a Kalman filter for the height estimation. If the estimated height is changed extremely, the filter decides that there is an obstacle. Then, it remembers the height of obstacle. Other extreme changes of height estimations are reflected. The experimental results using the proposed sensor system show detail flow of the height estimation.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.10 no.7
• /
• pp.793-800
• /
• 2015

We presented a method to perform simultaneously both head-eye calibration and wheel calibration for a mobile robot that has a stereo camera mounted on the pan-tilt mechanism. Such a mobile robot system prevails recently. However, conventional methods are not applicable to this system because they assumed that camera systems were mounted on fixed structures. Building on conventional methods, we devised an iterative linear solution to solve the problem, and achieved satisfactory results in terms of accuracy in addition to efficiency due to simultaneous calibration. Furthermore, the calibration accuracy was improved by nonlinear optimization.

• Proceedings of the Korea Contents Association Conference
• /
• 2004.05a
• /
• pp.396-400
• /
• 2004

In this study, we have proposed the tracking system of single moving object. The tracking system was estimated motion using differential image, and than track the moving object by controlled Pan/Tilt device of camera. Proposed tracking system is devided into image acquisition and preprocessing phase, motion estimation phase and object tracking phase. To estimation the motion, differential image method was used. In the binary differential image, decision of threshold value was used adaptive method. And in grouping the object area, block_based recursive labeling algorithm was used. As a result of experiment, motion of moving object can be estimated. The result of tracking, object was not lost and object was tracked correctly.

• Journal of Korea Multimedia Society
• /
• v.4 no.6
• /
• pp.510-517
• /
• 2001

In this paper, we implement a real time speaker close-up system using lip motion information from input images having some people. After detecting a speaker from input moving pictures through one color CCD camera, the other camera closes up the speaker by using lip motion information. The implemented system detects a face and lip area of each person by means of a facial color and a morphological information, and then finds out a speaker by using lip area variation. A PTZ(Pan/Tilt/Zoom) camera is used in order to close up the detected speaker and it is controlled by RS-232C serial port. Consequently, we can exactly detect a speaker in input moving pictures including more than three people.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.8 no.2
• /
• pp.95-104
• /
• 2012

In this paper, an estimation of person height and 3D location of a moving person by using the pan/tilt-embedded stereo tracking system is suggested and implemented. In the proposed system, face coordinates of a target person is detected from the sequential input stereo image pairs by using the YCbCr color model and phase-type correlation methods and then, using this data as well as the geometric information of the stereo tracking system, distance to the target from the stereo camera and 3-dimensional location information of a target person are extracted. Basing on these extracted data the pan/tilt system embedded in the stereo camera is controlled to adaptively track a moving person and as a result, moving trajectory of a target person can be obtained. From some experiments using 780 frames of the sequential stereo image pairs, it is analyzed that standard deviation of the position displacement of the target in the horizontal and vertical directions after tracking is kept to be very low value of 1.5, 0.42 for 780 frames on average, and error ratio between the measured and computed 3D coordinate values of the target is also kept to be very low value of 0.5% on average. These good experimental results suggest a possibility of implementation of a new stereo target tracking system having a high degree of accuracy and a very fast response time with this proposed algorithm.

• Journal of the Korean Society for Precision Engineering
• /
• v.34 no.2
• /
• pp.125-131
• /
• 2017

2-Axis Pan and Tilt Motion Platform, a complex multivariate non-linear system, may incur any disturbance, thus requiring system controller with robustness against various disturbances. In this study, we designed an adaptive backstepping compensated controller by estimating the disturbance and error using the Radial Basis Function Neural Network (RBF NN). In this process, Uniformly Ultimately Bounded (UUB) was demonstrated via Lyapunov and stability was confirmed. By generating progressive disturbance to the irregular frequency and amplitude changes, it was verified for various environmental disturbances. In addition, by setting the RBF NN input vector to the minimum, the estimated disturbance compensation process was analyzed. Only two input vectors facilitated compensatory function of RBF NN via estimating the modeling and control error values as well as irregular disturbance; the application of the process resulted in improved backstepping controller performance that was confirmed through simulation.

• The Journal of Korea Robotics Society
• /
• v.6 no.3
• /
• pp.210-219
• /
• 2011

This paper studies how to combine devices such as monocular/stereo cameras, motors for panning/tilting, fisheye lens and convex mirrors, in order to solve vision-based robotic problems. To overcome the well-known trade-offs between optical properties, we present two mixed versions of the new systems. The first system is the robot photographer with a conventional pan/tilt perspective camera and fisheye lens. The second system is the omnidirectional detector for a complete 360-degree field-of-view surveillance system. We build an original device that combines a stereo-catadioptric camera and a pan/tilt stereo-perspective camera, and also apply it in the real environment. Compared to the previous systems, we show benefits of two proposed systems in aspects of maintaining both high-speed and high resolution with collaborative moving cameras and having enormous search space with hybrid configuration. The experimental results are provided to show the effectiveness of the mixing collaborative and hybrid systems.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.35 no.4C
• /
• pp.408-414
• /
• 2010

When we are collecting traffic information on CCTV images, we have to install the detect zone in the image area during pan-tilt system is on duty. An automation of detect zone with pan-tilt system is not easy because of machine error. So the fisheye lens attached camera or convex mirror camera is needed for getting wide area images. In this situation some troubles are happened, that is a decreased system speed or image distortion. This distortion is caused by occlusion of angled ray as like trembled snapshot in digital camera. In this paper, we propose two methods of de-blurring to overcome distortion, the one is image segmentation by nonlinear diffusion equation and the other is deformation for some segmented area. As the results of doing de-blurring methods, the de-blurring image has 15 decibel increased PSNR and the detection rate of collecting traffic information is more than 5% increasing than in distorted images.

• Journal of Information Display
• /
• v.6 no.4
• /
• pp.16-25
• /
• 2005

In this paper, a new 3D object tracking system using the disparity motion vector (DMV) is presented. In the proposed method, the time-sequential disparity maps are extracted from the sequence of the stereo input image pairs and these disparity maps are used to sequentially estimate the DMV defined as a disparity difference between two consecutive disparity maps Similarly to motion vectors in the conventional video signals, the DMV provides us with motion information of a moving target by showing a relatively large change in the disparity values in the target areas. Accordingly, this DMV helps detect the target area and its location coordinates. Based on these location data of a moving target, the pan/tilt embedded in the stereo camera system can be controlled and consequently achieve real-time stereo tracking of a moving target. From the results of experiments with 9 frames of the stereo image pairs having 256x256 pixels, it is shown that the proposed DMV-based stereo object tracking system can track the moving target with a relatively low error ratio of about 3.05 % on average.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.6 no.4
• /
• pp.349-354
• /
• 2005

The study on computer vision is aimed on creating a system to substitute the ability of human visual sensor. Especially, moving object tracking system is becoming an important area of study. In this study, we have proposed the tracking system of single moving object based on motion estimation. The tracking system performed motion estimation using differential image, and then tracked the moving object by controlling Pan/Tilt device of camera. Proposed tracking system is devided into image acquisition and preprocessing phase, motion estimation phase and object tracking phase. As a result of experiment, motion of moving object can be estimated. The result of tracking, object was not lost and tracked correctly.