• Transactions of the Korean Society of Mechanical Engineers A
• /
• v.36 no.6
• /
• pp.629-635
• /
• 2012

Tracked robots usually have poor localization performance because of slippage of their tracks. This study proposes a new localization method for tracked robots that uses fuzzy fusion of stereo-camera-based visual odometry and encoder-based wheel odometry. Visual odometry can be inaccurate when an insufficient number of visual features are available, while the encoder is prone to accumulating errors when large slips occur. To combine these two methods, the weight of each method was controlled by a fuzzy decision depending on the surrounding environment. The experimental results show that the proposed scheme improved the localization performance of a tracked robot.

• Journal of Korea Spatial Information System Society
• /
• v.11 no.1
• /
• pp.195-199
• /
• 2009

Augmented reality is a field of computer research which deals with the combination of real-world and computer-generated data, where computer graphics objects are blended into real footage in real time and it has tremendous potential in visualizing geospatial information. However, to utilize augmented reality in mobile system, many researches have undergone with GPS or marker based approaches. Localization and tracking of current position become more complex problem when it is used in indoor environments. Many proposed RF based tracking and localization. However, it does cause deployment problems of large sensors and readers. In this paper, we present a noble markerless AR approach for indoor navigation system only using a camera. We will apply this work to mobile seamless indoor/outdoor u-GIS system.

• Journal of Institute of Control, Robotics and Systems
• /
• v.20 no.1
• /
• pp.70-77
• /
• 2014

This paper proposes a novel localization algorithm based on ego-motion which used Lucas-Kanade Optical Flow and warping image obtained through fish-eye lenses mounted on the robots. The omnidirectional image sensor is a desirable sensor for real-time view-based recognition of a robot because the all information around the robot can be obtained simultaneously. The preprocessing (distortion correction, image merge, etc.) of the omnidirectional image which obtained by camera using reflect in mirror or by connection of multiple camera images is essential because it is difficult to obtain information from the original image. The core of the proposed algorithm may be summarized as follows: First, we capture instantaneous $360^{\circ}$ panoramic images around a robot through fish-eye lenses which are mounted in the bottom direction. Second, we extract motion vectors using Lucas-Kanade Optical Flow in preprocessed image. Third, we estimate the robot position and angle using ego-motion method which used direction of vector and vanishing point obtained by RANSAC. We confirmed the reliability of localization algorithm using ego-motion based on fisheye warping image through comparison between results (position and angle) of the experiment obtained using the proposed algorithm and results of the experiment measured from Global Vision Localization System.

• The Journal of Korea Robotics Society
• /
• v.6 no.3
• /
• pp.197-209
• /
• 2011

This paper presents a localization system using ceiling images in a large indoor environment. For a system with low cost and complexity, we propose a single camera based system that utilizes ceiling images acquired from a camera installed to point upwards. For reliable operation, we propose a method using hybrid features which include natural landmarks in a natural scene and artificial landmarks observable in an infrared ray domain. Compared with previous works utilizing only infrared based features, our method reduces the required number of artificial features as we exploit both natural and artificial features. In addition, compared with previous works using only natural scene, our method has an advantage in the convergence speed and robustness as an observation of an artificial feature provides a crucial clue for robot pose estimation. In an experiment with challenging situations in a real environment, our method was performed impressively in terms of the robustness and accuracy. To our knowledge, our method is the first ceiling vision based localization method using features from both visible and infrared rays domains. Our system can be easily utilized with a variety of service robot applications in a large indoor environment.

• Transactions of the Korean Society of Mechanical Engineers A
• /
• v.31 no.4
• /
• pp.517-524
• /
• 2007

This paper presents a global localization method using circular correlation of an omni-directional image. The localization of a mobile robot, especially in indoor conditions, is a key component in the development of useful service robots. Though stereo vision is widely used for localization, its performance is limited due to computational complexity and its narrow view angle. To compensate for these shortcomings, we utilize a single omni-directional camera which can capture instantaneous $360^{\circ}$ panoramic images around a robot. Nodes around a robot are extracted by the correlation coefficients of CHL (Circular Horizontal Line) between the landmark and the current captured image. After finding possible near nodes, the robot moves to the nearest node based on the correlation values and the positions of these nodes. To accelerate computation, correlation values are calculated based on Fast Fourier Transforms. Experimental results and performance in a real home environment have shown the feasibility of the method.

• Journal of the Korean Society of Industry Convergence
• /
• v.23 no.2_2
• /
• pp.255-261
• /
• 2020

We consider the problem of autonomously flying a quadcopter in indoor environments. Navigation in indoor settings poses two major issues. First, real time recognition of the marker captured by the camera. Second, The combination of the distributed images is used to determine the position and orientation of the quadcopter in an indoor environment. We autonomously fly a miniature RC quadcopter in small known environments using an on-board camera as the only sensor. We use an algorithm that combines data-driven image classification with image-combine techniques on the images captured by the camera to achieve real 3D localization and navigation.

• Journal of Institute of Control, Robotics and Systems
• /
• v.22 no.5
• /
• pp.367-373
• /
• 2016

In this paper, range measurement performance of LRF (Laser Range Finder) module and image contrast of color CCD camera are evaluated under the aerosol (high temperature steam) environments, which are simulated severe accident conditions of the LWR (Light-Water-Reactor) nuclear power plant. Data of LRF and color CCD camera are key informations, which are needed in the implementation of SLAM (Simultaneous Localization and Mapping) function for emergency response robot system to cope with urgently accidents of the nuclear power plant.

• 전자공학회논문지 IE
• /
• v.43 no.4
• /
• pp.128-135
• /
• 2006

This paper proposes the control method of fuzzy based sensor fusion by using the self localization of environment, position data by dead reckoning of the encoder and world map from sonic sensors. The proposed fuzzy based sensor fusion system recognizes the object and extracts features such as edge, distance and patterns for generating the world map and self localization. Therefore, this paper has developed fuzzy based control of mobile robot with experimentations in a corridor environment.

• Proceedings of the KIEE Conference
• /
• 2004.11c
• /
• pp.459-461
• /
• 2004

This paper presents an implementation of real-time speaker localization using audio-visual information. Four channels of microphone signals are processed to detect vertical as well as horizontal speaker positions. At first short-time average magnitude difference function(AMDF) signals are used to determine whether the microphone signals are human voices or not. And then the orientation and distance information of the sound sources can be obtained through interaural time difference and interaual level differences. Finally visual information by a camera helps get finer tuning of the speaker orientation. Experimental results of the real-time localization system show that the performance improves to 99.6% compared to the rate of 88.8% when only the audio information is used.

• Proceedings of the KIEE Conference
• /
• 2006.10c
• /
• pp.545-547
• /
• 2006

This paper propose a localization method using color landmark that is applicable to mobile intelligent robot. The color landmarks are attached in the indoor ceiling. The world coordinate of robot is estimated by color patterns and the coordinates of landmarks. A landmark is composed of 4color and these 4 colors are sorted in a line. All of landmarks have a main color which indicates direction of robot. Other 3 colors are the combination of 5 kind of colors. The CCD camera is installed on the top of robot to observe the landmarks in the ceiling.