• KIPS Transactions on Software and Data Engineering
• /
• v.8 no.5
• /
• pp.205-212
• /
• 2019

Scene graph is a kind of knowledge graph that represents both objects and their relationships found in a image. This paper proposes a 3D scene graph generation model for three-dimensional indoor environments. An 3D scene graph includes not only object types, their positions and attributes, but also three-dimensional spatial relationships between them, An 3D scene graph can be viewed as a prior knowledge base describing the given environment within that the agent will be deployed later. Therefore, 3D scene graphs can be used in many useful applications, such as visual question answering (VQA) and service robots. This proposed 3D scene graph generation model consists of four sub-networks: object detection network (ObjNet), attribute prediction network (AttNet), transfer network (TransNet), relationship prediction network (RelNet). Conducting several experiments with 3D simulated indoor environments provided by AI2-THOR, we confirmed that the proposed model shows high performance.

• 제어로봇시스템학회:학술대회논문집
• /
• 2003.10a
• /
• pp.835-838
• /
• 2003

Computer vision and natural-language dialogue play an important role in friendly human-machine interfaces for service robots. In this paper we describe an integrated face detection and face recognition system for a welfare robot, which has also been combined with the robot's speech interface. Our approach to face detection is to combine neural network (NN) and genetic algorithm (GA): ANN serves as a face filter while GA is used to search the image efficiently. When the face is detected, embedded Hidden Markov Model (EMM) is used to determine its identity. A real-time system has been created by combining the face detection and recognition techniques. When motivated by the speaker's voice commands, it takes an image from the camera, finds the face inside the image and recognizes it. Experiments on an indoor environment with complex backgrounds showed that a recognition rate of more than 88% can be achieved.

• 제어로봇시스템학회:학술대회논문집
• /
• 2003.10a
• /
• pp.1184-1189
• /
• 2003

Map building and position estimation capabilities are practically indispensable for a mobile robot to execute its given tasks in its working environments. An autonomous map building method and a smart localization method is proposed in our previous works. The experimental verifications are carried out in this paper. We applied the proposed algorithms to mobile service robots in large-scale indoor buildings. Experimental results show that our strategy is reliable and feasible in tough conditions like non-polygonal and dynamic environments. The advantages of the algorithms are well-illustrated through real experiments.

• Journal of Institute of Control, Robotics and Systems
• /
• v.15 no.8
• /
• pp.845-850
• /
• 2009

Localization which estimates a robot's position and orientation in a given environment is very important for mobile robot navigation. Although low-cost sensors are preferred for practical service robots, they suffer from the inaccurate and insufficient range information. This paper proposes a novel approach to increasing the success rate of low-cost sensor-based localization. In this paper, both the previous and the current data obtained from the IR sensors are used for localization in order to utilize as much environment information as possible without increasing the number of sensors. The sensor model used in the monte carlo localization (MCL) is modified so that the accumulated range information may be used to increase the accuracy in estimating the current robot pose. The experimental results show that the proposed method can robustly estimate the robot's pose in indoor environments with several similar places.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2012.11a
• /
• pp.662-664
• /
• 2012

실내 서비스로봇이 빠르고 정확하게 업무를 수행하기 위해 위치인식과 물체인식은 매우 중요한 요소이다. 본 논문에서는 실내 서비스로봇의 물체인식 성능을 객관적으로 비교 평가를 할 수 있도록 Sejong OFEX 데이터베이스를 구성하였고 이에 대하여 기술하고자 한다. 2009년에 제작되어 제공되었던 OFEX 1.0의 취약점을 보완한 OFEX 2.0를 소개하고 있다. OFEX 2.0에서는 OFEX 1.0과 같은 환경 조건을 이용하여 촬영을 하였지만 물체를 6가지로 증가시키고, 복잡배경 영상을 추가하였다. 또한 기존에는 없던 복합조건 영상을 제작하여 제공한다. OFEX 2.0을 이용하여 물체인식 관련 알고리즘 간의 성능 비교 및 새로운 물체인식 방법의 개발에 도움이 될 것으로 기대한다.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.15 no.7
• /
• pp.817-822
• /
• 2005

Recently tile study that exploits visual information for tile services of robot in indoor environments is active. Conventional image processing approaches are based on the pre-defined geometric models, so their performances are likely to decrease when they are applied to the uncertain and dynamic environments. For this, diverse researches to manage the uncertainty based on the knowledge for improving image recognition performance have been doing. In this paper we propose a Bayesian network modeling method for predicting the existence of target objects when they are occluded by other ones for improving the object detection performance of the service robots. The proposed method makes object relationship, so that it allows to predict the target object through observed ones. For this, we define the design method for small size Bayesian networks (primitive Bayesian netqork), and allow to integrate them following to the situations. The experiments are performed for verifying the performance of constructed model, and they shows $82.8\%$ of accuracy in 5 places.

• Journal of Institute of Control, Robotics and Systems
• /
• v.11 no.12
• /
• pp.996-1001
• /
• 2005

Recently, with the development of service robots and with the new concept of ubiquitous world, the position estimation of mobile objects has been raised to an important problem. As pre-liminary research results, some of the localization schemes are introduced, which provide the relative location of the moving objects subjected to accumulated errors. To implement a real time localization system, a new absolute position estimation method for a mobile robot in indoor environment is proposed in this paper. Design and implementation of the localization system comes from the usage of active beacon systems (based upon RFID technology). The active beacon system is composed of an RFID receiver and an ultra-sonic transmitter: 1. The RFID receiver gets the synchronization signal from the mobile robot and 2. The ultra-sonic transmitter sends out the traveling signal to be used for measuring the distance. Position of a mobile robot in a three dimensional space can be calculated basically from the distance information from. Three beacons and the absolute position information of the beacons themselves. In some case, the mobile robot can get the ultrasonic signals from only one or two beacons, because of the obstacles located along the moving path. Therefore, in this paper, as one of our dedicated contribution, the position estimation scheme with less than three sensors has been developed. Also, the extended Kalman filter algorithm is applied for the improvement of position estimation accuracy of the mobile robot.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.15 no.4
• /
• pp.759-764
• /
• 2011

This paper deals with the method of using the amended virtual force field technique to avoidance the front environment(wall, obstacles etc.) in navigating by using the environmental informations recognized by a ultrasonic-ring and pan/tilt CCD camera equipped on a mobile robot. we will give an explanation for the robot system architecture designed and implemented in this study and a short review of existing techniques, since there exist several recent thorough books and review paper on this paper. It is proposed the rusult from the experimental run based on a virtual force field(VFF) method to support the validity of the aforementioned architecture of mobile service robot for local navigation and obstacle avoidance for autonomous mobile robots. We will conclude by discussing some possible future extensions of the project. The results show that the proposed algorithm is apt to identify obstacles in an indoor environments to guide the robot to the goal location safely.

• The Journal of Korea Robotics Society
• /
• v.2 no.1
• /
• pp.40-47
• /
• 2007

Recently, with the development of service robots and with the new concept of ubiquitous world, the position estimation of mobile objects has been raised to an important problem. As pre-liminary research results, some of the localization schemes are introduced, which provide the absolute location of the moving objects subjected to large errors. To implement a precise and convenient localization system, a new absolute position estimation method for a mobile robot in indoor environment is proposed in this paper. Design and implementation of the localization system comes from the usage of active beacon systems (based upon RFID technology). The active beacon system is composed of an RFID receiver and an ultra-sonic transmitter: 1. The RFID receiver gets the synchronization signal from the mobile robot and 2. The ultra-sonic transmitter sends out the traveling signal to be used for measuring the distance. Position of a mobile robot in a three dimensional space can be calculated basically from the distance information from three beacons and the absolute position information of the beacons themselves. Since it is not easy to install the beacons at a specific position precisely, there exists a large localization error and the installation time takes long. To overcome these problems, and provide a precise and convenient localization system, a new auto calibration algorithm is developed in this paper. Also the extended Kalman filter has been adopted for improving the localization accuracy during the mobile robot navigation. The localization accuracy improvement through the proposed auto calibration algorithm and the extended Kalman filter has been demonstrated by the real experiments.

• Journal of Institute of Control, Robotics and Systems
• /
• v.15 no.11
• /
• pp.1102-1107
• /
• 2009

An ultrasonic sensor has been widely used as a range sensor for its low cost and capability of detecting some obstacles, such as glasses and black surfaces, which are not well detected by a laser scanner and an IR sensor. Although low-cost sensors are preferred for practical service robots, they suffer from the inaccurate and insufficient range information. This paper proposes a novel approach to obstacle avoidance using low-cost anisotropic ultrasonic sensors with wide beam angle. In this paper, obstacles can be detected by the proposed sensor configuration which consists of one transmitter and three receivers. Because even wide obstacles are represented by a point, which corresponds to the intersection of range data from each receiver of the anisotropic sensor, a robot cannot avoid wide obstacles successfully. This paper exploits the probabilistic mapping technique to avoid collision with various types of obstacles. The experimental results show that the proposed method can robustly avoid obstacles in most indoor environments.