• Title/Summary/Keyword: Fuzzy environment map

Search Result 34, Processing Time 0.027 seconds

A Function Approximation Method for Q-learning of Reinforcement Learning (강화학습의 Q-learning을 위한 함수근사 방법)

  • 이영아;정태충
    • Journal of KIISE:Software and Applications
    • /
    • v.31 no.11
    • /
    • pp.1431-1438
    • /
    • 2004
  • Reinforcement learning learns policies for accomplishing a task's goal by experience through interaction between agent and environment. Q-learning, basis algorithm of reinforcement learning, has the problem of curse of dimensionality and slow learning speed in the incipient stage of learning. In order to solve the problems of Q-learning, new function approximation methods suitable for reinforcement learning should be studied. In this paper, to improve these problems, we suggest Fuzzy Q-Map algorithm that is based on online fuzzy clustering. Fuzzy Q-Map is a function approximation method suitable to reinforcement learning that can do on-line teaming and express uncertainty of environment. We made an experiment on the mountain car problem with fuzzy Q-Map, and its results show that learning speed is accelerated in the incipient stage of learning.

Reliable Navigation of a Mobile Robot in Cluttered Environment by Combining Evidential Theory and Fuzzy Controller (추론 이론과 퍼지 컨트롤러 결합에 의한 이동 로봇의 자유로운 주변 환경 인식)

  • 김영철;조성배;오상록
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2001.05a
    • /
    • pp.136-139
    • /
    • 2001
  • This paper develops a sensor based navigation method that utilizes fuzzy logic and the Dempster-Shafer evidence theory for mobile robot in uncertain environment. The proposed navigator consists of two behaviors: obstacle avoidance and goal seeking. To navigate reliably in the environment, we make a map building process before the robot finds a goal position and create a robust fuzzy controller. In this paper, the map is constructed on a two-dimensional occupancy grid. The sensor readings are fused into the map using D-S inference rule. Whenever the robot moves, it catches new information about the environment and replaces the old map with new one. With that process the robot can go wandering and finding the goal position. The usefulness of the proposed method is verified by a series of simulations. This paper deals with the fuzzy modeling for the complex and uncertain nonlinear systems, in which conventional and mathematical models may fail to give satisfactory results. Finally, we provide numerical examples to evaluate the feasibility and generality of the proposed method in this paper.

  • PDF

Mobile robot indoor map making using fuzzy numbers and graph theory

  • Kim, Wan-Joo;Ko, Joong-Hyup;Chung, Myung-Jin
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1993.10b
    • /
    • pp.491-495
    • /
    • 1993
  • In this paper, we present a methodology to model an indoor environment of a mobile robot using fuzzy numbers and to make a global map of the robot environment using graph theory. We describe any geometric primitive of robot environment as a parameter vector in parameter space and represent the ill-known values of the prameterized geometric primitive by means of fuzzy numbers restricted to appropriate membership functions. Also we describe the spatial relations between geometric prinitives using graph theory for local maps. For making the global map of the mobile robot environment, the correspondence problem between local maps is solved using a fuzzy similarity measure and a Bipartite graph matching technique.

  • PDF

Hierarchical Fuzzy Motion Planning for Humanoid Robots Using Locomotion Primitives and a Global Navigation Path

  • Kim, Yong-Tae
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.10 no.3
    • /
    • pp.203-209
    • /
    • 2010
  • This paper presents a hierarchical fuzzy motion planner for humanoid robots in 3D uneven environments. First, we define both motion primitives and locomotion primitives of humanoid robots. A high-level planner finds a global path from a global navigation map that is generated based on a combination of 2.5 dimensional maps of the workspace. We use a passage map, an obstacle map and a gradient map of obstacles to distinguish obstacles. A mid-level planner creates subgoals that help the robot efficiently cope with various obstacles using only a small set of locomotion primitives that are useful for stable navigation of the robot. We use a local obstacle map to find the subgoals along the global path. A low-level planner searches for an optimal sequence of locomotion primitives between subgoals by using fuzzy motion planning. We verify our approach on a virtual humanoid robot in a simulated environment. Simulation results show a reduction in planning time and the feasibility of the proposed method.

Fuzzy Based Mobile Robot Control with GUI Environment (GUI환경을 갖는 퍼지기반 이동로봇제어)

  • Hong, Seon-Hack
    • 전자공학회논문지 IE
    • /
    • v.43 no.4
    • /
    • pp.128-135
    • /
    • 2006
  • This paper proposes the control method of fuzzy based sensor fusion by using the self localization of environment, position data by dead reckoning of the encoder and world map from sonic sensors. The proposed fuzzy based sensor fusion system recognizes the object and extracts features such as edge, distance and patterns for generating the world map and self localization. Therefore, this paper has developed fuzzy based control of mobile robot with experimentations in a corridor environment.

Web-Based Organizational Memory Acquisition by Using a Fuzzy Cognitive Map (퍼지인식도를 이용한 웹기반 조직지식획득에 관한 연구)

  • 이건창
    • Journal of Intelligence and Information Systems
    • /
    • v.5 no.2
    • /
    • pp.79-97
    • /
    • 1999
  • Knowledge management (KM) is emerging as a robust management mechanism with which an organization can remain highly intelligent and competitive in a turbulent market. Organization knowledge is at the heart of KM success. As a vehicle of acquiring organizational knowledge in a distributed decision-making environment, we applied a fuzzy cognitive map (FMM) technique and proved its effectiveness in a distributed knowledge management environment. Our approach was applied to the financial statement analysis problem, yielding a robust result.

  • PDF

Fuzzy Cognitive Map Construction Support System based on User Interaction (사용자 상호작용에 의한 퍼지 인식도 구축 지원 시스템)

  • Shin, Hyoung-Wook;Jung, Jeong-Mun;Cheah, Wooi Ping;Yang, Hyung-Jeong;Kim, Kyoung-Yun
    • The Journal of the Korea Contents Association
    • /
    • v.8 no.12
    • /
    • pp.1-9
    • /
    • 2008
  • Fuzzy Cognitive Map, one of ways to model, describe and infer reasoning relations, is widely used in the field of reasoning knowledge engineering. Despite of the natural and easy understanding of decision and smooth explanation of relation between front and rear, reasoning relation is organized with mathematical haziness and complex algorithm and rarely has an interactive user interface. This paper suggests an interactive Fuzzy Cognitive Map(FCM) construction support system. It builds a FCM increasingly concerning multiple experts' knowledge. Futhermore, it supports user-supportive environment by dynamically displaying the structure of Fuzzy Cognitive Map which is constructed by the interaction between experts and the system.

Study on Mobile Robot's Navigation Problem Using Jacobian and Fuzzy Inference System (자코비안과 퍼지 추론 시스템을 이용한 이동로봇의 주행문제에 관한 연구)

  • Choi Gyu-Jong;Ahn Doo-Sung
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.12 no.6
    • /
    • pp.554-560
    • /
    • 2006
  • In this paper, we propose the topological map building method about unknown environment using the ultrasonic sensors. An ultrasonic sensor inherently has the range error due to the specular reflection. To decrease this error, we estimate the obstacle states(position and velocity) using the local minimum sensor values and Jacobian. Estimated states are used to avoid the obstacles and build the topological map similar to the type that human being memorizes an environment. When a mobile robot is faced with three problems(comer way, cross way and dead end), it senses the movable directions using FIS(Fuzzy Inference System). Among these directions, it can select the target direction using binary decision tree(Turn Side Selector). Proposed algorithm has been verified with three simulations and three implementations.

An Improved Hybrid Canopy-Fuzzy C-Means Clustering Algorithm Based on MapReduce Model

  • Dai, Wei;Yu, Changjun;Jiang, Zilong
    • Journal of Computing Science and Engineering
    • /
    • v.10 no.1
    • /
    • pp.1-8
    • /
    • 2016
  • The fuzzy c-means (FCM) is a frequently utilized algorithm at present. Yet, the clustering quality and convergence rate of FCM are determined by the initial cluster centers, and so an improved FCM algorithm based on canopy cluster concept to quickly analyze the dataset has been proposed. Taking advantage of the canopy algorithm for its rapid acquisition of cluster centers, this algorithm regards the cluster results of canopy as the input. In this way, the convergence rate of the FCM algorithm is accelerated. Meanwhile, the MapReduce scheme of the proposed FCM algorithm is designed in a cloud environment. Experimental results demonstrate the hybrid canopy-FCM clustering algorithm processed by MapReduce be endowed with better clustering quality and higher operation speed.

Assessment of Groundwater Contamination Vulnerability in Miryang City, Korea using Advanced DRASTIC and fuzzy Techniques on the GIS Platform (개선된 DRASTIC 기법과 퍼지기법을 이용한 밀양지역 지하수오염 취약성 평가)

  • Chung, Sang Yong;Elzain, Hussam Eldin;Senapathi, Venkatramanan;Park, Kye-Hun;Kwon, Hae-Woo;Yoo, In Kol;Oh, Hae Rim
    • Journal of Soil and Groundwater Environment
    • /
    • v.23 no.4
    • /
    • pp.26-41
    • /
    • 2018
  • The purpose of this study is to improve the Original DRASTIC Model (ODM) for the assessment of groundwater contamination vulnerability on the GIS platform. Miryang City of urban and rural features was selected for the study area to accomplish the research purpose. Advanced DRASTIC Model (ADM) was developed adding two more DRASTIC factors of lineament density and landuse to ODM. The fuzzy logic was also applied to ODM and ADM to improve their ability in evaluating the groundwater contamination vulnerability. Although the vulnerability map of ADM was a little simpler than that of ODM, it increased the area of the low vulnerability sector. The groundwater vulnerability maps of ODM and ADM using DRASTIC Indices represented the more detailed descriptions than those from the overlap of thematic maps, and their qualities were improved by the application of fuzzy technique. The vulnerability maps of ODM, ADM and FDM was evaluated by NO3-N concentrations in the study area. It was proved that ADM including lineament density and landuse factors produced a more reliable groundwater vulnerability map, and fuzzy ADM (FDM) made the best detailed groundwater vulnerability map with the significant statistical results.