• 제목/요약/키워드: Fuzzy environment map

검색결과 34건 처리시간 0.023초

강화학습의 Q-learning을 위한 함수근사 방법 (A Function Approximation Method for Q-learning of Reinforcement Learning)

  • 이영아;정태충
    • 한국정보과학회논문지:소프트웨어및응용
    • /
    • 제31권11호
    • /
    • pp.1431-1438
    • /
    • 2004
  • 강화학습(reinforcement learning)은 온라인으로 환경(environment)과 상호작용 하는 과정을 통하여 목표를 이루기 위한 전략을 학습한다. 강화학습의 기본적인 알고리즘인 Q-learning의 학습 속도를 가속하기 위해서, 거대한 상태공간 문제(curse of dimensionality)를 해결할 수 있고 강화학습의 특성에 적합한 함수 근사 방법이 필요하다. 본 논문에서는 이러한 문제점들을 개선하기 위해서, 온라인 퍼지 클러스터링(online fuzzy clustering)을 기반으로 한 Fuzzy Q-Map을 제안한다. Fuzzy Q-Map은 온라인 학습이 가능하고 환경의 불확실성을 표현할 수 있는 강화학습에 적합한 함수근사방법이다. Fuzzy Q-Map을 마운틴 카 문제에 적용하여 보았고, 학습 초기에 학습 속도가 가속됨을 보였다.

추론 이론과 퍼지 컨트롤러 결합에 의한 이동 로봇의 자유로운 주변 환경 인식 (Reliable Navigation of a Mobile Robot in Cluttered Environment by Combining Evidential Theory and Fuzzy Controller)

  • 김영철;조성배;오상록
    • 한국지능시스템학회:학술대회논문집
    • /
    • 한국퍼지및지능시스템학회 2001년도 춘계학술대회 학술발표 논문집
    • /
    • pp.136-139
    • /
    • 2001
  • This paper develops a sensor based navigation method that utilizes fuzzy logic and the Dempster-Shafer evidence theory for mobile robot in uncertain environment. The proposed navigator consists of two behaviors: obstacle avoidance and goal seeking. To navigate reliably in the environment, we make a map building process before the robot finds a goal position and create a robust fuzzy controller. In this paper, the map is constructed on a two-dimensional occupancy grid. The sensor readings are fused into the map using D-S inference rule. Whenever the robot moves, it catches new information about the environment and replaces the old map with new one. With that process the robot can go wandering and finding the goal position. The usefulness of the proposed method is verified by a series of simulations. This paper deals with the fuzzy modeling for the complex and uncertain nonlinear systems, in which conventional and mathematical models may fail to give satisfactory results. Finally, we provide numerical examples to evaluate the feasibility and generality of the proposed method in this paper.

  • PDF

Mobile robot indoor map making using fuzzy numbers and graph theory

  • Kim, Wan-Joo;Ko, Joong-Hyup;Chung, Myung-Jin
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1993년도 한국자동제어학술회의논문집(국제학술편); Seoul National University, Seoul; 20-22 Oct. 1993
    • /
    • pp.491-495
    • /
    • 1993
  • In this paper, we present a methodology to model an indoor environment of a mobile robot using fuzzy numbers and to make a global map of the robot environment using graph theory. We describe any geometric primitive of robot environment as a parameter vector in parameter space and represent the ill-known values of the prameterized geometric primitive by means of fuzzy numbers restricted to appropriate membership functions. Also we describe the spatial relations between geometric prinitives using graph theory for local maps. For making the global map of the mobile robot environment, the correspondence problem between local maps is solved using a fuzzy similarity measure and a Bipartite graph matching technique.

  • PDF

Hierarchical Fuzzy Motion Planning for Humanoid Robots Using Locomotion Primitives and a Global Navigation Path

  • Kim, Yong-Tae
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제10권3호
    • /
    • pp.203-209
    • /
    • 2010
  • This paper presents a hierarchical fuzzy motion planner for humanoid robots in 3D uneven environments. First, we define both motion primitives and locomotion primitives of humanoid robots. A high-level planner finds a global path from a global navigation map that is generated based on a combination of 2.5 dimensional maps of the workspace. We use a passage map, an obstacle map and a gradient map of obstacles to distinguish obstacles. A mid-level planner creates subgoals that help the robot efficiently cope with various obstacles using only a small set of locomotion primitives that are useful for stable navigation of the robot. We use a local obstacle map to find the subgoals along the global path. A low-level planner searches for an optimal sequence of locomotion primitives between subgoals by using fuzzy motion planning. We verify our approach on a virtual humanoid robot in a simulated environment. Simulation results show a reduction in planning time and the feasibility of the proposed method.

GUI환경을 갖는 퍼지기반 이동로봇제어 (Fuzzy Based Mobile Robot Control with GUI Environment)

  • 홍선학
    • 전자공학회논문지 IE
    • /
    • 제43권4호
    • /
    • pp.128-135
    • /
    • 2006
  • 본 논문에서는 이동로봇 주변의 자기위치인식, 광학식 엔코더의 위치 데이터 및 초음파 센서의 환경 지도를 이용하여 퍼지 기반 센서융합 제어방식을 제시하였다. 영상 카메라를 이용하여 자기위치 인식성능을 높이고 초음파 센서에서 감지한 목표물의 형태, 거리와 특징을 퍼지 기반 제어기를 통하여 처리하여 이동로봇 주변의 환경지도를 만들어 자기위치 인식능력의 개선을 실험을 통하여 구현하였다.

퍼지인식도를 이용한 웹기반 조직지식획득에 관한 연구 (Web-Based Organizational Memory Acquisition by Using a Fuzzy Cognitive Map)

  • 이건창
    • 지능정보연구
    • /
    • 제5권2호
    • /
    • pp.79-97
    • /
    • 1999
  • Knowledge management (KM) is emerging as a robust management mechanism with which an organization can remain highly intelligent and competitive in a turbulent market. Organization knowledge is at the heart of KM success. As a vehicle of acquiring organizational knowledge in a distributed decision-making environment, we applied a fuzzy cognitive map (FMM) technique and proved its effectiveness in a distributed knowledge management environment. Our approach was applied to the financial statement analysis problem, yielding a robust result.

  • PDF

사용자 상호작용에 의한 퍼지 인식도 구축 지원 시스템 (Fuzzy Cognitive Map Construction Support System based on User Interaction)

  • 신형욱;정종문;챠위핑;양형정;김경윤
    • 한국콘텐츠학회논문지
    • /
    • 제8권12호
    • /
    • pp.1-9
    • /
    • 2008
  • 인과관계의 지식을 모델링하고 표현하며 추론하는 주요 형식화 방법의 하나인 퍼지인식도(Fuzzy Cognitive Map)는 주로 인과지식공학에 많이 사용되고 있다. 인과관계의 자연스럽고 쉬운 의사결정의 이해와 전후관계의 자연스러운 설명이라는 장점에도 불구하고 인과관계의 지식 모델링과 표현은 구현에 있어서 수학적인 적용의 모호함과 복잡한 알고리즘으로 인해 상호작용에 기반 한 구축 시스템을 찾아보기 어렵다. 본 논문에서는 인과지식 추론을 위한 퍼지 인식도의 구축 지원 시스템을 제시한다. 본 논문에서 제안하는 인과관계 추론 시스템은 다중 전문가의 지식을 반영하기 위해 지식을 점진적으로 반영하여 퍼지 인식도를 구축한다. 또한 전문가와의 상호작용을 통해 구현된 퍼지 인식도의 구조를 동적으로 디스플레이함으로써 사용자 지향적인 환경을 제공한다.

자코비안과 퍼지 추론 시스템을 이용한 이동로봇의 주행문제에 관한 연구 (Study on Mobile Robot's Navigation Problem Using Jacobian and Fuzzy Inference System)

  • 최규종;안두성
    • 제어로봇시스템학회논문지
    • /
    • 제12권6호
    • /
    • pp.554-560
    • /
    • 2006
  • In this paper, we propose the topological map building method about unknown environment using the ultrasonic sensors. An ultrasonic sensor inherently has the range error due to the specular reflection. To decrease this error, we estimate the obstacle states(position and velocity) using the local minimum sensor values and Jacobian. Estimated states are used to avoid the obstacles and build the topological map similar to the type that human being memorizes an environment. When a mobile robot is faced with three problems(comer way, cross way and dead end), it senses the movable directions using FIS(Fuzzy Inference System). Among these directions, it can select the target direction using binary decision tree(Turn Side Selector). Proposed algorithm has been verified with three simulations and three implementations.

An Improved Hybrid Canopy-Fuzzy C-Means Clustering Algorithm Based on MapReduce Model

  • Dai, Wei;Yu, Changjun;Jiang, Zilong
    • Journal of Computing Science and Engineering
    • /
    • 제10권1호
    • /
    • pp.1-8
    • /
    • 2016
  • The fuzzy c-means (FCM) is a frequently utilized algorithm at present. Yet, the clustering quality and convergence rate of FCM are determined by the initial cluster centers, and so an improved FCM algorithm based on canopy cluster concept to quickly analyze the dataset has been proposed. Taking advantage of the canopy algorithm for its rapid acquisition of cluster centers, this algorithm regards the cluster results of canopy as the input. In this way, the convergence rate of the FCM algorithm is accelerated. Meanwhile, the MapReduce scheme of the proposed FCM algorithm is designed in a cloud environment. Experimental results demonstrate the hybrid canopy-FCM clustering algorithm processed by MapReduce be endowed with better clustering quality and higher operation speed.

개선된 DRASTIC 기법과 퍼지기법을 이용한 밀양지역 지하수오염 취약성 평가 (Assessment of Groundwater Contamination Vulnerability in Miryang City, Korea using Advanced DRASTIC and fuzzy Techniques on the GIS Platform)

  • 정상용;후삼 엘딘 엘자인;벤카트라마난 세나파티;박계헌;권해우;유인걸;오해림
    • 한국지하수토양환경학회지:지하수토양환경
    • /
    • 제23권4호
    • /
    • pp.26-41
    • /
    • 2018
  • The purpose of this study is to improve the Original DRASTIC Model (ODM) for the assessment of groundwater contamination vulnerability on the GIS platform. Miryang City of urban and rural features was selected for the study area to accomplish the research purpose. Advanced DRASTIC Model (ADM) was developed adding two more DRASTIC factors of lineament density and landuse to ODM. The fuzzy logic was also applied to ODM and ADM to improve their ability in evaluating the groundwater contamination vulnerability. Although the vulnerability map of ADM was a little simpler than that of ODM, it increased the area of the low vulnerability sector. The groundwater vulnerability maps of ODM and ADM using DRASTIC Indices represented the more detailed descriptions than those from the overlap of thematic maps, and their qualities were improved by the application of fuzzy technique. The vulnerability maps of ODM, ADM and FDM was evaluated by NO3-N concentrations in the study area. It was proved that ADM including lineament density and landuse factors produced a more reliable groundwater vulnerability map, and fuzzy ADM (FDM) made the best detailed groundwater vulnerability map with the significant statistical results.