• Title/Summary/Keyword: Modular Robot System

Search Result 54, Processing Time 0.042 seconds

Dynamic Positioning of Robot Soccer Simulation Game Agents using Reinforcement learning

  • Kwon, Ki-Duk;Cho, Soo-Sin;Kim, In-Cheol
    • Proceedings of the Korea Inteligent Information System Society Conference
    • /
    • 2001.01a
    • /
    • pp.59-64
    • /
    • 2001
  • The robot soccer simulation game is a dynamic multi-agent environment. In this paper we suggest a new reinforcement learning approach to each agent's dynamic positioning in such dynamic environment. Reinforcement learning is the machine learning in which an agent learns from indirect, delayed reward an optimal policy to chose sequences of actions that produce the greatest cumulative reward. Therefore the reinforcement learning is different from supervised learning in the sense that there is no presentation of input pairs as training examples. Furthermore, model-free reinforcement learning algorithms like Q-learning do not require defining or learning any models of the surrounding environment. Nevertheless it can learn the optimal policy if the agent can visit every state- action pair infinitely. However, the biggest problem of monolithic reinforcement learning is that its straightforward applications do not successfully scale up to more complex environments due to the intractable large space of states. In order to address this problem. we suggest Adaptive Mediation-based Modular Q-Learning (AMMQL)as an improvement of the existing Modular Q-Learning (MQL). While simple modular Q-learning combines the results from each learning module in a fixed way, AMMQL combines them in a more flexible way by assigning different weight to each module according to its contribution to rewards. Therefore in addition to resolving the problem of large state effectively, AMMQL can show higher adaptability to environmental changes than pure MQL. This paper introduces the concept of AMMQL and presents details of its application into dynamic positioning of robot soccer agents.

  • PDF

Development of a Guide Robot with Real-Time Linux OS

  • Mun, Jun-Hak;Seo, Gon-Yeon;Kim, Jin-Oh
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.137.1-137
    • /
    • 2001
  • A new method for a guide robot using Real-Time Linux OS is introduced in this paper. A guide robot is to guide people in museums or buildings. So it has to be more reliable and stable in its control system. In addition, it has to satisfy Real-Time operation requirement because it needs to react to changing environment prompty. The task includes localization, map building, collision avoidance, path planning, and user interface software. The modular guide robot is designed with Real-Time Linux OS, which is composed of many open sources for scheduler, interrupt dispatcher, fifos, shared memory, timer services. We developed application software to satisfy the given task. The developed guide robot moves at 0.2ms and the interrupt latency is less than 100$\mu\textrm{s}$ It is thought that the developed system can be a stable and low cost open architecture robot controller for ...

  • PDF

Tracing Algorithm for Intelligent Snake-like Robot System

  • Choi, Woo-Kyung;Kim, Seong-Joo;Jeon, Hong-Tae
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2005.06a
    • /
    • pp.486-491
    • /
    • 2005
  • There come various types of robot with researches for mobile robot. This paper introduces the multi-joint snake robot having 16 degree of freedom and composing of eight-axis. The biological snake robot uses the forward movement friction and the proposed artificial snake robot uses the un-powered wheel instead of the body of snake. To determine the enable joint angle of each joint, the controller inputs are considered such as color and distance using PC Camera and ultra-sonic sensor module, respectively. The movement method of snake robot is sequential moving from head to tail through body. The target for movement direction is decided by a certain article be displayed in the PC Camera. In moving toward that target, if there is any obstacle then the snake robot can avoid by itself. In this paper, we show the method of snake robot for tracing the target with experiment.

  • PDF

A Development of Intelligent Service Robot System for Store Management in Unmanned Environment (무인화 환경 기반의 상점 자동 관리를 위한 지능형 서비스 로봇 시스템)

  • Ahn, Ho-Seok;Sa, In-Kyu;Baek, Young-Min;Lee, Dong-Wook
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.17 no.6
    • /
    • pp.539-545
    • /
    • 2011
  • This paper describes an intelligent service robot system for managing a store in an unmanned environment. The robot can be a good replacement for humans because it is possible to work all day and to remember lots of information. We design a system architecture for configuring many intelligent functions of intelligent service robot system which consists of four layers; a User Interaction Layer, a Behavior Scheduling Layer, a Intelligent Module Layer, and a Hardware Layer. We develop an intelligent service robot 'Part Timer' based on the designed system architecture. The 'Part Timer' has many intelligent function modules such as face detection-recognition-tracking module, speech recognition module, navigation module, manipulator module, appliance control module, etc. The 'Part Timer' is possible to answer the phone and this function gives convenient interface to users.

A MNN(Modular Neural Network) for Robot Endeffector Recognition (로봇 Endeffector 인식을 위한 모듈라 신경회로망)

  • 김영부;박동선
    • Proceedings of the IEEK Conference
    • /
    • 1999.06a
    • /
    • pp.496-499
    • /
    • 1999
  • This paper describes a medular neural network(MNN) for a vision system which tracks a given object using a sequence of images from a camera unit. The MNN is used to precisely recognize the given robot endeffector and to minize the processing time. Since the robot endeffector can be viewed in many different shapes in 3-D space, a MNN structure, which contains a set of feedforwared neural networks, co be more attractive in recognizing the given object. Each single neural network learns the endeffector with a cluster of training patterns. The training patterns for a neural network share the similar charateristics so that they can be easily trained. The trained MNN is less sensitive to noise and it shows the better performance in recognizing the endeffector. The recognition rate of MNN is enhanced by 14% over the single neural network. A vision system with the MNN can precisely recognize the endeffector and place it at the center of a display for a remote operator.

  • PDF

Practice for Modular Mobile Robot and Position Recognition system in Ubiquitous Network (유비쿼터스 네트워크에서 모듈형 모바일 로봇과 위치 인식 시스템을 위한 사례)

  • Jeong, Goo-Cheol
    • The Journal of Korean Institute for Practical Engineering Education
    • /
    • v.4 no.2
    • /
    • pp.162-170
    • /
    • 2012
  • It is very important for the robot to recognize its position to accomplish numerous tasks and to go to the goal. In this paper, we suggest Location Recognition System to distinguish robot's locations using land-mark and the odometer in the environment of sensor network. All in all, we created a basic intelligent robot, Location Recognition System, and Environment Sensor Modules; we verified the proposed algorithm through computer simulation.

  • PDF

Performance Evaluation of Multi-Hop Communication Based on a Mobile Multi-Robot System in a Subterranean Laneway

  • Liu, Qing-Ling;Oh, Duk-Hwan
    • Journal of Information Processing Systems
    • /
    • v.8 no.3
    • /
    • pp.471-482
    • /
    • 2012
  • For disaster exploration and surveillance application, this paper aims to present a novel application of a multi-robot agent based on WSN and to evaluate a multi-hop communication caused by the robotics correspondingly, which are used in the uncertain and unknown subterranean tunnel. A Primary-Scout Multi-Robot System (PS-MRS) was proposed. A chain topology in a subterranean environment was implemented using a trimmed ZigBee2006 protocol stack to build the multi-hop communication network. The ZigBee IC-CC2530 modular circuit was adapted by mounting it on the PS-MRS. A physical experiment based on the strategy of PS-MRS was used in this paper to evaluate the efficiency of multi-hop communication and to realize the delivery of data packets in an unknown and uncertain underground laboratory environment.

A Study on Processing of Monolithic Rack Housing for Modular Steering Gear [II] - Processing Characteristics of Monolithic Rack Housing - (Steering Gear 모듈화를 위한 일체형 Rack Housing의 공정에 관한 연구 [II] - 일체형 Rack Housing의 공정특성 -)

  • Kim, Jong-Do;Lee, Chang-Je
    • Journal of Advanced Marine Engineering and Technology
    • /
    • v.33 no.2
    • /
    • pp.288-294
    • /
    • 2009
  • The purpose of this study is manufacturing of monolithic housing for modularization of steering gear. Monolithic housing is difficult to weld with only rotation and linear motion. It is for this reason that housing of joining parts have a slope of 76.3 degrees. For this reason, welding trajectory was measured by the cooperative controled robot system, and then allowing for measured results, we developed the dedicated system. The developed system can be welded by using only 3 axises in contrast with robot system using 8 axises in housing welding. In addition, we applied CMT and laser welding device to dedicated system and as a result of experiment, sound bead and excellent roundness could be obtained.

The Current State and Future Directions of Industrial Robotic Arms in Modular Construction

  • Song, Seung Ho;Choi, Jin Ouk;Lee, Seungtaek
    • International conference on construction engineering and project management
    • /
    • 2022.06a
    • /
    • pp.336-343
    • /
    • 2022
  • Industrial robotic arms are widely adopted in numerous industries for manufacturing automation under factory settings, which eliminates the limitations of manual labor and provides significant productivity and quality benefits. The U.S. modular construction industry, despite having similar controlled factory environments, still heavily relies on manual labor. Thus, this study investigates the U.S., Canada, and Europe-based leading modular construction companies and research labs implementing industrial robotic arms for manufacturing automation. The investigation mainly considered the current research scope, industry state, and constraints, as well as identifying the types and specifications of the robotic arms in use. First, the study investigated well-recognized modular building associations, the Modular Building Institute (MBI), and renowned architecture design magazine, Dezeen to gather industry updates. The authors discovered one university lab and a few companies that adopted Switzerland-based robotic arms, ABB. Researching ABB robotics led to the discovery of ABB's competitor, Germany-based KUKA robotic arms. Consequently, research extended to the companies and labs adopting KUKA models. In total, this study has identified seven modular companies and four research labs. All companies employed robotic arms and gantry robot combinations in a production-line-like system for partial automation, and some adopted design standardization for optimization. The common goal among the labs was to achieve greater flexibility and full automation with robotic arms. This study will help companies better implement robotic arm automation by providing recommendations from investigating its current industry status.

  • PDF