• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 1997년도 한국자동제어학술회의논문집; 한국전력공사 서울연수원; 17-18 Oct. 1997
• /
• pp.612-616
• /
• 1997

In this paper, two kinds of controller are proposed for a soccer robot system.. One for Supervisor and defense mode, and the other for attack mode. Robot soccer game has very dynamic characteristics. Furthermore, there exist competitions between agents. The soccer-playing robot should take an appropriate action according to its surroundings. Initially, an attack mode controller using a vector field concept is designed, then a supervisor and a defense mode controller are designed with a Petri-net. The efficiency and applicability of the proposed controllers are demonstrated through a real robot soccer game(MiroSot 97).

• International Journal of Control, Automation, and Systems
• /
• 제1권2호
• /
• pp.236-242
• /
• 2003

This paper presents a cooperation strategy between a human operator and autonomous robots for an interactive robot soccer game, The interactive robot soccer game has been developed to allow humans to join into the game dynamically and reinforce entertainment characteristics. In order to make these games more interesting, a cooperation strategy between humans and autonomous robots on a team is very important. Strategies can be pre-programmed or learned by robots themselves with learning or evolving algorithms. Since the robot soccer system is hard to model and its environment changes dynamically, it is very difficult to pre-program cooperation strategies between robot agents. Q-learning - one of the most representative reinforcement learning methods - is shown to be effective for solving problems dynamically without explicit knowledge of the system. Therefore, in our research, a Q-learning based learning method has been utilized. Prior to utilizing Q-teaming, state variables describing the game situation and actions' sets of robots have been defined. After the learning process, the human operator could play the game more easily. To evaluate the usefulness of the proposed strategy, some simulations and games have been carried out.

• 대한임베디드공학회논문지
• /
• 제4권1호
• /
• pp.9-15
• /
• 2009

In this paper, a network based robot soccer system is proposed. The system consists of robots, an image processing sub-system, a game server, and client systems. Embedded technique is applied to the hardware and software for controlling the robots and image processing. In this robot soccer system, a gamer can see and control robots in a remote site through Internet. During the game, the game server gives geometrical information on robots such as positions and orientations. We demonstrated the game in public and obtained optimistic results even though some technical problemssuch as communication delay and precise control for the robots should be improved.

• 한국게임학회 논문지
• /
• 제11권6호
• /
• pp.61-70
• /
• 2011

본 논문에서는 결정트리 학습 알고리즘을 활용한 축구 게임 수비 NPC 제어 방법을 제안한다. 제안하는 방법은 실제 게임 사용자들의 이동 방향 패턴과 행동 패턴을 추출하여 결정트리학습 알고리즘에 적용한다. 그리고 학습된 결정트리를 바탕으로 NPC의 이동방향과 행동을 결정한다. 실험결과 제안하는 방법은 결정트리 학습에 시간이 다소 걸리지만, 학습된 결정트리를 바탕으로 이동방향이나 행동을 결정하는 시간은 약 0.001-0.003 ms(밀리초)가 소요되어 실시간으로 NPC를 제어할 수 있었다. 또한, 제안하는 방법은 현재 상태 정보 뿐만 아니라 이를 분석한 관계정보, 이전 상태 정보도 함께 활용하므로, 기존방법인 (Letia98)에 비해 이동방향 결정시 높은 정확도를 나타냈다.

• International Journal of Control, Automation, and Systems
• /
• 제1권2호
• /
• pp.222-228
• /
• 2003

A tool which can be used for the analysis of a robot soccer game is presented. The tool enables automatic filtering and selection of game sequences which are suitable for the analysis of the game. Fuzzy logic is used since the data gathered by a camera is highly noisy. The data used in the paper was recorded during the game Germany - Slovenia in Hagen, on November 11, 2001. The dynamic parameters of our robots are estimated using the least squares technique. Meandering parameters are estimated and an attempt is made to identify the strategy of the opposing team with the method of introspection.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 2001년도 ICCAS
• /
• pp.59.2-59
• /
• 2001

This paper presents an evolvable cooperation strategy based on a genetic programming for the interactive robot soccer game. The interactive robot soccer game has been developed to allow a person to join in the game dynamically and to reinforce entertainment characteristics. In this game, a cooperation strategy between humans and autonomous robots is very important in order to make the game more enjoyable. First of all, necessary action sets for the cooperation strategy and its strategy structure are presented. In the first stage, a blocking action that an autonomous robot cut off an enemy robot from disturbing the way of the human controlled robot has been considered. The success probability of the blocking action has beer obtained in ...

• ETRI Journal
• /
• 제24권6호
• /
• pp.443-454
• /
• 2002

This paper introduces a system for mosaicking sequences of soccer images in a panoramic view for soccer game analysis. The continuous mosaic images of the soccer ground field allow the user to view a wide picture of the players' actions. The initial component of our algorithm automatically detects and traces the players and some lines. The next component of our algorithm finds the parameters of the captured image coordinates and transforms them into ground model coordinates for automatic soccer game analysis. The results of our experimentations indicate that the proposed system offers a promising method for segmenting, mosaicking, and analyzing soccer image sequences.

• 제어로봇시스템학회논문지
• /
• 제9권11호
• /
• pp.906-916
• /
• 2003

A multi-robot control algorithm using Petri-Net is proposed for 5vs5 robot soccer. The dynamic environment of robot soccer is modeled by defining the place and transition of each robot and converting it into Petri-Net diagram. Once all the places and transitions of robots are represented by the Petri-Net model, their actions can be chosen according to the roles of robots and position of the ball in soccer game, e.g., offensive, defensive and goalie robot. The proposed modeling method is implemented for soccer robot system. The efficiency and applicability of the proposed multiple-robot control algorithm using Petri-Net are demonstrated through 5vs5 Middle League SimuroSot soccer game.

• 한국지능시스템학회:학술대회논문집
• /
• 한국퍼지및지능시스템학회 2003년도 ISIS 2003
• /
• pp.166-169
• /
• 2003

Reinforcement learning if a kind of machine learning. It aims to adapt an agent to a given environment with a clue to a reward and a penalty. Q-learning [8] that is a representative reinforcement learning system treats a reward and a penalty at the same time. There is a problem how to decide an appropriate reward and penalty values. We know the Penalty Avoiding Rational Policy Making algorithm (PARP) [4] and the Penalty Avoiding Profit Sharing (PAPS) [2] as reinforcement learning systems to treat a reward and a penalty independently. though PAPS is a descendant algorithm of PARP, both PARP and PAPS tend to learn a local optimal policy. To overcome it, ion this paper, we propose the Multi Best method (MB) that is PAPS with the multi-start method[5]. MB selects the best policy in several policies that are learned by PAPS agents. By applying PS, PAPS and MB to a soccer game environment based on the SoccerBots[9], we show that MB is the best solution for the soccer game environment.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 1996년도 한국자동제어학술회의논문집(국내학술편); 포항공과대학교, 포항; 24-26 Oct. 1996
• /
• pp.507-510
• /
• 1996

In this paper we present the multi-agent robot system developed for participating in micro robot soccer tournament. The multi-agent robot system consists of micro robot, a vision system, a host computer and a communication module. Mcro robot are equipped with two mini DC motors with encoders and gearboxes, a R/F receiver, a CPU and infrared sensors for obstacle detection. A vision system is used to recognize the position of the ball and opponent robots, position and orientation of our robots. The vision system is composed of a color CCD camera and a vision processing unit. Host computer is a Pentium PC, and it receives information from the vision system, generates commands for each robot using a robot management algorithm and transmits commands to the robots by the R/F communication module. And in order to achieve a given mission in micro robot soccer game, cooperative behaviors by robots are essential. Cooperative work between individual agents is achieved by the command of host computer.