• Journal of information and communication convergence engineering
• /
• v.20 no.3
• /
• pp.181-188
• /
• 2022

An intelligent distributed multi-agent system (IDMS) using reinforcement learning (RL) is a challenging and intricate problem in which single or multiple agent(s) aim to achieve their specific goals (sub-goal and final goal), where they move their states in a complex and cluttered environment. The environment provided by the IDMS provides a cumulative optimal reward for each action based on the policy of the learning process. Most actions involve interacting with a given IDMS environment; therefore, it can provide the following elements: a starting agent state, multiple obstacles, agent goals, and a cluttered index. The reward in the environment is also reflected by RL-based agents, in which agents can move randomly or intelligently to reach their respective goals, to improve the agent learning performance. We extend different cases of intelligent multi-agent systems from our previous works: (a) a proposed environment-clutter-based-index for agent sub-goal selection and analysis of its effect, and (b) a newly proposed RL reward scheme based on the environmental clutter-index to identify and analyze the prerequisites and conditions for improving the overall system.

• Journal of the Korean Society for Precision Engineering
• /
• v.31 no.4
• /
• pp.287-295
• /
• 2014

Smart manufacturing (SM) considered as a new trend of modern manufacturing helps to meet objectives associated with the productivity, quality, cost and competiveness. It is characterized by decentralized, distributed, networked compositions of autonomous systems. The model of SM is inherited from the organization of the living systems in biology and nature such as ant colony, school of fish, bee's foraging behaviors, and so on. In which, the resources of the manufacturing system are considered as biological organisms, which are autonomous entities so that the manufacturing system has the advanced characteristics inspired from biology such as self-adaptation, self-diagnosis, and self-healing. To prove this concept, a cloud machining system is considered as research object in which internet of things and cloud computing are used to integrate, organize and allocate the machining resources. Artificial life tools are used for cooperation among autonomous elements in the cloud machining system.

• International Journal of Control, Automation, and Systems
• /
• v.1 no.2
• /
• pp.229-235
• /
• 2003

We designed a family of completely autonomous mobile robots with local intelligence. Each robot has a number of on-board sensors, including vision, and does not rely on global positioning systems The on-board embedded controller is sufficient to analyze several low-resolution color images per second. This enables our robots to perform several complex tasks such as navigation, map generation, or providing intelligent group behavior. Not being limited to playing the game of soccer and being completely autonomous, we are also looking at a number of other interesting scenarios. The robots can communicate with each other, e.g. for exchanging positions, information about objects or just the local states they are currently in (e.g. sharing their current objectives with other robots in the group). We are particularly interested in the differences between a behavior-based approach versus a traditional control algorithm at this still very low level of action.

• 제어로봇시스템학회:학술대회논문집
• /
• 2003.10a
• /
• pp.1126-1129
• /
• 2003

In this paper, we propose a multi-agent system for assisting those who need help in taking objects around him/her. One may imagine this kind of situation when a person is lying in bed and wishes to take an object on a distant table that cannot be reached only by stretching his/her hand. The proposed multi-agent system is composed of three main independent agents; a vision agent, a robot agent, and a pass agent. Once a human expresses his/her intention by pointing to a particular object using his/her hand and a finger, these agents cooperatively bring the object to him/her. Natural communication between a human and the multi-agent system is realized in this way. Performance of the proposed system is demonstrated in an experiment, in which a human intends to take one of the four objects on the floor and the three agents successfully cooperate to find out the object and to bring it to the human.

• Proceedings of the Korea Inteligent Information System Society Conference
• /
• 2001.01a
• /
• pp.198-201
• /
• 2001

Recently the wireless-internet has been spreading extensively. People are spending a large part of their time gaining access to information using a mobile device. With the rapid growth of on-line Electronic Commerce, the use of mobile devices creates a new paradigm that provides users with location-independent real time service. Although this new paradigm does have some advantages, limited process speed, low bandwidth, the low battery capacity of mobile devices, and a high rate of wireless network errors causes many overhead expenses during service time with the server. In this paper, we suggest an autonomous service delivery system, which provides mobile agent capability to users that cannot maintain a connection. We have developed the system based on java mobile agent technology. Using this system, we can provide more effective service to users when the user is sending requirements for service through a mobile device that has limited resources. Furthermore we can manage the contact server dynamically when new services are added.

• Proceedings of the Korean Society of Precision Engineering Conference
• /
• 1995.10a
• /
• pp.697-701
• /
• 1995

The network encironment includes a number of autonomous agents which are widely distributed, have different platforms, and change very dynamically. The information system operated on this environment must solve some basic problems; restrictive client-server models, heterogeneous systems, and intellignet agents. We are using KQML for knowledge management. Java language provides solutions against a strong server dependency and a heterogenous troubles. We introduce KQML as an agent communication language and JATLite as a java agent template. these increase an efficiency of communication on network and enable us to use resources distributed in world wide web. Also, we describe a new agent system architecture and implement it through an example scenario

• 제어로봇시스템학회:학술대회논문집
• /
• 2001.10a
• /
• pp.164.1-164
• /
• 2001

Q-learning is a recent reinforcement learning algorithm that does not need a modeling of environment and it is a suitable approach to learn behaviors for autonomous agents. But when it is applied to multi-agent learning with many I/O states, it is usually too complex and slow. To overcome this problem in the multi-agent learning system, we propose the successive Q-learning algorithm. Successive Q-learning algorithm divides state-action pairs, which agents can have, into several Q-functions, so it can reduce complexity and calculation amounts. This algorithm is suitable for multi-agent learning in a dynamically changing environment. The proposed successive Q-learning algorithm is applied to the prey-predator problem with the one-prey and two-predators, and its effectiveness is verified from the efficient avoidance ability of the prey agent.

• Proceedings of the Korean Information Science Society Conference
• /
• 1998.10c
• /
• pp.111-113
• /
• 1998

최근의 업무 환경은 네트워크를 이용한 다자간의 통신을 바탕으로 하고 있다. 조직의 주요한 정보 자산들은 다양한 내부 통제(Internal Control)와 각종 보안 시스템을 통해 보호 받고 있으며, 이들에 대한 침입(Intrusion)을 탐지해내고 자산을 보호할 수 있는 방안에 대한 계속적인 연구가 이루어지고 있다. 이러한 침입 탐지(Intrusion Detection)를 위한 소프트웨어 기술의 한 방안으로써 Agent에 대한 논의가 이루어지고 있으나, 이들 Agent간의 통신과 시스템 전체적인 측면에서의 조율(Coordinate) 및 관리에 대한 연구 성과는 아직 까지는 미약하다고 할 수 있다. 따라서 본 연구에서는 이러한 Intrusion Detection Agent들간의 조율을 담당할 수 있는 구조(Architecture)로서 Blackboard 시스템을 제안하며, 소규모 프로그램을 작성하여 침입 시나리오에 대한 탐지 과정의 시뮬레이션을 통해 본 모델을 평가해보도록 한다.

• Asia pacific journal of information systems
• /
• v.10 no.2
• /
• pp.23-49
• /
• 2000

We proposed a conceptual design of the web-based agent model for global supply chain management(GSCM), where agents representing autonomous operational units, such as suppliers, factories, distribution center and customers, cooperate and are coordinated through the information exchange. The agent model assumed the hierarchical federated system. In the federated system, the agents of the same region are grouped and linked to the region-specific facilitator only through which communication between agents is allowed. The facilitator is responsible for monitoring and controlling the conversations consisting of the message flows across the agents. A web-based user presentation was also designed so that human users could involve in collaborative settings into the GSCM multi-agent system. In the conversation protocols which allow for complex coordinated behavior among agents, the KQML was extended to represent the messages. A GSCM scenario where the supply chain is formed upon customer order and supply decision is made was used to demonstrate the dynamics of the conversation protocols.

• The KIPS Transactions:PartA
• /
• v.11A no.6
• /
• pp.439-450
• /
• 2004

Mobile agents are autonomous and dynamic entities that can migrate among various nodes in the network. Java's Jini framework facilitates mobile agent system development, providing hey features for distributed network programming. However, due to the security weakness, Jinil.0 service has a fundamental limitation on developing mobile agent systems which support secure remote communications. In this paper, we describe a Jini2.0-based secure mobile agent system named SecureJMoblet. On the top of Jini2.0, the system provides basic functionalities of a mobile agent system such as creation, transfer and control. In addition, with the SeureJS developed for secure JavaSpace service, SecureJMoblet supports a secure object repository and a reliable communication among mobile agents.