• International Journal of Control, Automation, and Systems
• /
• v.1 no.2
• /
• pp.236-242
• /
• 2003

This paper presents a cooperation strategy between a human operator and autonomous robots for an interactive robot soccer game, The interactive robot soccer game has been developed to allow humans to join into the game dynamically and reinforce entertainment characteristics. In order to make these games more interesting, a cooperation strategy between humans and autonomous robots on a team is very important. Strategies can be pre-programmed or learned by robots themselves with learning or evolving algorithms. Since the robot soccer system is hard to model and its environment changes dynamically, it is very difficult to pre-program cooperation strategies between robot agents. Q-learning - one of the most representative reinforcement learning methods - is shown to be effective for solving problems dynamically without explicit knowledge of the system. Therefore, in our research, a Q-learning based learning method has been utilized. Prior to utilizing Q-teaming, state variables describing the game situation and actions' sets of robots have been defined. After the learning process, the human operator could play the game more easily. To evaluate the usefulness of the proposed strategy, some simulations and games have been carried out.

• Korean Journal of Cognitive Science
• /
• v.5 no.2
• /
• pp.47-73
• /
• 1994

In this paper, a blackboard-based road image understanding system is implemented. The 7 useful information which organized by the hierarchical manner are stored in the blackboard system. The 6 Knowledge source modules and the blackboard make the communications under the supervision of the control module. For a scene, each hypothesis is generated and then verified for every meaningful object. On the simulation results, the correct recognition ratio can be reached out 90%. It shows that the extraction of road information for the autonomous navigation can be obtained using the blackboard architecture.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 1996.10a
• /
• pp.27-34
• /
• 1996

GENIE is a learning-based engine for building intelligent systems. Learning in GENIE proceeds by incrementally modeling its human or technical environment using a neural network and a genetic algorithm. The neural network is used to represent the knowledge for solving a given task and has the ability to grow its structure. The genetic algorithm provides the neural network with training examples by actively exploring the example space of the problem. Integrated into the training examples by actively exploring the example space of the problem. Integrated into the GENIE system architecture, the genetic algorithm and the neural network build a virtually self-teaching autonomous learning system. This paper describes the structure of GENIE and its learning components. The performance is demonstrated on a robot learning problem. We also discuss the lessons learned from experiments with GENIE and point out further possibilities of effectively hybridizing genetic algorithms with neural networks and other softcomputing techniques.

• Journal of KIISE
• /
• v.43 no.12
• /
• pp.1365-1375
• /
• 2016

One of the most important capabilities for autonomous service robots working in living environments is to recognize and understand the correct context in dynamically changing environment. To generate high-level context knowledge for decision-making from multiple sensory data streams, many technical problems such as multi-modal sensory data fusion, uncertainty handling, symbolic knowledge grounding, time dependency, dynamics, and time-constrained spatio-temporal reasoning should be solved. Considering these problems, this paper proposes an effective dynamic context management and spatio-temporal reasoning method for intelligent service robots. In order to guarantee efficient context management and reasoning, our algorithm was designed to generate low-level context knowledge reactively for every input sensory or perception data, while postponing high-level context knowledge generation until it was demanded by the decision-making module. When high-level context knowledge is demanded, it is derived through backward spatio-temporal reasoning. In experiments with Turtlebot using Kinect visual sensor, the dynamic context management and spatio-temporal reasoning system based on the proposed method showed high performance.

• Proceedings of the Korean Society of Precision Engineering Conference
• /
• 1995.10a
• /
• pp.697-701
• /
• 1995

The network encironment includes a number of autonomous agents which are widely distributed, have different platforms, and change very dynamically. The information system operated on this environment must solve some basic problems; restrictive client-server models, heterogeneous systems, and intellignet agents. We are using KQML for knowledge management. Java language provides solutions against a strong server dependency and a heterogenous troubles. We introduce KQML as an agent communication language and JATLite as a java agent template. these increase an efficiency of communication on network and enable us to use resources distributed in world wide web. Also, we describe a new agent system architecture and implement it through an example scenario

• Journal of Advanced Navigation Technology
• /
• v.26 no.4
• /
• pp.205-210
• /
• 2022

Drones, which have rapidly grown along with the 4th industrial revolution, spread over industries and also widely used for military purposes. In recent wars in Europe, drones are being evaluated as a game changer on the battlefield, and their importance for military use is being highlighted. The Republic of Korea Army also planned drone-bot systems including various drones suitable for echelons and missions of the military as future defense forces. The keyword of these drone-bot systems is autonomy by artificial intelligence. In addition, common use of operating platforms is required for the rapid development of various types of drones. In this paper, we propose software framework that applies diverse artificial intelligence technologies such as multi-agent system, cognitive architecture and knowledge-based context reasoning for mission autonomy and common use of military drones.

• Journal of the Korea Society of Computer and Information
• /
• v.26 no.3
• /
• pp.9-17
• /
• 2021

In this paper, an autonomous multi-agent path planning using reinforcement learning for monitoring of infrastructures and resources in a computationally distributed system was proposed. Reinforcement-learning-based multi-agent exploratory system in a distributed node enable to evaluate a cumulative reward every action and to provide the optimized knowledge for next available action repeatedly by learning process according to a learning policy. Here, the proposed methods were presented by (a) approach of dynamics-based motion constraints multi-agent path-planning to reduce smaller agent steps toward the given destination(goal), where these agents are able to geographically explore on the environment with initial random-trials versus optimal-trials, (b) approach using agent sub-goal selection to provide more efficient agent exploration(path-planning) to reach the final destination(goal), and (c) approach of reinforcement learning schemes by using the proposed autonomous and asynchronous triggering of agent exploratory phases.

• Journal of Intelligence and Information Systems
• /
• v.25 no.1
• /
• pp.43-61
• /
• 2019

Development of technologies in artificial intelligence has been rapidly increasing with the Fourth Industrial Revolution, and researches related to AI have been actively conducted in a variety of fields such as autonomous vehicles, natural language processing, and robotics. These researches have been focused on solving cognitive problems such as learning and problem solving related to human intelligence from the 1950s. The field of artificial intelligence has achieved more technological advance than ever, due to recent interest in technology and research on various algorithms. The knowledge-based system is a sub-domain of artificial intelligence, and it aims to enable artificial intelligence agents to make decisions by using machine-readable and processible knowledge constructed from complex and informal human knowledge and rules in various fields. A knowledge base is used to optimize information collection, organization, and retrieval, and recently it is used with statistical artificial intelligence such as machine learning. Recently, the purpose of the knowledge base is to express, publish, and share knowledge on the web by describing and connecting web resources such as pages and data. These knowledge bases are used for intelligent processing in various fields of artificial intelligence such as question answering system of the smart speaker. However, building a useful knowledge base is a time-consuming task and still requires a lot of effort of the experts. In recent years, many kinds of research and technologies of knowledge based artificial intelligence use DBpedia that is one of the biggest knowledge base aiming to extract structured content from the various information of Wikipedia. DBpedia contains various information extracted from Wikipedia such as a title, categories, and links, but the most useful knowledge is from infobox of Wikipedia that presents a summary of some unifying aspect created by users. These knowledge are created by the mapping rule between infobox structures and DBpedia ontology schema defined in DBpedia Extraction Framework. In this way, DBpedia can expect high reliability in terms of accuracy of knowledge by using the method of generating knowledge from semi-structured infobox data created by users. However, since only about 50% of all wiki pages contain infobox in Korean Wikipedia, DBpedia has limitations in term of knowledge scalability. This paper proposes a method to extract knowledge from text documents according to the ontology schema using machine learning. In order to demonstrate the appropriateness of this method, we explain a knowledge extraction model according to the DBpedia ontology schema by learning Wikipedia infoboxes. Our knowledge extraction model consists of three steps, document classification as ontology classes, proper sentence classification to extract triples, and value selection and transformation into RDF triple structure. The structure of Wikipedia infobox are defined as infobox templates that provide standardized information across related articles, and DBpedia ontology schema can be mapped these infobox templates. Based on these mapping relations, we classify the input document according to infobox categories which means ontology classes. After determining the classification of the input document, we classify the appropriate sentence according to attributes belonging to the classification. Finally, we extract knowledge from sentences that are classified as appropriate, and we convert knowledge into a form of triples. In order to train models, we generated training data set from Wikipedia dump using a method to add BIO tags to sentences, so we trained about 200 classes and about 2,500 relations for extracting knowledge. Furthermore, we evaluated comparative experiments of CRF and Bi-LSTM-CRF for the knowledge extraction process. Through this proposed process, it is possible to utilize structured knowledge by extracting knowledge according to the ontology schema from text documents. In addition, this methodology can significantly reduce the effort of the experts to construct instances according to the ontology schema.

• KIPS Transactions on Computer and Communication Systems
• /
• v.3 no.12
• /
• pp.455-462
• /
• 2014

In recent years, various services in mobile environments due to the growth of mobile devices and related techniques like wireless networks. Furthermore, as the increasing communication traffic in cellular networks has become a new significant issue, many studies for device-to-device(D2D) communication and D2D-based cooperative services have been performed recently. In this paper, we design a smart agent system for D2D-based cooperative services and propose a dynamic service binding method based on service ontology. We classify roles of mobile devices for cooperative services by defining three types of smart agents, and construct a knowledge base in order to describe properties of 'service' unit. The proposed knowledge model, D2D cooperative service ontology, can enable a autonomous cooperative services between mobile devices by binding a requested service to the appropriate member device according to the real-time context in mobile environments.

• Proceedings of the Korea Inteligent Information System Society Conference
• /
• 2007.05a
• /
• pp.297-306
• /
• 2007

지능정보시스템 구축에 있어서 자동화가 어려운 단계중의 하나인 규칙 습득을 위해 활용되는 방법중의 하나가 제한된 언어집합 기법을 이용하는 것이다. 그러나 제한된 언어집합 기법을 이용해 규칙을 생성하기 위해서는 규칙을 구성하는 변수와 그 값들에 대한 정보가 사전에 정의되어 있어야 하는데, 유동성이 큰 웹 환경에서 예상 가능한 모든 변수와 그 값을 사전에 정의하는 것이 매우 어렵다. 이에 본 연구에서는 이러한 한계를 극복하기 위해 제한된 언어집합 기법과 온톨로지를 이용한 규칙 생성 방법론을 제시하였다. 이를 위해 지식의 습득 대상이 되는 특정 문장은 문법구조 분석기를 이용해 파싱을 수행하며, 파싱된 단어들을 이용해 규칙의 구성 요소인 변수와 그 값을 식별한다. 그러나 규칙을 내포한 자연어 문장의 불완전성으로 인해 변수가 명확하지 않거나 완전히 빠져 있는 경우가 흔히 발생하며, 이로 인해 온전한 형식의 규칙 생성이 어렵게 된다. 이 문제는 도메인 온톨로지의 생성을 통해 해결하였다. 이 온톨로지는 특정 도메인을 구성하고 있는 개념들간의 관계를 포함하고 있다는 점에서는 기존의 온톨로지와 유사하지만, 규칙을 완성하는 과정에서 사용된 개념들의 사용빈도를 기반으로 온톨로지의 구조를 변경하고, 결과적으로 더 정확한 규칙의 생성을 지원한다는 점에서 기존의 온톨로지와 차별화된다. 이상의 과정을 통해 식별된 규칙의 구성요소들은 제한된 언어집합 기법을 이용해 구체화된다. 본 연구에서 제안하는 방법론을 설명하기 위해 임의의 인터넷 쇼핑몰에서 수행되는 배송관련 웹 페이지를 선정하였다. 본 방법론은 XRML에서의 지식 습득 과정의 효율성 제고에 기여할 수 있을 것으로 기대된다.