• Title/Summary/Keyword: multi-agent learning

Search Result 117, Processing Time 0.027 seconds

Deep Learning-Based Dynamic Scheduling with Multi-Agents Supporting Scalability in Edge Computing Environments (멀티 에이전트 에지 컴퓨팅 환경에서 확장성을 지원하는 딥러닝 기반 동적 스케줄링)

  • JongBeom Lim
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.12 no.9
    • /
    • pp.399-406
    • /
    • 2023
  • Cloud computing has been evolved to support edge computing architecture that combines fog management layer with edge servers. The main reason why it is received much attention is low communication latency for real-time IoT applications. At the same time, various cloud task scheduling techniques based on artificial intelligence have been proposed. Artificial intelligence-based cloud task scheduling techniques show better performance in comparison to existing methods, but it has relatively high scheduling time. In this paper, we propose a deep learning-based dynamic scheduling with multi-agents supporting scalability in edge computing environments. The proposed method shows low scheduling time than previous artificial intelligence-based scheduling techniques. To show the effectiveness of the proposed method, we compare the performance between previous and proposed methods in a scalable experimental environment. The results show that our method supports real-time IoT applications with low scheduling time, and shows better performance in terms of the number of completed cloud tasks in a scalable experimental environment.

Intelligent Service Agents using User Profile and Ontology (온톨로지와 사용자 프로파일을 적용한 지능형 서비스 에이전트)

  • Kim, Je-Min;Park, Young-Tack
    • Journal of KIISE:Software and Applications
    • /
    • v.33 no.12
    • /
    • pp.1062-1072
    • /
    • 2006
  • Recently, new intelligent service frameworks, such as ubiquitous computing are proposed. So, the necessity of adaptive agent system has been increased. In this paper, we propose an intelligent service agent to help that ubiquitous computing system offer user suitable service in ubiquitous computing environment. In order to offer user suitable uT-service, an intelligent service agent mediates the gap between the context information in uT-service system, and user preference is reflected in it. Therefore, we focus on following three components; the first is suitable multi agent framework-agent communication analysis and applicable method of inference engine, the second is uT-ontologies to describe various context information-context information sharing between agents and context information understanding between agents, the third is learning method of user profile to apply in uT-service system. This approach enables us to build adaptive uT-service system to offer suitable service according to user preference.

Comparative Analysis of Multi-Agent Reinforcement Learning Algorithms Based on Q-Value (상태 행동 가치 기반 다중 에이전트 강화학습 알고리즘들의 비교 분석 실험)

  • Kim, Ju-Bong;Choi, Ho-Bin;Han, Youn-Hee
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2021.05a
    • /
    • pp.447-450
    • /
    • 2021
  • 시뮬레이션을 비롯한 많은 다중 에이전트 환경에서는 중앙 집중 훈련 및 분산 수행(centralized training with decentralized execution; CTDE) 방식이 활용되고 있다. CTDE 방식 하에서 중앙 집중 훈련 및 분산 수행 환경에서의 다중 에이전트 학습을 위한 상태 행동 가치 기반(state-action value; Q-value) 다중 에이전트 알고리즘들에 대한 많은 연구가 이루어졌다. 이러한 알고리즘들은 Independent Q-learning (IQL)이라는 강력한 벤치 마크 알고리즘에서 파생되어 다중 에이전트의 공동의 상태 행동 가치의 분해(Decomposition) 문제에 대해 집중적으로 연구되었다. 본 논문에서는 앞선 연구들에 관한 알고리즘들에 대한 분석과 실용적이고 일반적인 도메인에서의 실험 분석을 통해 검증한다.

Intelligent Intrusion Detection and Prevention System using Smart Multi-instance Multi-label Learning Protocol for Tactical Mobile Adhoc Networks

  • Roopa, M.;Raja, S. Selvakumar
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.6
    • /
    • pp.2895-2921
    • /
    • 2018
  • Security has become one of the major concerns in mobile adhoc networks (MANETs). Data and voice communication amongst roaming battlefield entities (such as platoon of soldiers, inter-battlefield tanks and military aircrafts) served by MANETs throw several challenges. It requires complex securing strategy to address threats such as unauthorized network access, man in the middle attacks, denial of service etc., to provide highly reliable communication amongst the nodes. Intrusion Detection and Prevention System (IDPS) undoubtedly is a crucial ingredient to address these threats. IDPS in MANET is managed by Command Control Communication and Intelligence (C3I) system. It consists of networked computers in the tactical battle area that facilitates comprehensive situation awareness by the commanders for timely and optimum decision-making. Key issue in such IDPS mechanism is lack of Smart Learning Engine. We propose a novel behavioral based "Smart Multi-Instance Multi-Label Intrusion Detection and Prevention System (MIML-IDPS)" that follows a distributed and centralized architecture to support a Robust C3I System. This protocol is deployed in a virtually clustered non-uniform network topology with dynamic election of several virtual head nodes acting as a client Intrusion Detection agent connected to a centralized server IDPS located at Command and Control Center. Distributed virtual client nodes serve as the intelligent decision processing unit and centralized IDPS server act as a Smart MIML decision making unit. Simulation and experimental analysis shows the proposed protocol exhibits computational intelligence with counter attacks, efficient memory utilization, classification accuracy and decision convergence in securing C3I System in a Tactical Battlefield environment.

A Design and Implementation of The Deep Learning-Based Senior Care Service Application Using AI Speaker

  • Mun Seop Yun;Sang Hyuk Yoon;Ki Won Lee;Se Hoon Kim;Min Woo Lee;Ho-Young Kwak;Won Joo Lee
    • Journal of the Korea Society of Computer and Information
    • /
    • v.29 no.4
    • /
    • pp.23-30
    • /
    • 2024
  • In this paper, we propose a deep learning-based personalized senior care service application. The proposed application uses Speech to Text technology to convert the user's speech into text and uses it as input to Autogen, an interactive multi-agent large-scale language model developed by Microsoft, for user convenience. Autogen uses data from previous conversations between the senior and ChatBot to understand the other user's intent and respond to the response, and then uses a back-end agent to create a wish list, a shared calendar, and a greeting message with the other user's voice through a deep learning model for voice cloning. Additionally, the application can perform home IoT services with SKT's AI speaker (NUGU). The proposed application is expected to contribute to future AI-based senior care technology.

A Course Scheduling Multi-module System based on Web using Algorithm for Analysis of Weakness (취약성 분석 알고리즘을 이용한 웹기반 코스 스케줄링 멀티 모듈 시스템)

  • 이문호;김태석;김봉기
    • Journal of Korea Multimedia Society
    • /
    • v.5 no.3
    • /
    • pp.290-297
    • /
    • 2002
  • The appearance of web technology has accelerated the role of the application of multimedia technology, computer communication technology and multimedia application contents. Recently WBI model which is based on web has been proposed in the part of the new activity model of teaching-teaming. How to learn and evaluate is required to consider individual learner's learning level. And it is recognized that the needs of the efficient and automated education agents in the web-based instruction is increased But many education systems that had been studied recently did not service fluently the courses which learners had been wanting and could not provide the way for the learners to study the learning weakness which is observed in the continuous feedback of the course. In this paper we propose design of multi-module system for course scheduling of learner-oriented using weakness analysis algorithm. First proposed system monitors learner's behaviors constantly, evaluates them, and calculates his accomplishment and weakness. From this weakness the multi-agent prepares the learner a suitable course environment to strengthen his weakness. Then the learner achieves an active and complete teaming from the repeated and suitable course.

  • PDF

Deployment of Network Resources for Enhancement of Disaster Response Capabilities with Deep Learning and Augmented Reality (딥러닝 및 증강현실을 이용한 재난대응 역량 강화를 위한 네트워크 자원 확보 방안)

  • Shin, Younghwan;Yun, Jusik;Seo, Sunho;Chung, Jong-Moon
    • Journal of Internet Computing and Services
    • /
    • v.18 no.5
    • /
    • pp.69-77
    • /
    • 2017
  • In this paper, a disaster response scheme based on deep learning and augmented reality technology is proposed and a network resource reservation scheme is presented accordingly. The features of deep learning, augmented reality technology and its relevance to the disaster areas are explained. Deep learning technology can be used to accurately recognize disaster situations and to implement related disaster information as augmented reality, and to enhance disaster response capabilities by providing disaster response On-site disaster response agent, ICS (Incident Command System) and MCS (Multi-agency Coordination Systems). In the case of various disasters, the fire situation is focused on and it is proposed that a plan to strengthen disaster response capability effectively by providing fire situation recognition based on deep learning and augmented reality information. Finally, a scheme to secure network resources to utilize the disaster response method of this paper is proposed.

An Immune Algorithm based Multiple Energy Carriers System (면역알고리즘 기반의 MECs (에너지 허브) 시스템)

  • Son, Byungrak;Kang, Yu-Kyung;Lee, Hyun
    • Journal of the Korean Solar Energy Society
    • /
    • v.34 no.4
    • /
    • pp.23-29
    • /
    • 2014
  • Recently, in power system studies, Multiple Energy Carriers (MECs) such as Energy Hub has been broadly utilized in power system planners and operators. Particularly, Energy Hub performs one of the most important role as the intermediate in implementing the MECs. However, it still needs to be put under examination in both modeling and operating concerns. For instance, a probabilistic optimization model is treated by a robust global optimization technique such as multi-agent genetic algorithm (MAGA) which can support the online economic dispatch of MECs. MAGA also reduces the inevitable uncertainty caused by the integration of selected input energy carriers. However, MAGA only considers current state of the integration of selected input energy carriers in conjunctive with the condition of smart grid environments for decision making in Energy Hub. Thus, in this paper, we propose an immune algorithm based Multiple Energy Carriers System which can adopt the learning process in order to make a self decision making in Energy Hub. In particular, the proposed immune algorithm considers the previous state, the current state, and the future state of the selected input energy carriers in order to predict the next decision making of Energy Hub based on the probabilistic optimization model. The below figure shows the proposed immune algorithm based Multiple Energy Carriers System. Finally, we will compare the online economic dispatch of MECs of two algorithms such as MAGA and immune algorithm based MECs by using Real Time Digital Simulator (RTDS).

Characteristics of North Dakota State University Extension Service in USA (미국 노스다코타주 농업연구와 농촌지도의 특징과 한국의 농촌지도사업에 주는 시사점)

  • Park, Duk Byeong;Goreham, Gary A.
    • Journal of Agricultural Extension & Community Development
    • /
    • v.8 no.1
    • /
    • pp.73-83
    • /
    • 2001
  • North Dakota State University (NDSU) Extension Service's purpose was to create a learning partnership that helped adults and youth enhance their lives and communities. NDSU Extension Service has maintained a strong blend of county, regional and state staff to support their program delivery. Experiment Station and Extension Service were integrated both in their job duties and at the administrative level. While researchers at the campus and center carried out both research and outreach activities with producers, Extension staff both at county and center carried out some research activities as well as outreach activities. The strong county-based Extension network was the main avenue for program delivery. Extension agents also provide programs on a multi-country basis. Program planning includes county advisory councils, multi-county advisory councils, support groups, and commodity groups, such as farmers and business people. Planning was used to shape their long-range plan of work along with adjustments to their annual activities. Funding of the NDSU Extension Service has been a blend of federal, state, and county dollars. In the past few years, grant dollars and agency partnerships have increased. Local input into extension programs, combined with support and funding from state and federal partners, enabled the extension service to truly meet the needs of people.

  • PDF

Essential technical and intellectual abilities for autonomous mobile service medical robots

  • Rogatkin, Dmitry A.;Velikanov, Evgeniy V.
    • Advances in robotics research
    • /
    • v.2 no.1
    • /
    • pp.59-68
    • /
    • 2018
  • Autonomous mobile service medical robots (AMSMRs) are one of the promising developments in contemporary medical robotics. In this study, we consider the essential technical and intellectual abilities needed by AMSMRs. Based on expert analysis of the behavior exhibited by AMSMRs in clinics under basic scenarios, these robots can be classified as intellectual dynamic systems acting according to a situation in a multi-object and multi-agent environment. An AMSMR should identify different objects that define the presented territory (rooms and paths), different objects between and inside rooms (doors, tables, and beds, among others), and other robots. They should also identify the means for interacting with these objects, people and their speech, different information for communication, and small objects for transportation. These are included in the minimum set required to form the internal world model in an AMSMR. Recognizing door handles and opening doors are some of the most difficult problems for contemporary AMSMRs. The ability to recognize the meaning of human speech and actions and to assist them effectively are other problems that need solutions. These unresolved issues indicate that AMSMRs will need to pass through some learning and training programs before starting real work in hospitals.