• Title/Summary/Keyword: Agent Network

Search Result 981, Processing Time 0.025 seconds

Cooperative Multi-agent Reinforcement Learning on Sparse Reward Battlefield Environment using QMIX and RND in Ray RLlib

  • Minkyoung Kim
    • Journal of the Korea Society of Computer and Information
    • /
    • v.29 no.1
    • /
    • pp.11-19
    • /
    • 2024
  • Multi-agent systems can be utilized in various real-world cooperative environments such as battlefield engagements and unmanned transport vehicles. In the context of battlefield engagements, where dense reward design faces challenges due to limited domain knowledge, it is crucial to consider situations that are learned through explicit sparse rewards. This paper explores the collaborative potential among allied agents in a battlefield scenario. Utilizing the Multi-Robot Warehouse Environment(RWARE) as a sparse reward environment, we define analogous problems and establish evaluation criteria. Constructing a learning environment with the QMIX algorithm from the reinforcement learning library Ray RLlib, we enhance the Agent Network of QMIX and integrate Random Network Distillation(RND). This enables the extraction of patterns and temporal features from partial observations of agents, confirming the potential for improving the acquisition of sparse reward experiences through intrinsic rewards.

Network Analysis to Describe Service Link for Customized Visiting Health Care Program (맞춤형방문건강관리사업의 지역사회 네트워크 탐색)

  • Jang, Soong-Nang;Cho, Sung-Il
    • Korean Journal of Health Education and Promotion
    • /
    • v.29 no.1
    • /
    • pp.1-11
    • /
    • 2012
  • Objectives: The nurse visiting health service named Customized Visiting Health Care Program(CVHCP) requires the service innovations incorporating community support into a local service network. The purpose of this study was to assess the community network in CVHCP and inform improvement in this network. Methods: We used Social Network Analysis(SNA) in one CVHCP at H city. Network links were generated by self-administered questionnaires by the 14 community resource centers who quantified their links to all other 25 agents on the list. Links were analyzed by a dichotomous scale for any experience of collaboration and a scored scale of 0 to 3 for level of collaboration using UCINET v6. Results: A list of 14 agents was generated, and local network was dominated by the Public Health Center and a local welfare center named Unlimited Care Center(UCC). According to centrality score, UCC was the most prominent agent, and Public Health Center was the most influential agent, being a link in the pathway flow between other agents for 9.5% of contribution. CVHCP scored lower rank of prominent with 30.8% of other agents reported referring to it. Conclusions: Social network analysis provides a useful network description for informing and evaluation service network improvement in maximizing its service for the CVHCP.

A study on the improvement of thermostability and dielectric breakdown strength for packaging and impregnating epoxy composite materials for electrical machines and apparatus (전기 기기용 봉지 및 함침 에폭시 복합 재료의 내열성 및 절연파괴 특성 개선에 관한 연구)

  • 김명호;김재환
    • Electrical & Electronic Materials
    • /
    • v.7 no.6
    • /
    • pp.527-533
    • /
    • 1994
  • In this study, it was studied on dielectric breakdown strength and thennostability properties due to the structure variation of matrix resin and treatment of coupling agent of epoxy insulating materials. The interpenetrating network structure was formed by simultaneous heating curing the epoxy resin with single network structure and the methacrylic acid resin. Also inner structure was observed and the glass transition temperature was measured on these three type specimens. Dielectric breakdown properties were investigated by applying DC, AC and impulse voltage. As a result, the glass transition temperature and the dielectric breakdown strength of specimen with interpenetrating network structure was more higher than another two type specimens.

  • PDF

The Structure of Assure Information Security In Mobile Environment Based Mobile PKI (모바일 PKI 기반의 이동 보안 구조)

  • 서세영;신승수;최승권;조용환
    • Proceedings of the Korea Contents Association Conference
    • /
    • 2003.11a
    • /
    • pp.132-139
    • /
    • 2003
  • In this paper, we design and implement the public key certification the structure of assure information security which play an important role in PKI (Public Key Infrastructure). The structure of assure information security consists of Root-CA, Home-network and Foreign-network. CA will going to gave the mandate to Home-Agent or Foreign-Agent when they request. The structure of assure information security is various characteristic : more then high speed, mobile network, and low cost more then previous structure of assure information security.

  • PDF

Design and Performance Evaluation of Cross-layer ARQ Mechanism Using Local Re-transmission Agent in Next Generation Mobile Networks (차세대 이동 망에서 지역 재전송 에이전트를 이용한 Cross-layer ARQ 메커니즘 설계 및 성능 평가)

  • So, Sang-Gp;Park, Man-Kyu;Lee, Jae-Yong;Kim, Byung-Chul;Kim, Dae-Young
    • Journal of the Institute of Electronics Engineers of Korea TC
    • /
    • v.46 no.8
    • /
    • pp.50-58
    • /
    • 2009
  • Fourth generation mobile communication network have the technology of extensive form include basic service technology and it has been developed from the radio access technology and network topology. Not only fourth generation mobile communication network have basically done new highspeed radio access technology which is suitable to high and low speed environment of transfer, but also it is possible that they have been made for freely vertical handover. ETRI also has made fourth generation mobile communication network which is WiNGS(Wireless Initiative for Next Generation Service) satisfied that demand. This paper is made by lossless handover method through the local retransmission ARQ agent that is one of the main technology of fourth generation mobile communication network. Lossless handover method through local retransmission ARQ agent has been basically made by WiNGS and it was better than original local retransmission of layer by simulation.

Security Policy Negotiation Model Design for Secure Network Management (안전한 망 관리를 위한 보안정책 협상모델 설계)

  • Park, Jin-Ho;Chung, Jin-Wook
    • The KIPS Transactions:PartC
    • /
    • v.11C no.2
    • /
    • pp.171-176
    • /
    • 2004
  • This paper presents the design of a certain highly efficient security policy negotiation of SPS(Security Policy System) for secure network management using mobile agent system. The conventional IP security systems for secure network management have some problems. A drawback to these systems is that the required policy between each security area is different. Another problem is not possible to guarantee whether a packet is transmitted through the same path by both directions and is protected by the same policy due to the topology of the network. Unlike conventional systems, the model developed herein can be resolved by using a mobile agent technology. If each domain needs a negotiation of security policy, a mobile agent manages the result of the negotiation in the form of a passport and guarantees the authentication and reliability each other by using the passport.

Authentication Method based on AAA to Traverse the VPN Gateway in Mobile IPv4 (Mobile IPv4에서 VPN 게이트웨이 통과를 위한 AAA 기반의 인증 방법)

  • Kim, Mi-Young;Mun, Young-Song
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.32 no.4B
    • /
    • pp.191-199
    • /
    • 2007
  • Mobile node has to register its current location to Home Agent when it moves to another network while away from home. However, the registration procedure cannot be completed successfully when Home Agent is protected by the VPN gateway which guards MN's home network and discards the unauthorized packets incoming from outside as a lack of security association(SA) between the Care-of address and security policy of the home network so that the binding registration message without SA is discarded smoothly by the VPN gateway. This paper presents the authentication and key exchange scheme using the AAA infrastructure for a user in Internet to access the home network behind the VPN gateway. By defining the role of authentication and tunnel processing for each agent or relay entity, this paper presents the procedure to register the current location to its Home Agent with secure manner. Performance result shows cost improvement up to 40% comparing with existing scheme in terms of the packet loss cost, the property of mobility and traffic.

Implementation and Memory Performance Analysis of a Service Mobility Agent System to Support Service Mobility in Home Network (홈 네트워크 환경에서 서비스 이동성 지원을 위한 에이전트 구현 방안 및 메모리 성능 분석)

  • Nam, Jong-Wook;Yu, Myung-Ju;Choi, Seong-Gon
    • The Journal of the Korea Contents Association
    • /
    • v.10 no.6
    • /
    • pp.80-90
    • /
    • 2010
  • In this paper, we introduce some issues to implement an agent system to support service mobility in home network environment, and describe detailed design method in terminal as well as server agent. Specifically, we describe user recognition module, signaling message receiving/parsing module of terminal agent and signaling message receiving/parsing module, multimedia switching module, memory management module of server agent. We define several parameters managed in IP sharing device and design binding table structure to support mobility. And we utilize M/M/1/K queueing theory to obtain relations between memory size, blocking probability and memory utilization. From the obtained results, we show that memory size can be predicted in server agent mounted on IP sharing device.

Study on Agent based Internetworking Platform (에이전트 기반 인터네트워킹 플랫폼 연구)

  • 전준현
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.29 no.3B
    • /
    • pp.314-324
    • /
    • 2004
  • Recently, high-speed internet subscribers have grown continuously, and reached up to 10 millions. But existing network management that is responsible only for user access is confronted with many difficulties, since user access network(xDSL, Cable, B-WILL, and so on) has diversified and value added wired/wireless contents service has developed. In this paper propose the Agent based Inter Networking platform as object-oriented hierarchical system that can provide various service such as access QoS(Quality of Service), customized application service and security service according to user on demand. This system has divided into two parts(user agent and agent management system & local and central management systems). Management system periodically receive status information such as bandwidth, download speed, delay, current service, and so on, and process them, then build a policy based on processed information. According to personal user profile that is generated by this policy, the customized service can be provided for users. And This system adopt the object-oriented modeling in case that system migration and integration, and implement a system that is robust and stable for security through hierarchical server system.

Efficient Migration of Service Agent in P-Grid Environments based-on Mobile Agent (이동에이전트 기반의 P-그리드 환경에서 서비스 에이전트의 효율적인 이주기법)

  • Kook, Youn-Gyou;Uem, Young-Hyun;Jung, Gye-Dong;Chio, Yung-Geun
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • v.9 no.2
    • /
    • pp.131-134
    • /
    • 2005
  • This paper describes the efficient peer-to-peer migration method of Grid service agent on the mobile agent based P-Grid. The migration mechanism for transmitting service agent upon the service request is based on the peer's logic network topology. The network topologies that this system uses are organized as star topology, ring topology and tree topology, and agents are migrated by the master/slave method and serial/parallel method. The migration method of services is chosen based on the execution range and characteristic of the requested service. Also, the entire execution time of service is affected by the performance of peer that is a part of network topology, and the migration order, Therefore, the system monitors the performance of peers, and determines the migration priority based on analyzing and learning history. The system can reduce service execution time efficiently with decisions of migration method for service agent and priority of peers.

  • PDF