• Title/Summary/Keyword: Agent Based Simulation

Search Result 358, Processing Time 0.028 seconds

Design Mobility Agent Module for Healthcare Application Service (헬스케어 응용 서비스를 위한 Mobility Agent 모듈 설계)

  • Nam, Jin-Woo;Chung, Yeong-Jee
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.12 no.2
    • /
    • pp.378-384
    • /
    • 2008
  • The sensor network for the health care application service has the man or movable object as the main sensing object. In order to support inter-node interaction by the movement of such sensing objects, the node's dynamic function modification, dynamic self-configuration and energy efficiency must be considered. In this paper, the Agilla model which supports the dynamic function modification through the agent migration between nodes and LEACH protocol which guarantees the dynamic self-configuration and energy efficiency through the configuration of inter-node hierarchical cluster configuration are analyzed. Based on the results of the analysis, the Mobility Agent Middleware which supports the dynamic function modification between nodes is designed, and LEACH_Mobile protocol which guarantees the node nobility as the weakness of the existing LEACH protocol is suggested. Also, the routing module which supports the LEACH_Mobile protocol is designed and the interface for conjunction with Mobility Agent Middleware is designed. Then, it is definitely increase performance which un mobility node of transfer data rate through LEACH_Mobile protocol of simulation result.

The Integrated Control Model for the Freeway Corridors based on Multi-Agent Approach I : Simulation System & Modeling for Optimization (멀티 에이전트를 이용한 도로정체에 따른 교통흐름 예측 및 통합제어 I : 시뮬레이션 시스템 개발 및 최적화를 위한 모델링)

  • Cho, Ki-Yong;Bae, Chul-Ho;Kim, Hyun-Jun;Chu, Yul;Suh, Myung-Won
    • Transactions of the Korean Society of Automotive Engineers
    • /
    • v.15 no.1
    • /
    • pp.8-15
    • /
    • 2007
  • Freeway corridors consist of urban freeways and parallel arterials that drivers can use alternatively. Ramp metering in freeways and signal control in arterials are contemporary traffic control methods that have been developed and applied in order to improve traffic conditions of freeway corridors. However, most of the existing studies have focused on either optimal ramp metering in freeways, or progression signal strategies between arterial intersections. There have been no traffic control systems in Korea that integrates the freeway ramp metering and arterial signal control. The effective control strategies for freeway operations may cause negative effects on arterial traffic. On the other hand, traffic congestion and bottleneck phenomenon of arterials due to the increasing peak-hour travel demand and ineffective signal operation may generate an accessibility problem to freeway ramps. Thus, the main function of the freeway which is the through-traffic process has not been successful. The purpose of this study is to develop an integrated control model that connects freeway ramp metering systems and signal control systems in arterial intersections. And Optimization of integrated control model which consists of ramp metering and signal control is another purpose. The design of experiment, neural network, and simulated annealing are used for optimization.

Multi-Agent Model and Simulation for the Dynamics of Housing Market (주택시장변동 분석을 위한 멀티에이전트 모형의 개발 및 시뮬레이션)

  • Moon, Tae-Heon
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.12 no.3
    • /
    • pp.101-115
    • /
    • 2009
  • The prompt recovery of housing market in Korea became the national task, for which tools that can analyze the influence that changing situation of housing market and new policy may have on the housing market needs to be developed. Thus, this research intends to develop Multi-Agent Housing Market Model and simulation system in Jinju City as a study area. Analyzing the local housing market of Jinju City, then multi-agent model of housing market that consolidates 3 sub-models, house choice model, hedonic model of house price and location choice model is developed. Moreover in order to develop simulation system the model is programmed in the virtual space of which the size is $150{\times}100$ cell including physical shape of city such as road, urban facilities, land use, etc. With the system, simulations are performed to confirm the impact of urban development on the pattern of residential location. As a result, it is found that the residential location can not be easily induced when only road, commercial and convenient facilities are supplied. However, it is also found that since supplying green results in very many residences, arrangement of infrastructure and environmental factor should be considered at the same time for urban development. As conclusion, it is confirmed that the model and simulation system developed in this research smoothly works to be utilized for the analysis of diverse policy experiment and housing market.

  • PDF

An MPLS VPN with Mobility Support (이동성을 지원하는 MPLS 방식 가상사설망)

  • Lee, Young-Seok;Choi, Hoon
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.26 no.12C
    • /
    • pp.225-232
    • /
    • 2001
  • In this paper, we describe a mechanism that supports the mobility service for VPN(Virtual Private Network) users on MPLS(Multiprotocol Label Switching) network. The MPLS VPN considered in this study is controlled by CE(Customer Edge) routers. In such a VPN, CE routers have additional functions to support mobile VPN users, i.e., Home Agent function, foreign Agent function, Correspondent Agent function. This mechanism is applied when a VPN node moves to other site of the saute VPN, or when it moves to other site of a different VPN, or to a non-VPN site. We perform a simulation study to compare the performance of CE based MPLS VPN with that of PE(Provider Edge) based MPLS VPN with mobility support.

  • PDF

Agent-based Adaptive Multimedia Streaming Considering Device Capabilities and Dynamic Network Conditions (무선 단말의 처리능력과 동적 네트워크 환경을 고려한 에이전트 기반의 적응적 멀티미디어 스트리밍 기법)

  • Jang, Minsoo;Seong, Chaemin;Kim, Jingu;Lim, Kyungshik
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.10 no.6
    • /
    • pp.353-362
    • /
    • 2015
  • In order to provide smart devices with high quality multimedia streaming services, an adaptive streaming technique over HTTP has been received much attention recently and the Dynamic Adaptive Streaming over HTTP (DASH) standard has been established. In DASH, however, the technique to select an appropriate quality of multimedia based on the performance metrics measured in a smart device might have some difficulties to reflect the capabilities of other neighboring smart devices and dynamic network conditions in real time. To solve the problem, this paper proposes a novel software agent approach, called DASH agent (DA), which gathers and analyzes the device capabilities and dynamic network conditions in real time and finally determines the highest achievable quality of segment to meet the best Quality of Experience (QoE) in current situations. The simulation results show that our approach provides higher quality of multimedia segments with less frequency of quality changes to lower quality of multimedia segments.

Mean Field Game based Reinforcement Learning for Weapon-Target Assignment (평균 필드 게임 기반의 강화학습을 통한 무기-표적 할당)

  • Shin, Min Kyu;Park, Soon-Seo;Lee, Daniel;Choi, Han-Lim
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.23 no.4
    • /
    • pp.337-345
    • /
    • 2020
  • The Weapon-Target Assignment(WTA) problem can be formulated as an optimization problem that minimize the threat of targets. Existing methods consider the trade-off between optimality and execution time to meet the various mission objectives. We propose a multi-agent reinforcement learning algorithm for WTA based on mean field game to solve the problem in real-time with nearly optimal accuracy. Mean field game is a recent method introduced to relieve the curse of dimensionality in multi-agent learning algorithm. In addition, previous reinforcement learning models for WTA generally do not consider weapon interference, which may be critical in real world operations. Therefore, we modify the reward function to discourage the crossing of weapon trajectories. The feasibility of the proposed method was verified through simulation of a WTA problem with multiple targets in realtime and the proposed algorithm can assign the weapons to all targets without crossing trajectories of weapons.

A Study on Load Distribution of Gaming Server Using Proximal Policy Optimization (Proximal Policy Optimization을 이용한 게임서버의 부하분산에 관한 연구)

  • Park, Jung-min;Kim, Hye-young;Cho, Sung Hyun
    • Journal of Korea Game Society
    • /
    • v.19 no.3
    • /
    • pp.5-14
    • /
    • 2019
  • The gaming server is based on a distributed server. In order to distribute workloads of gaming servers, distributed gaming servers apply some algorithms which divide each of gaming server's workload into balanced workload among the gaming servers and as a result, efficiently manage response time and fusibility of server requested by the clients. In this paper, we propose a load balancing agent using PPO(Proximal Policy Optimization) which is one of the methods from a greedy algorithm and Policy Gradient which is from Reinforcement Learning. The proposed load balancing agent is compared with the previous researches based on the simulation.

Modified Deep Reinforcement Learning Agent for Dynamic Resource Placement in IoT Network Slicing

  • Ros, Seyha;Tam, Prohim;Kim, Seokhoon
    • Journal of Internet Computing and Services
    • /
    • v.23 no.5
    • /
    • pp.17-23
    • /
    • 2022
  • Network slicing is a promising paradigm and significant evolution for adjusting the heterogeneous services based on different requirements by placing dynamic virtual network functions (VNF) forwarding graph (VNFFG) and orchestrating service function chaining (SFC) based on criticalities of Quality of Service (QoS) classes. In system architecture, software-defined networks (SDN), network functions virtualization (NFV), and edge computing are used to provide resourceful data view, configurable virtual resources, and control interfaces for developing the modified deep reinforcement learning agent (MDRL-A). In this paper, task requests, tolerable delays, and required resources are differentiated for input state observations to identify the non-critical/critical classes, since each user equipment can execute different QoS application services. We design intelligent slicing for handing the cross-domain resource with MDRL-A in solving network problems and eliminating resource usage. The agent interacts with controllers and orchestrators to manage the flow rule installation and physical resource allocation in NFV infrastructure (NFVI) with the proposed formulation of completion time and criticality criteria. Simulation is conducted in SDN/NFV environment and capturing the QoS performances between conventional and MDRL-A approaches.

Application of Multi-Agent Transport Simulation for Urban Road Network Operation in Incident Case (유고상황 시 MatSIM을 활용한 도시부 도로네트워크 운영 분석)

  • Kim, Joo-Young;Yu, Yeon-Seung;Lee, Seung-Jae;Hu, Hye-Jung;Sung, Jung-Gon
    • International Journal of Highway Engineering
    • /
    • v.14 no.4
    • /
    • pp.163-173
    • /
    • 2012
  • PURPOSES : The purpose of this study is to check the possibilities of traffic pattern analysis using MatSIM for urban road network operation in incident case. METHODS : One of the stochastic dynamic models is MatSIM. MatSIM is a transportation simulation tool based on stochastic dynamic model and activity based model. It is an open source software developed by IVT, ETH zurich, Switzerland. In MatSIM, various scenario comparison analyses are possible and analyses results are expressed using the visualizer which shows individual vehicle movements and traffic patterns. In this study, trip distribution in 24-hour, traffic volume, and travel speed using MatSIM are similar to those of measured values. Therefore, results of MatSIM are reasonable comparing with measured values. Traffic patterns are changed according to incident from change of individual behavior. RESULTS : The simulation results and the actual measured values are similar. The simulation results show reasonable ranges which can be used for traffic pattern analysis. CONCLUSIONS : The change of traffic pattern including trip distribution, traffic volumes and speeds according to various incident scenarios can be used for traffic control policy decision to provide effective operation of urban road network.

Discrete-Time State Feedback Algorithm for State Consensus of Uncertain Homogeneous Multi-Agent Systems (불확실성을 포함한 다 개체 시스템의 상태 일치를 위한 이산 시간 출력 궤환 협조 제어 알고리즘)

  • Yoon, Moon-Chae;Kim, Jung-Su;Back, Juhoon
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.19 no.5
    • /
    • pp.390-397
    • /
    • 2013
  • This paper presents a consensus algorithm for uMAS (uncertain Multi-Agent Systems). Unlike previous results in which only nominal models for agents are considered, it is assumed that the uncertain agent model belongs to a known polytope set. In the middle of deriving the proposed algorithm, a convex set is found which includes all uncertainties in the problem using convexity of the polytope set. This set plays an important role in designing the consensus algorithm for uMAS. Based on the set, a consensus condition for uMAS is proposed and the corresponding consensus design problem is solved using LMI (Linear Matrix Inequality). Simulation result shows that the proposed consensus algorithm successfully leads to consensus of the state of uMAS.