• Title/Summary/Keyword: Agent based simulation

Search Result 365, Processing Time 0.032 seconds

Modified Deep Reinforcement Learning Agent for Dynamic Resource Placement in IoT Network Slicing

  • Ros, Seyha;Tam, Prohim;Kim, Seokhoon
    • Journal of Internet Computing and Services
    • /
    • v.23 no.5
    • /
    • pp.17-23
    • /
    • 2022
  • Network slicing is a promising paradigm and significant evolution for adjusting the heterogeneous services based on different requirements by placing dynamic virtual network functions (VNF) forwarding graph (VNFFG) and orchestrating service function chaining (SFC) based on criticalities of Quality of Service (QoS) classes. In system architecture, software-defined networks (SDN), network functions virtualization (NFV), and edge computing are used to provide resourceful data view, configurable virtual resources, and control interfaces for developing the modified deep reinforcement learning agent (MDRL-A). In this paper, task requests, tolerable delays, and required resources are differentiated for input state observations to identify the non-critical/critical classes, since each user equipment can execute different QoS application services. We design intelligent slicing for handing the cross-domain resource with MDRL-A in solving network problems and eliminating resource usage. The agent interacts with controllers and orchestrators to manage the flow rule installation and physical resource allocation in NFV infrastructure (NFVI) with the proposed formulation of completion time and criticality criteria. Simulation is conducted in SDN/NFV environment and capturing the QoS performances between conventional and MDRL-A approaches.

Application of Multi-Agent Transport Simulation for Urban Road Network Operation in Incident Case (유고상황 시 MatSIM을 활용한 도시부 도로네트워크 운영 분석)

  • Kim, Joo-Young;Yu, Yeon-Seung;Lee, Seung-Jae;Hu, Hye-Jung;Sung, Jung-Gon
    • International Journal of Highway Engineering
    • /
    • v.14 no.4
    • /
    • pp.163-173
    • /
    • 2012
  • PURPOSES : The purpose of this study is to check the possibilities of traffic pattern analysis using MatSIM for urban road network operation in incident case. METHODS : One of the stochastic dynamic models is MatSIM. MatSIM is a transportation simulation tool based on stochastic dynamic model and activity based model. It is an open source software developed by IVT, ETH zurich, Switzerland. In MatSIM, various scenario comparison analyses are possible and analyses results are expressed using the visualizer which shows individual vehicle movements and traffic patterns. In this study, trip distribution in 24-hour, traffic volume, and travel speed using MatSIM are similar to those of measured values. Therefore, results of MatSIM are reasonable comparing with measured values. Traffic patterns are changed according to incident from change of individual behavior. RESULTS : The simulation results and the actual measured values are similar. The simulation results show reasonable ranges which can be used for traffic pattern analysis. CONCLUSIONS : The change of traffic pattern including trip distribution, traffic volumes and speeds according to various incident scenarios can be used for traffic control policy decision to provide effective operation of urban road network.

Discrete-Time State Feedback Algorithm for State Consensus of Uncertain Homogeneous Multi-Agent Systems (불확실성을 포함한 다 개체 시스템의 상태 일치를 위한 이산 시간 출력 궤환 협조 제어 알고리즘)

  • Yoon, Moon-Chae;Kim, Jung-Su;Back, Juhoon
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.19 no.5
    • /
    • pp.390-397
    • /
    • 2013
  • This paper presents a consensus algorithm for uMAS (uncertain Multi-Agent Systems). Unlike previous results in which only nominal models for agents are considered, it is assumed that the uncertain agent model belongs to a known polytope set. In the middle of deriving the proposed algorithm, a convex set is found which includes all uncertainties in the problem using convexity of the polytope set. This set plays an important role in designing the consensus algorithm for uMAS. Based on the set, a consensus condition for uMAS is proposed and the corresponding consensus design problem is solved using LMI (Linear Matrix Inequality). Simulation result shows that the proposed consensus algorithm successfully leads to consensus of the state of uMAS.

Development of Pilot Plant for Distributed Intelligent Management System of Microgrids (멀티에이전트 시스템을 이용한 마이크로그리드 분산 지능형 관리시스템 파일럿 플랜트 개발)

  • Oh, Sang-Jin;Yoo, Cheol-Hee;Chung, Il-Yop;Lim, Jae-Bong
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.62 no.3
    • /
    • pp.322-331
    • /
    • 2013
  • This paper describes the development of the pilot plant of distributed intelligent management system for a microgrid. For optimal control and management of microgrids, intelligent agents area applied to the microgrid management system. Each agent includes intelligent algorithms to make decisions on behalf of the corresponding microgrid entity such as distributed generators, local loads, and so on. To this end, each agent has its own resources to evaluate the system conditions by collecting local information and also communicating with other agents. This paper presents key features of the data communication and management of the developed pilot plant such as the construction of mesh network using local wireless communication techniques, the autonomous agent coordination schemes using plug-and-play functions of agents and contract net protocol (CNP) for decision-making. The performance of the pilot plant and developed algorithms are verified via real-time microgrid test bench based on hardware-in-the-loop simulation systems.

Applying Rescorla-Wagner Model to Multi-Agent Web Service and Performance Evaluation for Need Awaring Reminder Service (Rescorla-Wagner 모형을 활용한 다중 에이전트 웹서비스 기반 욕구인지 상기 서비스 구축 및 성능분석)

  • Kwon, Oh-Byung;Choi, Keon-Ho;Choi, Sung-Chul
    • Journal of Intelligence and Information Systems
    • /
    • v.11 no.3
    • /
    • pp.1-23
    • /
    • 2005
  • Personalized reminder systems have to identify the user's current needs dynamically and proactively based on the user's current context. However, need identification methodologies and their feasible architectures for personalized reminder systems have been so far rare. Hence, this paper aims to propose a proactive need awaring mechanism by applying agent, semantic web technologies and RFID-based context subsystem for a personalized reminder system which is one of the supporting systems for a robust ubiquitous service support environment. RescorlaWagner model is adopted as an underlying need awaring theory. We have created a prototype system called NAMA(Need Aware Multi-Agent)-RFID, to demonstrate the feasibility of the methodology and of the mobile settings framework that we propose in this paper. NAMA considers the context, user profile with preferences, and information about currently available services, to discover the user's current needs and then link the user to a set of services, which are implemented as web services. Moreover, to test if the proposed system works in terms of scalability, a simulation was performed and the results are described.

  • PDF

An Alternative Evaluation of the Item-based Collaborative Filtering Using Simulated Online Shopping

  • Ahn, Hyung-Jun
    • Journal of Information Technology Applications and Management
    • /
    • v.16 no.3
    • /
    • pp.17-28
    • /
    • 2009
  • This paper presents a novel method for evaluating the usefulness of online product recommendation. Previous studies on evaluating recommendation systems have mostly relied on two methods : testing the accuracy of estimating user preferences by recommendation systems, or empirically testing the effectiveness with lab experiments involving human participants. The former does not measure the usefulness directly and hence can be misleading; the latter is expensive in that it requires a working online store System and test participants. In order to address the problems, the proposed approach uses simulation to imitate customer behavior and evaluate the usefulness of recommendation. Models for user behavior and an abstract Internet store are developed for simulation. Actual simulation experiments are performed to illustrate the use of the approach.

  • PDF

An Application of Blackboard Architecture for the Coordination among the Security Systems (보안 모델의 연동을 위한 블랙보드구조의 적용)

  • 서희석;조대호
    • Journal of the Korea Society for Simulation
    • /
    • v.11 no.4
    • /
    • pp.91-105
    • /
    • 2002
  • The attackers on Internet-connected systems we are seeing today are more serious and technically complex than those in the past. So it is beyond the scope of amy one system to deal with the intrusions. That the multiple IDSes (Intrusion Detection System) coordinate by sharing attacker's information for the effective detection of the intrusion is the effective method for improving the intrusion detection performance. The system which uses BBA (BlackBoard Architecture) for the information sharing can be easily expanded by adding new agents and increasing the number of BB (BlackBoard) levels. Moreover the subdivided levels of blackboard enhance the sensitivity of the intrusion detection. For the simulation, security models are constructed based on the DEVS (Discrete EVent system Specification) formalism. The intrusion detection agent uses the ES (Expert System). The intrusion detection system detects the intrusions using the blackboard and the firewall responses these detection information.

  • PDF

Intelligent Multi-Agent Distributed Platform based on Dynamic Object Group Management using Fk-means (Fk means를 이용한 동적객체그룹관리기반 지능형 멀티 에이전트 분산플랫폼)

  • Lee, Jae-wan;Na, Hye-Young;Mateo, Romeo Mark A.
    • Journal of Internet Computing and Services
    • /
    • v.10 no.1
    • /
    • pp.101-110
    • /
    • 2009
  • Multi-agent systems are mostly used to integrate the intelligent and distributed approaches to various systems for effective sharing of resources and dynamic system reconfigurations. Object replication is usually used to implement fault tolerance and solve the problem of unexpected failures to the system. This paper presents the intelligent multi-agent distributed platform based on the dynamic object group management and proposes an object search technique based on the proposed filtered k-means (Fk-means). We propose Fk-means for the search mechanism to find alternative objects in the event of object failures and transparently reconnect client to the object. The filtering range of Fk-means value is set only to include relevant objects within the group to perform the search method efficiently. The simulation result shows that the proposed mechanism provides fast and accurate search for the distributed object groups.

  • PDF

Implementation of an Agent-centric Planning of Complex Events as Objects of Pedagogical Experiences in Virtual World

  • Park, Jong Hee
    • International Journal of Contents
    • /
    • v.12 no.1
    • /
    • pp.25-43
    • /
    • 2016
  • An agent-centric event planning method is proposed for providing pedagogical experiences in an immersed environment. Two-level planning is required at in a macro-level (i.e., inter-event level) and an intra-event level to provide realistic experiences with the objective of learning declarative knowledge. The inter-event (horizontal) planning is based on search, while intra-event (vertical) planning is based on hierarchical decomposition. The horizontal search is dictated by several realistic types of association between events besides the conventional causality. The resulting schematic plan is further augmented by conditions associated with those agents cast into the roles of the events identified in the plan. Rather than following a main story plot, all the events potentially relevant to accomplishing an initial goal are derived in the final result of our planning. These derived events may progress concurrently or digress toward a new main goal replacing the current goal or event, and the plan could be merged or fragmented according to their respective lead agents' intentions and other conditions. The macro-level coherence across interconnected events is established via their common background world existing a priori. As the pivotal source of event concurrency and intricacy, agents are modeled to not only be autonomous but also independent, i.e., entities with their own beliefs and goals (and subsequent plans) in their respective parts of the world. Additional problems our method addresses for augmenting pedagogical experiences include casting of agents into roles based on their availability, subcontracting of subsidiary events, and failure of multi-agent event entailing fragmentation of a plan. The described planning method was demonstrated by monitoring implementation.

Design Healthcare Mobility Agent Module in Sensor Network (센서 네트워크에서 헬스케어 이동성 에이전트 모듈 설계)

  • Nam, Jin-Woo;Chung, Yeong-Jee
    • Journal of Korea Multimedia Society
    • /
    • v.11 no.4
    • /
    • pp.544-553
    • /
    • 2008
  • The general sensor network uses bundle method to collect fixed information from sensor node. However, this method is difficult to actively cope with major sensing objects in healthcare environment including status and position change of person and change of surrounding environment. In order to support the healthcare environment, certain information should be provided in accordance with the change of status of person and surrounding circumstance and also must cope with the change of network type by movement of person. This paper analyzes LEACH protocol which guarantees effectiveness of network as it constitutes clusters between Agilla model that is a representative multi agent middle ware and surrounding nodes. Based on the result of this analysis, it suggests LEACH_Mobile protocol which guarantees node mobility that is the weakest point of LEACH protocol. Moreover, it designs mobility agent middleware which supports dynamic function change of node and mobility agent module which supports dynamic function change of mobile node as components of LEACH_Mobile routing module. In addition, it is definitely increase performance which in mobile node of transfer data rate through LEACH_Mobile protocol of simulation result.

  • PDF