• Title/Summary/Keyword: Agent Based Simulation

Search Result 358, Processing Time 0.029 seconds

The Effect of the Distance Between $CO_2$ Agent Nozzle and Wall ($CO_2$소화제 노즐과 벽간 거리의 영향)

  • Park Chan-Su
    • Fire Science and Engineering
    • /
    • v.18 no.4
    • /
    • pp.27-34
    • /
    • 2004
  • We have conducted a numerical simulation under three-dimensional unsteady conditions in order to analyze the effect of flow and CO₂ mass transfer according to the distance between the CO₂ nozzle of CO₂ fire fighting system and the rear wall in a protection space. Flow fields and CO₂ concentration fields were measured. The different recirculation flow form and wall jet was developed according to increasing the distance between CO₂ nozzles and rear wall. In all the case, CO₂ mass transfer was generated toward the center of a protection space from each walls, but the CO₂ mass fraction of front and rear areas based on CO₂ nozzles showed higher or lower by increasing the distance between CO₂ nozzle and rear wall.

Punching Motion Generation using Reinforcement Learning and Trajectory Search Method (경로 탐색 기법과 강화학습을 사용한 주먹 지르기동작 생성 기법)

  • Park, Hyun-Jun;Choi, WeDong;Jang, Seung-Ho;Hong, Jeong-Mo
    • Journal of Korea Multimedia Society
    • /
    • v.21 no.8
    • /
    • pp.969-981
    • /
    • 2018
  • Recent advances in machine learning approaches such as deep neural network and reinforcement learning offer significant performance improvements in generating detailed and varied motions in physically simulated virtual environments. The optimization methods are highly attractive because it allows for less understanding of underlying physics or mechanisms even for high-dimensional subtle control problems. In this paper, we propose an efficient learning method for stochastic policy represented as deep neural networks so that agent can generate various energetic motions adaptively to the changes of tasks and states without losing interactivity and robustness. This strategy could be realized by our novel trajectory search method motivated by the trust region policy optimization method. Our value-based trajectory smoothing technique finds stably learnable trajectories without consulting neural network responses directly. This policy is set as a trust region of the artificial neural network, so that it can learn the desired motion quickly.

Job Allocation and Operation Scenario of Automated Material Handling for Cluster-Type Production System (클러스터 제조 라인의 작업할당 및 물류 운영 시나리오)

  • Yoon, Hyun-Joong;Kim, Jin-Gon;Kim, Jung-Yun
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.33 no.3
    • /
    • pp.169-175
    • /
    • 2010
  • Recently, to improve operating efficiency with the higher in-line rate in automated production lines, a lot of cases of grouping machines and material handling system together to form a cluster has shown frequently. This article addresses the job allocation and operation method of automated material handling for cluster-type production systems. First of all, the control problems of the automated material handling systems are classified into the control problem of inter-cluster material handling system and that of intra-cluster material handling system. Then, a distributed agent-based control scheme is proposed for the former, and an operational control procedure for the latter. Simulation experiment shows that the proposed method is efficient in reducing cycle times and improving utilization of material handling vehicles.

An Enhanced Robust Routing Protocol in AODV over MANETs (MANETs의 AODV기반 향상된 견고한 라우팅 프로토콜)

  • Kim, Kwan-Woong;Bae, Sung-Hwan;Kim, Dae-Ik
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.4 no.1
    • /
    • pp.14-19
    • /
    • 2009
  • In Mobile Ad-hoc Network, link failure and packet loss may occur frequently due to its nature of mobility and limited battery life. In this paper, an enhanced robust routing protocol based on AODV(Ad hoc On-demand Distance Vector routing) by monitoring variation of receiving signal strength is proposed. New metric function that consists of node mobility and hops of path is used for routing decision. For preventing route failure by node movement during data transmission, a new route maintenance is presented. If the node movement is detected, the routing agent switches local path to its neighbor node. Simulation results show that the performance of the proposed routing scheme is superior to previous AODV protocol.

  • PDF

Developing artificial football agents based upon multi-agent techniques in the AI world cup (AI World Cup 환경을 이용한 멀티 에이전트 기반 지능형 가상 축구 에이전트 구현)

  • Lee, Eunhoo;Seong, Hyeon-ah;Jung, Minji;Lee, Hye-in;Joung, Jinoo;Lee, Eui Chul;Lee, Jee Hang
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2021.11a
    • /
    • pp.819-822
    • /
    • 2021
  • AI World Cup 환경은 다수 가상 에이전트들이 팀을 이뤄서 서로 상호작용하며 대전이 가능한 가상 축구 환경이다. 본 논문에서는 AI World Cup 환경에서 멀티 에이전트기반 학습/추론 기술을 사용하여 다양한 전략과 전술을 구사하는 가상 축구 에이전트 구현과 시뮬레이션 결과를 소개한다. 먼저, 역할을 바탕으로 협동하여 상대방과 대전할 수 있는 논리 기반 추론형 멀티 에이전트 기술이 적용된 Dynamic planning 축구 에이전트 9 세트를 구현하였다. 이후, 강화학습 에이전트 기반, 단일 에이전트를 조합한 Independent Q-Learning 방식의 학습형 축구 에이전트를 구현한 후, 이를 멀티 에이전트 강화학습으로 확장하여 역할 기반 전략 학습이 가능한 가상 축구 에이전트를 구현하고 시뮬레이션 하였다. 구현된 가상 축구 에이전트들 간 대전을 통해 승률을 확인하고, 전략의 우수성을 분석하였다. 시뮬레이션 예제는 다음에서 확인할 수 있다 (https://github.com/I-hate-Soccer/Simulation).

An Experience-Type Car Maintenance Training System based on Logic Simulation (논리 시뮬레이션을 기반으로한 체험형 자동차 정비 훈련 시스템)

  • Park, Gil-Sik;Park, Dae-Sung;Park, Ki Hyun;Kim, Juntae
    • Journal of the Korea Society for Simulation
    • /
    • v.23 no.2
    • /
    • pp.73-84
    • /
    • 2014
  • Recently, researches on the application of IT technology to various fields including traditional industries are becoming more popular. One challenge in the field of education is to understand the way how technology may support learning, and research on self-directed learning has been accelerated by integrating education and IT technology. The process of self-directed learning in e-learning applications such as Car Maintenance Training is very difficult and complicated. Previous studies on car maintenance training applications provided simple training scenarios with predetermined action sequences. To incorporate self-directed learning in car maintenance training, however, trainees must be able to perform various maintenance operations himself and experience various situations. To provide such functionality, it is necessary to obtain an accurate response for various operations of trainees, but it requires complicated calculations with respect to varieties in the electrical and mechanical processes of a car. In this paper, we develop a logic simulation agent using JESS inference engine in which self-directed learning is achieved by capturing the behavior of trainees and simulating car operations without complicated physical simulations in car maintenance training.

Development of Stochastic Model and Simulation for Spatial Process Using Remotely Sensed Data : Fire Arrival Process (원격탐사자료를 이용한 공간적 현상의 모형화 및 시뮬레이션 : 자연화재발생의 경우)

  • 정명희
    • Spatial Information Research
    • /
    • v.6 no.1
    • /
    • pp.77-90
    • /
    • 1998
  • The complex interactions of climate, topography, geology, biota and hwnan activities result in the land cover patterns, which are impacted by natural disturbances such as fire, earthquake and flood. Natural disturbances disrupt ecosystem communities and change the physical environment, thereby generating a new landscape. Community ecologists believe that disturbance is critical in determining how diverse ecological systems function. Fires were once a major agent of disturbance in the North American tall grass prairies, African savannas, and Australian bush. The major focus of this research was to develop stochastic model of spatial process of disturbance or spatial events and simulate the process based on the developed model and it was applied to the fire arrival process in the Great Victoria Desert of Australia, where wildfires generate a mosaic of patches of habitat at various stages of post-fire succession. For this research, Landsat Multi-Spectral Scanner(MSS) data covering the period from 1972 to 1994 were utilized. Fire arrival process is characterized as a spatial point pattern irregularly distributed within a region of space. Here, nonhomogeneous planar Poisson process is proposed as a model for the fire arrival process and rejection sampling thinning the homogeneous Poisson process is used for its simulation.

  • PDF

A Performance Comparison of the Mobile Agent Model with the Client-Server Model under Security Conditions (보안 서비스를 고려한 이동 에이전트 모델과 클라이언트-서버 모델의 성능 비교)

  • Han, Seung-Wan;Jeong, Ki-Moon;Park, Seung-Bae;Lim, Hyeong-Seok
    • Journal of KIISE:Information Networking
    • /
    • v.29 no.3
    • /
    • pp.286-298
    • /
    • 2002
  • The Remote Procedure Call(RPC) has been traditionally used for Inter Process Communication(IPC) among precesses in distributed computing environment. As distributed applications have been complicated more and more, the Mobile Agent paradigm for IPC is emerged. Because there are some paradigms for IPC, researches to evaluate and compare the performance of each paradigm are issued recently. But the performance models used in the previous research did not reflect real distributed computing environment correctly, because they did not consider the evacuation elements for providing security services. Since real distributed environment is open, it is very vulnerable to a variety of attacks. In order to execute applications securely in distributed computing environment, security services which protect applications and information against the attacks must be considered. In this paper, we evaluate and compare the performance of the Remote Procedure Call with that of the Mobile Agent in IPC paradigms. We examine security services to execute applications securely, and propose new performance models considering those services. We design performance models, which describe information retrieval system through N database services, using Petri Net. We compare the performance of two paradigms by assigning numerical values to parameters and measuring the execution time of two paradigms. In this paper, the comparison of two performance models with security services for secure communication shows the results that the execution time of the Remote Procedure Call performance model is sharply increased because of many communications with the high cryptography mechanism between hosts, and that the execution time of the Mobile Agent model is gradually increased because the Mobile Agent paradigm can reduce the quantity of the communications between hosts.

Effective resource selection and mobility management scheme in mobile grid computing (모바일 그리드 컴퓨팅에서 효율적인 자원 확보와 이동성 관리 기법)

  • Lee, Dae-Won
    • The Journal of Korean Association of Computer Education
    • /
    • v.13 no.1
    • /
    • pp.53-64
    • /
    • 2010
  • In this paper, we tried to enable a mobile device as a resource to access to mobile grid networks. By advanced Internet techniques, the use of mobile devices has been rapidly increased. Some researches in mobile grid computing tried to combine grid computing with mobile devices. However, according to intrinsic properties of mobile environments, mobile devices have many considerations, such as mobility management, disconnected operation, device heterogeneity, service discovery, resource sharing, security, and so on. To solve these problems, there are two trends for mobile grid computing: a proxy-based mobile grid architecture and an agent-based mobile grid architecture. We focus on a proxy-based mobile grid architecture with IP-paging, which can easily manage idle mobile devices and grid resource status information. Also, we use SIP(Session Initiation Protocol)to support mobility management, mobile grid services. We manage variation of mobile device state and power by paging cache. Finally, using the candidate set and the reservation set of resources, we perform task migration. The performance evaluation by simulation, shows improvement of efficiency and stability during execution.

  • PDF

Topology Change Algorithms based on Fluid Flow and Flock Dispersion for Energy-Harvesting Mobile Sensor Networks (에너지 수확 모바일 센서 망을 위한 유체 흐름 및 군집 분산 기반 토폴로지 변환 알고리즘)

  • So, Wonho
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.50 no.12
    • /
    • pp.98-106
    • /
    • 2013
  • The duty-cycle synchronization among mobile sensor nodes with energy-harvesting is very important. The nodes should keep their duty-cycle same to others as much as possible because they have to cooperate each other and to consume energy efficiently. The distribution of node position in network affects not only node connectivity but also the active time of synchronized nodes, and it relates to network life-time finally. In this paper, we introduce a network topology change algorithm (TCA) for energy-harvesting mobile sensor networks based on self-synchronized duty-cycling. The algorithm tries to change a network topology into a balanced topology where the mobile sensor nodes are unified according to the density of the number of nodes. For TCA, both fluid flow algorithm and flock dispersion algorithm are proposed and they are evaluated through the simulation in agent based modeling language. TCA is applied to the energy-harvesting mobile sensor networks to improve the synchronization of duty-cycle and to reduce the variation of energy consumption among nodes.