• Title/Summary/Keyword: Agent Behavior Simulation

Search Result 97, Processing Time 0.028 seconds

A Self-Organizing Scheme for Swarm Systems

  • Kim, Dong-Hun;Kim, Hong-Pil
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.2475-2480
    • /
    • 2003
  • A control system design based on coupled nonlinear oscillators (CNOs) for a self-organized swarm system is presented. In this scheme, agents self-organize to flock and arrange group formations through attractive and repulsive forces among themselves using CNOs. Virtual agents are also used to create richer group formation patterns. The objective of the swarm control in this paper is to follow a moving target with a final group formation in the shortest possible time despite some obstacles. The simulation results have shown that the proposed scheme can effectively construct a self-organized multi-agent swarm system capable of group formation and group immigration despite the emergence of obstacles.

  • PDF

Exploring reward efficacy in traffic management using deep reinforcement learning in intelligent transportation system

  • Paul, Ananya;Mitra, Sulata
    • ETRI Journal
    • /
    • v.44 no.2
    • /
    • pp.194-207
    • /
    • 2022
  • In the last decade, substantial progress has been achieved in intelligent traffic control technologies to overcome consistent difficulties of traffic congestion and its adverse effect on smart cities. Edge computing is one such advanced progress facilitating real-time data transmission among vehicles and roadside units to mitigate congestion. An edge computing-based deep reinforcement learning system is demonstrated in this study that appropriately designs a multiobjective reward function for optimizing different objectives. The system seeks to overcome the challenge of evaluating actions with a simple numerical reward. The selection of reward functions has a significant impact on agents' ability to acquire the ideal behavior for managing multiple traffic signals in a large-scale road network. To ascertain effective reward functions, the agent is trained withusing the proximal policy optimization method in several deep neural network models, including the state-of-the-art transformer network. The system is verified using both hypothetical scenarios and real-world traffic maps. The comprehensive simulation outcomes demonstrate the potency of the suggested reward functions.

Stealthy Behavior Simulations Based on Cognitive Data (인지 데이터 기반의 스텔스 행동 시뮬레이션)

  • Choi, Taeyeong;Na, Hyeon-Suk
    • Journal of Korea Game Society
    • /
    • v.16 no.2
    • /
    • pp.27-40
    • /
    • 2016
  • Predicting stealthy behaviors plays an important role in designing stealth games. It is, however, difficult to automate this task because human players interact with dynamic environments in real time. In this paper, we present a reinforcement learning (RL) method for simulating stealthy movements in dynamic environments, in which an integrated model of Q-learning with Artificial Neural Networks (ANN) is exploited as an action classifier. Experiment results show that our simulation agent responds sensitively to dynamic situations and thus is useful for game level designer to determine various parameters for game.

Structural investigation on the intrinsically disordered N-terminal region of HPV16 E7 protein

  • Lee, Chewook;Kim, Do-Hyoung;Lee, Si-Hyung;Su, Jiulong;Han, Kyou-Hoon
    • BMB Reports
    • /
    • v.49 no.8
    • /
    • pp.431-436
    • /
    • 2016
  • Human papillomavirus (HPV) is the major cause of cervical cancer, a deadly threat to millions of females. The early oncogene product (E7) of the high-risk HPV16 is the primary agent associated with HPV-related cervical cancers. In order to understand how E7 contributes to the transforming activity, we investigated the structural features of the flexible N-terminal region (46 residues) of E7 by carrying out N-15 heteronuclear NMR experiments and replica exchange molecular dynamics simulations. Several NMR parameters as well as simulation ensemble structures indicate that this intrinsically disordered region of E7 contains two transient (10-20% populated) helical pre-structured motifs that overlap with important target binding moieties such as an E2F-mimic motif and a pRb-binding LXCXE segment. Presence of such target-binding motifs in HPV16 E7 provides a reasonable explanation for its promiscuous target-binding behavior associated with its transforming activity.

Autonomous Agents Navigating in Virtual Road Network

  • Cho, Eun-Sang;Choi, Kwang-Jin;Ko, Hyeongseok
    • Proceedings of the Korea Society for Simulation Conference
    • /
    • 1997.04a
    • /
    • pp.81-85
    • /
    • 1997
  • In a virtual environment, agents must demonstrate some degree of realism and interactivity. This paper discusses the algorithm that enables agents to navigate a virtual road network realistically and interactively. The road description files written in this language provide the information of road environments to the navigating agents and the scene visualizer. We call this navigating agent in the road an ambient car. The ambient cars must follow the traffic rules as human does. To do this, the ambient car should continuously check its circumstances, such as, the traffic lights, lanes, road signs, and other ambient cars. Because of the huge scale of road network and the large number of ambient cars, the algorithm considers only the area where the participant is currently located. By this locality, the performance of the whole system does not fluctuate much in different situations. The behavior of ambient cars according to the predefined rules may appear monotonous. We added probability distribution functions to introduce some randomness. We implemented the above idea on silicon Graphics Indigo 2 workstation. The ambient car exhibited its awareness of lanes, traffic lights, and other cars. The participants could hardly distinguish between a human-controlled car and computer-controlled ambient car generated by the algorithm.

  • PDF

Analysis on Motorcycle Driving Behavior (이륜자동차 주행행태 분석 연구)

  • Kim, Hyeong-Gyu;Kim, Jin-Tae;Park, Jun-Tae;Lee, Su-Beom
    • Journal of Korean Society of Transportation
    • /
    • v.29 no.4
    • /
    • pp.7-15
    • /
    • 2011
  • Emerged in early 1990s, so called 'Quick service' industry that provides faster delivery of small parcels than regular mail service accelerated use of motorcycles. As the economic grows, use of large bicycles (more than 250CC displacement) for leisure purpose has also rapidly increased. Traffic crash data clearly shows the increasing trend in motorcycle crashes. The ratio of motorcycle involved crashes out of total has increased from 5.7% in 2005 to 8.3% in 2008, and similar trend can be found in fatalities ratio as well. In this study, we assess the level of risk when motorcycles operate on motorways by analyzing traffic rule violation ratio, lane change behaviour, driving speed behaviors of motorcycles in Uninterrupted Traffic Flow Facilities and using PC-CRASH simulation we also calculate car shock impulses occurred when an accident happens. Analysis result shows that the motorcycle is different from the car in terms of lane change timing and average speed, and also shows motorcycle drivers tends to conduct more improper driving behavior particularly when traffic is congested. The results from this study could be usefully applied when the law enforcement agent decides whether bicycles shall be allowed to use motorways. The result could be also utilized as fundamental information for further study of bicycles' driving behavior.

Modeling Virtual Ecosystems that Consist of Artificial Organisms and Their Environment (인공생명체와 그들을 둘러싸는 환경으로 구성 되어지는 가상생태계 모델링)

  • Lee, Sang-Hee
    • Korean Journal of Agricultural and Forest Meteorology
    • /
    • v.12 no.2
    • /
    • pp.122-131
    • /
    • 2010
  • This paper introduces the concept of a virtual ecosystem and reports the following three mathematical approaches that could be widely used to construct such an ecosystem, along with examples: (1) a molecular dynamics simulation approach for animal flocking behavior, (2) a stochastic lattice model approach for termite colony behavior, and (3) a rule-based cellular automata approach for biofilm growth. The ecosystem considered in this study consists of artificial organisms and their environment. Each organism in the ecosystem is an agent that interacts autonomously with the dynamic environment, including the other organisms within it. The three types of model were successful to account for each corresponding ecosystem. In order to accurately mimic a natural ecosystem, a virtual ecosystem needs to take many ecological variables into account. However, doing so is likely to introduce excess complexity and nonlinearity in the analysis of the virtual ecosystem's dynamics. Nonetheless, the development of a virtual ecosystem is important, because it can provide possible explanations for various phenomena such as environmental disturbances and disasters, and can also give insights into ecological functions from an individual to a community level from a synthetic viewpoint. As an example of how lower and higher levels in an ecosystem can be connected, this paper also briefly discusses the application of the second model to the simulation of a termite ecosystem and the influence of climate change on the termite ecosystem.

Crossing Dynamics of Leader-guided Two Flocks (우두머리가 있는 두 생물무리의 가로지르기 동역학)

  • Lee, Sang-Hee
    • Journal of the Korea Society for Simulation
    • /
    • v.19 no.3
    • /
    • pp.37-43
    • /
    • 2010
  • In field, one can observe without difficulties that two flocks are intersected or combined with each other. For example, a fish flock in a stream separates into two part by obstacles (e.g. stone) and rejoins behind the obstacles. The dynamics of two flocks guided by their leader were studied in the situation where the flocks cross each other with a crossing angle, ${\theta}$, between their moving directions. Each leader is unaffected by its flock members whereas each member is influenced by its leader and other members. To understand the dynamics, I investigated the order parameter, ${\phi}$, defined by the absolute value of the average unit velocity of the flocks' members. When the two flocks were encountered, the first peak in ${\phi}$ was appeared due to the breaking of the flocks' momentum balance. When the flocks began to separate, the second peak in ${\phi}$ was observed. Subsequently, erratic peaks were emerged by some individuals that were delayed to rejoin their flock. The amplitude of the two peaks, $d_1$ (first) and $d_2$ (second), were measured. Interestingly, they exhibited a synchronized behavior for different ${\theta}$. This simulation model can be a useful tool to explore animal behavior and to develop multi-agent robot systems.

A Study on the Visibility Analysis Model for the Ward of General Hospital Considering Nurse's Circulation (종합병원 병동부 간호 이동 동선을 고려한 가시 특성 분석 모델에 관한 연구)

  • Kim, Seo-Yeong;Kweon, Jihoon
    • Journal of the Regional Association of Architectural Institute of Korea
    • /
    • v.20 no.6
    • /
    • pp.71-80
    • /
    • 2018
  • The path and visibility of nurses in general hospital wards have been treated as architectural planning factors. However, the analysis approach of existing studies shows limitations that only fixed physical elements are considered without considering the behavior of users using space. Consider factors for analysis of ward and models based on this study model. Select a case hospital to apply the analysis technique and conduct the nurse questionnaire and route survey of the hospital. Establish a framework for analysis model applied with the path of nurse movements. The analysis model applies to the case hospital. The analysis results are aggregated to derive design suggestion for reference to the spatial improvement of the ward. Visible visibility to observe the bedside in the nursing station, visibility to observe the beds in the nurse's path, and visibility to observe patients moving in the nurse's path were derived from visual access frequency and exposure frequency. The survey of nurses' movements at the site allowed the nurses to calculate the distance required to move. Reflecting the path of nurse movement, a model was presented for a comprehensive analysis of nursing distance and nursing visibility, which could lead to improvement in the observation and visibility of nurses and the layout of patient rooms or day rooms.

Joint moments and muscle forces during walking with sided load as one of activities of daily living (편향하중 조건 보행시 인체의 적응 작용에 대한 분석)

  • Kim, Hyun-Dong;Son, Jong-Sang;Kim, Han-Sung;Kim, Young-Ho;Lim, Do-Hyung
    • Proceedings of the KSME Conference
    • /
    • 2008.11a
    • /
    • pp.1709-1712
    • /
    • 2008
  • The trunk is inclined to the loaded side when carrying an object as one of activities of daily living. As the reaction to this behavior the human body may be inclined to his/her trunk to unloaded side. The present study investigated the biomechanical effects of weight variation for sided load carriage during walking upon joint moments and muscle torques, through the tracker agent and joint driving dynamic analysis. To perform the experiment one male was selected as subject for the study. Gait analysis was performed by using a 3D motion analysis system. Thirty nine 14mm reflective markers, according to the plug-in marker set, were attached to the subject. We used BRG.LifeMOD(Biomechanics Research Group, Inc., USA), for skeletal modeling and inverse and joint driving dynamic simulation during one gait cycle. In walking with a sided load carriage, the subject modeled held the carriage with the right hand, which weighed 0, 5, 10, 15kg, 20kg respectively. The result of this simulation showed that knee and hip in the coronal plane were inclined to the loaded side and loaded side had larger moments as the sided load carriage was increased. On the other hand thoracic and lumbar in the coronal plane had larger negative values as the sided loaded carriage was increased. The thoracic and lumbar in the transverse plane also had larger values as the sided load was increased. And the several muscles of loaded side were increased as increasing sided load. It could be concluded that human body is adopted to side loaded circumstances by showing more biologic force. These results could be very useful in analysis for delivery motion of daily life.

  • PDF