• Title/Summary/Keyword: Agent Based Simulation

Search Result 358, Processing Time 0.027 seconds

Optimal deployment of sonobuoy for unmanned aerial vehicles using reinforcement learning considering the target movement (표적의 이동을 고려한 강화학습 기반 무인항공기의 소노부이 최적 배치)

  • Geunyoung Bae;Juhwan Kang;Jungpyo Hong
    • The Journal of the Acoustical Society of Korea
    • /
    • v.43 no.2
    • /
    • pp.214-224
    • /
    • 2024
  • Sonobuoys are disposable devices that utilize sound waves for information gathering, detecting engine noises, and capturing various acoustic characteristics. They play a crucial role in accurately detecting underwater targets, making them effective detection systems in anti-submarine warfare. Existing sonobuoy deployment methods in multistatic systems often rely on fixed patterns or heuristic-based rules, lacking efficiency in terms of the number of sonobuoys deployed and operational time due to the unpredictable mobility of the underwater targets. Thus, this paper proposes an optimal sonobuoy placement strategy for Unmanned Aerial Vehicles (UAVs) to overcome the limitations of conventional sonobuoy deployment methods. The proposed approach utilizes reinforcement learning in a simulation-based experimental environment that considers the movements of the underwater targets. The Unity ML-Agents framework is employed, and the Proximal Policy Optimization (PPO) algorithm is utilized for UAV learning in a virtual operational environment with real-time interactions. The reward function is designed to consider the number of sonobuoys deployed and the cost associated with sound sources and receivers, enabling effective learning. The proposed reinforcement learning-based deployment strategy compared to the conventional sonobuoy deployment methods in the same experimental environment demonstrates superior performance in terms of detection success rate, deployed sonobuoy count, and operational time.

A Study on the Change of Urban Land Use According to the Change of Transportation Accessibility (교통 접근성 변동에 따른 도시 토지이용 변화에 관한 연구)

  • Won, Seok Hwan;Hwang, Chul-sue
    • Journal of Cadastre & Land InformatiX
    • /
    • v.47 no.1
    • /
    • pp.127-142
    • /
    • 2017
  • The purpose of this study is to examine the status of urbanization of Namyangju-Si from 2001 till 2008, analyze the correlation of the change of surrounding land use according to the change of accessibility and analyze the correlation of the change of land use. Based on the result from correlation analysis, I simulated from the view point of interactions between agents of land use and transportation accessibility by using MAS. I tried to forecast, based on space, the change of surrounding land use caused by the change of accessibility. I conducted landscape analysis by using a land registration map. Also, I conducted GIS analysis statistical analysis simulation analysis of traffic data, land use data in order to analyze the correlation of the change of surrounding land use according to the change of accessibility. I could find out a certain pattern that new roads and railroads causes the within 500m adjacent land to change into urban land use, which led me to construct a system through which land use changing phenomenon can be expected according to the change of accessibility. It is expected that it can make the best use of selecting the location where new transportation facilities are constructed.

A Mutual P3P Methodology for Privacy Preserving Context-Aware Systems Development (프라이버시 보호 상황인식 시스템 개발을 위한 쌍방향 P3P 방법론)

  • Kwon, Oh-Byung
    • Asia pacific journal of information systems
    • /
    • v.18 no.1
    • /
    • pp.145-162
    • /
    • 2008
  • One of the big concerns in e-society is privacy issue. In special, in developing robust ubiquitous smart space and corresponding services, user profile and preference are collected by the service providers. Privacy issue would be more critical in context-aware services simply because most of the context data themselves are private information: user's current location, current schedule, friends nearby and even her/his health data. To realize the potential of ubiquitous smart space, the systems embedded in the space should corporate personal privacy preferences. When the users invoke a set of services, they are asked to allow the service providers or smart space to make use of personal information which is related to privacy concerns. For this reason, the users unhappily provide the personal information or even deny to get served. On the other side, service provider needs personal information as rich as possible with minimal personal information to discern royal and trustworthy customers and those who are not. It would be desirable to enlarge the allowable personal information complying with the service provider's request, whereas minimizing service provider's requiring personal information which is not allowed to be submitted and user's submitting information which is of no value to the service provider. In special, if any personal information required by the service provider is not allowed, service will not be provided to the user. P3P (Platform for Privacy Preferences) has been regarded as one of the promising alternatives to preserve the personal information in the course of electronic transactions. However, P3P mainly focuses on preserving the buyers' personal information. From time to time, the service provider's business data should be protected from the unintended usage from the buyers. Moreover, even though the user's privacy preference could depend on the context happened to the user, legacy P3P does not handle the contextual change of privacy preferences. Hence, the purpose of this paper is to propose a mutual P3P-based negotiation mechanism. To do so, service provider's privacy concern is considered as well as the users'. User's privacy policy on the service provider's information also should be informed to the service providers before the service begins. Second, privacy policy is contextually designed according to the user's current context because the nomadic user's privacy concern structure may be altered contextually. Hence, the methodology includes mutual privacy policy and personalization. Overall framework of the mechanism and new code of ethics is described in section 2. Pervasive platform for mutual P3P considers user type and context field, which involves current activity, location, social context, objects nearby and physical environments. Our mutual P3P includes the privacy preference not only for the buyers but also the sellers, that is, service providers. Negotiation methodology for mutual P3P is proposed in section 3. Based on the fact that privacy concern occurs when there are needs for information access and at the same time those for information hiding. Our mechanism was implemented based on an actual shopping mall to increase the feasibility of the idea proposed in this paper. A shopping service is assumed as a context-aware service, and data groups for the service are enumerated. The privacy policy for each data group is represented as APPEL format. To examine the performance of the example service, in section 4, simulation approach is adopted in this paper. For the simulation, five data elements are considered: $\cdot$ UserID $\cdot$ User preference $\cdot$ Phone number $\cdot$ Home address $\cdot$ Product information $\cdot$ Service profile. For the negotiation, reputation is selected as a strategic value. Then the following cases are compared: $\cdot$ Legacy P3P is considered $\cdot$ Mutual P3P is considered without strategic value $\cdot$ Mutual P3P is considered with strategic value. The simulation results show that mutual P3P outperforms legacy P3P. Moreover, we could conclude that when mutual P3P is considered with strategic value, performance was better than that of mutual P3P is considered without strategic value in terms of service safety.

Performance Evaluation of Workstation System within ATM Integrated Service Switching System using Mean Value Analysis Algorithm (MVA 알고리즘을 이용한 ATM 기반 통합 서비스 교환기 내 워크스테이션의 성능 평가)

  • Jang, Seung-Ju;Kim, Gil-Yong;Lee, Jae-Hum;Park, Ho-Jin
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.6 no.4
    • /
    • pp.421-429
    • /
    • 2000
  • In present, ATM integrated switching system has been developed to a mixed modules that complexed switching system including maintenance, operation based on B-ISDN/LAN service and plug-in module, , which runs on workstation computer system. Meanwhile, workstation has HMI operation system feature including file system management, time management, graphic processing, TMN agent function. The workstation has communicated with between ATM switching module and clients. This computer system architecture has much burden messages communication among processes or processor. These messages communication consume system resources which are socket, message queue, IO device files, regular files, and so on. Therefore, in this paper we proposed new performance modeling with this system architecture. We will analyze the system bottleneck and improve system performance. In addition, in the future, the system has many additional features should be migrated to workstation system, we need previously to evaluate system bottleneck and redesign it. In performance model, we use queueing network model and the simulation package is used PDQ and C-program.

  • PDF

Geospatial Analysis and Modeling in Korea: A Literature Review (한국의 지리공간분석 및 모델링 연구)

  • Lee, Sang-Il;Kim, Kam-Young
    • Journal of the Korean Geographical Society
    • /
    • v.47 no.4
    • /
    • pp.606-624
    • /
    • 2012
  • The main objective of this paper is to provide an adequate and comprehensive review of what has been done in South Korea in the field of geospatial analysis and modeling. This review focuses on spatial data analysis and spatial statistics, spatial optimization, and geosimulation among various aspects of the field. It is recognized that geospatial analysis and modeling in South Korea got through the initial stage during the 1990s when computer and analytical cartography and GIS were introduced, moved to the growth stage during the first decade of the $21^{st}$ century when there was a surge of relevant researches, and now is heading for its maturity stage. In spatial data analysis and spatial statistics, various topics have been addressed for spatial point pattern data, areal data, geostatistical data, and spatial interaction data. In spatial optimization, modeling and applications related to facility location problems, districting problems, and routing problems have been mostly researched. Finally, in geosimulation, while most of research has focused on cellular automata, studies on agent-based model and simulation are in beginning stage. Among all these works, some have fostered methodological advances beyond simple applications of the standard techniques.

  • PDF

The Multisector Model of the Korean Economy: Structure and Coefficients (한국경제(韓國經濟)의 다부문모형(多部門模型) : 모형구조(模型構造)와 추정결과(推定結果))

  • Park, Jun-kyung;Kim, Jung-ho
    • KDI Journal of Economic Policy
    • /
    • v.12 no.4
    • /
    • pp.3-20
    • /
    • 1990
  • The multisector model is designed to analyze and forecast structural change in industrial output, employment, capital and relative price as well as macroeconomic change in aggregate income, interest rate, etc. This model has 25 industrial sectors, containing about 1,300 equations. Therefore, this model is characterized by detailed structural disaggregation at the sectoral level. Individual industries are based on many of the economic relationships in the model. This is what distinguishes a multisector model from a macroeconomic model. Each industry is a behavioral agent in the model for industrial investment, employment, prices, wages, and intermediate demand. The strength of the model lies in the simulating the interactions between different industries. The result of its simulation will be introduced in the next paper. In this paper, we only introduce the structure of the multisector model and the coefficients of the equations. The multisector model is a dynamic model-that is, it solves year by year into the future using its own solutions for earlier years. The development of a dynamic, year-by-year solution allows us to combine the change in structure with a consideration of the dynamic adjustment required. These dynamics have obvious advantages in the use of the multisector model for industrial planning. The multisector model is a medium-term and long-term model. Whereas a short-term model can taken the labor supply and capital stock as given, a long-term model must acknowledge that these are determined endogenously. Changes in the medium-term can be analyzed in the context of long-term structural changes. The structure of this model can be summarized as follow. The difference in domestic and world prices affects industrial structure and the pattern of international trade; domestic output and factor price affect factor demand; factor demand and factor price affect industrial income; industrial income and relative price affect industrial consumption. Technical progress, as measured in terms of total factor productivity and relative price affect input-output coefficients; input-output coefficients and relative price determine the industrial input cost; input cost and import price determine domestic price. The differences in productivity and wage growth among different industries affect the relative price.

  • PDF

Experimental and FEMLAB Simulation Study of Ibuprofen Racemate Separation in HPLC (Ibuprofen Racemate의 HPLC 분리실험과 FEMLAB 전산모사 연구)

  • Lee, Eun;Chang, Sang-Mork;Kim, Jong-Min;Kim, Woo-Shick;Kim, In-Ho
    • KSBB Journal
    • /
    • v.21 no.3
    • /
    • pp.224-229
    • /
    • 2006
  • FEMLAB is a powerful interactive environment for modeling, solving all kinds of scientific and engineering problems based on partial differential equations(PDEs). Separation process of chiral compound in HPLC columns was simulated by FEMLAB. To study change of elution profile with isotherm models, non-competitive and competitive Langmuir adsorption isotherm were adopted. Separated material was (R, S)-ibuprofen [(R, S)-2-(4-isobutyl phenyl) propionic acid], an anti-inflammatory agent, which retain the pharmacological activity in the (S)-(+)-enantiomer. Sample concentrations were changed from 0.5 mg/ml to 2.0 mg/ml at a flow rate of 1 ml/min and flow rate varied from 1 ml/min to 3 ml/min at an ibuprofen concentration of 2.0 mg/ml and $20{\mu}l$ of injection volume. Simulated results were well fitted with experimental data.

Development of Target-Controlled Infusion System in Plasma Concentration. PART1 : Establishment of Pharmacokinetic Model and Verification (혈중 목표 농도 자동 조절기(TCI) 개발 PART1 : 약동학적 모델의 수립과 검증)

  • 안재목;길호영
    • Journal of Biomedical Engineering Research
    • /
    • v.23 no.5
    • /
    • pp.341-349
    • /
    • 2002
  • The target controlled infusion(TCI) pump system is a logical approach to the development of improved administration techniques of an intravenous anaesthetic agent. The principle of TCI system is based on an understanding of the pharmacokinetic properties, three or four compartment model. The TCI system is optimal and flexible control of the plasma drug concentration. But the clinical goal is always to achieve a therapeutic drug effect, not a therapeutic concentration. So we developed the algorithm to target the concentration at the site of drug effect rather than the concentration in the plasma. If impulse drug is inputted into body, the decline of plasma concentration with time is shown, resulting in the expression of the differential equation. Therefore, we must reformulate our three-compartment model as four-compartment model with the effect compartment. And we tested plasma targeting and effect targeting algorithm by computer simulation using four-compartment model. So we developed the TCI capable of applying all intravenous drugs by adjusting individual pharmacokinetic parameters independently.