• Title/Summary/Keyword: Monte-Carlo algorithm

Search Result 503, Processing Time 0.029 seconds

Enhanced MCTS Algorithm for Generating AI Agents in General Video Games (일반적인 비디오 게임의 AI 에이전트 생성을 위한 개선된 MCTS 알고리즘)

  • Oh, Pyeong;Kim, Ji-Min;Kim, Sun-Jeong;Hong, Seokmin
    • The Journal of Information Systems
    • /
    • v.25 no.4
    • /
    • pp.23-36
    • /
    • 2016
  • Purpose Recently, many researchers have paid much attention to the Artificial Intelligence fields of GVGP, PCG. The paper suggests that the improved MCTS algorithm to apply for the framework can generate better AI agent. Design/methodology/approach As noted, the MCTS generate magnificent performance without an advanced training and in turn, fit applying to the field of GVGP which does not need prior knowledge. The improved and modified MCTS shows that the survival rate is increased interestingly and the search can be done in a significant way. The study was done with 2 different sets. Findings The results showed that the 10 training set which was not given any prior knowledge and the other training set which played a role as validation set generated better performance than the existed MCTS algorithm. Besed upon the results, the further study was suggested.

A study on the iverse modeling of communication channel by HOS (HOS를 이용한 통신 채널의 역 모델링에 관한 연구)

  • 임성각;진용옥
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.21 no.5
    • /
    • pp.1274-1282
    • /
    • 1996
  • This paper deals with an inverse modeling of nonminimum phase communication channel utilizing the HOS (High Order Statistics) of the received signal. After the communication channel is separated into the minimum phase and maximum phase components, the inverse modeling is performed independently. The performance superiority is confirmed by monte-carlo computer simulation in comparison with the traditional CMA (Constant Modulus Algorithm) method. By utilizing the proposed algorithm employing the HOS of the received signal, the inverse frequency characteristics of the channel can be obtained withoug transmitted signal in digital communication. This algorithm is required in preprocessing or postprocessing in order to remove the channel effect, and effective in the self adaptive equalizer which can minimize the bit error rate or symbol error rate in the recovry of received signal.

  • PDF

Simulating phase transition phenomena of the unitary cell model

  • Kim, Dong-Hoh
    • Journal of the Korean Data and Information Science Society
    • /
    • v.20 no.1
    • /
    • pp.225-235
    • /
    • 2009
  • Lattice process models are used to explain phase transitions in statistical mechanics, a branch of physics. The Ising model, a specific form of lattice process model, was proposed by Ising in 1925. Since then, variants of the Ising model such as the Potts model and the unitary cell model have been proposed. Like the Ising model, it is believed that the more general models exhibit phase transitions on the critical surface, which is based on the mathematical equation. In statistical sense, phase transitions can be simulated through Markov Chain Monte Carlo (MCMC). We applied Swendsen-Wang algorithm, a block Gibbs algorithm, to a general lattice process models and we simulate phase transition phenomena of the unitary cell model.

  • PDF

Ant Colony Optimization Approach to the Utility Maintenance Model for Connected-(r, s)-out of-(m, n) : F System ((m, n)중 연속(r, s) : F 시스템의 정비모형에 대한 개미군집 최적화 해법)

  • Lee, Sang-Heon;Shin, Dong-Yeul
    • IE interfaces
    • /
    • v.21 no.3
    • /
    • pp.254-261
    • /
    • 2008
  • Connected-(r,s)-out of-(m,n) : F system is an important topic in redundancy design of the complex system reliability and it's maintenance policy. Previous studies applied Monte Carlo simulation and genetic, simulated annealing algorithms to tackle the difficulty of maintenance policy problem. These algorithms suggested most suitable maintenance cycle to optimize maintenance pattern of connected-(r,s)-out of-(m,n) : F system. However, genetic algorithm is required long execution time relatively and simulated annealing has improved computational time but rather poor solutions. In this paper, we propose the ant colony optimization approach for connected-(r,s)-out of-(m,n) : F system that determines maintenance cycle and minimum unit cost. Computational results prove that ant colony optimization algorithm is superior to genetic algorithm, simulated annealing and tabu search in both execution time and quality of solution.

An Airline Scheduling Model and Solution Algorithms

  • AL-Sultan, Ahmed Thanyan;Ishioka, Fumio;Kurihara, Koji
    • Communications for Statistical Applications and Methods
    • /
    • v.18 no.2
    • /
    • pp.257-266
    • /
    • 2011
  • The rapid development of airlines, has made airports busier and more complicated. The assignment of scheduled to available gates is a major issue for daily airline operations. We consider the over-constrained airport gate assignment problem(AGAP) where the number of flights exceeds the number of available gates, and where the objectives are to minimize the number of ungated flights and the total walking distance or connection times. The procedures used in this project are to create a mathematical model formulation to identify decision variables to identify, constraints and objective functions. In addition, we will consider in the AGAP the size of each gate in the terminal and also the towing process for the aircraft. We will use a greedy algorithm to solve the problem. The greedy algorithm minimizes ungated flights while providing initial feasible solutions that allow flexibility in seeking good solutions, especially in case when flight schedules are dense in time. Experiments conducts give good results.

Multi-objective path planning for mobile robot in nuclear accident environment based on improved ant colony optimization with modified A*

  • De Zhang;Run Luo;Ye-bo Yin;Shu-liang Zou
    • Nuclear Engineering and Technology
    • /
    • v.55 no.5
    • /
    • pp.1838-1854
    • /
    • 2023
  • This paper presents a hybrid algorithm to solve the multi-objective path planning (MOPP) problem for mobile robots in a static nuclear accident environment. The proposed algorithm mimics a real nuclear accident site by modeling the environment with a two-layer cost grid map based on geometric modeling and Monte Carlo calculations. The proposed algorithm consists of two steps. The first step optimizes a path by the hybridization of improved ant colony optimization algorithm-modified A* (IACO-A*) that minimizes path length, cumulative radiation dose and energy consumption. The second module is the high radiation dose rate avoidance strategy integrated with the IACO-A* algorithm, which will work when the mobile robots sense the lethal radiation dose rate, avoiding radioactive sources with high dose levels. Simulations have been performed under environments of different complexity to evaluate the efficiency of the proposed algorithm, and the results show that IACO-A* has better path quality than ACO and IACO. In addition, a study comparing the proposed IACO-A* algorithm and recent path planning (PP) methods in three scenarios has been performed. The simulation results show that the proposed IACO-A* IACO-A* algorithm is obviously superior in terms of stability and minimization the total cost of MOPP.

P2P Ranging-Based Cooperative Localization Method for a Cluster of Mobile Nodes Containing IR-UWB PHY

  • Cho, Seong Yun;Kim, Joo Young;Enkhtur, Munkhzul
    • ETRI Journal
    • /
    • v.35 no.6
    • /
    • pp.1084-1093
    • /
    • 2013
  • problem of pedestrian localization using mobile nodes containing impulse radio ultra wideband (IR-UWB) is considered. IEEE 802.15.4a-based IR-UWB can achieve accurate ranging. However, the coverage is as short as 30 m, owing to the restricted transmit power. This factor may cause a poor geometric relationship among the mobile nodes and anchor nodes in certain environments. To localize a group of pedestrians accurately, an enhanced cooperative localization method is proposed. We describe a sequential algorithm and define problems that may occur in the implementation of the algorithm. To solve these problems, a batch algorithm is proposed. The batch algorithm can be carried out after performing the sequential algorithm to linearize the nonlinear range equation. When a sequential algorithm cannot be performed due to a poor geometric relationship among nodes, a batch algorithm can be carried out directly. Herein, Monte Carlo simulations are presented to illustrate the proposed method and verify its performance.

Bayesian Test of Quasi-Independence in a Sparse Two-Way Contingency Table

  • Kwak, Sang-Gyu;Kim, Dal-Ho
    • Communications for Statistical Applications and Methods
    • /
    • v.19 no.3
    • /
    • pp.495-500
    • /
    • 2012
  • We consider a Bayesian test of independence in a two-way contingency table that has some zero cells. To do this, we take a three-stage hierarchical Bayesian model under each hypothesis. For prior, we use Dirichlet density to model the marginal cell and each cell probabilities. Our method does not require complicated computation such as a Metropolis-Hastings algorithm to draw samples from each posterior density of parameters. We draw samples using a Gibbs sampler with a grid method. For complicated posterior formulas, we apply the Monte-Carlo integration and the sampling important resampling algorithm. We compare the values of the Bayes factor with the results of a chi-square test and the likelihood ratio test.

A Variable Dimensional Structure with Probabilistic Data Association Filter for Tracking a Maneuvering Target in Clutter Environment (클러터 환경하에서 기동표적의 추적을 위한 가변차원 확률 데이터 연관 필터)

  • 안병완;최재원;송택렬
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.9 no.10
    • /
    • pp.747-754
    • /
    • 2003
  • An enhancement of the probabilistic data association filter is presented for tracking a single maneuvering target in clutter environment. The use of the variable dimensional structure leads the probabilistic data association filter to adjust to real motion of a target. The detection of the maneuver for the model switching is performed by the acceleration estimates taken from a bias estimator of the two stage Kalman filter. The proposed algorithm needs low computational power since it is implemented with a single filtering procedure. A simple Monte Carlo simulation was performed to compare the performance of the proposed algorithm and the IMMPDA filter.

A Study on Randomization of Tining Space for Reducing Road Noise (도로소음 저감을 위한 타이닝 간격 랜덤화에 관한 연구)

  • Jung, Soon-Chul;Woo, Jong-Won;Kim, Yong-Soo;Lee, Jae-Eung
    • Transactions of the Korean Society for Noise and Vibration Engineering
    • /
    • v.15 no.8 s.101
    • /
    • pp.897-903
    • /
    • 2005
  • When driving on uniformly tining concrete pavement road, the whine noise which has high spectrum at the specific frequency related to the uniform tining space exist. In this paper, a randomization method of tining space for concrete pavements is proposed to reduce the whine noise. The proposed method is developed based on the LCG(linear congruential generator) algorithm. The design parameters used in the method are number of different tining space, ratio of each tining space, total linings of each size. sequence of actual tining under given constant drag length and texture. Monte Carlo simulations are used to validate the proposed method.