• Title/Summary/Keyword: stochastic problem

Search Result 534, Processing Time 0.031 seconds

A Learning based Algorithm for Traveling Salesman Problem (강화학습기법을 이용한 TSP의 해법)

  • Lim, JoonMook;Bae, SungMin;Suh, JaeJoon
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.32 no.1
    • /
    • pp.61-73
    • /
    • 2006
  • This paper deals with traveling salesman problem(TSP) with the stochastic travel time. Practically, the travel time between demand points changes according to day and time zone because of traffic interference and jam. Since the almost pervious studies focus on TSP with the deterministic travel time, it is difficult to apply those results to logistics problem directly. But many logistics problems are strongly related with stochastic situation such as stochastic travel time. We need to develop the efficient solution method for the TSP with stochastic travel time. From the previous researches, we know that Q-learning technique gives us to deal with stochastic environment and neural network also enables us to calculate the Q-value of Q-learning algorithm. In this paper, we suggest an algorithm for TSP with the stochastic travel time integrating Q-learning and neural network. And we evaluate the validity of the algorithm through computational experiments. From the simulation results, we conclude that a new route obtained from the suggested algorithm gives relatively more reliable travel time in the logistics situation with stochastic travel time.

STOCHASTIC DIFFERENTIAL EQUATION FOR WHITE NOISE FUNCTIONALS

  • Ji, Un Cig
    • Journal of the Chungcheong Mathematical Society
    • /
    • v.29 no.2
    • /
    • pp.337-346
    • /
    • 2016
  • Within white noise approach, we study the existence and uniqueness of the solution of an initial value problem for generalized white noise functionals, and then as a corollary we discuss the linear stochastic differential equation associated with a convolution of white noise functionals.

Analysis on Upper and Lower Bounds of Stochastic LP Problems (확률적 선형계획문제의 상한과 하한한계 분석)

  • 이상진
    • Journal of the Korean Operations Research and Management Science Society
    • /
    • v.27 no.3
    • /
    • pp.145-156
    • /
    • 2002
  • Business managers are often required to use LP problems to deal with uncertainty inherent in decision making due to rapid changes in today's business environments. Uncertain parameters can be easily formulated in the two-stage stochastic LP problems. However, since solution methods are complex and time-consuming, a common approach has been to use modified formulations to provide upper and lower bounds on the two-stage stochastic LP problem. One approach is to use an expected value problem, which provides upper and lower bounds. Another approach is to use “walt-and-see” problem to provide upper and lower bounds. The objective of this paper is to propose a modified approach of “wait-and-see” problem to provide an upper bound and to compare the relative error of optimal value with various upper and lower bounds. A computing experiment is implemented to show the relative error of optimal value with various upper and lower bounds and computing times.

A Note on the Stochastic Comparison in Production Yield Management (생산 수율 관리 문제와 확률적 비교)

  • Park, Kyungchul
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.40 no.5
    • /
    • pp.477-480
    • /
    • 2014
  • The single-period production inventory control problem under random yield is considered to analyze the impact of the yield characteristics on the firm's profit. We use the stochastic comparison as a main vehicle to compare the profits resulted under different random yields. Commonly used stochastic orderings are addressed with an analysis of their implications on the firm's profit. Moreover, a distribution-free bound on the profit is derived.

INDEFINITE STOCHASTIC OPTIMAL LQR CONTROL WITH CROSS TERM UNDER IQ CONSTRAINTS

  • Luo, Cheng-Xin;Feng, En-Min
    • Journal of applied mathematics & informatics
    • /
    • v.15 no.1_2
    • /
    • pp.185-200
    • /
    • 2004
  • A stochastic optimal LQR control problem under some integral quadratic (IQ) constraints is studied, with cross terms in both the cost and the constraint functionals, allowing all the control weighting matrices being indefinite. Sufficient conditions for the well-posedness of this problem are given. When these conditions are satisfied, the optimal control is explicitly derived via dual theory.

THE APPLICATION OF STOCHASTIC ANALYSIS TO COUNTABLE ALLELIC DIFFUSION MODEL

  • Choi, Won
    • Bulletin of the Korean Mathematical Society
    • /
    • v.41 no.2
    • /
    • pp.337-345
    • /
    • 2004
  • In allelic model X = ($\chi_1\chi$_2ㆍㆍㆍ, \chi_d$), M_f(t) = f(p(t)) - ${{\int^t}_0}\;Lf(p(t))ds$ is a P-martingale for diffusion operator L under the certain conditions. In this note, we can show existence and uniqueness of solution for stochastic differential equation and martingale problem associated with mean vector. Also, we examine that if the operator related to this martingale problem is connected with Markov processes under certain circumstance, then this operator must satisfy the maximum principle.

INVERSE PROBLEM FOR STOCHASTIC DIFFERENTIAL EQUATIONS ON HILBERT SPACES DRIVEN BY LEVY PROCESSES

  • N. U., Ahmed
    • Nonlinear Functional Analysis and Applications
    • /
    • v.27 no.4
    • /
    • pp.813-837
    • /
    • 2022
  • In this paper we consider inverse problem for a general class of nonlinear stochastic differential equations on Hilbert spaces whose generating operators (drift, diffusion and jump kernels) are unknown. We introduce a class of function spaces and put a suitable topology on such spaces and prove existence of optimal generating operators from these spaces. We present also necessary conditions of optimality including an algorithm and its convergence whereby one can construct the optimal generators (drift, diffusion and jump kernel).

Approximate Dynamic Programming-Based Dynamic Portfolio Optimization for Constrained Index Tracking

  • Park, Jooyoung;Yang, Dongsu;Park, Kyungwook
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.13 no.1
    • /
    • pp.19-30
    • /
    • 2013
  • Recently, the constrained index tracking problem, in which the task of trading a set of stocks is performed so as to closely follow an index value under some constraints, has often been considered as an important application domain for control theory. Because this problem can be conveniently viewed and formulated as an optimal decision-making problem in a highly uncertain and stochastic environment, approaches based on stochastic optimal control methods are particularly pertinent. Since stochastic optimal control problems cannot be solved exactly except in very simple cases, approximations are required in most practical problems to obtain good suboptimal policies. In this paper, we present a procedure for finding a suboptimal solution to the constrained index tracking problem based on approximate dynamic programming. Illustrative simulation results show that this procedure works well when applied to a set of real financial market data.

Dynamic Decisions using Variable Neighborhood Search for Stochastic Resource-Constrained Project Scheduling Problem (확률적 자원제약 스케줄링 문제 해결을 위한 가변 이웃탐색 기반 동적 의사결정)

  • Yim, Dong Soon
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.43 no.1
    • /
    • pp.1-11
    • /
    • 2017
  • Stochastic resource-constrained project scheduling problem is an extension of resource-constrained project scheduling problem such that activity duration has stochastic nature. In real situation where activity duration is not known until the activity is finished, open-loop based static policies such as activity-based policy and priority-based policy will not well cope with duration variability. Then, a dynamic policy based on closed-loop decision making will be regarded as an alternative toward achievement of minimal makespan. In this study, a dynamic policy designed to select activities to start at each decision time point is illustrated. The performance of static and dynamic policies based on variable neighborhood search is evaluated under the discrete-event simulation environment. Experiments with J120 sets in PSPLIB and several probability distributions of activity duration show that the dynamic policy is superior to static policies. Even when the variability is high, the dynamic policy provides stable and good solutions.

Searching a global optimum by stochastic perturbation in error back-propagation algorithm (오류 역전파 학습에서 확률적 가중치 교란에 의한 전역적 최적해의 탐색)

  • 김삼근;민창우;김명원
    • Journal of the Korean Institute of Telematics and Electronics C
    • /
    • v.35C no.3
    • /
    • pp.79-89
    • /
    • 1998
  • The Error Back-Propagation(EBP) algorithm is widely applied to train a multi-layer perceptron, which is a neural network model frequently used to solve complex problems such as pattern recognition, adaptive control, and global optimization. However, the EBP is basically a gradient descent method, which may get stuck in a local minimum, leading to failure in finding the globally optimal solution. Moreover, a multi-layer perceptron suffers from locking a systematic determination of the network structure appropriate for a given problem. It is usually the case to determine the number of hidden nodes by trial and error. In this paper, we propose a new algorithm to efficiently train a multi-layer perceptron. OUr algorithm uses stochastic perturbation in the weight space to effectively escape from local minima in multi-layer perceptron learning. Stochastic perturbation probabilistically re-initializes weights associated with hidden nodes to escape a local minimum if the probabilistically re-initializes weights associated with hidden nodes to escape a local minimum if the EGP learning gets stuck to it. Addition of new hidden nodes also can be viewed asa special case of stochastic perturbation. Using stochastic perturbation we can solve the local minima problem and the network structure design in a unified way. The results of our experiments with several benchmark test problems including theparity problem, the two-spirals problem, andthe credit-screening data show that our algorithm is very efficient.

  • PDF