Browse > Article
http://dx.doi.org/10.9766/KIMST.2019.22.5.667

Orienteering Problem with Unknown Stochastic Reward to Informative Path Planning for Persistent Monitoring and Its Solution  

Kim, Dooyoung (Department of Computer Science, Republic of Korea Naval Academy)
Publication Information
Journal of the Korea Institute of Military Science and Technology / v.22, no.5, 2019 , pp. 667-673 More about this Journal
Abstract
We present an orienteering problem with unknown stochastic reward(OPUSR) model for persistent monitoring tasks with unknown event probabilities at each point of interest. Prior studies on orienteering problem for persistent monitoring task assume that rewards and event probabilities are known as a prior. In this paper, we propose a stochastic reward model with unknown event statistics and a path re-planning algorithm based on Bayesian reward inference. Experiments demonstrate the efficiency of our method.
Keywords
Orienteering Problem; Persistent Monitoring; Path Planning;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Yu, J. Schwager, M. and Rus, D., "Correlated Orienteering Problem and its Application to Informative Path Planning for Persistent Monitoring Tasks," IEEE Conf. on Intelligent Robots and Systems(IROS), Chicago, Illinois, pp. 342-349, Sept. 2014.
2 Vansteenwegen, P. Souffriau, W. and Van Oudheusden, D., "The Orienteering Problem: A Survey," European Journal of Operational Research, 209(1):, pp. 1-10, 2011.   DOI
3 Ilhan, T. Iravani, S. M. and Daskin, M. S., "The Orienteering Problem with Stochastic Profits," Iie Trans., 40(4), pp. 406-421, 2008.   DOI
4 Baykal, C. Rosman, G. Claici, S. and Rus, D., "Persistent Surveillance of Events with Unknown, Time-Varying Statistics," IEEE Conf. on Robotics and Automation(ICRA), pp. 2682-2689, May 2017.
5 Sutton, R. S. and Barto, A. G., "Reinforcement Learning: An Introduction," MIT Press, Cambridge, 1998.
6 Thompson, W. R., "On the Likelihood That One Unknown Probability Exceeds Another in View of the Evidence of Two Samples," Biometrika, 25(3/4), pp. 285-294, 1933.   DOI
7 Republic of Korea Government Open Data Portal, "Traffic Accident Information," http://data.go.kr/dataset/15003493/fileData.do, accessed March, 2019.