Journal of the Korea Institute of Military Science and Technology (한국군사과학기술학회지)

The Korea Institute of Military Science and Technology (한국군사과학기술학회)
권호 표지
DOI QR코드

DOI QR Code

Orienteering Problem with Unknown Stochastic Reward to Informative Path Planning for Persistent Monitoring and Its Solution

지속정찰 임무의 경로계획을 위한 불확실 기댓값 오리엔티어링 문제와 해법

  • Kim, Dooyoung (Department of Computer Science, Republic of Korea Naval Academy)
  • 김두영 (해군사관학교 컴퓨터과학과)
  • Received : 2019.05.07
  • Accepted : 2019.08.23
  • Published : 2019.10.05
Download PDF
⟨ Previous Next ⟩

Abstract

We present an orienteering problem with unknown stochastic reward(OPUSR) model for persistent monitoring tasks with unknown event probabilities at each point of interest. Prior studies on orienteering problem for persistent monitoring task assume that rewards and event probabilities are known as a prior. In this paper, we propose a stochastic reward model with unknown event statistics and a path re-planning algorithm based on Bayesian reward inference. Experiments demonstrate the efficiency of our method.

Keywords

References

  1. Yu, J. Schwager, M. and Rus, D., "Correlated Orienteering Problem and its Application to Informative Path Planning for Persistent Monitoring Tasks," IEEE Conf. on Intelligent Robots and Systems(IROS), Chicago, Illinois, pp. 342-349, Sept. 2014.
  2. Vansteenwegen, P. Souffriau, W. and Van Oudheusden, D., "The Orienteering Problem: A Survey," European Journal of Operational Research, 209(1):, pp. 1-10, 2011. https://doi.org/10.1016/j.ejor.2010.03.045
  3. Ilhan, T. Iravani, S. M. and Daskin, M. S., "The Orienteering Problem with Stochastic Profits," Iie Trans., 40(4), pp. 406-421, 2008. https://doi.org/10.1080/07408170701592481
  4. Baykal, C. Rosman, G. Claici, S. and Rus, D., "Persistent Surveillance of Events with Unknown, Time-Varying Statistics," IEEE Conf. on Robotics and Automation(ICRA), pp. 2682-2689, May 2017.
  5. Sutton, R. S. and Barto, A. G., "Reinforcement Learning: An Introduction," MIT Press, Cambridge, 1998.
  6. Thompson, W. R., "On the Likelihood That One Unknown Probability Exceeds Another in View of the Evidence of Two Samples," Biometrika, 25(3/4), pp. 285-294, 1933. https://doi.org/10.1093/biomet/25.3-4.285
  7. Republic of Korea Government Open Data Portal, "Traffic Accident Information," http://data.go.kr/dataset/15003493/fileData.do, accessed March, 2019.