Deep Reinforcement Learning based Tourism Experience Path Finding

  • Kyung-Hee Park (Dept. of Computer Engineering, Dongguk Univ. ) ;
  • Juntae Kim (Univ. of Dongguk, Dept. of Computer Engineering)
  • Received : 2023.10.26
  • Accepted : 2023.12.21
  • Published : 2023.12.30

Abstract

In this paper, we introduce a reinforcement learning-based algorithm for personalized tourist path recommendations. The algorithm employs a reinforcement learning agent to explore tourist regions and identify optimal paths that are expected to enhance tourism experiences. The concept of tourism experience is defined through points of interest (POI) located along tourist paths within the tourist area. These metrics are quantified through aggregated evaluation scores derived from reviews submitted by past visitors. In the experimental setup, the foundational learning model used to find tour paths is the Deep Q-Network (DQN). Despite the limited availability of historical tourist behavior data, the agent adeptly learns travel paths by incorporating preference scores of tourist POIs and spatial information of the travel area.

Keywords

Acknowledgement

This research was funded by the Korea Agency for Infrastructure Technology Advancement (KAIA) grant funded by the Ministry of Land, Infrastructure and Transport, grant number 1615012545

References

  1. Parr, Diana K. Free independent travellers: The unknown tourists. Diss. Lincoln College, University of Canterbury, 1989.
  2. Wang, D., S. Park, and D. Fesenmaier, "The role of Smartphones in Mediating the Touristic Experience", Journal of Travel Research, Vol.51, No.4, 2012.
  3. Jongwook Lee and Woontack Woo. Current Status and Prospect of Smart Tourism Using 3D Map Linked Digital Twin. The Journal of The Korean Institute of Communication Sciences,36(10),55-62. (2019).
  4. Popescu, Gabriela, et al. "Current problems regarding the research of consumer behavior in tourism." Lucrari stiintifice Management Agricol 18.1 (2016): 269.
  5. HeeJun Lee and Choong Kwon Lee. Sequence-Based Travel Route Recommendation Systems Using Deep Learning - A Case of Jeju Island -. Smart Media Journal,9(1),45-50. (2020). https://doi.org/10.30693/SMJ.2020.9.1.45
  6. Chang, Jui-Hung, et al. "Travel Package Recommendation based on Reinforcement Learning and Trip Guaranteed Prediction." Journal of Internet Technology 22.6: 1359-1373 (2021). https://doi.org/10.53106/160792642021112206013
  7. Geng, Yuanzhe, et al, "Deep Reinforcement Learning Based Dynamic Route Planning for Minimizing Travel Time." 2021 IEEE International Conference on Communications Workshops (ICC Workshops), IEEE, (2021).
  8. Park, Hyoshin John,"A Personalized Trip Planner For Vulnerable Road Users." Center for Advanced Transportation Mobility. 8. (2019).
  9. Majid Alivand, et al, Analyzing how travelers choose scenic routes using route choice models, Computers, Environment and Urban Systems, Volume 50, 2015, Pages 41-52, ISSN 0198-9715 https://doi.org/10.1016/j.compenvurbsys.2014.10.004
  10. Ssin, S., Suh, M., Lee, J., Jung, T., Woo, W. (2021). Science Tour and Business Model Using Digital Twin-Based Augmented Reality. In: tom Dieck, M.C., Jung, T.H., Loureiro, S.M.C. (eds) Augmented Reality and Virtual Reality. Progress in IS. Springer, Cham.
  11. Richard Sutton, "Reinforcement Learning: An Introduction", 2017
  12. Digital Twin National Land 2023, V-World, https://map.vworld.kr/map/ws3dmap.do?mode=MAPW201
  13. Korea Tourism Organization 2023, Tour-API, https://api.visitkorea.or.kr/#/useUtilExercises?utilName=&requestPage=1
  14. Volodymyr Mnih, et al, "Playing Atari with Deep Reinforcement Learning", arXiv preprint arXiv:1312.5602. (2013)
  15. Kyung-Hee Park and Choel-soon Kim, Smart Tourism Contents based on Augmented Reality combined with Digital Twin, ICT Platform Society 2022 Conference , PTL Volume 9-1, Pages 41-47, ISSN 2288-8195