Browse > Article
http://dx.doi.org/10.9708/jksci.2021.26.12.029

An Approach of Solving the Constrained Dynamic Programming - an Application to the Long-Term Car Rental Financing Problem  

Park, Tae Joon (School of Business, Yonsei University)
Kim, Hak-Jin (School of Business, Yonsei University)
Kim, Jinhee (School of Business, Yonsei University)
Publication Information
Journal of the Korea Society of Computer and Information / v.26, no.12, 2021 , pp. 29-43 More about this Journal
Abstract
In this paper, a new approach to solve the constrained dynamic programming is proposed by using the constraint programming. While the conventional dynamic programming scheme has the state space augmented with states on constraints, this approach, without state augmentation, represents states of constraints as domains in a contraining programming solver. It has a hybrid computational mechanism in its computation by combining solving the Bellman equation in the dynamic programming framework and exploiting the propagation and inference methods of the constraint programming. In order to portray the differences of the two approaches, this paper solves a simple version of the long-term car rental financing problem. In the conventional scheme, data structures for state on constraints are designed, and a simple inference borrowed from the constraint programming is used to the reduction of violation of constraints because no inference risks failure of a solution. In the hybrid approach, the architecture of interface of the dynamic programming solution method and the constraint programming solution method is shown. It finally discusses the advantages of the proposed method with the conventional method.
Keywords
the dynamic programming; constraint programming; the long-term car rental financing problem; computation theory; optimization;
Citations & Related Records
연도 인용수 순위
  • Reference
1 M. Ono, M. Pavone, Y. Kuwata, and J. Balaram, "Chance-constrained dynamic programming with application to risk-aware robotic space exploration," Autonomous Robots, Vol. 39, No. 4, pp555-571, December 2014. DOI:10.1007/s10514-015-9467-7   DOI
2 F. Rossi, P. Van Beek, and T. Walsh, "Constraint programming," In Foundations of Artificial Intelligence. Elsevier. Vol 3, pp. 181-211, January 2008. DOI:10.1016/S1574-6526(07)03004-0   DOI
3 V. Srinivasan, and Y. H. Kim, "Deterministic cash flow management: state of the art and research directions," Omega, Vol. 14, No. 2, pp. 145-166, January 1986. DOI:10.1016/0305-0483(86)90017-4   DOI
4 J. Subramanian, S. Stidham Jr, and C. J. Lautenbacher, "Airline yield management with overbooking, cancellations, and no-shows," Transportation science, Vol. 33, No. 2, pp. 147-167, May 1999. DOI:10.1287/trsc.33.2.147   DOI
5 C. Zhang, C. Guo, and S. Yi, "Airline overbooking problem with uncertain no-shows." Journal of Applied Mathematics, Vol. 2014, January 2014. DOI:10.1155/2014/304217   DOI
6 A. A. Robichek, D. Teichroew, and J. M. Jones, "Optimal short term financing decision," Management Science, Vol. 12, No. 1, pp. 1-36, September 1965. DOI:10.1287/mnsc.12.1.1   DOI
7 D. P. Bertsekas, "Dynamic programming and optimal control," Athena scientific, 1995.
8 R. E. Chatwin, "Continuous-time airline overbooking with time-dependent fares and refunds," Transportation Science, Vol. 33, No. 2, pp. 182-191, May 1999. DOI:10.1287/trsc.33.2.182   DOI
9 E. A. Feinberg and A. Shwartz, "Constrained discounted dynamic programming," Mathematics of operations research, Vol. 21, No. 4, pp922-945, November 1996. DOI:10.1287/moor.21.4.922   DOI
10 Y. E. Orgler, "An unequal-period model for cash management decisions," Management Science, Vol. 16, No. 2, pp. B-77, October 1969. DOI:10.1287/mnsc.16.2.B77   DOI
11 C. Schulte, and M. Carlsson, "Finite domain constraint programming systems." In Foundations of Artificial Intelligence. Elsevier. Vol. 2, 495-526, January 2006. DOI:10.1016/S1574-6526(06)80018-0   DOI
12 B. C. Smith, J. F. Leimkuhler, and R. M. Darrow, "Yield management at American airlines," interfaces, Vol. 22, No. 1, pp. 8-31, February 1992. DOI:10.1287/inte.22.1.8   DOI
13 Y. Lan, M. O. Ball, I. Z. Karaesmen, J. X. Zhang, and G. X Liu, "Analysis of seat allocation and overbooking decisions with hybrid information," European Journal of Operational Research, Vol. 240, No.2, pp. 493-504, January 2015. DOI:10.1016/j.ejor.2014.07.021   DOI
14 B. Liu, C. Cheng, S. Wang, S. Liao, K. W. Chau, X. Wu, and W Li, "Parallel chance-constrained dynamic programming for cascade hydropower system operation," Energy, Vol. 165, pp752-767, December 2018. DOI:10.1016/j.energy.2018.09.140   DOI
15 J. I. McGill, and G. J. Van Ryzin, "Revenue management: Research overview and prospects," Transportation science, Vol. 33, No. 2, pp. 233-256, May 1999. DOI:10.1287/trsc.33.2.233   DOI
16 H. H. Kim, H. J. Kim, "A comparison of fund-operational decision making in long-term car rental business using optimization," Journal of the Korean Production and Operation Mangement Society, Vol. 29, No.2, pp 189-208, May 2018. DOI:10.21131/kopoms.29.2.201805.189   DOI
17 Y. Bukchin, T. Raviv, "Constraint programming for solving various assembly line balancing problems," Omega, Vol. 1, No. 78, pp57-68, July 2018. DOI:10.1016/j.omega.2017.06.008   DOI
18 J. Castro, "A stochastic programming approach to cash management in banking," European Journal of Operational Research, Vol. 192, No. 3, pp. 963-974, February 2009. DOI:10.1016/j.ejor.2007.10.015   DOI
19 J. Chen, J. Wang, and P. C. Bell, "Lease expiration management for a single lease term in the apartment industry," European Journal of Operational Research, Vol. 238, No. 1, pp. 233-244, October 2014. DOI:10.1016/j.ejor.2014.03.025   DOI
20 N. P. Faisca, K. I. Kouramas, P. M. Saraiva, B. Rustem, and E. N. Pistikopoulos, "A multi-parametric programming approach for constrained dynamic programming problems," Optimization Letters, Vol. 2, No. 2, pp267-280, March 2008. DOI:10.1007/s11590-007-0056-3   DOI
21 D. Kizilay, P. Van Hentenryck, D. T. Eliiyi, "Constraint programming models for integrated container terminal operations," European Journal of Operations Research, Vol. 286, No. 3, pp945-962, November 2020. DOI:10.1016/j.ejor.2020.04.025   DOI
22 J. G. Kallberg, R. W. White, and W. T. Ziemba, "Short term financial planning under uncertainty," Management Science, Vol. 28, No. 6, pp. 670-682, June 1982. DOI:10.1287/mnsc.28.6.670   DOI