Browse > Article
http://dx.doi.org/10.5139/JKSAS.2022.50.4.287

Approximate Dynamic Programming Based Interceptor Fire Control and Effectiveness Analysis for M-To-M Engagement  

Lee, Changseok (Department of Industrial Engineering, Hannam University)
Kim, Ju-Hyun (Hanwha System)
Choi, Bong Wan (Department of Industrial Engineering, Hannam University)
Kim, Kyeongtaek (Department of Industrial Engineering, Hannam University)
Publication Information
Journal of the Korean Society for Aeronautical & Space Sciences / v.50, no.4, 2022 , pp. 287-295 More about this Journal
Abstract
As low altitude long-range artillery threat has been strengthened, the development of anti-artillery interception system to protect assets against its attacks will be kicked off. We view the defense of long-range artillery attacks as a typical dynamic weapon target assignment (DWTA) problem. DWTA is a sequential decision process in which decision making under future uncertain attacks affects the subsequent decision processes and its results. These are typical characteristics of Markov decision process (MDP) model. We formulate the problem as a MDP model to examine the assignment policy for the defender. The proximity of the capital of South Korea to North Korea border limits the computation time for its solution to a few second. Within the allowed time interval, it is impossible to compute the exact optimal solution. We apply approximate dynamic programming (ADP) approach to check if ADP approach solve the MDP model within processing time limit. We employ Shoot-Shoot-Look policy as a baseline strategy and compare it with ADP approach for three scenarios. Simulation results show that ADP approach provide better solution than the baseline strategy.
Keywords
Long-Range Artillery; Dynamic Weapon Target Assignment; Markov Decision Process; Approximate Dynamic Programming; Effectiveness Analysis for Engagement;
Citations & Related Records
Times Cited By KSCI : 7  (Citation Analysis)
연도 인용수 순위
1 Park, S. G. and Lee, K. H., "A Study on the Establishment of Capability-Based Multi-Layered Missile Defense System Considering MD in U.S.," Journal of the KNST, Vol. 3, No. 1, 2020, pp. 46~55.   DOI
2 Yonhapnews, https://m.yna.co.kr/view/AKR20210628082800504?input=1195m. (accessed 2022/02/21)
3 Powell, W. B., "Perspectives of Approximate Dynamic Programming," Annals of Operations Research, Vol 13, No. 2, 2012, pp. 1~38.
4 McKenna, R. S., Robbins, M. J., Lunday, B. J. and McCormack, I. M., "Approximate Dynamic Programming for the Military Inventory Routing Problem," Annals of Operationd Research, Vol. 288, No. 1, 2020, pp. 391~416.   DOI
5 Bradtke, S. J. and Barto, A. G, "Linear Least-Squares Algorithms for Temporal Difference Learning," Machine Learning, Vol. 22, No. 1, 1996, pp. 33~57.   DOI
6 Hong, D. W., Yim, D. S. and Choi, B. W., "Application and Determination of Defended Footprint Using a Simulation Model for Ballistic Missile Trajectory," Journal of the Korea Institute of Military Science and Technology, Vol. 21, No. 4, 2018, pp. 551~561.   DOI
7 Jang, J. G., Kim, K., Choi, B. W. and Suh, J. J., "A Linear Approximation Model for an Asset-based Weapon Target Assignment Problem," Journal Society of Korea Industrial and System Engineering, Vol. 38, No. 3, 2015, pp. 108~116.
8 Kim, J. H., Kim, K., Choi, B. W. and Suh, J.J., "An Application of Quantum-inspired Genetic Algorithm for Weapon Target Assignment Problem," Journal Society of Korea Industrial and System Engineering, Vol. 40, No. 4, 2017, pp. 260~267.   DOI
9 Ha, M. R. and Choi, J. W., "Simulator Design for Static Weapon Allocation Algorithm Evaluation," Journal of Institute of Control, Robotics and Systems, Vol. 25, No. 4, 2019, pp. 340~345.   DOI
10 Yoon, M. H., Park, J. H., Yi, J. H. and Koo, B. J., "An Effective Weapon Assignment Algorithm in a Multi-Target and Multi-Weapon Environment," Korea Information Science Society, Winter Conference, 2016, pp. 87~89.
11 Yoo, B. C., Kim, J. H., Kwon, Y. S. and Choi, B. W., "A Study on the Flight Trajectory Prediction Method of Ballistic Missiles," Journal of Korean Society of Systems Engineering, Vol. 16, No. 2, 2020, pp. 131~140.   DOI
12 Im, J. S., Yoo, B. C., Kim, J. H. and Choi, B. W., "A Study of Multi-to-Majority Response on Threat Assessment and Weapon Assignment Algorithm: by Adjusting Ballistic Missiles and Long-Range Artillery Threat," Journal of Korean Society of Industrial and systems Engineering, Vol. 44 N0. 4, 2021, pp. 43~52.
13 Yook, J. K., Hwang, S. J. and Kim, T. G., "Impact of MOPs on Effectiveness for M-to-M Engagement with the Counter Long Range Artillery Intercept System", Journal of Korean Society of Simulation, Vol. 29, No. 3, September 2020, pp. 57~72.
14 Lloyd, S. P. and Witsenhausen, H. S, "Weapon Allocation is NP-Complete," Proceedings of the IEEE Summer Computer Simulation Conference, 1986, pp. 1054~1058.
15 Choi, B. W., Yoo, B. C., Kim, J. H. and Yim, D. S., "A Study on the Flight Trajectory Prediction Method of Ballistic Missiles," 2020 Autumn Conference on Journal of Korean Society of Systems Engineering, 2020, pp. 131~140.
16 Shin, M. K., Park, S.-S., Lee, D. and Choi, H.-L., "Mean Field Game based Reinforcement Learning for Weapon-Target Assignment", Journal of the Korea Institute of Military Science and Technology, Vol. 23, No. 4, 2020, pp. 337~345.   DOI
17 Davis, M. T., Robbins, M. J. and Lunday, B. J., "Approximate Dynamic Programming for Missile Defense Interceptor Fire Control," European Journal of Operational Research, 259, 2017, pp. 873~886.   DOI
18 Choi, Y. H., Lee, Y. H. and Kim, J. E., "Comparative Study on Performance of Meta-heuristics for Weapon-Target Assignment Problem," Journal of the Korea Institute of Military Science and Technology, Vol. 20, No. 3, 2017, pp. 441~453.   DOI
19 Summers, D. S., Robbins, M. J. and Lunday, B. J., "An Approximate Dynamic Programming for Comparing Firing Policies in a Networked Air Defense Environment," Computers & Operations Research 117, 2020 : 104890.   DOI
20 Powell, W. B., Approximate Dynamic Programming: Solving the Curse of Dimensionality, 2011, Second Edition, John Wiley & Sons, Hoboken, NJ.
21 Chosun media, https://www.chosun.com/politics/politics_general/2022/02/21/6SGFMAEIZZGG7PIZAMLVZ33HCU/. (accessed 2022/02/21)
22 Defense White Paper, Ministry of National Defense, 2014, pp. 1~332.
23 DEMA, https://kookbang.dema.mil.kr/newsWeb/m/20210720/1/BBSMSTR_000000100115/view.do?nav=0&nav2=0. (accessed 2022/02/21)