DOI QR코드

DOI QR Code

텍스트 기반 Explainable AI를 적용한 국가연구개발혁신 모니터링

Text Based Explainable AI for Monitoring National Innovations

  • 임정선 (한국과학기술정보연구원) ;
  • 배성훈 (한국국토정보공사 공간정보연구원)
  • 투고 : 2022.09.08
  • 심사 : 2022.11.09
  • 발행 : 2022.12.31

초록

Explainable AI (XAI) is an approach that leverages artificial intelligence to support human decision-making. Recently, governments of several countries including Korea are attempting objective evidence-based analyses of R&D investments with returns by analyzing quantitative data. Over the past decade, governments have invested in relevant researches, allowing government officials to gain insights to help them evaluate past performances and discuss future policy directions. Compared to the size that has not been used yet, the utilization of the text information (accumulated in national DBs) so far is low level. The current study utilizes a text mining strategy for monitoring innovations along with a case study of smart-farms in the Honam region.

키워드

과제정보

This study was supported by research funds of KISTI(Korea Institute of Science and Technology Information) K-22-L05-C02-S07 with K-22-L03-C04-S01.

참고문헌

  1. Ahn, H. and Lim, D.H., A Study on Fraud Detection in the C2C Used Trade Market Using Doc2vec, Journal of The Korea Society of Computer and Information, 2022, Vol. 27, No. 3, pp. 173-182.  https://doi.org/10.9708/JKSCI.2022.27.03.173
  2. Angelov, P.P., Soares, E.A., Jiang, R., Arnold, N.I., and Atkinson, P.M., Explainable Artificial Intelligence: An Analytical Review, Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 2021, Vol. 11, No. 5, pp. 1-13. 
  3. Arrieta, A. B., Diaz-Rodriguez, N., Ser, J. D., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molia, D., Benjamins, R., Chatila, R., and Herrera, F., Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges Toward Responsible AI, Information Fusion, 2020, Vol. 58, pp. 82-115.  https://doi.org/10.1016/j.inffus.2019.12.012
  4. Cao, D.S., Lianga, Y.Z., Xub, Q.S., Zhanga, L.X., Huc, Q.N. and Lia, H.D., Feature importance sampling-based adaptive random forest as a useful tool to screen underlying lead compounds, J. Chemometrics, 2011, Vol. 25, pp. 201-207.  https://doi.org/10.1002/cem.1375
  5. Chen, B.C., Kang, K.M., and Kim, J.K., Deep Learningbased Text Summarization Model for Explainable Personalized Movie Recommendation Service, Journal of Information Technology Services, 2022, Vol. 21, No. 2, pp. 109-126.  https://doi.org/10.9716/KITS.2022.21.2.109
  6. Cheon, K.M. and Yang, J., Explainable AI Application for Machine Predictive Maintenance, Journal of Korean Society of Industrial and Systems Engineering, 2021, Vol. 44, No. 4, pp. 227-233.  https://doi.org/10.11627/jksie.2021.44.4.227
  7. DARPA., Explainable Artificial Intelligence(XAI), 2022, [Online]. Availabe: https://www.darpa.mil/program/explainable-artificial-intelligence. 
  8. Duskova, M. and Souckova, M., Company and State Performance in Key Enabling Technologies-Case Study of Nanotechnology Industry, International Journal of Innovation and Technology Management, 2020, Vol. 17, No. 1, 2050002. 
  9. EC(European Commission), Feasibility study for and EU monitoring mechanism on key enabling technologies, Belgium: European Commission, 2012. 
  10. EC, KETs Obsevatory Phase ii Methodology Report, Belgium: European Commission, 2017. 
  11. EC, Advanced Technologies for Industry, 2022,[Online]. Available: https://ati.ec.europa.eu/. 
  12. Economic Ministers' Meeting 18-3, Government R&D investment innovation plan to support innovative growth, Joint ministry of Korea Government, 2018. 
  13. Evangelista, R., Meliciani, V., and Vezzani A., Specialisation in key enabling technologies and regional growth in Europe, Economics of Innovation and New Technology, 2018, Vol. 27, No. 3, pp. 273-289.  https://doi.org/10.1080/10438599.2017.1338392
  14. Fabris, F., Doherty, A., Palmer, D., Pedro de Magalhaes, J., and Freitas, A., A New Approach for Interpreting Random Forest Models and Its Application to the Biology of Ageing, Bioinformatics, 2018, Vol. 34, No. 14, pp. 2449-2456.  https://doi.org/10.1093/bioinformatics/bty087
  15. Gwarda-Gruszczynska, E. and Dobrowolska, B., KETs Diffusion and its Influence on Companies' Innovativeness and Competitiveness, Economics and Organization of the Enterprise, 2017, Vol. 6, pp. 47-57. 
  16. Ha, T., Coh, B.Y., Lee, M., Yun, B., and Chun, H.W., An Exploratory Approach to Discovering Salary-Related Wording in Job Postings in Korea, Journal of Information Science Theory and Practice, 2022, Vol. 10, pp. 86-95. 
  17. Hall, P., Gil, N., Kurka, M., and Phan, W., Machine Learning Interpretability with H2O Driverless AI, 2022, [Online], Available: https://docs.h2o.ai/driverless-ai/latest-stable/docs/booklets/MLIBooklet.pdf. 
  18. Henckaerts, R., Antonio, K., and Cote, M.P., When Stakes are High: Balancing Accuracy and Transparency with Model-Agnostic Interpretable Data-driven suRRogates, Expert Systems with Applications, 2022, Vol. 202, pp. 1-13. 
  19. Horvat, M., The New Framework for EU Research and Innovation, Science, 2011, Vol. 334, pp. 1066-1068.  https://doi.org/10.1126/science.1214295
  20. Hwang, H. and Lee, Y., Semi-Supervised Learning based on Auto-generated Lexicon using XAI in Sentiment Analysis, Proceedings of Recent Advances in Natural Language Processing, 2021, pp. 593-600. 
  21. Kim, D.Y., Jeong, A.Y., and Lee, T.J., Analysis of Malware Group Classification with eXplainable Artificial Intelligence, Journal of The Korea Institute of Information Security & Cryptology, 2021, Vol. 31, No. 4, pp. 559-571.  https://doi.org/10.13089/JKIISC.2021.31.4.559
  22. Lane, J., Let's Make Science Metrics More Scientific, Nature, 2010, Vol. 464, pp. 488-489.  https://doi.org/10.1038/464488a
  23. Lane, J. and Bertuzzi, S.. The Star Metrics Project: Current and Future Uses for S&E Workforce Data, 2010,[Online], Available: https://www.nsf.gov/sbe/sosp/workforce/lane.pdf. 
  24. Lim, J.S., Shin, K.M., Yoon, J.S., and Bae, S.H., Study of US/EU National Innovation Policies Based on Nanotechnology Development, and Implications for Korea, Journal of Information Science Theory and Practice, 2015, Vol. 3, No. 1, pp. 50-65.  https://doi.org/10.1633/JISTaP.2015.3.1.4
  25. Lim, J.S. and Kim, S.G., Quantifying Innovation Characteristics of National R&D Investment through Cross-Cutting Data Analysis: Case Study on NTIS Nanotechnology, Journal of The Korean Operations Research and Management Science Society, 2020, Vol. 45, No. 2, pp. 13-23.  https://doi.org/10.7737/jkorms.2020.45.2.013
  26. Lim, J.S., Kim, S.G., Bae, S.H., Kim, K.H., and Won, D.K., Research on Regional Spatial Information Analysis Platform about NTIS Raw Data, Journal of Cadastre & Land InformatiX, 2020, Vol. 50, No. 2, pp. 21-35.  https://doi.org/10.22640/LXSIRI.2020.50.2.21
  27. Lim, J.S., Park, J.H., and Kim, S.G., Study on Measurement of National R&D Investment Spillover: Linking Multilateral Big Data, Korea CEO Academy, 2021, Vol. 24, No. 1, pp. 311-330. 
  28. Messalas, A., Kanellopoulos, Y., and Makris, C., Model-Agnostic Interpretability with Shapley Values, 10th International Conference on IISA, 2019, pp. 1-7. 
  29. Mieszkowski, K., The Methods and Rationale for Selecting Advanced Manufacturing Technologies as a Smart Specialisation Priority in Less-innovative Countries: The Case of Poland, Problemy Eksploatacji, 2016, Vol. 2, pp. 71-82. 
  30. NTIS(National Science & Technology Information Service), 2022,[Online]. Available: https://www. ntis.go.kr. 
  31. OECD, Oslo Manual 2018, Guidelines for Collecting, Reporting and Using Data on Innovation, OECD Publications, 2018. 
  32. OECD, R&D Platform for Investment and Evaluation ("R&D PIE"), 2022,[Online], Available: https://oecd-opsi.org/innovations/rd-platform-for-investment-and-evaluation-rd-pie. 
  33. Salikhova, O.B., Industry Modernization Based on the Principles of Smart Specialization. Part ІI. Establishing the Tools for Monitoring and System Analysis of the Impact of Key Technologies on Industry Modernization, Statistics of Ukraine, 2020, Vol.88, No.1, pp. 84-90. https://doi.org/10.31767/su.1(88)2020.01.10