Browse > Article
http://dx.doi.org/10.1633/JISTaP.2022.10.S.9

An Exploratory Approach to Discovering Salary-Related Wording in Job Postings in Korea  

Ha, Taehyun (Future Technology Analysis Center, Korea Institute of Science and Technology Information (KISTI))
Coh, Byoung-Youl (Future Technology Analysis Center, Korea Institute of Science and Technology Information (KISTI))
Lee, Mingook (Future Technology Analysis Center, Korea Institute of Science and Technology Information (KISTI))
Yun, Bitnari (Center for Research and Development Investment and Strategy Research, Korea Institute of Science and Technology Information (KISTI))
Chun, Hong-Woo (Future Technology Analysis Center, Korea Institute of Science and Technology Information (KISTI))
Publication Information
Journal of Information Science Theory and Practice / v.10, no.spc, 2022 , pp. 86-95 More about this Journal
Abstract
Online recruitment websites discuss job demands in various fields, and job postings contain detailed job specifications. Analyzing this text can elucidate the features that determine job salaries. Text embedding models can learn the contextual information in a text, and explainable artificial intelligence frameworks can be used to examine in detail how text features contribute to the models' outputs. We collected 733,625 job postings using the WORKNET API and classified them into low, mid, and high-range salary groups. A text embedding model that predicts job salaries based on the text in job postings was trained with the collected data. Then, we applied the SHapley Additive exPlanations (SHAP) framework to the trained model and discovered the significant words that determine each salary class. Several limitations and remaining words are also discussed.
Keywords
job posting; text embedding; explainable artificial intelligence; SHapley Additive exPlanations;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Lundberg, S. M., & Lee, S. I. (2017, December 4-9). A unified approach to interpreting model predictions. In I. Guyon, U. von Luxburg, S. Bengio, H. M. Wallach, R. Fergus, S. V. N. Vishwanathan, & R. Garnett (Eds.), Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems (pp. 4768-4777). NIPS.
2 Park, J. (2020). KoELECTRA: Pretrained ELECTRA model for Korean. https://github.com/monologg/KoELECTRA/blob/master/README_EN.md.
3 Ribeiro, M. T., Singh, S., & Guestrin, C. (2016, August 13-17). "Why should I trust you?": Explaining the predictions of any classifier. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 1135-1144). ACM.
4 Ward, I. R., Wang, L., Lu, J., Bennamoun, M., Dwivedi, G., & Sanfilippo, F. M. (2021). Explainable artificial intelligence for pharmacovigilance: What features are important when predicting adverse outcomes? Computer Methods and Programs in Biomedicine, 212, 106415. https://doi.org/10.1016/j.cmpb.2021.106415.   DOI
5 Zhao, J., Wang, J., Sigdel, M., Zhang, B., Hoang, P., Liu, M., & Korayem, M. (2021). Embedding-based recommender system for job to candidate matching on scale. arXiv. https://doi.org/10.48550/arXiv.2107.00221.
6 Karakatsanis, I., AlKhader, W., MacCrory, F., Alibasic, A., Omar, M. A., Aung, Z., & Woon, W. L. (2017). Data mining approach to monitoring the requirements of the job market: A case study. Information Systems, 65, 1-6. https://doi.org/10.1016/j.is.2016.10.009.   DOI
7 Alvarez-Melis, D., & Jaakkola, T. S. (2018). On the robustness of interpretability methods. arXiv. https://doi.org/10.48550/arXiv.1806.08049.
8 Chang, H. C., Wang, C. Y., & Hawamdeh, S. (2019). Emerging trends in data analytics and knowledge management job market: Extending KSA framework. Journal of Knowledge Management, 23(4), 664-686. https://doi.org/10.1108/JKM02-2018-0088.   DOI
9 Choi, I. H., Kim, Y. S., & Lee, C. K. (2020, September 17-19). A study of the classification of IT jobs using LSTM and LIME. Proceedings of the 9th International Conference on Smart Media and Applications (pp. 248-252). ACM.
10 Gunning, D. (2017). Explainable artificial intelligence (XAI). Defense Advanced Research Projects Agency (DARPA).
11 Antenucci, D., Cafarella, M., Levenstein, M., Re, C., & Shapiro, M. D. (2014). Using social media to measure labor market flows. https://www.nber.org/papers/w20010.
12 Lacic, E., Reiter-Haas, M., Duricic, T., Slawicek, V., & Lex, E. (2019, September 16-20). Should we embed? A study on the online performance of utilizing embeddings for real-time job recommendations. Proceedings of the 13th ACM Conference on Recommender Systems (pp. 496-500). ACM.
13 Park, J. H., Jo, H. S., Lee, S. H., Oh, S. W., & Na, M. G. (2022). A reliable intelligent diagnostic assistant for nuclear power plants using explainable artificial intelligence of GRU-AE, LightGBM and SHAP. Nuclear Engineering and Technology, 54, 1271-1287. https://doi.org/10.1016/j.net.2021.10.024.   DOI
14 Sun, Y., Zhuang, F., Zhu, H., Zhang, Q., He, Q., & Xiong, H. (2021). Market-oriented job skill valuation with cooperative composition neural network. Nature Communications, 12(1), 1992. https://doi.org/10.1038/s41467-021-22215-y.   DOI
15 Clark, K., Luong, M. T., Le, Q. V., & Manning, C. D. (2020). ELECTRA: Pre-training text encoders as discriminators rather than generators. arXiv. https://doi.org/10.48550/arXiv.2003.10555.
16 Scrivner, O., Nguyen, T., Simon, K., Middaugh, E., Taska, B., & Borner, K. (2020). Job postings in the substance use disorder treatment related sector during the first five years of Medicaid expansion. PloS One, 15(1), e0228394. https://doi.org/10.1371/journal.pone.0228394.   DOI
17 Daneva, M., Wang, C., & Hoener, P. (2017, November 9-10). What the job market wants from requirements engineers? An empirical analysis of online job ads from the Netherlands. Proceedings of the 11th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (pp. 448-453). IEEE.
18 Ha, T., Lee, M., Yun, B., & Coh, B. Y. (2022). Job forecasting based on the patent information: A word embedding-based approach. IEEE Access, 10, 7223-7233. https://doi.org/10.1109/ACCESS.2022.3141910.   DOI
19 Hirudayaraj, M., & Baker, R. (2018). HRD competencies: Analysis of employer expectations from online job postings. European Journal of Training and Development, 42(9), 577-596. https://eric.ed.gov/?id=EJ1198597.   DOI
20 Zhu, C., Zhu, H., Xiong, H., Ding, P., & Xie, F. (2016, August 13-17). Recruitment market trend analysis with sequential latent variable models. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 383-392). ACM.
21 Bach, S., Binder, A., Montavon, G., Klauschen, F., Muller, K. R., & Samek, W. (2015). On pixel-wise explanations for nonlinear classifier decisions by layer-wise relevance propagation. PloS One, 10(7), e0130140. https://doi.org/10.1371/journal.pone.0130140.   DOI
22 Borisyuk, F., Zhang, L., & Kenthapadi, K. (2017, August 13-17). LiJAR: A system for job application redistribution towards efficient career marketplace. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 1397-1406). ACM.
23 Chen, J., Koju, W., Xu, S., & Liu, Z. (2021, March 26-28). Sales forecasting using deep neural network and SHAP techniques. Proceedings of the 2021 IEEE 2nd International Conference on Big Data, Artificial Intelligence and Internet of Things Engineering (ICBAIE) (pp. 135-138). IEEE.
24 Ku, D. (2021). Social recruiting: Everything you need to know for 2022. https://www.postbeyond.com/blog/social-recruiting/.
25 Chen, T., Xu, J., Ying, H., Chen, X., Feng, R., Fang, X., Gao, H., & Wu, J. (2019). Prediction of extubation failure for intensive care unit patients using light gradient boosting machine. IEEE Access, 7, 150960-150968. https://doi.org/10.1109/ACCESS.2019.2946980.   DOI
26 Kaya, M., & Bogers, T. (2021, September 27-October 1). Effectiveness of job title based embeddings on resume to job ad recommendation. Proceedings of the 2021 Workshop on Recommender Systems for Human Resources, RECSYS IN HR 2021 (pp. 1-7). CEUR Workshop Proceedings.