Information Systems Review (경영정보학연구)

The Korea Society of Management Information Systems (한국경영정보학회)
권호 표지
DOI QR코드

DOI QR Code

Service Quality Evaluation based on Social Media Analytics: Focused on Airline Industry

소셜미디어 어낼리틱스 기반 서비스품질 평가: 항공산업을 중심으로

  • Myoung-Ki Han (Department of Data Science, Kookmin University) ;
  • Byounggu Choi (College of Business Administration, Kookmin University)
  • 한명기 (국민대학교 데이터사이언스학과 대학원) ;
  • 최병구 (국민대학교 경영대학)
  • Received : 2021.12.28
  • Accepted : 2022.02.21
  • Published : 2022.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

As competition in the airline industry intensifies, effective airline service quality evaluation has become one of the main challenges. In particular, as big data analytics has been touted as a new research paradigm, new research on service quality measurement using online review analysis has been attempted. However, these studies do not use review titles for analysis, relyon supervised learning that requires a lot of human intervention in learning, and do not consider airline characteristics in classifying service quality dimensions.To overcome the limitations of existing studies, this study attempts to measure airlines service quality and to classify it into the AIRQUAL service quality dimension using online review text as well as title based on self-trainingand sentiment analysis. The results show the way of effective extracting service quality dimensions of AIRQUAL from online reviews, and find that each service quality dimension have a significant effect on service satisfaction. Furthermore, the effect of review title on service satisfaction is also found to be significant. This study sheds new light on service quality measurement in airline industry by using an advanced analytical approach to analyze effects of service quality on customer satisfaction. This study also helps managers who want to improve customer satisfaction by providing high quality service in airline industry.

항공산업의 경쟁이 치열해짐에 따라 효과적인 항공사 서비스 품질 측정은 주요 과제 중 하나가 되었다. 특히 빅데이터 어낼리틱스가 새로운 연구 패러다임으로 각광받게 됨에 따라 소비자가 직접 작성한 온라인 리뷰 분석을 통한 항공사 서비스 품질 측정 연구들이 새롭게 시도되고 있다. 그러나 이러한 연구들은 리뷰 제목을 분석에 활용하지 않았다는 점, 학습 데이터 셋 구축을 위한 레이블링(labeling)에 있어 사람의 개입이 많이 요구되는 지도 학습(supervised learning)에 의존한다는 점, 서비스 품질 차원 분류에 있어 항공사 특성을 고려하지 못한다는 점 등이 문제로 지적되고 있다. 기존 연구의 한계를 극복하기 위해 본 연구에서는 제목과 본문을 포함한 온라인 리뷰 전체를 자가학습(self-training)과 감성 분석을 활용해 AIRQUAL 서비스 품질 차원으로 분류함으로써 객관적이고 정교한 서비스 품질측정을 시도하였으며 이를 기반으로 서비스 품질 차원이 서비스 만족도에 미치는 영향을 파악하였다. 분석 결과 온라인 리뷰로부터 AIRQUAL의 다섯 가지 서비스 품질 차원을 효과적으로 추출할 수 있었으며 각 서비스 품질 차원은 모두 서비스 만족도에 유의한 영향을 미치는 것으로 나타났다. 나아가 리뷰 제목이 서비스 만족도에 미치는 영향 또한 유의한 것으로 파악되었다. 본 연구는 항공산업의 특성을 반영한 서비스 품질 차원 측정 및 이의 효과에 대한 분석이라는 측면에서 학문 및 실무적 의의가 있다.

Keywords

Acknowledgement

이 논문은 2020년 대한민국 교육부와 한국연구재단의 지원을 받아 수행된 연구임(NRF-2020S1A5A2A01047070).

References

  1. 최지은, 김소담, 김희웅, "의료 서비스 리뷰의 감성 수준이 병원 평가에 미치는 영향 분석", Information Systems Review, 제20권, 제2호, 2018, pp. 111-137. https://doi.org/10.14329/isr.2018.20.2.111
  2. Abdel Rady, H., "Measuring airline service quality using AIRQUAL model: A study applied to Egyptair", International Journal of Heritage, Tourism and Hospitality, Vol.12, No.1, 2018, pp. 271-290. https://doi.org/10.21608/ijhth.2018.31517
  3. Aksoy, S., E. Atilgan, and S. Akinci, "Airline services marketing by domestic and foreign firms: Differences from the customers' viewpoint", Journal of Air Transport Management, Vol.9, No.6, 2003, pp. 343-351. https://doi.org/10.1016/S0969-6997(03)00034-6
  4. Ali, F., B. L., Dey, and R. Filieri, "An assessment of service quality and resulting customer satisfaction in Pakistan international airlines: Findings from foreigners and overseas Pakistani customers", International Journal of Quality & Reliability Management, Vol.32, No.5, 2015, pp. 486-502. https://doi.org/10.1108/IJQRM-07-2013-0110
  5. Ascaniis, S. and U. Gretzel, "What's in a travel review title?", in: Fuchs, M., F. Ricci, and L. Cantoni (eds.), Information and Communication Technologies in Tourism, Springer, Vienna, 2012, pp. 494-505.
  6. Avery, C., P. Resnich, and R. Zeckhauser, "The market for evaluations", American Economic Review, Vol.89, No.3, 1999, pp. 564-584.
  7. Bailey, A. A., "Consumer awareness and use of product review websites", Journal of Interactive Advertising, Vol.6, No.1, 2005, pp. 68-81.
  8. Biswas, B., P. Sengupta, and B. Ganguly, "Your reviews or mine? Exploring the determinants of, "perceived helpfulness" of online reviews: A cross-cultural study", Electronic Markets, 2021, in Press.
  9. Boetsch, T., T. Bieger, and A. Wittmer, "A customer-value framework for analyzing airline services", Transportation Journal, Vol.50, No.3, 2011, pp. 251-270. https://doi.org/10.5325/transportationj.50.3.0251
  10. Breusch, T. S. and A. R. Pagan, "A simple test for heteroskedasticity and random coefficient variation", Econometrica, Vol.47, No.1979, pp. 1287-1294. https://doi.org/10.2307/1911963
  11. Cao, K., Y. Chen, J. Lu, N. Arechiga, A. Gaidon, and T. Ma, "Heteroskedastic and imbalanced deep learning with adaptive regularization", Proceedings of the International Conference on Learning Representations, 2021, https://openreview.net/forum?id=mEdwVCRJuX4.
  12. Cao, Q., W. Duan, and Q. Gan, "Exploring determinants of voting for the, "helpfulness" of online user reviews: A text mining approach", Decision Support Systems, Vol.50, No.2, 2011, pp. 511-521. https://doi.org/10.1016/j.dss.2010.11.009
  13. Carman, J. M., "Consumer perceptions of service quality: An assessment of the SERVQUAL dimensions", Journal of Retailing, Vol.66, No.1, 1990, pp. 33-55.
  14. Chen, Y. and J. Xie, "Online consumer review: Word-of-mouth as a new element of marketing communication mix", Management Science, Vol.54, No.3, 2008, pp. 477-491. https://doi.org/10.1287/mnsc.1070.0810
  15. Choi, J., A. Menon, and H. Tabakovic, "Using machine learning to revisit the diversification-performance relationship", Strategic Management Journal, Vol.42, No.9, 2021, pp. 1632-1661. https://doi.org/10.1002/smj.3317
  16. Chua, A. Y. and S. Banerjee, "Helpfulness of user-generated reviews as a function of review sentiment, product type and information quality", Computers in Human Behavior, Vol.54, 2016, pp. 547-554. https://doi.org/10.1016/j.chb.2015.08.057
  17. Demir, H. H., "Evaluation of service quality of airway companies giving domestic services in Turkey with fuzzy set approach", International Journal of Electronics, Mechanical and Mechatronics Engineering, Vol. 2, No. 3, 2012, pp. 233-239.
  18. Deveci, M., E. Ozcan, R. John, and S. C. Oner, "Interval type-2 hesitant fuzzy set method for improving the service quality of domestic airlines in Turkey", Journal of Air Transport Management, Vol.69, 2018, pp. 83-98. https://doi.org/10.1016/j.jairtraman.2018.01.008
  19. Dua, S. and P. Chowriappa, Data Mining for Bioinformatics, CRC Press, Boca Raton, FL, 2013.
  20. Duan, W., B. Gu, and A. B. Whinston, "Do online reviews matter?: An empirical investigation of panel data", Decision Support Systems, Vol.45, No.4, 2008, pp. 1007-1016. https://doi.org/10.1016/j.dss.2008.04.001
  21. Duan, W., Y. Yu, Q. Cao, and S. Levy, "Exploring the impact of social media on hotel service performance: A sentimental analysis approach", Cornell Hospitality Quarterly, Vol.57, No.3, 2016, pp. 282-296. https://doi.org/10.1177/1938965515620483
  22. Ekiz, H. E., K. Hussain, and A. Bavik, "Perceptions of service quality in North Cyprus national airline", Proceedings of the International Conference on Tourism and Hospitality Industry, 2006, pp. 778-790.
  23. Fan, W. and M. D. Gordon, "The power of social media analytics", Communications of the ACM, Vol.57, No.6, 2014, pp. 74-81.
  24. Farooq, M. S., M. Salam, A. Fayolle, N. Jaafar, and K. Ayupp, "Impact of service quality on customer satisfaction in Malaysia airlines: A PLS-SEM approach", Journal of Air Transport Management, Vol.67, 2018, pp. 169-180.
  25. Gao, K., Y. Yang, and X. Qu, "Examining nonlinear and interaction effects of multiple determinants on airline travel satisfaction", Transportation Research Part D: Transport and Environment, Vol.97, 2021, Article 102957.
  26. Ghose, A. and P. G. Ipeirotis, "Estimating the helpfulness and economic impact of product reviews: Mining text and reviewer characteristics", IEEE Transactions on Knowledge and Data Engineering, Vol.23, No.10, 2010, pp. 1498-1512. https://doi.org/10.1109/TKDE.2010.188
  27. Gottschalk, S. A. and A. Mafael, "Cutting through the online review jungle: Investigating selective eWOM processing", Journal of Interactive Marketing, Vol. 37, 2017, pp. 89-104. https://doi.org/10.1016/j.intmar.2016.06.001
  28. Hasan, M., M. N. Khan, and R. Farooqi, "Service quality measurement models: Comparative analysis and application in airlines industry", Global Journal of Enterprise Information System, Vol.11, No.2, 2019, pp. 29-41.
  29. Hu, N., N. S. Koh, and S. K. Reddy, "Ratings lead you to the product, reviews help you clinch it? The mediating role of online review sentiments on product sales", Decision Support Systems, Vol.57, 2014, pp. 42-53. https://doi.org/10.1016/j.dss.2013.07.009
  30. Huffaker, D., "Dimensions of leadership and social influence in online communities", Human Communication Research, Vol. 36, No. 4, 2010, pp. 593-617.
  31. Hussain, R., A. Al Nasser, and Y. K. Hussain, "Service quality and customer satisfaction of a UAE-based airline: An empirical investigation", Journal of Air Transport Management, Vol.42, 2015, pp. 167-175. https://doi.org/10.1016/j.jairtraman.2014.10.001
  32. Khalsa, S. J. S., C. A. Mattmann, and R. Duerr, "Deep web crawling for insights from polar data", Proceedings of the International Geoscience and Remote Sensing Symposium, 2017, pp. 376-379.
  33. Kocak, B. B. and O. Atalik, "Perceptual maps of Turkish airline services for different periods using supervised machine learning approach and multidimensional scaling", International Journal of Sustainable Aviation, Vol.5, No.3, 2019, pp. 205-229. https://doi.org/10.1504/IJSA.2019.103503
  34. Korfiatis, N., P. Stamolampros, P. Kourouthanassis, and V. Sagiainos, "Measuring service quality from unstructured data: A topic modeling application on airline passengers' online reviews", Expert Systems with Applications, Vol. 116, 2019, pp. 472-486. https://doi.org/10.1016/j.eswa.2018.09.037
  35. Lee, K. and C. Yu, "Assessment of airport service quality: A complementary approach to measure perceived service quality based on Google reviews", Journal of Air Transport Management, Vo.71, 2018, pp. 28-44.
  36. Li, W., S. Yu, H. Pei, C. Zhao, and B. Tian, "A hybrid approach based on fuzzy AHP and 2-tuple fuzzy linguistic method for evaluation in-flight service quality", Journal of Air Transport Management, Vol.60, 2017, pp. 49-64.
  37. Lin, J. W., F. Wang, and P. Chu, "Using semantic similarity in crawling-based web application testing", Proceedings of the International Conference on Software Testing, Verification and Validation, 2017, pp. 138-148.
  38. Liou, J. J., C. Y. Tsai, R. H. Lin, and G. H. Tzeng, "A modified VIKOR multiple-criteria decision method for improving domestic airlines service quality", Journal of Air Transport Management, Vol. 17, No. 2, 2011, pp. 57-61.
  39. Liu, B., "Sentiment analysis and opinion mining," Synthesis Lectures on Human Language Technologies, Vol.5, No.1, 2012, pp. 1-167. https://doi.org/10.1007/978-3-031-02145-9
  40. Lucini, F. R., L. M. Tonetto, F. S. Fogliatto, and M. J. Anzanello, "Text mining approach to explore dimensions of airline customer satisfaction using online customer reviews", Journal of Air Transport Management, Vol.83, 2020, pp. 101760.
  41. Mudambi, S. M. and D. Schuff, "What makes a helpful review? A study of customer reviews on amazon.com", MIS Quarterly, Vol.34, No.1, 2010, pp. 185-200. https://doi.org/10.2307/20721420
  42. Nadiri, H., K. Hussain, E. H. Ekiz, and S. Erdogan, "An investigation on the factors influencing passengers' loyalty in the North Cyprus national airline", The TQM Journal, Vol.20, No.3, 2008, pp. 265-280. https://doi.org/10.1108/17542730810867272
  43. Nakayama, M. and Y. Wan, "The cultural impact on social commerce: A sentiment analysis on Yelp ethnic restaurant reviews", Information & Management, Vol.56, No.2, 2019, pp. 271-279.
  44. O'Connor, P., "Managing a hotel's image on TripAdvisor", Journal of Hospitality Marketing & Management, Vol.19, No.7, 2010, pp. 754-772. https://doi.org/10.1080/19368623.2010.508007
  45. Pakdil, F. and O. Aydin, "Expectations and perceptions in airline services: An analysis using weighted SERVQUAL scores", Journal of Air Transport Management, Vol.13, No.4, 2007, pp. 229-237.
  46. Parasuraman, A., V. A. Zeithaml, and L. L. Berry, "SERVQUAL: A multiple-item scale for measuring consumer perceptions of service quality", Journal of Retailing, Vol.64, No.1, 1988, pp. 12-40.
  47. Park, E., Y. Jang, J. Kim, N. J. Jeong, K. Bae, and A. P. del Pobil, "Determinants of customer satisfaction with airline services: An analysis of customer feedback big data", Journal of Retailing and Consumer Services, Vol.51, 2019, pp. 186-190. https://doi.org/10.1016/j.jretconser.2019.06.009
  48. Park, J. W., "Passenger perceptions of service quality: Korean and Australian case studies", Journal of Air Transport Management, Vol.13, No.4, 2007, pp. 238-242. https://doi.org/10.1016/j.jairtraman.2007.04.002
  49. Park, S., J. S. Lee, and J. L. Nicolau, "Understanding the dynamics of the quality of airline service attributes: Satisfiers and dissatisfiers", Tourism Management, Vol.81, 2020, Article 104163.
  50. Park, S., J. S. Lee, and J. L. Nicolau, "Understanding the dynamics of the quality of airline service attributes: Satisfiers and dissatisfiers", Tourism Management, Vol.81, 2020, pp. 104-163.
  51. Parshall, C. G., P. D. B. Houghton, and J. D. Kromrey, "Equating error and statistical bias in small sample linear equating", Journal of Educational Measurement, Vol.32, No.1, 1995, pp. 37-54. https://doi.org/10.1111/j.1745-3984.1995.tb00455.x
  52. Percin, S., "Evaluating airline service quality using a combined fuzzy decision-making approach", Journal of Air Transport Management, Vol.68, 2018, pp. 48-60. https://doi.org/10.1016/j.jairtraman.2017.07.004
  53. Ranard, B. L., R. M. Werner, T. Antanavicius, H. A. Schwartz, R. J. Smith, F. Meisel, D. A. Asch, H. Ungar, and R. M. Merchant", Yelp reviews of hospital care can supplement and inform traditional surveys of the patient experience of care", Health Affairs, Vol.35, No.4, 2016, pp. 697-705. https://doi.org/10.1377/hlthaff.2015.1030
  54. Riantama, D., A. Tsai, S. Lin, and H. Lin, "Evaluating airline passengers' satisfaction during the COVID-19 pandemic: A text mining approach", Proceeding of the International Conference of Information Communication Technologies Enhanced Social Sciences and Humanities, 2021, https://doi.org/10.21428/7a45813f.d5497ab0.
  55. Salehan, M. and D. J. Kim, "Predicting the performance of online consumer reviews: A sentiment mining approach to big data analytics", Decision Support Systems, Vol.81, 2016, pp. 30-40. https://doi.org/10.1016/j.dss.2015.10.006
  56. Saputro, B., A. N. Hidayanto, Z. Abidin, and N. Paoprasert, "Measuring service quality in the telecommunications industry from customer reviews using sentiment analysis: A case study in PT XL Axiata", International Journal of Innovation and Learning, Vol.30, No.2, 2021, pp. 188-200. https://doi.org/10.1504/IJIL.2021.117224
  57. Sezgen, E., K. J. Mason, and R. Mayer, "Voice of airline passenger: A text mining approach to understand customer satisfaction", Journal of Air Transport Management, Vol.77, 2019, pp.65-74.
  58. Shan, G., D., Zhang, L. Zhou, L. Suo, J. Lim, and C. Shi, "Inconsistency investigation between online review content and ratings", Proceedings of the Americas Conference on Information Systems, 2018, https://aisel.aisnet.org/amcis2018/eBusiness/Presentations/23/.
  59. Stamolampros, P., N. Korfiatis, P. Kourouthanassis, and E. Symitsi, "Flying to quality: Cultural influences on online reviews", Journal of Travel Research, Vol.58, No.3, 2019, pp. 496-511.
  60. Statista, Annual growth in global air traffic passenger demand from 2006 to 2022, 2021, https://www.statista.com/statistics/193533/growth-of-global-airtraffic-passenger-demand/.
  61. Suki, N. M., "Passenger satisfaction with airline service quality in Malaysia: A structural equation modeling approach", Research in Transportation Business & Management, Vol.10, 2014, pp. 26-32. https://doi.org/10.1016/j.rtbm.2014.04.001
  62. Sukwadi, R., A. Susanto, and Y.C. Liang, "Airline service quality evaluation for Indonesian low-cost carriers based on Extenics innovation theory", Archives of Transport, Vol.58, No.2, 2021, pp. 7-20. https://doi.org/10.5604/01.3001.0014.8794
  63. Thompson, P., G. DeSouza, and B. T. Gale, "The strategic management of service quality", Quality Progress, Vol.18, No.6, 1985, pp. 20-25.
  64. Tian, X., W. He, C. Tang, L. Li, H. Xu, and D. Selover, "A new approach of social media analytics to predict service quality: Evidence from the airline industry", Journal of Enterprise Information Management, Vol.33, No.1, 2020, pp. 51-70.
  65. Tirunillai, S. and G. J. Tellis, "Mining marketing meaning from online chatter: Strategic brand analysis of big data using Latent Dirichlet Allocation", Journal of Marketing Research, Vol.51, No.4, 2014, pp. 463-479. https://doi.org/10.1509/jmr.12.0106
  66. Treisman, A.M., "Strategies and models of selective attention", Psychological Review, Vol.76, No.3, 1969, pp. 282-299. https://doi.org/10.1037/h0027242
  67. Tsaur, S. H., T. Y. Chang, and C. H. Yen, "The evaluation of airline service quality by fuzzy MCDM", Tourism Management, Vol.23, No.2, 2002, pp. 107-115. https://doi.org/10.1016/S0261-5177(01)00050-4
  68. Wang, C. Y. and Y. Wei, "Social media peer communication and impacts on Purchase intentions: A consumer socialization framework", Journal of Interactive Marketing, Vol.26, pp. 198-208.
  69. White, H., "A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity", Econometrica, Vol.48, No.4, 1980, pp. 817-838. https://doi.org/10.2307/1912934
  70. Wu, H. C. and C. C. Cheng, "A hierarchical model of service quality in the airline industry", Journal of Hospitality and Tourism Management, Vol.20, 2013, pp. 13-22.
  71. Xiang, Z., Q. Du, Y. Ma, and W. Fan, "A comparative analysis of major online review platforms: Implications for social media analytics in hospitality and tourism", Tourism Management, Vol. 58, 2017, pp. 51-65. https://doi.org/10.1016/j.tourman.2016.10.001
  72. Yang, Z., R. T. Peterson, and S. Cai, "Services quality dimensions of Internet retailing: An exploratory analysis", Journal of Services Marketing, Vol.17, No.7, 2003, pp. 685-700. https://doi.org/10.1108/08876040310501241
  73. Zappavigna, M., "Searchable talk: The linguistic functions of hashtags", Social Semiotics, Vol.25, No.3, 2015, pp. 274-291. https://doi.org/10.1080/10350330.2014.996948
  74. Zhu, X. and A. B. Goldberg, "Introduction to semi-supervised learning", Synthesis Lectures on Artificial Intelligence and Machine Learning, Vol.3, No.1, 2009, pp. 1-130.
  75. Zhou, Y., S. Yang, Y. Li, Y. Chen, J. Yao, and A. Qazi, "Does the review deserve more helpfulness when its title resembles the content? Locating helpful reviews by text mining", Information Processing & Management, Vol.57, No.2, 2020, Article 102179.