Browse > Article
http://dx.doi.org/10.30693/SMJ.2021.10.2.76

A Study on Classification of Mobile Application Reviews Using Deep Learning  

Son, Jae Ik (계명대학교 경영정보학과)
Noh, Mi Jin (계명대학교 경영정보학과)
Rahman, Tazizur (계명대학교 경영정보학과)
Pyo, Gyujin (계명대학교 경영정보학과)
Han, Mumoungcho (동국대학교 경주캠퍼스 파라마타칼리지 디지털기초교육부)
Kim, Yang Sok (계명대학교 경영정보학과)
Publication Information
Smart Media Journal / v.10, no.2, 2021 , pp. 76-83 More about this Journal
Abstract
With the development and use of smart devices such as smartphones and tablets increases, the mobile application market based on mobile devices is growing rapidly. Mobile application users write reviews to share their experience in using the application, which can identify consumers' various needs and application developers can receive useful feedback on improving the application through reviews written by consumers. However, there is a need to come up with measures to minimize the amount of time and expense that consumers have to pay to manually analyze the large amount of reviews they leave. In this work, we propose to collect delivery application user reviews from Google PlayStore and then use machine learning and deep learning techniques to classify them into four categories like application feature advantages, disadvantages, feature improvement requests and bug report. In the case of the performance of the Hugging Face's pretrained BERT-based Transformer model, the f1 score values for the above four categories were 0.93, 0.51, 0.76, and 0.83, respectively, showing superior performance than LSTM and GRU.
Keywords
Mobile Delivery Application; User review classification; User Reviews Taxonomy;
Citations & Related Records
연도 인용수 순위
  • Reference
1 황상흠, 김도현, "한국어 기술문서 분석을 위한 BERT 기반의 분류모델," 한국전자거래학회지, 제25권, 제1호, 203-214쪽, 2020년 2월   DOI
2 이현영, 강승식, "Out-of-Vocabulary 단어에 강건한 병렬 Tri-LSTM 문장 임베딩을 이용한 감정분석," 스마트미디어저널, 제10권, 제1호, 16-24쪽, 2021년 3월
3 D. Pagano, W. Maalej, "User feedback in the appstore: An empirical study," 2013 21st IEEE International, In Requirements Engineering Conference (RE), pp. 125-134, Rio de Janeiro, Brazil, Jul. 2013.
4 조미나, "모바일 음식 배달앱 서비스 품질 척도 개발 및 배달앱 품질 개선을 위한 SERVQUAL-Kano 통합 모델의 QFD 적용," 관광학연구, 제44권, 제4호, 103-121쪽, 2020년 6월
5 W. Maalej, H. Nabil, "Bug report, feature request, or simply praise? on automatically classifying app reviews," 2015 IEEE 23rd international requirements engineering conference (RE). pp. 116-125, Ottawa, Canada, Aug. 2015.
6 Jenq-Haur Wang, Ting-Wei Liu, Xiong Luo, Long Wang, "An LSTM approach to short text sentiment classification with word embeddings," Proceedings of the 30th conference on computational linguistics and speech processing, pp. 214-223, Hsinchu, Taiwan, Oct. 2018.
7 임명진, 박원호, 신주현, "Word2vec과 LSTM을 활용한 이별 가사 감정 분류," 스마트미디어저널, 제9권, 제3호, 90-97쪽, 2020년 9월   DOI
8 Huggingface bert(2021). https://github.com/huggingface (accessed Apr., 10, 2021).
9 Supot Tiarawut, "Mobile technology: Opportunity for entrepreneurship," Wireless personal communications, Vol. 69, No. 3, pp. 1025-1031, Apr. 2013.   DOI
10 App Annie, "App Annie State of Mobile 2020 Report," https://www.appannie.com/kr/go/state-of-mobile-2020/(accessed Mar., 15, 2021).
11 Y. Lu, L. Zhang ,B. Wang, "A multidimensional and hierarchical model of mobile service quality," Electronic Commerce Research and Applications, Vol. 8, Issue 5, pp. 228-240, Oct. 2009.   DOI
12 C. Iacob, R. Harrison, "Retrieving and analyzing mobile apps feature requests from online reviews," Proceedings of the 10th Working Conference on Mining Software Repositories, Vol. 1, pp. 41-44, San Francisco, USA, May 2013.
13 N. Chen, J. Lin, S.C.H. Hoi, X. Xiao, B. Zhang, "Ar-miner: mining informative reviews for developers from mobile app marketplace," Proceedings of the 36th International Conference on Software Engineering, pp. 767-778, Hyderabad, India, May-Jun. 2014.
14 E. Guzman, M. El-Haliby, B. Bruegge, "Ensemble methods for app review classification: An approach for software evolution (n)," Proceedings of the 30th IEEE/ACM International Conference on Automated Software Engineering, pp. 771-776, Lincoln, USA, Nov. 2015.
15 W. Zhang, T. Yoshida, X. Tang, "Text classification based on multi-word with support vector machine," Knowledge-Based Systems, Vol. 21, No. 8, pp. 879-886, 2008.   DOI
16 김유희, "딥러닝 기반 기사단위 및 문단 단위별 분류," 한국컴퓨터정보학회논문지, 제23권, 제11호, 31-41쪽, 2018년 11월
17 김은희, 임명진, 신주현, "ELMo 임베딩 기반 문장 중요도를 고려한 중심 문장 추출방법," 스마트미디어저널, 제10권, 제1호, 39-46쪽, 2021년 3월
18 김희상, 주기훈, 임현승, "단어 임베딩과 GRU를 활용한 상품 범주 분류," 한국정보기술학회논문지, 제19권, 제4호, 11-18쪽, 2021년 4월
19 장은아, 최회련, 이홍철, "BERT 를 활용한 뉴스 감성분석과 거시경제지표 조합을 이용한 주가지수 예측," 한국컴퓨터정보학회논문지, 제25권, 제5호, 47-56쪽, 2020년 5월