KIPS Transactions on Software and Data Engineering (정보처리학회논문지:소프트웨어 및 데이터공학)

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Retrieving Minority Product Reviews Using Positive/Negative Skewness

긍정/부정 비대칭도를 이용한 소수상품평의 검색

  • 조희련 (충북대학교 경영정보학과 BK21플러스 사업팀) ;
  • 이종석 (연세대학교 글로벌융합공학부)
  • Received : 2014.08.04
  • Accepted : 2014.12.14
  • Published : 2015.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

A given product's online product reviews build up to form largely positive or negative reviews or mixed reviews that include both the positive and negative reviews. While the homogeneously positive or negative reviews help readers identify the generally praised or criticized product, the mixed reviews with minority opinions potentially contain valuable information about the product. We present a method of retrieving minority opinions from the online product reviews using the skewness of positive/negative reviews. The proposed method first classifies the positive/negative product reviews using a sentiment dictionary and then calculates the skewness of the classified results to identify minority reviews. Minority review retrieval experiments were conducted on smartphone and movie reviews, and the F1-measures were 24.6% (smartphone) and 15.9% (movie) and the accuracies were 56.8% and 46.8% when the individual reviews' sentiment classification accuracies were 85.3% and 78.8%. The theoretical performance of minority review retrieval is also discussed.

소수 의견을 포함하는 온라인 상품평은 긍정 또는 부정 일변도인 상품평에서는 찾기 어려운 유익한 정보를 내포하기도 한다. 본 논문에서는 주어진 상품평 집합 속에서 소수상품평을 검색하는 방법을 제안한다. 제안방법은 개별 상품평을 먼저 긍정/부정 상품평으로 자동분류한 뒤, 주어진 상품평 집합의 긍정/부정 상품평의 비대칭도를 계산하여 소수상품평을 검색한다. 소수상품평 검색에서는 긍정/부정 자동분류 성능이 소수상품평 검색성능에 영향을 주는데, 본 논문에서는 도메인에 특화된 감성사전과 그렇지 않은 일반적인 감성사전을 가지고 상품평을 긍정/부정으로 감성분류한 뒤 비대칭도를 계산하여 소수상품평 검색성능을 비교한다. 스마트폰과 영화를 다룬 온라인 영문 상품평에 대하여 도메인에 특화된 감성사전을 가지고 소수상품평 검색성능을 평가한 결과, F1점수는 각각 24.6%와 15.9%였고, 정확도는 각각 56.8%와 46.8%였다. 이는 스마트폰과 영화의 개별 상품평 긍정/부정 분류 정확도가 각각 85.3%와 78.8%일 때의 성능이다. 본 논문에서는 또 긍정/부정 자동분류 성능이 주어졌을 때의 이론적인 소수상품평 검색성능에 대해서도 논의한다.

Keywords

References

  1. S. M. Mudambi, D. Schuff, "What makes a helpful online review? A study of customer reviews on Amazon.com," MIS Quarterly, Vol.34, No.1, pp.185-200, 2010.
  2. Z. Zhang, B. Varadarajan, "Utility scoring of product reviews," in Proceedings of the 15th ACM International Conference on Information and Knowledge Management, New York, pp. 51-57, 2006.
  3. B. Pang, L. Lee, "Opinion mining and sentiment analysis," Foundations and Trends in Information Retrieval, Vol.2, No.1-2, pp.1-135, 2008. https://doi.org/10.1561/1500000011
  4. H. Cho, S. Kim, J. Lee, and J.-S. Lee, "Data-driven integration of multiple sentiment dictionaries for lexicon-based sentiment classification of product reviews," Knowledge-Based Systems, Vol.71, pp.61-71, 2014. https://doi.org/10.1016/j.knosys.2014.06.001
  5. D. P. Doane, L. E. Seward, "Measuring skewness: A forgotten statistic?," Journal of Statistics Education, Vol.19, No.2, pp.1-18, 2011. (See p.6, equation [1a].)
  6. M. G. Bulmer, Principles of Statistics, Dover, 1979.
  7. F. A. Nielsen, "A new ANEW: Evaluation of a word list for sentiment analysis in microblogs," in Proceedings of ESWC Workshop Making Sense of Microposts, 2011.
  8. M. Bradley, P. Lang, "Affective Norms for English Words (ANEW): Instruction manual and affective ratings," Technical Report C-1, The Center for Research in Psychophysiology, University of Florida, 1999.
  9. P. J. Stone, E. B. Hunt, "A computer approach to content analysis: Studies using the General Inquirer system," in Proceedings of Spring Joint Computer Conference of American Federation of Information Processing Societies, 1963.
  10. S. Cerini, V. Compagnoni, A. Demontis, M. Formentelli, and C. Gandini, "Micro-WNOp: a gold standard for the evaluation of automatically compiled lexical resources for opinion mining," in Language Resources and Linguistic Theory, Franco Angeli, pp.200-210, 2007.
  11. M. Hu, B. Liu, "Mining and summarizing customer reviews," in Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2004, pp.168-177.
  12. E. Cambria, C. Havasi, and A. Hussain, "SenticNet 2: A semantic and affective resource for opinion mining and sentiment analysis," in Proceedings of the International Conference on Florida Artificial Intelligence Research Society, pp.202-207, 2012.
  13. J. C. de Albornoz, L. Plaza, and P. Gervas, "SentiSense: Aneasily scalable concept-based affective lexicon for sentiment analysis," in Proceedings of the 8th International Conference on Language Resources and Evaluation, pp.3562-3567, 2012.
  14. S. Baccianella, A. Esuli, and F. Sebastiani, "SentiWordNet 3.0: An enhanced lexical resource for sentiment analysis and opinion mining," in Proceedings of the 7th International Conference on Language Resources and Evaluation, pp.2200-2204, 2010.
  15. E. Riloff, J. Wiebe, "Learning extraction patterns for subjective expressions," in Proceedings of the 2003 Conference on Empirical Methods in Natural Language Processing, pp.105-112, 2003.
  16. C. Strapparava, A. Valitutti, "WordNet-Affect: An affective extension of WordNet," in Proceedings of the 4th International Conference on Language Resources and Evaluation, pp.1083-1086, 2004.
  17. C. D. Manning, P. Raghavan, and H. Schutze, Introduction to Information Retrieval, Cambridge University Press, 2008.