Browse > Article
http://dx.doi.org/10.9716/KITS.2016.15.3.071

R&D Perspective Social Issue Packaging using Text Analysis  

Wong, William Xiu Shun (Graduate School of Business Information Technology, Kookmin University)
Kim, Namgyu (School of MIS, Kookmin University)
Publication Information
Journal of Information Technology Services / v.15, no.3, 2016 , pp. 71-95 More about this Journal
Abstract
In recent years, text mining has been used to extract meaningful insights from the large volume of unstructured text data sets of various domains. As one of the most representative text mining applications, topic modeling has been widely used to extract main topics in the form of a set of keywords extracted from a large collection of documents. In general, topic modeling is performed according to the weighted frequency of words in a document corpus. However, general topic modeling cannot discover the relation between documents if the documents share only a few terms, although the documents are in fact strongly related from a particular perspective. For instance, a document about "sexual offense" and another document about "silver industry for aged persons" might not be classified into the same topic because they may not share many key terms. However, these two documents can be strongly related from the R&D perspective because some technologies, such as "RF Tag," "CCTV," and "Heart Rate Sensor," are core components of both "sexual offense" and "silver industry." Thus, in this study, we attempted to discover the differences between the results of general topic modeling and R&D perspective topic modeling. Furthermore, we package social issues from the R&D perspective and present a prototype system, which provides a package of news articles for each R&D issue. Finally, we analyze the quality of R&D perspective topic modeling and provide the results of inter- and intra-topic analysis.
Keywords
Big Data; Data Mining; Text Mining; Topic Modeling;
Citations & Related Records
Times Cited By KSCI : 5  (Citation Analysis)
연도 인용수 순위
1 Aggarwal, C.C. and C. Zhai, "A Survey of Text Clustering Algorithms", Mining Text Data, Springer, US, 2012, 77-128.
2 Agrawal, R. and M. Batra, "A Detailed Study on Text Mining Techniques", International Journal of Soft Computing and Engineering, Vol.2, 2013, 2231-2307.
3 Aizawa, A., "An Information-Theoretic Perspective of TF-IDF Measures", Information Processing and Management, Vol.39, No.1, 2003, 45-65.   DOI
4 Albright, R., "Taming Text with the SVD", SAS Institute Inc., 2004.
5 Bae, J., J. Shon, and M. Song, "Analysis of Twitter for 2012 South Korea Presidential Election by Text Mining Techniques", Journal of Information Technology Applications and Management, Vol.19, Vol.3, 2013, 141-156. (배정환, 손지은, 송 민, "텍스트 마이닝을 이용한 2012년 한국대선 관련 트위터 분석", 지능정보연구, 제19권, 제3호, 2013, 141-156.)
6 Barbakh, W.A., Y. Wu, and C. Fyfe, Non-Standard Parameter Adaption for Exploratory Data Analysis, Springer, Berlin Heidelberg, 2009, 1-6.
7 Blei, D.M., A.Y. Ng, and M.I. Jordan, "Latent Dirichlet Allocation", Journal of Machine Learning Research, Vol.3, 2003, Chicago, 993-1022.
8 Cai, D., X. He, and J. Han, "Locally Consistent Concept Factorization for Document Clustering", IEEE Transactions on Knowledge and Data Engineering, Vol.23, No.6, 2011, 902-913.   DOI
9 Carnerud, D., "Exploration of Text Mining Methodology through Investigation of QMODICQSS Proceedings", in QMOD-ICQSS Prague, Czech Republic, Sep, 3-5, 2014.
10 Fan, W., W. Wallace, S. Rich, and Z. Zhang, "Tapping the Power of Text Mining", Communications of the ACM, Vol.49, No.9, 2006, 76-82.
11 Feldman, R. and J. Sanger, The Text Mining Handbook : Advanced Approaches in Analyzing Unstructured Data, Cambridge University Press, 2007.
12 Griffiths, T.L. and M. Steyvers, "Finding Scientific Topics", Proceedings of the National Academy of Sciences, 2004, 5228-5235.
13 Han, J., M. Kamber, and J. Pei, Data Mining : Concepts and Techniques, 3rd Edition, Morgan Kaufmann Publishers, 2011.
14 Hearst, M.A., "Untangling Text Data Mining", Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics on Computational Linguistics, 1999, 3-10.
15 Hofmann, T., "Unsupervised Learning by Probabilistic Latent Semantic Analysis", Machine Learning, Vol.42, No.1-2, 2001, 177-196.   DOI
16 Holton, C., "Identifying Disgruntled Employee Systems Fraud Risk through Text Mining : A Simple Solution for a Multi-Billion Dollar Problem", Decision Support Systems, Vol.46, No.4, 2009, 853-864.   DOI
17 Hong, D.S. and H.G. Kim, "From Big Data to Business Value : Emerging Technology Extraction and Analysis System Based on Korean Newspapers", Journal of the Korea Entertainment Industry Association, Vol.8, No.4, 2014, 285-292.   DOI
18 Hyun, Y.J, H.J. Han, H.S. Choi, J.Y. Park, K.H. Lee, K.Y. Kwahk, and N.G. Kim, "Methodology using Text Analysis for Packaging R&D Information Services on Pending National Issues", Journal of Information Technology Applications and Management, Vol.20, 2013, 231-257. (현윤진, 한희준, 최희석, 박준형, 이규하, 곽기영, 김남규, "텍스트 분석을 활용한 국가 현안 대응 R&D 정보 패키징 방법론", 한국정보기술응용학회, 제20권, 제3호, 2013, 231-257.)
19 Jain, A.K., M.N. Murty, and P.J. Flynn, "Data Clustering : A Review", ACM Computing Surveys, Vol.31, No.3, 1999, 264-323.   DOI
20 Kim, I., "The Value of Big Data and Strategy", 2012 Big Data Search Analysis Technology Insight, 2012.
21 Lu, Y., Q. Mei, and C. Zhai, "Investigating Task Performance of Probabilistic Topic Models : An Empirical Study of PLSA and LDA", Information Retrieval, Vol.14, No.2, 2011, 178-203.   DOI
22 Kim, J.E., N.G. Kim, and Y.H. Cho, "User-Perspective Issue Clustering Using Multi-layered Two-Mode Network Analysis", Journal of Interlligence and Information Systems, Vol. 20, No.2, 2014, 93-107. (김지은, 김남규, 조윤호, "다계층 이원 네트워크를 활용한 사용자 관점의 이슈 클러스터링", 지능정보연구, Vol.20, 2014, 93-107.)
23 Liebowitz, J., Business Analytics : An Introduction, CRC Press, 2013.
24 Liu, B., Sentiment Analysis and Opinion Mining, Morgan and Claypool Publishers, 2012.
25 Macnamara, J.R., "Media Content Analysis : Its Uses, Benefits and Best Practice Methodology", Asia Pacific Public Relations Journal, Vol.6, No.1, 2003, 1-34.
26 Meyer, D., K. Hornik, and I. Feinerer, "Text Mining Infrastructure in R", Journal of Statistical Software, Vol.25, No.5, 2008, 1-54.
27 Mooney, R.J. and R. Bunescu, "Mining Knowledge from Text using Information Extraction", ACM SIGKDD Exploration, Vol.7, No.1, 2005, 3-10.
28 Myung, J.S., D.J. Lee, and S.G. Lee, "A Korean Product Review Analysis System using A Semi-Automatically Constructed Semantic Dictionary", Journal of KIISE : Software and Applications, Vol.35, No.6, 2008, 347-405. (명재석, 이동주, 이상구, "반자동으로 구축된 의미 사전을 이용한 한국어 상품평 분석 시스템", 정보과학회논문지 : 스프트웨어 및 응용, 제35권, 제6호, 2008, 347-405.)
29 Nagaraj, R., V. Thiagarasu, and P. Vijayakumar, "A Novel Semantic Level Text Classification by Combining NLP and Thesaurus Concepts", IOSR Journal of Computer Engineering, Vol.16, No.4, 2014, 14-26.   DOI
30 Newman, D.J. and S. Block, "Probabilistic Topic Decomposition of an Eighteenth? Century American Newspaper", Journal of the American Society for Information Science and Technology, Vol.57, No.6, 2006, 753-767.   DOI
31 Sebastiani, F., "Classification of Text, Automatic", The Encyclopedia of Language and Linguistics, (ed.2), Vol.14, Elsevier Science Pub, 2006.
32 Ng, A.Y., M.I. Jordan, and Y. Weiss, "On Spectral Clustering : Analysis and an Algorithm", Advances in Neural Information Processing Systems, Vol.2, 2002, 849-856.
33 Provost, F. and T. Fawcett, Data Science for Business, O'Reilly Media, 2013.
34 Romero, C., S. Ventura, and E. Garcia, "Data Mining in Course Management Systems : Moodle Case Study and Tutorial", Computer and Education, Vol.51, No.1, 2008, 368-384.   DOI
35 Stanvrianou, A., P. Andritsos, and N. Nicoloyannis, "Overview and Semantic Issues of Text Mining", ACM SIGMOD Record, Vol.36, No.3, 2007, 23-24.   DOI
36 Sun, Y., "A Text Mining Approach to Analyze Public Media Science Coverage and Public Interest in Science", International Journal of Machine Learning and Computing, Vol.4, No.6, 2014, 496.   DOI
37 Tseng, Y.H., C.J. Lin, and Y.I. Lin, "Text Mining Techniques for Patent Analysis", Information Processing and Management, Vol.43, No.5, 2007, 1216-1247.   DOI
38 Wang, M.Y., D.S. Chang, and C.H. Kao, "Identifying Technology Trends for R&D Planning using TRIZ and Text Mining", R&D Management, Vol.40, No.5, 2010, 491-509.   DOI
39 Wang, H. and Y. Ohsawa, "Innovation Support System for Creative Product Design Based on Chance Discovery", Expert Systems with Applications, Vol.39, No.5, 2012, 4890-4897.   DOI
40 Weiss, S.M., N. Indurkhya, and T. Zhang, Fundamentals of Predictive Text Mining, Springer, London, 2012.
41 Wong, W.X.S. and N. Kim, "Reorganizing Social Issues from R&D Perspective Using Social Network Analysis", Journal of Information Technology Application and Management, Vol.22, No.3, 2015, 83-103.   DOI
42 Yoon, J., "Detecting Weak Signals for Long-Term Business Opportunities Using Text Mining of Web News", Expert Systems with Applications, Vol.39, No.16, 2012, 12543-12550.   DOI
43 Xie, P. and E.P. Xing, "Integrating Document Clustering and Topic Modeling", arXiv preprint arXiv : 1309.6874, 2013.
44 Xu, W. and Y. Gong, "Document Clustering by Concept Factorization", Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2004, 202-209.
45 Xu, W., X. Liu, and Y. Gong, "Document Clustering Based on Non-Negative Matrix Factorization", Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2003, 267-273.