Browse > Article
http://dx.doi.org/10.3743/KOSIM.2018.35.1.231

A Study on the Deduction of Social Issues Applying Word Embedding: With an Empasis on News Articles related to the Disables  

Choi, Garam (경기대학교 일반대학원 문헌정보학과)
Choi, Sung-Pil (경기대학교 문헌정보학과)
Publication Information
Journal of the Korean Society for information Management / v.35, no.1, 2018 , pp. 231-250 More about this Journal
Abstract
In this paper, we propose a new methodology for extracting and formalizing subjective topics at a specific time using a set of keywords extracted automatically from online news articles. To do this, we first extracted a set of keywords by applying TF-IDF methods selected by a series of comparative experiments on various statistical weighting schemes that can measure the importance of individual words in a large set of texts. In order to effectively calculate the semantic relation between extracted keywords, a set of word embedding vectors was constructed by using about 1,000,000 news articles collected separately. Individual keywords extracted were quantified in the form of numerical vectors and clustered by K-means algorithm. As a result of qualitative in-depth analysis of each keyword cluster finally obtained, we witnessed that most of the clusters were evaluated as appropriate topics with sufficient semantic concentration for us to easily assign labels to them.
Keywords
keyword extraction; clustering; topic modeling; word embedding; TF-IDF;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 김성진, 김건우, 이동호 (2017). 딥러닝 기반의 뉴스 분석을 활용한 주제별 최신 연관단어 추출 기법. 한국정보처리학회 2017년 춘계학술발표대회 논문집, 873-876. Kim, Sung-Jin, Kim, Gun-Woo, & Lee, Dong-Ho (2017). A topic related word extraction method using deep learning based news analysis. The Journal of Korea information Processing Society, 873-876.
2 김우생, 김수영 (2014). 주성분 분석과 k 평균 알고리즘을 이용한 문서군집 방법. 한국정보통신학회논문지, 18(3), 625-630. http://dx.doi.org/10.6109/jkiice.2014.18.3.625 Kim, Woosaeng, & Kim, Sooyoung (2014). Document clustering technique by k-means algorithm and PCA. Journal of the Korea Institute of Information and Communication Engineering, 18(3), 625-630. http://dx.doi.org/10.6109/jkiice.2014.18.3.625   DOI
3 김일환, 이도길 (2011). 대규모 신문 기사의 자동 키워드 추출과 분석. 한국어학, 53, 145-194. Kim, Illhwan, & Lee, Do-Gill (2011). Automatic keyword extraction and analysis from the large scale newspaper corpus based on t-score. Korean Linguistics, 53, 145-194.
4 신동혁, 안광규, 최성춘, 최형기 (2016). K-평균 클러스터링을 이용한 네트워크 유해트래픽 탐지. 한국통신학회논문지, 41(2), 277-284. http://dx.doi.org/10.7840/kics.2016.41.2.277 Shin, Dong Hyuk, An, Kwang Kue, Choi, Sung Chune, & Choi, Hyoung-Kee (2016). Malicious traffic detection using k-means. The Journal of Korean Institute of Communications and Information Sciences, 41(2), 277-284. http://dx.doi.org/10.7840/kics.2016.41.2.277   DOI
5 안희정, 최건희, 김승훈 (2015). 키워드 가중치 방식에 근거한 도서 본문 주제어 추출. 한국컴퓨터정보학회 학술발표논문집, 23(1), 19-22. Ahn, Hee-Jeong, Choi, Gun-Hee, & Kim, Seung-Hoon (2015). Thematic word extraction from book based on keyword weighting method. The Journal of Korean Society of Computer and Information, 23(1), 19-22.
6 이성직, 김한준 (2009). TF-IDF 의 변형을 이용한 전자뉴스에서의 키워드 추출 기법. 한국전자거래학회지, 14(4), 59-73. Lee, Sung-Jick, & Kim, Han-Joon (2009). Keyword extraction from news corpus using modified TF-IDF. The Journal of Society for e-Business Studies, 14(4): 59-73.
7 정다미, 김재석, 김기남, 허종욱, 온병원, 강미정 (2013). 사회문제 해결형 기술수요 발굴을 위한 키워드 추출 시스템 제안. 지능정보연구, 19(3), 1-23. http://dx.doi.org/10.13088/jiis.2013.19.3.001 Jeong, Dami, Kim, Jaeseok, Kim, Gi-nam, Heo, Jong-Uk, On, Byung-Won, & Kang, Mijung (2013). A proposal of a keyword extraction system for detecting social issues. Journal of Intelligence and Information Systems, 19(3), 1-23. http://dx.doi.org/10.13088/jiis.2013.19.3.001   DOI
8 조태민, 이지형 (2015). LDA 모델을 이용한 잠재 키워드 추출. 한국지능시스템학회 논문지, 25(2), 180-185. http://dx.doi.org/10.5391/JKIIS.2015.25.2.180 Cho, Taemin, & Lee, Jee-Hyong (2015). Latent keyphrase extraction using LDA model. Journal of Korean Institute of Intelligent Systems, 25(2), 180-185. http://dx.doi.org/10.5391/JKIIS.2015.25.2.180
9 한국정보화진흥원 (2015). 2015 정보격차 실태조사. 서울: 미래창조과학부. National Information Society Agency (2015). 2015 The report on the digital divide. Seoul: Ministry of Science, ICT and Future Planning.
10 Beliga, S., Mestrovic, A., & Martincic-Ipsic, S. (2015). An overview of graph-based keyword extraction methods and approaches. Journal of Information and Organizational Sciences, 39(1), 1-20.
11 Blei, D. M. (2012). Probabilistic topic models. Communications of the ACM, 55(4), 77-84. http://dx.doi.org/10.1145/2133806.2133826   DOI
12 Rong, X. (2014). Word2vec parameter learning explained. arXiv preprint arXiv:1411.2738.
13 KoNLPy. Retrieved from http://konlpy.org/en/v0.4.4/
14 Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013). Efficient estimation of word representations in vector space. International Conference on Learning Representation 2013.
15 Mikolov, T., Yih, W. T., & Zweig, G. (2013). Linguistic regularities in continuous space word representations. NAACL-HLT, 746-751.
16 Sklearn.cluster.KMeans. Retrieved from http://scikit-learn.org/stable/modules/generated/sklearn.cluster.KMeans.html#sklearn.cluster.KMeans
17 Tensorflow Motivation: Why learn word embeddings? (2018). Retrieved from https://www.tensorflow.org/tutorials/word2vec
18 Word2vec. Retrieved from https://code.google.com/archive/p/word2vec/
19 Harris, Z. S. (1954). Distributional structure. Word, 10(2-3), 146-162. http://dx.doi.org/10.1080/00437956.1954.11659520   DOI