• Title/Summary/Keyword: Text Mining for Korean

Search Result 638, Processing Time 0.027 seconds

Analysis of trend in construction using textmining method (텍스트마이닝을 활용한 건설분야 트랜드 분석)

  • Jeong, Cheol-Woo;Kim, Jae-Jun
    • Journal of The Korean Digital Architecture Interior Association
    • /
    • v.12 no.2
    • /
    • pp.53-60
    • /
    • 2012
  • In this paper, we present new methods for identifying keywords for foresight topics that utilize the internet and textmining techniques to draw objective and quantified information that support experts' qualitative opinions and evaluations in foresight. Furthermore, by applying this fabricated procedure, we have derived keywords to analyze priorities in architectural engineering. Not much difference between qualitative methods of experts and quantitative methods such as text mining has been observed from comparison between technologies derived via qualitative method from "The Science Technology Vision" (control group). Therefore, as a quantitative tool useful for drawing keywords for foresight, textmining can supplement quantitative analysis by experts. In addition, depending on the level and type of raw data, text mining can bring better results in deriving foresight keywords. For this reason, research activities accommodating Internet search results and the development of textmining methods for analyzing current trends are in demand.

Feature-selection algorithm based on genetic algorithms using unstructured data for attack mail identification (공격 메일 식별을 위한 비정형 데이터를 사용한 유전자 알고리즘 기반의 특징선택 알고리즘)

  • Hong, Sung-Sam;Kim, Dong-Wook;Han, Myung-Mook
    • Journal of Internet Computing and Services
    • /
    • v.20 no.1
    • /
    • pp.1-10
    • /
    • 2019
  • Since big-data text mining extracts many features and data, clustering and classification can result in high computational complexity and low reliability of the analysis results. In particular, a term document matrix obtained through text mining represents term-document features, but produces a sparse matrix. We designed an advanced genetic algorithm (GA) to extract features in text mining for detection model. Term frequency inverse document frequency (TF-IDF) is used to reflect the document-term relationships in feature extraction. Through a repetitive process, a predetermined number of features are selected. And, we used the sparsity score to improve the performance of detection model. If a spam mail data set has the high sparsity, detection model have low performance and is difficult to search the optimization detection model. In addition, we find a low sparsity model that have also high TF-IDF score by using s(F) where the numerator in fitness function. We also verified its performance by applying the proposed algorithm to text classification. As a result, we have found that our algorithm shows higher performance (speed and accuracy) in attack mail classification.

Exploring an Optimal Feature Selection Method for Effective Opinion Mining Tasks

  • Eo, Kyun Sun;Lee, Kun Chang
    • Journal of the Korea Society of Computer and Information
    • /
    • v.24 no.2
    • /
    • pp.171-177
    • /
    • 2019
  • This paper aims to find the most effective feature selection method for the sake of opinion mining tasks. Basically, opinion mining tasks belong to sentiment analysis, which is to categorize opinions of the online texts into positive and negative from a text mining point of view. By using the five product groups dataset such as apparel, books, DVDs, electronics, and kitchen, TF-IDF and Bag-of-Words(BOW) fare calculated to form the product review feature sets. Next, we applied the feature selection methods to see which method reveals most robust results. The results show that the stacking classifier based on those features out of applying Information Gain feature selection method yields best result.

Anti-aging herbal formulae in Dongeuibogam : Identification of candidates by text mining (『동의보감(東醫寶鑑)』에서 항노화 효능을 가진 복방(複方) 후보군의 선별에 대한 연구)

  • Pae, Seung-Bin;Yun, Byeong-Cheol;Baek, Jin-Ung
    • Journal of Korean Medical classics
    • /
    • v.28 no.4
    • /
    • pp.1-9
    • /
    • 2015
  • Objectives : The main aims of this study were to identify candidate anti-aging herbal formulae(CAHF) from Dongeuibogam. Methods : We analyzed the terms describing effect of 3,901 herbal formulae on Dongeuibogam and selected the terms describing the anti-aging effect of herbal formulae(TAEHF). Finally, we generated a list of CAHFs based on TAEHFs. Results & Conclusions : 1. We finally selected 162 TAEHFs on Dongeuibogam. 2. We finally selected 138 CAHFs on Dongeuibogam(15CAHFs for external use, 123CAHFs for internal use). 3. TAEHFs are classified into 9 types. 4. CAHFs are classified into 9 types.

IMPLEMENTATION OF SUBSEQUENCE MAPPING METHOD FOR SEQUENTIAL PATTERN MINING

  • Trang, Nguyen Thu;Lee, Bum-Ju;Lee, Heon-Gyu;Ryu, Keun-Ho
    • Proceedings of the KSRS Conference
    • /
    • v.2
    • /
    • pp.627-630
    • /
    • 2006
  • Sequential Pattern Mining is the mining approach which addresses the problem of discovering the existent maximal frequent sequences in a given databases. In the daily and scientific life, sequential data are available and used everywhere based on their representative forms as text, weather data, satellite data streams, business transactions, telecommunications records, experimental runs, DNA sequences, histories of medical records, etc. Discovering sequential patterns can assist user or scientist on predicting coming activities, interpreting recurring phenomena or extracting similarities. For the sake of that purpose, the core of sequential pattern mining is finding the frequent sequence which is contained frequently in all data sequences. Beside the discovery of frequent itemsets, sequential pattern mining requires the arrangement of those itemsets in sequences and the discovery of which of those are frequent. So before mining sequences, the main task is checking if one sequence is a subsequence of another sequence in the database. In this paper, we implement the subsequence matching method as the preprocessing step for sequential pattern mining. Matched sequences in our implementation are the normalized sequences as the form of number chain. The result which is given by this method is the review of matching information between input mapped sequences.

  • PDF

Sustainable Industry-Academia-Government Collaborative Education Focusing on Advantages of Industry: Long-term Internship after 5years Practice

  • Morimoto, Emi;Yamanaka, Hideo
    • Journal of Engineering Education Research
    • /
    • v.15 no.5
    • /
    • pp.47-53
    • /
    • 2012
  • Practical problem-solving studies in a company or organization have provided great advantages for our university and students. For example, such studies can lead them to build a stronger relationship with local governments and companies as well as develop their research through collaborative studies. On the other hand, comments from companies or organizations that accepted our students showed that they did not always have advantages. This study seeks ways to establish a sustainable long-term internship program that can offer advantages for companies. Advantages and disadvantages of the internship are written by the company on the evaluated sheet. These feedback comments are analyzed by text-mining approach. It is shown that there are three types of company and organizations depending on their reasons for accepting students. Next, suitable internship programs for each type, including their period and expense distribution are presented.

Guiding Practical Text Classification Framework to Optimal State in Multiple Domains

  • Choi, Sung-Pil;Myaeng, Sung-Hyon;Cho, Hyun-Yang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.3 no.3
    • /
    • pp.285-307
    • /
    • 2009
  • This paper introduces DICE, a Domain-Independent text Classification Engine. DICE is robust, efficient, and domain-independent in terms of software and architecture. Each module of the system is clearly modularized and encapsulated for extensibility. The clear modular architecture allows for simple and continuous verification and facilitates changes in multiple cycles, even after its major development period is complete. Those who want to make use of DICE can easily implement their ideas on this test bed and optimize it for a particular domain by simply adjusting the configuration file. Unlike other publically available tool kits or development environments targeted at general purpose classification models, DICE specializes in text classification with a number of useful functions specific to it. This paper focuses on the ways to locate the optimal states of a practical text classification framework by using various adaptation methods provided by the system such as feature selection, lemmatization, and classification models.

Paying Back to Good Deeds: A Text Mining Approach to Explore Don-jjul as Pro-consumption Behavior

  • Hojin Choo;Sue Hyun Lee
    • Asia Marketing Journal
    • /
    • v.26 no.2
    • /
    • pp.104-128
    • /
    • 2024
  • More consumers are choosing pro-consumption for social change, but scholars know little about why and how consumers engage in pro-consumption behaviors. A newly emerged pro-consumption behavior called "Don-jjul," which appeared during the COVID-19 pandemic in South Korea, refers to compensating businesses that have engaged in altruistic actions by boosting their sales. This study used Latent Dirichlet Allocation (LDA) of topic modeling, sentiment analysis, and in-depth interviews to investigate the perceptions, motivations, and emotions regarding Don-jjul. As a result, the study revealed pro-consumers' perceptions of Don-jjul as "collective pro-consumption for contributing to social well-being." Don-jjul has two main motives: "supporting underdogs with difficulties" and "compensating good businesses economically." We also found two ambivalent emotions evoked by Don-jjul: "respect for good business owners" and "concerns regarding the misuse of Don-jjul." The results contribute to pro-consumption research for social well-being, providing business opportunities for retailers and CSR managers with a deep understanding of pro-consumers.

Comparison of term weighting schemes for document classification (문서 분류를 위한 용어 가중치 기법 비교)

  • Jeong, Ho Young;Shin, Sang Min;Choi, Yong-Seok
    • The Korean Journal of Applied Statistics
    • /
    • v.32 no.2
    • /
    • pp.265-276
    • /
    • 2019
  • The document-term frequency matrix is a general data of objects in text mining. In this study, we introduce a traditional term weighting scheme TF-IDF (term frequency-inverse document frequency) which is applied in the document-term frequency matrix and used for text classifications. In addition, we introduce and compare TF-IDF-ICSDF and TF-IGM schemes which are well known recently. This study also provides a method to extract keyword enhancing the quality of text classifications. Based on the keywords extracted, we applied support vector machine for the text classification. In this study, to compare the performance term weighting schemes, we used some performance metrics such as precision, recall, and F1-score. Therefore, we know that TF-IGM scheme provided high performance metrics and was optimal for text classification.

Ontology and Text Mining-based Advanced Historical People Finding Service (온톨로지와 텍스트 마이닝 기반 지능형 역사인물 검색 서비스)

  • Jeong, Do-Heon;Hwang, Myunggwon;Cho, Minhee;Jung, Hanmin;Yoon, Soyoung;Kim, Kyungsun;Kim, Pyung
    • Journal of Internet Computing and Services
    • /
    • v.13 no.5
    • /
    • pp.33-43
    • /
    • 2012
  • Semantic web is utilized to construct advanced information service by using semantic relationships between entities. Text mining can be applied to generate semantic relationships from unstructured data resources. In this study, ontology schema guideline, ontology instance generation, disambiguation of same name by text mining and advanced historical people finding service by reasoning have been proposed. Various relationships between historical event, organization, people, which are created by domain experts, are linked to literatures of National Institute of Korean History (NIKH). It improves the effectiveness of user access and proposes advanced people finding service based on relationships. In order to distinguish between people with the same name, we compares the structure and edge, nodes of personal social network. To provide additional information, external resources including thesaurus and web are linked to all of internal related resources as well.