• Journal of the Korea Society of Computer and Information
• /
• v.26 no.10
• /
• pp.157-165
• /
• 2021

Recently, studies using deep learning to analyze a large amount of text are being actively conducted. In particular, a pre-trained language model that applies the learning results of a large amount of text to the analysis of a specific domain text is attracting attention. Among various pre-trained language models, BERT(Bidirectional Encoder Representations from Transformers)-based model is the most widely used. Recently, research to improve the performance of analysis is being conducted through further pre-training using BERT's MLM(Masked Language Model). However, the traditional MLM has difficulties in clearly understands the meaning of sentences containing new words such as newly coined words. Therefore, in this study, we newly propose NTM(Newly coined words Target Masking), which performs masking only on new words. As a result of analyzing about 700,000 movie reviews of portal 'N' by applying the proposed methodology, it was confirmed that the proposed NTM showed superior performance in terms of accuracy of sensitivity analysis compared to the existing random masking.

• The Journal of the Korea Contents Association
• /
• v.9 no.12
• /
• pp.113-120
• /
• 2009

Currently the verbal abuse in text message over on-line game is so serious. However we do not have any effective policy or technical tools yet. Till now in order to cope with this problem, the online game service providers have accumulated a set of forbidden words and applied this list on the textual word used in on-line game, which is called 'Swear filter'. But young on-line game players easily avoid this filtering method by coining another words which is not kept in the list. Especially Korean is very easy to make new variations of a vulgar word. In this paper, we propose one smart filtering algorithm to identify newly coined profanities. Important features of our method include the canonical form transformation of coined profanities, semi-global alignment between in the level of consonant and vowel units. For experiment, we have collected more than 1000 newly coined vulgar words in on-line gaming sites and tested these word against our methods. where our system have successfully filtered more than 90% of those newly coined vulgar words.

• The Journal of the Convergence on Culture Technology
• /
• v.7 no.2
• /
• pp.149-156
• /
• 2021

Text mining is one of the useful tools to discover public opinion and perception regarding political issues from big data. It is very common that users of social media express their opinion with newly-coined words such as slang and emoji. However, those new words are not effectively captured by traditional text mining methods that process text data using a language dictionary. In this study, we propose effective methods to extract newly-coined words that connote the political stance and opinion of users. With various text mining techniques, I attempt to discover the context and the political meaning of the new words.

• Journal of Convergence for Information Technology
• /
• v.12 no.3
• /
• pp.178-185
• /
• 2022

This study compared and analyzed the characteristics of new words by classifying 197 newly coined Korean and Chinese characters in 2017 and 2018 into single, compound, derivative, abbreviated, and hybrid words according to the coined method. In the case of a single language, Korean is all words borrowed from Chinese and English. However, no monolingual language appeared in Chinese. In the case of compound words, the format of the Chinese synthesis method was much more diverse and the generative power was stronger than that of Korea. In the case of derivatives, there are not many prefixes in both countries, and Korean suffixes have the strongest productivity of Chinese suffixes and weak productivity of foreign and native suffixes. Korean foreign language suffixes were characterized by relatively more appearance than Chinese. In the case of abbreviations, it can be seen that the productivity of dark syllables is stronger for Korean abbreviations, and the productivity of empty syllables is stronger for Chinese abbreviations. In the case of mixed languages, the hybrid form of Korean was much more diverse than that of Chinese. Through this study, it will be possible to help Chinese Korean learners understand the process of forming a new language, and to develop their ability to guess the meaning of Korean words while learning a new language.

• Journal of Educational Research in Mathematics
• /
• v.13 no.3
• /
• pp.227-246
• /
• 2003

In this paper, some terms of high school mathematics which read Chinese characters phonetically in Hangul are studied semantically. Nowadays, most terms of high school mathematics are terms of Chinese characters given the reading of them in Hangul alphabet. In such terms of Chinese characters, there are many loan-words from daily life and newly coined terms. Some such terms are examined in respect of meaningfulness and rule-ness. The degree of meaningfulness and rule-ness of loan-words from daily life are relative. Students seems familiar to loan-words usually, but it is difficult to know whether students seems to be familiar to loan-words or not. Degree of familiarity to a certain loan-word must be relative. In loan-words, there are such terms whose mathematical meaning is different from daily life meaning. Such terms are strong in rule-ness. Newly coined terms are strong in rule-ness. Students are not familiar to newly coined terms which are not used in daily life and have only mathematical meaning. In coining new terms using Chinese character, unit characters are related directly or indirectly to concept which unit characters want to express. So, It is possible to guess something unit characters want to express by investigating them. According to Vinner(1991), images can be evoked. But in case of reading Chinese characters phonetically in Hangul, it can not be guaranteed for Hangul mathematical terms to evoke images which the original mathematical terms evoked. To solve such problems semantic investigation of mathematical terms has been suggested. Through this process, transplanting images which the original mathematical terms evoked into Hangul terms are planned.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2009.05a
• /
• pp.521-524
• /
• 2009

Everyone can easily acquire learning materials on web environment that rapidly develops. Because the importance of English education has been emphasized day by day, many English education systems are introduced. However, previous most English education systems support only single user mode, and cannot deal with a newly coined word such as 'WIKIPEDIA'. In order to lead a user's learning ability with interest and enjoyment, this paper propose an online English word game system implementing a 'scrabble' board game. The proposed English word game system has the following characteristics. First, the proposed system supports both single user mode and multi user mode with a virtual user based on artificial intelligence. Second, the proposed system can recognize newly coined words such as 'WIKIPEDIA' by using NEVER Open API dictionary. Third, the proposed system offers familiar user interface so that a user can play the game without any manual. Therefore, it is expected that the proposed system can help users to learn English words with interest and enjoyment.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2021.07a
• /
• pp.391-394
• /
• 2021

최근 딥러닝(Deep Learning)을 활용하여 텍스트로 표현된 단어나 문장의 의미를 파악하기 위한 다양한 연구가 활발하게 수행되고 있다. 하지만, 딥러닝을 통해 특정 도메인에서 사용되는 언어를 이해하기 위해서는 해당 도메인의 충분한 데이터에 대해 오랜 시간 학습이 수행되어야 한다는 어려움이 있다. 이러한 어려움을 극복하고자, 최근에는 방대한 양의 데이터에 대한 학습 결과인 사전 학습 언어 모델(Pre-trained Language Model)을 다른 도메인의 학습에 적용하는 방법이 딥러닝 연구에서 많이 사용되고 있다. 이들 접근법은 사전 학습을 통해 단어의 일반적인 의미를 학습하고, 이후에 단어가 특정 도메인에서 갖는 의미를 파악하기 위해 추가적인 학습을 진행한다. 추가 학습에는 일반적으로 대표적인 사전 학습 언어 모델인 BERT의 MLM(Masked Language Model)이 다시 사용되며, 마스크(Mask) 되지 않은 단어들의 의미로부터 마스크 된 단어의 의미를 추론하는 형태로 학습이 이루어진다. 따라서 사전 학습을 통해 의미가 파악되어 있는 단어들이 마스크 되지 않고, 신조어와 같이 의미가 알려져 있지 않은 단어들이 마스크 되는 비율이 높을수록 단어 의미의 학습이 정확하게 이루어지게 된다. 하지만 기존의 MLM은 무작위로 마스크 대상 단어를 선정하므로, 사전 학습을 통해 의미가 파악된 단어와 사전 학습에 포함되지 않아 의미 파악이 이루어지지 않은 신조어가 별도의 구분 없이 마스크에 포함된다. 따라서 본 연구에서는 사전 학습에 포함되지 않았던 신조어에 대해서만 집중적으로 마스킹(Masking)을 수행하는 방안을 제시한다. 이를 통해 신조어의 의미 학습이 더욱 정확하게 이루어질 수 있고, 궁극적으로 이러한 학습 결과를 활용한 후속 분석의 품질도 향상시킬 수 있을 것으로 기대한다. 영화 정보 제공 사이트인 N사로부터 영화 댓글 12만 건을 수집하여 실험을 수행한 결과, 제안하는 신조어 표적 마스킹(NTM: Newly Coined Words Target Masking)이 기존의 무작위 마스킹에 비해 감성 분석의 정확도 측면에서 우수한 성능을 보임을 확인하였다.

• Smart Media Journal
• /
• v.9 no.1
• /
• pp.51-59
• /
• 2020

From PC communication to the development of the internet, a new term has been coined on the social media, and the social media culture has been formed due to the spread of smart phones, and the newly coined word is becoming a culture. With the advent of social networking sites and smart phones serving as a bridge, the number of data has increased in real time. The use of new words can have many advantages, including the use of short sentences to solve the problems of various letter-limited messengers and reduce data. However, new words do not have a dictionary meaning and there are limitations and degradation of algorithms such as data mining. Therefore, in this paper, the opinion of the document is confirmed by collecting data through web crawling and extracting new words contained within the text data and establishing an emotional classification. The progress of the experiment is divided into three categories. First, a word collected by collecting a new word on the social media is subjected to learned of affirmative and negative. Next, to derive and verify emotional values using standard documents, TF-IDF is used to score noun sensibilities to enter the emotional values of the data. As with the new words, the classified emotional values are applied to verify that the emotions are classified in standard language documents. Finally, a combination of the newly coined words and standard emotional values is used to perform a comparative analysis of the technology of the instrument.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.13 no.9
• /
• pp.1898-1904
• /
• 2009

Recently, real documents such as newspapers as well as blogs include newly coined words such as "Wikipedia". However, most previous information processing technologies cannot deal with these newly coined words because they construct their dictionaries based on materials acquired during system development. In this paper, we propose a model to automatically recognize Korean unknown words excluded from the previously constructed dictionary. The proposed model consists of an unknown noun recognition phase based on full text analysis, an unknown verb recognition phase based on web document frequency, and an unknown noun recognition phase based on web document frequency. The proposed model can recognize accurately the unknown words occurred once and again in a document by the full text analysis. Also, the proposed model can recognize broadly the unknown words occurred once in the document by using web documents. Besides, the proposed model fan recognize both a Korean unknown verb, which syllables can be changed from its base form by inflection, and a Korean unknown noun, which syllables are not changed in any eojeol. Experimental results shows that the proposed model improves precision 1.01% and recall 8.50% as compared with a previous model.

• Journal of Information Processing Systems
• /
• v.18 no.3
• /
• pp.344-358
• /
• 2022

Text summarization is the task of producing a shorter version of a long document while accurately preserving the main contents of the original text. Abstractive summarization generates novel words and phrases using a language generation method through text transformation and prior-embedded word information. However, newly coined words or out-of-vocabulary words decrease the performance of automatic summarization because they are not pre-trained in the machine learning process. In this study, we demonstrated an improvement in summarization quality through the contextualized embedding of BERT with out-of-vocabulary masking. In addition, explicitly providing precise pointing and an optional copy instruction along with BERT embedding, we achieved an increased accuracy than the baseline model. The recall-based word-generation metric ROUGE-1 score was 55.11 and the word-order-based ROUGE-L score was 39.65.