Sentiment Analysis of Korean Reviews Using CNN: Focusing on Morpheme Embedding (CNN을 적용한 한국어 상품평 감성분석: 형태소 임베딩을 중심으로)
-
- Journal of Intelligence and Information Systems
- /
- v.24 no.2
- /
- pp.59-83
- /
- 2018
With the increasing importance of sentiment analysis to grasp the needs of customers and the public, various types of deep learning models have been actively applied to English texts. In the sentiment analysis of English texts by deep learning, natural language sentences included in training and test datasets are usually converted into sequences of word vectors before being entered into the deep learning models. In this case, word vectors generally refer to vector representations of words obtained through splitting a sentence by space characters. There are several ways to derive word vectors, one of which is Word2Vec used for producing the 300 dimensional Google word vectors from about 100 billion words of Google News data. They have been widely used in the studies of sentiment analysis of reviews from various fields such as restaurants, movies, laptops, cameras, etc. Unlike English, morpheme plays an essential role in sentiment analysis and sentence structure analysis in Korean, which is a typical agglutinative language with developed postpositions and endings. A morpheme can be defined as the smallest meaningful unit of a language, and a word consists of one or more morphemes. For example, for a word '예쁘고', the morphemes are '예쁘(= adjective)' and '고(=connective ending)'. Reflecting the significance of Korean morphemes, it seems reasonable to adopt the morphemes as a basic unit in Korean sentiment analysis. Therefore, in this study, we use 'morpheme vector' as an input to a deep learning model rather than 'word vector' which is mainly used in English text. The morpheme vector refers to a vector representation for the morpheme and can be derived by applying an existent word vector derivation mechanism to the sentences divided into constituent morphemes. By the way, here come some questions as follows. What is the desirable range of POS(Part-Of-Speech) tags when deriving morpheme vectors for improving the classification accuracy of a deep learning model? Is it proper to apply a typical word vector model which primarily relies on the form of words to Korean with a high homonym ratio? Will the text preprocessing such as correcting spelling or spacing errors affect the classification accuracy, especially when drawing morpheme vectors from Korean product reviews with a lot of grammatical mistakes and variations? We seek to find empirical answers to these fundamental issues, which may be encountered first when applying various deep learning models to Korean texts. As a starting point, we summarized these issues as three central research questions as follows. First, which is better effective, to use morpheme vectors from grammatically correct texts of other domain than the analysis target, or to use morpheme vectors from considerably ungrammatical texts of the same domain, as the initial input of a deep learning model? Second, what is an appropriate morpheme vector derivation method for Korean regarding the range of POS tags, homonym, text preprocessing, minimum frequency? Third, can we get a satisfactory level of classification accuracy when applying deep learning to Korean sentiment analysis? As an approach to these research questions, we generate various types of morpheme vectors reflecting the research questions and then compare the classification accuracy through a non-static CNN(Convolutional Neural Network) model taking in the morpheme vectors. As for training and test datasets, Naver Shopping's 17,260 cosmetics product reviews are used. To derive morpheme vectors, we use data from the same domain as the target one and data from other domain; Naver shopping's about 2 million cosmetics product reviews and 520,000 Naver News data arguably corresponding to Google's News data. The six primary sets of morpheme vectors constructed in this study differ in terms of the following three criteria. First, they come from two types of data source; Naver news of high grammatical correctness and Naver shopping's cosmetics product reviews of low grammatical correctness. Second, they are distinguished in the degree of data preprocessing, namely, only splitting sentences or up to additional spelling and spacing corrections after sentence separation. Third, they vary concerning the form of input fed into a word vector model; whether the morphemes themselves are entered into a word vector model or with their POS tags attached. The morpheme vectors further vary depending on the consideration range of POS tags, the minimum frequency of morphemes included, and the random initialization range. All morpheme vectors are derived through CBOW(Continuous Bag-Of-Words) model with the context window 5 and the vector dimension 300. It seems that utilizing the same domain text even with a lower degree of grammatical correctness, performing spelling and spacing corrections as well as sentence splitting, and incorporating morphemes of any POS tags including incomprehensible category lead to the better classification accuracy. The POS tag attachment, which is devised for the high proportion of homonyms in Korean, and the minimum frequency standard for the morpheme to be included seem not to have any definite influence on the classification accuracy.
Visual media transmits image and information reproduced in large quantities, such as a photography, film, television, video, advertisement, or computer image. Correspondence to the students' reception and recognition of culture in the future. arrangements for the field of studies of visual culture. 'Visual Culture' implies cultural phenomena of visual images via visual media, which includes not only the categories of traditional arts like a painting, sculpture, print, or design, but the performance arts including a fashion show or parade of carnival, and the mass and electronic media like a photography, film, television, video, advertisement, cartoon, animation, or computer image. In the world of visual media, Image' functions as an essential medium of communication. Therefore, people call the culture of today fra of Image Culture', which has been converted from an alphabet convergence era to an image convergence one. Image, via visual media, has become a dominant means for communication in large part of human life, so we can designate an Image' as a typical aspect of visual culture today. Image, as an essential medium of communication, plays an important role in contemporary society. The one way is the conversion of analogue image like an actual picture, photograph, or film into digital one through the digitalization of digital camera or scanner as 'an analogue/digital commutator'. The other is a way of process with a computer drawing, or modeling of objects. It is appropriate to the production of pictorial and surreal images. Digital images, produced by the other, can be divided into the form of Pixel' and form of Vector'. Vector is a line linking the point of departure to the point of end, which organizes informations. Computer stores each line's standard location and correlative locations to one another Digital image shows for more 'Perfectness' than any other visual media. Digital image has been evolving in the diverse aspects, such as a production of geometrical or organic image compositing, interactive art, multimedia art, or web art, which has been applied a computer as an extended trot of painting. Someone often interprets digitalized copy with endless reproduction of original even as an extension of a print. Visual af is no longer a simple activity of representation by a painter or sculptor, but now is intimately associated with a matter of application of media. There is some problem in images via visual media. First, the image via media doesn't reflect a reality as it is, but reflects an artificial manipulated world, that is, a virtual reality. Second, the introduction of digital effect and the development of image processing technology have enhanced a spectacle of destructive and violent scenes. Third, a child intends to recognize the interactive images of computer game and virtual reality as a reality, or truth. Education needs not only to point out an ill effect of mass media and prevent the younger generation from being damaged by it, but also to offer a knowledge and know-how to cope actively with social, cultural circumstances. Visual media education is one of these essential methods for the contemporary and future human being in the overflowing of image informations. The fosterage of 'Visual Literacy' can be considered as a very purpose of visual media education. This is a way to lead an individual to the discerning, active consumer and producer of visual media in life as far as possible. The elements of 'Visual Literacy' can be divided into a faculty of recognition related to the visual media, a faculty of critical reception, a faculty of appropriate application, a faculty of active work and a faculty of creative modeling, which are promoted at the same time by the education of 'visual literacy'. In conclusion, the education of 'Visual Literacy' guides students to comprehend and discriminate the visual image media carefully, or receive them critically, apply them properly, or produce them creatively and voluntarily. Moreover, it leads to an artistic activity by means of new media. This education can be approached and enhanced by the connection and integration with real life. Visual arts and education of them play an important role in the digital era depended on visual communications via image information. Visual me야a of day functions as an essential element both in daily life and in arts. Students can soundly understand visual phenomena of today by means of visual media, and apply it as an expression tool of life culture as well. A new recognition and valuation visual image and media education is required to cultivate the capability of active, upright dealing with the changes of history of civilization. 1) Visual media education helps to cultivate a sensibility for images, which reacts to and deals with the circumstances. 2) It helps students to comprehend the contemporary arts and culture via new media. 3) It supplies a chance of students' experiencing a visual modeling by means of new media. 4) There are educational opportunities of images with temporality and spaciality, and therefore a discerning person becomes to increase. 5) The modeling activity via new media leads students to be continuously interested in the school and production of plastic arts. 6) It raises the ability of visual communications dealing with image information society. 7) An education of digital image is significant in respect of cultivation of man of talent for the future society of image information as well. To correspond to the changing and developing social, cultural circumstances, and the form and recognition of students' reception of them, visual arts education must arrange the field of studying on a new visual culture. Besides, a program needs to be developed, which is in more systematic and active level in relation to visual media education. Educational contents should be extended to the media for visual images, that is, photography, film, television, video, computer graphic, animation, music video, computer game and multimedia. Every media must be separately approached, because they maintain the modes and peculiarities of their own according to the conveyance form of message. The concrete and systematic method of teaching and the quality of education must be researched and developed, centering around the development of a course of study. Teacher's foundational capability of teaching should be cultivated for the visual media education. In this case, it must be paid attention to the fact that a technological level of media is considered as a secondary. Because school education doesn't intend to train expert and skillful producers, but intends to lay stress on the essential aesthetic one with visual media under the social and cultural context, in respect of a consumer including a man of culture.
In university education, the choice of major class plays an important role in students' careers. However, in line with the changes in the industry, the fields of major subjects by department are diversifying and increasing in number in university education. As a result, students have difficulty to choose and take classes according to their career paths. In general, students choose classes based on experiences such as choices of peers or advice from seniors. This has the advantage of being able to take into account the general situation, but it does not reflect individual tendencies and considerations of existing courses, and has a problem that leads to information inequality that is shared only among specific students. In addition, as non-face-to-face classes have recently been conducted and exchanges between students have decreased, even experience-based decisions have not been made as well. Therefore, this study proposes a recommendation system model that can recommend college major classes suitable for individual characteristics based on data rather than experience. The recommendation system recommends information and content (music, movies, books, images, etc.) that a specific user may be interested in. It is already widely used in services where it is important to consider individual tendencies such as YouTube and Facebook, and you can experience it familiarly in providing personalized services in content services such as over-the-top media services (OTT). Classes are also a kind of content consumption in terms of selecting classes suitable for individuals from a set content list. However, unlike other content consumption, it is characterized by a large influence of selection results. For example, in the case of music and movies, it is usually consumed once and the time required to consume content is short. Therefore, the importance of each item is relatively low, and there is no deep concern in selecting. Major classes usually have a long consumption time because they have to be taken for one semester, and each item has a high importance and requires greater caution in choice because it affects many things such as career and graduation requirements depending on the composition of the selected classes. Depending on the unique characteristics of these major classes, the recommendation system in the education field supports decision-making that reflects individual characteristics that are meaningful and cannot be reflected in experience-based decision-making, even though it has a relatively small number of item ranges. This study aims to realize personalized education and enhance students' educational satisfaction by presenting a recommendation model for university major class. In the model study, class history data of undergraduate students at University from 2015 to 2017 were used, and students and their major names were used as metadata. The class history data is implicit feedback data that only indicates whether content is consumed, not reflecting preferences for classes. Therefore, when we derive embedding vectors that characterize students and classes, their expressive power is low. With these issues in mind, this study proposes a Net-NeuMF model that generates vectors of students, classes through network analysis and utilizes them as input values of the model. The model was based on the structure of NeuMF using one-hot vectors, a representative model using data with implicit feedback. The input vectors of the model are generated to represent the characteristic of students and classes through network analysis. To generate a vector representing a student, each student is set to a node and the edge is designed to connect with a weight if the two students take the same class. Similarly, to generate a vector representing the class, each class was set as a node, and the edge connected if any students had taken the classes in common. Thus, we utilize Node2Vec, a representation learning methodology that quantifies the characteristics of each node. For the evaluation of the model, we used four indicators that are mainly utilized by recommendation systems, and experiments were conducted on three different dimensions to analyze the impact of embedding dimensions on the model. The results show better performance on evaluation metrics regardless of dimension than when using one-hot vectors in existing NeuMF structures. Thus, this work contributes to a network of students (users) and classes (items) to increase expressiveness over existing one-hot embeddings, to match the characteristics of each structure that constitutes the model, and to show better performance on various kinds of evaluation metrics compared to existing methodologies.
Today's consumers perceive consumption as a representation of themselves. It is not simply an act that fulfills a consumer's physical and practical needs. Even in terms of life quality, consumers increasingly want to achieve an emotional and sensible experience through consumption. Consumers now make decisions based on their need to express their position in relation to other people, pursue emotional satisfaction, and try to improve the quality of life. Culture-art products that meet such internal and external demands of consumers have made significant improvements in both quantity and quality, because of the social interest and policy support. The recognition of personal and social values of culture and arts has brought about interest in and need for culture-art products. Businesses have agilely embraced such change and actively implemented various marketing strategies utilizing culture and arts. For example, businesses began to sponsor artists who produce culture-art products while building facilities for cultural and art performances or exhibitions. Businesses have also provided performances and exhibitions free-of-charge or at affordable prices. As a result, the supply in the market has started to exceed its demand as is often the case in many of other markets. However, such imbalance has occurred not because of over-supply but because of a lack of demand. Given these circumstances, the government and culture and art related organizations, which had mainly concentrated on the supply side, started to recognize the importance of creating personal and social values in culture and arts. As a result, the government and various organizations are now creating various strategies that include policy measures to achieve their new found goal. Unfortunately however, such efforts are not meeting the expectations. Focusing on above-mentioned circumstances and problems, this study aims to find measures to create demand for culture-art products in the internal conditions of those who consume culture-art products. In other words, given that the demand for culture-art products has not increased despite all external conditions to encourage consumption, this study aims to find the reasons in consumers' value judgment on culture-art products. Though there were recent studies on culture-art products that applied consumer behavior on marketing theories, most of them focused on peripheral aspects such as people's motivation for or satisfaction from watching culture-art events. Hence, there is a need to understand what kind of value consumers perceive from culture-art products and how such value cognition leads to consumption in a comprehensive manner. This study acts as follow-up to a separate study entitled "Qualitative Study about Value Cognition and Benefits of Consumer on Culture-Art Products". The current study aims to extend practical implications that enhance the effectiveness of marketing strategies among the producing and policy agencies in the industry. The purpose of this study is to investigate dimensions of value cognition, benefits and attributes of culture-art products, and identify the effects of consumer value cognition on benefits and attributes. The questionnaire was developed based on the conceptual structure of qualitative research and previous researches. It was composed of value cognition, benefits, attributes of culture-art products and demographic variables. This survey was conducted on-line and off-line among a total of 662 persons ranging from their teens to their 50's who were living in Seoul, Gyeonggi-do, various metropolitan cities, and small and medium-sized cities. The data collected was analyzed by factor analysis and path analysis using SPSS WIN 18.0 and AMOS 16.0. This empirical study found that the dimensions of value cognition of culture-art products were categorized into personal goods, aesthetic goods and public property. This shows that the consumers perceive culture-art products as products that are worthy enough to pay the costs not just for personal benefits but also for their social values. Also the formation of value cognition for culture-art products requires special conditions unlike that for physical consumer goods and services, which simply require marketing stimuli. The dimensions of benefits pursued by consuming culture-art products were found to be composed of four types - pursuit of aesthetic benefits, pursuit of actual benefits, pursuit of emotional benefits, and pursuit of conspicuous character. This result implies that people consume culture-art products not just to pursue pleasure from emotional and intelligent satisfaction as well as social relations, but also to seek the needs and benefits embodied at a social level. The dimensions of attributes of culture-art products had seven different factors, - environmental, price, evaluation, people, artwork, composition, and personal relations - which is plentiful. This is because the attributes of culture-art products are very complicated compared to other consumer goods or services. Since culture-art products include not just cultural or artistic works but also all physical, human, environmental, and systemic elements of the products in a comprehensive manner, consumers perceive everything they experience in the process of consuming culture-art products as part of the products. The dimensions of value cognition was found to affect attributes of the products, mostly using pursued benefits as a mediating factors. This result is consistent with the result of qualitative research, and proves that applying the means-end chain theory in the reverse direction is reasonable. The result can be interpreted that consumers' value cognitions for culture-art products turns into actual benefits leading to consumers' decisions. Furthermore, this result reveals that when consumers choose culture-art products, they take into account the attributes of culture-art products depending on the benefits they pursue. These results confirm that despite their conceptual and abstract attributes, culture-art products have values that contribute to actual benefits for individual consumers and society. Hence, value cognition generates benefits to be pursued and this in turn affects the consumers' choices of attributes on products. Based on the conceptual structure of consumers' value cognitions on culture-art products and its dimensions, it is possible to find detailed methods to provide opportunities for education and training to form and reinforce positive value cognition on culture-art products. And through those methods, it will be possible to develop attributes of culture-art products according to the dimensions of pursued benefits, and allow conceptual products become the subject to valuable consumption in real life. These results provide theoretical understanding of consumer behavior in culture marketing and useful information to culture-art producers, companies that use culture and art, and government agencies that use culture-art as a mean to improve the public perception of quality of life. As a follow up on this study, there should be experimental studies that can develop criteria visualizing the demands of consumers who purchase culture-art products and identify their detailed attributes. Studies that compare characteristics of different areas within the culture-art product category and in-depth studies on a specific area or genre will also be needed. In order to develop marketing strategies for culture-art products, studies on the formation and reinforcement of positive value cognition on culture-art products and education for the development of consumer demand as well as on the development and differentiation of attributes of culture-art products depending on types of consumer groups should also follow.