• Title/Summary/Keyword: Intelligent Character Recognition

Search Result 62, Processing Time 0.019 seconds

Korean Sentence Generation Using Phoneme-Level LSTM Language Model (한국어 음소 단위 LSTM 언어모델을 이용한 문장 생성)

  • Ahn, SungMahn;Chung, Yeojin;Lee, Jaejoon;Yang, Jiheon
    • Journal of Intelligence and Information Systems
    • /
    • v.23 no.2
    • /
    • pp.71-88
    • /
    • 2017
  • Language models were originally developed for speech recognition and language processing. Using a set of example sentences, a language model predicts the next word or character based on sequential input data. N-gram models have been widely used but this model cannot model the correlation between the input units efficiently since it is a probabilistic model which are based on the frequency of each unit in the training set. Recently, as the deep learning algorithm has been developed, a recurrent neural network (RNN) model and a long short-term memory (LSTM) model have been widely used for the neural language model (Ahn, 2016; Kim et al., 2016; Lee et al., 2016). These models can reflect dependency between the objects that are entered sequentially into the model (Gers and Schmidhuber, 2001; Mikolov et al., 2010; Sundermeyer et al., 2012). In order to learning the neural language model, texts need to be decomposed into words or morphemes. Since, however, a training set of sentences includes a huge number of words or morphemes in general, the size of dictionary is very large and so it increases model complexity. In addition, word-level or morpheme-level models are able to generate vocabularies only which are contained in the training set. Furthermore, with highly morphological languages such as Turkish, Hungarian, Russian, Finnish or Korean, morpheme analyzers have more chance to cause errors in decomposition process (Lankinen et al., 2016). Therefore, this paper proposes a phoneme-level language model for Korean language based on LSTM models. A phoneme such as a vowel or a consonant is the smallest unit that comprises Korean texts. We construct the language model using three or four LSTM layers. Each model was trained using Stochastic Gradient Algorithm and more advanced optimization algorithms such as Adagrad, RMSprop, Adadelta, Adam, Adamax, and Nadam. Simulation study was done with Old Testament texts using a deep learning package Keras based the Theano. After pre-processing the texts, the dataset included 74 of unique characters including vowels, consonants, and punctuation marks. Then we constructed an input vector with 20 consecutive characters and an output with a following 21st character. Finally, total 1,023,411 sets of input-output vectors were included in the dataset and we divided them into training, validation, testsets with proportion 70:15:15. All the simulation were conducted on a system equipped with an Intel Xeon CPU (16 cores) and a NVIDIA GeForce GTX 1080 GPU. We compared the loss function evaluated for the validation set, the perplexity evaluated for the test set, and the time to be taken for training each model. As a result, all the optimization algorithms but the stochastic gradient algorithm showed similar validation loss and perplexity, which are clearly superior to those of the stochastic gradient algorithm. The stochastic gradient algorithm took the longest time to be trained for both 3- and 4-LSTM models. On average, the 4-LSTM layer model took 69% longer training time than the 3-LSTM layer model. However, the validation loss and perplexity were not improved significantly or became even worse for specific conditions. On the other hand, when comparing the automatically generated sentences, the 4-LSTM layer model tended to generate the sentences which are closer to the natural language than the 3-LSTM model. Although there were slight differences in the completeness of the generated sentences between the models, the sentence generation performance was quite satisfactory in any simulation conditions: they generated only legitimate Korean letters and the use of postposition and the conjugation of verbs were almost perfect in the sense of grammar. The results of this study are expected to be widely used for the processing of Korean language in the field of language processing and speech recognition, which are the basis of artificial intelligence systems.

The Effects of Consumer Value Cognition on Benefits and Attributes of Culture-Art Products (문화예술상품 소비자의 가치인식이 추구혜택과 상품속성에 미치는 영향)

  • Shin, Eun Joo;Rhee, Young Sun
    • Asia Marketing Journal
    • /
    • v.14 no.2
    • /
    • pp.177-207
    • /
    • 2012
  • Today's consumers perceive consumption as a representation of themselves. It is not simply an act that fulfills a consumer's physical and practical needs. Even in terms of life quality, consumers increasingly want to achieve an emotional and sensible experience through consumption. Consumers now make decisions based on their need to express their position in relation to other people, pursue emotional satisfaction, and try to improve the quality of life. Culture-art products that meet such internal and external demands of consumers have made significant improvements in both quantity and quality, because of the social interest and policy support. The recognition of personal and social values of culture and arts has brought about interest in and need for culture-art products. Businesses have agilely embraced such change and actively implemented various marketing strategies utilizing culture and arts. For example, businesses began to sponsor artists who produce culture-art products while building facilities for cultural and art performances or exhibitions. Businesses have also provided performances and exhibitions free-of-charge or at affordable prices. As a result, the supply in the market has started to exceed its demand as is often the case in many of other markets. However, such imbalance has occurred not because of over-supply but because of a lack of demand. Given these circumstances, the government and culture and art related organizations, which had mainly concentrated on the supply side, started to recognize the importance of creating personal and social values in culture and arts. As a result, the government and various organizations are now creating various strategies that include policy measures to achieve their new found goal. Unfortunately however, such efforts are not meeting the expectations. Focusing on above-mentioned circumstances and problems, this study aims to find measures to create demand for culture-art products in the internal conditions of those who consume culture-art products. In other words, given that the demand for culture-art products has not increased despite all external conditions to encourage consumption, this study aims to find the reasons in consumers' value judgment on culture-art products. Though there were recent studies on culture-art products that applied consumer behavior on marketing theories, most of them focused on peripheral aspects such as people's motivation for or satisfaction from watching culture-art events. Hence, there is a need to understand what kind of value consumers perceive from culture-art products and how such value cognition leads to consumption in a comprehensive manner. This study acts as follow-up to a separate study entitled "Qualitative Study about Value Cognition and Benefits of Consumer on Culture-Art Products". The current study aims to extend practical implications that enhance the effectiveness of marketing strategies among the producing and policy agencies in the industry. The purpose of this study is to investigate dimensions of value cognition, benefits and attributes of culture-art products, and identify the effects of consumer value cognition on benefits and attributes. The questionnaire was developed based on the conceptual structure of qualitative research and previous researches. It was composed of value cognition, benefits, attributes of culture-art products and demographic variables. This survey was conducted on-line and off-line among a total of 662 persons ranging from their teens to their 50's who were living in Seoul, Gyeonggi-do, various metropolitan cities, and small and medium-sized cities. The data collected was analyzed by factor analysis and path analysis using SPSS WIN 18.0 and AMOS 16.0. This empirical study found that the dimensions of value cognition of culture-art products were categorized into personal goods, aesthetic goods and public property. This shows that the consumers perceive culture-art products as products that are worthy enough to pay the costs not just for personal benefits but also for their social values. Also the formation of value cognition for culture-art products requires special conditions unlike that for physical consumer goods and services, which simply require marketing stimuli. The dimensions of benefits pursued by consuming culture-art products were found to be composed of four types - pursuit of aesthetic benefits, pursuit of actual benefits, pursuit of emotional benefits, and pursuit of conspicuous character. This result implies that people consume culture-art products not just to pursue pleasure from emotional and intelligent satisfaction as well as social relations, but also to seek the needs and benefits embodied at a social level. The dimensions of attributes of culture-art products had seven different factors, - environmental, price, evaluation, people, artwork, composition, and personal relations - which is plentiful. This is because the attributes of culture-art products are very complicated compared to other consumer goods or services. Since culture-art products include not just cultural or artistic works but also all physical, human, environmental, and systemic elements of the products in a comprehensive manner, consumers perceive everything they experience in the process of consuming culture-art products as part of the products. The dimensions of value cognition was found to affect attributes of the products, mostly using pursued benefits as a mediating factors. This result is consistent with the result of qualitative research, and proves that applying the means-end chain theory in the reverse direction is reasonable. The result can be interpreted that consumers' value cognitions for culture-art products turns into actual benefits leading to consumers' decisions. Furthermore, this result reveals that when consumers choose culture-art products, they take into account the attributes of culture-art products depending on the benefits they pursue. These results confirm that despite their conceptual and abstract attributes, culture-art products have values that contribute to actual benefits for individual consumers and society. Hence, value cognition generates benefits to be pursued and this in turn affects the consumers' choices of attributes on products. Based on the conceptual structure of consumers' value cognitions on culture-art products and its dimensions, it is possible to find detailed methods to provide opportunities for education and training to form and reinforce positive value cognition on culture-art products. And through those methods, it will be possible to develop attributes of culture-art products according to the dimensions of pursued benefits, and allow conceptual products become the subject to valuable consumption in real life. These results provide theoretical understanding of consumer behavior in culture marketing and useful information to culture-art producers, companies that use culture and art, and government agencies that use culture-art as a mean to improve the public perception of quality of life. As a follow up on this study, there should be experimental studies that can develop criteria visualizing the demands of consumers who purchase culture-art products and identify their detailed attributes. Studies that compare characteristics of different areas within the culture-art product category and in-depth studies on a specific area or genre will also be needed. In order to develop marketing strategies for culture-art products, studies on the formation and reinforcement of positive value cognition on culture-art products and education for the development of consumer demand as well as on the development and differentiation of attributes of culture-art products depending on types of consumer groups should also follow.

  • PDF