• Journal of IKEEE
• /
• v.23 no.4
• /
• pp.1440-1447
• /
• 2019

Currently, the prevalence of autism spectrum disorders in children is reported to be higher and shows various types of disorders. In particular, they are having difficulty in communication due to communication impairment in the area of social communication and need to be improved through training. Thus, this study proposes a method of acquiring voice information through a microphone mounted on a robot designed through preliminary research and using this information to make intelligent motions. An ANN(Artificial Neural Network) was used to classify the speech data into robot motions, and we tried to improve the accuracy by combining the Recurrent Neural Network based on Convolutional Neural Network. The preprocessing of input speech data was analyzed using MFCC(Mel-Frequency Cepstral Coefficient), and the motion of the robot was estimated using various data normalization and neural network optimization techniques. In addition, the designed ANN showed a high accuracy by conducting an experiment comparing the accuracy with the existing architecture and the method of human intervention. In order to design robot motions with higher accuracy in the future and to apply them in the treatment and education environment of children with autism.

• Journal of Broadcast Engineering
• /
• v.24 no.1
• /
• pp.48-57
• /
• 2019

The purpose of this study is to understand the intention of the inquirer from the single text type question in Goal-oriented dialogue. Goal-Oriented Dialogue system means a dialogue system that satisfies the user's specific needs via text or voice. The intention analysis process is a step of analysing the user's intention of inquiry prior to the answer generation, and has a great influence on the performance of the entire Goal-Oriented Dialogue system. The proposed model was used for a daily chemical products domain and Korean text data related to the domain was used. The analysis is divided into a speech-act which means independent on a specific field concept-sequence and which means depend on a specific field. We propose a classification method using the word embedding model and the CNN as a method for analyzing speech-act and concept-sequence. The semantic information of the word is abstracted through the word embedding model, and concept-sequence and speech-act classification are performed through the CNN based on the semantic information of the abstract word.

• Phonetics and Speech Sciences
• /
• v.14 no.4
• /
• pp.45-56
• /
• 2022

This paper proposes an optimal methodology for automatically diagnosing and predicting the severity of the chronic kidney disease (CKD) using patients' utterances. In patients with CKD, the voice changes due to the weakening of respiratory and laryngeal muscles and vocal fold edema. Previous studies have phonetically analyzed the voices of patients with CKD, but no studies have been conducted to classify the voices of patients. In this paper, the utterances of patients with CKD were classified using the variety of utterance types (sustained vowel, sentence, general sentence), the feature sets [handcrafted features, extended Geneva Minimalistic Acoustic Parameter Set (eGeMAPS), CNN extracted features], and the classifiers (SVM, XGBoost). Total of 1,523 utterances which are 3 hours, 26 minutes, and 25 seconds long, are used. F1-score of 0.93 for automatically diagnosing a disease, 0.89 for a 3-classes problem, and 0.84 for a 5-classes problem were achieved. The highest performance was obtained when the combination of general sentence utterances, handcrafted feature set, and XGBoost was used. The result suggests that a general sentence utterance that can reflect all speakers' speech characteristics and an appropriate feature set extracted from there are adequate for the automatic classification of CKD patients' utterances.

• Journal of Intelligence and Information Systems
• /
• v.24 no.2
• /
• pp.221-241
• /
• 2018

Deep learning is getting attention recently. The deep learning technique which had been applied in competitions of the International Conference on Image Recognition Technology(ILSVR) and AlphaGo is Convolution Neural Network(CNN). CNN is characterized in that the input image is divided into small sections to recognize the partial features and combine them to recognize as a whole. Deep learning technologies are expected to bring a lot of changes in our lives, but until now, its applications have been limited to image recognition and natural language processing. The use of deep learning techniques for business problems is still an early research stage. If their performance is proved, they can be applied to traditional business problems such as future marketing response prediction, fraud transaction detection, bankruptcy prediction, and so on. So, it is a very meaningful experiment to diagnose the possibility of solving business problems using deep learning technologies based on the case of online shopping companies which have big data, are relatively easy to identify customer behavior and has high utilization values. Especially, in online shopping companies, the competition environment is rapidly changing and becoming more intense. Therefore, analysis of customer behavior for maximizing profit is becoming more and more important for online shopping companies. In this study, we propose 'CNN model of Heterogeneous Information Integration' using CNN as a way to improve the predictive power of customer behavior in online shopping enterprises. In order to propose a model that optimizes the performance, which is a model that learns from the convolution neural network of the multi-layer perceptron structure by combining structured and unstructured information, this model uses 'heterogeneous information integration', 'unstructured information vector conversion', 'multi-layer perceptron design', and evaluate the performance of each architecture, and confirm the proposed model based on the results. In addition, the target variables for predicting customer behavior are defined as six binary classification problems: re-purchaser, churn, frequent shopper, frequent refund shopper, high amount shopper, high discount shopper. In order to verify the usefulness of the proposed model, we conducted experiments using actual data of domestic specific online shopping company. This experiment uses actual transactions, customers, and VOC data of specific online shopping company in Korea. Data extraction criteria are defined for 47,947 customers who registered at least one VOC in January 2011 (1 month). The customer profiles of these customers, as well as a total of 19 months of trading data from September 2010 to March 2012, and VOCs posted for a month are used. The experiment of this study is divided into two stages. In the first step, we evaluate three architectures that affect the performance of the proposed model and select optimal parameters. We evaluate the performance with the proposed model. Experimental results show that the proposed model, which combines both structured and unstructured information, is superior compared to NBC(Naïve Bayes classification), SVM(Support vector machine), and ANN(Artificial neural network). Therefore, it is significant that the use of unstructured information contributes to predict customer behavior, and that CNN can be applied to solve business problems as well as image recognition and natural language processing problems. It can be confirmed through experiments that CNN is more effective in understanding and interpreting the meaning of context in text VOC data. And it is significant that the empirical research based on the actual data of the e-commerce company can extract very meaningful information from the VOC data written in the text format directly by the customer in the prediction of the customer behavior. Finally, through various experiments, it is possible to say that the proposed model provides useful information for the future research related to the parameter selection and its performance.

• (The) Research of the performance art and culture
• /
• no.19
• /
• pp.379-418
• /
• 2009

This study is a link in a chain which grope for the description of puppet performance history. This study imply my intention which is not a description of puppet performance 'history' but a description of 'puppet performance' history. Object materials of this study is materials connected with puppet performance from ancient times to Chosun dynasty. Object materials of this study include not only records but also remains and pictures. Discussion start with regulation of puppet performance materials and establishment of a classification criterion. As a result of that discussion, the age of puppet performance is as follows: 'the age of diverse use of puppet', 'the age of ritual puppet performance of worship', 'the age of play puppet performance of handling', 'the age of ritual puppet performance of display', 'the age of ritual puppet performance of expulsion', 'the age of ritual puppet performance of handling', 'the age of play puppet performance of display', 'the age of play puppet performance of handling and voice-acting'. According to the internal division of age, the description of puppet performance history which is spread chronologically is attempted. As a result of the description, I confirm that puppet performance reveal a one's unfolding process. And a distinct aspect from the general cultu! re history is found. The development process which is a changeover that is 'from ritual puppet performance to play puppet performance' is amended by a circulation of ritual puppet performance and play puppet performance'. And the development process which is a changeover 'from static puppet to dynamic puppet' is amended by a circulation of static puppet and dynamic puppet'. Like this the thing which is laid in the inside which is not a one sided changeover but is a circulation is said that from one age of puppet performance to other age of puppet performance is not a close of former puppet performance tradition. Unfolding from one age to other age, on the other hand former puppet performance reveal aspect which is a continuance and change with a one's vitality. And a relation of mutual influence is exist between the ritual puppet performance and the play puppet performance on a large scale, among the puppet performance types on a small scale. this also don't overlook in cas! e of a groping of puppet performance history.

• Cartoon and Animation Studies
• /
• s.45
• /
• pp.27-50
• /
• 2016

The present study argues that documentary-animation films, which are based on actual human voices, on the level of representation, constitute a new expansion for the medium of animation films, which serve as testimonies to the real world. Animation films are produced using very diverse techniques so that they are complex to the degree of being indefinable, and documentary films, though based on objective representation, increase in complexity in that there exist various types of artificial interventions such as direction and digital image processing. Having emerged as a hybrid genre of the two media, documentary-animation films draw into themselves actual events and elements so that they conceptually share reality-based narratives and are visually characterized by the trappings of animation films. Generally classified as 'animated documentaries', this genre triggered discussions following the release of , a work that is mistaken as having used rotoscoping transforming live action in terms of the technique. When analyzed in detail, however, this work is presented as an ambiguous medium where the characteristics of animation films, which are virtual simulacra without reality, and of documentaries, which are based on the objective indexicality of the referents, coexist because of its mixed use of typical animation techniques, 3D programs, and live-action images. Discussed in the present study, , , and share the characteristics of the medium of documentaries in that the narratives develop as testimonies of historical figures but, at the same time, are connected to animation films because of their production techniques and direction characteristics. Consequently, this medium must be discussed as a new expansion rather than being included in the existing classification system, and such a presupposition is an indispensable process for directly facing the reality of the works and for developing discussions. Through works that directly use the interviewees' voices yet do not transcend the characteristics of animation films, the present study seeks to define documentary-animation films and to discuss the possibility of the medium, which has expanded as a testimony to the real world.

• The Journal of the Korea Contents Association
• /
• v.19 no.3
• /
• pp.252-260
• /
• 2019

Smart devices have penetrated deeply into our daily lives. They have not only increased user convenience, but also changed the overall lifestyle of society. The objective of this study was to examine the change process of user experience through device classification and technology by generation. In order to achieve the objective, this study analyzed the purpose and pattern of using a device, which is a digital platform, and the input and output, which are the most important digital components for personal exclusiveness and interaction. The analysis results of this study showed that, in the past, the purpose of using a device was clear, a device was used in common, and a separate device was used for input and output. However, as devices evolved, users began to emphasize the fun aspect than the purpose of a device. As a result, personal exclusiveness has increased. Moreover, unlike devices in the past depending on separate input or output methods, devices are evolving to employ a method performing input and output using the five senses of people such as the touchscreen using a body part of a user, voice, and motion. This study evaluated how the overall experience of users, which was obtained through technology, has changed for each generation. Furthermore, this study proposed the future direction of device development by considering the user experience. It is believed that the results of this study will be useful for future studies on the overall experience of users who will use a range of smart devices, which will be released in the future.

• Journal of Intelligence and Information Systems
• /
• v.29 no.3
• /
• pp.57-78
• /
• 2023

COVID-19, which started in Wuhan, China in November 2019, spread beyond China in 2020 and spread worldwide in March 2020. It is important to prevent a highly contagious virus like COVID-19 in advance and to actively treat it when confirmed, but it is more important to identify the confirmed fact quickly and prevent its spread since it is a virus that spreads quickly. However, PCR test to check for infection is costly and time consuming, and self-kit test is also easy to access, but the cost of the kit is not easy to receive every time. Therefore, if it is possible to determine whether or not a person is positive for COVID-19 based on the sound of a cough so that anyone can use it easily, anyone can easily check whether or not they are confirmed at anytime, anywhere, and it can have great economic advantages. In this study, an experiment was conducted on a method to identify whether or not COVID-19 was confirmed based on a cough sound. Cough sound features were extracted through MFCC, Mel-Spectrogram, and spectral contrast. For the quality of cough sound, noisy data was deleted through SNR, and only the cough sound was extracted from the voice file through chunk. Since the objective is COVID-19 positive and negative classification, learning was performed through XGBoost, LightGBM, and FCNN algorithms, which are often used for classification, and the results were compared. Additionally, we conducted a comparative experiment on the performance of the model using multidimensional vectors obtained by converting cough sounds into both images and vectors. The experimental results showed that the LightGBM model utilizing features obtained by converting basic information about health status and cough sounds into multidimensional vectors through MFCC, Mel-Spectogram, Spectral contrast, and Spectrogram achieved the highest accuracy of 0.74.

• The Journal of Bigdata
• /
• v.4 no.2
• /
• pp.1-12
• /
• 2019

As Artificial Intelligence (AI) technology develops, it is applied to various fields such as image, voice, and text. AI has shown fine results in certain areas. Researchers have tried to predict the stock market by utilizing artificial intelligence as well. Predicting the stock market is known as one of the difficult problems since the stock market is affected by various factors such as economy and politics. In the field of AI, there are attempts to predict the ups and downs of stock price by studying stock price patterns using various machine learning techniques. This study suggest a way of predicting stock price patterns based on the Convolutional Neural Network(CNN) among machine learning techniques. CNN uses neural networks to classify images by extracting features from images through convolutional layers. Therefore, this study tries to classify candlestick images made by stock data in order to predict patterns. This study has two objectives. The first one referred as Case 1 is to predict the patterns with the images made by the same-day stock price data. The second one referred as Case 2 is to predict the next day stock price patterns with the images produced by the daily stock price data. In Case 1, data augmentation methods - random modification and Gaussian noise - are applied to generate more training data, and the generated images are put into the model to fit. Given that deep learning requires a large amount of data, this study suggests a method of data augmentation for candlestick images. Also, this study compares the accuracies of the images with Gaussian noise and different classification problems. All data in this study is collected through OpenAPI provided by DaiShin Securities. Case 1 has five different labels depending on patterns. The patterns are up with up closing, up with down closing, down with up closing, down with down closing, and staying. The images in Case 1 are created by removing the last candle(-1candle), the last two candles(-2candles), and the last three candles(-3candles) from 60 minutes, 30 minutes, 10 minutes, and 5 minutes candle charts. 60 minutes candle chart means one candle in the image has 60 minutes of information containing an open price, high price, low price, close price. Case 2 has two labels that are up and down. This study for Case 2 has generated for 60 minutes, 30 minutes, 10 minutes, and 5minutes candle charts without removing any candle. Considering the stock data, moving the candles in the images is suggested, instead of existing data augmentation techniques. How much the candles are moved is defined as the modified value. The average difference of closing prices between candles was 0.0029. Therefore, in this study, 0.003, 0.002, 0.001, 0.00025 are used for the modified value. The number of images was doubled after data augmentation. When it comes to Gaussian Noise, the mean value was 0, and the value of variance was 0.01. For both Case 1 and Case 2, the model is based on VGG-Net16 that has 16 layers. As a result, 10 minutes -1candle showed the best accuracy among 60 minutes, 30 minutes, 10 minutes, 5minutes candle charts. Thus, 10 minutes images were utilized for the rest of the experiment in Case 1. The three candles removed from the images were selected for data augmentation and application of Gaussian noise. 10 minutes -3candle resulted in 79.72% accuracy. The accuracy of the images with 0.00025 modified value and 100% changed candles was 79.92%. Applying Gaussian noise helped the accuracy to be 80.98%. According to the outcomes of Case 2, 60minutes candle charts could predict patterns of tomorrow by 82.60%. To sum up, this study is expected to contribute to further studies on the prediction of stock price patterns using images. This research provides a possible method for data augmentation of stock data.