• Journal of Internet Computing and Services
• /
• v.11 no.1
• /
• pp.85-102
• /
• 2010

In this paper, we propose a novel method of analyzing video and representing the relationship among characters based on their contexts in the video sequences, namely Character-Net. As a huge amount of video contents is generated even in a single day, the searching and summarizing technologies of the contents have also been issued. Thereby, a number of researches have been proposed related to extracting semantic information of video or scenes. Generally stories of video, such as TV serial or commercial movies, are made progress with characters. Accordingly, the relationship between the characters and their contexts should be identified to summarize video. To deal with these issues, we propose Character-Net supporting the extraction of major characters in video. We first identify characters appeared in a group of video shots and subsequently extract the speaker and listeners in the shots. Finally, the characters are represented by a form of a network with graphs presenting the relationship among them. We present empirical experiments to demonstrate Character-Net and evaluate performance of extracting major characters.

• The Journal of the Convergence on Culture Technology
• /
• v.7 no.3
• /
• pp.353-358
• /
• 2021

This study provides the syntactic analysis for the agreement attraction by proposing three types of syntactic subject-verb agreement. Because subject-verb number agreement codifies the link between a predicate and its subject, it must be the purely syntactic processes of the head-to-head agreement or the feature percolation, where relevant agreement features percolate upward or downward through the hierarchical syntactic structure. The agreement errors are not affected by linear proximity or minimal interference, but instead are affected by the hierarchical relationship between an agreement target and a local attractor. The data in this paper includes the complex noun phrases with a modifier PP or a relative clause CP. Here, the [+PL] feature is suggested to be a local attractor for subject-verb agreement errors as a strong feature. Therefore, speakers tend to erroneously produce plural agreement for a singular subject in a main clause due to a plural NP in a modifier PP or plural agreement for a singular subject in a relative clause due to plural main subject.

• Journal of Science Education
• /
• v.41 no.3
• /
• pp.462-479
• /
• 2017

This study classified the visualization's materials presented in two types of middle school science textbooks to data visualization and infographics, thereafter characteristics of infographics according to science content's domains were analyzed using an analytical framework for infopraphics. The results of this study are as follows : First, visualization materials in middle school science textbooks had more data visualization (23.2%) than infographics (76.8%). Second, there were many differences in information content's category among the science subject's domains. The relationship type of information content in the domain of energy and matter, the function type in life domain, and the location type in the earth domain were prominent. In visual representation's category, the illustration type and comparative analysis type were the most dominant in the all science domains. The horizontal type in layout category occupied the largest proportion in all science domains. Therefore, it is necessary to present the visualization materials with the infographics conveying many informations than the data visualization in middle school science textbooks. And the infographics need to be developed and distributed in various formats in each science domain.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.15 no.9
• /
• pp.5763-5768
• /
• 2014

Maintaining a voice color is important when compounding both the normal voice because an emotion is not expressed with various emotional voices in a single synthesizer. When a synthesizer is developed using the recording data of too many expressed emotions, a voice color cannot be maintained and each synthetic speech is can be heard like the voice of different speakers. In this paper, the speech data was recorded and the change in the voice color was analyzed to develop an emotional HMM-based speech synthesizer. To realize a speech synthesizer, a voice was recorded, and a database was built. On the other hand, a recording process is very important, particularly when realizing an emotional speech synthesizer. Monitoring is needed because it is quite difficult to define emotion and maintain a particular level. In the realized synthesizer, a normal voice and three emotional voice (Happiness, Sadness, Anger) were used, and each emotional voice consists of two levels, High/Low. To analyze the voice color of the normal voice and emotional voice, the average spectrum, which was the measured accumulated spectrum of vowels, was used and the F1(first formant) calculated by the average spectrum was compared. The voice similarity of Low-level emotional data was higher than High-level emotional data, and the proposed method can be monitored by the change in voice similarity.

• Korean Journal of Cognitive Science
• /
• v.21 no.1
• /
• pp.157-175
• /
• 2010

Understanding dialogue participant's emotion is important as well as decoding the explicit message in human communication. It is well known that non-verbal elements are more suitable for conveying speaker's emotions than verbal elements. Written texts, however, contain a variety of linguistic units that express emotions. This study aims at analyzing components for constructing an emotion ontology, that provides us with numerous applications in Human Language Technology. A majority of the previous work in text-based emotion processing focused on the classification of emotions, the construction of a dictionary describing emotion, and the retrieval of those lexica in texts through keyword spotting and/or syntactic parsing techniques. The retrieved or computed emotions based on that process did not show good results in terms of accuracy. Thus, more sophisticate components analysis is proposed and the linguistic factors are introduced in this study. (1) 5 linguistic types of emotion expressions are differentiated in terms of target (verbal/non-verbal) and the method (expressive/descriptive/iconic). The correlations among them as well as their correlation with the non-verbal expressive type are also determined. This characteristic is expected to guarantees more adaptability to our ontology in multi-modal environments. (2) As emotion-related components, this study proposes 24 emotion types, the 5-scale intensity (-2~+2), and the 3-scale polarity (positive/negative/neutral) which can describe a variety of emotions in more detail and in standardized way. (3) We introduce verbal expression-related components, such as 'experiencer', 'description target', 'description method' and 'linguistic features', which can classify and tag appropriately verbal expressions of emotions. (4) Adopting the linguistic tag sets proposed by ISO and TEI and providing the mapping table between our classification of emotions and Plutchik's, our ontology can be easily employed for multilingual processing.

• Journal of Korea Entertainment Industry Association
• /
• v.13 no.8
• /
• pp.167-180
• /
• 2019

The purpose of this study is to find out the results of synesthesia speech training using similar language for shaping audiobook text. The audiobook text for training uses Tolstoy's work, and uses similar language of tone, tone, pose, speed, intonation, accent, and expression of emotions. The participants who ten visually impaired trainee in H library were selected for qualitative research. Based on the research questions raised in this study, the results are as follows. First, synesthesia training, in which more than two senses of the five senses work simultaneously in voice training for audio book text shaping, produced the result by visualizing the original purpose, meaning, and background of the text. Second, the use of similar language was helpful in the whole process of expressing the meaning of sentence and dialogue for audiobook text shaping. In addition, although there were some differences among the study subjects, they found commonalities that considered tone, pose, and intonation important. Third, the visually impaired have advanced sensory aspects and memory, which resulted in rapid acquisition of metabolism and acceptance of transmission during training. In addition, the teacher's friendly behavior was a very important key mediator in the training process.

• Sijohaknonchong
• /
• v.26
• /
• pp.25-54
• /
• 2007

This paper examines the literatherapy effects of Korea's oldest form of literature, Sijo, and its role in the future of literatherapy. Since literature is the expression of human emotions, and therapy is related to medicine, the two seem to have little in common, but they share the function of resolving conflicts. The effectiveness of literatherapy has only recently become a matter of discussion. However, literatherapy is greatly involved with the utility value of literature, and should be taken seriously. This research focused on the literatherapy function of the 16th-17th century Gangho-Sijo. Gangho-Sijo was created by literary men from the Sarim-school, who were removed from their posts in the government due to a massacre(Sawha) and rianly(Dangjaing), and spent most of their time away from politics. Their Sijo were mostly about life in retreat, and their mental state at that time. In relation to literatherapy, the mentality and attitudes of these scholars can be divided into three stages. The first is anxiety and depression, the second tranquility and harmony. and the third serenity. At the final stage, the scholars are liberated from worldly desires. Each of these phases hold the effect of literatherapy. The first stage can relate to 'theory of purgation', ISO-Prinsip, which is based on 'like cures like' which means to treat something with its own kind Fight fire with fire. The second step involves 'theory of purification', and by balancing his emotions, the scholar can achieve mental stability. In the final stage, literatherapy is acquired when the scholar expresses his emotions in a clarification(theory of clarification). At this phase, literatherapy finally has an effect, while the phase itself functions as literatherapy as well. The study of literatherapy is still at its early stages, thus has many limitations. However, literatherapy has bright prospects, and it is my hope that this report will be used as a reference for its further research.

• Cross-Cultural Studies
• /
• v.31
• /
• pp.371-394
• /
• 2013

This study aims to know word forms and usages according to personal relationships of 'Kureru Kudasaru' by analyzing dialogues of female speakers. Novels of the Meiji period when there were attempts of a language revolution were mainly used for this study as well as novels of the Edo Period and the Taisho Period. Firstly, the number of examples according to gender differences in the novels was as follows. In case of 'Kureru', female speakers showed a high usage rate in the novels of the Edo period. 'Kureru' was mostly connected with female languages such as 'Naharu', 'Namasu', 'Nansu'. These expressions were not used in the novels of the Meiji Period and the Taisho Period. Although 'Okureru' and 'Okurenasaru' were used in the novels of the Meiji Period, the number of examples of 'Kureru' by female speakers was decreased in the novels of the Meiji Period and the Taisho Period. 'Kudasaru' was predominantly used by female speakers. Especially, female speakers used clearly to show vertical relationships in the novels of the Edo Period and"Doseishoseikatagi"of Meiji 10s. After"Ukigumo", the usage rate of female speakers was decreased but the usage rate of male speakers was increased. Gender differences became gradually smaller. Female speakers in the novels were increased from geisha and relatives such as wife, sister, mother and children to young women, teacher and student. Aspects of benefactive verbs' usages could be summarized as follows. Female speakers at licensed quarters used clearer and more typical expressions according to vertical relationships and gender differences in the novels of The Edo Period than the novels of The Meiji Period and the Taisho Period. In the novels of the Meiji Period, female speakers in a sophisticated social group used benefactive verbs to show strong respect and concern for the other person. In the novels of the Taisho Period, female speakers used benefactive verbs to show respect and concern for the other person according to their areas of outside activities. In the novels of the Meiji Period, female speakers used 'Okureru' when the other person was younger than them and was socially and psychologically close to them. Also, 'O~Nasaru' which was one of respect expressions was used by female speakers. Female speakers used it to older people in the Edo period but they also used it to younger people in the Meiji Period. Examples were not shown in the novels of the Taisho Period. Usages of 'Kureru' 'Kudasaru' according to vertical relationships were as follows. If 'a giver' was an older person, 'Kureru' with respect expressions 'Nasaru' 'Nansu' 'Namasu' was used more than 'Kudasaru' in the novels of the Edo Period. However, many examples of 'Kudasaru' were shown on the novels of the Meiji Period and the Taisho period. In the novels of the Meiji Period, 'Okureru' and 'Okurenasaru' which were expressions included in 'Kureru' were shown. Female speakers used them to older people who were socially and psychologically close to them like family. There were not many examples of 'a giver' and 'a receiver' around the same age. However, 'Kureru' and 'Okureru' were used in a younger group and 'Kudasaru' was used in an older group in the novels of the Meiji Period. If 'a giver' was an younger person, 'Kureru' was mainly used in the novels of the Edo period and "Doseishoseikatagi"in Meiji 10s. However, 'Kudasaru' was used many times in the novels of the latter Meiji Period and the Taisho Period.

• The Journal of the Convergence on Culture Technology
• /
• v.4 no.2
• /
• pp.123-130
• /
• 2018

Storytelling is a compound of two words, 'story' and 'telling'. While the static aspect of 'story' has been emphasized, the dynamic and specific aspect of telling has been ignored. So, in the argument of 'storytelling', it is necessary to break from talking about 'story' and discuss the matter in terms of 'telling' and 'interaction'. In order to accept this need, the term 'Traditional Storytelling' is coined to engage 'oral-storytelling situation' more actively. When 'storytelling' is expressed by a storyteller, it can be referred to 'traditional storytelling', called 'oral performance'. In fact, the storytelling, which has a long history, originated from oral storytelling such as 'oral narration'. It is natural that our current storytelling isn't the same storytelling of an oral period, but the traditional storytelling casts a few crucial viewpoints to us these days when 'telling' has a significant meaning. In the first place, it is 'reflexivity' that we should note in the form of traditional 'storytelling'. It is a kind of self-reference which means reflecting and looking back at oneself in the form of narration. Through this reflexivity, the storytelling is affected by the site of telling and an aspect of one-off thing very frequently. Another point we need to note is a frame. Through this frame, the traditional storytelling come to hold time and space of narration.

• Journal of Broadcast Engineering
• /
• v.11 no.1 s.30
• /
• pp.28-41
• /
• 2006

Due to the rapid development of multimedia appliances, the increasing amount of multimedia data enforces the development of automatic video analysis techniques. In this paper, a method of ToC generation is proposed for educational video contents. The proposed method consists of two parts: scene segmentation followed by scene annotation. First, video sequence is divided into scenes by the proposed scene segmentation algorithm utilizing the characteristics of educational video. Then each shot in the scene is annotated in terms of scene type, existence of enclosed caption and main speaker of the shot. The ToC generated by the proposed method represents the structure of a video by the hierarchy of scenes and shots and gives description of each scene and shot by extracted features. Hence the generated ToC can help users to perceive the content of a video at a glance and. to access a desired position of a video easily. Also, the generated ToC automatically by the system can be further edited manually for the refinement to effectively reduce the required time achieving more detailed description of the video content. The experimental result showed that the proposed method can generate ToC for educational video with high accuracy.