• Journal of the Ergonomics Society of Korea
• /
• v.34 no.5
• /
• pp.411-426
• /
• 2015

Objective: The goal of this thesis is to design the interaction structure and framework of system to recognize sign language. Background: The sign language of meaningful individual gestures is combined to construct a sentence, so it is difficult to interpret and recognize the meaning of hand gesture for system, because of the sequence of continuous gestures. This being so, in order to interpret the meaning of individual gesture correctly, the interaction structure and framework are needed so that they can segment the indication of individual gesture. Method: We analyze 700 sign language words to structuralize the sign language gesture interaction. First of all, we analyze the transformational patterns of the hand gesture. Second, we analyze the movement of the transformational patterns of the hand gesture. Third, we analyze the type of other gestures except hands. Based on this, we design a framework for sign language interaction. Results: We elicited 8 patterns of hand gesture on the basis of the fact on whether the gesture has a change from starting point to ending point. And then, we analyzed the hand movement based on 3 elements: patterns of movement, direction, and whether hand movement is repeating or not. Moreover, we defined 11 movements of other gestures except hands and classified 8 types of interaction. The framework for sign language interaction, which was designed based on this mentioned above, applies to more than 700 individual gestures of the sign language, and can be classified as an individual gesture in spite of situation which has continuous gestures. Conclusion: This study has structuralized in 3 aspects defined to analyze the transformational patterns of the starting point and the ending point of hand shape, hand movement, and other gestures except hands for sign language interaction. Based on this, we designed the framework that can recognize the individual gestures and interpret the meaning more accurately, when meaningful individual gesture is input sequence of continuous gestures. Application: When we develop the system of sign language recognition, we can apply interaction framework to it. Structuralized gesture can be used for using database of sign language, inventing an automatic recognition system, and studying on the action gestures in other areas.

• Journal of Korea Multimedia Society
• /
• v.25 no.10
• /
• pp.1535-1545
• /
• 2022

Sign language has completely different meaning depending on the direction of the hand or the change of facial expression even with the same gesture. In this respect, it is crucial to capture the spatial-temporal structure information of each movement. However, sign language translation studies based on Sign2Gloss2Text only convey comprehensive spatial-temporal information about the entire sign language movement. Consequently, detailed information (facial expression, gestures, and etc.) of each movement that is important for sign language translation is not emphasized. Accordingly, in this paper, we propose Spatial-temporal Keypoints Centered Sign2Gloss2Text Translation, named STKC-Sign2 Gloss2Text, to supplement the sequential and semantic information of keypoints which are the core of recognizing and translating sign language. STKC-Sign2Gloss2Text consists of two steps, Spatial Keypoints Embedding, which extracts 121 major keypoints from each image, and Temporal Keypoints Embedding, which emphasizes sequential information using Bi-GRU for extracted keypoints of sign language. The proposed model outperformed all Bilingual Evaluation Understudy(BLEU) scores in Development(DEV) and Testing(TEST) than Sign2Gloss2Text as the baseline, and in particular, it proved the effectiveness of the proposed methodology by achieving 23.19, an improvement of 1.87 based on TEST BLEU-4.

• 제어로봇시스템학회:학술대회논문집
• /
• 2004.08a
• /
• pp.1106-1110
• /
• 2004

A human sign language is generally composed of both static and dynamic gestures. Each gesture is represented by a hand shape, its position, and hand movement (for a dynamic gesture). One of the problems found in automated sign language translation is on segmenting a hand movement that is part of a transitional movement from one hand gesture to another. This transitional gesture conveys no meaning, but serves as a connecting period between two consecutive gestures. Based on the observation that many dynamic gestures as appeared in Thai sign language dictionary are of quasi-periodic nature, a method was developed to differentiate between a (meaningful) dynamic gesture and a transitional movement. However, there are some meaningful dynamic gestures that are of non-periodic nature. Those gestures cannot be distinguished from a transitional movement by using the signal quasi-periodicity. This paper proposes a hybrid method using a combination of the periodicity-based gesture segmentation method with a HMM-based gesture classifier. The HMM classifier is used here to detect dynamic signs of non-periodic nature. Combined with the periodic-based gesture segmentation method, this hybrid scheme can be used to identify segments of a transitional movement. In addition, due to the use of quasi-periodic nature of many dynamic sign gestures, dimensionality of the HMM part of the proposed method is significantly reduced, resulting in computational saving as compared with a standard HMM-based method. Through experiment with real measurement, the proposed method's recognition performance is reported.

• Language and Information
• /
• v.16 no.2
• /
• pp.1-15
• /
• 2012

In accounting for the so-called copy raising (CR) in English, the movement perspective has assumed that the embedded subject of the CR verb's sentential complement is raised to the matrix subject, leaving behind its pronominal copy. This kind of movement-based analysis raises both empirical and analytical issues, when considering variations in the pronominal copy constraint. This paper investigates the actual uses of the construction, using online-available corpora. Based on this corpus search, we classify two different types of copy raising predicates (genuine and perception), and discuss their grammatical properties in detail. We suggest that the simple copying rule couched upon movement operations is not enough to capture great variations in the uses of the construction, and show that interpretive constraints, e.g., perceptual characterization condition, play an important role in licensing the construction.

• Korean Association of Arts Management
• /
• no.55
• /
• pp.155-184
• /
• 2020

This paper aims to reveal the merits and demerits of the exhibition by examining whether the subject intended at the exhibition planning stage was finally persuasively implemented throughout the work and exhibition, along with the theoretical verification of the way the exhibition dealing with the history of the women's independence movement from the psychoanalytic feminist point of view. To this end, a more fundamental approach to the theme of the Women's Independence Movement calls for the search for a feminine language that can capture women's unique identity rather than a masculine language such as the existing independence movement exhibition method, and for finding such feminine language, a feminine speech, art and poetic language, maternal genealogy, and women's solidarity are presented, along with theories. This paper, which expounds the role of art works in exhibitions dealing with history through theoretical verification of actual exhibition cases, has significance as communication between theory and field.

• The KIPS Transactions:PartB
• /
• v.16B no.1
• /
• pp.79-84
• /
• 2009

This paper explores a method of text watermarking for agglutinative languages and develops a syntactic tree-based syntactic constituent movement scheme. Agglutinative languages provide a good ground for the syntactic tree-based natural language watermarking because syntactic constituent order is relatively free. Our proposed natural language watermarking method consists of seven procedures. First, we construct a syntactic dependency tree of unmarked text. Next, we perform clausal segmentation from the syntactic tree. Third, we choose target syntactic constituents, which will move within its clause. Fourth, we determine the movement direction of the target constituents. Then, we embed a watermark bit for each target constituent. Sixth, if the watermark bit does not coincide with the direction of the target constituent movement, we displace the target constituent in the syntactic tree. Finally, from the modified syntactic tree, we obtain a marked text. From the experimental results, we show that the coverage of our method is 91.53%, and the rate of unnatural sentences of marked text is 23.16%, which is better than that of previous systems. Experimental results also show that the marked text keeps the same style, and it has the same information without semantic distortion.

• Language and Information
• /
• v.6 no.1
• /
• pp.41-69
• /
• 2002

This paper addresses the issue of constraints on the conversion of the participle II in German, proposing a constraint-based lexical semantic approach. I argue against the widely accepted syntactic view which is based on the dichotomous distinction of intransitive verbs, which has been advanced by the Unaccusative Hypothesis [Perlmutter (1978)]. Several arguments are also given against the semantic view which is based on some aspectual notions such as 'telicity', 'transformativity' or 'terminativity'. The crucial constraints on the conversion of the participle II in German, it is argued, is instead two lexical semantic entailments, movement with a definite change of location and affectedness. These and other lexical semantic entailments in the sense of Dowty (1991) are encoded into the multiple inheritance type hierarchy of qfpsoa. The proposal made in this paper is based on the multiple inheritance hierarchy which is envisaged in a recent framework of head-driven Phrase Structure Grammar.

• The Journal of the Korea Contents Association
• /
• v.15 no.2
• /
• pp.242-251
• /
• 2015

This paper is to analyse statutes and execution system on 'plain language policy' of the U.S. in the process of policy was instituted, and to suggest the meaningful implications for Korean easy public language improvement project based on the conclusions drawn. The summarized conclusion is as follows. First, the continuous interests of Presidents and taking the lead of federal agencies played important roles until the U.S. plain language policy has been established as a system. Second, in executing the U.S. plain language policy, laws legislated by period contributed to elicit mandatory compliances from the federal agencies. Third, a propelling agent of plain language policy, PLAIN, is not an administrative department but a community consisted of federal employees and experts. Fourth, plain language policy was unexpectedly given wholehearted support and assistance by Presidents and their administrations from the reform-minded Democratic party. Fifth, during the 2000s most federal departments and agencies held self-managed websites and programs related to plain language. To conclude the current U.S. plain language policy surely performs a mechanism to improve communication and a role as a ladder of trust between the public and government.

• English Language & Literature Teaching
• /
• v.10 no.2
• /
• pp.1-23
• /
• 2004

This article reports a bi-directional interlanguage study designed to investigate the initial state of L2 acquisition with regard to English and Korean wh-questions. Based on the UG system in line with the minimalist theory, it was hypothesized that the L2 initial state is characterized by the most economical form of syntax in which no overt wh-movement to Spec-CP is assumed. Results of the early interlanguage study showed that 1) L1 Korean learners of L2 English predominantly produced wh-questions with the fronted wh-word, but without productive wh-movement to the Spec-CP position; and 2) L1 English learners of L2 Korean overwhelmingly produced wh-questions with the wh-word remaining in-situ. These results were interpreted as supporting the minimalist account of the L2 initial grammar in that no overt syntactic wh-movement were adopted in early interlanguages of both English and Korean regardless of the learner's L1.

• Language and Information
• /
• v.2 no.1
• /
• pp.177-213
• /
• 1998

conflicting criterial used in identifying words have called the lexical integrity principle into question. That is, cases where the morphological word does not coincide with the syntactic word have notivated the syntactic view of word derivation, as pointed out by Bresnan and Mchombo(1995). Further, the implicit desire to make the clausal structure of Korean parallel to those posited for English(Chomsky 1991) and French(Pollock 1989) has also led most of the current literature on Korean morphology to claim that Korean verbal inflections head their own functional projections such as AgrP, TP, and MP im syntax. In this paper, I will first argue against such a syntactic view. After reviewing some basic properties of Korean verbal inflections, I will show that the evidence from mismatch phenomena supports the lexical integrity principle over the head-movement theories of word derivation. Then, I will propose a theory of lexical grammar which maintains the lexical integrity principle while retaining the effects of functional projections and syntactic movement.