• 제목/요약/키워드: Movement based language

검색결과 83건 처리시간 0.029초

A Structure and Framework for Sign Language Interaction

  • Kim, Soyoung;Pan, Younghwan
    • 대한인간공학회지
    • /
    • 제34권5호
    • /
    • pp.411-426
    • /
    • 2015
  • Objective: The goal of this thesis is to design the interaction structure and framework of system to recognize sign language. Background: The sign language of meaningful individual gestures is combined to construct a sentence, so it is difficult to interpret and recognize the meaning of hand gesture for system, because of the sequence of continuous gestures. This being so, in order to interpret the meaning of individual gesture correctly, the interaction structure and framework are needed so that they can segment the indication of individual gesture. Method: We analyze 700 sign language words to structuralize the sign language gesture interaction. First of all, we analyze the transformational patterns of the hand gesture. Second, we analyze the movement of the transformational patterns of the hand gesture. Third, we analyze the type of other gestures except hands. Based on this, we design a framework for sign language interaction. Results: We elicited 8 patterns of hand gesture on the basis of the fact on whether the gesture has a change from starting point to ending point. And then, we analyzed the hand movement based on 3 elements: patterns of movement, direction, and whether hand movement is repeating or not. Moreover, we defined 11 movements of other gestures except hands and classified 8 types of interaction. The framework for sign language interaction, which was designed based on this mentioned above, applies to more than 700 individual gestures of the sign language, and can be classified as an individual gesture in spite of situation which has continuous gestures. Conclusion: This study has structuralized in 3 aspects defined to analyze the transformational patterns of the starting point and the ending point of hand shape, hand movement, and other gestures except hands for sign language interaction. Based on this, we designed the framework that can recognize the individual gestures and interpret the meaning more accurately, when meaningful individual gesture is input sequence of continuous gestures. Application: When we develop the system of sign language recognition, we can apply interaction framework to it. Structuralized gesture can be used for using database of sign language, inventing an automatic recognition system, and studying on the action gestures in other areas.

수어 동작 키포인트 중심의 시공간적 정보를 강화한 Sign2Gloss2Text 기반의 수어 번역 (Sign2Gloss2Text-based Sign Language Translation with Enhanced Spatial-temporal Information Centered on Sign Language Movement Keypoints)

  • 김민채;김정은;김하영
    • 한국멀티미디어학회논문지
    • /
    • 제25권10호
    • /
    • pp.1535-1545
    • /
    • 2022
  • Sign language has completely different meaning depending on the direction of the hand or the change of facial expression even with the same gesture. In this respect, it is crucial to capture the spatial-temporal structure information of each movement. However, sign language translation studies based on Sign2Gloss2Text only convey comprehensive spatial-temporal information about the entire sign language movement. Consequently, detailed information (facial expression, gestures, and etc.) of each movement that is important for sign language translation is not emphasized. Accordingly, in this paper, we propose Spatial-temporal Keypoints Centered Sign2Gloss2Text Translation, named STKC-Sign2 Gloss2Text, to supplement the sequential and semantic information of keypoints which are the core of recognizing and translating sign language. STKC-Sign2Gloss2Text consists of two steps, Spatial Keypoints Embedding, which extracts 121 major keypoints from each image, and Temporal Keypoints Embedding, which emphasizes sequential information using Bi-GRU for extracted keypoints of sign language. The proposed model outperformed all Bilingual Evaluation Understudy(BLEU) scores in Development(DEV) and Testing(TEST) than Sign2Gloss2Text as the baseline, and in particular, it proved the effectiveness of the proposed methodology by achieving 23.19, an improvement of 1.87 based on TEST BLEU-4.

Hybrid HMM for Transitional Gesture Classification in Thai Sign Language Translation

  • Jaruwanawat, Arunee;Chotikakamthorn, Nopporn;Werapan, Worawit
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2004년도 ICCAS
    • /
    • pp.1106-1110
    • /
    • 2004
  • A human sign language is generally composed of both static and dynamic gestures. Each gesture is represented by a hand shape, its position, and hand movement (for a dynamic gesture). One of the problems found in automated sign language translation is on segmenting a hand movement that is part of a transitional movement from one hand gesture to another. This transitional gesture conveys no meaning, but serves as a connecting period between two consecutive gestures. Based on the observation that many dynamic gestures as appeared in Thai sign language dictionary are of quasi-periodic nature, a method was developed to differentiate between a (meaningful) dynamic gesture and a transitional movement. However, there are some meaningful dynamic gestures that are of non-periodic nature. Those gestures cannot be distinguished from a transitional movement by using the signal quasi-periodicity. This paper proposes a hybrid method using a combination of the periodicity-based gesture segmentation method with a HMM-based gesture classifier. The HMM classifier is used here to detect dynamic signs of non-periodic nature. Combined with the periodic-based gesture segmentation method, this hybrid scheme can be used to identify segments of a transitional movement. In addition, due to the use of quasi-periodic nature of many dynamic sign gestures, dimensionality of the HMM part of the proposed method is significantly reduced, resulting in computational saving as compared with a standard HMM-based method. Through experiment with real measurement, the proposed method's recognition performance is reported.

  • PDF

Copy Raising Construction in English: A Usage-based Perspective

  • Kim, Jong-Bok
    • 한국언어정보학회지:언어와정보
    • /
    • 제16권2호
    • /
    • pp.1-15
    • /
    • 2012
  • In accounting for the so-called copy raising (CR) in English, the movement perspective has assumed that the embedded subject of the CR verb's sentential complement is raised to the matrix subject, leaving behind its pronominal copy. This kind of movement-based analysis raises both empirical and analytical issues, when considering variations in the pronominal copy constraint. This paper investigates the actual uses of the construction, using online-available corpora. Based on this corpus search, we classify two different types of copy raising predicates (genuine and perception), and discuss their grammatical properties in detail. We suggest that the simple copying rule couched upon movement operations is not enough to capture great variations in the uses of the construction, and show that interpretive constraints, e.g., perceptual characterization condition, play an important role in licensing the construction.

  • PDF

정신분석학적 페미니즘 관점에서의 《어와 만세 백성들아, 여성_독립운동_김해》전시 연구 - L. 이리가레이와 J. 크리스테바의 이론을 중심으로 - (A Study on the Exhibition 《Women_Independence Movement_Gimhae》 from a Psychoanalytic Feminist Point of View: Based on the Theories of L. Irigaray and J. Kristeva)

  • 최정은
    • 예술경영연구
    • /
    • 제55호
    • /
    • pp.155-184
    • /
    • 2020
  • 본 논문은 여성독립운동의 역사를 다루는 전시가 예술작품을 매개로 주제에 접근하고자 하는 방식을 정신분석학적 페미니즘 관점에서 이론적으로 검증하고, 전시기획 단계에서 의도했던 주제가 최종적으로 작품과 전시 전반에 걸쳐 설득적으로 구현되었는가를 살펴보는 것을 그 목적으로 한다. 이를 위해 뤼스 이리가레이와 줄리아 크리스테바의 이론을 중심으로 작품과 전시를 해석함으로써 전시의 공과를 밝히고자한다. 그리고 여성독립운동이라는 주제에 대한 보다 더 근원적인 접근을 위해서는 기존 독립운동 전시 방식과 같은 남성적 언어가 아닌 여성 고유의 주체성을 담아낼 수 있는 여성적 언어에 대한 모색이 필요함을 주장하고 그러한 여성적 언어를 찾는 방법으로 여성적 말하기, 예술과 시적 언어, 모성의 계보학과 여성들의 연대를 제시하고 그에 관한 이론을 바탕으로 전시내용을 분석하였다. 역사를 다루는 전시에서 예술작품이 어떠한 역할을 할 수 있는가를 실제 전시 사례에 대한 이론적 검증을 통해 밝히고 있는 이 논문은 이론과 현장 간의 소통으로서의 의의를 갖는다.

구문요소의 전치에 기반한 문서 워터마킹 (Text Watermarking Based on Syntactic Constituent Movement)

  • 김미영
    • 정보처리학회논문지B
    • /
    • 제16B권1호
    • /
    • pp.79-84
    • /
    • 2009
  • 이 논문은 한국어 문장을 대상으로 구문요소의 전치를 기반으로 한 문서 워터마킹 방법을 제안한다. 한국어와 같은 교착어는 구문요소의 순서가 자유롭기 때문에 구문 트리 기반의 자연어 워터마킹을 위한 좋은 환경을 제공한다. 본 논문에서 제안하는 자연어 워터마킹 방법은 7단계로 구성되어 있다. 첫째, 문장의 구문분석을 수행한다. 다음으로, 구문요소가 해당 절의 범위 안에서만 전치되도록 범위를 한정하기 위하여 구문 트리로부터 각 절을 분할한다. 세 번째로, 전치를 위한 목표 구문요소를 선택한다. 네 번째, 목표 구문요소의 전치 후에도 문장의 의미나 문체의 변화가 최소화되도록 가장 자연스러운 전이위치를 결정한다. 그 후, 목표 구문요소에 대한 워터마크 비트를 삽입한다. 여섯 번째 단계로, 워터마크 비트가 목표 구문요소의 전치 방향과 상응하지 않으면 구문 트리에서 목표 구문요소를 전치한다. 마지막으로 변환된 구문 트리에서 워터마킹된 문서를 얻는다. 실험 결과를 통해 본 논문에서 제안한 방법의 적용률은 91.53%이고, 최종 워터마킹된 문장들 중 부자연스러운 문장의 비율은 23.16%로서 기존 시스템들보다 좋은 결과를 보여준다. 또한 워터마킹된 문장이 원시 문장과 같은 문체를 유지하고, 의미적인 왜곡없이 같은 정보를 나타내고 있다.

현대 독일어 제2형 분사의 형용사 전환에 대한 제약 (Constraints on the Conversion of the Participle II in German)

  • 류병래
    • 한국언어정보학회지:언어와정보
    • /
    • 제6권1호
    • /
    • pp.41-69
    • /
    • 2002
  • This paper addresses the issue of constraints on the conversion of the participle II in German, proposing a constraint-based lexical semantic approach. I argue against the widely accepted syntactic view which is based on the dichotomous distinction of intransitive verbs, which has been advanced by the Unaccusative Hypothesis [Perlmutter (1978)]. Several arguments are also given against the semantic view which is based on some aspectual notions such as 'telicity', 'transformativity' or 'terminativity'. The crucial constraints on the conversion of the participle II in German, it is argued, is instead two lexical semantic entailments, movement with a definite change of location and affectedness. These and other lexical semantic entailments in the sense of Dowty (1991) are encoded into the multiple inheritance type hierarchy of qfpsoa. The proposal made in this paper is based on the multiple inheritance hierarchy which is envisaged in a recent framework of head-driven Phrase Structure Grammar.

  • PDF

미국의 쉬운 언어정책의 제도화와 한국에의 시사점 (A Plain Language Policy Institutionalized in the U.S. and Implications for Korea)

  • 김명희
    • 한국콘텐츠학회논문지
    • /
    • 제15권2호
    • /
    • pp.242-251
    • /
    • 2015
  • 본 연구는 미국의 '쉬운 언어 정책'을 대상으로 정책의 제도화 과정에서의 법령과 추진체계를 분석하고 결론을 도출하여 한국의 쉬운 공공언어 프로젝트에 유의미한 시사점을 제시하는데 목적이 있다. 분석결과를 요약하면 다음과 같다. 첫째, 미국의 쉬운 언어 정책이 제도로 정착되기까지 행정부의 수반인 대통령의 지속적인 관심과 연방기관들의 솔선수범이 중요한 역할을 하였다. 둘째, 미국의 쉬운 언어 정책집행에 있어서 시대별로 마련된 법령들은 연방기관들의 의무적 준수를 끌어낼 수 있도록 기여했다. 셋째, 쉬운 언어 정책의 추진주체는 PLAIN(Plain Language Action and Information Network, 쉬운 언어 활동 정보 네트워크)이라는 행정부처가 아닌 연방공무원과 전문가로 이뤄진 커뮤니티이다. 넷째, 쉬운 언어정책은 공교롭게도 개혁성향의 민주당 출신 대통령들과 행정부로부터 전폭적인 지지와 지원을 받았다. 다섯째, 2000년대 이후 대부분의 연방부처와 기관들은 쉬운 언어 웹사이트를 운영하고 자체적으로 쉬운 언어 프로그램을 보유하고 있다. 결론적으로 현행 미국의 쉬운 언어 정책은 국민과 정부 간 명실상부한 의사소통을 향상시키는 메커니즘이자 신뢰사다리로서의 역할을 수행한다.

Wh-movement in the L2 Learner's Initial Syntax

  • Kim, Jung-Tae
    • 영어어문교육
    • /
    • 제10권2호
    • /
    • pp.1-23
    • /
    • 2004
  • This article reports a bi-directional interlanguage study designed to investigate the initial state of L2 acquisition with regard to English and Korean wh-questions. Based on the UG system in line with the minimalist theory, it was hypothesized that the L2 initial state is characterized by the most economical form of syntax in which no overt wh-movement to Spec-CP is assumed. Results of the early interlanguage study showed that 1) L1 Korean learners of L2 English predominantly produced wh-questions with the fronted wh-word, but without productive wh-movement to the Spec-CP position; and 2) L1 English learners of L2 Korean overwhelmingly produced wh-questions with the wh-word remaining in-situ. These results were interpreted as supporting the minimalist account of the L2 initial grammar in that no overt syntactic wh-movement were adopted in early interlanguages of both English and Korean regardless of the learner's L1.

  • PDF

Interface between Morphology and Syntax: A Constraint-Based and Lexicalist Approach

  • Kim, Jong-Bok
    • 한국언어정보학회지:언어와정보
    • /
    • 제2권1호
    • /
    • pp.177-213
    • /
    • 1998
  • conflicting criterial used in identifying words have called the lexical integrity principle into question. That is, cases where the morphological word does not coincide with the syntactic word have notivated the syntactic view of word derivation, as pointed out by Bresnan and Mchombo(1995). Further, the implicit desire to make the clausal structure of Korean parallel to those posited for English(Chomsky 1991) and French(Pollock 1989) has also led most of the current literature on Korean morphology to claim that Korean verbal inflections head their own functional projections such as AgrP, TP, and MP im syntax. In this paper, I will first argue against such a syntactic view. After reviewing some basic properties of Korean verbal inflections, I will show that the evidence from mismatch phenomena supports the lexical integrity principle over the head-movement theories of word derivation. Then, I will propose a theory of lexical grammar which maintains the lexical integrity principle while retaining the effects of functional projections and syntactic movement.

  • PDF