• Title/Summary/Keyword: Language and non-language

Search Result 819, Processing Time 0.026 seconds

Sign Language Translation Using Deep Convolutional Neural Networks

  • Abiyev, Rahib H.;Arslan, Murat;Idoko, John Bush
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.2
    • /
    • pp.631-653
    • /
    • 2020
  • Sign language is a natural, visually oriented and non-verbal communication channel between people that facilitates communication through facial/bodily expressions, postures and a set of gestures. It is basically used for communication with people who are deaf or hard of hearing. In order to understand such communication quickly and accurately, the design of a successful sign language translation system is considered in this paper. The proposed system includes object detection and classification stages. Firstly, Single Shot Multi Box Detection (SSD) architecture is utilized for hand detection, then a deep learning structure based on the Inception v3 plus Support Vector Machine (SVM) that combines feature extraction and classification stages is proposed to constructively translate the detected hand gestures. A sign language fingerspelling dataset is used for the design of the proposed model. The obtained results and comparative analysis demonstrate the efficiency of using the proposed hybrid structure in sign language translation.

Retroalimentación Positiva de los Profesores Nativos de ELE

  • Choi, Hong-Joo
    • Iberoamérica
    • /
    • v.23 no.2
    • /
    • pp.135-178
    • /
    • 2021
  • A teacher's talk does not make a simple delivery of information. It reflects the role of the teacher, since the language used by a teacher intervenes in a crucial way in the complex mechanisms that underlie teaching and learning of foreign languages. In this sense, the ways in which teachers give feedback have an impact on the process, not only of learning, but also of teaching. The important role of emotional factors in learning has resonated strongly in the intuition of many second and foreign language teachers. As a result, over the past three decades, research on foreign language acquisition has confirmed the hypothesis that language learning is enhanced by rapport between teacher and student. This study analyses the positive feedback given by native Spanish teachers in the context of university classes in Korea. The positive words from a language teacher are related to forming emotional factors such as motivation, attitude, interest, self-confidence, self-esteem, anxiety, and empathy, which directly influence in the acquisition of Spanish. 35 hours of oral practical classes taught by three native teachers of Colombian, Spanish and Mexican nationality were examined. According to the result, almost all the correct answers from students were corresponded with some type of positive feedback. The most frequent strategies are making a compliment, an approval, a repetition, and laughter or non-verbal cues. It is interesting to observe that teachers don't use only a single strategy to provide positive feedback, but instead combine multiple ways to enrich the positiveness of the feedback.

Automatic Coarticulation Detection for Continuous Sign Language Recognition (연속된 수화 인식을 위한 자동화된 Coarticulation 검출)

  • Yang, Hee-Deok;Lee, Seong-Whan
    • Journal of KIISE:Software and Applications
    • /
    • v.36 no.1
    • /
    • pp.82-91
    • /
    • 2009
  • Sign language spotting is the task of detecting and recognizing the signs in a signed utterance. The difficulty of sign language spotting is that the occurrences of signs vary in both motion and shape. Moreover, the signs appear within a continuous gesture stream, interspersed with transitional movements between signs in a vocabulary and non-sign patterns(which include out-of-vocabulary signs, epentheses, and other movements that do not correspond to signs). In this paper, a novel method for designing a threshold model in a conditional random field(CRF) model is proposed. The proposed model performs an adaptive threshold for distinguishing between signs in the vocabulary and non-sign patterns. A hand appearance-based sign verification method, a short-sign detector, and a subsign reasoning method are included to further improve sign language spotting accuracy. Experimental results show that the proposed method can detect signs from continuous data with an 88% spotting rate and can recognize signs from isolated data with a 94% recognition rate, versus 74% and 90% respectively for CRFs without a threshold model, short-sign detector, subsign reasoning, and hand appearance-based sign verification.

Sentence Type Identification in Korean Applications to Korean-Sign Language Translation and Korean Speech Synthesis (한국어 문장 유형의 자동 분류 한국어-수화 변환 및 한국어 음성 합성에의 응용)

  • Chung, Jin-Woo;Lee, Ho-Joon;Park, Jong-C.
    • Journal of the HCI Society of Korea
    • /
    • v.5 no.1
    • /
    • pp.25-35
    • /
    • 2010
  • This paper proposes a method of automatically identifying sentence types in Korean and improving naturalness in sign language generation and speech synthesis using the identified sentence type information. In Korean, sentences are usually categorized into five types: declarative, imperative, propositive, interrogative, and exclamatory. However, it is also known that these types are quite ambiguous to identify in dialogues. In this paper, we present additional morphological and syntactic clues for the sentence type and propose a rule-based procedure for identifying the sentence type using these clues. The experimental results show that our method gives a reasonable performance. We also describe how the sentence type is used to generate non-manual signals in Korean-Korean sign language translation and appropriate intonation in Korean speech synthesis. Since the method of using sentence type information in speech synthesis and sign language generation is not much studied previously, it is anticipated that our method will contribute to research on generating more natural speech and sign language expressions.

  • PDF

Stative and Non-Stative Predicates and Sequence-of-tense Phenomena

  • Song, Mean-Young
    • Proceedings of the Korean Society for Language and Information Conference
    • /
    • 2002.06a
    • /
    • pp.39-47
    • /
    • 2002
  • This paper aims at investigating what semantic interpretation the occurrence of stative and non-statve predicates in the complement clauses of the prepositional attitude verbs make a contribution to, as illustrated in (la-b) and (2a-b). (1) a, John believed that Mary was tired (Ambiguous), b. John believed that Mary walked to school. (2) a. John believes that Mary was sick, b. John believes that Mary is sick.

  • PDF

The Problems and countermasure about entry of headings in Japanese book cataloging (일서일록(日書日錄)에 있어서 표목(標目)의 표기(表記) 방법(方法)에 관한 문제(問題)와 대책(對策))

  • Kim, Chi-Woo
    • Journal of the Korean BIBLIA Society for library and Information Science
    • /
    • v.4 no.1
    • /
    • pp.1-22
    • /
    • 1980
  • It was analysed and considered about entry methods of headings in Japanese book cataloging which using methods of major universities and public libraries in our nation at present. I was suggested and clarified one's position that authors heading must make an entry to our pronunciation after translating from sound of chines letters, title headings must make an entry translation from Japanese title or Chinese title, to Korean. On the cataloging of authors heading or title heading, if cataloging make an entry to Japanese pronunciation it have many faults as follow. (1) In the title and authors heading of Japanese books, if it make an entry as Kana letter, not only non skilled librarian at Japanese language will have many faults but also non skilled users to Japanese language or pronunciation will very difficult to reference in title and authors catalog card. (2) If it Romanize the catalog card of title and authors heading in the Japanese books, librarian of the catalog part will make efforts and take pains to the catalog work. In addition, catalog users which is skilled in Japanese language but can not understand or unknown to the Romanized entry, and which if not understand to the, methods of entry will very difficult to card investigation or can not refer to catalog card. (3) If it make an entry to Korean in the authors and title heading from Japanese sound or pronunciation, librairans and library users which is unskilful as Japanese language will be inconvenience to works and investigation of library materials.

  • PDF

Causal Relationships between Emotional Labor and Emotions and Communication Skills in the Foodservice Industry (외식산업 종사자의 감정노동과 감정노동자의 정서, 커뮤니케이션 스킬간의 인과관계 )

  • Kim, Min-Joo;Kim, Doo-Ra
    • Culinary science and hospitality research
    • /
    • v.14 no.2
    • /
    • pp.73-85
    • /
    • 2008
  • This study is based on an empirical study on consequences of emotions and emotional labor in the food-service industry. It analyzed the effect of emotional labor on emotions of emotional laborers and the effect of emotional labor on communication skills. Data used for analysis were collected through the questionnaire surveyed on the various samples including employees of family restaurants, Korean restaurants, Chinese restaurants, Japanese restaurants, etc. The result of data analysis indicated that only the efforts for emotional expressions among the factors influenced affirmative emotion(P-value=0.042). It also showed that the factor of the efforts for emotional expressions by researchers had a positive effect on both language communication skills and non-language communication skills(P-value=0.000). This study was valuable in the aspect that emotions and communication skills were first selected as dependent variables of emotional labor and it verified causality between emotional labor and these variables. However, it also has some limitations that its sample size was small and it depended on convenience sampling.

  • PDF

Non-D-linked Wh-NPs in Korean and Japanese

  • Son, Gwang-Rak
    • Language and Information
    • /
    • v.8 no.2
    • /
    • pp.93-110
    • /
    • 2004
  • This paper discloses a striking similarity between Korean/Japanese wh-NPs and Italian QPs: both categories are disallowed from LD-movement out of weak islands. This leads us to a substantial claim that wh-phrases in the former languages possibly belong to a non-D-linked category, parallel to the Italian QPs. This claim is also supported by semantic evidence: that is, in-situ wh-NPs in these languages lack covert partitivity (Kyungnam University)

  • PDF

Compositionality Reconsidered: With Special Reference to Cognition

  • Lee, Chungmin
    • Language and Information
    • /
    • v.16 no.2
    • /
    • pp.17-42
    • /
    • 2012
  • The issues of compositionality, materialized ever since Frege (1982), are critically re-examined in language first mainly and then in all other possible representational systems such as thoughts, concept combination, computing, gesture, music, and animal cognition. The notion is regarded as necessary and suggested as neurologically correlated in humans, even if a weakened version is applicable because of non-articulated constituents and contextuality. Compositionality is crucially involved in all linguistically or non-linguistically meaningful expressions, dealing with at-issue content, default content, and even not-at-issue meanings such as implicatures and presuppositions in discourse. It is a constantly guiding principle to show the relation between representation and mind, still posing tantalizing research issues.

  • PDF

A PKI-based Secure Multiagent Engine (PKI 기반의 보안 다중 에이전트 엔진)

  • 장혜진
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.3 no.4
    • /
    • pp.319-324
    • /
    • 2002
  • The Integration of agent technology and security technology is needed to many application areas like electronic commerce. This paper suggests a model of extended multi-agent engine which supports privacy, integrity, authentication and non-repudiation on agent communication. Each agent which is developed with the agent engine is composed of agent engine layer and agent application layer. We describe and use the concepts self-to-self messages, secure communication channel, and distinction of KQML messages in agent application layer and messages in agent engine layer. The suggested agent engine provides an agent communication language which is extended to enable secure communication between agents without any modifications or restrictions to content layer and message layer of KQML. Also, in the model of our multi-agent engine, secure communication is expressed and processed transparently on the agent communication language.

  • PDF