• KIPS Transactions on Software and Data Engineering
• /
• v.11 no.8
• /
• pp.325-330
• /
• 2022

This paper conducts the collection and experiment of datasets for deep learning research on sign language such as sign language recognition, sign language translation, and sign language segmentation for Korean sign language. There exist difficulties for deep learning research of sign language. First, it is difficult to recognize sign languages since they contain multiple modalities including hand movements, hand directions, and facial expressions. Second, it is the absence of training data to conduct deep learning research. Currently, KETI dataset is the only known dataset for Korean sign language for deep learning. Sign language datasets for deep learning research are classified into two categories: Isolated sign language and Continuous sign language. Although several foreign sign language datasets have been collected over time. they are also insufficient for deep learning research of sign language. Therefore, we attempted to collect a large-scale Korean sign language dataset and evaluate it using a baseline model named TSPNet which has the performance of SOTA in the field of sign language translation. The collected dataset consists of a total of 11,402 image and text. Our experimental result with the baseline model using the dataset shows BLEU-4 score 3.63, which would be used as a basic performance of a baseline model for Korean sign language dataset. We hope that our experience of collecting Korean sign language dataset helps facilitate further research directions on Korean sign language.

• Physical Therapy Korea
• /
• v.25 no.1
• /
• pp.53-61
• /
• 2018

Background: The process of language translation, adaptation, and cross-cultural validation of tools for use in multiple countries requires the adoption of well-established, comprehensive, and rigorous methodological approaches. Back translation, which is the most recommended method, permits the detection of errors in the translation and the identification of words or phrases that cannot be accurately or literally translated. Objects: The aim of this study was to verify the content validity of a Korean version of a Balance Evaluation Systems test (BESTest) by using a back-translation method. Methods: This research was conducted in six steps: 1) translation of the BESTest into Korean, 2) evaluation of the translation conformity of Korean-translated BESTest, 3) evaluation of the degree of translation comprehension, 4) back translation of Korean BESTest, 5) evaluation of the technical and conceptual equivalence, and 6) completion of the Korean version of BESTest by the translation verification committee. Results: In this study, Korean version of the BESTest achieved a rating of more than 3 (moderate) for translation comprehension, and technical equivalence and conceptual equivalence of back translation were evaluated as 3 (moderate) or more. Conclusion: The Korean version of the BESTest has proven content validity and is an appropriate tool to measure balance function.

• Annual Conference on Human and Language Technology
• /
• 2019.10a
• /
• pp.333-338
• /
• 2019

인코더-디코더(Encoder-decoder)는 현대 기계 번역(Machine translation)의 가장 기본이 되는 모델이다. 인코딩은 마치 인간의 뇌가 출발어(Source language) 문장을 읽고 이해를 하는 과정과 유사하고, 디코딩은 뇌가 이해한 의미를 상응하는 도착어(Target language) 문장으로 재구성하는 행위와 비슷하다. 그렇다면 벡터로 된 인코더 표현은 문장을 읽고 이해함으로써 변화된 뇌의 상태에 해당한다고 볼 수 있다. 사람이 어떤 문장을 잘 번역하기 위해서는 그 문장에 대한 이해가 뒷받침되어야 하는 것처럼, 기계 역시 원 문장이 가진 의미를 제대로 인코딩해야 향상된 성능의 번역이 가능할 것이다. 본 논문에서는 뇌과학에서 뇌 동기화(Brain-to-brain coupling)라 일컫는 현상을 모방해, 출발어와 도착어의 공통된 의미를 인코딩하여 기계 번역 성능 향상에 도움을 줄 수 있는 이중 번역 기법을 소개한다.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2024.01a
• /
• pp.317-319
• /
• 2024

본 논문에서는 비디오 캡셔닝 알고리즘을 적용한 수어 번역 및 행동 인식 알고리즘을 적용한 수어 인식 알고리즘을 제안한다. 본 논문에 사용된 비디오 캡셔닝 알고리즘으로 40개의 연속된 입력 데이터 프레임을 CNN 네트워크를 통해 임베딩 하고 트랜스포머의 입력으로 하여 문장을 출력하였다. 행동 인식 알고리즘은 랜덤 샘플링을 하여 한 영상에 40개의 인덱스에서 40개의 연속된 데이터에 CNN 네트워크를 통해 임베딩하고 GRU, 트랜스포머를 결합한 RNN 모델을 통해 인식 결과를 출력하였다. 수어 번역에서 BLEU-4의 경우 7.85, CIDEr는 53.12를 얻었고 수어 인식으로 96.26%의 인식 정확도를 얻었다.

• Annual Conference on Human and Language Technology
• /
• 1993.10a
• /
• pp.559-570
• /
• 1993

In this article we present a rapid development of a Korean to English translation system, by the help of general English generator, PENMAN. PENMAN is an English sentence generation system, of which input language is a language specially devised for sentence generation, named Sentence Planning Language(SPL). The language SPL has various features that are necessary for generating sentences, covering both syntactic and semantic features. In this development we integrated a Korean language parser based on dependency grammar and the English sentence generator PENMAN, bridging two systems through a converting module, which converts dependency structures produced by Korean parser into SPL for PENMAN.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2019.10a
• /
• pp.552-554
• /
• 2019

Deaf mutism (a hearing-impaired person and speech disorders) communicates using sign language. There are difficulties in communicating by voice. However, sign language can only be limited in communicating with people who know sign language because everyone doesn't use sign language when they communicate. In this paper, a finger language translation system is proposed and implemented as a means for the disabled and the non-disabled to communicate without difficulty. The proposed algorithm recognizes the finger language data by leap motion and self-learns the data using machine learning technology to increase recognition rate. We show performance improvement from the simulation results.

• Proceedings of the Korean Society for Language and Information Conference
• /
• 1994.02a
• /
• pp.153-162
• /
• 1994

• Proceedings of the Korean Society for Language and Information Conference
• /
• 1998.02a
• /
• pp.334-339
• /
• 1998

• Proceedings of the Korean Society for Language and Information Conference
• /
• 1995.02a
• /
• pp.261-266
• /
• 1995

• Proceedings of the Korean Society for Language and Information Conference
• /
• 1996.02a
• /
• pp.53-62
• /
• 1996