• Journal of the Korea Society of Computer and Information
• /
• v.15 no.10
• /
• pp.183-190
• /
• 2010

The present study attempted to identify the metacognitive strategies used by L2 writers at the university level as well as their particular aspects which might influence the use of these strategies. Twenty-seven participants, all of whom were enrolled in an English course, were asked to write an expository essay and then complete a questionnaire which includes their beliefs and attitudes toward L2 writing experience and the metacognitive strategies during the writing process. It was found that even though inexpert writers knew and employed as many strategies as the expert counterparts did, they were unsuccessful in the quality of their texts. Simply possessing a repertoire of metacognitive strategies was not enough for successful L2 writing. The failure of the inexpert writers to apply these metacognitive strategies in an effective manner was influenced by affective factors such as anxiety, self-confidence, self-concept, etc. As a result of this study, a pedagogical implication is suggested.

• Annual Conference on Human and Language Technology
• /
• 2021.10a
• /
• pp.384-390
• /
• 2021

본 논문은 영어 에세이 자동 평가를 위한 딥러닝 기반의 새로운 평가 방법론을 제안한다. 어휘, 형태소, 구문, 의미 단계로 이루어진 평가 과정을 통해 자동화된 에세이 평가가 가능하다. 제안하는 방법의 객관성과 신뢰성을 검증하기 위하여 사람이 평가한 점수와 각 단계별 점수 사이의 상관관계 분석을 진행하였으며, 그 결과 제안하는 평가 방법이 유의미함을 알 수 있었다.

• The Journal of the Convergence on Culture Technology
• /
• v.7 no.3
• /
• pp.439-444
• /
• 2021

This study investigates the relationship between syntactic complexity and English proficiency for Korean college students, using the recently developed TAASSC(the Tool for the Automatic Analysis of Syntactic Sophistication and Complexity) program. Essays on the ICNALE(International Corpus Network of Asian Learners of English) corpus were employed and phrasal complexity indices and clausal complexity indices, respectively were used to predict English proficiency level for Korean students. Results of stepwise regression analysis showed that indices of phrasal complexity explained 8% of variance in English proficiency, while indices of clausal complexity accounted for approximately 11%. That is, indices of clausal complexity were slightly better predictors of English proficiency than indices of phrasal complexity, which contradicts Biber et at.(2011)'s claim that phrasal complexity is the hallmark of writing development.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2013.11a
• /
• pp.1290-1293
• /
• 2013

본 논문은 문장 내에서 나타나는 어휘간의 관계를 통해 표현 수준을 자동으로 평가할 수 있는 시스템을 제안한다. 제안하는 방법은 영어에세이 코퍼스 내의 문장에서 발생하는 철자 및 문법의 오류와 함께 어휘와 문법 패턴에 따른 표현난이도를 평가할 수 있는 자질을 생성하고 다양한 기계학습기법을 사용하여 문장의 수준을 평가하고자 하였다. 또한 기존에 연구되어온 규칙기반의 문장 평가시스템을 구현하고 기계학습기법을 이용한 문장 평가시스템과 비교하였다. 이를 통해 철자 및 문법의 오류율뿐만 아니라 표현난이도를 평가할 수 있는 자질들이 유용함을 확인할 수 있었다. 영어작문 문장의 수준평가를 위해서 국내 학생들의 토플 에세이 코퍼스를 수집하여 2,000문장을 추출하였고, 4명의 전문평가자들을 통해 6단계로 평가하여 학습 및 테스트 세트를 구성하였다. 성능척도로는 정확률과 재현율을 사용하였으며, 제안하는 방법으로 67.3%의 정확률과 67.1%의 재현율을 보였다.

• Annual Conference on Human and Language Technology
• /
• 2011.10a
• /
• pp.25-29
• /
• 2011

영어 논술 자동 평가 시스템은 수험자가 쓴 에세이에 대하여 전문 평가자가 직접 읽고 평가하는 방식에서 벗어나 웹상에서 자동으로 평가 받을 수 있는 실시간 시스템이다. 하지만 비영어권 수험자에게는 논리력 혹은 작문 능력보다 그것을 영어로 표현하는 유창성에서 더 큰 문제가 있을 수 있는데 기존 연구에서는 이런 측면에 대한 평가가 부족하였다. 본 연구에서는 보다 정확한 비영어권 수험자의 영어 논술 평가를 위해 어휘력, 문장 구조의 다양성, 문장의 혼잡도를 평가하여 언어 유창성에 집중된 기계학습 방법의 추가적인 자질을 제안한다. 실험 결과 전문 평가자의 점수와 1) 상관관계 2) 정확도 측면에서 제안하는 방법은 기존의 방법에 비해 더 나은 성능을 보였다.

• The Journal of the Convergence on Culture Technology
• /
• v.7 no.3
• /
• pp.433-438
• /
• 2021

This study investigates the relationship between lexical sophistication features and English proficiency for Korean college students. Essays from the ICNALE(International Corpus Network of Asian Learners of English) corpus were analyzed, using TAALES program. In order to examine whether or not there are statistically significant differences in lexical sophistication features across three groups, MANOVA was conducted. Results showed that the lexical sophistication features were significantly affected by English proficiency level. Essays written by Korean students with different English proficiency levels can be differentiated in terms of various lexical sophistication features including content words frequency, content words familiarity, lexical decision mean reaction time function words, hypernymy verbs, word naming response time function words, age of acquisition content words.

• Journal of the Korea Convergence Society
• /
• v.13 no.3
• /
• pp.55-65
• /
• 2022

As Internet and mobile technology is developing, the educational environment is changing from the traditional passive way into an active one driven by learners. It is important to construct the proper learner's profile for personalized education where learners are able to study according to their learning levels. The existing studies on ICT-based personalized education have mostly focused on vocabulary and learning contents. In this paper, learning profile is constructed with not only vocabulary but grammar to define a learner's learning status in more detailed way. A proficiency metric is defined which shows how a learner is accustomed to the learning contents. The simulational results present the suggested approach is effective to the evaluation essay data with each learner's proficiency that is determined after pre-learning process. Additionally, the proposed analysis technique enables to provide statistics or graphs of the learner's status and necessary data for the learner's learning contents.

• The Journal of the Convergence on Culture Technology
• /
• v.8 no.2
• /
• pp.315-319
• /
• 2022

This study investigates longitudinal writing development in terms of syntactic complexity using linear mixed effects (LME) model. This study employs essays written by four case study participants. Participants voluntarily wrote essays outside of the classroom and submitted the first and second drafts, after reflecting on the automated writing evaluation feedback (i.e., Criterion) every month over one year. A total of 48 first drafts were analyzed and syntactic complexity features were selected from Syntactic Complexity Analyzer. Results of LME showed that there was a significant positive linear relationship between time and mean length of T-unit and also between time and the ratio of dependent clauses to independent clauses, indicating that case study participants wrote longer T-units and also a higher proportion of dependent clauses over one year.

• The Journal of the Convergence on Culture Technology
• /
• v.8 no.5
• /
• pp.691-696
• /
• 2022

This study explored the lexical sophistication features to distinguish the group membership of English proficiency, using the automatic analysis program of lexical sophistication. A total of 600 essays written by 300 Korean college students were extracted from the ICNALE (International Corpus Network of Asian Learners of English) corpus and a discriminant function analysis was performed using SPSS program. Results showed that the lexical features to distinguish three groups of English proficiency are SUBTLEXUS frequency content words, age of acquisition content words, lexical decision mean reaction time function words, and hypernymy verbs. High-level Korean students used frequent content words from SUBTLEXUS corpus to a lesser degree and produced more sophisticated words that can be learned at a later age and take longer reaction time in lexical decision task, and more concrete verbs.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2015.04a
• /
• pp.787-790
• /
• 2015

본 연구에서는 글의 구성요소를 추측하는 가장 높은 성능을 나타내는 알고리즘을 제시한다. 실험 방법은 글의 각 문장에 대한 자질을 추출, 자질 선택, 그리고 데이터에 대해 여러 기계학습 알고리즘을 학습시킨 후 성능을 비교하여 진행하였다. 또한 이 중 가장 높은 성능을 보이는 CRF를 기존에 연구되어 있는 성능과도 비교하였다. 마지막으로 CRF가 구성요소를 추측하는 데 있어서 가장 높은 성능을 보이는 이유에 대해 분석하였다. 국내의 유명 어학원 및 토플 웹사이트를 통해 1969개의 토플 에세이를 수집했으며 2명의 전문 평가자를 통해 각 문장을 8개의 분류로 나누었다. 이를 CRF를 적용한 결과 87.2%의 F score가 나왔으며 기존 연구결과, 그리고 다른 알고리즘보다 높은 성능을 보였다.