• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.12 no.1
• /
• pp.195-199
• /
• 2011

There are many causes for the variation of the result in oral proficiency test such as the examiner, the task, the theme of the interview, and the gender of the participants. Previous literature documents that the rater is an important variable influencing test scores of second language oral proficiency. Although much research in language testing has been conducted concerning rater effect on test scores, there has been little attention paid to the effect of potential rater variables in language testing on their rating process. There are noticeably different contents of the rating scales across different speaking tests developed in different context. Therefore, it would not be appropriate to apply the same rating criteria for various tasks. In conclusion, we need more subject protocol analyses and more thoughtful studies on rating processes. In other words, the oral proficiency test needs a more realistic and valid tool for the assessment of second language proficiency.

• English Language & Literature Teaching
• /
• v.13 no.2
• /
• pp.91-108
• /
• 2007

This study investigates learners' perception on their engagement in rating activities in the EFL essay-writing context. The current study aims to address the answers to the following research questions: 1) What attitude do students show about their participation in the rating tasks? and 2) which of three aspects (e.g. the degree of rating experience, the exposure to English composition instruction and learning, and proficiency level) significantly influences learners' rating activities? 104 EFL learners participated in the rater training session. After participants finished rater training session, they rated three sample essays and peer essays using the given scoring guide. Based on the analysis of survey responses that students made, students showed positive attitude toward their engagement in rating tasks. For research question 2, only L2 writing proficiency seriously affected students' perception on the rating tasks. Advanced level of subjects did not feel stressed by a grade of peers as low level of subjects did. They were also critical about the benefits of self- and peer-assessment, suggesting that a peer's feedback on their own essay was not so useful and that a self-rating does not fully help learners identify their writing proficiency.

• Asia Pacific Journal of Corpus Research
• /
• v.2 no.1
• /
• pp.35-45
• /
• 2021

With the wide spread of the Common European Framework of Reference (CEFR) scales, many studies attempt to apply them in routine teaching and rater training, while more evidence regarding criterial features at different CEFR levels are still urgently needed. The current study aims to explore complexity features that distinguish and predict CEFR proficiency levels in oral performance. Using a quantitative/corpus-based approach, this research analyzed lexical and syntactic complexity features over 80 transcriptions (includes A1, A2, B1 CEFR levels, and native speakers), based on an interview test, Standard Speaking Test (SST). ANOVA and correlation analysis were conducted to exclude insignificant complexity indices before the discriminant analysis. In the result, distinctive differences in complexity between CEFR speaking levels were observed, and with a combination of six major complexity features as predictors, 78.8% of the oral transcriptions were classified into the appropriate CEFR proficiency levels. It further confirms the possibility of predicting CEFR level of L2 learners based on their objective linguistic features. This study can be helpful as an empirical reference in language pedagogy, especially for L2 learners' self-assessment and teachers' prediction of students' proficiency levels. Also, it offers implications for the validation of the rating criteria, and improvement of rating system.

• Journal of the Korean Society for Aviation and Aeronautics
• /
• v.16 no.2
• /
• pp.36-42
• /
• 2008

영어는 1947년부터 국제민간항공기구에 의해 국제 항공공통어로 사용되기 시작하였다. 그러나 원어민을 제외한 대부분 국가의 조종사와 항공교통관제사는 항공영어로 인한 어려움을 토로하고 있으며 항공기 사고의 많은 부분도 항공영어를 사용하는 communication 문제로 발생하고 있다. 이 점을 인식한 ICAO에서는 2008년부터 항공영어의 등급을 제도화하여 비영어권 국가의 항공종사자에 대한 영어능력의 향상을 도모하고 있다. 본 연구는 관제사를 대상으로 한 항공영어교육의 결과를 SPSS11을 이용하여 분석하였다. 분석결과 교육기간과 교육시간이 영어성적 결과에 유의미한 차이를 보이며, 항공영어의 평가요소 6가지가 상호 유의미한 영향을 미치는 것으로 분석되었다.