• Journal of Korean language education
• /
• v.28 no.1
• /
• pp.173-196
• /
• 2017

Writing is a subjective and performative activity. Writing ability has multi-facets and compoundness. To understand the examinees's writing ability accurately and provide effective writing scores, raters first ought to have the competency regarding assessment. Therefore, this study is significant as a fundamental research about rater's characteristics on the TOPIK writing assessment. 150 scripts of the 47th TOPIK examinees were selected randomly, and were further rated independently by 20 raters. The many-facet Rasch model was used to generate individualized feedback reports on each rater's relative severity and consistency with respect to particular categories of the rating scale. This study was analyzed using the FACETS ver 3.71.4 program. Overfit and misfit raters showed many difficulties for noticing the difference between assessment factors and interpreting the criteria. Writing raters appear to have much confusion when interpreting the assessment criteria, and especially, overfit and misfit teachers interpret the criteria arbitrarily. The main reason of overfit and misfit is the confusion about assessment factors and criteria in finding basis for scoring. Therefore, there needs to be more training and research is needed for raters based on this type of writing assessment characteristics. This study is recognized significantly in that it collectively examined writing assessment characteristics of writing raters, and visually confirmed the assessment error aspects of writing assessment.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.10 no.9
• /
• pp.2424-2434
• /
• 2009

This study, centering on public enterprises, has been conducted from 4 different perspectives such as grasping the effects that the factor precedent of the multi-rater feedback affects on the usefulness of evaluation and the effects that the usefulness of evaluation affects on the organizational achievement, checking on whether there is any discrepancy among the effects affecting on the usefulness of evaluation in accordance with the degree of advance training on the evaluation system, and being what kind of effects the usefulness of valuation that the appraised eventually understand affects on the organizational achievement. As result of the study, the factor precedent that are confidence of the appraisers and the support from CEO reasonably affected on the usefulness of evaluation, but the standard referred to evaluation was not reasonable. It became resultantly clear that the confidence of the appraisers held the effect of control from the verification of whether there is the effect of control between the factor precedent and the usefulness of evaluation in accordance with the degree of advance training. However, it turned out that the standard referred to evaluation and the support from CEO held no effect of control. As result, It was possible to confirm that the usefulness of evaluation in this study affects directly or indirectly to the organizational achievement such as organizational immersion, job satisfaction, self development opportunity, and organizational revitalization as influenced by the prior factors, and the advance training was partially effective on the adjusting effect.