• Journal of Korean language education
• /
• v.28 no.1
• /
• pp.173-196
• /
• 2017

Writing is a subjective and performative activity. Writing ability has multi-facets and compoundness. To understand the examinees's writing ability accurately and provide effective writing scores, raters first ought to have the competency regarding assessment. Therefore, this study is significant as a fundamental research about rater's characteristics on the TOPIK writing assessment. 150 scripts of the 47th TOPIK examinees were selected randomly, and were further rated independently by 20 raters. The many-facet Rasch model was used to generate individualized feedback reports on each rater's relative severity and consistency with respect to particular categories of the rating scale. This study was analyzed using the FACETS ver 3.71.4 program. Overfit and misfit raters showed many difficulties for noticing the difference between assessment factors and interpreting the criteria. Writing raters appear to have much confusion when interpreting the assessment criteria, and especially, overfit and misfit teachers interpret the criteria arbitrarily. The main reason of overfit and misfit is the confusion about assessment factors and criteria in finding basis for scoring. Therefore, there needs to be more training and research is needed for raters based on this type of writing assessment characteristics. This study is recognized significantly in that it collectively examined writing assessment characteristics of writing raters, and visually confirmed the assessment error aspects of writing assessment.

• Journal of Korean language education
• /
• v.28 no.1
• /
• pp.23-47
• /
• 2017

This research analyzed procedural problems presented in academic writing faced by international students. The result of this research will serve as a basis for suggesting methods of developing a curriculum in Korean writing as a liberal arts education designed for international students. To analyze problems presented in academic writing by international students, the standard of assessment was divided into interaction, knowledge construction, and material quotation. Then, knowledge construction was divided into contents, structure, and expression, and the items were subdivided in each category. These categories of assessment correspond to the genre of academic writing and are different from the existing standard of assessment for academic writing. Applying these standards, this research analyzed 43 texts of academic writing in process for a final paper by international students in an class and presented problems in them. Furthermore, this paper aims to give detailed feedback that can help solve those problems.

• English Language & Literature Teaching
• /
• v.8 no.1
• /
• pp.165-198
• /
• 2002

The purpose of this research is to improve the writing ability of students by an ideal test model of English writing based on strategies of procedural learning stages enhancing the level of students' writing ability. Assessment of writing in the field of English education has been limited so far to very restricted areas with no appropriate scientific scrutiny. Assessment is really meaningful only when it exactly estimates the ability of students. Since English writing competence has become indispensable in this era of global village, writing instruction should be most emphasized. The most forceful method of busting writing instruction is to utilize the so-called washback effect of testing. So, to develop a good test model of writing, the first thing that is required is to inspect writing strategy in steps and, then, testing itself. First of all, analyzed with a special reference to the 6th high school English curriculum were the goals and contents of the syllabus reflected in one kind of junior high textbook and eight different kinds of senior high textbooks. Then questionnaires on the whole area of writing and tendencies of English writing classes were given to 100 English teachers, 300 students. The results of questionnaires were statistically analyzed. Then, some suggestions and opinions about the questioning method were made: the procedural strategy in steps, English writing instruction and test model of assessment were applied to the syllabus referring to teaching plans. On the bases of the results of the questionnaires, three pretests and a final test of English writing were administered to verify the effect of enhanced English writing competence which had been gradually promoted and, through the promotion, produced the test criteria of English writing. In conclusion, guidance and evaluation of English writing through in steps are really indispensable to increase student's practical ability and, accordingly, we are in need of the development of a testing method of useful writing practiced in school class above anything else. So, it is necessary to further the study on methods to assess writing ability on the bases of participation and fluency of students with their keen interest in English. Also, to intensify the effect of the test model, more accommodating reorganization of syllabus is required in our education. For instance, we need a flexible operation in organizing time units from the current 50 minutes to 100-130 minutes.

• Journal of Oriental Neuropsychiatry
• /
• v.25 no.2
• /
• pp.133-142
• /
• 2014

Objectives: The aim of this study was to investigate the effects of handwriting on the writing assessment, according to whether the handwriting is excellent or bad. Methods: A total of 24 elementary and middle school teachers participated in this study and assessed 6 original writings and 6 transcriptions of the same original writings using the HWP 2007 program. Six writings were collected from elementary students of 4th to 6th grades, 3 of 6 students presented with excellent handwriting and 3 of 6 with bad handwriting. The assessments were done according to the standards of propositional knowledge assessment (You & Jeong, 2008). Results: In the excellent handwritings, the rules of orthography and the contents of introduction of the original writings were scored higher than those in the transcriptions. The difference between transcription and original writing showed minus scores in original writing assessments and plus scores in transcription assessments. In the propositional knowledge score and its subscales scores - content knowledge, text knowledge, language knowledge and text context knowledge -, were differences in transcription assessments significantly higher than those in original writing assessments. Several assessment indices - clarity of the ending, contents of introduction, appropriate contents, rules of orthography, structured composition and various vocabularies showed significantly higher differences in transcription assessments than those in original writing assessments. Conclusions: The excellent handwriting could be assessed high and the bad handwriting could be assessed low. These results suggest that we should consider the effects of handwriting factors on the results of writing assessment and that the transcription could be used for an accurate writing assessment.

• Korean Journal of Cognitive Science
• /
• v.30 no.4
• /
• pp.175-197
• /
• 2019

Writing is an activity known to enhance higher level thinking. It allows the writer to utilize, apply, and actively expand the acquired knowledge. One way to increase writing activity in classroom setting is to use peer assessment. In this study, we sought to increase the accuracy of peer assessment by having students discuss about the scoring rubric or by referring to an expert's assessment. One hundred and fifty college students participated in the experiment. In the group that referred to the expert's assessment, the accuracy of peer assessment increased when the same piece of writing was evaluated; however, no such increase was observed when another piece of writing was assessed. On the other hand, in the group that discussed about the scoring rubric, the accuracy of peer assessment remained the same when the same piece of writing was evaluated, but increased when another piece of writing was assessed. Also, in the discussion group, the accuracy increased in proportion to the number of comments during the discussion. The results suggest that active and voluntary participation of students increase the accuracy of peer assessment.

• Korean Journal of Cognitive Science
• /
• v.29 no.2
• /
• pp.85-104
• /
• 2018

Peer assessment in educational setting, refers to activities in which students provide grades or comments on other students' accomplishments such as writing, presentation, or performances. In case of writing, peer assessment can allow instructors to give out more writing assignments, which were often avoided because of the burden of grading. Moreover, grading other students' writing can enhance learning by having students participate in the assessment process. This review will introduce major peer assessment systems and results from empirical studies on peer assessment, examine obstacles to its more wide-spread use, and discuss topics for further research. We hope this paper will facilitate further studies and use of peer assessment in actual educational settings, and eventually lead to many changes in assessment and teaching in Korea.

• English Language & Literature Teaching
• /
• v.13 no.2
• /
• pp.91-108
• /
• 2007

This study investigates learners' perception on their engagement in rating activities in the EFL essay-writing context. The current study aims to address the answers to the following research questions: 1) What attitude do students show about their participation in the rating tasks? and 2) which of three aspects (e.g. the degree of rating experience, the exposure to English composition instruction and learning, and proficiency level) significantly influences learners' rating activities? 104 EFL learners participated in the rater training session. After participants finished rater training session, they rated three sample essays and peer essays using the given scoring guide. Based on the analysis of survey responses that students made, students showed positive attitude toward their engagement in rating tasks. For research question 2, only L2 writing proficiency seriously affected students' perception on the rating tasks. Advanced level of subjects did not feel stressed by a grade of peers as low level of subjects did. They were also critical about the benefits of self- and peer-assessment, suggesting that a peer's feedback on their own essay was not so useful and that a self-rating does not fully help learners identify their writing proficiency.

• Korean Journal of Child Studies
• /
• v.21 no.3
• /
• pp.107-117
• /
• 2000

This study examined a portfolio scale for the assessment of the writing of 295 kindergarten children. The data were analyzed by Spradley's Developmental Research Sequence(DRS), using qualitative methods. Results showed that the writing portfolio scale for 4-year-olds includes "a word or write a children's name" "picture or word with shape of letters" and "scribbling or zig-zag". The writing portfolio scale for 5- and 6-year-olds includes "invented spelling" "write according to sound" and "omitted letters" "write a good hand". The writing portfolio scale for 4-, 5-, and 6-year-olds reflects their writing experience in daily life.

• Journal of Korean Elementary Science Education
• /
• v.26 no.4
• /
• pp.385-394
• /
• 2007

In order to investigate elementary school students' readiness to write on scientific subject, we analyzed the participants' draft in elementary student section [National Student Science Writing Contest] which is sponsored by a daily press. As a first step, we designed an assessment framework to analyze the students' writing. It is composed of three domains: scientific thinking, logical validity, creativeness. Each domain has three sub-domains. By using the framework, seven raters scored the students' inquiry reports. The findings reveal that the students needed the training for scientific writing. Especially they had great difficulty in the sub-domain of 'suggestion of rational alternative solution' in scientific thinking domain, the sub-domains of 'clearness' and 'coherence' in logical validity domain, and in the sub-domains of 'creative problem solving' and 'creative presentation' in creative domain.

• Journal of Engineering Education Research
• /
• v.14 no.6
• /
• pp.51-59
• /
• 2011

The authors have developed a reading & writing textbook for engineering students to improve their communication capability, and also analyzed the outcomes that the students accomplished through the Engineering Reading and Writing class. The reading & writing textbook has been organized to be used as a guidebook with which the engineering students can practically solve the problems that they would face continuously after they finish their regular curriculum and when they are employed. The questionnaire survey analysis has been performed in order to evaluate the textbook contents, lecturing, and learning outcomes for the lecturers and students finished the engineering reading and writing classes. Desirable evaluation has been resulted in the broad areas: subject extraction from the readings, logical understanding, summarizing, practical writing, writing principle, etc.