• Journal of Korean Elementary Science Education
• /
• v.26 no.4
• /
• pp.385-394
• /
• 2007

In order to investigate elementary school students' readiness to write on scientific subject, we analyzed the participants' draft in elementary student section [National Student Science Writing Contest] which is sponsored by a daily press. As a first step, we designed an assessment framework to analyze the students' writing. It is composed of three domains: scientific thinking, logical validity, creativeness. Each domain has three sub-domains. By using the framework, seven raters scored the students' inquiry reports. The findings reveal that the students needed the training for scientific writing. Especially they had great difficulty in the sub-domain of 'suggestion of rational alternative solution' in scientific thinking domain, the sub-domains of 'clearness' and 'coherence' in logical validity domain, and in the sub-domains of 'creative problem solving' and 'creative presentation' in creative domain.

• Journal of the Korean Home Economics Association
• /
• v.36 no.6
• /
• pp.95-108
• /
• 1998

This study is the second study which was aimed to validate the Infant/ Toddler Environment Rating Scale(ITERS). The test-retest reliability included 10 infant/toddler classes among 30 national/public and private child care centers in Inchon city which had been observed in the first validation study. The Spearman's correlation coefficient for test-retest reliability was ranged from .52 to .84. In addition, two raters observed 10 family day care centers in Inchon city, where two observers independently rated each centers on the ITERS during a single visit. The Spearman's correlation coefficient for interrater reliability was ranged from.72 to .99 For the second measure of content validity, experts who were working in day care centers and who were graduate students, lecturers, or professors majoring child studies rated the appropriateness of each ITERS items for the provision of high-quality programs for infants and toddlers, using a 1(low) to 5(high) scale. The mean rating was ranged from 2.52 to 4.52. In sum, when the rating scores were analyzed by the type of child care centers, national/public child care centers have better quality than private or family child care centers.

• Korean Journal of Child Studies
• /
• v.20 no.4
• /
• pp.141-158
• /
• 1999

This study investigated relationships among family environment, quality of child care center and chlld's stress behaviors. The subjects were 241 boys, 197 girls and their mothers in 7 child care centers in Seoul and Kyonggido. Children's behaviors were evaluated by three raters(mothers, teachers, and observers) in either a family setting or a child care center. The results showed that children who had problem behaviors in their families showed more stress and problem behaviors in the child care centers. Mothers who reported more stressful life events and parental stress had children with more problem behaviors in their families. Observers and teachers reported fewer stress and problem behaviors in child care centers rated as showing high quality of program.

• Physical Therapy Korea
• /
• v.2 no.1
• /
• pp.1-13
• /
• 1995

The purpose of this study was to examine the inter-rater reliability of the Korean translation of the GMFM(Gross Motor Function Measure). Three licensed physical therapists with varying amounts(2 - 6 years) of clinical experience served as raters. Thirty patients with cerebral palsy were subjects for this study. Subjects were 22 boys and 8 girls, aged 1 to 8 years. Reliability of each dimension and each total score of the GMGM were analyzed using ICCs(intraclass correlation coefficients). The reliability of each dimension score ranged from .76 to .98, with the walking, running, and jumping dimension having higher reliability values. The reliability of the total dimension score was .94. We conclude that the GMFM has inter-rater reliability for assessing gross motor function in patients with cerebral palsy.

• Proceedings of the KSPS conference
• /
• 2003.10a
• /
• pp.37-40
• /
• 2003

This paper presents the preliminary result of the automatic pronunciation scoring for non-native English speakers, and shows the developmental process for an English speech recognizer for the educational and evaluational purposes. The proposed speech recognizer, featuring two refined acoustic model sets, implements the noise-robust data compensation, phonetic alignment, highly reliable rejection, key-word and phrase detection, easy-to-use language modeling toolkit, etc., The developed speech recognizer achieves 0.725 as the average correlation between the human raters and the machine scores, based on the speech database YOUTH for training and K-SEC for test.

• English Language & Literature Teaching
• /
• v.17 no.4
• /
• pp.339-356
• /
• 2011

This study explored pre-service English teachers' participation in the development of a rubric and examined evaluation of their own English poetry. The current study would investigate: 1) the pre-service English teachers' perception as a rubric developer and self-evaluator, 2) the number of analytic area that the participants included in their rubrics and the scoring scheme that they designed in their rubrics, and 3) the inter-rater differences between self-assessemnt and expert-assessment across analytic areas. Twenty-four EFL learners participated in the current study. The researchers analyzed the learners' own English poetry, their field notes which contained the process of their writing, their rubrics, scores of self-assessment, and expert raters' scores. The results revealed that learners showed positive responses on learner-directed assessment, that 'content' is the most important area, and that inter-rater difference is small across all analytic areas.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.19 no.38
• /
• pp.159-168
• /
• 1996

Appraisal format is the methods that is used to gether informations related to performance behaviors. Appraisal format has descriptive characteristics including evalustion dimensions, anchors, scales. The purpose of this paper is to study the effectiveness of a format characteristics of the appraisal results through literature review and to explore more approprate appraisal format through comparing three types of formats, graphic scales, BARS, BOS. According to the results, rating format's characteristics can affect the quality of appreisa results in that appraisal format can provide rators with evaluation standards which help raters to evaluate effectively. Specific dimensions are better than gernal one dimension. The effectiveness of scale in some degrees depends on development procedure. In general anchors are important to reduce rating errors and behavioral anchors are better than numeric anchors, The systematically developed BARS and BOS can reduce rating erros but graphic scales has limitstions.

• International Journal of Contents
• /
• v.15 no.4
• /
• pp.97-106
• /
• 2019

EMI (English as a Medium of Instruction) classes are now accepted policy at Korean universities, yet students often struggle with required academic English writings. The present study examined an EMI class that used direct instruction and access to online assistive English writing software. From preliminary analysis, 26 students expressed interest in how an EMI academic writing class could facilitate improved English writing skills. Study participants completed a survey on self-efficacy and learning needs and assignments for an EMI academic writing class. To establish inter-rater reliability, three trained raters assessed the written essays of students prior to and after instructional intervention. Fleiss' Kappas statistics showed moderate reliability. Students' opinions on the use of online software were also analysed. Paired t-test was run on the quality of students' pre- and post-instruction assignments, and there was significant difference in the rated scores. Self-efficacy was found to have moderate positive association with improved post-essay writing scores.

• Proceedings of the KSPS conference
• /
• 2000.07a
• /
• pp.241-254
• /
• 2000

The past decade has witnessed the abundant use of computer in testing language skills such as listening and reading. Compared with these language skills, we have experienced little use of computer in testing a speaking skill including pronunciation. This is largely due to limitations of the current computer technology. One of such limitations for testing pronunciation is to store and automatically evaluate what the learner utters. Due to this limitation, the computer simply stores what the learner utters and raters evaluate it afterward on a certain rating continuum. With the advent of voice recognition technology, however, the computer has been able to test pronunciation in a systematic way. This technology enables the computer to identify, visually show, and evaluate the learner's intonation pattern by means of autocorrection. The evaluation is expressed in terms of the degree in which the learner's intonation pattern overlaps with that of the native speaker of the target language. In particular, the degree is numerically displayed on the screen, and this numeral is considered as the score of the learner's utterance under our testing framework.

• Korean Journal of Child Studies
• /
• v.12 no.2
• /
• pp.78-93
• /
• 1991

The purpose of this study was to develop a rating scale for measuring children's temperament. The subjects were 622(324 boys and 298 girls) 3-to 7-year-old children. The temperament rating scale was composed of 50 items(4-point Liken scales) was based on mother's interview, RITQ and PTQ. The raters were the subjects' mothers. The data were analysed on dimensions of validity, reliability, and item discrimination. Statistical methods were factor analysis, ${\chi}^2$-test, and calculations of Pearson's r Cramer's V and Cronbach's $\alpha$. On validity 5 factors were extracted, which explained 84% of the total common variance. The 5 factors were named 'malleability', 'activity', 'sensitive reactivity', 'eating habits & physical constraints', 'physiological rhythmicity'. Regarding reliability, Cronbach's $\alpha$ appeared between .66 and .81 among the 5 factors. Regarding item discrimination, the degree of discrimination on all 50 items was significant and acceptable.