• Journal of The Korean Association For Science Education
• /
• v.30 no.2
• /
• pp.275-290
• /
• 2010

In this study, reliabilities of holistic scoring method and analytic scoring method were analyzed in performance assessments of middle school students' science investigation activity. Reliabilities of 2, 3, and 4~7-level rubric ratings for analytic scoring methods were compared to figure out optimized numbers of rubric ratings. Two trained raters rated four activity sheets of 60 students by two rating methods and three kinds of rubric ratings. Internal consistency reliabilities of holistic scoring methods were higher than those of analytic scoring methods, while intrarater reliabilities of analytic scoring were higher than those of holistic scoring methods. Internal consistency reliabilities and intra-rater reliabilities of 3-level rubric rating showed similar patterns of 4~7-level rubric ratings. But students' discriminations, item difficulties and item-response curves showed that the 3-level rubric ratings was reliable. These results suggest that holistic scoring method could be adapted to increase internal consistency reliabilities with improvement in intra-rater reliabilities by rater's conferences. Also, the 3-level rubric rating would be enough for good reliability in case of adapting analytic scoring methods.

• Korean Journal of Childcare and Education
• /
• v.15 no.3
• /
• pp.175-201
• /
• 2019

Objective: This study aims to develop and validate the musicality level of an individual child, based on the on performance tasks rubrics. Methods: The survey was conducted on 284 children(ages 3-5years old from kindergartens and day care centers), their parents, and their 51 teachers. The collected data were calculated and analyzed using SPSS 22.0 and AMOS 22.0. Results: Consisted of two components, two task types, 17 performance tasks, and 41 items in three dimensions. Rubrics were determined and based on the child's best performance, and categorized into five levels. Lastly, the item difficulty and item discriminating power were defined in order to comprehend the item quality analysis, which showed that average scores varied depending on the performance. Conclusion/Implications: The musicality rating scale for young children is significant in order to comprehend musicality levels through the performances of children aged three to five. This study has educational implications in that teachers can connect the results of the ratings to curriculum and promote the development of teaching and learning methodologies based on the musicality levels of individual children.