• Journal of The Korean Association For Science Education
• /
• v.30 no.2
• /
• pp.275-290
• /
• 2010

In this study, reliabilities of holistic scoring method and analytic scoring method were analyzed in performance assessments of middle school students' science investigation activity. Reliabilities of 2, 3, and 4~7-level rubric ratings for analytic scoring methods were compared to figure out optimized numbers of rubric ratings. Two trained raters rated four activity sheets of 60 students by two rating methods and three kinds of rubric ratings. Internal consistency reliabilities of holistic scoring methods were higher than those of analytic scoring methods, while intrarater reliabilities of analytic scoring were higher than those of holistic scoring methods. Internal consistency reliabilities and intra-rater reliabilities of 3-level rubric rating showed similar patterns of 4~7-level rubric ratings. But students' discriminations, item difficulties and item-response curves showed that the 3-level rubric ratings was reliable. These results suggest that holistic scoring method could be adapted to increase internal consistency reliabilities with improvement in intra-rater reliabilities by rater's conferences. Also, the 3-level rubric rating would be enough for good reliability in case of adapting analytic scoring methods.

• Journal of the Korean earth science society
• /
• v.41 no.6
• /
• pp.684-694
• /
• 2020

In this study, we developed a rubric for assessing middle school students' conceptual understanding about dew point. For this purpose, we analyzed 9th grade students' responses collected by using a multi-tiers constructed-response item of National Assessment of Educational Achievement (NAEA) and classified the types of the responses according to their characteristics. In addition, we analyzed the distribution of student response types according to mean achievement scores and developed an assessment rubric of conceptual understanding about dew point. The findings are as follows: First, the analysis of student responses to finding dew point in the saturation curve showed that many students had no or lack understanding of the scientific concept of dew point. Second, as a result of analyzing the student response to the water vapor condensation process at dew point, the proportion of scientific conception types was very low, while the proportion of misconception types was relatively high and the types varied as well. Third, a four- level assessment rubric was developed based on the analysis of the distribution of student response types according to the mean achievement scores. Based on the findings, we suggested the development and utilization of assessment rubric in the field of Earth science education.

• Journal of the Korean earth science society
• /
• v.22 no.5
• /
• pp.350-359
• /
• 2001

The purpose of this study is to develop theme-based integrated science unit by the interdisciplinary approach and to analyze it's effects on the science achievement and the attitude towards science learning. 'Interaction' and 'Stability' were selected as the integrated themes, and the main concept and subconcept in relation to the themes were extracted from the four areas of science, and the learning contents were constructed in the integrated ways. While the main concept have relevance to subconcept in the interaction, the main concept have little relevance to subconcept in the stability. Therefore, the stability was to fit with middle school integrated science theme, but the interaction was not. The theme-based integrated science units developed was implemented in middle school, and the results are follows. First, the science achievement of group of theme-based integrated science teaching is significantly higher than those of group of traditional teaching. Second, the scores of the test of attitude toward science learning of the group of theme-based integrated science teaching is significantly higher than those of group of traditional teaching. Third, the students' perception of theme-based integrated science teaching was positive. The students have participation, interest, motivation in theme-based integrated science teaching, and students have difficulty in learning theme-based integrated science teaching.

• The Journal of the Korea Contents Association
• /
• v.16 no.6
• /
• pp.225-235
• /
• 2016

This study aims at developing Reminiscence Function Scale-Short Form(RFS-S) and verifying it as a supplemental diagnosis instrument to judge differences between normal and mild cognitive impairment and useful measure to rate effects of reminiscence therapy in the clinical field through internal consistency reliability and criterion validity. The study also aims at figuring out factors affection reminiscence function by figuring out demographic features of RFS-S. The research subjects were the control group of 60 normal people and experimental group of 58 people with mild cognitive impairment and both groups were over 65 years old. For internal consistency reliability(Cronbach's alpha) between questions was reliable with 0.63. Convergent validities of RFS-S with SRT and CDR-SB were 0.20(p<.05) and -0.25(p<.001), respectively, as both showed significant correlations. As a result of criterion validity to analyze AUROC, it was 0.68(p<.001) and less accurate. Its optimal cut-off points were 17 and sensitivity according to them was 0.59, and specificity was 0.72, respectively. However, reminiscence function according to demographic variables did not show any significant differences. Therefore, it is expected that RFS-S will be used as a supplemental diagnosis instrument with higher reliability and validity for discerning differences between normal and mild cognitive impairment and as a useful one to verify effects of reminiscence therapy.