• English Language & Literature Teaching
• /
• v.17 no.4
• /
• pp.339-356
• /
• 2011

This study explored pre-service English teachers' participation in the development of a rubric and examined evaluation of their own English poetry. The current study would investigate: 1) the pre-service English teachers' perception as a rubric developer and self-evaluator, 2) the number of analytic area that the participants included in their rubrics and the scoring scheme that they designed in their rubrics, and 3) the inter-rater differences between self-assessemnt and expert-assessment across analytic areas. Twenty-four EFL learners participated in the current study. The researchers analyzed the learners' own English poetry, their field notes which contained the process of their writing, their rubrics, scores of self-assessment, and expert raters' scores. The results revealed that learners showed positive responses on learner-directed assessment, that 'content' is the most important area, and that inter-rater difference is small across all analytic areas.

• Journal of The Korean Association For Science Education
• /
• v.30 no.2
• /
• pp.275-290
• /
• 2010

In this study, reliabilities of holistic scoring method and analytic scoring method were analyzed in performance assessments of middle school students' science investigation activity. Reliabilities of 2, 3, and 4~7-level rubric ratings for analytic scoring methods were compared to figure out optimized numbers of rubric ratings. Two trained raters rated four activity sheets of 60 students by two rating methods and three kinds of rubric ratings. Internal consistency reliabilities of holistic scoring methods were higher than those of analytic scoring methods, while intrarater reliabilities of analytic scoring were higher than those of holistic scoring methods. Internal consistency reliabilities and intra-rater reliabilities of 3-level rubric rating showed similar patterns of 4~7-level rubric ratings. But students' discriminations, item difficulties and item-response curves showed that the 3-level rubric ratings was reliable. These results suggest that holistic scoring method could be adapted to increase internal consistency reliabilities with improvement in intra-rater reliabilities by rater's conferences. Also, the 3-level rubric rating would be enough for good reliability in case of adapting analytic scoring methods.

• Journal of Korean Home Economics Education Association
• /
• v.20 no.3
• /
• pp.85-105
• /
• 2008

The purpose of this study was to develop a narrative analytic scoring rubric through teacher-students negotiations, as an assessment of tasks using methods of experiment and practice for home economic(HE) in the middle school. In this study. an analytic rubric had been developed in the following three stages: In the first stage, all the things for rubric development were defined and prepared, by selecting tasks used for rubric application through a questionnaire survey, providing detailed directions on methods and procedures and needed items, and selecting a class for rubric negotiation and setting the development schedule. In addition, the method suggested by Ainsworth and Christinson(1998) in Student Generated Rubrics was used. In the second stage, performance criteria for tasks in terms of knowledge, skills, and attitude were developed, setting scoring framework and scales depending on assessment areas. Referring to selected scoring framework and assessment criteria, observable and assessable behaviors were used to describe rubric based on A, B, and C scale. Then, a primary rubric was developed through teacher-students negotiations, using rubrics made by group. In the last stage, the developed primary rubric was reviewed by an expert of HE education to test the validity. Moreover, the analysis to test the suitability of the final rubric assessment tool employed 46 copies of questionnaire collected from incumbent home economics teachers selected by way of random sampling mainly focusing on those teachers who were in the Master's degree program or completed the program at one university. As a result, the average of suitability of aa the rubrics were over 4.0 in th 5-point scale.

• School Mathematics
• /
• v.6 no.1
• /
• pp.21-35
• /
• 2004

This article was to develop a tool and apply it to the high school classrooms for the performance assessment in trigonometry Bloom(1956)'s cognitive domain and holistic rubric and analytic rubric(NCTM, 1999) were used to guide the development of 12 problems. To find validity and credibility of this developed tool, Cronbach n and Rasch's BIGSTEPS were used with the samples of high students, 208, using SPSS 10.0K. The results from the investigation, indicated that the tool was very worth assessing students' achievement and there was no difference between the areas where students lived, but were differences between genders as well as between a specialized high school and preparatory high schools.

• The Journal of Korean Academic Society of Nursing Education
• /
• v.23 no.2
• /
• pp.135-145
• /
• 2017

Purpose: The purpose of this study was to develop a program outcomes assessment system based on Course Embedded Assessment for nursing education. Methods: This study was conducted in accordance with the procedures of the developmental research method. Results: The major results are as follows. 1) The program outcomes were measured according to the Analytic Hierarchy Process. 2) The Course Embedded Assessment matrix was made according to program outcomes' weight, the curriculum-organizing principle, and achievement levels. 3) The Course Embedded Assessment rubric was developed in logical process, and consisted of a performance criterion, and rating scale. The content validity index of the Course Embedded Assessment rubric was 0.85. 4) An evaluation guideline and 12 documents were developed to facilitate the performance of the assessment system. 5) The average content validity index of the Course Embedded Assessment-based program outcomes assessment system was as high as 0.89. Conclusion: A Course Embedded Assessment-based program outcomes assessment system is more suitable for accreditation of nursing education than previous studies. Because this system evaluates the process of achievement as well as program outcomes, the results can also serve as immediate feedback to improve the educational process. Above all, this system facilitates that students check their achievements and strive to acquire core competencies in nursing.

• Journal of Korean Home Economics Education Association
• /
• v.21 no.1
• /
• pp.35-49
• /
• 2009

The purpose of this study was to examine the effect of instruction for the development of analytical rubrics based on teacher-student compromise, which would be applied to performance assessment about the ninth-grade housing unit of the 7th national curriculum. In order to find out the influence of the rubric development instruction on learning motivation, two different third-year classes in a middle school were selected respectively as an experimental group and a control group. The way of presenting the rubrics and learning motivation were respectively selected as independent and dependent variables. Both groups took two lessons and a pretest-posttest on learning motivation. As for the analytic rubric for the individual task performance in the housing unit, three evaluation items were selected. As a result, the instruction for the learner-involved development of analytical rubrics for the housing segment had a positive effect on the confidence and satisfaction of the middle schoolers, which were two out of four sub-factors of learning motivation. Open-ended questions showed that the instruction got to build confidence in the course of being aware of the evaluation criteria and fulfilling the given tasks.

• Journal of Oral Medicine and Pain
• /
• v.30 no.1
• /
• pp.35-44
• /
• 2005

Purpose: The aim of this preliminary study was to evaluate the effect of Problem-Based Learning (PBL) curriculum on development of comprehension of basic medical knowledge and quality of semi-structured problem solving including scientific reasoning skill. This scientific reasoning contained five components including: size of simple, design of research cause-effect, construction of risk factor, analysis statistic of data, interpretation of result. Materials and Methods: Seoul National University Dental students (100) participated in this experience during two weeks, 2004. Forty eight multiple-choice questions (MCQ) concerned "Infection Control and Prevention" were asked before and after two sections of Lecture-Based Learning (LBL) and PBL (pretest-posttest control group design). A semi-structured problem in epidemiological research was asked to these students after two sections (posttest-only control group design). Data (mean and SD) were analysed using the t Test for two independent samples (p<.05), comparing PBL versus LBL. Results: Our analyse of scores show no difference between LBL and PBL in the development of comprehension of "Infection Control and Prevention". The quality problem solving (epidemiological research) was significantly different between the two groups (p=.029); specially, two components' scores of reflection on scientific reasoning cause-effect (p=.000) and interpretation of result (p=.001) were significantly better for PBL than for LBL. Conclusion: Theses results indicate that comparing LBL and PBL, PBL curriculum have not been disadvantaged in comprehension of basic knowledge, and have contributed to develop the scientific reasoning in problem solving.