• Journal of The Korean Association For Science Education
• /
• v.22 no.1
• /
• pp.176-189
• /
• 2002

The purpose of the study is to develop major types of scoring rubrics of portfolio system, and estimate the reliability of the rubrics developed. The portfolio system was developed by Science Education Laboratory, Chongju National University of Education in summer, 2000. The portfolio is based on the Unit 2, The Layer and Fossil, and Unit 4, Heat and Change of Objects at fourth-grade level. Four types of scoring rubrics, holistic-general, holistic-specific, analytical-general, and analytical-specific, were developed. Students' portfolios were scored and inter-rater and intra-rater reliability were calculated. To estimate inter-rater reliability, 3 elementary teachers per each rubric(total 12) scored 12 students' portfolios. Teachers who used analytical-specific rubric scored only six portfolios because it took much more time than other rubrics. To estimate intra-rater reliability, second scoring was administered by two raters per rubric in two and half month. The results show that holistic-general rubric has high inter-rater and moderate intra-rater reliability. Holistic-specific rubric shows moderate inter- and intra-rater reliability. Analytical-general rubric has high inter-rater and moderate intra-rater reliability. Analytical-specific rubric shows high inter- and intra-rater reliability. The raters feel that general rubrics seems to be practical but not clear. Specific rubrics provide more clear guidelines for scoring but require more time and effort to develop the rubrics. Analytical-specific rubric requires more than two times of time to score each portfolio and is proved to be highly reliable but less practical.

• Journal of The Korean Association For Science Education
• /
• v.38 no.3
• /
• pp.355-367
• /
• 2018

The purposes of this study are 1) to identify systems thinking level and definition, 2) to develop a framework for the assessment of systems thinking level, and 3) to develop a rubric for scoring open-ended written responded test. In order to achieve these purposes, a total of 60 articles were analyzed by using the literature analysis framework. The systems thinking level and definition are identified through the results of systems thinking literature analysis. Based on the systems thinking level and definitions, the research derived a framework that includes the core ideas and evaluation content of each level. In addition, rubric for the scoring of open-ended response test items was revised and supplemented. It is concluded that a content validity test on the tools (systems thinking level and definition, framework for item development, rubric) has been developed in the study. The content validity was verified by 7-science education experts. According to the result of CVI, it was found to be more than .95 in all three tools. Based on the results of this study, the research will develop items that can measure students' level of systems thinking. The construct validity and criterion validity of the developed items should be verified systematically. The research could carry out a validation study for the systems thinking measurement related to the core competence emphasized in the 2015 revised curriculum.

• Journal of the Korean earth science society
• /
• v.41 no.6
• /
• pp.684-694
• /
• 2020

In this study, we developed a rubric for assessing middle school students' conceptual understanding about dew point. For this purpose, we analyzed 9th grade students' responses collected by using a multi-tiers constructed-response item of National Assessment of Educational Achievement (NAEA) and classified the types of the responses according to their characteristics. In addition, we analyzed the distribution of student response types according to mean achievement scores and developed an assessment rubric of conceptual understanding about dew point. The findings are as follows: First, the analysis of student responses to finding dew point in the saturation curve showed that many students had no or lack understanding of the scientific concept of dew point. Second, as a result of analyzing the student response to the water vapor condensation process at dew point, the proportion of scientific conception types was very low, while the proportion of misconception types was relatively high and the types varied as well. Third, a four- level assessment rubric was developed based on the analysis of the distribution of student response types according to the mean achievement scores. Based on the findings, we suggested the development and utilization of assessment rubric in the field of Earth science education.

• Journal of The Korean Association of Information Education
• /
• v.9 no.1
• /
• pp.113-124
• /
• 2005

In this study, we designed and developed a tool to help teachers select and develop effective performance assessment criteria considering characteristics of individual learners. Using this tool, we can analyze preferences of teachers and characteristics of students for each rubric by exploring the classification and association rules through data mining. Those findings can give us guidelines and insights for the development and the selection of performance assessment criteria. The classification rules found are used for the learner-centered evaluation reflecting learners' interests, capabilities, and circumstances. Association rules found are utilized for analyzing teachers' preference, which enable to reduce time and efforts for the development and selection of rubric. Also, this tool supports creation, change, and selection of teachers' rubric linked with the performance assessment of NEIS(National Education Information System).

• Journal of Korean Elementary Science Education
• /
• v.28 no.1
• /
• pp.9-23
• /
• 2009

This research defined professionality of science teacher from the perspective of PCK. An teaching strategy in the in-service teacher training for the gifted education was proposed based on the definition and implemented at an in-service teacher training program for the gifted education in order to explore about the teaching strategy and suggest practical implications that could improve the program. The in-service teacher training teaching strategy proposed in this research consists of three components: 'crafting activity materials', 'conducting inquiry-based experiment', 'developing rubric for identification of giftedness'. The survey carried out for the participants of the teacher training program showed that teachers perceived the importance of the need for the rubric for gifted identification, developing activity materials for the gifted education in science, and developing the rubric of gifted identification as properties for in-service teacher training programs fur the gifted education. However, the insufficiency of time and opportunities for being fully engaged in such a program made teachers feel lack of self-confidence in developing activity materials for the gifted education in science and rubric for gifted identification. Therefore, teacher training programs reflecting real features of the gifted education should be constantly developed and provided to enhance the effectiveness of in-service teacher training programs.

• Journal of Engineering Education Research
• /
• v.13 no.6
• /
• pp.132-142
• /
• 2010

The purpose of this study is to suggest the assessment method for PO6(teamwork) and PO7(communication skill), one of the most important assessment items in engineering accreditation. In this paper, we used the assessment criteria of Rubric, to empirically measure the teamwork and communication skill. Teamwork and communication skill (PO6, PO7) are the most critical social competences in modern society. Numerous studies on education showed that teamwork and communication skill can be enhanced through learning. We, therefore, need to investigate teamwork and communication skill in terms of education. However, research on the assessment method of the engineering accreditation, based on educational view is scarce. In this study, we suggest the assessment criteria of Rubric for PO6 and PO7 with the perspective of the education. We also tried to apply the developed criteria to the related subjects.

• School Mathematics
• /
• v.6 no.1
• /
• pp.21-35
• /
• 2004

This article was to develop a tool and apply it to the high school classrooms for the performance assessment in trigonometry Bloom(1956)'s cognitive domain and holistic rubric and analytic rubric(NCTM, 1999) were used to guide the development of 12 problems. To find validity and credibility of this developed tool, Cronbach n and Rasch's BIGSTEPS were used with the samples of high students, 208, using SPSS 10.0K. The results from the investigation, indicated that the tool was very worth assessing students' achievement and there was no difference between the areas where students lived, but were differences between genders as well as between a specialized high school and preparatory high schools.

• Communications of Mathematical Education
• /
• v.28 no.4
• /
• pp.553-571
• /
• 2014

Mathematical process is an issue in current mathematics education. In this paper discuss how to assess the mathematical process using essay type questions. For this we first suggest the concept of Mathematical Process Oriented Question which is an essay type question and possible to assess mathematical processes, that is, the mathematical communication, reasoning, and problem solving as well as mathematics knowledge. And we develop a framework for developing the mathematical process oriented question and rubric, examples of assessment standards and those questions containing rubric for assessing mathematical processes. The results of this paper can serve as basic data and examples for follow up research about mathematical process assessment.

• Journal of Korean language education
• /
• v.29 no.1
• /
• pp.163-197
• /
• 2018

The present study suggests ways to improve the Korean proficiency screening test through an analysis of WIDA tests. A review of WIDA Screener, WIDA MODEL, and W-APT reveals that each of these three tests consists of four or five tests, corresponding to grade-level clusters. In addition, the WIDA screening tests assess both English for social communication and academic English, according to WIDA's five English Language Development (ELD) standards. Thematic folders of the ELD standards have different ranges of item difficulty, and the WIDA screening tests are adaptive tests. Lastly, the writing tests consist of performance-based tasks, and the rubric is holistic. As suggestions for improvement for Korean screening tests of the KSL curriculum, this study proposes (a) to devise items to assess academic Korean, so as to evaluate students' overall proficiency more accurately, (b) to utilize an adaptive method to screen students' proficiency more efficiently, and (c) to revise the writing tasks and rubric of the current KSL screening tests.

• Human Ecology Research
• /
• v.61 no.2
• /
• pp.195-218
• /
• 2023

The purpose of this study was to present a class case that verified the validity, reliability, and usefulness of a portfolio assessment in a cohousing class in the housing area of home economics. To achieve this objective, 241 male and female students in eight classes of the third grade of a junior high school in Gyeonggi-do, Korea, were enrolled in a project class on establishing a cohousing village in which the portfolio assessment method was applied for a total of 10 sessions for approximately four weeks from May 24 to June 16, 2021. To ensure the validity of the portfolio assessment, we designed the lesson after presenting the curriculum goals in detail using the backward design model and developed a specific rubric and conducted all evaluations and feedback based on the rubric to ensure objectivity and reliability. The online tool Padlet was used as a portfolio, which allowed students to easily upload their work, receive feedback from the teacher, and interact with their peers. After the class, the students reflected on the rubric and were generally satisfied with the class using portfolio assessment. This study is expected to facilitate the use of the portfolio assessment method in the classroom, while also supporting student growth and development.