• Journal of The Korean Association For Science Education
• /
• v.31 no.1
• /
• pp.32-47
• /
• 2011

The purpose of this study was to analyze the ability to control variables and the ways by which variables are controlled. First, the assessment criteria for evaluating the students' ability to control variables were developed for 8th grade students. Second, the ways variables are controlled were classified from student activity reports. These students' answers were categorized into six types (type A~ type F). Type A is defined as the group that excelled in recognizing the importance of controlling variables, eliminating unnecessary variables and identifying manipulated, dependent and controlled variables. Third, the scores of ability to control variables (CV score) and the classroom test of scientific reasoning (Lawson SRT) scores were measured. The results indicated that the CV score was highly correlated with Lawson SRT scores (r=.67, p<.01). Therefore, the assessment criteria developed in this study was used to evaluate the ability to control variables (CV score) and to measure the students' scientific reasoning.

• Journal of the Korean earth science society
• /
• v.41 no.1
• /
• pp.48-60
• /
• 2020

The purpose of this study is to analyze the patterns and characteristics of changes in integrated process skills during the process of science high school students' inquiry by using group-based trajectory modeling. 59 students participated in this study. Three hypothetico-deductive inquiry tasks were used as an intervention activity. We asked science high school students to perform those three tasks sequentially and to generate reports of the process and results. We evaluated students' reports by four elements (designing inquiry, collecting data, analyzing data, and forming conclusion) of the integrated process skills according to the scoring rubric developed by Lee and Park (2017), and analyzed the level of changes in integrated process skills in those three inquiry tasks by using group-based trajectory modeling. In addition, we analyzed the characteristics of changes in integrated process skills from several perspectives. The findings are as follows: First, concerning the change patterns of students' integrated process skills, all of the four elements were classified into two groups, but the change patterns were very different by elements. Second, regarding the change characteristics of students' integrated process skills, we found the context-dependency of integrated process skills, variation of learning progression for integrated process skills, and jaggedness of integrated process skills level. Based on these findings, we suggested that a couple of ways be sought to improve the integrated process skills of science high school students.

• Journal of the Korean Geographical Society
• /
• v.47 no.6
• /
• pp.934-954
• /
• 2012

Constructed-response items are useful to estimate a higher-order thinking abilities such as sense of place, graphicacy, and geographical imaginations which are aimed by geography education. This study aims to identify the conception of the constructed-response items, to classify those feasible items in geography education, and to propose some comments and suggestions for development and application in Korea. The author tries to classify the constructed-response items by analyzing the NAEP items in the formal aspect and the aspect of cognitive dimension respectively. In the formal aspect, they are classified as 'question-standalone' type and 'material-presenting' type. In the aspect of cognitive dimension, they are classified into three types as 'knowledge-requirement', 'understanding-requirement', and 'applying-requirement'. Some comments and suggestions are as follows. First, it is necessary to develope the constructed-response items that coherent to both content and cognitive dimensions. Second, it is required for students who take an examination to use a great variety of graphics, photos, thematic maps related to geography. Third, we need to inquire the rubric, grade, process to scoring because they are vital to success of the constructed-response items.

• Journal of The Korean Association For Science Education
• /
• v.32 no.1
• /
• pp.160-181
• /
• 2012

The purpose of this study is to understand raters' errors in rating performance assessments of science inquiry. For this, 60 middle school students performed scientific inquiry about sound propagation and 4 trained raters rated their activity sheets. Variance components estimation for the result of the generalizability analysis for the person, task, rater design, the variance components for rater, rater by person and rater by task are about 25%. Among 4 raters, 2 raters' severity is higher than the other two raters and their severities were stabilized. Four raters' rating agreed with each other in 51 cases among the 240 cases. Through the raters' conferences, the rater error types for 189 disagreed cases were identified as one of three types; different salience, severity, and overlooking. The error type 1, different salience, showed 38% of the disagreed cases. Salient task and salient assessment components are different among the raters. The error type 2, severity, showed 25% and the error type 3, overlooking showed 31%. The error type 2 seemed to have happened when the students responses were on the borders of two levels. Error type 3 seemed to have happened when raters overlooked some important part of students' responses because she or he immersed her or himself in one's own salience. To reduce the above rater errors, raters' conference in salience of task and assesment components are needed before performing the holistic scoring of complex tasks. Also raters need to recognize her/his severity and efforts to keep one's own severity. Multiple raters are needed to prevent the errors from being overlooked. The further studies in raters' tendencies and sources of different interpretations on the rubric are suggested.

• Journal of Korean Home Economics Education Association
• /
• v.23 no.3
• /
• pp.69-90
• /
• 2011

To develop the descriptive evaluation questionnaire with high validity and reliability on the Clothing and Textiles section of the middle school Technology & Hone Economics textbook, apply it to students and analyze its results. We made out a draft for descriptive evaluation questionnaire that was based upon the concrete establishment of the goal and the range of evaluation. We also made a rubric for scoring as well as sample answer-sheets. Finally, we completed a total of twenty three descriptive evaluation questions and we applied it to sixty five 2nd-grade students in two classes in a middle school. Descriptive evaluation questionnaire exhibited the relative high validity on each question. Moreover, three graders gave the same score on each question of descriptive evaluation, suggesting that descriptive evaluation questionnaire has the high inter-grader reliability and the strong correlation. But, low academic achievement was generally observed in the subjects. They had difficulty in describing their knowledge via their own language and drawing up accurate and detailed answers. They recognized the positive aspects of descriptive evaluation questionnaire, but they felt it uncomfortable due to study-burden and description itself. To overcome these limitations, it is required that students should experience various materials related to subject contents in classes as well as textbooks, concentrate themselves on finding solutions for problems, expand their scope, and practice describe them in advance. Therefore, the additional training for description evaluation questionnaire will be necessary for the more efficient and discriminative questionnaire. Also the questionnaire with high validity and reliability should be developed and the aggressive and voluntary participation of teachers will be needed.