• Journal of Science Education
• /
• v.41 no.2
• /
• pp.179-194
• /
• 2017

The purpose of this study is to construct two equivalent science relevance recognition test tool after confirming the reliability and validity of the CARS(Changes in Attitude of Relevance to Science) questionnaire to determine the applicability of the items to Korean students and to compare gender and school differences. For this study, 59 items of the CARS scientific relevance test were translated and assigned to 787 middle and high school students (analyed the answer of 300 middle school students and 431 high school students). In order to determine the fit of the CARS question to Korean students and to overcome the limitation of the number of questions, we used the item-linking method of the Rasch model. By analyzing the results of the research, we constructed two equivalent scientific relevance recognition questionnaires of CARS-A and CARS-B with 25 items. The Pearson correlation coefficient of the Rasch scores of the two equivalent test was 0.78. The two types of scientific relevance recognition test tools generated through this study can be used to confirm students' attitude of scientific relevance to daily life, or to confirm the change after a certain class or grade. Through this study, we will discuss the implications of students' perceptions of science associations in science education, and the development and application of tools.

• Journal of The Korean Association For Science Education
• /
• v.40 no.5
• /
• pp.485-502
• /
• 2020

The purpose of this study was to develop an instrument for the measuring students' state curiosity and anxiety by dividing science learning context into three stages: when confronting scientific task, checking the results, learning science concepts, and verify the validity and reliability of the measurement tools developed. For this purpose, based on the theoretical background of various prior studies, science state curiosity and science state anxiety were defined in three stages of the learning context, and preliminary items were developed according to these definitions. The preliminary items were developed with the same number and the basic framework for each stage to identify changes in state curiosity and anxiety. Some preliminary items were refined during the confirming face validity and content validity. As a result of the exploratory and confirmatory factor analysis, the measurement tool consisted of five items of state curiosity and five items of state anxiety (two factors, ten items) at each stage, and confirmed the construct validity of the measurement tool. The Cronbach alpha was 0.8 or higher for each factor or for all items. This measurement tool is meaningful in that it can measure the state curiosity and anxiety applicable in three stages of science learning context and identify the changes.

• Journal of The Korean Association For Science Education
• /
• v.20 no.1
• /
• pp.155-165
• /
• 2000

The purpose of this study was to find out the degree of science problem solving by the information processing types and cognitive styles of 235 6th grade students. The results of this study were as follows. First, as the students got higher scores in the two types of information processing, they could solve more science achievement items and creative problem solving items correctly. And as the students got higher scores in simultaneous information processing test, they could solve more scientific concept understanding items. Secondly, as the students were more field-independent, they could solve more science achievement items and creative problem solving items. And especially in solving scientific concept understanding items, much higher field-independence was required. Finally, there was a significant difference on the distributions of cognitive styles by the information processing types. As the students got higher scores in the two types of information processing, their cognitive style tended to be more field-independent.

• Journal of Science Education
• /
• v.34 no.1
• /
• pp.164-174
• /
• 2010

The purpose of this study was to find out taxonomic characteristics of objectives infered from questions of summative evaluation by analyzing those objectives with Bloom's revised taxonomy of educational objectives. 1,711 questions of midterm and final examinations collected from 25 middle schools were analyzed to classify objective of each question. The major findings of the study were as follows: first, from the analysis of objectives in the knowledge dimension, the assessment of factual knowledge was most prevailing(67.6%) in the biology summative evaluation. In the cognitive process dimension, memory assessment was most dominant(76.1%). Thus, the main objectives of evaluation leaned toward particular classes in the Bloom's revised taxonomy, which was different from the findings of earlier studies on the weights of evaluation areas. Second, the level of the objectives should be determined in consideration of the grade of middle schoolers, as their cognitive level improves with grade. In fact, however, there was no difference among three grades in characteristics of objective taxonomy.

• Journal of The Korean Association For Science Education
• /
• v.24 no.6
• /
• pp.1245-1255
• /
• 2004

The purpose of this study is to develop a valid and reliable evaluating instrument for elementary school fifth and sixth graders. The instrument is developed through R&D procedure, which includes two checks of science specialist and two field trials of the instrument. Evaluating items are content-free for each science inquiry skill. Each science inquiry element is based on SAPA and the 7th curriculum. This study has selected 10 science inquiry skills(observing, classifying, measuring, predicting, inferring, recognizing of a problem, controlling variables, interpreting data, drawing a conclusion, designing an experiment), formulated a clear definition of the elements of science inquiry skills, and established the objectives of evaluation. The content areas are divided into three categories, material and energy, life and environment, and the earth and circulation. Each category contains 10 items. So the instrument consists of 30 items. The content validity of items, objectivity of the scoring keys, and clarity of the items has been checked twice by specialists in science education. At the same time, two field trials were performed to produce the reliability of the instruments, discrimination index, and item difficulty index. The instrument has the content validity is 91.6%, reliability 0.79, objectivity 93.3%, discrimination index 0.30, and item difficulty index 66.1%.

• Journal of The Korean Association For Science Education
• /
• v.35 no.1
• /
• pp.121-130
• /
• 2015

Identifying students' achievement level and reflecting it on educational policy making or instructional improvement by analyzing the results of nationwide standardized assessment is an integral part of accountability in education. On the basis of this premise, we analyzed the characteristics of National Assessment of Educational Achievement (NAEA) items for middle school science subject conducted from 2010 to 2013 by using the option response rate distribution curve, the fittest graph estimated from the response rate of correct/incorrect options by achievement score. Furthermore, we classified the type of option response rate curve in terms of correct and incorrect options. Results of the analysis of option response curve showed that five types of correct option response curve (S-shaped, J-shaped, straight-shaped, F-shaped, and step-shaped) and 4 types of incorrect option response curve (down-slope, flat, mound, and up-slope) were identified. The most common type of items was the combination of S-shaped correct option response curve and down-slope incorrect option response curve, which are considered as appropriate items to discriminate the students according to achievement level. Moreover, correct option response was found to be correlated with incorrect option response. Based on the results, we also discussed some implications on teaching-learning method and classroom assessment in science education.

• Journal of the Korean Chemical Society
• /
• v.59 no.5
• /
• pp.445-453
• /
• 2015

In 2005, descriptive assessment was introduced to increase students’ higher mental ability like problem-solving ability and creativity. Every year the ratio of descriptive assessment increases and it is regarded as an alternative evaluation to a multiple-choice item which measures simplicity knowledge. Externally the descriptive assessment took a root in school, but we can’t say definitely that it meets its original goal. In this paper, science descriptive assessment items of 5 middle schools in Gyeonggi-do were analysed; examiners was interviewed about how well they understood the characteristic of the assessment items. According to the analysis, characteristic of the items are ① unequal distribution of unit, ② difference of item’s type by unit, and ③ disappearance of measuring higher mental ability. It is considered that there are several factors of these characteristic - the lack of teachers’ ability to make assessment item; understanding of assessment instrument. These factors can be explained by the lack of assessment expertise. So the society’s effort is needed to raise teacher’s ability for the descriptive assessment.

• 대한공업교육학회지
• /
• v.36 no.2
• /
• pp.219-238
• /
• 2011

The purpose of this study was to analyze the industrial education items in the teacher recruitment examination for secondary school and make a better proposal. To achieve the purpose, all the industrial education items, which had taken an examination for ten times from the school year 2002 to the most recent year 2011, were analyzed. The results of this study were as follows; First, the number and score ratio of industrial education items had been increased quarterly from the school year 2002 to 2011, but had same sharing in all subjects and fixed since the school year 2010. Second, as the industrial education items had been increased quarterly, they were taken from more various subcategory of industrial education. Recently, the industrial education items on "complex domain" including two more subcategory of industrial education were increased. Third, the industrial education items with science education items was compared from the school year 2009 to 2011. The items on PCK(Pedagogical Content Knowledge) had been increased in the industrial education but the proportion of PCK was lower than science education.

• Journal of Science Education
• /
• v.42 no.2
• /
• pp.198-213
• /
• 2018

In recent years, descriptive evaluation has been gaining importance at school. The purpose of this study is to analyse descriptive evaluation items which have been made by school teachers. 300 items for regular examinations are collected from 7 middle schools (grades 1 through 3) in Gyeongnam Province. Distribution and types of items are examined to compare educational objectives of standard achievements and those of evaluation according to Bloom's revised taxonomy of educational objectives. The result shows that there exist a majority of shared subject units for descriptive evaluation. Huge difference of frequency is also found among subject units and standard achievements. Less than 65% of evaluation items are descriptive and the rest is simple completion or short answers. In addition, it reveals only 40.3% of agreement between educational objectives of standard achievements and those of evaluation items. The interviews with 27 teachers indicate that lack of ability to develop proper items and grading are the major obstacles. In conclusion, systematic training courses are to be provided in order to resolve issues over descriptive evaluation.

• Journal of The Korean Association For Science Education
• /
• v.22 no.1
• /
• pp.40-53
• /
• 2002

This study was based on the analysis of earth and environmental science items in PISA 2000 data. The purpose of this study was to identify i) gender differences in scientific literacy, ii) item characteristics that favored either female or male, and iii) misconceptions that 15-years-old Korean students have in the field of earth and environmental science. The results revealed significant gender differences. Overall, male students demonstrated higher level of achievement than female students. On the other hand, amongst high ability students, female students outperformed male students in open-constructed items. Female students tended to score higher on items that required long answers or items related to scientific processes, whereas male students outperformed female students in science knowledge or items that required data interpretation. The study also revealed that a majority of Korean students had misconceptions in fundamental earth and environmental science knowledge, such as the direction of earth's axis and equator, and the causes of Greenhouse Effect.