• Journal of The Korean Association For Science Education
• /
• v.34 no.1
• /
• pp.1-9
• /
• 2014

This study aimed to explore the over-efficacy in problem solving and overconfidence of knowledge of students performing assessments in two different test formats: multiple-choice and supply-type. Two hundred and four female middle school students participated in this study. Multiple-choice and supply-type formats of tests on photosynthesis were used, and each item contained scales indicating one's self-efficacy on problem-solving and confidence of knowledge. The results showed that the correlation coefficients of performance between the two different assessment formats were less than 0.5 and the correlation coefficients between efficacy/confidence and actual performance were less than 0.45. Moreover, students tended to exhibit more over-efficacy and overconfidence in multiple-choice formats. The percentage of over-efficacy and overconfidence was higher in the group that completed the multiple-choice test first followed by the supply-type assessment than in the group that started with the supply-type followed by the multiple-choice assessment. From this study, it can be suggested that more use of supply-type assessment is required in science education. If test administrators require the combination of both multiple-choice and supply-type in an assessment, the supply-type assessment format should come first so that students can maintain the appropriate level of efficacy and confidence. In addition, science educators need to develop new learning programs to enhance students' self-monitoring skills of their problem-solving ability and knowledge.

• Journal of The Korean Association For Science Education
• /
• v.24 no.6
• /
• pp.1143-1157
• /
• 2004

The purpose of this study was to develop HS-VOSTS(High School Students' Views On Science-Technology-Society), which is an instrument that monitors high school students' views on STS. For this study, 23 multiple-choice items were developed on four categories. First, a categorial scheme was constructed. The categorial scheme was based on many instruments that evaluate students' understanding on STS, literature review, and STS learning goal that many researchers had asserted. Second, the multiple-choice items were developed. The development of the items was carried out through four steps. In the first step, some pairs of statement on each subordinate category were formed. Next, the student statement questionaries which were based on the pairs of statement were responded by 772 students. In the second step, the response written by the students were analyzed to common viewpoints and the first multiple-choice items were constructed. In the third step, the semistructured interview with 28 high school students was implemented and the second multiple-choice items were constructed. In the fourth step, the final version of the instrument was developed through the analysis of the students' response on the second multiple-choice items. HS-VOSTS is an useful instrument for monitoring students' beliefs and viewpoints on STS topics. The results of the students' responses to HS-VOSTS items reflect the students' own thoughts directly. These results will give some implications for the curriculum developers, the authors of text books and the educational policy makers as well as the teachers.

• Journal of Educational Research in Mathematics
• /
• v.18 no.2
• /
• pp.239-261
• /
• 2008

This study presents results by the content areas in mathematics. Average performance is provided for five content areas: number, algebra, measurement, geometry, and data. Relative achievement is shown among the content areas for 4 countries in comparison to Korea. In number, Korea had lower average achievement than Singapore, especially for ratio proportion percent. Among 5 countries, Korea had the highest average achievement in algebra and geometry, but the lowest in attributes and units of measurement. In data, Korean students didn't learn the followings successfully: a) comparing characteristics of data sets and using mean, median, range, and shape of distribution, b) interpreting data sets (e.g., draw conclusions, make predictions, and estimate values between and beyond given data points), c) evaluating interpretations of data with respect to correctness and completeness of interpretation.

• Journal of the Korean Chemical Society
• /
• v.65 no.1
• /
• pp.48-57
• /
• 2021

This study analyzed the science assessment items that were conducted by the paper and the computer-based assessment in the TIMSS 2019 pre-test, which is an international academic achievement assessment. We examined whether the test mode influenced the percentage of items answered correctly by each graders. As a result, there was no significant difference in the correct answer rates of science items according to the test media in 4th and 8th graders. Looking at the each graders, the difference in the percentage of correct answers was relatively large in the fourth grader rather than the eighth grader. In terms of items, the difference in the percentage of correct answers was relatively larger for the constructed items than the multiple choice questions. As a result of analyzing the content of science and assessment items on the influence of the test media, the multiple choice items showed little difference between the paper and the computer-based assessment items, but the answer-type items tended to have a lower percentage of correct answers than the paper-based assessment. In addition, by grade, 4th graders showed lower percentages of correct answers in the constructed items than 8th graders. This study provides implications related to the development and introduction of computer-based assessment in Korea, and suggests an educational implications for computer-based assessment to be well established as school evaluation.

• Journal of the Korean Society of Earth Science Education
• /
• v.11 no.2
• /
• pp.125-144
• /
• 2018

The purpose of this study is to analyze the astronomical thinking level of elementary, middle, and high school students using ordered multiple choice items. For this purpose, we constructed a questionnaire comprising three items about spatial thinking and system thinking. This survey was conducted and applied to 1,066 students in the 5th grade, 8th grade, and 11th grade in 12 schools located in Gangwon Province. The collected student response data were analyzed by applying inferential statistics of classical test theory and Rasch model. The results of the analysis were as follows; First, in the level of spatial thinking, students were able to grasp the spatial location and orientation of the celestial body, but were not able to convert the celestial motion of two-dimensional plane into three-dimensional plane, and it was revealed that there is no statistically significant difference in the spatial thinking of students among grade levels. Second, in the level of system thinking, students were able to identify the components and relationship between components of the celestial motion system, but could not identify the patterns of the system, and it was revealed that there was statistically significant difference among the system thinking of students in different grade levels, unlike in spatial thinking. Third, the astronomical thinking expressed in certain context (content) was very similar regardless of grade level, Through this, we could confirm the context-dependency or content-dependency of the astronomical thinking of students. It is expected that the results of this study can be used as basic data for exploring ways to enhance astronomical thinking level in school science classes.

• Journal of The Korean Association For Science Education
• /
• v.19 no.1
• /
• pp.146-158
• /
• 1999

Since 1960' s. aims of science education have changed from attainment of scientific concepts. principles and laws to improvement of science process(or inquiry) skills. According to the science education philosophy like this. our nation has adopted improvement and evaluation of science process(or inquiry) skills in science education. The purpose of this study was to examine the performance of high school students on 4 types of multiple choice items used to access students ability to identify independent and dependent variables. Stimulus materials were either a question focusing on the relationship between two variables. a hypothesis. a description of an experiment. or a description of results of an experiment. Student performance on these item types was compared to this performance on a standard Piagetian interview task of variable identification. The results of the study included: (1) the "hypothesis" type was the most difficult, while the "question" type appeared to be the easiest; (2) the "procedure" item type had a higher correlation with the total interview than any other item type. Among conclusions reached in this study was that although all four item types operated similarly. they did not correlate very highly with the performance assessment by interview.

• Korean Journal of Cognitive Science
• /
• v.28 no.4
• /
• pp.315-328
• /
• 2017

Even though assessment using information and communication technology will most likely lead the future of educational assessment, there is little domestic research on this topic. Computerized assessment will not only cut costs but also measure students' performance in ways not possible before. In this context, this study introduces a tool which can overcome the problems of multiple choice tests, which are most widely used type of assessment in current Korean educational setting. Multiple-choice tests, in which options are presented with the questions, are efficient in that grading can be automated; however, they allow for students who don't know the answer, to find the correct answer from the options. Park(2005) has developed a modified multiple-choice testing system (CMMT) using the interactivity of computers, that presents questions first, and options later for a short time when the student requests for them. The present study was conducted to find out if penalizing wrong answers could lower the possibility of students choosing an answer among the options when they don't know the correct answer. 116 students were tested with the directions that they will be penalized for wrong answers, but not for no response. There were 4 experimental conditions: 2 conditions of high or low percentage of penalizing, each in traditional multiple-choice or CMMT format. The results were analyzed using a two-way ANOVA for the number of no response, the test score and self-report score. Analysis showed that the number of no response was significantly higher for the CMMT format and that test scores were significantly lower when the penalizing percentage was high. The possibility of applying CMMT format tests while penalizing wrong answers in actual testing settings was addressed. In addition, the need for further research in the cognitive sciences to develop computerized assessment tools, was discussed.

• Journal of the Korean Chemical Society
• /
• v.54 no.6
• /
• pp.818-828
• /
• 2010

It has already been 17 years since the first implementation of the Korean College Scholastic Ability Test (CSAT). Having been administered so many CSAT tests including practice tests, criticisms have been made against CAST tests being stuck to the same pattern and focusing mainly on knowledge-based items. To address this issue, we analyzed the chemistry items of the Japanese National Center Test for University Admissions (NCTUA) administered in January of 2009 with regard to content factors, behavioral domains, item types, and noted any peculiarities in comparison to CSAT. Also, we estimated the predicted percentage of correct answers from the perspectives of Korean candidates to arrive at implications for chemistry items of CSAT.

• Journal of Science Education
• /
• v.38 no.1
• /
• pp.168-181
• /
• 2014

The purpose of this study was to monitor evaluation in science education at primary and secondary school in Korea. In order to do this, the survey was administered. The subject was 518 teachers; 292 elementary school teachers, 110 middle school science teachers and 116 general high school science teachers. It was found that the ratio of paper examination increased while that of performance evaluation decreased according to the grade of school. In the science paper examination, the ratio of selection type item was higher than that of supply type item, and the ratio of item belonging to knowledge area was higher than that of item belonging to the inquiry area regardless of the grade of school, teaching career, and teacher's gender. The teachers recognized the necessity of supply type item, but they suffered from the reliability of the result of that item. And it was hard for them to do performance evaluation because it took much time and effort. This study suggested that the high-quality in-service teacher training be provided and laboratory assistants who help the science experiment and grading test papers be employed in order to fulfil the performance evaluation and increase the ratio of supply type item and items belonging to the inquiry area.

• Journal of Science Education
• /
• v.36 no.2
• /
• pp.293-302
• /
• 2012

The purpose of this study was to analyze of the science examination of middle school 7th grade by Klopfer's taxonomy of educational objectives. A total of 645 test items from 10 middle schools were analyzed for this study. The examination items were analyzed according to the objectives of science education, such as behavior and contents area, question types, and the degree of difficulty. It was shown that, when the distribution of behavioral objectives was considered, the items emphasized knowledge and comprehension, and were scientific knowledge oriented. The tests consisted of multiple choice questions at a relatively high rate, compared to short answer questions. Comparing the rate of teachers' expectations to the degree of difficulty, the ratio of "top" was low and that of "medium" was high. The results of this study suggested that using various types of question and multiple levels of content and behavior enabled more effective evaluation of the diverse thinking powers and learning of the students.