• Journal of Science Education
• /
• v.48 no.1
• /
• pp.31-46
• /
• 2024

This study analyzes the academic achievement characteristics of Korean fourth graders on the problem solving and inquiry tasks (PSIs) introduced in TIMSS 2019. TIMSS 2019 conducted a computer-based assessment in addition to the traditional paper-based assessment. The PSIs were included only in the computer-based assessment, so 30 countries participated in the PSIs of the computer-based assessment. PSIs consist of integrating multiple content and cognitive domains, including 10 or fewer items. Most of the items are constructed in an open-ended format rather than multiple-choice. The analysis results showed that there were differences in student achievement across countries depending on the inclusion of PSIs. Korea's average achievement score decreased by 1 point. The analysis of individual items showed that students' achievement was somewhat low, and the correct answer rate for male students was generally higher than that for female students in many items. Furthermore, item-by-item analysis revealed that there were items where countries such as England and Finland had higher correct answer rates than traditional high-achieving countries, i.e. Singapore, Taiwan, and Korea. Considering the recent emphasis on integrated education, it seems necessary to review the use of PSIs in assessments in Korea as well.

• Journal of The Korean Association For Science Education
• /
• v.36 no.3
• /
• pp.509-517
• /
• 2016

Previous studies have investigated the similarity between the development of evolutionary explanations and students' conceptual developments on evolution. However, the validity and reliability of the assessment method reflecting the similarity have not been quantitatively examined yet. In addition, no study has examined the conceptual progressions of evolution concept based on contexts although literature has addressed the contextual difference of evolutionary explanation in the history of science. This study examined the validity and reliability of history-of-science-based evolution concept assessment using ordered multiple choice (OMC) methods and Rasch analysis and explored conceptual progression by three contexts (e.g., human, animal, and plant). The evolution concept assessment developed by Ha (2007) was used to examine 1711 elementary, middle, and high school students, and pre- and in-service science teachers' (biology majors and non-majors) evolution concepts. Internal consistency reliability and item response fitness of the OMC method that provide 0- to 4-point scores to creationism, teleology, intentionality, use/disuse, and natural selection respectively met the benchmark based on the Cronbach alpha and MNSQ indices of Rasch analysis. The level of elementary and middle school students' evolution concepts were located between intentionality and use/disuse while the level of high school and non-biology science teachers' evolution concepts were located between use/disuse and natural selection. The conceptual progressions of evolution concepts were differentiated according to three contexts. This study provided the quantitative evidence for the similarity between the development of evolutionary explanations and students' conceptual developments on evolution and suggest new analysis methods (i.e., OMC) of evolution concept assessment.

• Journal of The Korean Association For Science Education
• /
• v.24 no.6
• /
• pp.1235-1244
• /
• 2004

The purpose of the study was to produce resources to help develop instructional methods and programs for school science to reduce gender differences in science achievement by analyzing TIMSS-R results according to item type, benchmark, and content category. Korean male students performed higher than Korean female students and gender differences of Korean students were higher than international means in all item types including multiple-choice, short answer, and extended response type. GDI(Gender Difference Index) of Korean students was lower than international mean in top 10% benchmark but higher than international means in other benchmarks. Korean male students also exhibited higher performance than Korean female students in all content categories except scientific inquiry and the nature of science category. Regarding items that GDIs were higher than 10, the number of items belonged to life science and earth science category was relatively larger and a high percentage of them was not included in school science curriculum. In addition, the items were equally distributed in each performance category. In sum, the study showed various gender differences according to item type, benchmark, and content category. The results could be used to find appropriate instructional methods to reduce gender differences in science achievement.

• The Journal of Korean Association of Computer Education
• /
• v.11 no.1
• /
• pp.65-74
• /
• 2008

In this paper, we introduce an analysis system for answer dataset by using a data mining method. We analyze students' answer data collected from a test including multiple choice question items, and find associations between the items. Analysis of evaluation results based on our system will not only provide correct information on students' achievement levels but also provides a basis for modifying weaknesses of the evaluation procedures, question items, or teaching/learning procedures. Furthermore, it will enable us to improve the quality of question items for future use so that we can secure itemsets of high quality.

• The Journal of Korean Association of Computer Education
• /
• v.21 no.1
• /
• pp.31-42
• /
• 2018

Countries around the world are strengthening informatics education to cope with the development of technology that leads to rapid social change. The last step in the capacity to foster through formal education is high school education. The purpose of this study is to examine the competence and level of informatics curriculum for high school students who aim to enter university in terms of testing tools. In order to carry out the research, we analyzed informatics education related test tools for high school students such as Japan, Germany, and USA. The results of the analysis are as follows: First, both the essay type and the short answer type question are included in the test tool as well as the multiple choice question type. Second, we use the real world model as an item and ask whether we can use computing power for practical problem solving ability. Third, the items directly related to the university education are reflected in the items. This study suggests that it has helped to elucidate the features and discussions of the test tool and establish the development direction of the test tool for informatics education.

• Journal of the Korean Society for Library and Information Science
• /
• v.47 no.2
• /
• pp.181-200
• /
• 2013

The test instrument utilized to diagnose and evaluate a trainee's ability are necessary for an effective information literacy education. Nevertheless, there is a lack of a standardized test instrument to comprehensively measure students' information literacy. The purpose of this study is to develop a standardized test instrument to evaluate the information literacy of middle school students, and to verify the reliability and validity of the test instrument. For this purpose, this study selected factors that can show the information literacy and developed an information literacy test framework that was designed based on Guilford's SOI model and Meeker's SOI-LA test. The test instrument that was developed through this study is a 30-item Web-based multiple-choice test. This study administrated tests in middle school students (794 students joined), and analyzed difficulty, reliability, discrimination index, validity of tests, and reviewed tests items to qualify the standardized test. The cutoff score was also decided when using these tests as a diagnostic information literacy assessment.

• Journal of the Korean earth science society
• /
• v.28 no.4
• /
• pp.405-414
• /
• 2007

This study examined students' achievement of Earth science in the Trends in International Mathematics and Science Study (TIMSS) that was conducted with 46 participating countries in 2003 and analyzed average percent-correct items for Earth science were analyzed in terms of subcategory, item type and cognitive domain. In addition, items showing a gender difference and a big difference in the test scores of Korean and international students were analyzed. Korean students performed higher than the international average, especially in the astronomy-related topic and in the cognitive domain of 'reasoning and analysis'. In an analysis of the five items that Korean students scored lower than the international average, Korean students performed not so well in demonstrating what they understood with drawings and writings. Korean female students showed a difficulty more than male students did in multiple-choice items that asked recalling of factual knowledge and demonstrated lack of confidence in the items that they have not learned yet. Based on the result content organization of Earth science curriculum and ways to improve teaching and loaming methods were recommended.

• Journal of The Korean Association For Science Education
• /
• v.22 no.4
• /
• pp.696-705
• /
• 2002

The main purpose of this study is to investigate whether the correlational reasoning activities could improve middle school students' correlational reasoning abilities. The subjects were 8th grade students, and the correlational reasoning activities of the CASE(cognitive acceleration through science education) program was intervened to the experimental group(n=111) during science class while usual science instruction was given to the control group(n=55). The correlational reasoning test was administered before and after the intervention. The pre-test results showed that most of subjects performed poorly in correlation problems and no significant differences were found between the two groups. In the post-test, the experimental group showed enhanced performance while the control group did not. Therefore it can be concluded that CASE program activities help the students to improve correlational reasoning ability. However, the proportions of students gave correct response were not so high: 27% for the multiple-choice item and about 6% for the essay-type items.

• Communications of Mathematical Education
• /
• v.32 no.3
• /
• pp.435-453
• /
• 2018

The results analysis of National Assessment of Educational Achievement(NAEA) can provide various implications for teaching and learning in the school field. In this study we analyzed the deviation of NAEA achievement level-based correct-answer rate and the distribution of the responses percentages for three years from 2015 to 2017 focused on multiple-choice items. First we calculated the deviation of correct-answer rate between advanced level and proficient level and between proficient level and basic level, and then we selected the items whose deviation of correct-answer rate is more than the third quartile. We explored what the content areas, behavior areas and achievement standards of each item are and what the achievement standards and characteristics of these questions are. Based on the results of the analysis, we intended to derive implications for appropriate teaching-learning methods at each achievement-level.

• Journal of Korean Library and Information Science Society
• /
• v.28
• /
• pp.93-135
• /
• 1998

The purpose of this study was to compare the effectiveness of programmed instruction versus lecture and discussion method on the knowledge of basic reference sources among undergraduate library and information science students. The hypotheses of the study were: 1. Programmed instruction will be more effective than the lecture/discussion method with regard to academic achievement. 2. There will be a significant difference in learning time between the experimental and the control groups. Seventy-eight library and information science students were participated m the study from the two universities in Chungchong Province. A programmed instruction manual, including 4-types of reference sources-dictionary, encyclopaedia, bibliography, indexes and abstracts, 40-item multiple choice post-test, and a questionnaire for the students' attitude toward programmed instruction were developed specifically for this research. The post-test only control-group design was selected for this experimental study. Students were given instruction on the specific reference titles in dictionary, encyclopedia, bibliography, indexes and abstracts. The control group was instructed by the lecture and discussion method while the experimental group completed a programmed instruction manual by themselves. Both the control and the experimental group were tested right after the instruction of 4-types of reference sources. In addition, a questionnaire asking students' attitude toward programmed instruction was administered to the experimental group. The findings from this study are summarized as follows: 1. The results showed that there were no significant difference in the mean of the post test score between the two groups. Therefore, programmed instruction is viable as an alternative method of instruction in the teaching of reference sources. 2. There was a significant difference in the mean of time spending for the leaning of bibliography, indexes and abstracts between the two groups. Accordingly, programmed instruction proved to be more efficient than the conventional lecture/discussion method in terms of learning time. 3. Students showed positive response to programmed instruction and evaluated it very interesting and challenging. In conclusion, the programmed instruction method was just as effective as the lecture/discussion method in the teaching of reference sources. And students' attitude toward the programmed instruction was favorable enough to secure a continued use of this method for the teaching of reference sources.