• Journal of the Korean School Mathematics Society
• /
• v.18 no.4
• /
• pp.431-448
• /
• 2015

Elementary school teacher selection test has to be implemented for knowledge(MKT) to estimate and to be a step in the expansionary direction. For this, It has to be analyzed closely in terms of teacher's MKT first that questions set from selection tests until now. In this research, some standards were established by type of question, grade, contents field and subject from 84 mathematics questions set at examinations. And it was analyzed concretely by general tendency and produced the results of analysis related to elementary teacher's MKT in elementary school teacher selection test since year 2000. The results showed that descriptive and short answer type was mostly set(71.4%) in type of question and integrated grade type was mostly set(41.7%) in type of grade in elementary school teacher selection test. And in type of contents field, rated from highest to lowest, number and operations(31.0%), measurement(23.8%), figure(15.5%) were set. Textbook/manual(34.5%), solution of problem(26.2%), learning psychology(13.1%) in status of subject were followed in order, but there's no relationship with estimation. This research was based on a standard of precedent study and made an analysis of elementary mathematics questions of selection test since year 2000. Therefore, it has a meaning because of produced results from analysis related to elementary teacher's MKT.

• Journal of Science Education
• /
• v.38 no.1
• /
• pp.168-181
• /
• 2014

The purpose of this study was to monitor evaluation in science education at primary and secondary school in Korea. In order to do this, the survey was administered. The subject was 518 teachers; 292 elementary school teachers, 110 middle school science teachers and 116 general high school science teachers. It was found that the ratio of paper examination increased while that of performance evaluation decreased according to the grade of school. In the science paper examination, the ratio of selection type item was higher than that of supply type item, and the ratio of item belonging to knowledge area was higher than that of item belonging to the inquiry area regardless of the grade of school, teaching career, and teacher's gender. The teachers recognized the necessity of supply type item, but they suffered from the reliability of the result of that item. And it was hard for them to do performance evaluation because it took much time and effort. This study suggested that the high-quality in-service teacher training be provided and laboratory assistants who help the science experiment and grading test papers be employed in order to fulfil the performance evaluation and increase the ratio of supply type item and items belonging to the inquiry area.

• The Journal of the Korea Contents Association
• /
• v.21 no.1
• /
• pp.311-320
• /
• 2021

At present, the secondary school teacher employment examination(SSTEE) is the only gateway to become a national and public secondary teacher in Korea, and after the revision from the 2014 academic year, all the questions of the exam have been converted to supply-type test items, requiring more definitive, accurate, and solid answers. Compared to the selection-type test items that measure recognition memory, the supply-type questions, testing recall memory, require constant memorization and retrieval practices to furnish answers; however, there is not enough learning tools available to support the practices. At this juncture, this study invented a mobile app, called ONE PASS, for the SSTEE. By unpacking the functional mechanisms of the brain, the basis of cognitive processing, this ONE PASS app offers a set of tools that feature brain-based learning principles, such as a personalized study planner, motivation measurement scales, mind mapping, brainstorming, and sample questions from previous tests. This study is expected to contribute to the research on the development of learning contents for applications, and at the same time, it hopes to be of some help for candidates in their exam preparation process.

• 대한공업교육학회지
• /
• v.35 no.2
• /
• pp.182-203
• /
• 2010

The purpose of this study was to analyze of Information-related subjects on industry department of college scholastic ability test in Korea and Japan. These were compared with information-related foundation and data-technology foundation, programming on industry department test of vocational education area in college scholastic ability test in Korea and Japan and suggest implications of items development of college scholastic ability test in Korea. Based on the results of study, the following recommendations were made for new direction of items development of college scholastic ability test in Korea. First, Information-related foundation on industry department of National Center for University Entrance Examinations in Japan consisted of basic informations of agricultural, industry, commercial department etc. of vocational education area. Similarly it is necessary to introduce 'computer-related foundation' consist of common contents of several departments of college scholastic ability test in Korea. Second, it is necessary to diverse sub-item situations different from main item situations and introduce diverse situations of set type items of college scholastic ability test in Korea. Third, test for National Center for University Entrance Examinations in Japan consisted of several types items like this selecting answers on multi-answer group. it is necessary to introduce short answer type, completion type and supply type of college scholastic ability test in Korea.

• Journal of the Korean earth science society
• /
• v.41 no.6
• /
• pp.684-694
• /
• 2020

In this study, we developed a rubric for assessing middle school students' conceptual understanding about dew point. For this purpose, we analyzed 9th grade students' responses collected by using a multi-tiers constructed-response item of National Assessment of Educational Achievement (NAEA) and classified the types of the responses according to their characteristics. In addition, we analyzed the distribution of student response types according to mean achievement scores and developed an assessment rubric of conceptual understanding about dew point. The findings are as follows: First, the analysis of student responses to finding dew point in the saturation curve showed that many students had no or lack understanding of the scientific concept of dew point. Second, as a result of analyzing the student response to the water vapor condensation process at dew point, the proportion of scientific conception types was very low, while the proportion of misconception types was relatively high and the types varied as well. Third, a four- level assessment rubric was developed based on the analysis of the distribution of student response types according to the mean achievement scores. Based on the findings, we suggested the development and utilization of assessment rubric in the field of Earth science education.

• Journal of Korean Elementary Science Education
• /
• v.17 no.1
• /
• pp.75-87
• /
• 1998

The problem solving processes of elementary school children who are talented in science have been seldom studied. Researchers often resort to thinking aloud method to collect data of problem solving processes. The major purpose of the study is investigating high ability elementary school students' problem solving processes through the analysis of written responses to science problems in everyday context. 67 elementary students were participated Chungcheongbuk-do Elementary Science Contest held on October, 1997. The written responses of the contest participants to science problems in everyday context were analyzed in terms of problem solving processes. The findings of the research are as follows. (1) High ability elementary students use various concepts about air and water in the process of problem solving. (2) High ability elementary students use content specific problem solving strategies. (3) The problem solving processes of the high ability elementary students consist of problem representation, problem solution, and answer stages. Problem representation stage is further divided into translation and integration phases. Problem solving stage is composed of deciding relevant knowledge, strategy, and info..ins phases. (4) High ability elementary students' problem solving processes could be categorized into 11 qualitatively different groups. (5) Students failures in problem solving are explained by many phases of problem solving processes. Deciding relevant knowledge and inferring phases play major roles in problem solving. (6) The analysis of students' written responses, although has some limitations, could provide plenty of information about high ability elementary students' problem solving precesses.

• KIISE Transactions on Computing Practices
• /
• v.22 no.5
• /
• pp.218-224
• /
• 2016

This paper proposes a computer-based practical automatic scoring system for Korean short answers through student answer analysis and natural language processing techniques. The proposed system reduces the overall scoring time and budget, while improving the ease-of-use to write answer templates from student answers as well as the accuracy and reliability of automatic scoring system. To evaluate the application of the automatic scoring system and compare to the human scoring process, we performed an experiment using the student answers of social science subject in 2014 National Assessment of Educational Achievement.

• Journal of The Korean Association For Science Education
• /
• v.43 no.1
• /
• pp.17-28
• /
• 2023

In line with the entry into the digital-based intelligent information society, the science curriculum emphasizes the cultivation of scientific competencies, and computer-based test (CBT) is drawing attention for assessment of competencies. CBT has advantages to develop items that have high fidelity, and to establish a feedback system by accumulating results into the database. However, it is necessary to solve the problems of improving validity of assessment results, lowering measurement efficiency, and increasing management factors. To examine students' responses to the introduction of the new assessment tools in the process of transitioning from paper-based test (PBT) to CBT, in this study, we analyzed the results of the PBT and the CBT conducted in 2021 National Assessment of Educational Achievement (NAEA). In particular, we sought to find the effects on student achievement when only the mode of assessment was changed without change of items, and the effect on student achievement when the items were composed including technology enhanced features that take advantage of CBT. This study is derived through the analysis of the results of 7,137 third-grade middle school students taking one among the three kinds of assessments, which were the PBT or two kinds of CBT. After the assessment, the percentage of correct answers and the item discriminations were collected for each group, and expert opinions on characteristics of response were collected through the expert council involving 8 science teachers with experience in NAEA. According to the results, there was no significant difference between students' achievement results in the PBT and the CBT-M, which means simple mode conversion type of CBT, so it could be explained that the mode effect did not appear. However, it was confirmed that the percentage of correct answers for the construct response items was somewhat high in the CBT, and this result was analyzed to be related to the convenience of the response. On the other hand, there were the items with a difference of more than 10%p from the correct answer rate of similar items, among the items to which technology enhanced functions were applied following the introduction of CBT. According to the analysis of response rate of options, these results could be explained that the students' level of understanding could be more closely grasped through the innovative items developed through the technology enhanced function. Based on the results, we discussed some guidance to be considered when introducing CBT and developing items through CBT, and presented implications.

• Journal of The Korean Association For Science Education
• /
• v.38 no.4
• /
• pp.481-494
• /
• 2018

This study investigated elementary students' understanding of Earth revolution and its accompanied apparent motion of constellation in terms of spatial reasoning. We designed a set of multi-tiered constructed response items in which students described their own idea about the reason of consecutive movement of constellations for three months and drew a diagram about relative locations of the Sun, the Earth, and the constellations. Sixty-five sixth grade students from four elementary schools participated in the tests both before and after science classes on the relative movement of Earth and Moon. Their answers to the items were categorized inductively in terms of transforming frames of reference which are observed on the Earth and designed from the Space-based perspective. We analyzed those categories by the levels of spatial reasoning and depicted the change of students' levels between pre/post-tests so that we could get an idea on the preliminary developmental pathway of students' understanding of this topic. The lower anchor description was that constellations move around the Earth with geocentric perspective. Intermediate level descriptions were planar understanding of Earth movement, intuitive idea on constellation movement along with the Earth. Students with intermediate levels did not reach understanding of the apparent motion of constellations. As the upper anchor description students understood the apparent motion of constellations according to the Earth revolution and could transform their frames of reference between Earth-based view and Space-based view. The features as the case of evolutionary learning progressions and critical points of students' development for this topic were discussed.

• Journal of The Korean Association For Science Education
• /
• v.34 no.1
• /
• pp.1-9
• /
• 2014

This study aimed to explore the over-efficacy in problem solving and overconfidence of knowledge of students performing assessments in two different test formats: multiple-choice and supply-type. Two hundred and four female middle school students participated in this study. Multiple-choice and supply-type formats of tests on photosynthesis were used, and each item contained scales indicating one's self-efficacy on problem-solving and confidence of knowledge. The results showed that the correlation coefficients of performance between the two different assessment formats were less than 0.5 and the correlation coefficients between efficacy/confidence and actual performance were less than 0.45. Moreover, students tended to exhibit more over-efficacy and overconfidence in multiple-choice formats. The percentage of over-efficacy and overconfidence was higher in the group that completed the multiple-choice test first followed by the supply-type assessment than in the group that started with the supply-type followed by the multiple-choice assessment. From this study, it can be suggested that more use of supply-type assessment is required in science education. If test administrators require the combination of both multiple-choice and supply-type in an assessment, the supply-type assessment format should come first so that students can maintain the appropriate level of efficacy and confidence. In addition, science educators need to develop new learning programs to enhance students' self-monitoring skills of their problem-solving ability and knowledge.