• Journal of the Korean Chemical Society
• /
• v.54 no.6
• /
• pp.781-786
• /
• 2010

The purpose of this study was to investigate errors on written tests of science, matters, in middle school 7th grade. Errors were defined something you have done which is considered to be incorrect or wrong, or which should not have been done. We found and classified errors, and then examined the frequency of types of errors on the written tests. A total of 167 test items from 10 middle schools were analyzed for this study. Errors on the written tests were classified into 5 types: insufficient information; unnecessary information; inaccurate information; information against curriculum; and unclear information. A total of 81 errors were counted out of 167 test items. The results of this study are expected to help teachers develop written test items to convey definite meanings by text and would be used as basic information for improving written test item standards.

• Journal of The Korean Association For Science Education
• /
• v.37 no.3
• /
• pp.429-440
• /
• 2017

This study investigated the influence of paired think-aloud problem solving on interactions among the pedagogical content knowledge (PCK) components considered in the processes of making written test items by pre-service chemistry teachers. The processes of making written test items using paired think-aloud problem solving in four small groups consisting of two pre-service chemistry teachers were recorded and transcribed. The analysis of the results revealed that the 'assessment in science education' of the five PCK components, regardless of the roles (solver or listener), was most frequently used in making written test items. 'Subject matter knowledge' and 'students' were also frequently used although less than the previous component. However, 'curriculum for science education' and 'instructional strategies and instruction for science education' was a little used. In the aspects of integration, the integrations between two or three components of various types were frequently found. The integrations among four or five components were also slightly found. However, the integrations of 'curriculum for science education' with the other components were less frequently found. The integrations of 'instructional strategies and instruction for science education' with other components were hardly found. The usefulness, limitations, and effective use of paired think-aloud problem solving as a strategy improving competency to make written test items and the PCK of pre-service teachers were discussed on the basis of the results.

• Journal of The Korean Association For Science Education
• /
• v.43 no.1
• /
• pp.17-28
• /
• 2023

In line with the entry into the digital-based intelligent information society, the science curriculum emphasizes the cultivation of scientific competencies, and computer-based test (CBT) is drawing attention for assessment of competencies. CBT has advantages to develop items that have high fidelity, and to establish a feedback system by accumulating results into the database. However, it is necessary to solve the problems of improving validity of assessment results, lowering measurement efficiency, and increasing management factors. To examine students' responses to the introduction of the new assessment tools in the process of transitioning from paper-based test (PBT) to CBT, in this study, we analyzed the results of the PBT and the CBT conducted in 2021 National Assessment of Educational Achievement (NAEA). In particular, we sought to find the effects on student achievement when only the mode of assessment was changed without change of items, and the effect on student achievement when the items were composed including technology enhanced features that take advantage of CBT. This study is derived through the analysis of the results of 7,137 third-grade middle school students taking one among the three kinds of assessments, which were the PBT or two kinds of CBT. After the assessment, the percentage of correct answers and the item discriminations were collected for each group, and expert opinions on characteristics of response were collected through the expert council involving 8 science teachers with experience in NAEA. According to the results, there was no significant difference between students' achievement results in the PBT and the CBT-M, which means simple mode conversion type of CBT, so it could be explained that the mode effect did not appear. However, it was confirmed that the percentage of correct answers for the construct response items was somewhat high in the CBT, and this result was analyzed to be related to the convenience of the response. On the other hand, there were the items with a difference of more than 10%p from the correct answer rate of similar items, among the items to which technology enhanced functions were applied following the introduction of CBT. According to the analysis of response rate of options, these results could be explained that the students' level of understanding could be more closely grasped through the innovative items developed through the technology enhanced function. Based on the results, we discussed some guidance to be considered when introducing CBT and developing items through CBT, and presented implications.

• Journal of Science Education
• /
• v.44 no.1
• /
• pp.38-49
• /
• 2020

The purpose of this study is to analyze the paper test items of high school physics I 'Space-Time and the Universe' unit and how similar the textbook goals are to the cognitive and content areas. This study analyzed paper test items used from nine high schools and KICE about the unit. In order to analyze the distribution of items, they were classified by contents and by cognitive level which is knowledge, comprehension and application levels. As conclusion, application level items were a few, and unbalanced contents distribution appeared in school items. In comparison through the ratio difference index, the objectives of the textbook and the school items were very similar, but the similarities were low when comparing the school items with the KICE items. Based on the above, we suggested some ways to increase the validity of test items.

• Communications of Mathematical Education
• /
• v.18 no.2 s.19
• /
• pp.143-154
• /
• 2004

학교에서 실시되는 평가의 주체는 교사이므로, 교사는 '좋은 평가 도구'를 개발 ${\cdot}$ 제작 할 수 있어야 한다. 좋은 평가 도구를 제작하기 위해서는 이에 대한 직접적인 훈련이 필수적인 동시에 교사 교육의 첫 단계부터 좋은 평가 도구로 평가를 받는 간접 경험도 중요하다. 이 논문에서는 문항반응이론을 적용하여 수학교사 양성기관에서 사용되는 지필고사 문항에 대하여 신뢰도, 타당도, 난이도 및 변별도를 측정하였다. 이 결과는 평가 문항을 개발할 때에 기초자료로 사용될 수 있다.

• Proceedings of the Korean Information Science Society Conference
• /
• 2011.06b
• /
• pp.262-265
• /
• 2011

많은 학습 시스템에서 학습자의 수준에 맞는 맞춤학습을 위해서 학습자의 정확한 능력을 측정하는 평가 방법이 필요하다. 기존의 지필고사는 이를 위해서 학습자의 능력과 관련된 많은 수의 문항을 똑같은 시간과 순서대로 풀게 되므로 평가의 효율성 면에서 문제를 가지고 있다. 따라서 이러한 지필고사방식의 문제점을 해결하기 위해 문항정보이론과 컴퓨터의 처리성능을 결합시킨 컴퓨터화된 적응적 검사(CAT)에 대한 연구가 활발히 진행되고 있다. CAT는 지필고사의 문제점을 상당부분 해결했으나 문항간 연관성에 대해서는 독립을 가정하여 그렇지 않은 경우에는 비효율성을 가져올 수 있다. 본 논문에서는 문항반응이론 방식의 CAT가 가진 문제점을 해결하면서 성능이 개선된 베이지안 네트워크를 도입한 CAT를 제안한다. 이는 베이지안 네트워크에 평가문항을 세부분야별로 대입하여 한 문항에 대한 응답으로 그와 연관된 분야의 학습자 능력을 추론한다. 또한 실험을 통해 기존의 기법을 사용했을 때에 비해 학습자의 실제 능력치에 수렴하는 속도가 증가함을 보인다.

• Therapeutic Science for Rehabilitation
• /
• v.7 no.1
• /
• pp.27-35
• /
• 2018

Objective : The aim of this study was to identify correlation between KF-NAP and Pencil-Paper test(Line bisection test, Letter cancellation, Albert's test) and to determine the high sensitive assessment tool for spatial neglect. Method : Thirty-two stroke patients who admitted to an inpatient rehabilitation unit at the medical center in Seoul from September, 2014 to September, 2015 were included in our research. They all have spatial neglect (male=19, female=13, the average age 61.8). KF-NAP and Pencil-Paper test were performed within 7 days. The detection of spatial neglect was analyzed by total scores of each assessments. Results : The highest sensitivity assessments of spatial neglect was KF-NAP. The detection of spatial neglect through KF-NAP was 93.8% (Line bisection test 53.1, Letter cancellation 53.1%, Albert's test 37.5%). Line bisection test (r=.430), Letter cancellation(r=.641), Albert's test(r=.398) and KF-NAP scores had significant correlation(p<0.05). Conclusion : KF-NAP is higher sensitive in comparison with Pencil-Paper test for detection of spatial neglect as the assessment tool of spatial neglect during activities daily livings of patients and neglect severity could be assessed with KF-NAP. Therefore, KF-NAP is recommended for assessment of spatial neglect.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2010.11a
• /
• pp.405-408
• /
• 2010

문항은 지필평가의 핵심요소이다. 문항의 표현은 전통적으로 문항카드를 이용했다. 교육정보화가 발달하면서 온라인 평가 서비스는 다양한 문항의 표현 구조를 만들었으나, 새롭게 주목받고 있는 스마트 러닝 환경에 그대로 사용하기에는 한계가 있다. 이 논문은 국내의 평가 특성과 스마트 러닝의 이동성을 고려한 문항 표현 구조를 제안한다.

• School Mathematics
• /
• v.9 no.2
• /
• pp.241-257
• /
• 2007

The study aims to figure out how to improve existing examination tools to distinguish mathematically gifted children and to clarify procedures and criteria for selecting candidates. Toward this end, it examined correlations between grades of gifted children selected through evaluation by pen-and-pencil tests and their creative problem-solving capability and performance assessment, and analyzed learning activities of the gifted children. According to the analysis, results of pen-and-pencil tests turned out to have low correlations with their creative problem-solving capability and performance assessment, but it was found that their creative problem-solving capability has high correlations with results of performance assessment. The analysis also found that there were some students who participated in a program for gifted children with high marks but had difficulties in adapting themselves to it. It found that there were children who joined the program with low marks but emerged as successive performers later on. In this regard, the existing examination tools to tell the gifted students apart need to be used to the fullest extent, and other diversified tools to evaluate mathematical capabilities that include mathematical creativity need to be further studied and developed. Qualitative studies on affective development of the gifted students and their creative problem-solving processes need to be conducted.

• Journal of the Korean Chemical Society
• /
• v.65 no.1
• /
• pp.48-57
• /
• 2021

This study analyzed the science assessment items that were conducted by the paper and the computer-based assessment in the TIMSS 2019 pre-test, which is an international academic achievement assessment. We examined whether the test mode influenced the percentage of items answered correctly by each graders. As a result, there was no significant difference in the correct answer rates of science items according to the test media in 4th and 8th graders. Looking at the each graders, the difference in the percentage of correct answers was relatively large in the fourth grader rather than the eighth grader. In terms of items, the difference in the percentage of correct answers was relatively larger for the constructed items than the multiple choice questions. As a result of analyzing the content of science and assessment items on the influence of the test media, the multiple choice items showed little difference between the paper and the computer-based assessment items, but the answer-type items tended to have a lower percentage of correct answers than the paper-based assessment. In addition, by grade, 4th graders showed lower percentages of correct answers in the constructed items than 8th graders. This study provides implications related to the development and introduction of computer-based assessment in Korea, and suggests an educational implications for computer-based assessment to be well established as school evaluation.