• Journal of The Korean Association For Science Education
• /
• v.37 no.2
• /
• pp.225-237
• /
• 2017

In this study, we investigated the characteristics of the individual processes of pre-service chemistry teachers in making written test items. For this, we analyzed the think-aloud processes of eight pre-service chemistry teachers while making six written test items about gas laws and their in-depth interview scripts. The characteristics of the processes were found to be divided into six categories; the lack of systemicity in planning stage for making written test items, the lack of awareness and consideration for the interrelationship between instruction and assessment, the diverse criteria in determining test item types, the difficulties in judging behavioral domains and difficulties of items in the table of specification, the limitation in using teacher's guides and misunderstanding of teacher's guides, and the limitation in point and/or content of review and differences depending on the time of review. These can provide some significant guidelines and implications in finding ways to improve pre-service chemistry teachers' ability to make written test items.

• The Journal of Korean society of community based occupational therapy
• /
• v.9 no.2
• /
• pp.43-58
• /
• 2019

Objective : The purpose of this study was to develop an assessment tool to measure Korean occupational balance. Methods : From March 2017 to July 2019, preliminary questionnaire was prepared through analysis of previous research and expert focus meeting, and preliminary questions were selected through the Delphi survey. In order to verify the validity of the items, Rash analysis was conducted to analyze the persons and items fitness, the distribution of item difficulty, separation reliability, and the appropriateness of the rating scale. Results : Among 141 subjects, 9 (6.38%) in time use and 11 (7.80%) in the occupation area were inappropriate subjects. As a result of analyzing the appropriateness of the items except for the inappropriate subjects, the 3 items were judged as ineligible items, but 1 item of the occupation characteristics was finally deleted based on the theoretical and clinical grounds. In the analysis of the scale, 4 points were more appropriate than the 5 point scale, and the separation reliability was .86~.94. Finally, 3 categories (time use, occupation area, occupation characteristics) and 18 items were selected. Conclusion : The occupational balance assessment tool was selected three categories and 18 questions finally, three categories and 18 questions, and was developed on a four-point Likert scale. Further research needs to prove the concurrent validity of the K-OBA and to analyze the factors that influence the occupational balance.

• School Mathematics
• /
• v.14 no.4
• /
• pp.517-529
• /
• 2012

Assessment in the school should be done consistently in accordance with the national curriculum. This study analyzed the process that preservice teachers developed the question items. The preservice teachers already equipped with the knowledge about the curriculum, didn't reflect it to items at first. However, in the review and modification process with colleague discussions, they get the curriculum coherence faithfully. And the item completeness gets higher such as to conform to the item intent, to help the students easily understand the item and to have the consistency between items.

• The Journal of Korean Association of Computer Education
• /
• v.11 no.1
• /
• pp.65-74
• /
• 2008

In this paper, we introduce an analysis system for answer dataset by using a data mining method. We analyze students' answer data collected from a test including multiple choice question items, and find associations between the items. Analysis of evaluation results based on our system will not only provide correct information on students' achievement levels but also provides a basis for modifying weaknesses of the evaluation procedures, question items, or teaching/learning procedures. Furthermore, it will enable us to improve the quality of question items for future use so that we can secure itemsets of high quality.

• Proceedings of The KACE
• /
• 2018.01a
• /
• pp.107-110
• /
• 2018

본 연구에서는 컴퓨팅 사고력 평가도구로써 비버 챌린지 문항을 활용하기 위하여 문항반응이론을 통해 비버 챌린지 문항을 분석하고, 비버 챌린지에서 기존에 제시하는 난이도와 문항반응이론을 통한 난이도 간의 상관관계를 분석하였다. 분석 결과 비버 챌린지는 쉽고 변별력이 높은 검사로 나타났으나, 비버 챌린지에서 제시하는 난이도와 문항반응이론을 통한 난이도 간의 상관관계는 없었다. 난이도에 따라 가점과 감점이 이루어지는 비버 챌린지 채점 기준을 고려할 때 정확한 컴퓨팅 사고력 측정을 위해서는 난이도에 대한 수정 및 보완이 필요하다.

• Communications of Mathematical Education
• /
• v.18 no.2 s.19
• /
• pp.143-154
• /
• 2004

학교에서 실시되는 평가의 주체는 교사이므로, 교사는 '좋은 평가 도구'를 개발 ${\cdot}$ 제작 할 수 있어야 한다. 좋은 평가 도구를 제작하기 위해서는 이에 대한 직접적인 훈련이 필수적인 동시에 교사 교육의 첫 단계부터 좋은 평가 도구로 평가를 받는 간접 경험도 중요하다. 이 논문에서는 문항반응이론을 적용하여 수학교사 양성기관에서 사용되는 지필고사 문항에 대하여 신뢰도, 타당도, 난이도 및 변별도를 측정하였다. 이 결과는 평가 문항을 개발할 때에 기초자료로 사용될 수 있다.

• Journal of the Korean Chemical Society
• /
• v.65 no.1
• /
• pp.48-57
• /
• 2021

This study analyzed the science assessment items that were conducted by the paper and the computer-based assessment in the TIMSS 2019 pre-test, which is an international academic achievement assessment. We examined whether the test mode influenced the percentage of items answered correctly by each graders. As a result, there was no significant difference in the correct answer rates of science items according to the test media in 4th and 8th graders. Looking at the each graders, the difference in the percentage of correct answers was relatively large in the fourth grader rather than the eighth grader. In terms of items, the difference in the percentage of correct answers was relatively larger for the constructed items than the multiple choice questions. As a result of analyzing the content of science and assessment items on the influence of the test media, the multiple choice items showed little difference between the paper and the computer-based assessment items, but the answer-type items tended to have a lower percentage of correct answers than the paper-based assessment. In addition, by grade, 4th graders showed lower percentages of correct answers in the constructed items than 8th graders. This study provides implications related to the development and introduction of computer-based assessment in Korea, and suggests an educational implications for computer-based assessment to be well established as school evaluation.

• Journal of The Korean Association For Science Education
• /
• v.36 no.1
• /
• pp.87-101
• /
• 2016

This study analyzes the content validity of descriptive tests developed for elementary schools, in order to acquire basic data to improve them. Various descriptive tests were collected and tested for differences in proportions between two-dimensional classification of educational objectives and the level of behavioral objectives. Results show that the descriptive tests developed by elementary school teachers mainly focused on "knowledge" and "understanding," and that content validity for behavioral levels to be low. Nine elementary school teachers were interviewed to understand the result. From the interviews, we found both internal and external factors that cause low content validity. The main internal factors were teachers' ability to make two-dimensional classification of educational objectives, the teachers' consideration of students' level, item level of difficulty, the ease of scoring, and path dependence. The main external factors were curriculum, parents, and administration. Based on the results, we suggested the factors related to elementary school teachers' PCK of descriptive tests.

• Journal of Educational Research in Mathematics
• /
• v.26 no.3
• /
• pp.527-542
• /
• 2016

In the mathematics curriculum that was revised in 2009, statistical literacy is explicitly addressed as a goal and specific objectives are included. However, statistical literacy has not been addressed in the studies on KSAT. This study aimed to draw implications on how to improve KSAT in a sense that statistical literacy could be evaluated instead of testing typical facts or skills by comparing KSAT with SAT. We used mathematical problem solving process and category of context of PISA framework (OECD, 2013) to administer the comparison of KSAT and SAT. Result shows that both KSAT and SAT use various context, but items in KSAT is limited in assessing critical understanding. We suggested several ways to develop context-based items for KSAT in which statistical literacy could be assessed.

• Journal of the Korean School Mathematics Society
• /
• v.15 no.2
• /
• pp.281-297
• /
• 2012

Mathematics evaluation is aimed at measuring students' mathematical ability to think and achievement. Moreover, the quality of mathematics education at school is elevated by the test questions analysis and application process. And the starting point of evaluation is to make good test questions. This study is composed of four parts. First, theoretical background associated with making test questions is surveyed. Second, example questions according to the education goals and question-making cautions are presented. Third, four practical stages of making test questions which consist of designing, making the first draft of questions, verifying and making the final draft of questions, are illustrated.