• Journal of the Korean Geographical Society
• /
• v.49 no.4
• /
• pp.615-632
• /
• 2014

This study aims to explore 'bluffing', one of the most important topics in order to ensure the objectivity, validity, reliability of scoring of constructed-response items. The author identifies the conception of bluffing, and classifies major types of bluffing on the basis of previous studies on the theoretical level. Next, the author analyzes empirically the bluffing strategies and types of learners on key terms of Korean Geography subject. Compared with the existing research reports, the result of this study shows a significantly lower average bluffing score. On the other hand, it is consistent in results of previous studies reported that average bluffing score is similar between genders and that those students who got highest grades did least bluffing. Actually bluffing types are classified into four categories: 'repeating the question' type, 'depending on a well-known or existing knowledge' type, 'applying some basic concepts regardless of understanding' type, and 'inducing scorer's basic beliefs' type. Some comments and suggestions are as follows. First, it is necessary to continue researches of the relations among bluffing and age, gender, grade, intelligence and learning styles. Second, it is required for scorers who score constructed-response items to develop and supply the scoring guide including analysis contents of bluffing types and cases, and increase opportunity for training. Third, we need to inquire the domain-specific bluffing types in geography subject based on the generalizable sample size.

• Journal of the Korean Society of Earth Science Education
• /
• v.10 no.1
• /
• pp.50-61
• /
• 2017

The purpose of this study is to analysis eye tracking for high school students' learning styles in the process of solving in the behavioral domains of the College Scholastic Ability Test on Earth Science I. The subjects of this study were 50 students from two classes out of 4 classes in E high school in Chungcheong province. Among them, we conducted experiments by randomly sampling 2 students of each type of learning based on the criteria that they had not encountered the problem of Earth Science I from the past two years. The findings indicate that the item correctness rate of divergers, assimilators, convergers, and accommodators were higher in the knowledge domain, application domain, knowledge-understanding domain, and understanding domain. This confirms that there is a difference among the four learning styles in the level of achievement according to the behavioral areas of the assessment questions. The latter finding was that the high eye-share of AOI 2 appeared higher than AOI 1, 3, 4 in the course of solving the problems. This is because the four types of learners pay more careful attention to the AOI 2 area, which is the cue-or-information area of problem solving, that is, the Table, Figure, and Graph area. Therefore, in order to secure the fairness and objectivity of the selection, it is necessary that an equal number of questions of each behavioral domain be selected on the Earth Science I Test of the College Scholastic Ability Test in general. Besides, it seems to be necessary that the knowledge, understanding, application, and the behavior area of the inquiry be highly correlated with the AOI 2 area in development of test questions.

• Korean Journal of Social Welfare
• /
• v.66 no.2
• /
• pp.255-286
• /
• 2014

This study aimed at developing and validating two standardized measures, 'power controllability', and 'power desirability', which can be utilized to categorize power relationships among the school youth. In order to identify initial items for the measures researchers conducted individual as well as focus group interviews with middle and high school students. School teachers and other school related professionals involved in ensuring both the face validity and the content validity of the initial items. For the finally selected items both exploratory and confirmatory factor analyses have been executed with the sample of 1,822 students attending elementary, middle, and high schools in the metropolitan area of Seoul, Korea. To test the validity of the confirmed factor structure of the measures the new sample of 348 middle school students were employed from the metropolitan area. Both construct validity and reliability were calculated from the validity test sample. Based on the two developed measures 4 types of power relationship were identified among the students. The four types of power relationship turned out to predict well the roles that students take in the field of school violence.

• Journal of the Korean School Mathematics Society
• /
• v.26 no.2
• /
• pp.137-158
• /
• 2023

This study aimed to analyze the shifts in the mathematics domains of the College Scholastic Ability Test (CSAT) since its inception in 1993, with the intent of identifying improvements for the future. The goal is to provide insights for exploring the direction of assessment in Korean high school mathematics education. To this end, we focused on the test system, content area, and behavioral area within the CSAT mathematics domains. Key findings include: first, the test structure influences the assessment factors and item types, in addition to the examination time and number of items. Second, by analyzing the content area, we established a correlation between the national curriculum and assessment area, and confirmed the importance of setting the assessment area. Third, the examination of the behavioral area tended to the item-type fixation, demonstrating the necessity of the ongoing modifications in evaluation item types. Building upon these findings, we discuss the direction of an evaluation that considers the evolving demands and shifts within mathematics education.

• Journal of The Korean Association For Science Education
• /
• v.22 no.1
• /
• pp.122-131
• /
• 2002

Recently, performance assessment that makes growing use of free response items in a large scale assessment has been emphasized. This study is an empirical examination of the effectiveness of free response items in comparison with multiple choice items. Using the information function in Item Response Theory (IRT) framework, item information of free response items and multiple-choice items from the Third International Mathematics and Science Study-Repeat (TlMSS-R) were obtained. Test information of the whole science area as well as each area of science contents was computed. On average, free response items yielded more information than multiple choice items, especially in earth science, physics, chemistry, and life science. This study also showed that free response items were appropriate for students in high science ability. Also, free response items estimated students' science ability more accurately than multiple choice items with smaller number of free response items.

• School Mathematics
• /
• v.12 no.2
• /
• pp.113-136
• /
• 2010

According to the self-assessment tool identifying teacher's competence in assessment, many teachers have difficulty in making assessment tools. This study analyzes the types of modification with data of NAEA(National Assessment of Educational Achievement) items from 2006 to 2008. NAEA goes through complicated formalities from begin to make draft items to completing them. This study shows the types of item modification and its specific examples. NAEA analyzes the degrees of studuents' achievement according to the educational objectives of the National Curriculum. This study provides specific comments on making mathematics assessment items to the teachers who embody national curriculem. Therefore this study will contribute to improve mathematics teacher's professional competence in the area of assessment tool development.

• Journal of Science Education
• /
• v.47 no.2
• /
• pp.211-224
• /
• 2023

The purpose of this study is to suggest how to investigate the reliability of the assessment, which consists of items generated by automatic item generation using empirical example data. To achieve this, we analyzed the illustrative assessment data by applying the multivariate generalizability theory, which can reflect the design of responding to different items for each student and multiple error sources in the assessment score. The result of the G-study showed that, in most designs, the student effect corresponding to the true score of the classical test theory was relatively large after residual effects. In addition, in the design where the content domain was fixed, the ranking of students did not change depending on the item types or items. Similarly, in the design where the item format was fixed, the difficulty showed little variation depending on the content domains. The result of the D-study indicated that the original assessment data achieved a sufficient level of reliability. It was also found that higher reliability than the original assessment data could be obtained by reducing the number of items in the content domains of operation, geometry, and probability and statistics, or by assigning higher weights to the domains of letters and formulas, and function. The efficient measurement conditions presented in this study are limited to the illustrative assessment data. However, the method applied in this study can be utilized to determine the reliability and to find efficient measurement conditions for the various assessment situations using automatic item generation based on measurement traits.

• Journal of the Korea Society of Computer and Information
• /
• v.28 no.11
• /
• pp.227-234
• /
• 2023

The evaluation of students' computational thinking begins with the evaluation of knowledge about the concepts and principles of computing. In this study, we analyzed the differences in teachers' perceptions depending on the description method of the bebras challenge questions to evaluate computer science knowledge. First, we classified the questions into two types depending on whether computer science terms were included or not. Also we made a computational thinking questionnaire with two types of questions and surveyed 72 major teachers. As a result, teachers expressed the opinion that the evaluation questions that revealed computer science terms were appropriate as evaluation questions for information subjects. They also perceived it as more helpful in assessing computational thinking and coding skills. Through the results of this study, we suggested that the way the questions are worded is important in the process of assessing students' understanding of computer science concepts and computational thinking skills.

• Journal of The Korean Association of Information Education
• /
• v.19 no.3
• /
• pp.271-278
• /
• 2015

This study proposed new approach for the information gifted discrimination test using EPL. We tried to distinguish high level thinking in the information gifted through test of this study. We categorized testing tool according to context type: simple attribute problem, complex same attribute problem, complex focus attribute problem, mathematic-verbal ability required problem. And testing tool divided into modifying scripts, guess scripts's result, using scratch program. In the effectiveness test of proposed tool, we confirmed content validity and credibility.

• Journal of the Korean School Mathematics Society
• /
• v.12 no.2
• /
• pp.281-308
• /
• 2009

In the process of solving a linear equation, some questions had equal sign('=') relation properly, while other questions did not have equal sign('=') relation properly. Since whether students could express equal sign('=') relation properly or not is determined by questions, the direction for teaching should be instituted, and instruction and teaching should be conducted by comparing and analyzing after conducing tests on may items. Most of students who got the answer for items without the method of solving a linear equation solved the items using binomial. For questions asking to solve using the characteristic of equality, most of students solved the questions using binomial instead of using the characteristic of equality. Therefore, instruction and learning to solve equations using both the characteristic of equality and binomial have to be achieved.