• Survey Research
• /
• v.3 no.2
• /
• pp.1-15
• /
• 2002

High fidelity translations of measurement instruments from one language to another are required for meaningful comparisons between cultures. A differential item functioning technique, PSIBTEST was used to assess the degree to which a personality test provided cross-cultural validity across U.S. and Korea. The Sixteen Personality Factor (16PF) questionnaire was administered in English to 844 American college students and in Korean to 538 Korean college students. Results of PSIBTEST classified 23 out of 51 items as significantly biased. Implications of this procedure for translation evaluation are discussed.

• Journal of Educational Research in Mathematics
• /
• v.23 no.2
• /
• pp.75-94
• /
• 2013

As part of the education in the pursuit of equity, in this study, we have analyzed the differential item functioning on mathematics assessment through the result of 2011 National Assessment Educational Achievement. For this we used SIBTEST method and M-H method to extract differential item functioning on multicultural and North Korea migrant families students. As a result, 10 items that has the differential functioning were extracted by both methods in three school levels from Elementary, Middle and High School. The result of a exploratory for potential causes of differential functioning on multicultural and North Korea migrant families students through a qualitative analysis of each items that has been extracted, language ability, the complexity of computation and problem-solving process, the curriculum, the problem situation have been discussed. These results will be able to contribute to establishing education policy and designing teaching and learning methods for the multicultural and North Korea migrant families students.

• Proceedings of the Korean Association for Survey Research Conference
• /
• 2002.06a
• /
• pp.8-34
• /
• 2002

This paper is concerned with evaluating the fidelity of a non-cognitive test adaptation for use in multiple languages and cultures using two differential item functioning(DIF) techniques: (a) PSIBTEST, and (b) Logistic Discriminant Function Analysis(LDFA). In particular, this study focused on how DIF research can best be extended to the problem of evaluating the equivalence of tests across cultures and languages. The Sixteen Personality Factor (16PF) questionnaire was administered in English to 844 American college students and in Korean to 538 Korean college students. This study attempted to identify the best matching criterion for the translated tests by using both a multivariate matching technique and iterative purification process. The results generally showed a small number of DIF items on each scale, except for scales A and N where about half of the items showed DIF. The choice of matching variables based on a combination of internal measures appeared to have little effect and the iterative purification method was unsuccessful. Finally, the results were discussed and methodological implications were also presented.

• Korean Journal of Comparative Education
• /
• v.28 no.1
• /
• pp.135-151
• /
• 2018

This study was conducted to help establish the status of comparative education as an academic discipline by investigating its relationship with educational evaluation. Comparative education as a subfield of education covers other areas of study in education, while educational evaluation is a study of methodology. First, international comparative study was investigated, and recent methodologies in educational evaluation were introduced. International comparative study started in 1960's, and is being expanded. The participating countries hope for better education by comparing their educational curricula and practices with others. For international comparative studies, a differential item functioning analysis as a multigroup analysis can provide information on what sociocultural factors other than the construct are affecting the measurement results. The study dataset has a hierarchical structure so that multilevel item response theory is suitable to obtain multidimensional national profiles. Although there have been methodological advances in educational evaluation, the methods are not available in comparative education. In order to reduce the gap, scholars in educational evaluation should try to make the methods easily available, while those in comparative education should try to use the exact and precise methods in their studies.

• (The) Korean Journal of Educational Psychology
• /
• v.22 no.2
• /
• pp.367-384
• /
• 2008

The purpose of this study was to develop picture testing instrument for measuring children's causal reasoning ability on events that can occur in daily life. The measurement instrument contains three domain of human development; haman behavior domain, human psychology domain, and natural/physical domain. Through this study, researchers designed a concept model based on theoretical framework and prior studies and investigated the reliability and validity of the measurement instrument which was developed in accordance with the concept model. For the empirical validation research, a pretest was conducted to 336 elementary school students in grade 2 to 4 in Seoul. Considering reliability and validity of the developed measurement instrument and factor loadings, researchers sorted out 18 questions. And then 18 question test and KICE Critical Thinking Ability Test was conducted to 509 elementary school students in grade 1 to 4 in Seoul. According to the result of the tests, the researchers sorted out final 12 questions. The Cronbach's alpha, reliability of the children's causal reasoning ability test consisted of the final 12 question, was significant as .72. Also, the result of exploratory factor analysis showed that factors of this test were haman behavior domain, human psychology domain, and natural/physical domain. Moreover, the correlation between the KEDI Reasoning Ability Test(2003) scores and the scores of the test developed in the current study was significant as .55. Finally, the result of the analysis about children's grade differences, the development by discrepancy of age was significant in total points and that of each domain. The children's causal reasoning ability test developed by this study can be useful not only for the evaluation of children's thinking ability but also for screening of the handicapped children in thinking ability development.

• Korean Journal of Comparative Education
• /
• v.28 no.5
• /
• pp.1-19
• /
• 2018

The purpose of educational assessments such as the Trends in International Mathematics and Science Study (TIMSS) is to compare groups such as countries. When the unit of measurement is above the student level, group-level diagnostic assessment based on multilevel item response theory (ML-IRT) can be considered just as cognitive diagnosis models are developed from item response theory. This study suggests an ML-IRT-based group-level diagnostic assessment model by modifying an item feature model by Park and bolt (2008). The model is illustrated on the recently released TIMSS 2015 Grade 8 mathematics assessment. The results provide skill profiles for the studied countries and the nine cognitive attributes; that is, the attribute effects can be compared across the countries and also across the attributes. By controlling unexplained variance, the suggested model may provide more reliable and more informative group-level comparisons. The results are interpreted using an example. Limitations and directions for future research are also discussed.

• Korean Journal of Culture and Social Issue
• /
• v.30 no.2
• /
• pp.159-192
• /
• 2024

The purpose of this study is to validate the Reactive-Proactive Aggression Questionnaire (RPQ), a tool for measuring reactive-proactive aggression, in the context of South Korea. A thorough translation was conducted in collaboration with the original author. An exploratory factor analysis (EFA), exploratory structural equation modeling (ESEM), rating scale model (Rasch), differential item functioning (DIF), and convergent validity were performed on a sample of 510 South Korean individuals. The results revealed a two-factor structure of reactive and proactive aggression after removing one item showing dual loading. Rating scale analysis based on the Rasch model indicated the appropriateness of the 3-point Likert scale, with all items meeting fit criteria. Although the separation index and separation reliability of proactive aggression was marginally lower, the overall discrimination between participants and items was satisfactory. Examination of participant-item distribution indicated a suitable alignment between reactive aggression and participant ability levels, whereas proactive aggression exhibited slightly elevated item difficulty. Furthermore, three items were found to function differently based on gender. A moderate but statistically significant positive correlation was found between the Barratt Impulsiveness Scale-11-R (Korean version) and RPQ from the results of the convergent validity evaluation. Overall, this study employed rigorous statistical methods to validate the suitability of the RPQ for use in Korea, taking cultural nuances into account, and introduced the concepts of reactive and proactive aggression to the Korean general population.

• Journal of the Korean Data and Information Science Society
• /
• v.24 no.6
• /
• pp.1319-1329
• /
• 2013

The purpose of this research was to develop and validate the coach-athlete relationship scale suitable to amateur golf players by applying the Rasch rating scale model. As the coach-athlete relationship scale, the Korean form of scale developed by Kim and Park (2008), which was revised based on the evidence on the basis of inspection contents, was used to conduct a survey on 217 amateur golf athletes. And the unidimensionality, which is the basic assumption of the Rasch model, was verified using the WINSTEPS program, and the appropriateness of the item category was established through the step calibration. The goodness of fit of each question was tested through the goodness-of-fit index and the differential item functioning (DIF) was estimated according to the golf career. When the goodness-of-fit index estimated for each question was 1.30 or more it was judged unfit and the significance level in the analysis was all set as.05. The results of the analysis showed that the measures variance explained by the Rasch measurement model was more (33.7%) than 20%, so the unidimensionality assumptions of the 11 questions (..hospitable posture when my coach is teaching) were satisfied. The result of analyzing the item category (7 scale) with step calibration was found to be unfit, but in the result of reanalyzing by rescoring into a 5-point scale, it was found to be fit. Particularly, in the result of estimating the goodness-of-fit using the systematized item category (5 scale), Question 10 (...my best when my coach is teaching) and Question 11 were found to be unfit, and as a result of estimating the differential functioning item according to golf career, Question 11 was found to be unevenly differentiated according to golf career. So the 5-point scale of Question 9 after eliminating the two questions which were unfit and differentiated was validated to be the coach-athlete relationship scale suitable to amateur golf athletes.

• The Journal of the Korea Contents Association
• /
• v.19 no.4
• /
• pp.111-119
• /
• 2019

The purpose of this study was to explore the determinants of minor and double major satisfaction of university students. To achieve this, F.G.I. was performed with the university teaching assistants to create a questionnaire. The survey was performed to the subject of 239 university students completing minor and double major. A statistical program (SPSS) was used for data analysis and factor analysis, reliability analysis, and multiple regression analysis were conducted. First, it drew three principal factors including need-achievement, class discrimination, and course registration discrimination by conducting factor analysis regarding survey questions on minor and double major. Next, the multiple regression analysis identifying the effects of the three principal factors was conducted. The results indicated three principal factors to be statistically significant. The degree of influence over satisfaction marked the highest in the order of need-achievement, class discrimination, and course registration discrimination. In the conclusion, the positive function and possibilities of minor and double major are proposed.

• The KIPS Transactions:PartA
• /
• v.18A no.6
• /
• pp.241-248
• /
• 2011

Many learning systems are applying Self-Directed Learning to improve learning efficiency. The degree of understanding of the same learning contents can be different even if the learner's level is same. Therefore, it is difficult to represent an effective learning experience because the learning is progressed by the determined difficulty of learning and the learning process even thought the provided content is difficult to understand. In this paper, we augmented SCORM to reconstruct the learning contents which are suitable for the changed level of each learner in real-time. Also, we designed and implemented this augmented SCORM based DCOS(Differential Contents Organization System). In order to provide the suitable contents for each learner, DCOS reorganizes learning contents based on the learner's level, the learner's achievement of learning objectives, and the correlation between learning objects, that is the component of the learning content. Each 30 Each 30 students studied e-learning contents, which are constructed based on the existing System and DCOS respectively. And the average score and system's satisfaction of the students who studied DCOS based e-learning contents was higher.