• The Journal of Korean Academy of Sensory Integration
• /
• v.18 no.2
• /
• pp.15-28
• /
• 2020

Objective : The purpose of this study was to verify the construct validity of Short Sensory Profile-2 (SSP-2) for children with Autism Spectrum Disorder (ASD). Methods : Data were collected from SSP-2 for 120 parents of ASD children. Raw data were analyzed by applying the Rasch analysis to the goodness fit of person and item, item difficulty, rating scale, and separation reliability of SSP-2. Results : 7 persons in sensory processing area and 8 persons in behavioral response area were inappropriate criteria and excluded from the analysis. Item goodness-of-fit analysis determined that the If the Mnsq value is between 0.6 and 1.4 and the Z value is outside the ±2 range for nonconformity. this study All items in the instrument were found to have appropriate criteria. Item difficulty analysis in sensory processing area was high in item 13 (.48 logit) and low in item 10 (-.54 logit). In the behavioral response area, item 25 (1.58 logit) was high and item 30 (-.68 logit) was low. In the rating scale analysis, it was found that the 3-point scale is more appropriate than the 5-point scale. The separation reliability of sensory processing area was .90 and the behavioral response area was .95. Conclusion : This study verified the construct validity of SSP-2 and expected to be applied as a useful evaluation tool for children with ASD.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.22 no.2
• /
• pp.240-247
• /
• 2021

The purpose of this study was to identify the professional identity levels and characteristics of occupational therapists through Rasch analysis and to use this as the basis for further assessment and research on the same subject. An online survey was conducted, and the response of 88 people working as occupational therapists between May and June 2020 was analyzed. The collected data included the frequency, analyzed by SPSS 22.0 and technical statistics, Winsteps 3.8.0 target and item suitability, item difficulty, level scale, and separation reliability. According to the analysis, 17 (16.3%) of the subjects and 5 (20%) out of 25 items were unsuitable. Item difficulty was the highest in the category "I systematically read professional publications on occupational therapy", and the lowest level of difficulty in "I make my own decisions about what to do." The three-point scale was suitable for the equilibrium scale, and the separation reliability was between .86 and .95. Thus, identity levels and characteristics of occupational therapists, the suitability of items and subjects, and difficulty levels can be identified through Rasch analysis. In the future, research should be conducted on various sample groups, to develop identity measurement tools specifically for occupational therapists, and to present items appropriate to the characteristics of their work.

• English Language & Literature Teaching
• /
• v.18 no.1
• /
• pp.171-195
• /
• 2012

While noticing that there is insufficient interest in the assessment of EFL learners' vocabulary levels or sizes, the researchers developed two tests identical in form (Forms A and B) to assess the lexical knowledge of Korean university learners at the $1^{st}{\sim}10^{th}$ 1,000 word bands by adapting a pre-established vocabulary levels test (VLT). Of equal concern was to investigate if the VLT was equally a valid and reliable instrument to be used on measuring the lexical knowledge of EFL learners. The participants were 804 university freshmen enrolled in a General Education English Course from four different colleges. The learners were asked to respond to either Form A or B. While scores generally fell towards the lower frequency bands, multiple regression found the Korean College Scholastic Ability Test (CSAT) to be a significant variable for predicting the learners' vocabulary sizes. From a methodological perspective, however, noticeable differences between Forms A and B could be found with item response theory analysis. The findings of the study provide suggestions on how future VLT for testing EFL learners may have to be redesigned.

• Journal of Industrial Convergence
• /
• v.22 no.4
• /
• pp.21-29
• /
• 2024

This study analyzed the difficulty of scoring in different match situations in relation to which competitor scored first. The study analyzed the data from the 2022 Guadalajara World Taekwondo Championships. The analysis was performed for two separate weight classes: lightweight and heavyweight. Four game content variables were used: whether the athlete scored first, attack type, attack area, and game situation. Descriptive statistics, the Rasch model, and discrimination function questions were applied for data processing. SPSS and Winsteps were used for the statistical analysis, and the statistical significance level was set at 0.05. Consequently, in the lightweight class, the scoring frequency of the first scorer was high for all the game variables. In the heavyweight class, the scoring frequency for the first scorer was high for the attack type and attack area. By contrast, those who did not score first were more frequently found to be in a loss situation. By analyzing the scoring difficulties in different match situations based on whether the competitor scored first, the athletes who scored first in attack type most easily scored first. In losing situations, the athletes who scored first in attack area scored most easily, whereas those who did not score first scored most easily in body and match situations. For the heavyweight class, those who scored first in terms of attack type, counter-attack, and attack area scored the most easily while winning in body and match situations.

• Women's Health Nursing
• /
• v.27 no.2
• /
• pp.69-74
• /
• 2021

Structural validity, internal consistency, and cross-cultural validity/measurement invariance are psychometric properties of the internal structure of an instrument. In psychometric studies published in Korean nursing journals, structural validity has mainly been assessed using confirmatory factor analysis. Cross-cultural validity/measurement invariance has rarely been evaluated. It is recommended for Korean nursing researchers to evaluate the internal structure of instruments using a greater variety of methods, such as item response theory, Rasch analysis, multi-group confirmatory factor analysis, and differential item functioning.

• Journal of The Korean Association For Science Education
• /
• v.34 no.2
• /
• pp.123-134
• /
• 2014

This study aims to develop and validate an instrument to measure students' attitude toward convergence. To do so, we have defined five constructs (i.e. knowledge about convergence, personal relevance, social relevance, interest and self-efficacy) of 'attitude toward convergence' based on literature review, developed items, and collected data from 233 11th grade science track students. The validity of these items have been evaluated by Messick's framework (1995) (i.e. content, substantive, structural aspects of validity), experts' review, Rasch analysis, and confirmatory factor analysis using structural equation modeling. Our results have confirmed the five constructs and 23 selected items have met the benchmark of item validity. Moreover, the theoretical model illustrating that the high level of attitude toward convergence increases the level of science motivation has also been supported by the data. The items developed in this study will be used to measure students' attitude toward convergence and to estimate the effect of learning program for convergence science.

• Journal of Science Education
• /
• v.44 no.1
• /
• pp.74-83
• /
• 2020

The purpose of this study is to investigate motivation to learn physics in order to understand engineering college students' physics learning. Therefore, in this study, 374 engineering students at the university located in Seoul were studied using the Physics Motivation Questionnaire (PMQ), which was a Science Motivation Questionnaire II modified into the context of learning physics. The PMQ is composed of five factors: intrinsic motivation, career motivation, self-determination, self-efficacy, and grade motivation. It involves 25 Likert scale items. Through exploratory factor analysis, PMQ confirms that the five factors are structurally valid in measuring the motivation of engineering students to learn physics. In addition, item fit (MNSQ) was also confirmed using a Rasch model analysis. The results show that grade motivation has the highest mean with 4.2, followed by job motivation mean with 3.76. The mean of intrinsic motivation was 3.42, the self-efficacy was 3.38, and self-determination was 3.32. The results of this study confirm that the physics learning motivation of engineering college students is characterized showing high external motivation related to job and grade. Therefore, we should try to develop the teaching strategy to increase intrinsic motivation by developing mastery goal orientation of physics learning for engineering students.

• The Journal of the Korea Contents Association
• /
• v.13 no.12
• /
• pp.321-327
• /
• 2013

Impaired naming difficulty is common in normal elderly as well as in patients with neurological impairment. The 60-item Korean version-Boston Naming Test(K-BNT) is one of the most commonly used test for measuring confrontational naming ability. However, age-related cognitive decline may make the elderly difficult concentrating during the 60-item test, therefore, item reduction of the K-BNT would improve test validity and reliability. Thus, the purpose of this study was to develop a short form of the K-BNT based on Item Response Theory(IRT). Considering item-fit index, sex factor, and item difficulty through Rasch analysis, the 15-item K-BNT(i.e., K-BNT-15) was developed. Via administration of the K-BNT-15, we observed age-related decline in naming ability and significantly different performance between the normal elderly and patients with mild cognitive impairment. This study demonstrates the utility of IRT for developing a short-form language evaluation tool. The K-BNT-15 can be effective as a language screening tool to differentiate between normal aging and pathological diseases.

• Journal of Science Education
• /
• v.42 no.3
• /
• pp.308-321
• /
• 2018

The purpose of the study is to develop a questionnaire that examines unskeptical attitudes in scientific inquiry context. The questionnaire items were developed through literature research, expert review, and statistical analyses for validity and the differences in scores were identified by gender and tracks. A total of 363 high school students participated in the study. To explore the validity evidence of items, the Rasch analysis and the reliability of internal consistency were performed, and the two-way ANOVA was performed to compare the scores of the unskeptical attitudes between gender and academic track. Self-reporting and Likert-scaling 23 items were developed to measure unskeptical attitudes in scientific inquiry context. The items were developed in the sub-domain of scientific inquiry: 'questioning and hypothesis generating,' 'experiment designing,' and 'explaining and interpreting.' Second, the validity and reliability of the unskeptical were identified in a rigorous method. The validity of items were identified by multi-dimensional partial score model analysis through the Rasch model, and all 23 items were found to be fit to model. Various reliability evidences were also found to be appropriate. It was found that there were no significant differences of unskeptical attitude score between the gender and academic track except one comparison. The developed questionnaire could be used to check an unskeptical attitude in the course of scientific inquiry and to compare the effects of scientific inquiry classes.

• Therapeutic Science for Rehabilitation
• /
• v.11 no.3
• /
• pp.65-80
• /
• 2022

Objective : This study examined the psychometric properties of the 12-item Coping Orientation to Problems Experienced Scale (COPE) using Rasch analysis. COPE is one of the instruments used to measure stress-coping skills. Methods : The study participants were 480 community-dwelling older adults. We tested the instrument's unidimensionality assumption using principal component analysis (PCA). Item fit was examined using infit-and-outfit mean-square (MnSq) and standardized fit statistics (ZSTD). The precision and item difficulty hierarchies of the instrument were examined. The item-difficulty hierarchy was investigated to identify the easy and difficult items. We tested differential item functioning (DIF) for sex and age groups. Results : PCA revealed that the instrument met the unidimensionality assumption (eigenvalue = 1.78). Among the 12 items, item 2 was removed because of misfit (Infit MnSq = 1.33, Infit ZSTD = 5.05, Outfit MnSq = 1.56, Outfit ZSTD = 7.15). The remaining 11 items demonstrated a conceptual item-difficulty hierarchy. The person strata value was 3.10, which is equivalent to a reliability index value of 0.81. There was no DIF for the sex and age groups (DIF contrast <0.27). Conclusion : The findings indicated that the revised COPE-11 has adequate item-level psychometric properties and can accurately measure stress coping skills.