• The Journal of Korean Physical Therapy
• /
• v.19 no.5
• /
• pp.29-41
• /
• 2007

Purpose: The aim of this study was to examine the validity and reliability on Psychometric Arthritis Impact Measurement Scale-Short Form (AIMS-SF) in patients with knee osteoarthritis(OA). Methods: The sample consisted of 62 patients who had received physical therapy at the physical therapy units of the Andong Medical Center, Sungso Hospital, Ahn Orthopedic Surgery Clinic, and St. Luke Clinic in Andong city in June 2006. Questionnaire on the AIMS-SF was recruited by 5 physical therapists. The internal structure and reliability of the scales were evaluated by means of item-internal consistency(Cronbach's alpha coefficient: ${\alpha}$), item-discriminant validity, Pearson's relation coefficient. To explore construct validity we conducted a principal component factor analysis with varimax rotation analysis. The criterion for factor extraction was an eigenvalue >1.0. Results: 62 OA patients's an average $age{\pm}standard$ deviation was $53.8{\pm}14.4$ years (range: $40{\sim}81$ yr). The internal consistency reliability of 11 items, as estimated by Cronbach's ${\alpha}$ coefficient, was high ranging $0.60{\sim}0.78$ (except for 0.40 for mobility level and -0.48 for mood). The internal consistency reliability of item-each scale was also high $0.82{\sim}0.93$ (except for 0.48 for mood). Of 11 items, the item-discriminant validity on 6 items was high (${\alpha}$ coefficient range: $0.11{\sim}0.25$), however, others (0.57 for tension level, 0.48 for arthritis pain, 0.41 for walking and bending, and 0.40 for work) were a little low. The construct validity by factor analysis was a little low. Conclusion: In conclusion, the results reported here confirm the validity and reliability of the AIMS-SF in patients with OA of the knee. The Collection of information on health status using this instrument was acceptable to patients. A further prospective multi-center study will be necessary to prove the construct validity.

• Journal of Korean Academy of Fundamentals of Nursing
• /
• v.16 no.4
• /
• pp.490-496
• /
• 2009

Purpose: The purpose of this study was to examine the validity of a single item scale by comparing a single item scale of health related quality of life to subscopes of the multi-item scales in the Medical Outcome Study Short Form-36 (SF-36), and Minnesota Living with Heart Failure Questionnaire (MLHFQ). Method: The data from 103 patients with heart failure were analyzed. The statistics program SPSS 12.0 used for descriptive statistics. Results: Significant correlations were found between the single item scale and subscopes of SF-36, for physical functioning (r= .42), role physical (r= .22), general health perception (r= .46), vitality (r= .40), social functioning (r= .20) and mental health (r= .51), but not for body pain (r= .12) and role emotional (r= .06). Physical (r= -.41), emotional (r= -.49) and total scores (r= -.49) of MLHFQ were significantly related to the single item scale. Conclusion: The single item scale of health related quality of life showed low to moderate correlation with multi-item scales. Even though the single item scale was correlated with several subscopes of multi-item scales, the correlation was not high, so we have to use caution when using the single item scale instead of multi-item scales.

• Journal of The Korean Association For Science Education
• /
• v.40 no.3
• /
• pp.253-269
• /
• 2020

This study aims to develop items to diagnose pre-service physics teachers' understanding of the conceptual knowledge of modern physics, based on the achievement criteria presented in the 2015 revised national science curriculum, and to identify the validity and reliability of the newly developed items. Data were collected from 467 pre-service physics teachers in the Physical Education Department or Science Education Department (Physics Education Major) of 15 universities across the nation. In this study the content validity, substantive validity, the internal structure validity, generalization validity, and the external validity proposed by Messick (1995) were examined by various statistical tests. The results of the MNSQ analysis showed that there was no nonconformity in the 23 items. The internal structure validity was confirmed by the standardized residual variance analysis, which shows that the 22 items was unidimensional. The generalization validity was confirmed by differential item functioning (DIF) analysis about groups lectured or not modern physics/quantum mechanics. In addition, item analysis and test analysis based on classical test theory were performed. The mean item difficulty is 0.66, mean item discrimination is 0.47 and mean point biserial coefficient obtained was 0.41. These results for item parameters satisfied the criteria respectively. The reliability of the internal consistency of the KR-20 is 0.77 and the Ferguson's delta obtained was δ = 0.972. By Rasch model analysis, the item difficulty (item measures) was discussed.

• Educational Technology International
• /
• v.23 no.2
• /
• pp.157-181
• /
• 2022

Scale scores for cognitive domains have been used as an important indicator for both academic achievement and clinical diagnosis. For example, in education, Cognitive Abilities Test (CogAT) has been used to measure student's capability in academic learning. In a clinical setting, Cognitive Impairment Screening Test utilizes items measuring cognitive ability as a dementia screening test. We demonstrated a procedure of generating cognitive ability test items similar as in CogAT but the theory associated with the generation is totally different. When creating cognitive test items, we applied automatic item generation (AIG) that reduces errors in predictions of cognitive ability but attains higher reliability. We selected two cognitive ability test items, categorized as a time estimation item for measuring quantitative reasoning and a paper-folding item for measuring visualization. As CogAT has widely used as a cognitive measurement test, developing an AIG-based cognitive test items will greatly contribute to education field. Since CLASS is the only LMS including AIG technology, we used it for the AIG software to construct item models. The purpose of this study is to demonstrate the item generation process using AIG implemented within CLASS, along with proving quantitative and qualitative strengths of AIG. In result, we confirmed that more than 10,000 items could be made by a single item model in the quantitative aspect and the validity of items could be assured by the procedure based on ECD and AE in the qualitative aspect. This reliable item generation process based on item models would be the key of developing accurate cognitive measurement tests.

• Journal of muscle and joint health
• /
• v.5 no.2
• /
• pp.206-221
• /
• 1998

The purpose of this study was to validate translated Multidimensional Assessment of Fatigue(MAF) scale. The scale is a 16-item scale that measures four dimensions of fatigue : severity, distress, impact, timing. Fourteen items are numerical rating scales and 2 items have multiple choice responses. Data were collected from the 137 patients with rheumatoid arthritis after content validation. Criterion validity was tested by correlation coefficient with Piper Fatigue Scale, which resulted in 0.7573(p<.0000). Construct validity was tested by item analysis and factor analysis. Corrected item-total correlation coefficients were 0.63-0.88. And factor analysis showed 2 factors : fatigue degree factor and fatigue impact factor. These two factors explained 73.5% of total variance. Reliability of internal consistency was 0.96 in Cronbach's alpha. Further validation study is necessary in each factor in other settings with other subjects.

• Physical Therapy Korea
• /
• v.15 no.2
• /
• pp.20-29
• /
• 2008

The purpose of this study was to examine the validity and reliability of the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC)-VA3.0 in patients with hip and knee osteoarthritis (OA). The sample consisted of 301 patients who had received treatments at the physical therapy units of 5 medical institutions in Andong City in june 2006. Questionnaires on the WOMAC were recruited by 12 physical therapists. The internal structure and reliability of the scales were evaluated by means of item-internal consistency (Cronbach's alpha coefficient: ${\alpha}$), item-discriminant validity, and Pearson's relation coefficient. To explore construct validity, we conducted a principal component factor analysis with varimax rotation analysis. The criterion for factor extraction was an eigenvalue >1.0. The average age of the patients was 62.1 years. All WOMAC subscales (pain, stiffness, and physical function) were internally consistent with Cronbach's coefficients of .81, .91, and .80, respectively. The internal consistency reliability of item-each scale were also internally consistent with Cronbach's coefficient of .89 (Pearson's correlation coefficient: .71~.84), .93 (.89~.91), and .96 (.67~.91), respectively. However, high correlation was found among 3 items (.66~.83, .66~.67, and .67~.83), so the item-discriminant validity was low (${\alpha}$ coefficient: .81, .91, .80, respectively). The construct validity by factor analysis was low because it was not consistent With WOMAC-VA3.0. In conclusion, the results reported here confirm the reliability of the WOMAC in patients with OA of the hip and knee. The collection of information on the hip and knee osteoarthritis using this instrument was acceptable to patients. A further prospective multi-center study will be necessary to prove the construct validity.

• Journal of Korean Academy of Nursing
• /
• v.25 no.1
• /
• pp.141-155
• /
• 1995

The objective of this study was to develop a scale to measure stress in infertile couples and to test its reliability and validity. Prior to item generation, a basic decision was made to conceptualize stress in infertile couples as including two dimensions and four subdimensions. The dimensions were, intrapersonal stress including cognitive and affective stress, and interpersonal stress including marital and social stress. Initially 95 items were generated from the inter-view data of 31 primary or secondary infertile women and from a literature review. These items were analyzed through the Index of Content Validity(CVI) and 69 items were selected which met 70% or more of the CVI. This preliminary Infertility Stress Scale were analyzed for reliability and construct validity. Item analysis and factor analysis were applied for construct validity. Forty items were selected through item analysis. This procedure was based on the inter-item correlation matrix, a corrected average inter-item correlation coefficient(.30~.70), a corrected item to total correlation coefficient (.03 or more) and information about the alpha estimate if this item was dropped from the scale. The result of the initial factor analysis including varimax rotation produced eight factors. Five items deleted because of factor complexity(indiscriminate factor loadings). The secondary factor analysis including varimax rotation produced seven factors that coincided with the conceptual framework posed for the scale developed. The seven factors were labeled as ‘meaning of children’,‘worthiness’,‘tenacious linking’,‘marital satisfaction’,‘sexual satisfaction’,‘familial adjustment’ and ‘social adjustment’. The alpha coefficient relating to internal consistency was .93 for reliability The results of this study suggest that the measurement derived from the Infertility Stress Scale is useful in assessing the stress of infertile couples.

• Journal of Preventive Medicine and Public Health
• /
• v.38 no.1
• /
• pp.61-70
• /
• 2005

Objectives : To develop a tool for multidimensional measurement of the quality of life, which was psychometrically sound, short, and easy to administer for patients with hypertension. Methods : A sample of 1,115 hypertensive patients aged 20 or above in Cheong-Song County was studied from June 1997 to October 1998. In the development of the instrumental stage, the authors first conceptualized the quality of life. Item generation, item reduction, and questionnaire formatting were followed. Item-level (item descriptive, missing%, item internal consistency, item discriminant validity) analysis, scale-level (scale descriptive, floor and ceiling effect) analysis, and other tests(Cronbach's alpha, inter-dimension correlations, factor analysis, clinical validity) were performed to evaluate the validity and reliability of the new measurement scale. After 1 year, responsiveness and confirmatory factor analysis were performed. Results : The results of both item-level and scale-level analyses were acceptable. An acceptable degree of internal consistency was observed for each of the dimensions (Cronbach's alpha was 0.60 or higher). Inter-dimension correlations were below 0.50 and the factor analysis result was the same as the intended dimension structure. Correlation coefficients between perceived health status, stress and dimensions were proven to be acceptable. The result of comparing dimensional score means among ADL and MMSE-K groups above 60 years was statistically significant(p<0.05). The result of confirmatory factor analysis concluded that the dimensional structure model was well fitted. However, the result of responsiveness test using sensitivity and specificity was unsatisfactory. Conclusions : The newly developed measurement scale is psychometrically reliable and valid instrument for measuring quality of life in hypertensive patients.

• Journal of Korean Academy of Nursing
• /
• v.37 no.3
• /
• pp.324-333
• /
• 2007

Purpose: The purpose of this study was to develop and evaluate a quality of life scale for Korean patients with cancer (C-QOL). Methods: The C-QOL was developed and validated as follows, item generation, pilot study, and psychometric tests. A total of 337 patients diagnosed with stomach, liver, lung, colon, breast, or cervix cancer were recruited. The patients were asked to complete the preliminary questionnaire comprising the content-validated items, the SF-36, and the ECOG performance status. The obtained data was analyzed using descriptive statistics, factor analysis, multidimensional scaling (MDS), multitrait/multi-item matrix, ANOVA, t-test, and Cronbach's alpha. Results: Preliminarily twenty-six items were generated through content validity and a pilot study. Factor analysis and MDS extracted a total of 21 items with a 5-point Likert-type scale (C-QOL). The C-QOL included five subscales: physical status (6 items), emotional status (6 items), social function (3 items), concern status (2 items), and coping function (4 items). The C-QOL established content validity, construct validity, item convergent and discriminant validity, known-groups validity, reliability, and sensitivity. Conclusion: The Newly developed C-QOL is an easily applicable instrument which established psychometric properties and reflected Korean culture. It is recommended for further study to examine the responsiveness of the C-QOL using a longitudinal research design.

• Women's Health Nursing
• /
• v.24 no.3
• /
• pp.297-309
• /
• 2018

Purpose: To develop Pregnancy Risk symptom Perception Scale (PRPS) and evaluate its validity and reliability. Methods: A preliminary 30-item version of PRPS was developed through literature review, in-depth interview, and Content Validity. Each item was scored on a four-point Likert scale. The preliminary scale was developed based on 301 pregnant women who visited a hospital. Date were analyzed using item analysis, factor analysis, confirmatory factor analysis, Pearson's correlation coefficients, and Cronbach's ${\alpha}$ (0.90 for total item, 0.80 to 0.88 for factors). Results: The PRPS consisted of 27 items. Three factors (physical, environmental, and emotional factors) explained 55% of the total variance. Cronbach's Criterion validity was supported by comparison with the Perception of Pregnancy Risk Questionnaire (r=0.34). In reliability test, the reliability coefficient of pregnancy risk symptom perception was high at 0.90. Conclusion: These results suggest that the pregnancy risk symptom perception scale developed in this study comprises items that can assess the level of pregnant women's pregnancy risk symptom perception in Korea. Its validity and reliability were proven. PRPS can be utilized to measure pregnant women's risk symptom perception during pregnancy. PRPS will contribute to the development of systematic prenatal care and effective risk management.