• Journal of the Korean Society for Railway
• /
• v.13 no.3
• /
• pp.327-332
• /
• 2010

In this paper we presents an approach to assessing the efficiency of freight railroad stations reflecting freight item importance weights with multiple performance indicators and multiple operational condition indicators. We evaluate 187 freight railroad stations using data envelopment analysis with assurance region. Each freight item's loading/unloading volume is used as a performance indicator. Freight labor and yard capacity are used as operational condition indicators. Freight item importance weights are reflected to the data envelopment analysis as assurance region. The evaluation results facilitates the organization's decision making by providing valuable information.

• Physical Therapy Korea
• /
• v.15 no.2
• /
• pp.44-53
• /
• 2008

The purpose of this preliminary study was to develop a measurement for assessing risk factors for falling in community-dwelling elderly persons. Rasch analysis and principal component analysis were performed to examine whether items on the Activities-Specific Balance Confidence (ABC), assessing self-efficacy, and items on the Berg Balance Scale (BBS), assessing balance function, contribute jointly to a unidimensional construct in the elderly. A total of 35 elderly persons (4 men, 31 women) participated. In this study, each item of ABC (16 items) and BBS (14 items) was scored on a 5-point ordinal rating scale from 0 to 4. The initial Rasch and principal component analysis indicated that 3 of the ABC items and 2 of the BBS items were misfit for this study. These 5 items were excluded from further study. After combining ABC and BBS, Rasch and principal component analyses were examined and finally 23 items selected; 12 items from ABC, 11 items from BBS. The 23 combined ABC-BBC items were arranged in order of difficulty. The hardest item was 'walk outside on icy sidewalks' and the easiest item was 'pivot transfer'. Although structural calibration of each 5 rating scale categories was not ordered, the other three essential criteria of Linacre's optimal rating scale were satisfied. Overall, the ABC-BBS showed sound item psychometric properties. Each of the 5 rating scale categories appeared to distinctly identify subjects at different ability levels. The findings of this study support that the new ABC-BBS scale measure balance function and self-efficacy. It will be a clinically useful assessment of risk factors for falling in the elderly. However, the number of subjects was too small to generalize our results. Further study is needed to develop a new assessment considering more risk factors of falling in elderly.

• Journal of Engineering Education Research
• /
• v.26 no.6
• /
• pp.40-50
• /
• 2023

This study is to examine the validity of assessing basic-level proficiency in physics among incoming engineering freshmen through item analysis and standard setting. For empirical analysis, we examined the physics subject taken by the freshman class of 2021 at K University, considering its significance for engineering students. In this study, we initially performed item analysis utilizing both classical test theory and item response theory. Subsequently, leveraging the item and test information, we employed a modified Angoff method and the Bookmark method for standard setting. Consequently, the difficulty level initially set during item development was found to be higher than the actual performance level exhibited by the students. This study highlights a discernible disparity between the expected university standard and the real proficiency level of incoming freshmen in terms of basic academic ability in physics. Based on these research findings, a comprehensive discussion on the fundamental academic competence of engineering students was conducted, underscoring the necessity for formulating a tailored learning approach leveraging the outcomes from the basic ability test.

• Journal of Family Resource Management and Policy Review
• /
• v.14 no.1
• /
• pp.37-55
• /
• 2010

The purpose of this study was to determine the factors affecting family strength and therewith, suggest some strategies to improve family strength and welfare. For this purpose, the researcher sampled 208 college students and surveyed them for their perceptions of the concept of family and family strengths. The results of this study can be summarized as follows. First, as a result of surveying the subjects on their perception of the concept of family, it was found that almost all of them (99%) perceived that 'a family consists of a couple and their children' (item 1). The other items regarding the concept of family chosen by the majority of subjects were 'a couple and adopted child' (item 3 & item 17), 'a remarried couple and their children' (item 9), 'a single parent and children' (item 2), 'a three-generation family; couple, widowed daughter and granddaughter' (item 4), 'three sisters' (item 7), 'an unmarried woman living with a son born from a sperm bank' (item 19), 'a separated couple with no child' (item 13), 'cousins living together' (item 11), 'a divorced man and his girlfriend with child' (item 15) and 'homosexual family' (item 8). Second, as a result of assessing subjects' needs for family functions and their efforts for family strengths, it was found that the family functions for family members scored higher than those for the society, and that subjects' efforts for the family functions conducive to both their family members and society scored lower than their needs for the family functions. Third, subjects' needs and efforts for family functions were positively correlated with family strengths. Namely, family functions were closely related with family strengths.

• Physical Therapy Korea
• /
• v.21 no.4
• /
• pp.56-66
• /
• 2014

For maintaining adequate psychometric properties when reducing the number of items from an instrument, item level psychometrics is crucial. Strategies such as low item correlation or factor loadings, using classical test theory, have traditionally been advocated. The purpose of this study is to describe the development of a new short form assessing the impact of low back pain on physical activity. Rasch measurement model has been applied to the International Classification of Functioning, Disability and Health Activity Measure (ICF-AM). One hundred and one individuals with low back pain aged 19-89 years (mean age: $48.1{\pm}17.3$) who live in the community were participated in the study. Twenty-seven items of lifting/carrying construct of the ICF-AM were analyzed. Ten items were selected from the construct to create a short form. Item elimination criteria include: 1) high or low mean square (out of the range: .6-1.4 for the fit statistics), 2) similar item calibrations to adjacent items, 3) person separation value, and item-person map for potential gap in person ability continuum. All 10 items of the short form fit to the Rasch model except one item (i.e., carrying toddler on back). Despite its high infit and outfit statistics (1.90/2.17), the item had to be reinstated due to potential gaps at the upper extreme of person ability level. The short form had a slightly better spread of person ability continuum compared to the entire set of item. The created short form separated individuals with low back pain into nearly 4 groups, while the entire set of items separated the individuals into 6 groups. The findings prompted multidimensional models for better explanation of the lifting/carrying domain. The item level psychometrics based on the Rasch model can be useful in developing short forms with rationally retained items.

• Korean Journal of Child Studies
• /
• v.24 no.3
• /
• pp.135-149
• /
• 2003

This study aimed to develop an observation scale for assessing the quality of day care programs and to examine reliability and validity of the scale. Instruments included 3 self-assessment scales, the Evaluation Scale for Early Childhood Programs and an observation scale completed by 8 trained observers in 89 day care sites. Item analysis indicated that most items were acceptable in terms of item discrimination and item response distribution. Cronbach ${\alpha}^{\prime}s$ and inter-observer reliability were relatively high. Validity of the scale was evidenced by correlations between the observation scale and the criterion measure and inter-correlations among sub-areas of the observation scale. Scores on the observation scale were validated by quality ratings from self-assessment scores.

• Research in Community and Public Health Nursing
• /
• v.11 no.1
• /
• pp.199-208
• /
• 2000

The purpose of this study is to test the psychometric properties of the Korean version of the Health-Related Hardiness Scale(HRHS) in a sample of Korean nursing students. The korean version of HRHS was administered to 234 nursing students including 135 college students and 99 university students. The Korean version of HRHS was measured on a 6 Likert scale, assessing three factors of HRHS : control, commitment, and challenge. Internal consistency was used to test the instrument's reliability. The internal consistency of the scale was measured using a coefficient alpha. The coefficient alpha was .69(control), .49(commitment). and .69(challenge), Item analysis and confirmatory factor analysis (CFA) were used to test the instrument's construct validity. The item analysis identified that there were 13 items. which were lower than the .25 item-total correlation. CFA revealed that the scale's fadoral validity was not proper by showing unfit indices(RMSEA .07. stand, RMR .09. GFI .71). According to the findings of this study, the reliability and construct validity of the Korean version of HRHS is not satisfactory in the sample of nursing students. As a result. the researcher modified the scale through item analysis and repetitive CFA process, and proposed the revised 25-item Korean version of HRHS for nursing students. The revised scale's reliability(control .74, commitment .73. challenge .77) and factorial validity were within acceptable levels. The item analysis identified that there was no item, which is lower than the .25 item-total correlation. CFA revealed that the scale's factoral validity was proper by showing fit indices(RMSEA .08 stand. RMR .08. GFI .80).

• Journal of Korean Academy of Nursing
• /
• v.45 no.1
• /
• pp.107-117
• /
• 2015

Purpose: The purpose of this study was to evaluate the psychometric properties of the Korean version of the Alzheimer's Disease Knowledge Scale (ADKS-K) to determine its applicability to Korean adults. Methods: Cross-cultural validity was performed according to Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN). The Kuder-Richardson Formula 20 for internal consistency and Intraclass Correlation Coefficient (ICC) for test-retest reliability were conducted. Content validity, criterion related validity and construct validity were evaluated. The Classical Test Theory (CTT) model and the Item Response Theory (IRT) model were applied in performing the item analysis. Results: The KR 20 was .71, and the ICC was .90, indicating that the ADKS-K has internal consistency and stability reliability. Thirty items of the ADKS-K had significant Content Validity Ratio (CVR) values, i.e., mean of 0.82 and range of 0.60~1.00. Mean item difficulty and discrimination indices calculated by TestAn program were 0.63 and 0.23, respectively. Mean item difficulty and discrimination indices calculated by BayesiAn program were -0.60 and 0.77, respectively. These tests indicate that ADKS-K has an acceptable level of difficulty and discriminating efficiency. Conclusion: Results suggest that ADKS-K has the potential to be a proper instrument for assessing AD knowledge in Korean adults.

• Journal of Korean Academy of Nursing
• /
• v.25 no.1
• /
• pp.141-155
• /
• 1995

The objective of this study was to develop a scale to measure stress in infertile couples and to test its reliability and validity. Prior to item generation, a basic decision was made to conceptualize stress in infertile couples as including two dimensions and four subdimensions. The dimensions were, intrapersonal stress including cognitive and affective stress, and interpersonal stress including marital and social stress. Initially 95 items were generated from the inter-view data of 31 primary or secondary infertile women and from a literature review. These items were analyzed through the Index of Content Validity(CVI) and 69 items were selected which met 70% or more of the CVI. This preliminary Infertility Stress Scale were analyzed for reliability and construct validity. Item analysis and factor analysis were applied for construct validity. Forty items were selected through item analysis. This procedure was based on the inter-item correlation matrix, a corrected average inter-item correlation coefficient(.30~.70), a corrected item to total correlation coefficient (.03 or more) and information about the alpha estimate if this item was dropped from the scale. The result of the initial factor analysis including varimax rotation produced eight factors. Five items deleted because of factor complexity(indiscriminate factor loadings). The secondary factor analysis including varimax rotation produced seven factors that coincided with the conceptual framework posed for the scale developed. The seven factors were labeled as ‘meaning of children’,‘worthiness’,‘tenacious linking’,‘marital satisfaction’,‘sexual satisfaction’,‘familial adjustment’ and ‘social adjustment’. The alpha coefficient relating to internal consistency was .93 for reliability The results of this study suggest that the measurement derived from the Infertility Stress Scale is useful in assessing the stress of infertile couples.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.22 no.50
• /
• pp.1-9
• /
• 1999

The purpose of this study is to establish a basis for assessing construct validity of measures used in organizational research. The classic Campbell and Fiske's(1959) criteria are found to be lacking in their assumptions, diagnostic information, and power. The inherent confounding of measurement error with systematic trait and method effects is a severe limitation for a proper interpretation of convergent and discriminant validity. The confirmatory factor analysis(CFA) approach overcomes most of the limitations found in Campbell and Fiske's(1959) method. However, the CFA approach confounds random error with unique variance specific to a measure. The second-order confirmatory factor analysis(SOCFA) was shown to harbor rather restrictive assumptions and is unlikely to be met in practice. The first-order, multiple-informant, multiple-item(FOMIMI) model is a viable option, but it may also be of limited use because of the large number measures.