• Title/Summary/Keyword: Assessing Item

검색결과 151건 처리시간 0.025초

화물품목의 중요도를 반영한 철도화물취급역의 효율성 평가 (Assessing the Efficiency of Freight Railroad Stations Reflecting Freight Item Importance Weights)

  • 김성호;최태성
    • 한국철도학회논문집
    • /
    • 제13권3호
    • /
    • pp.327-332
    • /
    • 2010
  • 본 논문에서는 다수의 성과지표를 동시에 고려하며 각 역의 운영조건을 반영하고 더불어 화물품목의 중요도를 반영하여 각 화물취급역의 성과를 평가하는 방안을 제안하였다. 본 논문에서는 187개 화물취급역에 대해서 품목별 '발송규모'와 '도착규모'를 성과지표로 사용하고 각 역의 '화물인력'과 '유치가능량'을 운영조건지 표로 사용하며 품목별 중요도를 확신영역 제약조건으로 반영하는 자료포락분석으로 효율성을 평가하였다. 이러한 결과는 철도경영자 또는 철도정책담당자의 경영전략이나 정책의사결정에 유용한 정보로 사용될 수 있을 것으로 기대한다.

노인의 낙상에 영향을 주는 요인을 평가하기 위한 ABC-BBS의 적용: 사전연구 (Combining Two Scales to Assess Risk Factors of Falling in Community-Dwelling Elderly Persons: A Preliminary Study)

  • 박소연
    • 한국전문물리치료학회지
    • /
    • 제15권2호
    • /
    • pp.44-53
    • /
    • 2008
  • The purpose of this preliminary study was to develop a measurement for assessing risk factors for falling in community-dwelling elderly persons. Rasch analysis and principal component analysis were performed to examine whether items on the Activities-Specific Balance Confidence (ABC), assessing self-efficacy, and items on the Berg Balance Scale (BBS), assessing balance function, contribute jointly to a unidimensional construct in the elderly. A total of 35 elderly persons (4 men, 31 women) participated. In this study, each item of ABC (16 items) and BBS (14 items) was scored on a 5-point ordinal rating scale from 0 to 4. The initial Rasch and principal component analysis indicated that 3 of the ABC items and 2 of the BBS items were misfit for this study. These 5 items were excluded from further study. After combining ABC and BBS, Rasch and principal component analyses were examined and finally 23 items selected; 12 items from ABC, 11 items from BBS. The 23 combined ABC-BBC items were arranged in order of difficulty. The hardest item was 'walk outside on icy sidewalks' and the easiest item was 'pivot transfer'. Although structural calibration of each 5 rating scale categories was not ordered, the other three essential criteria of Linacre's optimal rating scale were satisfied. Overall, the ABC-BBS showed sound item psychometric properties. Each of the 5 rating scale categories appeared to distinctly identify subjects at different ability levels. The findings of this study support that the new ABC-BBS scale measure balance function and self-efficacy. It will be a clinically useful assessment of risk factors for falling in the elderly. However, the number of subjects was too small to generalize our results. Further study is needed to develop a new assessment considering more risk factors of falling in elderly.

  • PDF

공학계열 대학생 물리 기초학력평가 문항분석 및 성취수준 설정 사례연구 (A Case Study on Item Analysis and Standard Setting of the Physics Basic Ability Test for Engineering College Students)

  • 이금호;정혜경
    • 공학교육연구
    • /
    • 제26권6호
    • /
    • pp.40-50
    • /
    • 2023
  • This study is to examine the validity of assessing basic-level proficiency in physics among incoming engineering freshmen through item analysis and standard setting. For empirical analysis, we examined the physics subject taken by the freshman class of 2021 at K University, considering its significance for engineering students. In this study, we initially performed item analysis utilizing both classical test theory and item response theory. Subsequently, leveraging the item and test information, we employed a modified Angoff method and the Bookmark method for standard setting. Consequently, the difficulty level initially set during item development was found to be higher than the actual performance level exhibited by the students. This study highlights a discernible disparity between the expected university standard and the real proficiency level of incoming freshmen in terms of basic academic ability in physics. Based on these research findings, a comprehensive discussion on the fundamental academic competence of engineering students was conducted, underscoring the necessity for formulating a tailored learning approach leveraging the outcomes from the basic ability test.

대학생들이 인식하는 가족개념과 가족건강성의 관계 (The Relationship between Family Concept and Family Strengths Perceived by College Students)

  • 박수선
    • 가족자원경영과 정책
    • /
    • 제14권1호
    • /
    • pp.37-55
    • /
    • 2010
  • The purpose of this study was to determine the factors affecting family strength and therewith, suggest some strategies to improve family strength and welfare. For this purpose, the researcher sampled 208 college students and surveyed them for their perceptions of the concept of family and family strengths. The results of this study can be summarized as follows. First, as a result of surveying the subjects on their perception of the concept of family, it was found that almost all of them (99%) perceived that 'a family consists of a couple and their children' (item 1). The other items regarding the concept of family chosen by the majority of subjects were 'a couple and adopted child' (item 3 & item 17), 'a remarried couple and their children' (item 9), 'a single parent and children' (item 2), 'a three-generation family; couple, widowed daughter and granddaughter' (item 4), 'three sisters' (item 7), 'an unmarried woman living with a son born from a sperm bank' (item 19), 'a separated couple with no child' (item 13), 'cousins living together' (item 11), 'a divorced man and his girlfriend with child' (item 15) and 'homosexual family' (item 8). Second, as a result of assessing subjects' needs for family functions and their efforts for family strengths, it was found that the family functions for family members scored higher than those for the society, and that subjects' efforts for the family functions conducive to both their family members and society scored lower than their needs for the family functions. Third, subjects' needs and efforts for family functions were positively correlated with family strengths. Namely, family functions were closely related with family strengths.

  • PDF

The Use of Rasch Model in Developing a Short Form Based on Self-Reported Activity Measure for Low Back Pain

  • Choi, Bong-Sam
    • 한국전문물리치료학회지
    • /
    • 제21권4호
    • /
    • pp.56-66
    • /
    • 2014
  • For maintaining adequate psychometric properties when reducing the number of items from an instrument, item level psychometrics is crucial. Strategies such as low item correlation or factor loadings, using classical test theory, have traditionally been advocated. The purpose of this study is to describe the development of a new short form assessing the impact of low back pain on physical activity. Rasch measurement model has been applied to the International Classification of Functioning, Disability and Health Activity Measure (ICF-AM). One hundred and one individuals with low back pain aged 19-89 years (mean age: $48.1{\pm}17.3$) who live in the community were participated in the study. Twenty-seven items of lifting/carrying construct of the ICF-AM were analyzed. Ten items were selected from the construct to create a short form. Item elimination criteria include: 1) high or low mean square (out of the range: .6-1.4 for the fit statistics), 2) similar item calibrations to adjacent items, 3) person separation value, and item-person map for potential gap in person ability continuum. All 10 items of the short form fit to the Rasch model except one item (i.e., carrying toddler on back). Despite its high infit and outfit statistics (1.90/2.17), the item had to be reinstated due to potential gaps at the upper extreme of person ability level. The short form had a slightly better spread of person ability continuum compared to the entire set of item. The created short form separated individuals with low back pain into nearly 4 groups, while the entire set of items separated the individuals into 6 groups. The findings prompted multidimensional models for better explanation of the lifting/carrying domain. The item level psychometrics based on the Rasch model can be useful in developing short forms with rationally retained items.

어린이집 프로그램 관찰척도의 개발과 타당화 (Development and Validation of an Observation Scale for Day Care Programs)

  • 이은해;최혜영;송혜린;신혜영
    • 아동학회지
    • /
    • 제24권3호
    • /
    • pp.135-149
    • /
    • 2003
  • This study aimed to develop an observation scale for assessing the quality of day care programs and to examine reliability and validity of the scale. Instruments included 3 self-assessment scales, the Evaluation Scale for Early Childhood Programs and an observation scale completed by 8 trained observers in 89 day care sites. Item analysis indicated that most items were acceptable in terms of item discrimination and item response distribution. Cronbach ${\alpha}^{\prime}s$ and inter-observer reliability were relatively high. Validity of the scale was evidenced by correlations between the observation scale and the criterion measure and inter-correlations among sub-areas of the observation scale. Scores on the observation scale were validated by quality ratings from self-assessment scores.

  • PDF

간호학생을 대상으로한 건강관련 강인성 도구(HRHS)의 신뢰도와 타당도 검증 및 수정 (The Reliability and Validity of the Health-Related Hardiness Scale in a Sample of Korean Nursing Students)

  • 이미라
    • 지역사회간호학회지
    • /
    • 제11권1호
    • /
    • pp.199-208
    • /
    • 2000
  • The purpose of this study is to test the psychometric properties of the Korean version of the Health-Related Hardiness Scale(HRHS) in a sample of Korean nursing students. The korean version of HRHS was administered to 234 nursing students including 135 college students and 99 university students. The Korean version of HRHS was measured on a 6 Likert scale, assessing three factors of HRHS : control, commitment, and challenge. Internal consistency was used to test the instrument's reliability. The internal consistency of the scale was measured using a coefficient alpha. The coefficient alpha was .69(control), .49(commitment). and .69(challenge), Item analysis and confirmatory factor analysis (CFA) were used to test the instrument's construct validity. The item analysis identified that there were 13 items. which were lower than the .25 item-total correlation. CFA revealed that the scale's fadoral validity was not proper by showing unfit indices(RMSEA .07. stand, RMR .09. GFI .71). According to the findings of this study, the reliability and construct validity of the Korean version of HRHS is not satisfactory in the sample of nursing students. As a result. the researcher modified the scale through item analysis and repetitive CFA process, and proposed the revised 25-item Korean version of HRHS for nursing students. The revised scale's reliability(control .74, commitment .73. challenge .77) and factorial validity were within acceptable levels. The item analysis identified that there was no item, which is lower than the .25 item-total correlation. CFA revealed that the scale's factoral validity was proper by showing fit indices(RMSEA .08 stand. RMR .08. GFI .80).

  • PDF

한국어판 알츠하이머병 지식 측정도구의 신뢰도와 타당도 (Psychometric Properties of the Alzheimer's Disease Knowledge Scale-Korean Version)

  • 김은주;정지영
    • 대한간호학회지
    • /
    • 제45권1호
    • /
    • pp.107-117
    • /
    • 2015
  • Purpose: The purpose of this study was to evaluate the psychometric properties of the Korean version of the Alzheimer's Disease Knowledge Scale (ADKS-K) to determine its applicability to Korean adults. Methods: Cross-cultural validity was performed according to Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN). The Kuder-Richardson Formula 20 for internal consistency and Intraclass Correlation Coefficient (ICC) for test-retest reliability were conducted. Content validity, criterion related validity and construct validity were evaluated. The Classical Test Theory (CTT) model and the Item Response Theory (IRT) model were applied in performing the item analysis. Results: The KR 20 was .71, and the ICC was .90, indicating that the ADKS-K has internal consistency and stability reliability. Thirty items of the ADKS-K had significant Content Validity Ratio (CVR) values, i.e., mean of 0.82 and range of 0.60~1.00. Mean item difficulty and discrimination indices calculated by TestAn program were 0.63 and 0.23, respectively. Mean item difficulty and discrimination indices calculated by BayesiAn program were -0.60 and 0.77, respectively. These tests indicate that ADKS-K has an acceptable level of difficulty and discriminating efficiency. Conclusion: Results suggest that ADKS-K has the potential to be a proper instrument for assessing AD knowledge in Korean adults.

불임 스트레스 척도 개발에 관한 연구 (A Study on the Development of an Infertility Stress Scale)

  • 김선행;박영주;장성옥
    • 대한간호학회지
    • /
    • 제25권1호
    • /
    • pp.141-155
    • /
    • 1995
  • The objective of this study was to develop a scale to measure stress in infertile couples and to test its reliability and validity. Prior to item generation, a basic decision was made to conceptualize stress in infertile couples as including two dimensions and four subdimensions. The dimensions were, intrapersonal stress including cognitive and affective stress, and interpersonal stress including marital and social stress. Initially 95 items were generated from the inter-view data of 31 primary or secondary infertile women and from a literature review. These items were analyzed through the Index of Content Validity(CVI) and 69 items were selected which met 70% or more of the CVI. This preliminary Infertility Stress Scale were analyzed for reliability and construct validity. Item analysis and factor analysis were applied for construct validity. Forty items were selected through item analysis. This procedure was based on the inter-item correlation matrix, a corrected average inter-item correlation coefficient(.30~.70), a corrected item to total correlation coefficient (.03 or more) and information about the alpha estimate if this item was dropped from the scale. The result of the initial factor analysis including varimax rotation produced eight factors. Five items deleted because of factor complexity(indiscriminate factor loadings). The secondary factor analysis including varimax rotation produced seven factors that coincided with the conceptual framework posed for the scale developed. The seven factors were labeled as ‘meaning of children’,‘worthiness’,‘tenacious linking’,‘marital satisfaction’,‘sexual satisfaction’,‘familial adjustment’ and ‘social adjustment’. The alpha coefficient relating to internal consistency was .93 for reliability The results of this study suggest that the measurement derived from the Infertility Stress Scale is useful in assessing the stress of infertile couples.

  • PDF

구성 타당성 평가방법에 관한 연구 (A Study on the Methods for Assessing Construct Validity)

  • 이광희;이선규;장성호
    • 산업경영시스템학회지
    • /
    • 제22권50호
    • /
    • pp.1-9
    • /
    • 1999
  • The purpose of this study is to establish a basis for assessing construct validity of measures used in organizational research. The classic Campbell and Fiske's(1959) criteria are found to be lacking in their assumptions, diagnostic information, and power. The inherent confounding of measurement error with systematic trait and method effects is a severe limitation for a proper interpretation of convergent and discriminant validity. The confirmatory factor analysis(CFA) approach overcomes most of the limitations found in Campbell and Fiske's(1959) method. However, the CFA approach confounds random error with unique variance specific to a measure. The second-order confirmatory factor analysis(SOCFA) was shown to harbor rather restrictive assumptions and is unlikely to be met in practice. The first-order, multiple-informant, multiple-item(FOMIMI) model is a viable option, but it may also be of limited use because of the large number measures.

  • PDF