• Title/Summary/Keyword: Item validity

Search Result 824, Processing Time 0.031 seconds

Concurrent Validity of the Seven-Item BBS-3P with Other Clinical Measures of Balance in a Sample of Stroke Patients

  • Kim, Da-Yeon;Kim, Tae-Ho;Kim, Jung-Bin
    • The Journal of Korean Physical Therapy
    • /
    • v.29 no.3
    • /
    • pp.122-127
    • /
    • 2017
  • Purpose: The aim of this study was to investigate if the 7-item Berg balance scale (BBS) 3-point, which is a short form of the BBS (SFBBS), has compatible psychometric properties in comparison with the original BBS, and also to study the concurrent validity using a 10-meter walk test (10mWT) and a timed up and go test (TUG), which are widely used with SFBBS in clinical settings. Methods: A total of 255 patients who had experienced stroke participated in this cross-sectional study. We used results obtained from 188 patients who completed both 10mWT and TUG. The three levels in the center of the BBS were collapsed to a single level (i.e.,0-2-4) to form the SFBBS. The concurrent validity was assessed by computing the Spearman coefficients for correlation among outcome measures and in between each outcome measure and the SFBBS. As there were four outcomes, the corrected p-value for significant correlation was 0.013 (0.05/4). Results: Spearman coefficients for correlations and evaluation instruments for concurrent validity revealed significantly high validity for both of SFBBS and BBS (r=0.944). 10mWT and TUG were -0.749 and -0.770 respectively, which are in the high margin and are statistically significant (p>0.000). Conclusion: SFBBS has sound psychometric properties for evaluating patients with stroke. Thus, we recommend the use of SFBBS in both clinical and research settings.

Development and Validation of a Survey Form for Adverse Events Associated with Acupuncture and Moxibustion (침구 치료 이상반응 설문지 개발과 타당도 평가)

  • Kim, Seoyeon;Lee, Jun-Hwan;Yook, Tae Han;Park, Jimin;Leem, Jungtae;Lee, Hyangsook
    • Korean Journal of Acupuncture
    • /
    • v.32 no.4
    • /
    • pp.177-189
    • /
    • 2015
  • Objectives : To develop and validate a survey form for adverse events(AEs) associated with acupuncture and moxibustion treatment. Methods : The 1st version of a survey form consisting of 9 categories was developed and modified based on the analysis of questionnaires from previous studies on AEs. To evaluate content validity of the 1st version, a Delphi survey where experts in acupuncture and moxibustion, and research methodology were invited, was conducted alongside a separate content validity questionnaire. The content validity indices for each item and total scale were calculated as the proportion of the number of experts judging each item or scale valid to the number of total experts. Results : After the Delphi round 1, the content validity of 2 items and total scale was rated as inadequate. The 1st version was modified accordingly, and the 2nd version of the survey form was developed. The content validity of the 2nd version was assessed in the Delphi round 2 and the final version was completed after incorporating the expert comments. The final version consists of 13 questions regarding practitioner/patient information, condition/disease, intervention, treated body parts, safety issue and AE occurrence related with practitioner's behavior or instruments, AEs associated with treatment and emergency actions taken if necessary, time to AE occurrence, outcomes, serious AEs or death, and time to AE disappearance. Conclusions : This newly developed and validated survey form will serve to collect AEs associated with acupuncture and moxibustion treatments in Korea and contribute to establishing the evidence on safety of Korean acupuncture treatment.

Development and Psychometric Evaluation of the Patient Safety Violation Scale in Medical Oncology Units in Iran

  • Shali, Mahboobeh;Ghaffari, Fatemeh;Joolaee, Soodabeh;Ebadi, Abbas
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.17 no.9
    • /
    • pp.4341-4347
    • /
    • 2016
  • Background: Patient safety is one of the key components of nursing care for cancer cases. Valid and reliable context-based instruments are necessary for accurate evaluation of patient safety in oncology units. The aim of the present study was to develop and evaluate the psychometric properties of the Patient Safety Violation Scale in medical oncology units in Iran. Materials and Methods: In this methodological study, a pool of 58 items was generated through reviewing the existing literature. The validity of the 58-item scale was assessed through calculating impact score, content validity ratio, and content validity index for its items as well as conducting exploratory factor analysis. The reliability of the scale was evaluated by assessing its internal consistency and testretest stability. Study sample consisted of 300 oncology nurses who were recruited from thirteen teaching hospitals affiliated to Tehran University of Medical Sciences, Tehran, Iran. Results: Sixteen items were excluded from the scale due to having low impact scores, content validity ratios, or content validity indices. In exploratory factor analysis, the remaining 42 items were loaded on five factors including patient fall, verification of patientidentity, harm during care delivery, delay in care delivery, and medication errors. These five factors explained 62% of the total variance. The Cronbach's alpha of the scale and the test-retest interclass correlation coefficient were equal to 0.933 and 0.92, respectively. Conclusions: The 42-item Patient Safety Violation Scale is a simple and short scale which has acceptable validity and reliability. Consequently, it can be used for assessing patient safety in clinical settings such as medical oncology units and for research projects.

Nursing needs assessment scale for women with infertility: development and validation (난임 여성의 간호 요구 측정 도구 개발 및 타당도 검정)

  • Park, Jummi;Shin, Nayeon;Lee, Kyungmi
    • Women's Health Nursing
    • /
    • v.26 no.2
    • /
    • pp.141-150
    • /
    • 2020
  • Purpose: High-quality nursing care must be provided for women with infertility, and their nursing needs must be identified. Although scales have been developed to assess infertility-related stress, quality of life, and psychosocial status, there is a lack of scales that assess the nursing needs of women with infertility. The purpose of this study was to develop a needs assessment scale for nursing care in women with infertility and to verify its reliability and validity. Methods: The 250 subjects in this study were women with infertility recruited from four hospitals. The scale was developed following the framework of DeVellis, through a literature review, in-depth interviews, development of preliminary items, verification of content validity, development of secondary items, verification of construct validity, and extraction of the final items. Date were analyzed using item analysis, factor analysis, confirmatory factor analysis, Pearson correlation coefficients, and Cronbach's alpha. Reliability was tested using Cronbach's alpha, and validity was evaluated using item analysis, exploratory factor analysis, and criterion validity. Results: The final version of the nursing needs assessment scale for woman with infertility consisted of 18 items. Four factors (physical and psychological nursing needs, needs for information regarding treatment, needs for infertility-related understanding and concern, and supportive needs) explained 66.0% of the total variance. Cronbach's alpha was .92 for the overall instrument and ranged from .88 to .91 for the subscales. Conclusion: These results suggest that this needs assessment scale for nursing care in women with infertility demonstrated acceptable validity and reliability and contained items suitable for assessing the level of nursing care needed by women with infertility.

Development of the Cultural Competence Scale for Registered Nurses (CCS-RN) (간호사의 문화간호역량 측정도구의 개발)

  • Kim, Kyung Won;Kim, Sun-Hee;Kim, Young Hee;Kim, Hyun Kyoung;Park, Hae Sook;Lee, Sun Hee;Jeong, Geum Hee
    • Research in Community and Public Health Nursing
    • /
    • v.30 no.3
    • /
    • pp.281-294
    • /
    • 2019
  • Purpose: This study is to develop the Cultural Competence Scale for Registered Nurses (CCS-RN) and to examine its validity and reliability. Methods: The item pool was generated based on related scales, a wide review of the literature, and in-depth interviews with nurses according to Purnell's cultural competence model. Content validity was verified by nursing experts. Construct validity using exploratory factor analysis, convergent validity using correlation coefficients, discriminant validity, internal consistency reliability, and test-retest reliability were examined. Results: The CCS-RN consists of a 35-item/7-factor solution with 54.1% of the total variance explained. The convergent validity of CCS-RN was supported. Cronbach's ${\alpha}$ was .94 for the total scale and ranged from .77 to .90 for the seven factors. Test-retest reliability was moderate. Conclusion: The evaluation of the psychometric properties of the CCS-RN shows that this scale is expected to be a valid and reliable measure of cultural competence among nurses. This scale may be useful for assessing nurses' own cultural competence and thus contribute to strengthening cultural competence.

A Pilot Study of Evaluating the Reliability and Validity of Pattern Identification Tool for Insomnia and Analyzing Correlation with Psychological Tests (불면증 변증도구 신뢰도와 타당도 평가 및 심리검사와의 상관성에 대한 초기연구)

  • Jeong, Jin-Hyung;Lee, Ji-Yoon;Kim, Ju-Yeon;Kim, Si-Yeon;Kang, Wee-Chang;Lim, Jung Hwa;Kim, Bo Kyung;Jung, In Chul
    • Journal of Oriental Neuropsychiatry
    • /
    • v.31 no.1
    • /
    • pp.1-12
    • /
    • 2020
  • Objectives: The purpose of this study was to evaluate the reliability and validity of the instrument on pattern identification for insomnia (PIT-Insomnia) and verify the correlation between PIT-Insomnia and psychological tests. Methods: Two evaluators examined the pattern identification of the participants who met insomnia disorder diagnostic criteria of the Diagnostic and Statistical Manual of Mental Disorder, Fifth Edition (DSM-5) and took the Insomnia Severity Index (ISI) score over 15 once manually and twice using the PIT-Insomnia to measure the inter-rater and test-retest reliability. We also conducted the following surveys: the Pittsburgh Sleep Quality Index (PSQI), the Korean version of Beck's depression inventory (K-BDI), the Korean version of the State-Trait Anxiety Inventory (STAI-K), the Korean Symptom checklist-95 (KSCL-95), and the EuroQol-5 dimension (EQ-5D), to measure concurrent validity and correlation between the PTI-Insomnia and psychological tests. Results: 1. The test-retest reliability analysis of the pattern identification results showed moderate agreement, and test-retest reliability analysis of each pattern identification score showed agreements from poor to moderate. 2. The inter-rater reliability analysis of the pattern identification results via manual showed slight agreement, when analysis was performed with calibration, the inter-rater reliability analysis of the pattern identification results via manual showed fair agreement. 3. The concordance analysis between results via manual and the PIT-Insomnia showed poor agreement, when the analysis was performed with calibration, concordance analysis showed fair agreement. 4. The concordance analysis between the PIT-Insomnia and the PSQI showed positive linear correlation. 5. The concordance analysis between the PIT-Insomnia and the PSQI, K-BDI, STAI-K, KSCL-95, and EQ-5D showed that non-interaction between the heart and kidney have positive linear correlation with the K-BDI, anxiety item of KSCL-95, dual deficiency of the heart-spleen have positive linear correlation with somatization item of KSCL-95, paranoia item of KSCL-95, heart deficiency with timidity have positive linear correlation with stress vulnerability item of KSCL-95, parania item of KSCL-95, phlegm-fire harassing the heart have positive linear correlation with K-BDI, paranoia item of KSCL-95, depressed liver qi transforming into fire have positive linear correlation with the anxiety item of KSCL-95, parania item of KSCL-95, all pattern identification have negative linear correlation with EQ-5D. Conclusions: The PIT-Insomnia has moderate agreement of reliability and reflects the severity of insomnia since it has some concurrent validity with the PSQI. There are some correlations between the PTI-Insomnia with specific psychological tests, so we could suggest it can be used appropriately in the clinical situation.

Construct Validation of the Sensory Profile for Children with Congenital Cerebral Palsy (뇌성마비 아동을 대상으로 한 감각프로파일(Sensory Profile)의 구성타당도 연구)

  • Yoo, Doo Han;Hong, Deok Gi;Hwang, Sun Jung
    • 재활복지
    • /
    • v.18 no.4
    • /
    • pp.315-330
    • /
    • 2014
  • The purpose of this study was to verify the construct validity of the Sensory Profile for children with congenital cerebral palsy. Parents of 87 children(the ages of 3 to 10) with congenital cerebral palsy participated in this study. The data were analyzed through Winstep version 3.81 using the Rasch model to examine the uni-dimensionality of the fit of each item, the distribution of difficulty of each item, and the reliability and appropriateness of the rating scale. Based on a Rasch analysis, four out of the 87 children were considered to be inappropriate participants, and 15 item of the Sensory Profile was determined to be an inappropriate item. The items of high-level difficulty are needed as new items of the Korean Sensory Profile. The rating scale of three categories were appropriate than those of the five categories. The person and item separation reliability of three categories was above 0.90, which is a relatively excellent value. Finally, it will be need to verify of validity for Korean version of Sensory Profile, to develop new item of a high level of difficulty and convert into three point rating scale.

A validation study for the Infant/Toddler Environment Rating Scale(I) (영아/걸음마기 아동 환경 평정 척도 타당화 연구(I))

  • 현온강
    • Journal of the Korean Home Economics Association
    • /
    • v.35 no.6
    • /
    • pp.235-248
    • /
    • 1997
  • This study was aimed to validate the Infant/Toddler Environment Rating scale (ITERS). The rating scale was translated and adjusted appropriately by two researchers majoring child studies. An item-by-item comparison of the ITERS with criteria of NAEYC was conducted as the measure of content validity. 88% of the items of the ITERS was covered on the NAEYC criteria. Criterion validity was assessed by comparing ITERS scores and the Assessment Profile for early childhood Programs scores. The total correlation of two scores was .87. The sample for the inetrater reliability and internal consistency studies included 30 infant/toddler classes in 30 day care center in Inchon city. Two observers independently rated each class on the ITERS during a single visit. The Spearman's correlation coefficient for interater reliability on the overall scale was .74. For the measure of internal consistency, the Cronbach's Alpha score on the overall scale was .93. The rating results show that national/public child care centers have better quality in Adult Needs and Learning Activities subscales than private child care centers have.

  • PDF

A Validation Study on the Home Observation for Measurement of the Environment in Elementary Children (가정환경검사(HOME)의 타당화 연구)

  • Lee, Ju-Lie
    • Journal of Families and Better Life
    • /
    • v.10 no.1 s.19
    • /
    • pp.1-13
    • /
    • 1992
  • The purpose of this study was to validate the Elementary HOME(Home Observation for Measurement of the Environment) with korean elementary children. Subjects were 536 mothers 1st-5th graders in the elementary schools in the Seoul. Pearson's r, pearcentage(%), phi($\phi$/), Cronbach's $\alpha$/ ware conducted for the statistical analysis. The major findings were as follows. 1) The item pass rate(percentage) were ranged 16~98. 2) The discriminant coefficients($\phi$/) of the item were ranged 0.06~0.58. 3) The reliability coefficients of the scale were that the split-falf was 0.84, and Cronbach's $\alpha$/ was 0.88. Considering the length of the scale, these reliability estimates appear to be at an acceptable level 4) The factor analysis and the correlations between HOME and SES indices and children's school schievement to test construct validity were conducted to test construct validity. Eight factors were extracted from the factor analysis and coefficients(r) were ranged 0.16~0.45 and -0.08~0.37.

  • PDF

Issues Related to the Objectivity of Student Assessment in Medical Education (의학교육 학생평가의 객관성에 대한 쟁점)

  • Min, Kyung-Seok;Yang, Kil-Seok
    • Korean Medical Education Review
    • /
    • v.15 no.3
    • /
    • pp.105-111
    • /
    • 2013
  • This paper addressed various issues related to the objectivity of student assessment in medical education. The objectivity of assessment was related to all the steps of test development, administration, and results reporting in terms of reliability and validity. Specifically, the objectivity of item formats, representativeness of test content, standardization of test administration, consistency of scoring procedures, and appropriateness of reporting test results were discussed by comparing performance assessment with traditional paper-and-pencil tests. The conclusions were derived from current measurement theories such as standards-based assessment, evidencebased design, and outcome-based assessment. Further, based on Shepard's propositions (2006), the objectivity of student assessment could be achieved by improving the concordance between educational objectives and assessment components such as item types, test contents, and test administration, scoring, and reporting.