• Title/Summary/Keyword: Psychometric

Search Result 317, Processing Time 0.028 seconds

Psychometrics of Perspective Taking in Writing: CombiningManualCoding and Computational Approaches

  • Minkyung Cho
    • International journal of advanced smart convergence
    • /
    • v.12 no.1
    • /
    • pp.120-129
    • /
    • 2023
  • Perspective taking, one's knowledge of their own mental and emotional states and inferences about others' mental and emotional states, is an important higher order cognitive skill required in successful writing. However, there has not been much research on the identification and examiantion of the psychometrics of perspective taking. To fill in this gap, I reviewed the psychological and cognitive frameworks of perspective taking including theory of mind, audience awareness, development of epistemological understanding, and argumentation schema. I also reviewed various methods of examining the psychometric properties of perspective taking in written composition, including both manual and computational approaches. The review of literature yielded suggestions on the development of manual coding scheme for perspective taking as well as the selection of indexes to draw from natural language processing tools. Challenges and affordances of combining the manual and computational approach are discussed along with future research directions to advance the field of psycholinguistics.

Development and Validation of the Korean Patient Safety Culture Survey Instrument for Hospitals (한국형 환자안전문화 측정도구 개발 및 평가)

  • Sun-Gyo Lee
    • Quality Improvement in Health Care
    • /
    • v.30 no.1
    • /
    • pp.105-119
    • /
    • 2024
  • Purpose: This study aimed to develop a survey instrument to assess the Patient Safety Culture in Korean hospitals and evaluate its validity and reliability. Methods: A preliminary instrument was developed through a literature review, focus group interviews, content validity testing, and pretesting for face validity. A total of 467 hospital employees participated in the psychometric testing. Validity and reliability assessments included content validity, construct validity, criterion-related validity, and internal consistency. Results: The Korean Patient Safety Culture Survey Instrument comprised 35 items across seven factors: leadership, patient safety policy and procedure, patient safety improvement system, teamwork, non-punitive environment, patient safety knowledge and attitudes, and patient safety priority. These seven factors contributed 60.98% of the variance of the total scale. Cronbach's alpha for internal consistency was .93; the seven factors ranged from .66 to .91. Conclusion: The results of this study showed that the Korean Patient Safety Culture Survey Instrument is reliable, valid, and suitable for measuring patient safety culture in Korean hospitals.

Psychometric Charateristics of Occupational Low Back Pain Patients (일부 재해성 요부손상 환자의 심리적 특성)

  • Ha, Mi-Na;Cho, Soo-Hun;Kweon, Ho-Jang;Han, Sang-Hwan;Joo, Young-Soo;Pack, Nam-Jong
    • Journal of Preventive Medicine and Public Health
    • /
    • v.28 no.3 s.51
    • /
    • pp.715-725
    • /
    • 1995
  • This study was done for identifying the factors which affect psychologic symptoms of low back(LBP) patients. The study subjects were 43 work-related low back pain patients, 28 work-related non-low back pain patients and 47 general low back injury patients. The study materialis SCL 90-R for checking psychologic symptoms and questionnaire for obtaining general information about the subjects. The data were analyzed by model of analysis of covariance adjusted by several variables such as gender, age, education and marital status and then compared the least square means of symptom score between groups. To identify the factors that affect psychologic symptom, duration of suspension, return to work and interaction factor of these two variables were analyzed by multivariate model and we calcuated partial correlation coefficient of these variables. As a result, work-related LBP patients showed higher score of symptoms in somatization, depression and psychosis than work-related non-LBP and non-work-related LBP. Duration of suspension and return to work were significant explanatory variables for psychologic symptom score of work-related LBP. Then, we may conclude that the treatment and rehabilitation programe for work-related LBP should cover the strategy of early return to work.

  • PDF

Psychometric Test of Korean Version of Self-Efficacy and Outcome Expectations for Restorative Care Activities Scale among Nurses (한국판 기능유지간호에 대한 간호사의 자기효능감 및 결과기대감 측정도구의 타당도와 신뢰도)

  • Jung, Dukyoo;Byun, Jinyee;Lee, Minkyung;Kim, Hyejin
    • The Journal of the Korea Contents Association
    • /
    • v.15 no.9
    • /
    • pp.317-328
    • /
    • 2015
  • The purpose of this study is to measure the validity and reliability of the Korean version of the self-efficacy for restorative care activity (K-SERCA) scale and the outcome expectations for restorative care activity (K-OERCA) scale. Psychometric testing was given to 187 nurses who have worked in 69 long-term care facilities in South Korea via post service and personal visit. Data were collected via structured-questionnaire and analyzed using SPSS/WIN 21.0 and AMOS 22.0. Content, construct validity using confirmatory factor analysis (CFA), criterion validity and internal consistency reliability were conducted. The K-SERCA scale had factor loading of the 10 items ranged from .74 to .87, and was validated by confirmatory factor analysis (CFI=.96, NFI=.94, RMSEA=.10). The K-SERCA scale was also a significantly positive correlation with 'Job satisfaction' (r=.32, p<.001). There was a reliable internal consistency with a Cronbach's ${\alpha}=.94$. The K-OERCA scale had factor loading of the 9 items ranging from .38 to .95, and was validated by confirmatory factor analysis (CFI=.98, NFI=.96, RMSEA=.09). The K-OERCA scale was also a positive correlation with 'Knowledge (r=.26, p<.001)', and 'Job satisfaction (r=.30, p<.001)'. There was a reliable internal consistency with a Cronbach's ${\alpha}=.89$. The results demonstrate that the K-SERCA and K-OERCA scales had satisfactory validity and reliability to measure self-efficacy and outcome expectations for restorative care activities among nurses who have worked in long-term care facilities in South Korea.

A Cross-Validation of the Korean Version of the Revised Memory and Behavioral Problems Checklist(K-RMBPC): Exploratory and Confirmatory Analyses ("한국형 기억 및 행동문제 개정점검표(Korean Version of the Revised Memory and Behavioral Problems Checklist: K-RMBPC)"의 타당화를 위한 탐색적 연구)

  • Lee, Min-Hong;Yoon, Eun-Kyung
    • Korean Journal of Social Welfare
    • /
    • v.59 no.2
    • /
    • pp.65-88
    • /
    • 2007
  • This study evaluates psychometric properties of the Revised Memory and Behavioral Problems Checklist(RMBPC) in Korean version. The sample includes 387 South Korean family caregivers who provide the majority of day to day tasks and emotional care for their older family members with physical and/or cognitive disabilities. The psychometric properties of the RMBPC are verified by item analysis, exploratory factor analysis(EFA) & confirmatory factor analysis(CFA). For cross-validity, the randomly divided two samples are used: one sample for EFA(n=193, 387/2) and the other sample for CFA(n=194, 387/2). The internal consistency of the K-RMBPC is excellent, and the convergent and criterion-related validity of the K-RMBPC with related variables is empirically confirmed. An EFA based on the Principal Component Analysis(PCA) method with varimax rotation explains 65.85% of variance accounted for by the three factors. A CFA also verifies that the model fit was acceptable. The shorter Korean version of the RMBPC is found reliable and valid. The translated checklist would be very useful for clinical and research settings by (a) focusing on observable, conceptually relevant, potentially modifiable behaviors and (b) using objective criteria within a self-administered framework, to enable clinicians and researchers to pinpoint areas of disturbance and target intervention goals for patients and caregivers in a cost-effective manner.

  • PDF

Item-Level Psychometrics of the 12 Items of the Coping Orientation to Problems Experienced Scale (스트레스 대처 척도 12개 항목에 대한 심리측정 속성)

  • Nam, Sanghun;Hilton, Claudia L.;Lee, Mi-Jung;Pritchard, Kevin T.;Bae, Suyeong;Hong, Ickpyo
    • Therapeutic Science for Rehabilitation
    • /
    • v.11 no.3
    • /
    • pp.65-80
    • /
    • 2022
  • Objective : This study examined the psychometric properties of the 12-item Coping Orientation to Problems Experienced Scale (COPE) using Rasch analysis. COPE is one of the instruments used to measure stress-coping skills. Methods : The study participants were 480 community-dwelling older adults. We tested the instrument's unidimensionality assumption using principal component analysis (PCA). Item fit was examined using infit-and-outfit mean-square (MnSq) and standardized fit statistics (ZSTD). The precision and item difficulty hierarchies of the instrument were examined. The item-difficulty hierarchy was investigated to identify the easy and difficult items. We tested differential item functioning (DIF) for sex and age groups. Results : PCA revealed that the instrument met the unidimensionality assumption (eigenvalue = 1.78). Among the 12 items, item 2 was removed because of misfit (Infit MnSq = 1.33, Infit ZSTD = 5.05, Outfit MnSq = 1.56, Outfit ZSTD = 7.15). The remaining 11 items demonstrated a conceptual item-difficulty hierarchy. The person strata value was 3.10, which is equivalent to a reliability index value of 0.81. There was no DIF for the sex and age groups (DIF contrast <0.27). Conclusion : The findings indicated that the revised COPE-11 has adequate item-level psychometric properties and can accurately measure stress coping skills.

Validation of a Korean translated version of the Critical Care Pain Observation Tool (CPOT) for ICU patients (중환자 통증사정을 위한 한국어판 Critical care Pain Observation Tool (CPOT)의 신뢰도 및 타당도 검증)

  • Kwak, Eun-Mi;Oh, Hee-Young
    • Journal of Korean Academy of Nursing
    • /
    • v.42 no.1
    • /
    • pp.76-84
    • /
    • 2012
  • Purpose: The purpose of this methodological study was to examine the reliability and validity of a translated Korean version of the Critical Care Pain Observation Tool (CPOT) developed for assessment of pain in critically ill nonverbal patients. Methods: A cross-sectional study design was used. Data were collected from a convenience sample of 202 critically ill patients admitted to a university hospital. Upon establishment of content and translation equivalence between the English and Korean version of CPOT, psychometric properties were evaluated. Results: The interrater reliability was found to be acceptable with the weighted kappa coefficients of .81-.88. Significant high correlations between the CPOT and the Checklist of Nonverbal Pain Indicators were found indicating good concurrent validity (r=.72-.83, p<.001). Data showed the area under the ROC curve of 0.86 with a cut-off point of 1, which resulted in 76.9% sensitivity and 88.6% specificity. The mean score of CPOT during suctioning was significantly different from that of before (t= -14.16, p<.001) or 20 minutes after suctioning (t=16.31, p<.001). Conclusion: Results of this study suggest that the CPOT can be used as a reliable and valid measure to assess pain in critically ill nonverbal patients.

Measuring plagiarism in the second language essay writing context (영작문 상황에서의 표절 측정의 신뢰성 연구)

  • Lee, Ho
    • English Language & Literature Teaching
    • /
    • v.12 no.1
    • /
    • pp.221-238
    • /
    • 2006
  • This study investigates the reliability of plagiarism measurement in the ESL essay writing context. The current study aims to address the answers to the following research questions: 1) How does plagiarism measurement affect test reliability in a psychometric view? and 2) how do raters conceive the plagiarism in their analytic scoring? This study uses the mixed-methodology that crosses quantitative-qualitative techniques. Thirty eight international students took an ESL placement writing test offered by the University of Illinois. Two native expert raters rated students' essays in terms of 5 analytic features (organization, content, language use, source use, plagiarism) and made a holistic score using a scoring benchmark. For research question 1, the current study, using G-theory and Multi-facet Rasch model, found that plagiarism measurement threatened test reliability. For research question 2, two native raters and one non-native rater in their email correspondences responded that plagiarism was not a valid analytic area to be measured in a large-scale writing test. They viewed the plagiarism as a difficult measurement are. In conclusion, this study proposes that a systematic training program for avoiding plagiarism should be given to students. In addition, this study suggested that plagiarism is measured reliably in the small-scale classroom test.

  • PDF

Validity and Reliability of K-SKAGOAO for Korean Nursing Groups (한국판 간호그룹파워 도구의 타당도와 신뢰도 검증)

  • Sung, Young Hee;Lee, Mi Kyoung;Jeong, Jeong Hee;Park, Hyun Tae;Kim, Seon Woo
    • Journal of Korean Clinical Nursing Research
    • /
    • v.20 no.3
    • /
    • pp.372-383
    • /
    • 2014
  • Purpose: The purpose was to determine the content validity of a semantic revision of items on a reliable and valid instrument, the Sieloff-King Assessment of Group Outcome Attainment (Power) within Organizations in Korea (K-SKAGOAO). Methods: The target population for research was chief nurse officers (CNOs) of all hospital within Korea. A sample of 303 hospitals from across the Korea was selected through a stratified random sampling process. A total of 174 CNOs comprised the final sample. Psychometric evaluation of the K-SKAGOAO included: (a) criterion-related validity (b) factor analysis and (c) internal consistency reliability using Cronbach's alpha coefficients. Results: The Convergent validity and criterion-related validity were supported. Cronbach's alpha coefficient for the K-SKAGOAO was .95. Subscale alphas ranged from .60 to .86. Conclusion: The K-SKAGOAO and related subscales show validity and internal reliability. A nursing group of any size can use the K-SKAGOAO to both assess the group's level of outcome attainment and develop strategies to further improve that level.

Translation and Validation of Korean Version of Hall's Professionalism Inventory (간호의 전문직업성 척도 개발을 위한 Hall의 전문직업성 척도 번역 및 동등성 비교)

  • Kim, Yeoun-Soo;Baek, Hee-Chong
    • Journal of Korean Academy of Nursing Administration
    • /
    • v.13 no.4
    • /
    • pp.509-515
    • /
    • 2007
  • Purpose: The purpose of this study was to translate and validate the Korean version of Hall's Professional Inventory(HPI) scale to assess levels of professionalism among Korean registered nurses. Method: The 25 item HPI scale was translated and content review was done by translation panel. After the content review, a bilingual nursing scholar performed the back-translation into English. A semantic equivalence test was conducted with 5 American nursing professors. A pilot study was conducted with a sample of 164 registered nurses in Korea to test the validity and reliability of the translated HPI. Result: The content equivalence for translated version of HPI was validated by a translation panel. The finding of the semantic equivalence test of back-translated version was 72.8%. The Cronbach's alpha for the Korean version of HPI was .820. Conclusions: This study provides information about the issues of translating an instrument such as the HPI. The Korean version of the HPI is a valid and reliable instrument and can have psychometric properties equivalent to those of the original HPI. The translated version could be used for assessing levels of professionalism for other health care professionalism as well as nurses.

  • PDF