• Journal of Korean Academy of Nursing Administration
• /
• v.14 no.2
• /
• pp.131-143
• /
• 2008

Purpose: The aim of this study was to develop service quality indicators to evaluate structure and process of the nursing home service. Method: On the basis of literature review and analysis of existing quality indicators, the researcher made a preliminary service quality indicators and verified content validity twice. The final service quality indicators were applied in 30 nursing homes. Results: Preliminarily, 3 domains, 24 sub-domains, and 156 indicators were generated. Through two content validity testings, the indicators scoring over .80 CVI for each testing were adopted and modified by discussion with a panel of experts. The final indicators consisted of 3 domains, 15 sub-domains, and 128 indicators. These indicators were applied in 30 nursing homes. The result showed that they were easily applicable and suitable for a evaluation of service quality in nursing home. Conclusion: This 'service quality indicators in nursing home' was verified by the content validity. This tool will be able to be used for evaluation and improvement of nursing home service quality. However, repeated researches are needed for further validity and reliability.

• Journal of Korean Academy of Nursing
• /
• v.45 no.3
• /
• pp.439-448
• /
• 2015

Purpose: The purpose of this study was to examine validity and reliability of Webel and colleagues'HIV Self-Management Scale when used with a Korean sample. Methods: The original 20-item HIV Self-Management Scale was translated into Korean using translation and back-translation. Nine HIV nurse experts tested content validity. Principal component analysis (PCA) and confirmatory factor analysis (CFA) of data from 203 patients was used to test construct validity. Concurrent validity was evaluated using correlation with patients'self-rating as a "mart patient"measured using a visual analogue scale. Internal consistency was tested by Cronbach' alpha coefficients. Results: All items were rated as having satisfactory content validity. Based on PCA and consideration of conceptual meaning, a three-factor solution was selected, explaining 48.76% of the variance. CFA demonstrated the adequacy of the three-domain structure of the construct HIV self-management: daily self-management health practices, social support and HIV self-management, and chronic nature of HIV self-management. Goodness-of-fit indices showed an acceptable fit overall with the full model (${\chi}^2/df_{(164)}=1.66$, RMSEA=0.06, SRMR=0.05, TLI=0.91, and CFI=0.92). The Korean version of the HIV Self-Management Scale (KHSMS) was significantly correlated with patients'self-rated smart patient (r=.41). The subscale Cronbach' alpha coefficients ranged from .78 to .81; alpha for the total scale was .89. Conclusion: The KHSMS provides a valid and reliable measure of self-management in Korean patients with HIV. Continued psychometric testing is recommended to provide further evidence of validity with this population.

• The Journal of the Korea Contents Association
• /
• v.12 no.5
• /
• pp.280-292
• /
• 2012

Cognitive-pragmatic language ability decreases during the normal aging process. Evaluating the ability might be useful in testing predicting cognitive level and diseases such as dementia. The aim of this study is to analyze various assessment protocols for normal aging, and evaluate the content validity of the currently developing cognitive-pragmatic language test domains and items. Content Validity Index(CVI) was calculated based on ratings judged by 17 experts including speech-language pathologists and clinical psychologists. As a result, it was found that CVIs of all 7 domains including attention, memory, organization, reasoning, problem solving, executive function, pragmatic language were above .75. It was concluded that the test items contained the appropriate content validity to assess cognitive-pragmatic language for normal aging.

• Safety and Health at Work
• /
• v.5 no.2
• /
• pp.80-85
• /
• 2014

Background: Currently available questionnaires for evaluating the quality of worklife do not fully examine every factor related to worklife in all cultures. A tool in Thai is therefore needed for the direct evaluation of the quality of worklife. Our aim was to translate the Work-related Quality of Life Scale-2 (WRQLS-2) into Thai, to assess the validity and reliability of the Thai-translated version, and to examine the tool's accuracy vis-$\grave{a}$-vis nursing in Thailand. Methods: This was a descriptive correlation study. Forward and backward translations were performed to develop a Thai version of the WRQLS. Six nursing experts participated in assessing content validity and 374 registered nurses (RNs) participated in its testing. After a 2-week interval, 67 RNs were retested. Structural validity was examined using principal components analysis. The Cronbach's alpha values were calculated. The respective independent sample t test and intraclass correlation coefficient were used to analyze known-group validity and test-retest reliability. Multistate sampling was used to select 374 RNs from the In- and Outpatient Department of Srinagarind Hospital of the Khon Kaen University (Khon Kaen, Thailand). Results: The content validity index of the scale was 0.97. Principal components analysis resulted in a seven-factor model, which explains 59% of the total variance. The overall Cronbach's alpha value was 0.925, whereas the subscales ranged between 0.67 and 0.82. In the assessment results, the known-group validity was established for the difference between civil servants and university employees [F (7.982, 0.005) and t (3.351; p < 0.05)]. Civil servants apparently had a better quality worklife, compared to university employees. Good test-retest reliability was observed (r = 0.892, p < 0.05). Conclusion: The Thai version of a WRQLS appears to be well validated and practicable for determining the quality of the work-life among nurses in Thailand.

• Journal of Korean Academy of Nursing
• /
• v.38 no.6
• /
• pp.881-890
• /
• 2008

Purpose: Research related to social support in Korea has been hampered by paucity of measurement tools reflecting Korean culture. The aim of the study was to develop Korean social support questionnaire (KSSQ) based on the Korean social support pyramid and to test psychometric properties of the KSSQ. Methods: The questionnaire was administered to 701 subjects and 658 college students. Psychometric analyses included factor analyses, expert validity, criterion-related validity, internal consistency, and test-retest reliability. Results: A principal components analysis support for construct validity, eliciting a three factor solution accounting for 65.46% of variance in scores. Concurrent and discriminant validity supported criterion-related validity. Internal consistency of reliability was support with Cronbach's alpha of .97-.98 for the entire scale. Test-retest reliability was .76. Conclusion: This initial testing of KSSQ to measure Korean social support demonstrates evidence of reliability and validity. Assessment of known-group validity and norm establishment of KSSQ are suggested to provide further sound psychometric properties and practical measurement tools.

• Journal of Korean Academy of Nursing
• /
• v.43 no.1
• /
• pp.50-58
• /
• 2013

Purpose: The purpose of this study was to evaluate measurement properties of self-report questionnaires for studies published in Korean nursing journals. Methods: Of 424 Korean nursing articles initially identified, 168 articles met the inclusion criteria. The methodological quality of the measurements used in the studies and interpretability were assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. It consists of items on internal consistency, reliability, measurement error, content validity, construct validity including structural validity, hypothesis testing, cross-cultural validity, and criterion validity, and responsiveness. For each item of the COSMIN checklist, measurement properties are rated on a four-point scale: excellent, good, fair, and poor. Each measurement property is scored with worst score counts. Results: All articles used the classical test theory for measurement properties. Internal consistency (72.6%), construct validity (56.5%), and content validity (38.2%) were most frequently reported properties being rated as 'excellent' by COSMIN checklist, whereas other measurement properties were rarely reported. Conclusion: A systematic review of measurement properties including interpretability of most instruments warrants further research and nursing-focused checklists assessing measurement properties should be developed to facilitate intervention outcomes across Korean studies.

• Journal of Preventive Medicine and Public Health
• /
• v.55 no.4
• /
• pp.334-341
• /
• 2022

Objectives: This study was conducted to develop the Mobility to Participation Assessment Scale for Stroke (MPASS) and assess its content validity, internal consistency, inter-rater and intra-rater reliability, and convergent validity in people with stroke living in the community. Methods: The MPASS was developed using published data on mobility-related activity and participation timing in elderly individuals, and then reviewed by community physical therapists. Content validity was established by reaching a consensus of experienced physical therapists in a focus group. The MPASS was scored for 32 participants with stroke (mean age 61.75±4.92 years) by 3 individual testers. Reliability was examined using the intraclass correlation coefficient (ICC), internal consistency using the Cronbach alpha coefficient (α), and convergent validity using the Pearson correlation coefficient (r) to compare the MPASS to the Modified Rivermead Mobility Index as a referent test of mobility. Results: The MPASS consists of 8 items, and its scoring system provides information on the ability of people with stroke to reach a movement level enabling them to live in society, including interactions with other people and safe living in the community. The interrater and intra-rater reliability were excellent (ICC, 0.948; 95% confidence interval [CI], 0.893 to 0.982 and ICC, 0.967; 95% CI, 0.933 to 0.989, respectively). Internal consistency was good (α=0.877). The convergent validity was moderate (r=0.646; p<0.001). Conclusions: The newly developed MPASS showed acceptable construct validity and high reliability. The MPASS is suitable for use in people with stroke, especially those who have been discharged and live in the community with the ability to initiate sitting.

• Journal of Korean Academy of Nursing
• /
• v.53 no.1
• /
• pp.12-27
• /
• 2023

Purpose: This study aimed to develop a scale to measure distress in patients with ischemic stroke and verify its validity and reliability. Methods: Preliminary items were developed from literature review and in-depth interviews. The final preliminary scale was confirmed through a content validity test of eight experts and a preliminary survey of 10 stroke patients. The participants for psychometric testing were 305 stroke patients in the outpatient clinic. Validity and reliability analyses included item analysis, exploratory and confirmatory factor analysis, convergent validity, known-group validity, and internal consistency of the scale. Results: The final scale consisted of 17 items and 3 factors. The three distinct factors were 'self-deprecation, worry about future health, and withdrawal from society' and this structure was validated using a confirmatory factor analysis. Convergent validity was supported by comparison with the Center for Epidemiologic Studies Depression Scale (r = .54, p < .001) and Brief Illness Perception Questionnaire (r = .67, p < .001). Known-groups validity was verified by dividing groups according to 'duration since diagnosis' (t = 2.65, p = .009), 'presence of sequela' (t = 10.16, p < .001), and 'awareness of distress' (t = 12.09, p < .001). The internal consistency of the scale using Cronbach's α for the total items was .93. Conclusion: The Ischemic Stroke Distress Scale is a valid and reliable tool that reflects stroke distress effectively. It is expected to be used as a basic tool to develop various intervention strategies to reduce distress in ischemic stroke patients.

• Korean Journal of Radiology
• /
• v.22 no.3
• /
• pp.442-453
• /
• 2021

Artificial intelligence (AI) will likely affect various fields of medicine. This article aims to explain the fundamental principles of clinical validation, device approval, and insurance coverage decisions of AI algorithms for medical diagnosis and prediction. Discrimination accuracy of AI algorithms is often evaluated with the Dice similarity coefficient, sensitivity, specificity, and traditional or free-response receiver operating characteristic curves. Calibration accuracy should also be assessed, especially for algorithms that provide probabilities to users. As current AI algorithms have limited generalizability to real-world practice, clinical validation of AI should put it to proper external testing and assisting roles. External testing could adopt diagnostic case-control or diagnostic cohort designs. A diagnostic case-control study evaluates the technical validity/accuracy of AI while the latter tests the clinical validity/accuracy of AI in samples representing target patients in real-world clinical scenarios. Ultimate clinical validation of AI requires evaluations of its impact on patient outcomes, referred to as clinical utility, and for which randomized clinical trials are ideal. Device approval of AI is typically granted with proof of technical validity/accuracy and thus does not intend to directly indicate if AI is beneficial for patient care or if it improves patient outcomes. Neither can it categorically address the issue of limited generalizability of AI. After achieving device approval, it is up to medical professionals to determine if the approved AI algorithms are beneficial for real-world patient care. Insurance coverage decisions generally require a demonstration of clinical utility that the use of AI has improved patient outcomes.

• The Journal of Information Systems
• /
• v.27 no.4
• /
• pp.1-33
• /
• 2018

Purpose The purpose of this study is to review topic and survey methodological trends in 'The Journal of Information Systems' in order to present the practical guidelines for the future IS research. By attempting to conduct a meta-analysis on both topic and survey methodological trends, this study could provide researchers wishing to pursue this line of work further with what can be done to improve IS disciplines. Design/methodology/approach In this study, we have reviewed 185 papers that were published in 'The Journal of Information Systems' from 2010 to 2018 and classified them based on topics studied and survey methodologies used. The classification guidelines, which was developed by Palvia et al.(2015), has been used to capture the topic trends. We have also employed Struab et al.(2004)s' guidelines for securing rigor of validation issues. By using two guidelines, this study could also present topic and rigor trends in 'The Journal of Information Systems' and compare them to those trends in International Journals. Findings Our findings have identified dominant research topics in 'The Journal of Information Systems'; 1) social media and social computing, 2) IS usage and adoption, 3) mobile computing, 4) electronic commerce/business, 5) security and privacy, 6) supply chain management, 7) innovation, 8) knowledge management, and 9) IS management and planning. This study also could offer researchers who pursue this line of work further practical guidelines on mandatory (convergent and discriminant validity, reliability, and statistical conclusion validity), highly recommended (common method bias testing), and optional validations (measurement invariance testing for subgroup analysis, bootstrapping methods for testing mediating effects).