• Journal of the Korean Society of Earth Science Education
• /
• v.2 no.1
• /
• pp.62-79
• /
• 2009

In the present study I developed the test for earth scientific creativity level and verified means to measure scientific creativity. I developed 22 test items and after being examined by science education specialist, 11 items were finally established, and these were applied to 104 middle students. Each answer paper was graded according to the standard answer that I developed and the results of analysis are as follows. First, to verify the validity of measuring means I figured out content validity. The content validity about test items and adequacy of evaluation goal was examined by 1 science education specialist and 3 middle school science teachers, 6 education graduate students. As a result of validity verification, the content validity was 82.7% and it showed that the test of earth scientific creativity was valid for evaluation goal and sub-factors of creativity. Second, to verify reliability of measuring means, I analyzed internal consistency of the test sheet of earth scientific creativity after finding correlation coefficient and Cronbach's $\alpha$. Cronbach's $\alpha$, the internal reliability coefficient, was 0.848. Therefore, it was verified that this test sheet of earth scientific creativity is reliable to measure the creativity of the middle school students. The correlation between sub-factors of creativity was statistically significant, and for the relation between the variables related to creativity, the originality was the most significant. This shows that in the procedure of scientific creativity and studying science, originality should be the most important factor.

• The Journal of Korean Academy of Sensory Integration
• /
• v.19 no.1
• /
• pp.24-38
• /
• 2021

Objective : This study aimed to create a Korea translation of the Evaluation in Ayres Sensory Integration (EASI) and to then test the adapted version for construct validity. Methods : The translation and content validation process were conducted in accordance with a four-step process, namely translation, integration, content validity examination, and backward translation. The construct validity of the translated version was evaluated using the EASI for children aged 3~12 years with and without sensory integration problems, comparing the two groups as well as preschool and school-aged groups. The group comparison was analyzed using the Mann-Whitney U test in SPSS. Results : In terms of content validity, all 20 items averaged more than 3.17 points. Of the four EASI categories, there was a difference in Sensory Perception (p=0.044) between the typical and sensory integration groups, and there was a statistical difference between tactile and vestibular sensations. Between the preschool and school-aged children, statistical difference was observed in two categories, namely Praxis and Ocular-Postural-Bilateral Motor Integration. Conclusion : Based on its construct validity, the Korean version of EASI is suitable for use in research. The construct validity study highlighted items that explain differences between typical and diagnostic children and items that explain those differences by age. Our findings could therefore be considered when interpreting EASI results.

• Korean Journal of Child Studies
• /
• v.20 no.4
• /
• pp.25-42
• /
• 1999

The teacher's role scale for improving young children's creativity is designed for both teacher self-rating and observer rating. Content validity was determined by 5 experts who defined the domains of specific content. Construct validity was obtained by the self-ratings of 404 teachers of 3- to 5-year-old children. Five factors using 38 items of the original 59 were found to be related to the teacher's role in improving young children's creativity. The factors were Indulgence and Perseverance, Flexibility, Originality, Elaboration, and Fluency. Convergent validity was confirmed by positive correlations of the Teacher's Role Scale with the Teacher's Creativity Test of the Korean Institute for Research in the Behavioral Sciences. For internal consistency, Cronbach ${\alpha}$ of the 5 factors ranged from .74 to .88. Test-retest reliability coefficientents ranged from .653 to .838. These results confirm the Scale as a valid and reliable measure of the teacher's role in improving the creativity of young children.

• Safety and Health at Work
• /
• v.4 no.1
• /
• pp.37-45
• /
• 2013

Objectives: As quality of work-life (QWL) among nurses affects both patient care and institutional standards, assessment regarding QWL for the profession is important. Work-related Quality of Life Scale (WRQOLS) is a reliable QWL assessment tool for the nursing profession. To develop a Chinese version of the WRQOLS-2 and to examine its psychometric properties as an instrument to assess QWL for the nursing profession in China. Methods: Forward and back translating procedures were used to develop the Chinese version of WRQOLS-2. Six nursing experts participated in content validity evaluation and 352 registered nurses (RNs) participated in the tests. After a two-week interval, 70 of the RNs were retested. Structural validity was examined by principal components analysis and the Cronbach's alphas calculated. The respective independent sample t-test and intra-class correlation coefficient were used to analyze known-group validity and test-retest reliability. Results: One item was rephrased for adaptation to Chinese organizational cultures. The content validity index of the scale was 0.98. Principal components analysis resulted in a seven-factor model, accounting for 62% of total variance, with Cronbach's alphas for subscales ranging from 0.71 to 0.88. Known-group validity was established in the assessment results of the participants in permanent employment vs. contract employment (t = 2.895, p < 0.01). Good test-retest reliability was observed (r = 0.88, p < 0.01). Conclusion: The translated Chinese version of the WRQOLS-2 has sufficient validity and reliability so that it can be used to evaluate the QWL among nurses in mainland China.

• Journal of Korean Academy of Nursing
• /
• v.45 no.3
• /
• pp.439-448
• /
• 2015

Purpose: The purpose of this study was to examine validity and reliability of Webel and colleagues'HIV Self-Management Scale when used with a Korean sample. Methods: The original 20-item HIV Self-Management Scale was translated into Korean using translation and back-translation. Nine HIV nurse experts tested content validity. Principal component analysis (PCA) and confirmatory factor analysis (CFA) of data from 203 patients was used to test construct validity. Concurrent validity was evaluated using correlation with patients'self-rating as a "mart patient"measured using a visual analogue scale. Internal consistency was tested by Cronbach' alpha coefficients. Results: All items were rated as having satisfactory content validity. Based on PCA and consideration of conceptual meaning, a three-factor solution was selected, explaining 48.76% of the variance. CFA demonstrated the adequacy of the three-domain structure of the construct HIV self-management: daily self-management health practices, social support and HIV self-management, and chronic nature of HIV self-management. Goodness-of-fit indices showed an acceptable fit overall with the full model (${\chi}^2/df_{(164)}=1.66$, RMSEA=0.06, SRMR=0.05, TLI=0.91, and CFI=0.92). The Korean version of the HIV Self-Management Scale (KHSMS) was significantly correlated with patients'self-rated smart patient (r=.41). The subscale Cronbach' alpha coefficients ranged from .78 to .81; alpha for the total scale was .89. Conclusion: The KHSMS provides a valid and reliable measure of self-management in Korean patients with HIV. Continued psychometric testing is recommended to provide further evidence of validity with this population.

• Safety and Health at Work
• /
• v.5 no.2
• /
• pp.80-85
• /
• 2014

Background: Currently available questionnaires for evaluating the quality of worklife do not fully examine every factor related to worklife in all cultures. A tool in Thai is therefore needed for the direct evaluation of the quality of worklife. Our aim was to translate the Work-related Quality of Life Scale-2 (WRQLS-2) into Thai, to assess the validity and reliability of the Thai-translated version, and to examine the tool's accuracy vis-$\grave{a}$-vis nursing in Thailand. Methods: This was a descriptive correlation study. Forward and backward translations were performed to develop a Thai version of the WRQLS. Six nursing experts participated in assessing content validity and 374 registered nurses (RNs) participated in its testing. After a 2-week interval, 67 RNs were retested. Structural validity was examined using principal components analysis. The Cronbach's alpha values were calculated. The respective independent sample t test and intraclass correlation coefficient were used to analyze known-group validity and test-retest reliability. Multistate sampling was used to select 374 RNs from the In- and Outpatient Department of Srinagarind Hospital of the Khon Kaen University (Khon Kaen, Thailand). Results: The content validity index of the scale was 0.97. Principal components analysis resulted in a seven-factor model, which explains 59% of the total variance. The overall Cronbach's alpha value was 0.925, whereas the subscales ranged between 0.67 and 0.82. In the assessment results, the known-group validity was established for the difference between civil servants and university employees [F (7.982, 0.005) and t (3.351; p < 0.05)]. Civil servants apparently had a better quality worklife, compared to university employees. Good test-retest reliability was observed (r = 0.892, p < 0.05). Conclusion: The Thai version of a WRQLS appears to be well validated and practicable for determining the quality of the work-life among nurses in Thailand.

• Journal of Korean Academy of Nursing
• /
• v.43 no.1
• /
• pp.50-58
• /
• 2013

Purpose: The purpose of this study was to evaluate measurement properties of self-report questionnaires for studies published in Korean nursing journals. Methods: Of 424 Korean nursing articles initially identified, 168 articles met the inclusion criteria. The methodological quality of the measurements used in the studies and interpretability were assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. It consists of items on internal consistency, reliability, measurement error, content validity, construct validity including structural validity, hypothesis testing, cross-cultural validity, and criterion validity, and responsiveness. For each item of the COSMIN checklist, measurement properties are rated on a four-point scale: excellent, good, fair, and poor. Each measurement property is scored with worst score counts. Results: All articles used the classical test theory for measurement properties. Internal consistency (72.6%), construct validity (56.5%), and content validity (38.2%) were most frequently reported properties being rated as 'excellent' by COSMIN checklist, whereas other measurement properties were rarely reported. Conclusion: A systematic review of measurement properties including interpretability of most instruments warrants further research and nursing-focused checklists assessing measurement properties should be developed to facilitate intervention outcomes across Korean studies.

• Korean Medical Education Review
• /
• v.23 no.3
• /
• pp.185-193
• /
• 2021

Students must be familiar with clinical skills before starting clinical practice to ensure patients' safety and enable efficient learning. However, performance is mainly tested in the third or fourth years of medical school, and studies using the validity framework have not been reported in Korea. We analyzed the validity of a performance test conducted among second-year students classified into content, response process, internal structure, relationships with other variables, and consequences according to Messick's framework. As results of the analysis, content validity was secured by developing cases according to a pre-determined blueprint. The quality of the response process was controlled by training and calibrating raters. The internal structure showed that (1) reliability by generalizability theory was acceptable (coefficients of 0.724 and 0.786, respectively, for day 1 and day 2), and (2) the relevant domains had proper correlations, while the clinical performance examination (CPX) and objective structured clinical examination (OSCE) showed weaker relationships. OSCE/CPX scores were correlated with other variables, especially grade point average and oral structured exam scores. The consequences of this assessment were (1) making students learn clinical skills and study themselves, while causing too much stress for students due to lack of motivation; (2) reminding educators of the need to apply practical teaching methods and to give feedback on the test results; and (3) providing an opportunity for faculty to consider developing support programs. It is necessary to develop the blueprint more precisely according to students' level and to verify the validity of the response process with statistical methods.

• Journal of Korean Critical Care Nursing
• /
• v.12 no.2
• /
• pp.1-12
• /
• 2019

Purpose : The purpose of this study was to validate the Korean version of Partners In Health scale (PIH-K) which is used to measure the self-management of patients with chronic illnesses in Korea. Methods : Translation of the 12-item PIH-K was conducted according to the World Health Organization guidelines. Data from 306 participants who took medicines over 3 months by doctor's prescription were collected from October to November 2017. Validity such as content validity, construct validity, and concurrent validity were conducted using content validity index (CVI), exploratory and confirmatory factor analyses (CFA). To evaluate concurrent validity, the correlation coefficients between the PIH-K and concurrent scales (Self-As-Carer Inventory) were calculated. The reliability of the PIH-K was examined using the internal consistency and test-retest reliability tests. Results : The CVI of the PIH-K was 0.91. According to the CFA, factor loadings for four factors ranged from .64 to .97, which explained 67.5% of the total variance. The PIH-K was significantly correlated with concurrent variables such as those on the Self-As-Carer Inventory. The Cronbach's ${\alpha}$ was .86 and the intraclass correlation coefficient for the two-week test-retest reliability was .88. Conclusion : Findings show that the PIH-K is reliable and valid in measuring self-management of patients with chronic illnesses.

• Physical Therapy Rehabilitation Science
• /
• v.8 no.2
• /
• pp.99-110
• /
• 2019

Objective: The aim of the present study was to develop a valid and reliable scale that measures the healthy life styles among young adults. Design: A methodological study design was employed to develop and validate the Healthy Lifestyle Screening Tool (HLST). Methods: The validity and reliability of the HLST were established in accordance with DeVellis' 8 steps guideline for tool development. The question items were generated based on literature reviews and interviews, which were then classified into 12 categories. The HLST was administered to 272 students attending a Korean university. The reliability was tested using Cronbach's alpha. The validity of the scale was examined with the mean inter-item correlations (MIIC) and factor analysis, and was also examined for content validity by experts. Results: The reliability of the HLST was found to be acceptable, as indicated by a Cronbach's alpha of 0.71. In the validity test, items with less than 80% "agreement" ratings on the content validity index by experts were revised. The MIIC values were greater than 0.25. A factor analysis of 36 items extracted 9 factors (i.e., four items per factor), which together explained 50.4% of the variance. The HLST consists of 36 items that measure 9 factors based on a 4-point Likert rating scale, with 4 items per factor, as follows: sunlight, water, air, rest, exercise, nutrition, temperance, trust, and general physical condition. High scores on the HLST are indicative of a healthy lifestyle (HL). Conclusions: The HLST is a valid and reliable scale that can be used to measure HL among young adults. Identification of HL by using the HLST can provide guidance to integrated therapeutic approaches along with conventional physical therapy.