• 제목/요약/키워드: Content validity

검색결과 1,216건 처리시간 0.031초

지구과학 창의성 검사지 개발 (A Development of the Test of Creativity Level for Earth Science Field)

  • 정효원;김희수
    • 대한지구과학교육학회지
    • /
    • 제2권1호
    • /
    • pp.62-79
    • /
    • 2009
  • In the present study I developed the test for earth scientific creativity level and verified means to measure scientific creativity. I developed 22 test items and after being examined by science education specialist, 11 items were finally established, and these were applied to 104 middle students. Each answer paper was graded according to the standard answer that I developed and the results of analysis are as follows. First, to verify the validity of measuring means I figured out content validity. The content validity about test items and adequacy of evaluation goal was examined by 1 science education specialist and 3 middle school science teachers, 6 education graduate students. As a result of validity verification, the content validity was 82.7% and it showed that the test of earth scientific creativity was valid for evaluation goal and sub-factors of creativity. Second, to verify reliability of measuring means, I analyzed internal consistency of the test sheet of earth scientific creativity after finding correlation coefficient and Cronbach's $\alpha$. Cronbach's $\alpha$, the internal reliability coefficient, was 0.848. Therefore, it was verified that this test sheet of earth scientific creativity is reliable to measure the creativity of the middle school students. The correlation between sub-factors of creativity was statistically significant, and for the relation between the variables related to creativity, the originality was the most significant. This shows that in the procedure of scientific creativity and studying science, originality should be the most important factor.

  • PDF

Evaluation in Ayres Sensory Integration® (EASI)의 번역 및 구성타당도 연구 (A Translation and Construct Validity Study of the Evaluation in Ayres Sensory Integration® (EASI))

  • 김경미;이지현;정혜림;최정실;홍은경
    • 대한감각통합치료학회지
    • /
    • 제19권1호
    • /
    • pp.24-38
    • /
    • 2021
  • 목적 : Evaluation in Ayres Sensory Integration(EASI)의 국내사용을 위해 번역연구를 통한 한글 연구판 EASI를 제시하고, EASI의 구성타당도를 검정하고자 하였다. 연구방법 : EASI의 번역연구는 타문화 적응을 위한 번역 가이드라인의 4단계에 따라 실행하였다. 과정은 번역, 번역내용의 통합과 내용타당도 분석을 거쳤으며, 하위 검사 하나는 역번역을 실시하여 한글 연구판 EASI를 제시하였다. 구성타당도 검증은 3~12세의 일반아동과 감각통합문제를 가진 아동을 대상으로 EASI를 사용하여 평가하였다. 구성타당도는 일반아동과 감각통합문제를 가진 아동 그룹의 집단비교와 학령전기와 학령기 일반아동의 집단비교를 통하여 검증하였다. 집단비교는 Mann Whitney U 검정을 사용하여 분석하였다. 결과 : 번역 내용타당도 검증 결과 20개의 모든 항목은 평균 3.17점 이상을 보였다. 일반아동군과 감각통합문제 아동군의 EASI 영역별 차이를 알아본 결과 4개의 영역 중 감각지각 영역에서 두 그룹간 차이를 보였다(p=0.044). 세부적으로 촉각과 전정감각과 관련된 항목에서 통계학적인 차이를 보였다. 일반아동의 학령전기 아동군와 학령기 아동군의 EASI 영역별 비교에서는 실행, 안구, 자세 및 양측운동통합의 2개 영역에서 통계학적 차이가 있는 것으로 나타났다. 결론 : EASI 번역연구를 통해 제시된 한글판 EASI는 연구용으로 사용하기에 적합하다. 구성타당도 검증결과 일반아동과 진단군 아동의 차이를 설명할 수 있는 항목들과 연령에 따른 차이를 설명할 수 있는 항목들을 제시하였다. 이는 EASI 결과 해석에 고려될 수 있으리라 생각된다. 감각통합 기능의 종합적인 평가와 중재에 대한 근거를 제시하기 위해서는 앞으로 검사자간 신뢰도와 검사-재검사 신뢰도 검증이 필요하며, 추가적인 타당도 검증이 필요하리라 생각된다.

유아의 창의성 증진을 위한 교사역할 평정척도 개발연구 (The Development of Teacher's Role Scale for Improving Young Children's Creativity)

  • 문미옥
    • 아동학회지
    • /
    • 제20권4호
    • /
    • pp.25-42
    • /
    • 1999
  • The teacher's role scale for improving young children's creativity is designed for both teacher self-rating and observer rating. Content validity was determined by 5 experts who defined the domains of specific content. Construct validity was obtained by the self-ratings of 404 teachers of 3- to 5-year-old children. Five factors using 38 items of the original 59 were found to be related to the teacher's role in improving young children's creativity. The factors were Indulgence and Perseverance, Flexibility, Originality, Elaboration, and Fluency. Convergent validity was confirmed by positive correlations of the Teacher's Role Scale with the Teacher's Creativity Test of the Korean Institute for Research in the Behavioral Sciences. For internal consistency, Cronbach ${\alpha}$ of the 5 factors ranged from .74 to .88. Test-retest reliability coefficientents ranged from .653 to .838. These results confirm the Scale as a valid and reliable measure of the teacher's role in improving the creativity of young children.

  • PDF

Preliminary Psychometric Properties of the Chinese Version of the Work-Related Quality of Life Scale-2 in the Nursing Profession

  • Lin, Shike;Chaiear, Naesinee;Khiewyoo, Jiraporn;Wu, Bin;Johns, Nutjaree Pratheepawanit
    • Safety and Health at Work
    • /
    • 제4권1호
    • /
    • pp.37-45
    • /
    • 2013
  • Objectives: As quality of work-life (QWL) among nurses affects both patient care and institutional standards, assessment regarding QWL for the profession is important. Work-related Quality of Life Scale (WRQOLS) is a reliable QWL assessment tool for the nursing profession. To develop a Chinese version of the WRQOLS-2 and to examine its psychometric properties as an instrument to assess QWL for the nursing profession in China. Methods: Forward and back translating procedures were used to develop the Chinese version of WRQOLS-2. Six nursing experts participated in content validity evaluation and 352 registered nurses (RNs) participated in the tests. After a two-week interval, 70 of the RNs were retested. Structural validity was examined by principal components analysis and the Cronbach's alphas calculated. The respective independent sample t-test and intra-class correlation coefficient were used to analyze known-group validity and test-retest reliability. Results: One item was rephrased for adaptation to Chinese organizational cultures. The content validity index of the scale was 0.98. Principal components analysis resulted in a seven-factor model, accounting for 62% of total variance, with Cronbach's alphas for subscales ranging from 0.71 to 0.88. Known-group validity was established in the assessment results of the participants in permanent employment vs. contract employment (t = 2.895, p < 0.01). Good test-retest reliability was observed (r = 0.88, p < 0.01). Conclusion: The translated Chinese version of the WRQOLS-2 has sufficient validity and reliability so that it can be used to evaluate the QWL among nurses in mainland China.

Psychometric Properties of the Korean Version of the HIV Self-Management Scale in Patients with HIV

  • Kim, Gwang Suk;Chu, Sang Hui;Park, Yunhee;Choi, Jun Yong;Lee, Jeong In;Park, Chang Gi;McCreary, Linda L.
    • 대한간호학회지
    • /
    • 제45권3호
    • /
    • pp.439-448
    • /
    • 2015
  • Purpose: The purpose of this study was to examine validity and reliability of Webel and colleagues'HIV Self-Management Scale when used with a Korean sample. Methods: The original 20-item HIV Self-Management Scale was translated into Korean using translation and back-translation. Nine HIV nurse experts tested content validity. Principal component analysis (PCA) and confirmatory factor analysis (CFA) of data from 203 patients was used to test construct validity. Concurrent validity was evaluated using correlation with patients'self-rating as a "mart patient"measured using a visual analogue scale. Internal consistency was tested by Cronbach' alpha coefficients. Results: All items were rated as having satisfactory content validity. Based on PCA and consideration of conceptual meaning, a three-factor solution was selected, explaining 48.76% of the variance. CFA demonstrated the adequacy of the three-domain structure of the construct HIV self-management: daily self-management health practices, social support and HIV self-management, and chronic nature of HIV self-management. Goodness-of-fit indices showed an acceptable fit overall with the full model (${\chi}^2/df_{(164)}=1.66$, RMSEA=0.06, SRMR=0.05, TLI=0.91, and CFI=0.92). The Korean version of the HIV Self-Management Scale (KHSMS) was significantly correlated with patients'self-rated smart patient (r=.41). The subscale Cronbach' alpha coefficients ranged from .78 to .81; alpha for the total scale was .89. Conclusion: The KHSMS provides a valid and reliable measure of self-management in Korean patients with HIV. Continued psychometric testing is recommended to provide further evidence of validity with this population.

Validation of the Thai Version of aWork-related Quality of Life Scale in the Nursing Profession

  • Sirisawasd, Poramate;Chaiear, Naesinee;Johns, Nutjaree Pratheepawanit;Khiewyoo, Jiraporn
    • Safety and Health at Work
    • /
    • 제5권2호
    • /
    • pp.80-85
    • /
    • 2014
  • Background: Currently available questionnaires for evaluating the quality of worklife do not fully examine every factor related to worklife in all cultures. A tool in Thai is therefore needed for the direct evaluation of the quality of worklife. Our aim was to translate the Work-related Quality of Life Scale-2 (WRQLS-2) into Thai, to assess the validity and reliability of the Thai-translated version, and to examine the tool's accuracy vis-$\grave{a}$-vis nursing in Thailand. Methods: This was a descriptive correlation study. Forward and backward translations were performed to develop a Thai version of the WRQLS. Six nursing experts participated in assessing content validity and 374 registered nurses (RNs) participated in its testing. After a 2-week interval, 67 RNs were retested. Structural validity was examined using principal components analysis. The Cronbach's alpha values were calculated. The respective independent sample t test and intraclass correlation coefficient were used to analyze known-group validity and test-retest reliability. Multistate sampling was used to select 374 RNs from the In- and Outpatient Department of Srinagarind Hospital of the Khon Kaen University (Khon Kaen, Thailand). Results: The content validity index of the scale was 0.97. Principal components analysis resulted in a seven-factor model, which explains 59% of the total variance. The overall Cronbach's alpha value was 0.925, whereas the subscales ranged between 0.67 and 0.82. In the assessment results, the known-group validity was established for the difference between civil servants and university employees [F (7.982, 0.005) and t (3.351; p < 0.05)]. Civil servants apparently had a better quality worklife, compared to university employees. Good test-retest reliability was observed (r = 0.892, p < 0.05). Conclusion: The Thai version of a WRQLS appears to be well validated and practicable for determining the quality of the work-life among nurses in Thailand.

자가 보고형 질문지 측정 속성에 대한 평가: 국내 간호학술지에 게재된 논문을 중심으로 (Measurement Properties of Self-report Questionnaires Published in Korean Nursing Journals)

  • 이은현;김춘자;김은정;채현주;조수연
    • 대한간호학회지
    • /
    • 제43권1호
    • /
    • pp.50-58
    • /
    • 2013
  • Purpose: The purpose of this study was to evaluate measurement properties of self-report questionnaires for studies published in Korean nursing journals. Methods: Of 424 Korean nursing articles initially identified, 168 articles met the inclusion criteria. The methodological quality of the measurements used in the studies and interpretability were assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. It consists of items on internal consistency, reliability, measurement error, content validity, construct validity including structural validity, hypothesis testing, cross-cultural validity, and criterion validity, and responsiveness. For each item of the COSMIN checklist, measurement properties are rated on a four-point scale: excellent, good, fair, and poor. Each measurement property is scored with worst score counts. Results: All articles used the classical test theory for measurement properties. Internal consistency (72.6%), construct validity (56.5%), and content validity (38.2%) were most frequently reported properties being rated as 'excellent' by COSMIN checklist, whereas other measurement properties were rarely reported. Conclusion: A systematic review of measurement properties including interpretability of most instruments warrants further research and nursing-focused checklists assessing measurement properties should be developed to facilitate intervention outcomes across Korean studies.

Messick의 타당도 틀을 활용한 임상실습 전 실기시험의 타당도 평가 (Assessing the Validity of the Preclinical Objective Structured Clinical Examination Using Messick's Validity Framework)

  • 이혜윤;윤소정;이상엽;임선주
    • 의학교육논단
    • /
    • 제23권3호
    • /
    • pp.185-193
    • /
    • 2021
  • Students must be familiar with clinical skills before starting clinical practice to ensure patients' safety and enable efficient learning. However, performance is mainly tested in the third or fourth years of medical school, and studies using the validity framework have not been reported in Korea. We analyzed the validity of a performance test conducted among second-year students classified into content, response process, internal structure, relationships with other variables, and consequences according to Messick's framework. As results of the analysis, content validity was secured by developing cases according to a pre-determined blueprint. The quality of the response process was controlled by training and calibrating raters. The internal structure showed that (1) reliability by generalizability theory was acceptable (coefficients of 0.724 and 0.786, respectively, for day 1 and day 2), and (2) the relevant domains had proper correlations, while the clinical performance examination (CPX) and objective structured clinical examination (OSCE) showed weaker relationships. OSCE/CPX scores were correlated with other variables, especially grade point average and oral structured exam scores. The consequences of this assessment were (1) making students learn clinical skills and study themselves, while causing too much stress for students due to lack of motivation; (2) reminding educators of the need to apply practical teaching methods and to give feedback on the test results; and (3) providing an opportunity for faculty to consider developing support programs. It is necessary to develop the blueprint more precisely according to students' level and to verify the validity of the response process with statistical methods.

한국어판 자기관리 측정도구(Partners In Health scale)의 타당도 및 신뢰도 분석 (Validity and Reliability of the Korean Version of the Partners In Health Scale (PIH-K))

  • 전미경;안정원;박연환;이미경
    • 중환자간호학회지
    • /
    • 제12권2호
    • /
    • pp.1-12
    • /
    • 2019
  • Purpose : The purpose of this study was to validate the Korean version of Partners In Health scale (PIH-K) which is used to measure the self-management of patients with chronic illnesses in Korea. Methods : Translation of the 12-item PIH-K was conducted according to the World Health Organization guidelines. Data from 306 participants who took medicines over 3 months by doctor's prescription were collected from October to November 2017. Validity such as content validity, construct validity, and concurrent validity were conducted using content validity index (CVI), exploratory and confirmatory factor analyses (CFA). To evaluate concurrent validity, the correlation coefficients between the PIH-K and concurrent scales (Self-As-Carer Inventory) were calculated. The reliability of the PIH-K was examined using the internal consistency and test-retest reliability tests. Results : The CVI of the PIH-K was 0.91. According to the CFA, factor loadings for four factors ranged from .64 to .97, which explained 67.5% of the total variance. The PIH-K was significantly correlated with concurrent variables such as those on the Self-As-Carer Inventory. The Cronbach's ${\alpha}$ was .86 and the intraclass correlation coefficient for the two-week test-retest reliability was .88. Conclusion : Findings show that the PIH-K is reliable and valid in measuring self-management of patients with chronic illnesses.

The validity and reliability of the Healthy Lifestyle Screening Tool

  • Kim, Cheong Hoon;Kang, Kyung-Ah
    • Physical Therapy Rehabilitation Science
    • /
    • 제8권2호
    • /
    • pp.99-110
    • /
    • 2019
  • Objective: The aim of the present study was to develop a valid and reliable scale that measures the healthy life styles among young adults. Design: A methodological study design was employed to develop and validate the Healthy Lifestyle Screening Tool (HLST). Methods: The validity and reliability of the HLST were established in accordance with DeVellis' 8 steps guideline for tool development. The question items were generated based on literature reviews and interviews, which were then classified into 12 categories. The HLST was administered to 272 students attending a Korean university. The reliability was tested using Cronbach's alpha. The validity of the scale was examined with the mean inter-item correlations (MIIC) and factor analysis, and was also examined for content validity by experts. Results: The reliability of the HLST was found to be acceptable, as indicated by a Cronbach's alpha of 0.71. In the validity test, items with less than 80% "agreement" ratings on the content validity index by experts were revised. The MIIC values were greater than 0.25. A factor analysis of 36 items extracted 9 factors (i.e., four items per factor), which together explained 50.4% of the variance. The HLST consists of 36 items that measure 9 factors based on a 4-point Likert rating scale, with 4 items per factor, as follows: sunlight, water, air, rest, exercise, nutrition, temperance, trust, and general physical condition. High scores on the HLST are indicative of a healthy lifestyle (HL). Conclusions: The HLST is a valid and reliable scale that can be used to measure HL among young adults. Identification of HL by using the HLST can provide guidance to integrated therapeutic approaches along with conventional physical therapy.