• Title/Summary/Keyword: 타당도 평가

Search Result 857, Processing Time 0.029 seconds

Development of STEAM Diagnostic Evaluation Tool to Strengthen the Implementation of STEAM Education (STEAM 교육의 실행 강화를 위한 학교 STEAM 역량 진단 도구 개발)

  • Park, HyunJu;Sim, Jaeho;Lee, Ji-Ae;Lee, Youngtae
    • Journal of Science Education
    • /
    • v.45 no.3
    • /
    • pp.349-363
    • /
    • 2021
  • The purpose of this study is to develop an instrument for school STEAM education diagnostic assessment. Literature reviews, the developmental study of a prototype instrument, experts' advices, and pilot study were administrated. The school STEAM education diagnostic assessment was consist of five areas: 'STEM education action and sustainability plan,' 'STEAM curriculum and instruction,' 'STEAM professional development,' 'process-based evaluation,' and 'community and partnerships.' Each area had one to five sub-areas. A total of 14 diagnosis items were developed, including items that can diagnose the school's STEAM environment base and STEAM education execution level at the school unit and member level for each area. The validation of the diagnostic assessment was conducted through the content validity of the expert group and the validity of a survey targeting school teachers. For applying the instrument for STEAM Education School Assessment to schools, a total of 267 elementary, middle, and high schools participated. As a result, the average of the five areas was 1.46 to 2.18. This instrument comprehensively diagnoses and evaluates the implementation and effectiveness of STEAM education in schools, and is expected to be used as basic data and core data for implementing STEAM education.

The Study of Reliability and Validity of Attention Deficit Disorder Evaluation Scale-School Version(ADDES-SV) (주의력결핍 과잉운동장애 아동 평가척도의 교사 평가판에 대한 신뢰도 및 타당도 연구)

  • Bae, Jin-Woo;Cheung, Seung-Douk;Lee, Jong-Bum;Park, Hyung-Bae;Kim, Jin-Seung;Song, Chang-Jin
    • Journal of Yeungnam Medical Science
    • /
    • v.14 no.2
    • /
    • pp.415-429
    • /
    • 1997
  • The purpose of this study was to examine the reliability and validity of attention deficit disorder evaluation scale-school version(ADDES-SV). Between October 1996 and November 1996, ADDES-SV was administered to 263 elementary school students in the second grade and between Jun 1996 and October 1996, 28 attention deficit hyperactivity disorder patients. In the reliability test, the test-retest reliability coefficient was significantly high and that of inattention was 0.88, that of impulsivity was 0.80, that of hyperactivity was 0.83 and total score was 0.83. In the reliability test by internal consistancy, the Cronbach $\alpha$ coefficient was significantly high and that of inattention was 0.98, that of impulsivity was 0.87, that of hyperactivity was 0.87(p<0.05). The half-sprit reliability coefficient by first-second half method showed high correlation and that of inattention was part 1: 0.96, part 2: 0.96 impulsivity was part 1: 0.95, part 2: 0.93, hyperactivity was part 1: 0.92, part 2: 0.94(p<0.05). Inter-rater reliability by pearson correlation coefficient was significantly high and that of inattention was 0.92, that of impulsivity was 0.87, that of hyperactivity was 0.89 and total score was 0.89. The concurrent validity between ADDES-SV and CAP scale was 0.85 in attention deficit hyperactivity disorder patient group and 0.79 in normal control group(p<0.05). In discriminant validity test between attention deficit hyperactivity disorder patient group and normal control group, the patient group showed higher score(p<0.05). The total discriminant capacity of the patient group in ADDES-SV was 94.6%. In this point of view, ADDES-SV scale showed high reliability and validity in applying to Korean subjects and was proved to be the useful screening test tool for attention deficit hyperactivity disorder research.

  • PDF

Validity and Reliability of a Korean Version of the Trier Inventory for Chronic Stress (한국어판 축약형 순간 스트레스 측정 도구(Trier Inventory for Chronic Stress: TICS)의 타당도 및 신뢰도 평가)

  • Ryu, Gi Wook;Yang, Yong Sook;Choi, Mona
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.21 no.10
    • /
    • pp.530-540
    • /
    • 2020
  • Ecological momentary assessment (EMA) is a method that captures the current experience and behavior of subjects in real time in a natural environment. The data collected by EMA reveals alterations according to the time and context of experience and action. The Trier Inventory for Chronic Stress (TICS) is a tool that measures momentary stress, and is capable of measuring stress experienced in real life. This study was undertaken to verify the validity and reliability after translating the short form TICS into a Korean version. Totally, 89 police officers working at the police station in the capital participated in this study. The mobile application developed for this study was installed on their smartphones, and data were collected four times a day for seven consecutive days. Confirmatory factor analysis and content validity index (CVI) was applied to test the validity, and concurrent validity was evaluated by correlating with the occupational stress score. The model was validated by confirmatory factor analysis, and we obtained good reliabilities (I-CVI=0.83-1, RMSEA=0.104, SRMR=0.104, CFI=0.948, TLI=0.919, Cronbach's alpha=0.839). Our findings indicate the reliability, and validate use of the Korean tool for measuring momentary stress.

Reliability and Validity of the Korean Version of Children Participation Questionnaire (한글판 Children Participation Questionnaire(K-CPQ)의 신뢰도 및 타당도 연구)

  • Ko, You-Jeong;Ko, Su-Jeong;Chae, Soo-Gyuong
    • The Journal of the Korea Contents Association
    • /
    • v.19 no.3
    • /
    • pp.163-170
    • /
    • 2019
  • The purpose of this study was to examine the reliability and validity of the K-CPQ in 299 children with developmental disorder and non-disabled children to prove their level of participation in Korean children with developmental disabilities. In order to verify the reliability of the K-CPQ, Cronbach ${\alpha}$ was calculated and Pearson correlation analysis was used for test-retest reliability test. As a result, the internal consistency(${\alpha}=.81{\sim}.90$) in each area of K-CPQ was relatively high and the Pearson correlation coefficient (r=.807~.843) in the test-retest reliability test was significant in all areas(p<.01). It showed statistically significant difference in all areas(t=2.32~5.18) in comparison with the non-disabled children group in order to verify the discriminant validity of K-CPQ. For the criterion-related validity of the K-CPQ, Pearson correlation analysis of K-SMS and K-SFA shows statistically significant static correlation(r=.817, r=743) showed(p<.01). Through this study, K-CPQ has been confirmed as a reliable and reasonable assessment tool and we expect that diverse research by K-CPQ will provide appropriate interventions for children with disabilities.

The Validity of Activity Participation Assessment for School-Age Children (학령기 아동을 위한 활동 참여 평가도구(Activity Participation Assessment)의 타당도 연구)

  • Kim, Se-Yun
    • The Journal of Korean Academy of Sensory Integration
    • /
    • v.17 no.1
    • /
    • pp.19-29
    • /
    • 2019
  • Objective : The aim of this study was to verify validity of the Activity Participation Assessment for school-age children. Methods : A questionnaire consisting of 30 items from the APA, 75 items from the PACS, and 55 items from the CAPE was administered to elementary school students. A total of 207 questionnaires were analyzed. Confirmatory factor analysis was performed to confirm the construct validity of the APA. Convergence validity and discriminant validity were verified with the average variance extracted (AVE) and the square of the correlation coefficient. The discriminant validity was the Pearson correlation coefficient of the APA, PACS, and CAPE. Results : The results of the analysis were as follows: 1) For construct validity, the goodness of fit of the modified hierarchical second-order factor model was found to be appropriate (p < .001), 2) For convergent validity, the AVE was higher than .50 for all latent variables, 3) For discriminant validity, the AVE of the latent variable was greater than the square of the correlation coefficient (0.239), 4) For concurrent validity, the correlation between the total sum of the APA and PACS scores showed a positive correlation in all domains, and the correlation coefficient ranged from .303 to .647 at a statistically significant level (p < .01), 5) The correlation coefficient between the total sum of the APA and CAPE scores was .490 for recreational activities, .329 for physical activities, .571 for social activities, .401 for skill-based activities, and .390 for self-improvement activities. All domains showed a positive correlation, and were statistically significant (p < .01). Conclusion : APA can be used as a valid assessment tool to measure the participation of school aged children.

A Study on Development of the Job Functional Assessment Scale for people with Disabilities (장애인 근로능력평가 척도 개발에 관한 연구 -국민연금장애연금수급자를 중심으로)

  • Shin, Hyun-Uk;Kang, Byeongro
    • Journal of Digital Convergence
    • /
    • v.12 no.4
    • /
    • pp.379-397
    • /
    • 2014
  • The purpose of this study was to develop the Job Functional Assessment Scale. This study was involved took third steps. First, 93 preliminary items were developed based on theoretical literature and International Classification of Functioning, Disability and Health (ICF) Model. To verify the content validity, 3 rehabilitation experts rated those items. Second, the scale consisting of 73 items was administered to sample of 880 people with disabilities. Finally, items of the scale were reduced to 58 items. Factor analysis showed evidence of construct validity of the scale. Internal consistency (Cronbach's ${\alpha}$) of total score showed .94 and Cronbach's ${\alpha}$ of 7 subfactor demonstrated .74~.90. Thus, Job Functional Assessment Scale demonstrated satisfactory convergent validity and discriminant validity. In addition, the practical use of the scale was discussed.

Development of Theocratical Model and Evaluation Tool for Learning Epistemic Frame using Computer based Learning System (컴퓨터기반 교육시스템의 인식론적 프레임 학습을 위한 이론모형 구축과 평가도구 개발)

  • Choi, Younyoung;Seo, Donggi;Jung, Sunho
    • The Journal of the Korea Contents Association
    • /
    • v.18 no.3
    • /
    • pp.354-360
    • /
    • 2018
  • Recently, the computer aided learning system has promoted a new educational concept and education system. The purpose of this study is to construct a theoretical model for the epistemic frame and evaluation tool which is emphasized according to the 21st century. Specifically, first, this study conducted a domain analysis of epistemic frame. Second, this study developed an evaluation tool to measure epistemic frame. Finally, the evaluation tool is examined in terms of validity and reliability using factor analysis and Cronbach's alpha. As a result, the theoretical model was presented through the consultation of the Advisory Group and the evaluation tool was empirically validated. We expect that this study will provide a useful information to researchers and practitioners who want to develop a computer based learning tool for learning epistemic frame.

Converged Study on Development and Evaluation of Stress with clinical practice Scale for Nursing Students (간호대학생의 임상실습스트레스 측정도구 개발 및 평가에 관한 융합연구)

  • Park, Jin Kyoung;Lim, Su-Jin
    • Journal of the Korea Convergence Society
    • /
    • v.8 no.12
    • /
    • pp.189-197
    • /
    • 2017
  • This study was done to develop and to evaluate a stress of clinical practice scale for nursing students. Based on a literature review, the first preliminary 40 questions were developed, which content validation by expert reviewers and a pilot study. To evaluate the validity and reliability of this preliminary scale, data were collected from 426 nursing students. Thirty seven items were selected for the final scale, and categorized into 8 factors explaining 66.61% of total variance. The convergent validity and determinant validity were 100.0%, respectively. Cronbach's alpha coefficient for the 37 items was .96. The scale developed in this study that can be used to measure the stress with clinical practice of nursing students.

Comparison of Modified-Modified Schober Test with Range of Motion in Evaluating Visual Analog Scale of Patients with Low Back Pain (요통 환자의 시각 통증 등급 평가에 있어서 Modified-Modified Schober Test와 관절 운동 범위의 비교)

  • Park, In-Shik;Byun, Hyuk;Jung, Chan-Young;Lee, Seung-Deok;Kim, Eun-Jung;Kim, Kap-Sung
    • Journal of Acupuncture Research
    • /
    • v.24 no.5
    • /
    • pp.97-104
    • /
    • 2007
  • 목적 : 요통 환자에서 Modified-Modified Schober Test (MMST)와 관절 운동 범위를 비교하여 시각 통증 등급 평가에 있어서 타당도의 우위를 추정하여 보고자 하였다. 방법 : 요통으로 입원한 31명의 환자들을 대상으로 MMST, 관절 운동 범위 및 시각 통증 등급을 주 3회씩 입원 기간 동안 측정하였다. 각 측정 방법의 시행 순서는 무작위로 선택되었으며, 환자들은 맨발로 환자복을 입은 채 측정하였다. 결과 : 각 자료의 상관성을 분석하기 위하여 피어슨 상관계수가 사용되었다. 요추의 MMST 측정값(r=-0.61 ; 99%CI)이 요추의 신전 및 굴곡의 관절 운동 범위 측정값보다 시각 통증 등급에 통계적으로 의미 있게 나타났다. 또한 요추의 MMST 측정값(r= -0.77 ; 99%CI)은 요추의 신전 관절 운동 범위 측정값보다 요추의 굴곡 관절 운동 범위 측정값과 통계적으로 의미 있게 나타났다. 결론 : 이상의 결과를 통하여 요통 환자의 평가에 있어서 MMST가 관절 운동 범위보다 높은 타당도를 가지는 것으로 추정된다.

  • PDF