• Title/Summary/Keyword: (예측)타당도

Search Result 113, Processing Time 0.024 seconds

Validity Analysis of Python Automatic Scoring Exercise-Problems using Machine Learning Models (머신러닝 모델을 이용한 파이썬 자동채점 연습문제의 타당성 분석)

  • Kyeong Hur
    • Journal of Practical Engineering Education
    • /
    • v.15 no.1
    • /
    • pp.193-198
    • /
    • 2023
  • This paper analyzed the validity of exercise problems for each unit in Python programming education. Practice questions presented for each unit are presented through an online learning system, and each student uploads an answer code and is automatically graded. Data such as students' mid-term exam scores, final exam scores, and practice questions scores for each unit are collected through Python lecture that lasts for one semester. Through the collected data, it is possible to improve the exercise problems for each unit by analyzing the validity of the automatic scoring exercise problems. In this paper, Orange machine learning tool was used to analyze the validity of automatic scoring exercises. The data collected in the Python subject are analyzed and compared comprehensively by total, top, and bottom groups. From the prediction accuracy of the machine learning model that predicts the student's final grade from the Python unit-by-unit practice problem scores, the validity of the automatic scoring exercises for each unit was analyzed.

Development of the Mathematics Teaching Efficacy Beliefs Instrument Korean Version for Elementary Preservice Teachers (초등 예비 수학 교사를 대상으로 하는 MTEBI 한글판 개발)

  • Ryang, Dohyoung
    • The Mathematical Education
    • /
    • v.52 no.3
    • /
    • pp.363-377
    • /
    • 2013
  • 교수효능감은 교사가 교실에서 얼마나 효율적으로 가르칠 것인지를 예측하는 매우 강력한 구인이다. MTEBI는 초등 예비교사를 대상으로 수학 교수 효능감을 재는 유효한 척도이다. 그러나 MTEBI는 미국에서 개발되어 다른 문화에서 바로 사용할 수는 없다. 본 연구는 MTEBI가 한국에서 유효한 지에 대한 실증적 조사이다. 먼저, 영문의 MTEBI를 국문으로 번역하고, 번역한 것을 다수의 수학교사 교육자가 철저하게 검토하였다. 그다음, 506명의 예비 초등교사 표본에서 정규성, 신뢰도, 타당도 등의 통계적 검정을 실시하였다. 그 결과, 한글판 MTEBI의 하위척도인 PMTE와 MTOE의 알파계수가 각각 .836과 .705이었다. 이로써 한글판 MTEBI가 한국에서 효능감 연구에 사용할 수 있을 만큼 믿을 수 있고 문항 구성이 타당함을 입증하였다. 나아가 본 연구에서 제시된 영문판을 바탕으로 한국과 교육에 대한 전통과 문화가 비슷한 이웃 문화에서도 효능감 연구가 일어나기를 기대한다.

A Validation Study on Korean version of Heterophobia scale for Gay male (한국판 남성 동성애자의 이성애불편감(Heterophobia) 척도(K-HGM)의 타당화)

  • Kim Joon Hyun;Yu Kum Lan
    • Korean Journal of Culture and Social Issue
    • /
    • v.29 no.1
    • /
    • pp.25-51
    • /
    • 2023
  • The purpose of the study was to validate the Korean version of the Heterophobia Scale for Gay Male (HGM). Heterophobia refers to the rejection, fear, and avoidance that sexual minorities feel against of heterosexuals. The three subscales of HGM assesses the unease/avoidance, disconnectedness, and expected rejection fromwith heterosexual male. To validate the Korean HGM, item translation, item analysis, and exploratory factor analysis were conducted. From the Using exploratory factor analysis of the Korean version of the HGM(N=213), per 13 items, a 3-factor model consisting of 13 items wereas determined. The Cconfirmatory factor analysis supported the goodness of fit of the 3-factor structure of the K-HGM (N=153) and showed adequate model fit, K-HGM showed adequate the internal consistency, convergent validity, discriminant validity and Criterion validity was good with other related scales (K-SOMS, K-MISS-G, SDS-9, and RS). In conclusion, the K-HGM is a valid measure of heterophobia for gay male within the Korean population. Based on the findings, implications, practical use, limitations, and suggestions for future study are discussed.

Evaluating the Predictive Validity for the New Pressure Sores Risk Assessment Scale (수정욕창위험 사정도구의 예측타당도 평가)

  • Kim, Si-Sook;Choi, Kyung-Sook
    • Korean Journal of Adult Nursing
    • /
    • v.16 no.2
    • /
    • pp.183-190
    • /
    • 2004
  • Purpose: The purpose of this study was To exam the skin and pressure sore and To evaluate the predictive validity for the new pressure sores risk assessment scale. Method: There was finally 211 neurosurgery subject admitted in Chung-Ang Univ. Hospital from Nov, 11, 2002 to Feb, 11, 2003. Data was collected three times per week from 48-72hr after admission until incidence of pressure sores or discharge or die. Inclusion criteria were; (1) no pressure sores at admittance, (2) at least 3 times assessment, (3) adults older than 16yrs, (4) patients consent to participate in study. Result: 1. 34 case of 211 developed pressure sores(11.6%). 2. The coccyx area was the most common occurrence site of pressure sores. 3. At the cutoff point 23 of sensitivity 100%, specificity 76.3% was higher in 2003 than specificity 63.8% at the cutoff point 26 of sencitivity 100% in 1991. 4. "Moisture" of subscale for pressure sores risk factor was the strongest predictor. Conclusion: This study shows that the New Pressure Sores Risk Assessment Scale still predict the risk of developing pressure sores in neurosurgical subject.

  • PDF

Development and Validation of the Post-bereavement Growth Inventory in Later Life (노년기 사별 후 성장척도의 개발 및 타당화)

  • Chang, Sujie
    • Korean Journal of Social Welfare
    • /
    • v.67 no.2
    • /
    • pp.61-84
    • /
    • 2015
  • The purpose of this study was to develop the Post-bereavement Growth Inventory(PBGI) for the elderly and to evaluate its validity. The items for developing PBGI were compiled from a literature search, content validity review, and a preliminary survey. A main survey of 308 widowed persons(aged 60+) was conducted. The results were as follows. First, an exploratory factor analysis revealed six factors of the PBGI. The results of the confirmatory factor analysis supported a five-factor structure for the final 24 scale items of scale. Second, in terms of concurrent validity, the PGBI compared favorably with the "Personal Growth" scale from The Hogan Grief Reaction Checklist (HGRC: Hogan and Schimdt, 2001). Third, the results of contrast group validity tests demonstrated that the group scoring in the upper 30% on the scales of Psychological Well-being (PWB, Ryff and Keyes, 1995) and the Grief Reaction Inventory (GRI: Remondet and Hansson, 1987) showed a significantly higher degree of post-bereavement growth (PBG) than the group scoring in the lower 30%. Fourth, Cronbach's ${\alpha}$ values for the five factors were between .649-.856 and .907 overall, indicating high internal consistency. Finally, education had the most significant influence on PBG. All results indicated the high validity of the PBGI. The findings from this study could provide the rationale for practical interventions from a growth-oriented perspective for widowed persons, as well as an objective assessment tool for practitioners in clinical areas.

  • PDF

Development and Validation of the Two Measures (power controllability, power desirability) for Identifying Power Relationships Among the School Youth (학교 내 청소년들의 권력관계 양상과 유형 파악을 위한 척도 개발 및 타당화 연구)

  • Um, Myungyong;Song, Minkyung
    • Korean Journal of Social Welfare
    • /
    • v.66 no.2
    • /
    • pp.255-286
    • /
    • 2014
  • This study aimed at developing and validating two standardized measures, 'power controllability', and 'power desirability', which can be utilized to categorize power relationships among the school youth. In order to identify initial items for the measures researchers conducted individual as well as focus group interviews with middle and high school students. School teachers and other school related professionals involved in ensuring both the face validity and the content validity of the initial items. For the finally selected items both exploratory and confirmatory factor analyses have been executed with the sample of 1,822 students attending elementary, middle, and high schools in the metropolitan area of Seoul, Korea. To test the validity of the confirmed factor structure of the measures the new sample of 348 middle school students were employed from the metropolitan area. Both construct validity and reliability were calculated from the validity test sample. Based on the two developed measures 4 types of power relationship were identified among the students. The four types of power relationship turned out to predict well the roles that students take in the field of school violence.

  • PDF

Factors of Predicting Difficulty of Mathematics Test Items in College Scholastic Ability Test (고등학교 수리영역 시험의 난이도 예측 요인 분석)

  • Ko, Ho-Kyoung;Yi, Hyun-Sook
    • Journal of the Korean School Mathematics Society
    • /
    • v.10 no.1
    • /
    • pp.113-127
    • /
    • 2007
  • This study explored the possibility of building a statistical model predicting difficulty of mathematics test items through the analysis of nation-wide scholastic ability test results for the past 5 years. Multiple linear regression analysis was conducted in predicting difficulty of mathematics test items. We adopted three major areas for independent variables: the content area, the behavior area, and the test item format area, each of which was categorized into more detailed sub-areas. For the dependent variable, the proportion of correct answer was used to represent the item difficulty. Statistically significant independent variables were included in the regression model based on the stepwise selection method. Several important factors affecting difficulty of mathematics test items for each area were identified. R-squares for the final regression model were fairly high, implying that the regression equation can be used to predict difficulty of test items at an acceptable level. Lastly, the regression model was cross-validated using independently collected data. We believe that this study will provide basic but very critical information for predicting the proportion of correct answer by showing the factors that should be considered for developing mathematics test items for the college entrance examination or high school classroom test.

  • PDF

A Longitudinal Validation Study of the Korean Version of PCL-5(Post-traumatic Stress Disorder Checklist for DSM-5) (PCL-5(DSM-5 기준 외상 후 스트레스 장애 체크리스트) 한국판 종단 타당화 연구)

  • Lee, DongHun;Lee, DeokHee;Kim, SungHyun;Jung, DaSong
    • Korean Journal of Culture and Social Issue
    • /
    • v.28 no.2
    • /
    • pp.187-217
    • /
    • 2022
  • The aim of this study is to examine the psychometric properties of the Korean version of the Post-traumatic Stress Disorder Checklist for DSM-5(PCL-5). For this purpose, online surveys were conducted for two times with a one year interval using the data from 1,077 Korean adults at time 1, and 563 Korean adults at time 2. First, from the result of the confirmatory factor analysis, comparing the model fit of the 1, 4, 6, and 7-factor model, the 4, 6, and 7-factor model showed a acceptable fit, and the best fit was seen in the order of the 7, 6, 4-factor model. Second, the internal consistency, omega coefficient, construct validity, average variance extracted, and test-retest reliability results were all satisfactory.. Third, a correlation analysis with the K-PC-PTSD-5 and the sub-factors of BSI-18 was conducted to check the validity of the Korean Version of PCL-5. As a result, a positive correlation was seen with both K-PC-PTSD-5 and BSI-18. Fourth, a hierarchical multiple regression was performed to examine whether the Korean Version of PCL-5 predicts future PTSD, depression, anxiety, and somatization. As a result, the Korean Version of PCL-5 measured at time 1 significantly predicted PTSD, depression, anxiety, and somatization symptoms at time 2. Fifth, by analyzing the ROC curve, the discriminant power of PCL-5 for screening PTSD symptom groups was confirmed, and the best cut-off score was suggested. As a result of the longitudinal validation of Korean version of PCL-5, it was found that this scale is a reliable and valid measure for Korean adults. By looking into the predictive validity of the scale, it was found that the Korean version of PCL-5 can predict not only PTSD symptoms but also PTSD-related symptoms such as depression, anxiety, and somatization. Also, this study differs from previous validation studies measuring PTSD symptoms in that it suggested a cut-off score to help differentiate PTSD symptom groups.

A comparative study on validity of AHP and conjoint analysis: a case of cosmetics preference (계층적 의사결정과 컨조인트 분석의 타당성 비교: 화장품 선호 사례 조사)

  • Lee, Ji Hye;Jeong, Hyeong Chul
    • The Korean Journal of Applied Statistics
    • /
    • v.29 no.5
    • /
    • pp.921-933
    • /
    • 2016
  • In this paper, we consider the comparisons of the personal preferences of analytic hierarchy process (AHP) and conjoint analysis (CA) which contain very relatively small number of alternatives. However, a direct performance comparison is not easy because these two methods have a much different process to achieve the final decision. Therefore, we adopt a validity and reference method with empirical case study for cosmetics preference of female college students. In case study, conjoint analysis has the merit of measuring internal validity; however, AHP has the merit of measuring predictive validity.

Psychometric Properties of the Subjective Agingwell Scale (주관적 에이징웰 척도의 타당화)

  • Hong, Ji-Woong;Ju, Haewon
    • Journal of Digital Convergence
    • /
    • v.19 no.11
    • /
    • pp.415-424
    • /
    • 2021
  • The purpose of the current study is to to examine the psychometric properties of the Subjective Agingwell Scale (SAS). Three hundred and forty two elders completed the SAS and the scales assessing subjective well-being, optimism, perceived control and adhering to healthy behavior. The 11-item SAS that displays good internal reliability and good fit to the three-factor model consisting of cognitive satisfaction, positive affect, and spiritual fullness. Correlational analyses with measures of subjective agingwell, subjective well-being, and optimism provide evidence for construct validity. Moreover, the results from hierarchical regression analyses show criterion-related validity of the SAS. This scale could be used in the field to measure and promote subjective agingwell.