• Korean Journal of Social Welfare
• /
• v.54
• /
• pp.5-33
• /
• 2003

This study is about the re-validation evaluation of the family Relationship Scale (FRS), developed to measure the family relationship in the social work practice. This study aims at re-validating the FRS, developed and validated in by Yang in 2001 for more general utilization. The sample was married mates and females residing in Seoul. For Face Validity, the content analysis was performed, and the FRS was re-validated in the dimensions of Love & Caring, Acceptance, and Recognition, positive affection, empathy, and autonomy and flexibility for each area. Internal reliability was .93, and internal consistency among three dimensions was 93%. For Empirical Validity, the Construct validity, the Criterion validity, and the Discriminant validity were performed. Construct Validity was validated through factor analyses. Commonalities for the factor analysis was 54%, and the factor loading for each factor was over .45. The confirmative factor analysis also confirmed the fitness of the scale. For Predictive Validity of Criterion Validity, regression analysis showed that the family stress scores became lower as the scores of the family relationship became higher; the discriminant analysis revealed that the family stress turned low ill tile group of high scores of family relationship. The Correlation analysis for Concurrent Validity was performed and the results showed the positive and significant relationship with a couple communication level (r=54) and a parent-child communication level (r=64). Life satisfaction and mental health level also revealed significantly positive correlation to prove Convergent Validity. Physical health level revealed a weak relationship with family relationship providing the evidence of Discriminant Validity. Discriminance was also proved by the analysis of variance with demographics. Thus, Cross Validation was confirmed the validation of the FRS through the various analyses with the married population. This study result improved the validity generalization of the Scale and verify the generalized usage of this sociometric scale in the field of social work practice.

• The Journal of the Korea Contents Association
• /
• v.15 no.11
• /
• pp.374-385
• /
• 2015

This purpose of study is to develop a dyslexia check list for students in middle and high school. To ensure the contents validity, researching related studies was conducted, and then factors and items were made under the 5 experts advisory. The pilot test was done on 265 students who are in middle and high school. To obtain the reliability, SPSS 21,0 was conducted as exploratory factor analysis and to confirm the goodness of fit test, AMOS 7.0 was done as confirmatory factor analysis. The results of study are as below, firstly, 8 measure factors and 34 items were ensured. Secondly, in exploratory analysis, Crombach ${\alpha}=.920$ was obtained, it was high value. Thirdly. in confirmatory factor analysis, the absolute fit index : GFI=.920, RMR=.057, RMSEA=.062 and incremental fit index : CGI=.960, TLI=.977 were ensured. Above results, the developed measurement tool for students in middle and high school in this study was confirmed as a suitable one.

• Journal of Educational Research in Mathematics
• /
• v.24 no.4
• /
• pp.573-594
• /
• 2014

Capacity of making assessment items among teacher's assessment competency is essential element in validity and reliability of assessment. Errors in test items on the formal and content aspects can be a big stumbling block to derive a correct evaluation result. Through this assessment, the positive feedback can not be derived. In this study, By analyzing midterm and final 60 exam papers for geometry and vector in 45 high Schools of Seoul GyeonggiIncheon area, We argue error items and improvements on the formal and content aspect the paper-based assessment of mathematics. Through this, Our intention is to improve the skills of teachers for making assessment items.

• Korean Journal of Social Welfare
• /
• v.57 no.3
• /
• pp.305-335
• /
• 2005

This paper is a result from validation study for SPDA(A Screening Scale For Potential Drug-use Adolescents) created in 2003 and newly developed during 2004. SPDA aims to screen adolescents in their early stage of drug-use and to help practitioners make a preventive approach for the adolescents. 4307 junior and senior high school students were selected as primary research subjects by stratified and quota sampling methods. 305 adolescents on probation were also selected as a comparison group and asked to answer the same questionnaire. Reliability for SPDA recorded 0.914, which proved to be better than previous year's (0.898). Exploratory and confirmatory factor analyses to test construct validity proved that SPDA could be divided into 7 factors and that each factor structure of SPDA could be a proper measurement model with high level of fitness and factor loadings. Discriminant analysis to test predictive validity confirmed that SPDA could classify the adolescents excellently by the frequency of drug-use, with hit ratio of 86.6 percent(78.8% and 87.4% for junior and senior high school students respectively). For concurrent validity test, Hare Home Self-Esteem Scale, Hare School Self-Esteem, Zuckerman-Kuhlman Sensation-seeking Scale were employed to find correlation with SPDA and all the three scales had significant Pearson correlation coefficients with SPDA. Known-groups validity test indicated that SPDA had an adequate power to classify out adolescents on probation from those in schooling, with a hit ratio of 71.8 percent. Cut-off point to detect adolescents with high risk of substance use was 77, which indicated approximately T score, 55 (0.5 SD), satisfying sensitivity, specificity, and efficiency criteria.

• Therapeutic Science for Rehabilitation
• /
• v.11 no.1
• /
• pp.69-85
• /
• 2022

Objective : This study aimed to develop a Comprehensive Oro-Facial Function Scale (COFFS) that can evaluate oro-facial function in patients with dysphagia. Methods : To verify the item composition and reliability of the COFFS, preliminary items were collected by selecting and analyzing four previous studies, and the Content Validity Ratio (CVR) was derived through a second survey of experts. Cronbach's 𝛼 was calculated for the internal validity of the evaluation items, and the test-retest reliability and inter-rater reliability were calculated using the internal classification coefficients (ICC). Results : The content validity ratio of all items was 0.67; in the case of Cronbach's 𝛼 value for each domain, 0.849 for communication domain, -0.224 for the oro-facial structure and shape, 0.831 for the ability to perform orofacial movements, and 0.946 for mastication and swallowing function. The test-retest reliability was 0.974 and the inter-rater reliability was 0.937, showing high reliability. Conclusion : In this study, the evaluation tool of COFFS was finally selected from 34 items in four areas and developed on a 3-5 point scale according to the evaluation items. In future studies, additional research is needed to prove its validity through correlation with other evaluation tools that measure oro-facial function.

• Korean Journal of Psychosomatic Medicine
• /
• v.26 no.1
• /
• pp.35-43
• /
• 2018

Objectives : Effects of multiple trauma are complex and extend beyond core PTSD symptoms. However, few psychological instruments for trauma assessment address this issue of symptom complexity. The Trauma Symptom Checklist-40 (TSC-40) is a self-report scale that assesses wide range of symptoms associated with childhood or adult traumatic experience. The purpose of the present study was to evaluate the validity of the Korean Version of the TSC-40 in a sample of psychiatric outpatients. Methods : Data of 367 treatment-seeking patients with DSM-IV diagnoses were obtained from an outpatient department of psychiatric unit at a university hospital. The diagnoses were anxiety disorder, posttraumatic stress disorder, depressive disorder, adjustment disorder and others. Included in the psychometric data were the TSC-40, the Life events checklist, the Impact of Event Scale-Revised, the Zung's Self-report Depression Scale, and the Zung's Self-report Anxiety Scale. Cronbach's ${\alpha}$ for internal consistency were calculated. Convergent and concurrent validity was approached with correlation between the TSC-40 and other scales (PTSD, anxiety and depression). Results : Exploratory factor analysis of the Korean Version of TSC-40 extracted seven-factor structure accounted for 59.55% of total variance that was contextually similar to a six-factor structure and five-factor structure of the original English version. The Korean Version of TSC-40 demonstrated a high level of internal consistency. (Cronbach's ${\alpha}=0.94$) and good concurrent and convergent validity with another PTSD scale and anxiety and depression scales. Conclusions : Excellent construct validity of The Korean Version of TSC-40 was proved in this study. And subtle difference in the factor structure may reflect the cultural issues and the sample characteristics such as heterogeneous clinical population (including non-trauma related disorders) and outpatient status. Overall, this study demonstrated that the Korean version of TSC-40 is psychometrically sound and can be used for Korean clinical population.

• Journal of The Korean Association For Science Education
• /
• v.38 no.4
• /
• pp.495-504
• /
• 2018

This study was conducted to develop items to measure scientific core competency based on statements of scientific core competencies presented in the 2015 revised national science curriculum and to identify the validity and reliability of the newly developed items. Based on the explanations of scientific reasoning, scientific inquiry ability, scientific problem-solving ability, scientific communication ability, participation/lifelong learning in science presented in the 2015 revised national science curriculum, 25 items were developed by five science education experts. To explore the validity and reliability of the developed items, data were collected from 11,348 students in elementary, middle, and high schools nationwide. The content validity, substantive validity, the internal structure validity, and generalization validity proposed by Messick (1995) were examined by various statistical tests. The results of the MNSQ analysis showed that there were no nonconformity in the 25 items. The confirmatory factor analysis using the structural equation modeling revealed that the five-factor model was a suitable model. The differential item functioning analyses by gender and school level revealed that the nonconformity DIF value was found in only two out of 175 cases. The results of the multivariate analysis of variance by gender and school level showed significant differences of test scores between schools and genders, and the interaction effect was also significant. The assessment items of science core competency based on the 2015 revised national science curriculum are valid from a psychometric point of view and can be used in the science education field.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.18 no.4
• /
• pp.304-310
• /
• 2017

This study is a methodological research study that tests the validity and reliability of the NCRC (Nurse Clinical Reasoning Competence scale), an instrument developed by Liou and his colleagues as the basic data for enhancing the clinical reasoning competence of nurses, by translating it into Korean and checking the similarity of the sentence structure and meaning (between the two versions?). This study verified its validity and reliability by examining 166 nurses working in four tertiary hospitals located in Seoul and Busan. An analysis of the content validity by experts showed that all of the items have a content validity higher than CVI 0.8. From the exploratory and confirmatory factor analysis, it was found that the instrument includes a total of 15 items consisting of one factor. In addition, the correlation with the Korean version of the Nurse Clinical Reasoning Competence scale is confirmed to test the concurrent validity, by using a measurement tool of nurses' critical thinking dispositions and clinical decision-making abilities (correlation coefficient =.55-.64(p<.001) and Cronbach's ${\alpha}=.93$). Thus, the Korean version of the NCRC may be a useful instrument for evaluating the clinical reasoning competence of Korean nurses and providing the basic data for assessing their clinical reasoning competence and developing their promotion strategies.

• The Journal of the Korea Contents Association
• /
• v.19 no.7
• /
• pp.638-649
• /
• 2019

The purpose of this study was to investigate the usefulness of the cognitive function test tool in the clinical or multi-life environment for the elderly and high-risk demented subjects after the development of the non-clinical dementia early diagnosis test content(Co-Wis) based on the contents of the International Clinical Data Standard(CDISC TAUG-Alzheimer's v 2.0, SDTMIG v3.3) And to verify the validity and reliability of the data. To do this, after searching for dementia diagnosis process, we developed a non-clinical dementia diagnosis content(Co-Wis) that can supplement the shortcomings of the existing paper test. We selected 30 subjects from elders who were over 60 years old and verified the validity of test and the reliability of retest among cognitive domains of the Korean MMSE-K, Seoul Neuropsychological Test(SNSB-II) and non-medication dementia diagnosis content(Co-Wis). As a result, we showed high correlation and reliability in all cognitive domains. However, the limitations of insufficient subjects and regional distribution were identified. Based on the results of the study, we discussed the necessity of supplementing and expanding further studies such as various methods of verifying validity and reliability.

• Korean Journal of Culture and Social Issue
• /
• v.29 no.4
• /
• pp.595-616
• /
• 2023

The Critical Consciousness Scale (CCS) is a scale developed by Diemer and colleagues (2017) that can measure the capacity of the oppressed or marginalized people to critically analyze their social and political conditions, support societal equality, and take action to change the perceived inequities. In this study, we validated the CCS for Korea by adapting and localizing the scale and validating it among university students. Content validity was verified by having five individuals with master's and doctoral degrees in psychology evaluate the suitability of the translated items. Afterwards, reliability and validity were verified through a survey of 314 university students nationwide using the CCS, along with the opportunity inequality recognition scale, recognition of the need for environmental change scale, social participation scale, and belief in a just world scale. To verify the scale's validity, exploratory factor analysis was conducted, confirming three subfactors. Then, a confirmatory factor analysis was carried out, where 14 items out of the original 22 were retained. The construct validity and reliability of these 14 items were found to be satisfactory. Additionally, in the correlation analysis between the CCS and similar scales, a significant clear relationship was found. The CCS showed a positive correlation with scales such as opportunity inequality recognition, need for environmental change recognition, and social participation, and a negative correlation with the belief in a just world scale. Based on these results, the CCS can be considered valid and reliable. Finally, the limitations and significance of this study were discussed.