• The Journal of Korean Medicine
• /
• v.45 no.1
• /
• pp.1-16
• /
• 2024

Introduction: The importance of clinical skills training in traditional Korean medicine education is increasingly emphasized. Since the clinical skills tests are high-stakes tests that determine success in national licensing exams, it is essential to develop reliable multifaceted analysis methods for clinical skills tests in actual education settings. In this study, we applied the multifaceted validity evaluation methods to the evaluation results of the cardiopulmonary resuscitation module to confirm the applicability and effectiveness of the methods. Methods: In this study, we used internal consistency, factor analysis, generalizability theory G-study and D-study, ANOVA, Kendall's tau, descriptive statistics, and other statistical methods to analyze the multidimensional validity of a cardiopulmonary resuscitation test in clinical education settings over the past three years. Results: The factor analysis and internal consistency analysis showed that the evaluation rubric had an unstable structure and low concordance. The G-study showed that the error of the clinical skills assessment was large due to the evaluator and unexpected errors. The D-study showed that the variance error of the evaluator should be significantly reduced to validate the evaluation. The ANOVA and Kendall's tau confirmed that evaluator heterogeneity was a problem. Discussion and Conclusion: Clinical skills tests should be continuously evaluated and managed for validity in two steps of pre-production and actual implementation. This study has presented specific methods for analyzing the validity of clinical skills training and testing in actual education settings. This study would contribute to the foundation for competency-based evidence-based education in practical clinical training.

• Journal of Korean Society for Quality Management
• /
• v.51 no.4
• /
• pp.643-662
• /
• 2023

Purpose: The purpose of this study was to understand an individuals' COVID-19 vaccine acceptance intention during the peak of the pandemic by utilizing the coping theory and technology threat avoidance theory (TTAT) as a framework. Specifically, we focused on understanding how inward and outward emotion-focused coping (EFC), such as psychological distancing and emotional support seeking, affect problem-focused behavior (PFC), which is vaccine acceptance. Furthermore, we investigate how the individuals' cognitive appraisal to- ward COVID-19, consisted of perceived threat and perceived avoidability act as an antecedent of EFC. Methods: A PLS-SEM analysis was conducted to find the causal relation between the variables. An online survey was conducted targeting vaccination recipients on April, 2021. Participants were asked about their perception toward the virus, their coping strategy, and vaccine acceptance intention. A total of 186 valid samples were collected and used for the analysis. Furthermore, to analyze the out-of-sample predictive power of the research model and ensure the generalizability of the results, a PLSpredict analysis was conducted. Results: The results of the PLS-SEM analysis show that perceived threat toward COVID-19 significantly affect an individuals' EFC strategy. Furthermore, both types of inward EFC (psychological distancing, wishful thinking) negatively affected vaccine acceptance intention. On the other hand, emotional support seeking, which is a type of outward EFC, positively affected vaccine acceptance. The result of the PLSpredict analysis confirms the generalizability of the PLS-SEM result. Conclusion: The results of our study could be utilized to decrease vaccine hesitancy and prevent global pandemics by accelerating and increasing vaccination. Our study provides several meaningful implications to researchers and practitioners regarding vaccine acceptance and threat coping behavior.

• Communications of Mathematical Education
• /
• v.31 no.1
• /
• pp.49-70
• /
• 2017

The purpose of this study was to investigate the relative influence of multiple error sources and to find optimal measurement conditions that obtain a desired level of reliability of a creative attitude test in mathematical creativity. This study analyzed the scores of the Creative Attitude Scale-Korea allowed to access publicly of 125 general students and 109 mathematically gifted students by performing a multivariate generalizability analysis. The main results were as follows. First, based on reliability, the Creative Attitude Scale-Korea was measured less precisely for mathematically gifted students. On the contrary, based on the conditional standard error of measurement, it was measured less precisely for general students. However, the Creative Attitude Scale-Korea showed strong reliability in both groups. Second, the optimal weights should adjust to .3, .3, .4 in mathematically gifted students and .4, .4, .2 in general students with three scoring components of divergent attitude, problem solving attitude, and convergent attitude based on the maximum reliability. Third, to approach desirable reliability, it is possible to use one component of divergent attitude in general students but three components of divergent attitude, problem solving attitude, and convergent attitude in mathematically gifted students. Finally this study proposed application plans for the Creative Attitude Scale-Korea and future directions of research.

• Journal of Digital Convergence
• /
• v.19 no.7
• /
• pp.33-39
• /
• 2021

This paper aims to analyze lexical properties of keyword lists extracted from NLT Old Testament Corpus(NOTC), NLT New Testament Corpus(NNTC), and The NLT Bible Corpus(NBC) and identify that text dispersion keyness is more effective than corpus frequency keyness. For this purpose, NOTC including around 570,000 running words and NNTC about 200,000 were compiled after downloading the files from NLT website of Bible Hub. Scott's (2020) WordSmith 8.0 was utilized to extract keyword lists through comparing a target corpus and a reference corpus. The result demonstrated that text dispersion keyness showed lexical properties of keyword lists better than corpus frequency keyness and that the former was a superior measure for generating optimal keyword lists to fully meet content-generalizability and content distinctiveness.

• Korean journal of food and cookery science
• /
• v.19 no.2
• /
• pp.155-164
• /
• 2003

The purpose of this study was to examine, in a service context, construct validity and generalizability of widely used and accepted measures of perceived organizational support, job satisfaction, organizational commitment, and service duality, and to test each measures' predictive utility in this context with path analysis. Of 350 subjects, 309 subjects participated in the analysis. Descriptive statistics (frequencies), exploratory factor analysis, reliability analysis, zero-order partial correlation analysis, and confirmatory factor analysis were used for this study. The findings from this study are as follows. First, perceived organizational support significantly influenced job satisfaction, organizational commitment. and service quality. Second, Job satisfaction had a directional impact upon organizational commitment and service quality. Third, organizational commitment showed to have a predictive impart on service quality. Finally, the results of the study provide some insight into the types of internal marketing strategies that can be applied successfully by operators of hotel F & B departments.

• Journal of the Korean Data and Information Science Society
• /
• v.27 no.2
• /
• pp.395-407
• /
• 2016

This study aims to apply the G-theory for estimation of reliability of evaluation scores between raters on Taekwondo Poomsae rating categories. Selecting a number of game days and raters as multiple error sources, we analyzed the error sources caused by relative magnitude of error variances of interaction between the factors and proceeded with D-study based on the results of G-study for optimal determination of measurement condition. The results showed below. The estimated outcomes of variance component for accuracy among the Taekwondo Poomsae categories with G-theory showed that impact of error was the biggest influence factor in raters conditions and in order of interaction in subjects and between subjects, also impact of variance component estimation error on expression category was the major influence factor in interaction and in order of the between subjects and raters. Finally, the result of generalizability coefficient estimation via D-study showed that measurement condition of optimal level depend on the number of raters was 8 persons of raters on accuracy category, and stable reliability on expression category was gained when the raters were 7 persons.

• International journal of advanced smart convergence
• /
• v.11 no.4
• /
• pp.104-119
• /
• 2022

Life safety awareness level diagnosis is necessary for customized safety education and continuous safety awareness. As the starting stage of safety education for each life cycle, a scale that has verified the reliability and validity of high school students' life safety awareness has not yet been developed. In this context, the purpose of this study is to develop and validate the life safety awareness scale of high school students and to analyze interindividual differences. Questionnaire data was collected from April to June 2022 from 834 students in the first, second, and third grades of high schools in △△ city in Jeollabuk-do. A final 25-item scale was developed using the preliminary survey, preliminary test, the main test, descriptive statistical analysis, and exploratory and confirmatory factor analysis. This scale consists of four sub-factors: 'safety prevention', 'safety knowledge', 'safety preparation', and 'safety protection'. Good reliability and validity were verified by analysis of content validity and construct validity. The generalizability of the scale was verified by crossover validation between the search group and the crossover group. Based on the interindividual differences analysis, although there was a difference between genders in life safety awareness, there was no difference by grade level and academic achievement. This study is significant in developing the first valid scale that can measure high school students' life safety awareness and providing the necessity and rationale for life safety education by life cycle considering individual gender differences.

• Phonetics and Speech Sciences
• /
• v.9 no.3
• /
• pp.49-56
• /
• 2017

Much research attention has been directed to identify how native speakers perceive non-native speakers' oral proficiency. To investigate the generalizability of previous findings, this study examined segmental, phonological, accentual, and temporal correlates of native speakers' evaluation of L2 Korean proficiency produced by learners with various levels and nationalities. Our experiment results show that proficiency ratings by native speakers significantly correlate not only with rate of speech, but also with the segmental accuracies. The influence of segmental errors has the highest correlation with the proficiency of L2 Korean speech. We further verified this finding within substitution, deletion, insertion error rates. Although phonological accuracy was expected to be highly correlated with the proficiency score, it was the least influential measure. Another new finding in this study is that the role of pitch and accent has been underemphasized so far in the non-native Korean speech perception studies. This work will serve as the groundwork for the development of automatic assessment module in Korean CAPT system.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.36 no.7C
• /
• pp.428-434
• /
• 2011

Recently, subspace analysis has raised its performance to a higher level through the adoption of kernel-based nonlinearity. Especially, the radial basis function, based on its nonparametric nature, has shown promising results in face recognition. However, due to the endemic small sample size problem of face data, the conventional kernel-based feature extraction methods have difficulty in data representation. In this paper, we introduce a novel variant of the RBF kernel to alleviate this problem. By adopting the concept of the nearest feature line classifier, we show both effectiveness and generalizability of the proposed method, particularly regarding the small sample size issue.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.19 no.5
• /
• pp.323-330
• /
• 2018

This study examined the fairness of the teaching aptitude and personality test assigned to pre-service engineering teachers in a graduate school of education based on measurement traits. For this study, we analyzed the teaching aptitude and personality test scores of 99 students enrolled in engineering education in a graduate school of education located in the Seoul metropolitan area from 2013 to 2017. The main results were as follows. First, the estimated variance due to residual was generally the highest, followed by nesting of items within domains, pre-service engineering teachers, interactions of pre-service engineering teachers with domains, domains, and occasions. Second, dependability coefficients were better indicators than Cronbach's because the latter may have been overestimated by applying the traditional reliability coefficient in inappropriate manners. Third, the teaching aptitude and personality test can be applied to pre-service engineering teachers in a graduate school of education based on empirical evidence considering dependability coefficients. Fourth, a total of 96 items from the original 210 items, with 2 occasions and 12 domains containing 8 items in each domain, were optimal measurement conditions to reach adequate degrees of reliability based on the total number of items. Finally, the results were discussed, the study limitations described and future research directions proposed.