• Korean Medical Education Review
• /
• v.23 no.3
• /
• pp.185-193
• /
• 2021

Students must be familiar with clinical skills before starting clinical practice to ensure patients' safety and enable efficient learning. However, performance is mainly tested in the third or fourth years of medical school, and studies using the validity framework have not been reported in Korea. We analyzed the validity of a performance test conducted among second-year students classified into content, response process, internal structure, relationships with other variables, and consequences according to Messick's framework. As results of the analysis, content validity was secured by developing cases according to a pre-determined blueprint. The quality of the response process was controlled by training and calibrating raters. The internal structure showed that (1) reliability by generalizability theory was acceptable (coefficients of 0.724 and 0.786, respectively, for day 1 and day 2), and (2) the relevant domains had proper correlations, while the clinical performance examination (CPX) and objective structured clinical examination (OSCE) showed weaker relationships. OSCE/CPX scores were correlated with other variables, especially grade point average and oral structured exam scores. The consequences of this assessment were (1) making students learn clinical skills and study themselves, while causing too much stress for students due to lack of motivation; (2) reminding educators of the need to apply practical teaching methods and to give feedback on the test results; and (3) providing an opportunity for faculty to consider developing support programs. It is necessary to develop the blueprint more precisely according to students' level and to verify the validity of the response process with statistical methods.

• Communications of Mathematical Education
• /
• v.36 no.2
• /
• pp.201-227
• /
• 2022

The purpose of this study was to develop an instrument measuring mathematics anxiety suitable for Korean High school students. In order to achieve this study purpose, the study was conducted according to the procedure of setting components of mathematics anxiety, developing questions, and verifying validity and reliability. First, in order to set the components of mathematic anxiety, previous studies on mathematic anxiety. Through this, six factors of mathematic anxiety were derived. Next, new questions were developed for each of the six constituent factors. The 122 questions were revised and supplemented through two content validity tests, and the final instrument for mathematics anxiety consisted of 49 questions of 6 factors. Finally, to verify the validity and reliability of the measurement instrument for mathematics anxiety, a survey was conducted on 1,848 students from 16 universities in Seoul and the metropolitan area. Next, a validity analysis was conducted with the 1,645 responses, excluding students who answered that there was no mathematics anxiety. As a result of exploratory factor analysis, 15 out of 49 questions were removed. Six factors were named individual characteristics, pressure on achievement, abstraction in mathematics, teaching and learning style, parental attitudes, and cumulative mathematics subjects. As a result of confirmatory factor analysis, the model fit was found to be appropriate, and the convergence validity and discriminant validity were found to be good.

• Journal of Hospice and Palliative Care
• /
• v.25 no.3
• /
• pp.110-120
• /
• 2022

Purpose: The purpose of this study was to confirm the factor structure of the McGill Quality of Life Questionnaire-Revised (MQOL-R) in the context of Korean culture and to verify its reliability and validity. Methods: The participants comprised terminal cancer patients aged 25 or older, and data from 164 participants were analyzed. The study was conducted in the following order: translation, expert review, reverse translation, preliminary investigation and interviews, and completion of the final version. Confirmatory factor analysis was applied to evaluate the validity of the instrument, and the Beck Depression Inventory, Korean version (K-BDI) was applied to confirm the criterion validity of the MQOL-R Korean version. The Cronbach's alpha coefficient, representing internal consistency, was measured to evaluate reliability. Results: Cronbach's alpha for all 14 questions was 0.862. The model fit indices for confirmatory factor analysis were within the acceptance criteria. The factor loadings of all four factors were over 0.50, and convergent validity and discriminant validity were confirmed. Regarding criterion validity, a negative correlation was found between the four factors of MQOL-R Korean version and the K-BDI. Conclusion: The MQOL-R Korean version, the reliability and validity of which were verified in this study, is a 15-item tool consisting of 14 items dealing with four physical, psychological, existential, and social factors and a single item evaluating the overall quality of life. The MQOL-R Korean version is an instrument that can more concisely and effectively measure the quality of life of patients with life-threatening diseases.

• Journal of Korean Academy of Nursing
• /
• v.53 no.1
• /
• pp.12-27
• /
• 2023

Purpose: This study aimed to develop a scale to measure distress in patients with ischemic stroke and verify its validity and reliability. Methods: Preliminary items were developed from literature review and in-depth interviews. The final preliminary scale was confirmed through a content validity test of eight experts and a preliminary survey of 10 stroke patients. The participants for psychometric testing were 305 stroke patients in the outpatient clinic. Validity and reliability analyses included item analysis, exploratory and confirmatory factor analysis, convergent validity, known-group validity, and internal consistency of the scale. Results: The final scale consisted of 17 items and 3 factors. The three distinct factors were 'self-deprecation, worry about future health, and withdrawal from society' and this structure was validated using a confirmatory factor analysis. Convergent validity was supported by comparison with the Center for Epidemiologic Studies Depression Scale (r = .54, p < .001) and Brief Illness Perception Questionnaire (r = .67, p < .001). Known-groups validity was verified by dividing groups according to 'duration since diagnosis' (t = 2.65, p = .009), 'presence of sequela' (t = 10.16, p < .001), and 'awareness of distress' (t = 12.09, p < .001). The internal consistency of the scale using Cronbach's α for the total items was .93. Conclusion: The Ischemic Stroke Distress Scale is a valid and reliable tool that reflects stroke distress effectively. It is expected to be used as a basic tool to develop various intervention strategies to reduce distress in ischemic stroke patients.

• The Journal of Korean Academic Society of Nursing Education
• /
• v.28 no.4
• /
• pp.357-367
• /
• 2022

Purpose: The aim of the study was to verify the validity and reliability of the Korean version of the General Attitudes towards Artificial Intelligence Scale (GAAIS-K) for nursing students. Methods: Data from 235 participants were collected from April 12 to April 26, 2022. A total of 230 participants' data were analyzed. The data were analyzed for content, discriminant, known-groups, and construct validity using content validity index, correlation coefficient, and confirmatory factor analyses. The reliability of the GAAIS-K was examined using internal consistency and test-retest analyses. Results: The expert-rated content validity index was ≥.80. The sub-scales of the GAAIS-K were moderately correlated with attitude toward accepting technology, indicative of its discriminant validity. The male students' positive attitude score was significantly higher than that of the female students, satisfying the known-groups validity. Cronbach's α for the scale was .86 (positive) and .74 (negative), and the intra-class correlation coefficient for the two-week test-retest reliability was .86 (positive) and .60 (negative). The scores for positive and negative attitudes were 3.68±0.46 and 3.05±0.55. Conclusion: This study shows that the GAAIS-K is a valid and reliable instrument for assessing nursing students. Additional research is recommended to continue the evaluation of the GAAIS-K with a focus on healthcare settings.

• The Journal of the Korea Contents Association
• /
• v.20 no.11
• /
• pp.391-401
• /
• 2020

This study verified the reliability and validity of the Korean version of the Student Career Construct Inventory(K-SCCI) that was translated into Korean language from the Student Career Construct Inventory (SCCI) developed by Savickas et al.(2018). To achieve this, this study conducted item content analysis, exploratory factor analysis, confirmatory factor analysis, and criterion-related validity in 530 university students. As a result of item content analysis and exploratory factor analysis, it was found that 4 factor models and 18 items were the most appropriate in K-SCCI. The 4 factors were named as crystallizing a vocational self-concept, exploring to gather information about occupations, deciding to commit to an occupational choic, and preparing to implement that choice. As a result of confirmatory factor analysis to verify the goodness-of-fit of the 4 factor models, it appeared to be appropriate. As a result of analyzing the correlation with related measures to verify the criterion-related validity of measures, it was found that student career construct was negatively correlated with employment anxiety but positively correlated with career adaptability.

• Journal of Advanced Navigation Technology
• /
• v.18 no.1
• /
• pp.22-28
• /
• 2014

This paper presents the design and development of ECU simulator in order to verify automatic firmware update system of ECU SW on the vehicle. We designed and developed general-proposed ECU simulator as devide into HW and SW parts. HWadopt 32bit MPU, CAN, LIN, LCD, and touch-pad button to satisfy general-proposed ECU level. And SW constructed as finite-state-machine structure in order to support HW spec. We developed ECU manager which deliveries update data to verify validity of operation. And we tested ECU simulator with ECU manager. For test of validity of ECU simulator, we set 4 scenarios between ECU simulator and manager. As the result, we confirmed validity of operation in ECU simulator for automatic SW update system.

• Journal of Korean Clinical Nursing Research
• /
• v.26 no.2
• /
• pp.175-185
• /
• 2020

Purpose: This study was performed to develop a valid and reliable Pediatric Patient Classification System (PPCS). Methods: The study was conducted in a children's hospital which included various ward settings. Content validity was analyzed by Delphi method and to verify intraclass correlation reliability, 7 nurse managers and 29 staff nurses classified 216 patients. To verify construct validity, the staff nurses classified 216 patients according to PPCS comparing differences by age, days of stay, type of stay and medical department. Results: The developed PPCS has 12 categories, 55 nursing activities and 80 criterions. High agreement among nurses (r=.90) suggested substantial reliability. Construct validity was verified by comparing differences in age, days of stay, type of stay and medical department (p<.05). The entire patient group were classified to four groups using PPCS. Conclusion: The findings suggest that PPCS would be a useful tool for estimating nursing demands related to medications and the complexity of pediatric patients.

• Journal of Korean society of Dental Hygiene
• /
• v.22 no.2
• /
• pp.93-105
• /
• 2022

Objectives: The purpose of this study was to develop operation management evaluation standards for efficient operation of practical courses conducted on campus and to verify validity and reliability. Methods: The draft evaluation criteria of this study were derived based on the CIPP program evaluation model, in order to verify the validity of the content, the Delphi survey was conducted targeting 30 dental hygiene professors and clinical field dental hygienists who had been in charge of practical education for more than 5 years. Main survey was conducted with 252 professors and clinical field dental hygienists in charge of practical education. Results: Through exploratory factor analysis, a total of 36 questions were confirmed with 7 factors. As a result of verifying the internal consistency of the final evaluation criteria, the degree of internal fit of the items in the entire domain was 0.914. Conclusions: According to the above results, the validity and reliability of the evaluation criteria for evaluating the operation and management of in-school clinical practice were verified to be appropriate, and it is thought that it can be used in follow-up studies related to the operation and management of the practice course in the future.

• Journal of the Health Care and Life Science
• /
• v.10 no.1
• /
• pp.69-80
• /
• 2022

The purpose of this study is to advanced and develop a core competency diagnosis tool that junior college students must have in order to implement competency-oriented education to nurture talents required by the future society, and to verify its validity and reliability. To this end, the existing diagnostic tools were analyzed and preliminary questions were derived through analysis of prior research, collecting opinions of members, FGI, and expert advice. A total of 46 items were derived, which were verified as content validity. Afterwards, a preliminary survey was conducted targeting 380 applicants among current students. To verify the validity of the construct, an exploratory factor analysis was performed using AMOS 18.0. As a result, 30 final questions composed of 6 core competencies were derived. The core competency diagnosis tool is expected to be actively used as a future-oriented competency education execution, evaluation, and quality management tool by diagnosing the competencies of current students.