• Physical Therapy Korea
• /
• v.30 no.4
• /
• pp.306-313
• /
• 2023

Background: As social problems due to the acceleration of the aging era and the increase in the elderly population are becoming serious, virtual reality (VR)-based healthcare is emerging as an approach for preventing and managing health issues. Objects: This study used validity and reliability analyses to examine the clinical efficacy that is, the clinical value and usability of a novel VR cognitive evaluation system index that we developed. Methods: We developed a VR cognitive evaluation system based on motion recognition analysis evaluation for individuals aged 65 to 85. After conducting the Korean version of the Mini-Mental State Exam (K-MMSE) cognitive evaluation, the evaluation score was verified through correlation analysis in the VR cognitive evaluation system. To verify the construct validity of the two groups, the Global Deterioration Scale (GDS) grades were categorized into a normal cognitive group (GDS grade 1) and a cognitive impairment group (GDS grades 2 and 3). The data were measured twice to determine the reliability between the two measurements and assess the stability and clinical value of the evaluation system. Results: Our evaluation system had a high correlation of 0.85 with the widely used K-MMSE cognitive evaluation. The system had strong criterion-related validity at the 95% confidence interval. Compared to the average score of GDS grade 1 in the VR cognitive evaluation system, the average score of GDS grades 2 and 3 in the VR cognitive evaluation system was statistically significantly lower while also having strong construct validity at the 95% confidence interval. To measure the reliability of the VR cognitive evaluation system, tests-retests were conducted using the intraclass correlation coefficient (3,1), which equaled 0.923 and was statistically significant. Conclusion: The VR cognitive evaluation system we developed is a valid and reliable clinical tool to distinguish between normal cognitive status and mild cognitive impairment.

• Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
• /
• v.17 no.4
• /
• pp.1-7
• /
• 2003

This is basic study for analyzing the character of the evaluation according to the ways of exterior lighting through the image prediction experiment by computer simulation. The aim of this research is to verify the validity of physical quantity & subjective evaluation on the basis of Online experiment. The following carried out the experiment procedure by conditions of Online experiment, 1) to make a photo of Online experirrent, 2) to measure physical quantity of luminance, and 3) to do subjective evaluation in Online experiment by means of vocabulary of the evaluation through preparation experiment. Then to verify the validity of Online and CG experiment, Online and photo experiment with each subjective evaluation results. The result of this study is that the validity difference is within 5% in the verification the validity of the physic amount, which showed little difference. While in verification of subjective evaluation of online and CG, online and photo experiment, the result is showed little difference as well except a little the item.

• Journal of Korean Society of Water and Wastewater
• /
• v.29 no.5
• /
• pp.583-590
• /
• 2015

Evaluation and comparison for the performance on the contracting-out became possible after the introduction of the performance indicators(PIs) in 2012 in Korea, And local governments and private companies are utilizing them as evaluation data to enhance the performance of the contracting-out. Several revisions on performance indicator were carried out by expert group on contents validity of PIs, But the review of the composition validity of PIs was not sufficient. In this study, the applicability, distinction ability and composition validity of PIs is evaluated by statistical method. From the results, Improvement of indicator is required in order to increase the interrelationship among indicators to enhance the compostion validity of indicators related with operation, sludge and water reuse.

• Health Policy and Management
• /
• v.13 no.4
• /
• pp.1-27
• /
• 2003

The purpose of this study was to develop the evaluation indicator for the health promotion programs of the Community Health Centers and to test its validity. The modified logic model was used as the evaluation model based on the literature reviews. Using this model, four dimensions, eleven sub­dimensions, and forty­one individual indicators were developed. These evaluation indicators are superior in reflecting the distinctiveness of the community health promotion programs, and also flexible enough to accommodate diverse programs. These indicators also emphasize the role of process evaluation, and the diversity of outcomes. To test content validity, survey method of experts in the community health promotion field was conducted. Eleven in three expert groups(professionals, practitioners in Community Health Centers, and policy makers) generally agreed with the validity of evaluation indicators. To examine criteria and construct validity, these indicators were used to evaluate the health promotion programs conducted by the 18 Key Community Health Centers. The data came from the interview surveys of the main health promotion practitioner and 30 visitors from each center. The ranks of these eighteen Community Health Centers were computed from these data. There was no significant difference in ranking either by these indicators or by the existing indicators, which was developed by Technical Support and Evaluation Team for criteria validity. There was no statistically significant difference in ranking between input, process and outcome dimensions. Based on these study results, evaluation indicators developed in this study are valid to evaluate Community Health Center's health promotion program. It can be used both by the Community Health Center for internal evaluation, and by the stakeholders for external evaluation.

• Journal of the Korean Dietetic Association
• /
• v.15 no.4
• /
• pp.364-382
• /
• 2009

The purposes of this study were to develop the standard indicators to evaluate the food and nutrition systems in hospitals and to test the validity of those items scientifically. The results were as follows: First, the conceptual validity was examined with recognition degrees of importance from the hospital nutrition department managers. All of the hospital nutrition department's operation evaluation standards and the indicators' conceptual validity tested were in the range of 3.71~4.93 out of 5.0, and the mean score was 4.36. Therefore, the conceptual validity was verified. Second, to verify the factor validity of the items of the standards and indicators for the hospital nutrition department's operation evaluation, the standards and indicators were analyzed as key-factors. Key-factor analysis after vertical rotation showed that four factors appeared and were composed of (a) facilities management, (b) sanitation management, (c) operation & foodservice management, and (d) nutrition management. Third, the reliability of the standards and indicators for the hospital nutrition department's operation evaluation was analyzed and resulted in a score of 0.98, which showed good internal consistency. Fourth, the discriminative power of each item of the standards for the hospital nutrition department's operation evaluation was tested by checking the differences between groups with first quartile and forth quartile of total evaluation scores. The indicators having low distinction power were modified into obligatory items or eliminated for better differentiation.

• Journal of Engineering Education Research
• /
• v.16 no.3
• /
• pp.28-41
• /
• 2013

The purpose of this study was to develop the Meta-Evaluation Criteria which can comprehensively and systematically evaluate and improve the Accreditation Evaluation System for Engineering Education. This will provide useful implications for establishing value, direction, and improvement remedy for Engineering Educations Accreditation System of Korea. In order to achieve the purpose of this study, Meta-Evaluation Criteria was developed to comprehensively and systematically assess and analyze the Accreditation Evaluation System of Engineering Education. The research methodology used to study these subjects: literature review, interviews with experts, Delphi survey (three times), survey, analysis of narrative opinion and secondary source. The results and conclusions of this study can be summarized as follows: First, the final Meta-Evaluation Criteria were developed so as to comprehensively and systematically assess and analyze the Accreditation Evaluation System of Engineering Education. The criteria's validity and reliability were also identified. Specific details are as follows: In a draft plan of the Meta-Evaluation Criteria, Meta-Evaluation concept was defined as evaluation on the whole range of Accreditation Evaluation System of Engineering Education. Meta-Evaluation Criteria was designed to be based on a systematic approach and applies the phased approach to the lower component to reflect evaluation's characteristics. Then validity and reliability of the developed draft plan was verified by calculating Content Validity Ratio (CVR), Degree of Consensus, Degree of Convergence and Cronbach's alpha. The final developed Meta-Evaluation Criteria obtaining validity and reliability were composed of 5 evaluation areas (environment, input, performance, result, utilization), 15 evaluation items, 68 evaluation indicators.

• The Journal of Korean Medicine
• /
• v.29 no.1
• /
• pp.7-14
• /
• 2008

Purpose : The purpose of study was to develop generalized validity evaluation methods and terms for Sasang type diagnostic tests. Methods : A generalized statistical evaluation model for Sasang typology was suggested and generalized validity evaluation indices were proposed with this model. Results : The usefulness of validity evaluations, such as sensitivity and specificity values, were confirmed by the systematic review of the data from previously reported studies. Conclusion :Major obstacles in the multi-facet analysis and systematic review for Sasang type diagnostic tests were discussed with this test validity study.

• The Journal of Korean Academic Society of Nursing Education
• /
• v.4 no.2
• /
• pp.172-186
• /
• 1998

This study is intended to develop a reliable and approproate instrument of the clinical nursing education. This research consisted of 4 step. First step is contruction of the content for evaluation. Second step have the research of the content validity by 10 professors in Department of Nursing, H University, the pilot study for the content validity by 20 professors and clinical preceptors, and the survey with four point Likert Scale, which includes from the point of 'strongly valid' to the point of 'strongly non-valid' by 250 professor and clinical preceptor. The data were collected form March 1998 to July 1998. This study was analyzed by Cronbach's for the reliability and the factor analyisis for the validity of the collected data. The third step showed the final evaluation instrument of clinical nursing education which consists a couple of tool. One is the evaluation instrument of clinical nursing which includes the 20 items, the other is the evaluation instrument for case study which includes the 15 items. The fourth step is the test of reliability and validity of the final evaluation too. The results from these step's study showed the higher reliability and validity. Respectly, Cronbach's revealed the evaluation instrument of clinical nursing and case study is Cronbach's $\alpha$=.92413, Cronbach's $\alpha$=.95602. For further research, it needs to develop a reliable and variable instrument of the students self-evaluation and community based instrument.

• Journal of Technologic Dentistry
• /
• v.30 no.1
• /
• pp.73-82
• /
• 2008

This study has been analyzed to write an ideal training evaluation table after analyzing validity of content organization and assigning score of evaluating elements of clinical practice of Dept. of dental technology. 220 junior students who are studying dental technology in D university in Daegu were questioned to analyze the relationship of content organization and score of clinical practice evaluation table. The corrected material has been inspected by SAS V8 for Windows. The results are as following. 1. The validity of content organization of clinical practice evaluation table has a result which can be reliable over than 70% but the validity of score shows low reliance. c 2. The validity of content organization of detail elements of clinical practice evaluation shows that overuse of material and attentiveness(3.78) and responsibility (3.60) are high response but in score organization, the validity shows that safety measure(2.36) when controling machines, arrangement(2.98) after use and ability (2.98) of solving problems are very low. 3. In the elements without interpersonal relation, it shows that those are related to each other. its grading is p < 0.01 so it appears to be meaningful. 4. In result of analyzing the effect to 'studying amount' mark in clinical practice evaluation mark, it appears the element of attitude for job to affect it. And in result of analyzing the effect to 'training attitude' mark, it appears the element of 'controling machines' to affect it. For these results, to be a better evaluation tool, it should be modified by continuous research with arranging evaluation elements to be marked differently in between elements.

• Journal of the Korean Society of Physical Medicine
• /
• v.11 no.2
• /
• pp.103-114
• /
• 2016

PURPOSE: The purpose of this study was first to develop a Korean version of pediatric functional muscle testing for children with a motor developmental disorder who have a communication problem and who are aged below five years, and also to verify the content validity. METHODS: First, the preliminary study was conducted to verify the reliability of pediatric functional muscle testing, developed by Venita in Korea. Based on the results of the study, the primary evaluation items were selected and modified. Second, the first test of content validity was conducted through a panel discussion, and a second investigation of content validity was carried out by utilizing the Item Content Validity Index (I-CVI). In this study, we selected only 0.78 or more items from I-CVI. RESULTS: Based on the results of the preliminary study, 19 primary evaluation items were selected. Based on the results of the first and second content validity tests, 15 tertiary evaluation items for the Korean version of pediatric functional muscle testing were determined. CONCLUSION: This study developed a new Korean version of pediatric functional muscle testing and suggested that it will be a useful tool to measure muscle strength for Korean children with a motor developmental disorder and a communication problem, aged below five years.