• 한국전문물리치료학회지
• /
• 제30권4호
• /
• pp.306-313
• /
• 2023

Background: As social problems due to the acceleration of the aging era and the increase in the elderly population are becoming serious, virtual reality (VR)-based healthcare is emerging as an approach for preventing and managing health issues. Objects: This study used validity and reliability analyses to examine the clinical efficacy that is, the clinical value and usability of a novel VR cognitive evaluation system index that we developed. Methods: We developed a VR cognitive evaluation system based on motion recognition analysis evaluation for individuals aged 65 to 85. After conducting the Korean version of the Mini-Mental State Exam (K-MMSE) cognitive evaluation, the evaluation score was verified through correlation analysis in the VR cognitive evaluation system. To verify the construct validity of the two groups, the Global Deterioration Scale (GDS) grades were categorized into a normal cognitive group (GDS grade 1) and a cognitive impairment group (GDS grades 2 and 3). The data were measured twice to determine the reliability between the two measurements and assess the stability and clinical value of the evaluation system. Results: Our evaluation system had a high correlation of 0.85 with the widely used K-MMSE cognitive evaluation. The system had strong criterion-related validity at the 95% confidence interval. Compared to the average score of GDS grade 1 in the VR cognitive evaluation system, the average score of GDS grades 2 and 3 in the VR cognitive evaluation system was statistically significantly lower while also having strong construct validity at the 95% confidence interval. To measure the reliability of the VR cognitive evaluation system, tests-retests were conducted using the intraclass correlation coefficient (3,1), which equaled 0.923 and was statistically significant. Conclusion: The VR cognitive evaluation system we developed is a valid and reliable clinical tool to distinguish between normal cognitive status and mild cognitive impairment.

• 조명전기설비학회논문지
• /
• 제17권4호
• /
• pp.1-7
• /
• 2003

본 연구의 목적은 야간경관조명의 다양한 조명기법을 대상으로 컴퓨터 시뮬레이션을 통한 이미지 예측실험을 통해 조명기법별 평가특성을 분석하기 위한 기초연구로서 현장실험을 기준으로 물리량 및 주관 평가의 유효성을 검증하는데 있다. 연구는 우선 예비실험을 통해 선정된 평가어휘를 바탕으로 현장실험의 실험조건별 사진촬영과 물리량 측정 및 주관평가를 수행하여 조명 해석 프로그램에서 계산된 물리량과, 현장 실험에서 측정된 물리량을 비교하였으며 각각의 주관평가 결과를 가지고 현장과 CG, 현장과 사진에 대한 유효성을 검증하였다. 연구결과 1) 물리량의 유효성 검증결과 유의차가 5% 내외로 유의차가 없었으며 2) 현장실험과 CG, 현장실험과 사진실험의 주관평가 유효성 검증 결과 일부 항목을 제외한 대부분의 항목에서 유의차가 없는 것으로 나타났다.

• 상하수도학회지
• /
• 제29권5호
• /
• pp.583-590
• /
• 2015

Evaluation and comparison for the performance on the contracting-out became possible after the introduction of the performance indicators(PIs) in 2012 in Korea, And local governments and private companies are utilizing them as evaluation data to enhance the performance of the contracting-out. Several revisions on performance indicator were carried out by expert group on contents validity of PIs, But the review of the composition validity of PIs was not sufficient. In this study, the applicability, distinction ability and composition validity of PIs is evaluated by statistical method. From the results, Improvement of indicator is required in order to increase the interrelationship among indicators to enhance the compostion validity of indicators related with operation, sludge and water reuse.

• 보건행정학회지
• /
• 제13권4호
• /
• pp.1-27
• /
• 2003

The purpose of this study was to develop the evaluation indicator for the health promotion programs of the Community Health Centers and to test its validity. The modified logic model was used as the evaluation model based on the literature reviews. Using this model, four dimensions, eleven sub­dimensions, and forty­one individual indicators were developed. These evaluation indicators are superior in reflecting the distinctiveness of the community health promotion programs, and also flexible enough to accommodate diverse programs. These indicators also emphasize the role of process evaluation, and the diversity of outcomes. To test content validity, survey method of experts in the community health promotion field was conducted. Eleven in three expert groups(professionals, practitioners in Community Health Centers, and policy makers) generally agreed with the validity of evaluation indicators. To examine criteria and construct validity, these indicators were used to evaluate the health promotion programs conducted by the 18 Key Community Health Centers. The data came from the interview surveys of the main health promotion practitioner and 30 visitors from each center. The ranks of these eighteen Community Health Centers were computed from these data. There was no significant difference in ranking either by these indicators or by the existing indicators, which was developed by Technical Support and Evaluation Team for criteria validity. There was no statistically significant difference in ranking between input, process and outcome dimensions. Based on these study results, evaluation indicators developed in this study are valid to evaluate Community Health Center's health promotion program. It can be used both by the Community Health Center for internal evaluation, and by the stakeholders for external evaluation.

• 대한영양사협회학술지
• /
• 제15권4호
• /
• pp.364-382
• /
• 2009

The purposes of this study were to develop the standard indicators to evaluate the food and nutrition systems in hospitals and to test the validity of those items scientifically. The results were as follows: First, the conceptual validity was examined with recognition degrees of importance from the hospital nutrition department managers. All of the hospital nutrition department's operation evaluation standards and the indicators' conceptual validity tested were in the range of 3.71~4.93 out of 5.0, and the mean score was 4.36. Therefore, the conceptual validity was verified. Second, to verify the factor validity of the items of the standards and indicators for the hospital nutrition department's operation evaluation, the standards and indicators were analyzed as key-factors. Key-factor analysis after vertical rotation showed that four factors appeared and were composed of (a) facilities management, (b) sanitation management, (c) operation & foodservice management, and (d) nutrition management. Third, the reliability of the standards and indicators for the hospital nutrition department's operation evaluation was analyzed and resulted in a score of 0.98, which showed good internal consistency. Fourth, the discriminative power of each item of the standards for the hospital nutrition department's operation evaluation was tested by checking the differences between groups with first quartile and forth quartile of total evaluation scores. The indicators having low distinction power were modified into obligatory items or eliminated for better differentiation.

• 공학교육연구
• /
• 제16권3호
• /
• pp.28-41
• /
• 2013

The purpose of this study was to develop the Meta-Evaluation Criteria which can comprehensively and systematically evaluate and improve the Accreditation Evaluation System for Engineering Education. This will provide useful implications for establishing value, direction, and improvement remedy for Engineering Educations Accreditation System of Korea. In order to achieve the purpose of this study, Meta-Evaluation Criteria was developed to comprehensively and systematically assess and analyze the Accreditation Evaluation System of Engineering Education. The research methodology used to study these subjects: literature review, interviews with experts, Delphi survey (three times), survey, analysis of narrative opinion and secondary source. The results and conclusions of this study can be summarized as follows: First, the final Meta-Evaluation Criteria were developed so as to comprehensively and systematically assess and analyze the Accreditation Evaluation System of Engineering Education. The criteria's validity and reliability were also identified. Specific details are as follows: In a draft plan of the Meta-Evaluation Criteria, Meta-Evaluation concept was defined as evaluation on the whole range of Accreditation Evaluation System of Engineering Education. Meta-Evaluation Criteria was designed to be based on a systematic approach and applies the phased approach to the lower component to reflect evaluation's characteristics. Then validity and reliability of the developed draft plan was verified by calculating Content Validity Ratio (CVR), Degree of Consensus, Degree of Convergence and Cronbach's alpha. The final developed Meta-Evaluation Criteria obtaining validity and reliability were composed of 5 evaluation areas (environment, input, performance, result, utilization), 15 evaluation items, 68 evaluation indicators.

• 대한한의학회지
• /
• 제29권1호
• /
• pp.7-14
• /
• 2008

Purpose : The purpose of study was to develop generalized validity evaluation methods and terms for Sasang type diagnostic tests. Methods : A generalized statistical evaluation model for Sasang typology was suggested and generalized validity evaluation indices were proposed with this model. Results : The usefulness of validity evaluations, such as sensitivity and specificity values, were confirmed by the systematic review of the data from previously reported studies. Conclusion :Major obstacles in the multi-facet analysis and systematic review for Sasang type diagnostic tests were discussed with this test validity study.

• 한국간호교육학회지
• /
• 제4권2호
• /
• pp.172-186
• /
• 1998

This study is intended to develop a reliable and approproate instrument of the clinical nursing education. This research consisted of 4 step. First step is contruction of the content for evaluation. Second step have the research of the content validity by 10 professors in Department of Nursing, H University, the pilot study for the content validity by 20 professors and clinical preceptors, and the survey with four point Likert Scale, which includes from the point of 'strongly valid' to the point of 'strongly non-valid' by 250 professor and clinical preceptor. The data were collected form March 1998 to July 1998. This study was analyzed by Cronbach's for the reliability and the factor analyisis for the validity of the collected data. The third step showed the final evaluation instrument of clinical nursing education which consists a couple of tool. One is the evaluation instrument of clinical nursing which includes the 20 items, the other is the evaluation instrument for case study which includes the 15 items. The fourth step is the test of reliability and validity of the final evaluation too. The results from these step's study showed the higher reliability and validity. Respectly, Cronbach's revealed the evaluation instrument of clinical nursing and case study is Cronbach's $\alpha$=.92413, Cronbach's $\alpha$=.95602. For further research, it needs to develop a reliable and variable instrument of the students self-evaluation and community based instrument.

• 대한치과기공학회지
• /
• 제30권1호
• /
• pp.73-82
• /
• 2008

This study has been analyzed to write an ideal training evaluation table after analyzing validity of content organization and assigning score of evaluating elements of clinical practice of Dept. of dental technology. 220 junior students who are studying dental technology in D university in Daegu were questioned to analyze the relationship of content organization and score of clinical practice evaluation table. The corrected material has been inspected by SAS V8 for Windows. The results are as following. 1. The validity of content organization of clinical practice evaluation table has a result which can be reliable over than 70% but the validity of score shows low reliance. c 2. The validity of content organization of detail elements of clinical practice evaluation shows that overuse of material and attentiveness(3.78) and responsibility (3.60) are high response but in score organization, the validity shows that safety measure(2.36) when controling machines, arrangement(2.98) after use and ability (2.98) of solving problems are very low. 3. In the elements without interpersonal relation, it shows that those are related to each other. its grading is p < 0.01 so it appears to be meaningful. 4. In result of analyzing the effect to 'studying amount' mark in clinical practice evaluation mark, it appears the element of attitude for job to affect it. And in result of analyzing the effect to 'training attitude' mark, it appears the element of 'controling machines' to affect it. For these results, to be a better evaluation tool, it should be modified by continuous research with arranging evaluation elements to be marked differently in between elements.

• 대한물리의학회지
• /
• 제11권2호
• /
• pp.103-114
• /
• 2016

PURPOSE: The purpose of this study was first to develop a Korean version of pediatric functional muscle testing for children with a motor developmental disorder who have a communication problem and who are aged below five years, and also to verify the content validity. METHODS: First, the preliminary study was conducted to verify the reliability of pediatric functional muscle testing, developed by Venita in Korea. Based on the results of the study, the primary evaluation items were selected and modified. Second, the first test of content validity was conducted through a panel discussion, and a second investigation of content validity was carried out by utilizing the Item Content Validity Index (I-CVI). In this study, we selected only 0.78 or more items from I-CVI. RESULTS: Based on the results of the preliminary study, 19 primary evaluation items were selected. Based on the results of the first and second content validity tests, 15 tertiary evaluation items for the Korean version of pediatric functional muscle testing were determined. CONCLUSION: This study developed a new Korean version of pediatric functional muscle testing and suggested that it will be a useful tool to measure muscle strength for Korean children with a motor developmental disorder and a communication problem, aged below five years.