• 한국전문물리치료학회지
• /
• 제30권4호
• /
• pp.306-313
• /
• 2023

Background: As social problems due to the acceleration of the aging era and the increase in the elderly population are becoming serious, virtual reality (VR)-based healthcare is emerging as an approach for preventing and managing health issues. Objects: This study used validity and reliability analyses to examine the clinical efficacy that is, the clinical value and usability of a novel VR cognitive evaluation system index that we developed. Methods: We developed a VR cognitive evaluation system based on motion recognition analysis evaluation for individuals aged 65 to 85. After conducting the Korean version of the Mini-Mental State Exam (K-MMSE) cognitive evaluation, the evaluation score was verified through correlation analysis in the VR cognitive evaluation system. To verify the construct validity of the two groups, the Global Deterioration Scale (GDS) grades were categorized into a normal cognitive group (GDS grade 1) and a cognitive impairment group (GDS grades 2 and 3). The data were measured twice to determine the reliability between the two measurements and assess the stability and clinical value of the evaluation system. Results: Our evaluation system had a high correlation of 0.85 with the widely used K-MMSE cognitive evaluation. The system had strong criterion-related validity at the 95% confidence interval. Compared to the average score of GDS grade 1 in the VR cognitive evaluation system, the average score of GDS grades 2 and 3 in the VR cognitive evaluation system was statistically significantly lower while also having strong construct validity at the 95% confidence interval. To measure the reliability of the VR cognitive evaluation system, tests-retests were conducted using the intraclass correlation coefficient (3,1), which equaled 0.923 and was statistically significant. Conclusion: The VR cognitive evaluation system we developed is a valid and reliable clinical tool to distinguish between normal cognitive status and mild cognitive impairment.

• 한국간호교육학회지
• /
• 제22권1호
• /
• pp.5-13
• /
• 2016

Purpose: The purpose of this study is to provide essential resources on various evaluation strategies by identifying relationships between professor-evaluation, peer-evaluation, and self-evaluation of the core basic nursing skills in nursing students. Methods: Forty third-year nursing students who participated in core basic nursing skills were given the same checklist that was used for assessment by the examiners. Then, the scores of the professor and the students were compared and analyzed with SPSS/WIN 18.0. Results: The scores of the student peer (178.54) and student self-evaluation(177.74) was significantly higher than the scores of professor-evaluation (172.05),(F=5.03, p=.008). There was a significant, positive correlation between the professor-evaluation and the student-peer-evaluation in skill-scores(r=.47, p=.002) and attitude-scores(r=.52, p<.001). In addition, the professor-evaluation and the self-evaluation each showed a significant, positive correlation in skill-scores(r=.61, p<.001) and attitude-scores(r=.36, p=.023). Conclusion: The study result indicates that in order to expand the evaluation method, the professor evaluation, as well as the student self and the peer evaluation, will contribute to improve the educational achievement of learners.

• 한국정보관리학회:학술대회논문집
• /
• 한국정보관리학회 2002년도 추계학술발표논집
• /
• pp.23-65
• /
• 2002

This study is to consider varying factors of internal/external informational and operational environments in libraries, and develop a new evaluation indicators for university libraries in digital environments. In order to do this research, the previous works have been investigated, and the Delphi study and our own analysis have been performed. The main research results are as follows. First, the results through the Delphi method that was to adopted to verify evaluation items and indicators determined by the literature review show that the repressed values for each evaluation category is greater than 3.00. overall average is 4.02. and standard deviation is ranged from 0.40 to 0.62 for each category. This means that the evaluation indicators are valid. Second, the factor analysis was performed to verify the construct validity of evaluation indicators. As a result. the cumulative variance of evaluation indicators consisting of 11 dimensions per factor is 72.733%. In turn, this result shows that the validity of these indicators is very reliable. Third, t-test and one way ANOVA are performed within significance probability 0.05 in order to verify differences in each librarians point of views for the degree of importance in evaluation indicators. The results show that these evaluation indicators are verified to be appropriate since there is no significant difference. Based on the Delphi study and our own analysis. we developed a new evaluation indicators that consists of 7 evaluation categories, 35 evaluation items, and 92 evaluation indicators.

• International Journal of Knowledge Content Development & Technology
• /
• 제14권2호
• /
• pp.99-139
• /
• 2024

In this study, the library ESG evaluation indicators specialized for libraries were developed, and based on which, a survey was conducted targeting the actual libraries to evaluate the ESG level of libraries. As a result of the study, first, among the ESG evaluation indicators, the indicators of the social field and the governance field are demonstrating high in which field of the library's ESG evaluation indicators will appear the highest. The social area's high score of 3.70 seems to be because the protection of users' rights, occupational safety, and contribution to society and the local community are very closely related to the original role of the library. Second, it may be seen that there is a difference between the questions in the corporate governance part, while the averages are the same. In the case of library's cooperation, it turned out that it was 3.94 in the necessity evaluation of the evaluation indicators, but it was lowered to 3.61 in the actual library situation evaluation. Meanwhile, in connection with the activities of the director of library and the board of directors, it may be seen that the index evaluation increased from 3.32 to 3.58 in the actual evaluation.

• Journal of Yeungnam Medical Science
• /
• 제40권3호
• /
• pp.233-240
• /
• 2023

The purpose of this study aims to analyze research trends related to 'evaluation' in Korean medical education through a systematic review. This study used a systematic review method, which is a research methodology for research trends and 'literature analysis.' Researchers searched the Korean journal literature published until the end of December 2020 in the Korean research database with keywords related to medicine and evaluation. Thus, 5,205 cases were identified. Based on these data, 143 papers were selected through a logical screening process, requiring 1 month to complete the data search and analysis process. In terms of publications, medical journals overwhelmingly outnumbered nonmedical journals until 2015; however, after 2016, the number of papers published in nonmedical journals increased, and the number of published papers was similar to that of medical journals. In terms of evaluation-related research, research on student and program evaluations has been very active compared to that on accreditation. As the number of evaluation studies has gradually decreased over the past 10 years, preparing a plan to revitalize them in Korean medical education is necessary. Considering that the role of evaluation in education has been emphasized in recent years, research on reestablishing the concept of evaluation; developing evaluation indicators; analyzing the status of student evaluation, program evaluation, and accreditation; and deriving measures to improve medical education through evaluation is required.

• Journal of Information Technology Applications and Management
• /
• 제16권1호
• /
• pp.77-96
• /
• 2009

The balanced scorecard has drawn attention from many researchers in various fields since its appearance in 1992. It became a norm for performance evaluation framework in many areas, such as marketing, information system evaluation, strategic planning, etc. Centered in the large companies in Korea, the balanced scorecard has been popularly used as a performance evaluation tool for human resource management. Now we Question its applicability to performance evaluation tool even in small business. This study tried to apply the balanced scorecard in developing an information system for performance evaluation in a small business. The study showed that the balanced scorecard can be nicely used in small business as a performance evaluation tool. The process of developing an information system is described in detail. The practitioners are to obtain a lot of insights in designing their human resource management systems from the study results.

• Journal of Information Technology Applications and Management
• /
• 제9권3호
• /
• pp.31-46
• /
• 2002

The objective of this paper is to develop an evaluation model for pilot informatization projects. There are relatively many researches on evaluation models for information systems. These previous researches, however, lack of comprehensive view of informatization Projects and pilot systems. We apply and test a hybrid evaluation model for to measure the success of pilot informatization projects. A user satisfaction model has been used and hypotheses are developed to find relationships of evaluation factors. The hypotheses have been tested with 51 user surveys. The result of this research can give an insight for the evaluation of pilot informatization projects.

• 한국IT서비스학회지
• /
• 제3권1호
• /
• pp.117-126
• /
• 2004

In this study an evaluation method is proposed, with the strong relationship between the ante and post audit works evaluation. The ante evaluation does in general and systematic ways, with past audit results and proposals. The criteria-based evaluation is used for the audit activities and outputs. The critical success factors for the projects applies to the activities evaluation and product evaluation framework to the output. The ante and post evaluation have the cross evaluation items to be the whole and continuous one. Eighteen common evaluation items are derived, with their own evaluation elements in detail, which have only differences of the actually done and expectations between the ante and post. The proposed evaluation makes the ante and post one to be related with each other in a systematic and objective ways, to enhance the reliability of audit results and effectiveness of the audit.

• 기술혁신연구
• /
• 제13권3호
• /
• pp.175-196
• /
• 2005

This Paper examines analytic studies of the evaluation system used for evaluating government-supported R&D Institutes (GSRIs), and designs a new model for analyzing the evaluation system's effectiveness. The analytic models in existing studies use the meta evaluation and balanced scorecard (BSC) models. However, theses studies focused on the structure and elements of the evaluation system for examples, the appropriateness of the elements within the evaluation system and the balance of the evaluation index. Accordingly, the effectiveness of the GSRI evaluation system, that is, the evaluation's influence on GSRI performance improvement was not analyzed. This study uses the institution theory and contingency theory perspectives as related to government organization management to develop an analytical model of GSRI evaluation system effectiveness. The new model proposes an analytical approach for improving the effectiveness of the GSRI evaluation system in an institutionalized environment.

• 한국응급구조학회지
• /
• 제24권3호
• /
• pp.41-53
• /
• 2020

Purpose: This study tests the validity of a standard evaluation tool of ambulance ride practices with new evaluation items and supports its application by 119 preceptors. Methods: We tested the validity of standard evaluation items collected from 19 on-site professionals assessing ambulance ride practices. New evaluation items, 'understanding of emergency rescue equipment' and 'ability to communicate', were added as additional criteria. The modified Delphi technique was used to test the three evaluation areas and ten evaluation items. We used the analytic hierarchy process to analyze the weighting value of the reconstructed evaluation tool model. Results: All three evaluation areas and 10 evaluation items within the standard evaluation tools used for ambulance ride practices corresponded with the consistency index, degree of convergence, and agreement in the modified Delphi panel. Conclusion: These results provide evidence of the consistency and usefulness behind preceptors' use of this standard evaluation tool in ambulance ride practice.