• Journal of National Security and Military Science
• /
• s.8
• /
• pp.383-420
• /
• 2010

This article is focusing on the improvement of weapon system test & evaluation, aimed at the weapon system in the research development stage. This article suggests improvement directions in three aspects(organization and system, skilled manpower and technology, test facilities of weapon system test & evaluation) as follows. 1) Weapon system test & evaluation organization and system a. Establishment of comprehensive test & evaluation system b. Making regulation for comprehensive test infrastructure management. c. Standardization of test & evaluation process, which can be used in special subject to army, navy and air force. 2) Skilled manpower and technology of weapon system test & evaluation a. Training & education, management of test & evaluation experts. b. Establishment of skill management system of test & evaluation. 3) Test facilities of weapon system test & evaluation a. Establishment of comprehensive improvement direction of test & evaluation installation and equipment. b. Consideration of counter measures to prevent overlapping investment, and to use the test & evaluation resources efficiently. c. Establishment of organic network for the effective use of test & evaluation installation and equipment. d. Establishment of detailed cooperation plan for the commonage of test & evaluation facility and equipment.

• International Journal of Highway Engineering
• /
• v.14 no.6
• /
• pp.75-84
• /
• 2012

PURPOSES : This paper aims to improve the evaluation method of the Level of Service(LOS) for urban streets presented by the current Korean Highway Capacity Manual(KHCM) and suggest its utilization plan as a part of the methods to evaluate the sustainability of a transportation policy. METHODS : This paper carried out a research in 3 steps to develop a new evaluation method. First of all, this paper reviewed the previous studies related to the LOS of urban streets and the socially requested items for a sustainable transportation system. Then this paper derived an index and weight through expert questions to select an evaluation index. Lastly, this paper compared the results according to the existing evaluation methods with the new evaluation methods through case studies. This paper used an Analytic Hierarchy Process(AHP) for importance analysis and weight selection between new evaluation items and indices, and applied a Grey System Theory(GST) for a synthetic and integrated evaluation between the selected evaluation indices. RESULTS : As a result of evaluating the LOS according to the existing evaluation methods and the integrated evaluation methods using a GST through case studies, it was analyzed that new methods' results are less than or equal to the existing evaluation methods; and as a result of applying a weight between evaluation indices according to AHP, it was noticed that the total score seems to rise more when the LOS in the existing evaluation is calculated lower. It was analyzed that the LOS calculated by reflecting the newly established evaluation items and the importance between indices in this study has difference from the LOS of the existing urban streets. CONCLUSIONS : It is expected that this evaluation method can diagnose the current conditions when establishing a future sustainable traffic system and can be used for the measurement of the sustainability effects of the improvement plans and so on.

• Journal of the Ergonomics Society of Korea
• /
• v.18 no.3
• /
• pp.55-72
• /
• 1999

Evaluation of user interfaces has to be performed in an intuitive and subjective manner by experts especially when the problem comes to the complexity and consistency of sophisticated interface procedures. The manual analysis and evaluation of logical interfaces also tends to be slow and laborious. To make the evaluation more formal and objective, the criteria and the procedure with which the evaluation can proceed must be explicitly prescribed. Furthermore, to make the formal procedure as practical as subjective expert evaluation, the criteria must reflect the user knowledge of the target tasks since the task knowledge plays the role of a basis for users to understand the interface organizations and procedures. This paper describes ESTIM, a support system for task-based evaluation of user interface, that includes the interface evaluation criteria and implies an evaluation procedure. The support system can be used either in an interactive manner by the analyst during the evaluation or in an automatic evaluation mode. It was verified that the result of automatic evaluation by ESTIM matched the results of expert evaluation fairly well.

• Journal of Engineering Education Research
• /
• v.20 no.4
• /
• pp.38-50
• /
• 2017

The purpose of this study is to analyze the current evaluation methods on faculty performance at Korean engineering colleges and develop teaching evaluation indicators for faculty performance. We investigated the faculty performance cases in engineering colleges inside and outside of the Korea, the engineering faculty's awareness of evaluation factors for their educational performance, and the appropriate ratios by indicating factors. Also we developed evaluation indicators for educational achievements to improve the current faculty performance system. 227 engineering faculty members answered our survey questionnaire. The result in the case study on faculty performance evaluation is as follows. First, most items of faculty performance evaluation are about quantitative indicators that can easily conduct objective evaluation. Second, evaluation items of faculty performance are mostly focused on instruction in a classroom. Third, the evaluation by students and administrative managers is more dominant than that by professors or their colleagues, document evaluation than on site evaluation, general evaluation than formative evaluation, and static evaluation than dynamic evaluation. Lastly, Some universities tend to substitute outstanding articles for underperforming instruction. The evaluation indicators that we have developed can be implemented by four types of subjects, such as students, professors, their colleagues, and deans. Also, based on the evaluation indicators, faculties can freely select their evaluation domains depending on the their tracks, such as a teaching track, a research track, or an industry-university cooperation track. The mandatory evaluation fields include teaching, student counselling, teaching portfolio evaluation by mentors or colleagues, class management evaluation by deans, and self-evaluation. The other areas are optional and professors can choose their evaluation factors.

• Journal of Korean Academy of Nursing
• /
• v.14 no.2
• /
• pp.5-11
• /
• 1984

The main purpose of this study were; to determine the reliability and validity of evaluation tool administered to the nursing student in nursing management practice,；to identify the effective evaluation method of nursing student in nursing management practice. The subjects were 46 senior nursing students at Department of Nursing, College of Medicine, Seoul National University in 1983. The evaluation tool was analyzed according to evaluation method; self-evaluation. and head nurse evaluation. Also individual item of evaluation tool was analyzed by item analysis in order to determine the evaluation area, and appropriateness of the test item used. A Summary of the results is as follows; 1. The reliability and validity of evaluation tool were relatively high both in self-evaluation and head nurse evaluation. 2. In comparison of mean scores, there is no significant difference between head nurse evaluation and self-evaluation. 3. The nursing management activities which have the correlation of self-evaluation and head nurse evaluation were in the activity of interpersonal relation, independent activity and implementing nursing process. In general nursing practice and unit management activity, there was no correlation of self-evaluation and head nurse evaluation.

• Journal of Korean Society for Quality Management
• /
• v.51 no.2
• /
• pp.185-202
• /
• 2023

Purpose: The purpose of this study is to identify key performance evaluation items and factors that are effective and practical for project management of defense standard standard improvement projects, and to develop a quantitative performance evaluation model. Methods: For the development of a performance evaluation model for defense standard improvement projects, we analyzed past major project performance and derived evaluation items and factors. To increase the objectivity and efficiency of project evaluation, we developed an evaluation index that enables relative evaluation of evaluation targets, and calculated the main importance of evaluation items using the Analytic Hierarchy Process (AHP) method based on the main opinions of expert groups. Results: The study resulted in the identification of main performance items for defense standard improvement projects, which were classified into defense standard conformity review performance and defense standard improvement performance items. We also simplified the evaluation model by integrating various evaluation items into similar evaluation factors. Additionally, we developed a quantitative evaluation index that enables relative evaluation of the targets and verified the objectivity and validity of the suggested performance evaluation model by reevaluating it using performance data from past commissioned professional institutions Conclusion: Developing a quantitative evaluation model for defense standard improvement projects is expected to provide a means of measuring the effectiveness of the project, and to be used as a tool to determine the appropriateness and effectiveness of medium and long-term project plans.

• The Journal of Information Systems
• /
• v.3
• /
• pp.133-145
• /
• 1994

Performance evaluation is essential for the successful management and operation of MIS. The more MIS grows and relevant investment enlarges, the more performance evaluation grows in importance. However, MIS managers as well as top management still have difficulty in evaluating the performance of MIS. This arises from various reasons, such as the specialty of MIS, diversified influences of MIS, multidimensionality of evaluation items, and the difference between evaluation levels. In this paper, MIS is understood in a broad sense. MIS's scope is of a very wide range from each application system to system innovation view. The MIS should support the firm's objectives, and, consequently, MIS evaluation should be implemented at corporate level, not merely at application system level. The most critical problem of MIS evaluation is that a systematic frame covering various viewpoints and factors of MIS evaluation does not exist. Not a single measure covers all aspects of MIS evaluation. To help resolve this problem, this paper proposes an hierarchical approach for practical use that includes most aspects of evaluation approaches from previous studies, and, furthermore, emphasizes the evaluation of strategic aspects of MIS.

• Journal of the Korea Computer Industry Society
• /
• v.8 no.3
• /
• pp.147-154
• /
• 2007

Many studies have reported that each evaluation had a stronger effect on the development of a student's teaming ability. Nevertheless, in reality schools rely on the results of summative evaluation after the lesson only for the purpose of learning evaluation. Such a method of evaluation is a result-oriented learning evaluation, with no consideration of developing process of loaming ability of each student. Existing learning evaluation has been considered difficult to process learning performance ability in a clearer manner, as it examines teaming performance ability by diagnostic evaluation and learning ability improvement by formative evaluation, separately. Therefore, this paper proposes a learning evaluation method incorporating diagnostic and formative evaluation, using a Fuzzy inference, for a more objective assessment of performance ability. The proposed method assessed teaming ability based on different weight values, in order to reflect the level of diagnostic and formative evaluation.

• The Journal of Fisheries Business Administration
• /
• v.41 no.1
• /
• pp.1-24
• /
• 2010

The main goal of the study is to propose an objective and standardized evaluation system of stock enhancement programs. In order to achieve this goal, the study first suggested the need for stock enhancement program evaluation system through the review of current status and problems. Second, the study identified possible problems of the existing stock enhancement program evaluation by reviewing domestic and foreign evaluation systems. Finally the study proposed a new evaluation system and implementation plan of it. This study also classified the program evaluation criteria into ex-ante evaluation and ex-post evaluation according to the evaluation point in time, and applied the economic, political and technical feasibility tests into the evaluation of the stock enhancement program in order to solve the current problems of the evaluation. The evaluation process of the stock enhancement program is composed of an evaluation system design, estimation of weights using the analytical hierarchy process, design of estimation standard, conversion of scores and final summary of the evaluation. The central government takes the lead in the evaluation of the regional (metropolitan city or province) projects and the regional government is in charge of the evaluation of the local (city or county) projects. For the implementation of the ex-ante evaluation, either the regional or local governments ask for the evaluation and then submit an evaluation plan and other necessary documents to the upper level governments. The ex-post evaluation is then carried out by the upper level governments.

• Journal of Korean Society for Quality Management
• /
• v.50 no.4
• /
• pp.665-677
• /
• 2022

Purpose: The purpose of this study is to analyze the current status and investigate relevant indicators so that R&D performance evaluation suitable for government-funded research institutes can proceed. A suitable performance evaluation model was presented based on the surveyed indicators. Based on the presented performance evaluation model, the importance was analyzed to calculate the weight for each indicator of the performance evaluation model. Methods: The method applied in this study presented a performance evaluation model based on the organizational performance evaluation cases of advanced overseas countries. By using the AHP(Analytic Hierarchy Process) technique, the weight of each indicator of the performance evaluation model was studied. Results: As a result of examining the indicators necessary for the evaluation model, focusing on overseas cases, 13 evaluation items were derived. A weight was calculated for the importance of the study results. And the scientific/technical research results showed the highest excellence. Conclusion: Key indicators of performance evaluation suitable for government-funded research institutes were derived and presented through detailed modeling in three stages. A realistic model that can objectively evaluate the performance of government-funded research institutes was proposed using the AHP technique.