• Journal of Information Technology Services
• /
• v.8 no.4
• /
• pp.141-150
• /
• 2009

There are no objective standards for selection and improvement of SLA evaluation metrics for IT service. In this study, we analyze the current IT maturity models for selection and improvement of the metrics and then we derive them according to the maturity levels and propose the redesigned maturity model. To verify whether the model is applicable, we execute a case study based on the D company. We apply the proposed evaluation metrics of the maturity models to the D company and evaluate the metrics. We select a proper level of the D company and an improvement line after measuring evaluation metrics in the maturity level 2. We propose improvement guidelines of evaluation metrics which score is less than the improvement line's and derive SLA evaluation metrics. By using the SLA evaluation metrics for a year, we prove that the way of selection and improvement is useful.

• Industrial Engineering and Management Systems
• /
• v.14 no.2
• /
• pp.122-128
• /
• 2015

The purpose of this paper is to propose an appropriate evaluation scheme for improvement activities, based on a simple model comprising cash inflow by sales as well as variable and fixed cost expenditures. The paper distinguishes capacity surplus and capacity shortage situations, and examines economic benefits gained by yield increase improvement and capacity increase. The paper then proposes a basic rule of thumb for economic evaluation of improvement activities. The logic is simple but useful in practice, being conducive towards improvement activities under current economic conditions with uncertainties.

• Journal of Korean Society for Quality Management
• /
• v.51 no.2
• /
• pp.185-202
• /
• 2023

Purpose: The purpose of this study is to identify key performance evaluation items and factors that are effective and practical for project management of defense standard standard improvement projects, and to develop a quantitative performance evaluation model. Methods: For the development of a performance evaluation model for defense standard improvement projects, we analyzed past major project performance and derived evaluation items and factors. To increase the objectivity and efficiency of project evaluation, we developed an evaluation index that enables relative evaluation of evaluation targets, and calculated the main importance of evaluation items using the Analytic Hierarchy Process (AHP) method based on the main opinions of expert groups. Results: The study resulted in the identification of main performance items for defense standard improvement projects, which were classified into defense standard conformity review performance and defense standard improvement performance items. We also simplified the evaluation model by integrating various evaluation items into similar evaluation factors. Additionally, we developed a quantitative evaluation index that enables relative evaluation of the targets and verified the objectivity and validity of the suggested performance evaluation model by reevaluating it using performance data from past commissioned professional institutions Conclusion: Developing a quantitative evaluation model for defense standard improvement projects is expected to provide a means of measuring the effectiveness of the project, and to be used as a tool to determine the appropriateness and effectiveness of medium and long-term project plans.

• Journal of National Security and Military Science
• /
• s.8
• /
• pp.383-420
• /
• 2010

This article is focusing on the improvement of weapon system test & evaluation, aimed at the weapon system in the research development stage. This article suggests improvement directions in three aspects(organization and system, skilled manpower and technology, test facilities of weapon system test & evaluation) as follows. 1) Weapon system test & evaluation organization and system a. Establishment of comprehensive test & evaluation system b. Making regulation for comprehensive test infrastructure management. c. Standardization of test & evaluation process, which can be used in special subject to army, navy and air force. 2) Skilled manpower and technology of weapon system test & evaluation a. Training & education, management of test & evaluation experts. b. Establishment of skill management system of test & evaluation. 3) Test facilities of weapon system test & evaluation a. Establishment of comprehensive improvement direction of test & evaluation installation and equipment. b. Consideration of counter measures to prevent overlapping investment, and to use the test & evaluation resources efficiently. c. Establishment of organic network for the effective use of test & evaluation installation and equipment. d. Establishment of detailed cooperation plan for the commonage of test & evaluation facility and equipment.

• Korean Medical Education Review
• /
• v.22 no.2
• /
• pp.131-142
• /
• 2020

A systematic educational program evaluation system for continuous quality improvement in undergraduate medical education is essential. Monitoring and evaluation (M&E) are two distinct but complementary processes referred to in an evaluation system that emphasizes formative purpose. Monitoring involves regular data collection for tracking process and results, while evaluation requires periodic judgment for improvement. We have recently completed implementing an educational evaluation using the M&E concept in a medical school. The evaluation system consists of two loops, one at the lesson/course level and the other at the phase/graduation level. We conducted evaluation activities in four stages: planning, monitoring, evaluation, and improvement. In the planning phase, we clarified the purpose of evaluation, formulated a plan to engage stakeholders, determined evaluation criteria and indicators, and developed an evaluation plan. Next, during the monitoring phase, we developed evaluation instruments and methods and then collected data. In the evaluation phase, we analyzed results and evaluated the criteria of the two loops. Finally, we reviewed the evaluation results with stakeholders to make improvements. We have recognized several problems including excessive burden, lack of expertise, insufficient consideration of stakeholders' evaluation questions, and inefficient data collection. We need to share the value of evaluation and build a system gradually.

• Journal of Engineering Education Research
• /
• v.20 no.5
• /
• pp.74-86
• /
• 2017

The purpose of this study is to analyze the perceptions of college officials about the evaluation of university education on the perspective of industry, to make policy proposals for improvement by analyzing the preparing process of the departments that have received the evaluation of the best universities, In order to achieve the purpose of the study, we conducted literature review, survey studies, and in-depth interviews. The survey was conducted by professors related to this system, and finally the results of 51 responses were used for analysis. The contents of the survey were composed of the recognition, appropriateness, the utilization of the results, the proliferation and improvement plan of the evaluation of university education on the perspective of industry. In-depth interviews conducted 1:1 interviews with 5 professors. The evaluation of university education on the perspective of industry is generally perceived to be a bridge between industry and university education, but there is room for improvement in evaluation criteria, operating methods, and promotion strategies to public.

• Journal of Korean Society for Quality Management
• /
• v.50 no.2
• /
• pp.183-197
• /
• 2022

Purpose: The purpose of this study is to develop a quantitative evaluation model for the defense quality management system and suggest institutionalization plans. To this end, another existing evaluation model was reviewed and analyzed to develop a quantitative evaluation model applicable to military institutions. Methods: In this study, in order to establish a DQMS quantitative evaluation model, a military product quality level survey model and a defense quality model operated in the defense field were analyzed. In addition, evaluation models and indicators were analyzed by investigating evaluation models operated by other institutions and private sectors. Results: As a result of the study, the total score of the DQMS model was 1,000 points, 600 points for maturity level indicators and 400 points for operation performance indicators, and the evaluation items consisted of 7 major categories and 25 middle categories. The maturity level index 600 points are 70 points for organizational situation, 60 points for leadership, 40 points for planning, 100 points for support, 180 points for operation, 90 points for performance evaluation, and 60 points for improvement. Conclusion: It will be easy to quantify and evaluate the operating level of DQMS certified companies through the application of the DQMS quantitative evaluation model and evaluation criteria presented in this study. As a result, it will be possible to grasp the level of quality management system and the areas of improvement, and the overall level of improvement can be expected by inducing voluntary improvement activities through sharing of best practices and identifying improvement cases.

• Journal of Korea Water Resources Association
• /
• v.40 no.7
• /
• pp.503-510
• /
• 2007

In the area of such a nature-friendly stream improvement, it is not established yet which engineering method is suitable for stream environment, due to lack of technology. Therefore, although nature-friendly stream improvement was done with expensive engineering method, the effect has not been fully confirmed, which results from the absence of overall valuation tool of stream improvement. In this regard, it is necessary to develop and apply comprehensive and diverse valuation methods covering stream functions to the analysis of stream improvement. In this study, we collected data from years' of monitoring on the Gyeongcheon river, which is located in Sunchang-eup, Jeollabuk-do and recently underwent an nature-friendly stream improvement work. Based on the data, we developed a series of valuation methods such as stream naturalness evaluation, life cycle evaluation, amenity evaluation, and economic benefit analysis to consider the environmental function of stream from a comprehensive perspective. Stream naturalness evaluation is a quantitative analysis of how natural a stream is, and includes additional valuation items such as ecosystem and water quality for the purpose of overall valuation, unlike existing research focusing on physical elements and structural characteristics of a stream. We developed a method of stream valuation with life cycle assessment to river reorganization project. Amenity evaluation method was developed as a means to analyze residents' satisfaction with stream improvement through questionnaires. Economic benefit analysis was developed as a means to determine the attributes of environmental water supply, ecosystem, river maintenance, and water quality and predict economic benefits using contingent valuation method (CVM) and multi-attribute utility analysis (MAUA) method in order to analyze economic benefits brought in by stream improvement. It is considered that the four methods developed in this study make possible to conduct an overall and quantitative analysis of stream improvement.

• The Journal of Korean Obstetrics and Gynecology
• /
• v.35 no.4
• /
• pp.105-120
• /
• 2022

Objectives: The purpose of this study is to investigate the perception of Korean Medicine (KM) doctors toward infertility treatment evaluation tools and develop a standard evaluation tool for mental and physical function improvement following Korean medicine treatment. Methods: An online survey (Moaform) was conducted, and responses were analyzed for members of the Society of Korean Medicine Obstetrics and Gynecology and KM doctors who participated in the 2021-2022 traditional Korean medicine treatment infertility support program in Gyeonggi-do. Results: In fertility treatment, the most effective indicators that KM doctors wanted to evaluate other than pregnancy and childbirth were reproductive health indicators, overall health improvement, and stress improvement (33.1%, 21.2%, 18.9%). Furthermore, 45.1% of the respondents had experience using the presented infertility stress evaluation tools. For each evaluation tool, 52.1% and 54.6% of the respondents answered that it 'does not reflect the changing circumstances of the times' and that there were 'too many questions'. As for the developing a standard evaluation tool for infertility treatment in KM, KM doctors expected a simple and clear tool focusing on the pregnancy rate. They also wanted the tool to include a reproductive health index, overall function improvement and stress improvements. Conclusions: The survey confirmed the need to evaluate indicators for reproductive health, mental health, and infertility stress in addition to pregnancy rate to assess the effectiveness of KM infertility treatment. It also confirms the necessity of developing an infertility stress evaluation tool with simplified questions that reflects the changing time.

• The Korean Journal of Health Service Management
• /
• v.3 no.2
• /
• pp.29-43
• /
• 2009

The purpose of this study is to provide basic material about the improvement method of the hospital evaluation system by grasping recognition, corresponding behavior to evaluation, influence and problems about the hospital evaluation system with respect to the employee of mid sized hospitals having relatively poorer environment. In this study were used 518 questionnaires to hospital employee working at 20 general hospitals in Pusan, Kyungnam with less than 500 beds and having experience of the hospital evaluation during 2005~2007. As a result of the research, they felt the investigation tool used for the hospital evaluation has too many items and it could be difficult to reflect characteristics of each hospital. It appeared that utilization of the report result after the hospital evaluation was helpful for grasping a part necessary for hospital improvement and the present level of hospitals and increase of interest about medical service quality improvement of the a hospital director or hospital employee. They trusted the result of the hospital evaluation to some degree, and recognized it helps the patients to select a hospital and increase rights-to-know. Hospital employee recognized the necessity and showed high interest and participation, but they didn't sympathize in the propriety and the feasibility of the hospital evaluation items. High degree evaluated hospital employee receive hospital evaluation system positively and think hospital services to be improve after taking hospital evaluation. The hospital evaluation should make the hospital to effort to achieve medical quality improvement to its purpose. Also, systematic reformation will be necessary to reflect characteristics of the hospital that has relatively small scale or locates in poor environment.