• 한국IT서비스학회지
• /
• 제8권4호
• /
• pp.141-150
• /
• 2009

There are no objective standards for selection and improvement of SLA evaluation metrics for IT service. In this study, we analyze the current IT maturity models for selection and improvement of the metrics and then we derive them according to the maturity levels and propose the redesigned maturity model. To verify whether the model is applicable, we execute a case study based on the D company. We apply the proposed evaluation metrics of the maturity models to the D company and evaluate the metrics. We select a proper level of the D company and an improvement line after measuring evaluation metrics in the maturity level 2. We propose improvement guidelines of evaluation metrics which score is less than the improvement line's and derive SLA evaluation metrics. By using the SLA evaluation metrics for a year, we prove that the way of selection and improvement is useful.

• Industrial Engineering and Management Systems
• /
• 제14권2호
• /
• pp.122-128
• /
• 2015

The purpose of this paper is to propose an appropriate evaluation scheme for improvement activities, based on a simple model comprising cash inflow by sales as well as variable and fixed cost expenditures. The paper distinguishes capacity surplus and capacity shortage situations, and examines economic benefits gained by yield increase improvement and capacity increase. The paper then proposes a basic rule of thumb for economic evaluation of improvement activities. The logic is simple but useful in practice, being conducive towards improvement activities under current economic conditions with uncertainties.

• 품질경영학회지
• /
• 제51권2호
• /
• pp.185-202
• /
• 2023

Purpose: The purpose of this study is to identify key performance evaluation items and factors that are effective and practical for project management of defense standard standard improvement projects, and to develop a quantitative performance evaluation model. Methods: For the development of a performance evaluation model for defense standard improvement projects, we analyzed past major project performance and derived evaluation items and factors. To increase the objectivity and efficiency of project evaluation, we developed an evaluation index that enables relative evaluation of evaluation targets, and calculated the main importance of evaluation items using the Analytic Hierarchy Process (AHP) method based on the main opinions of expert groups. Results: The study resulted in the identification of main performance items for defense standard improvement projects, which were classified into defense standard conformity review performance and defense standard improvement performance items. We also simplified the evaluation model by integrating various evaluation items into similar evaluation factors. Additionally, we developed a quantitative evaluation index that enables relative evaluation of the targets and verified the objectivity and validity of the suggested performance evaluation model by reevaluating it using performance data from past commissioned professional institutions Conclusion: Developing a quantitative evaluation model for defense standard improvement projects is expected to provide a means of measuring the effectiveness of the project, and to be used as a tool to determine the appropriateness and effectiveness of medium and long-term project plans.

• 안보군사학연구
• /
• 통권8호
• /
• pp.383-420
• /
• 2010

This article is focusing on the improvement of weapon system test & evaluation, aimed at the weapon system in the research development stage. This article suggests improvement directions in three aspects(organization and system, skilled manpower and technology, test facilities of weapon system test & evaluation) as follows. 1) Weapon system test & evaluation organization and system a. Establishment of comprehensive test & evaluation system b. Making regulation for comprehensive test infrastructure management. c. Standardization of test & evaluation process, which can be used in special subject to army, navy and air force. 2) Skilled manpower and technology of weapon system test & evaluation a. Training & education, management of test & evaluation experts. b. Establishment of skill management system of test & evaluation. 3) Test facilities of weapon system test & evaluation a. Establishment of comprehensive improvement direction of test & evaluation installation and equipment. b. Consideration of counter measures to prevent overlapping investment, and to use the test & evaluation resources efficiently. c. Establishment of organic network for the effective use of test & evaluation installation and equipment. d. Establishment of detailed cooperation plan for the commonage of test & evaluation facility and equipment.

• 의학교육논단
• /
• 제22권2호
• /
• pp.131-142
• /
• 2020

A systematic educational program evaluation system for continuous quality improvement in undergraduate medical education is essential. Monitoring and evaluation (M&E) are two distinct but complementary processes referred to in an evaluation system that emphasizes formative purpose. Monitoring involves regular data collection for tracking process and results, while evaluation requires periodic judgment for improvement. We have recently completed implementing an educational evaluation using the M&E concept in a medical school. The evaluation system consists of two loops, one at the lesson/course level and the other at the phase/graduation level. We conducted evaluation activities in four stages: planning, monitoring, evaluation, and improvement. In the planning phase, we clarified the purpose of evaluation, formulated a plan to engage stakeholders, determined evaluation criteria and indicators, and developed an evaluation plan. Next, during the monitoring phase, we developed evaluation instruments and methods and then collected data. In the evaluation phase, we analyzed results and evaluated the criteria of the two loops. Finally, we reviewed the evaluation results with stakeholders to make improvements. We have recognized several problems including excessive burden, lack of expertise, insufficient consideration of stakeholders' evaluation questions, and inefficient data collection. We need to share the value of evaluation and build a system gradually.

• 공학교육연구
• /
• 제20권5호
• /
• pp.74-86
• /
• 2017

The purpose of this study is to analyze the perceptions of college officials about the evaluation of university education on the perspective of industry, to make policy proposals for improvement by analyzing the preparing process of the departments that have received the evaluation of the best universities, In order to achieve the purpose of the study, we conducted literature review, survey studies, and in-depth interviews. The survey was conducted by professors related to this system, and finally the results of 51 responses were used for analysis. The contents of the survey were composed of the recognition, appropriateness, the utilization of the results, the proliferation and improvement plan of the evaluation of university education on the perspective of industry. In-depth interviews conducted 1:1 interviews with 5 professors. The evaluation of university education on the perspective of industry is generally perceived to be a bridge between industry and university education, but there is room for improvement in evaluation criteria, operating methods, and promotion strategies to public.

• 품질경영학회지
• /
• 제50권2호
• /
• pp.183-197
• /
• 2022

Purpose: The purpose of this study is to develop a quantitative evaluation model for the defense quality management system and suggest institutionalization plans. To this end, another existing evaluation model was reviewed and analyzed to develop a quantitative evaluation model applicable to military institutions. Methods: In this study, in order to establish a DQMS quantitative evaluation model, a military product quality level survey model and a defense quality model operated in the defense field were analyzed. In addition, evaluation models and indicators were analyzed by investigating evaluation models operated by other institutions and private sectors. Results: As a result of the study, the total score of the DQMS model was 1,000 points, 600 points for maturity level indicators and 400 points for operation performance indicators, and the evaluation items consisted of 7 major categories and 25 middle categories. The maturity level index 600 points are 70 points for organizational situation, 60 points for leadership, 40 points for planning, 100 points for support, 180 points for operation, 90 points for performance evaluation, and 60 points for improvement. Conclusion: It will be easy to quantify and evaluate the operating level of DQMS certified companies through the application of the DQMS quantitative evaluation model and evaluation criteria presented in this study. As a result, it will be possible to grasp the level of quality management system and the areas of improvement, and the overall level of improvement can be expected by inducing voluntary improvement activities through sharing of best practices and identifying improvement cases.

• 한국수자원학회논문집
• /
• 제40권7호
• /
• pp.503-510
• /
• 2007

현재 하천정비는 하천생태계에 초점을 맞추고 자연하천에 근접할 수 있는 공법을 사용하는 자연 친화적인 하천정비가 비약적으로 늘어나고 있다. 하지만 자연 친화적인 하천정비는 아직까지 많은 기술이 축적되지 않아 어떤 공법이 하천환경에 적합한 공법인지가 확립되어 있지 않은 상태이다. 또한, 값비싼 공법을 적용하여 하천을 자연 친화적으로 정비하였다. 하더라도 하천정비에 대한 종합적인 평가방법이 확립되어있지 않아 자연 친화적 하천정비에 대한 타당성을 객관화하지 못하고 있다. 따라서 하천환경기능을 포함한 종합적이고 다양한 평가방법을 개발하여 정비하천에 대한 평가를 수행할 필요가 있다. 본 연구에서는 자연 친화적으로 정비된 하천에 대해 정비의 타당성과 효율성을 평가하는 평가방법에 대해 연구하였다. 전라북도 순창읍에 있는 경천을 대상으로 2000년${\sim}$2000년 월별로 모니터링을 수행하여 자료를 수집하였으며, 수집된 자료를 분석하여 하천환경기능을 종합적으로 고려할 수 있는 방법으로서 하천자연도 평가, 전 과정 평가, 어메니티 평가, 경제적 편익 평가 등의 평가방법을 개발하였다. 본 연구에서 개발한 4가지의 평가방법은 하천정비사업의 종합적이고 정량적인 평가를 수행할 수 있는 방법으로 판단된다. 하지만 하나의 하천을 대상으로 개발된 방법을 적용하였기 때문에 차후 각 하천마다 갖는 특성을 고려하여 하천정비의 평가방법이 요구된다.

• 대한한방부인과학회지
• /
• 제35권4호
• /
• pp.105-120
• /
• 2022

Objectives: The purpose of this study is to investigate the perception of Korean Medicine (KM) doctors toward infertility treatment evaluation tools and develop a standard evaluation tool for mental and physical function improvement following Korean medicine treatment. Methods: An online survey (Moaform) was conducted, and responses were analyzed for members of the Society of Korean Medicine Obstetrics and Gynecology and KM doctors who participated in the 2021-2022 traditional Korean medicine treatment infertility support program in Gyeonggi-do. Results: In fertility treatment, the most effective indicators that KM doctors wanted to evaluate other than pregnancy and childbirth were reproductive health indicators, overall health improvement, and stress improvement (33.1%, 21.2%, 18.9%). Furthermore, 45.1% of the respondents had experience using the presented infertility stress evaluation tools. For each evaluation tool, 52.1% and 54.6% of the respondents answered that it 'does not reflect the changing circumstances of the times' and that there were 'too many questions'. As for the developing a standard evaluation tool for infertility treatment in KM, KM doctors expected a simple and clear tool focusing on the pregnancy rate. They also wanted the tool to include a reproductive health index, overall function improvement and stress improvements. Conclusions: The survey confirmed the need to evaluate indicators for reproductive health, mental health, and infertility stress in addition to pregnancy rate to assess the effectiveness of KM infertility treatment. It also confirms the necessity of developing an infertility stress evaluation tool with simplified questions that reflects the changing time.

• 보건의료산업학회지
• /
• 제3권2호
• /
• pp.29-43
• /
• 2009

The purpose of this study is to provide basic material about the improvement method of the hospital evaluation system by grasping recognition, corresponding behavior to evaluation, influence and problems about the hospital evaluation system with respect to the employee of mid sized hospitals having relatively poorer environment. In this study were used 518 questionnaires to hospital employee working at 20 general hospitals in Pusan, Kyungnam with less than 500 beds and having experience of the hospital evaluation during 2005~2007. As a result of the research, they felt the investigation tool used for the hospital evaluation has too many items and it could be difficult to reflect characteristics of each hospital. It appeared that utilization of the report result after the hospital evaluation was helpful for grasping a part necessary for hospital improvement and the present level of hospitals and increase of interest about medical service quality improvement of the a hospital director or hospital employee. They trusted the result of the hospital evaluation to some degree, and recognized it helps the patients to select a hospital and increase rights-to-know. Hospital employee recognized the necessity and showed high interest and participation, but they didn't sympathize in the propriety and the feasibility of the hospital evaluation items. High degree evaluated hospital employee receive hospital evaluation system positively and think hospital services to be improve after taking hospital evaluation. The hospital evaluation should make the hospital to effort to achieve medical quality improvement to its purpose. Also, systematic reformation will be necessary to reflect characteristics of the hospital that has relatively small scale or locates in poor environment.