• Health Policy and Management
• /
• v.9 no.4
• /
• pp.87-119
• /
• 1999

The main purpose of this research is to measure and analyze how productive the health centers are and how much inputs(or outputs) in the inefficient health centers should be decreased(or increased) for efficiency. The evaluation of the performance of health centers gives a strong incentive to improve resource allocation in regional health planning. It has been, however, implemented very rarely until now. In this regard, this paper measures the performance of the health centers with a single indicator for multiple-outputs in terms of productivity(technical efficiency), based on Data Envelopment method. The 20 Kyungnam health centers which provide clinic services and specific primary health care services were analyzed. The results show that 50.0% of 20 health centers were productive with respective to overall technical efficiency, 65.0% were productive for pure technical efficiency, and 50.0% for scale efficiency. The inefficient group includes Geoje, Mahsan, Miryang, Sahchun, Tongyoung, Gosung, Nahmhae, Euryang, Hahmahn, Hahbchun health centers. The worst case was identified as Tongyoung health center which represented a 47.5% efficiency, compared with productive health centers. The empirical results for input-output analysis indicates that the low-productive health centers have excessive manpower in administration department, producing low outputs in clinical services and vaccination program. These findings imply that a systemic evaluation of the performance of the Korean health centers and the subsequent structural reform are strongly required.

• Journal of Information Technology Services
• /
• v.11 no.4
• /
• pp.135-151
• /
• 2012

Traditionally in IS studies, the relationship between construct and its measurement items tends to be assumed to be reflective, meaning that the measurements are a reflection of the construct. In reality, however, the nature of the construct can be often formative, which means that its measurement items describe and define the construct rather than vice versa. The purpose of this study was to investigate theoretical and empirically-analysed differences between formative construct and reflective construct through comprehensive interdisciplinary literature review. And then on the basis of these differences, we intended to derive the rule of specifying whether the construct is formative or reflective and propose the methodology of testing the validity(content validity, construct validity, internal consistency and external construct) of formative construct and its measurements, differentiated from that in the case of reflective construct. Also, we suggested the concrete statistical testing methods such as VTT(Vanishing Tetrad Test), MIMIC(Multiple Indicators and Multiple Causes) test and multi-collinearity test. In order to examine the applicability of this methodology to developing the constructs for performance evaluation of IS(Information Systems), we tried to identify its attribute(formative or reflective) and test the validity for the construct arbitrarily chosen among them which had been derived in our previous IS performance evaluation study by using this methodology. The result of the examination was that the methodology proposed in this study was significantly valid and effective in the area of IS performance evaluation.

• Journal of the Korean Society of Systems Engineering
• /
• v.19 no.1
• /
• pp.107-113
• /
• 2023

For one-shot systems such as 81mm high-explosive ammunition, research on performance prediction is insignificant due to research manpower infrastructure and lack of interest and difficulties in securing field data, which can only be done by special task workers. In order to evaluate the actual range of ammunition, the storage ammunition reliability evaluation checks the range by firing actual ammunition through a functional test. Test evaluation is a method of extracting a sample from the population, launching it, and recording the results accordingly. As a result of these tests, the range, which is an indicator of ammunition performance, can be measured differently according to meteorological factors such as temperature, atmospheric pressure, and humidity according to the location of the test site. In this study, various environmental factors generated at the test site and storage period analyze the correlation with the range, which is the performance of ammunition, and analyze the priority of importance for each factor and the numerical standards that environmental factors affect range. Through this, a new approach to one-shot system performance prediction was presented.

• Journal of Internet Computing and Services
• /
• v.18 no.5
• /
• pp.113-121
• /
• 2017

Company A's core competency is IT internet security services. The Web diagnosis team analyzes the vulnerability of customer's internet web servers and provides remedy reports. Traditionally, Company A management has utilized a simple table format report for resource planning. But these reports do not notify the timing of human resource commitment. So, upper management asked its team leader to organize a task team and design a visual dashboard for decision making with the help of outside professional. The Task team selected the web security diagnosis practice process as a pilot and designed a dashboard for performance evaluation. A structural design process was implemented during the heuristic working process. Some KPI (key performance indicators) for checking the productivity of internet web security vulnerability reporting are recommended with the calculation logics. This paper will contribute for security service management to plan and address KPI design policy, target process selection, and KPI calculation logics with actual sample data.

• Korean Medical Education Review
• /
• v.24 no.3
• /
• pp.250-260
• /
• 2022

Evaluating the effectiveness of educational programs involves measuring learning processes as well as outcomes. It is essential to study cohorts of students and graduates to evaluate the long-term effects of educational programs with data generated both during education and after graduation. The purpose of this study was to establish cohorts of students and graduates to evaluate their performance, thereby providing a basis for evaluating the social accountability of medical education. In this study, student and graduate cohorts were built for both students currently enrolled and graduates at Inje University College of Medicine (IUCM). A model involving the process of cohort establishment and an evaluation indicator framework was developed. In the process of cohort establishment, the following steps were conducted: defining the goals and objectives of the student and graduate cohorts, organizing a cohort committee, developing regulations, registering cohorts, acquiring consent, and building a database. A framework of evaluation indicators according to the graduate roles of IUCM was developed by adapting Kirkpatrick's evaluation model. Next, items to be collected in student and graduate cohorts were selected, and the current status of existing data was analyzed. Moreover, a preliminary analysis was conducted, including analyses of the evaluation indicators and graduates' performance. This study suggests that it is necessary to include additional evaluation indicators considering students' learning environment and well-being in student cohorts and to develop strategies or methods for graduates to continue participating in data collection for a long-term study.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.46 no.4
• /
• pp.209-217
• /
• 2023

In this study, the evaluation items related to the effectiveness evaluation of the LVC (Live, Virtual, Constructive) training system of the Air Force were derived and the weights of each item were analyzed. The LVC training system evaluation items for AHP (Analytic Hierarchy Process) analysis were divided into three layers, and according to the level, 3 items were derived at level 1, 11 items at level 2, and 33 items at level 3. For weight analysis of evaluation items, an AHP-based pairwise comparison questionnaire was conducted for Air Force experts related to the LVC training system. As a result of the survey, related items such as (1) Achievement of education and training goals (53.8%), (1.2) Large-scale mission and operational performance (25.5%), and (1.2.1) Teamwork among training participants (19.4%) was highly rated. Also, it was confirmed that the weights of evaluation items were not different for each expert group, that is, the priority for importance was evaluated in the same order between the policy department and the working department. Through these analysis results, it will be possible to use them as evaluation criteria for new LVC-related projects of the Air Force and selection of introduction systems.

• Journal of the Korean Operations Research and Management Science Society
• /
• v.40 no.1
• /
• pp.185-198
• /
• 2015

This study drew performance management factors analyzed a causal link between acceptance and satisfaction of performance management to present the method for promoting acceptance on the performance management system that most of the public enterprises, government-affiliated organizations are implementing. To achieve this, qualitative analysis and quantitative analysis were conducted in parallel through in-depth case studies and surveys. The results of this study are as follows. First, the analysis of the performance management factors with preceding studies shows that performance management indicators, performance management operations and performance management communications. Second, from the causal relationship of performance management factors affecting performance management acceptance reveals that performance management operation has statistical significance. Third, the analysis of the effect of performance management factors on the management satisfaction shows that operation and indicator of the performance management have statistical significance and reflecting the performance indicators to business, adequacy of target level, training, system support and CEO's Leadership have been revealed as important variables to the management satisfaction. Fourth, the result of the analysis on casual connection between acceptance and satisfaction of the performance management shows that improving management acceptance has a direct impact on satisfaction because performance management receptiveness were deemed statistically significant. Fifth, the result of the in-depth case studies on improving performance management acceptance shows that public enterprises have been putting in an effort to design indicators and try to encourage internal member's involvement during the monitoring and evaluation. The quantitative analysis based on survey has turned out that performance management operation and performance management indicators have statistical significance. The qualitative analysis by in-depth analysis shows that public enterprises put a lot of effort to performance management indicators and communication between internal members. As a result, commitment to performance management operation is required to improve the performance management acceptance. In other words, a detailed implementation plan for training, information system support, and CEO's leadership has to be established and ought to be pushed.

• Korean Journal of Construction Engineering and Management
• /
• v.20 no.1
• /
• pp.62-72
• /
• 2019

Future prospects for the North Korean construction market created by reunification of the Korean Peninsula has consistently been recognized as highly promising. Although rehabilitation projects of the deteriorating construction facilities in North Korea are expected to serve as new source of growth engine to South Korea in future, the status quo of each infrastructure in the North are described verbosely with signs of subjective translation. There has been limited approach on depicting the condition and performance of the North Korean facilities based on quantitative and systematic approach. Thus, this study has been conducted under a twofold purpose. First, this study proposes a performance indicator for identifying the status quo of the major construction facilities in North Korea based on a quantitative approach. Second, this study applies the developed indicator to visualize the results on the conditions of each facility in the form of a report card. This expected to serve as a basis on determining the appropriate level of the construction infrastructure in North Korea and estimating the range of rehabilitation projects along with the investment cost.

• Journal of Information Technology Applications and Management
• /
• v.13 no.3
• /
• pp.145-179
• /
• 2006

The measurement of informatization program effectiveness continues to be a central concern of both academics and practitioners. However, most studies of it have been inclined too heavily toward testing validity and reliability of evaluation measure to strengthen the theoretical rigor. Drawbacks of this approach have been pointed out as being unsuitable for evaluating the effectiveness of informatization program due to lack of practical relevance. The paper comprises four sections to solve the problem. 1) Through literature review of theoretical conceptual models in IS effectiveness and the domestic and foreign cases on informatization program, we establish the evaluation framework which consists of evaluation phases, 6 evaluation areas, and 22 evaluation items, and developed evaluation measures of each items. 2) Different researchers have addressed different aspects of attribute of measure. With comparing them to each other, 3 mutually exclusive criteria on coincidence analysis(usability of measurement. reliability of measurement. and validity of content) are identified. 3) Data are gathered from respondents in informatizaiton program-related organizations such as policy agency, management agency, support agency, and recipient agency. 4) The degree of coincidence of each evaluation measure are analyzed by course of an coincidence analysis procedure, which includes the reliability test, arithmetical test, and criteria validity test. The academic implication of this study is that researchers can gain an insight into the coincidence analysis to approach the problem of deciding on an indicator of performance for informatization program. There is also practical implication for applying the potential means of improving the practical relevance of conducting evaluating the informatization program.

• Health Policy and Management
• /
• v.23 no.2
• /
• pp.176-187
• /
• 2013

Background: In 2006 Emergency Medical Services Index (EMSI), which summarizes the performance of regional emergency medical services system, was developed. This study assesses the performance of the EMSI to help determine whether EMSI can be used as evaluation tool. Methods: To build a composite score of the EMSI from predefined 24 indicators, 3 normalized values were calculated for each indicator, the normalized values of each indicator were weighted using 4 weighting methods, and the weighted values were aggregated into the final composite score using 2 aggregation schemes. The performance of EMSI was evaluated using 3 criteria: discrimination, construct validity, and sensitivity. Discrimination was the proportion of regions that did not include the overall median rank in the 5th to 95th percentiles rank interval, which was calculated from Monte Carlo simulation. Construct validity was a correlation among the alternative EMSIs. Sensitivity of EMSIs was evaluated by total shift of quartile membership and changes of 5th to 95th percentile intervals. Results: The total discrimination performance of the EMSI was 50.0%. Correlation coefficients between EMSIs using standardized values and those using rescaled values ranged from 0.621 to 0.997. Variation of the quartile membership of regions ranged from 0.0% to 75.0%. The total change in the 5th to 95th percentile intervals ranged from -19 to +17 places. Conclusion: The results suggested that the EMSI could be used as a tool for evaluating quality of regional EMS system and for identifying the areas for quality improvement.