• Proceedings of the Korea Committee for Ocean Resources and Engineering Conference
• /
• 2006.11a
• /
• pp.277-280
• /
• 2006

Most real world design evaluation and risk-based decision support combine quantitative and qualitative (linguistic) variables. Decision-making based on conventional mathematics that combines qualitative and quantitative concepts always exhibit difficulty in modelling actual problems. The successful selection process for choosing a design/procurement proposal is based on a high degree of technical integrity, safety levels and low costs in construction, corrective measures, maintenance, operation, inspection and preventive measures. However, the objectives of maximising the degree of technical performance, maximising the safety levels and minimising the costs incurred are usually in conflict, and the evaluation of the technical performance, safety and costs is always associated with uncertainties, especially for a novel system at the initial concept design stage. In this paper, a design-decision support framework using a composite structure methodology grounded in approximate reasoning approach and evidential reasoning method is suggested for design evaluation of machinery space of a ship engine room at the initial stages. It is a Multiple Attribute Decision-Making (MADM) or Multiple Criteria Decision Making (MCDM) framework, which provides a juxtaposition of cost, safety and technical performance of a system during evaluation to assist decision makers in selecting the winning design/procurement proposal that best satisfies the requirement in hand. An illustrative example is used to demonstrate the application of the proposed framework.

• Journal of Korean Institute of Industrial Engineers
• /
• v.31 no.2
• /
• pp.143-151
• /
• 2005

Information technology(IT) investment evaluation requires measurements from many perspectives. Except for the case of financial performance, these measurements mostly belong to the qualitative or intangible domain. The problem with IT investment evaluation lies in the fact that it is very difficult to define the qualitative properties against which to measure the performances. This paper addresses the issue of developing the set of performance indices, and defining the structural relationships between them, such that the IT investment evaluation can be done in a systematic, objective and comprehensive manner. We introduce the balanced scorecard strategy map as the backbone reference frame for the generation of performance indices and for the description of the relationships between them. Sample indices for evaluating projects from strategic perspectives are provided with a case example. A step by step follow through of the index generation process has been presented along with the case.

• Journal of the Earthquake Engineering Society of Korea
• /
• v.23 no.1
• /
• pp.19-29
• /
• 2019

Recent earthquakes in Korea caused some damages to stone pagodas and thereby awakened the importance of earthquake preparedness. Korean stone pagodas which have been built with very creative style of material use and construction method are worthy of world heritage. Each stone pagoda consists of three parts: top; body; and base. However each tower is uniquely defined by its own features, which makes it more difficult to generalize the seismic assessment method for stone pagodas. This study has focused on qualitative preliminary evaluation of stone pagodas that enables us to compare the relative seismic performance across major aspects among many various Korean pagodas. Specifically an analytical model for multi-block stone pagodas is to be proposed upon the investigation of structural characteristics of stone pagoda and their dynamic behavior. A strategy for seismic evaluation of heritage stone pagodas is to be established and major evaluation factors appropriate for the qualitative evaluation are identified. The evaluation factors for overall seismic resisting behavior of stone pagodas are selected based on the dynamic motions of a rigid block and its limit state. Numerical simulation analysis using discrete element method is performed to analyze the sensitivity of each factor to earthquake and discuss some effects on seismic performance.

• Journal of Information Technology Services
• /
• v.12 no.1
• /
• pp.189-199
• /
• 2013

As many organizations have adopted and implemented ERP systems, concerns about ERP performance also have increased. Former researches studied the ERP implementation of general large or medium size enterprises but there are not enough studies on ERP systems of a specific industry domain. In this paper, we introduce a case study on ERP adoption methodology of global leading company 'D' in shipbuilding and marine engineering industry. We examined ERP implementation background, method and scope and evaluated ERP performance in perspective of both quantitative and qualitative approaches. Quantitative research usually examines ERP performance based on financial statements and qualitative study typically examines organization change or improvement. As a result, ERP implementation in shipbuilding and marine industry can improve quantitative aspects such as cost, human resource and organization performance. As qualitative analysis, business process and tools can be unified and management transparency can be improved by ERP implementation. The result of this paper will be useful guideline for organizations which are considering ERP systems.

• Journal of Korea Technology Innovation Society
• /
• v.11 no.3
• /
• pp.376-399
• /
• 2008

Science and technology (S&T) is one of the most important elements in a nation's competitiveness. In an effort to strengthen their national competitiveness, all countries are focusing on upgrading the level of eir S&T. With these factors in mind, Korea has increased its support of national research and development (R&D). In recent years, this added support has resulted in an increased interest in the effectiveness of R&D. We have made continuous efforts to enhance the accountability and effectiveness of R&D by strengthening performance evaluation and considering R&D evaluation results during the budget review (appropriation) process. In order to change to a performance based system, we need to develop objective and scientific indicators to measure and evaluate the quality of the research performance of R&D programs. One of the primary research outcomes is publications. The impact factor of publications is widely used to evaluate overall journal quality and the quality of the papers published therein. However, the use of impact factors has been criticised because they can vary greatly when works from different subject areas are compared. In order to overcome this limitation, we have developed three kinds of qualitative indicators, which are functions of the impact factor. Two of these qualitative indicators, Modified Rank Normalized Impact Factor and Ordinal Rank Normalized Impact Factor, are based on order statistics (rank) for all journals from a specific specialty. The third qualitative indicator, Relative Field Impact Factor, uses the average impact factor of all journals within a subject category. We also suggest a quantitative indicator, Percentage of Contribution. In this study, we suggest 4 indicators and use them to evaluate the performance of outcomes from three R&D programs supported by the Ministry of Education, Science & Technology. We also perform a simulation study to verify the effectiveness of the proposed indicators. It can be shown that the proposed Ordinal Rank Normalized Impact Factor is the most reliable and effective indicator for comparing research performance across subject categories. However, we recommend using previous indicators in combination with the proposed indicators in this study for the research evaluation of R&D programs.

• Journal of the Korean BIBLIA Society for library and Information Science
• /
• v.33 no.4
• /
• pp.93-114
• /
• 2022

This study aims to propose the ways to improve the research performance evaluation to support the establishment of a sound research culture. For the study, we analyzed the cases of domestic and foreign research performance evaluation, and a survey and an interview were conducted for faculty and research performance evaluation officials, respectively. In the study, the direction of establishing the principle of research performance evaluation, the method of categorizing the type of research performance, the method and procedure of research performance evaluation, and necessary documents were proposed. First, eight principles were suggested to be considered in evaluating research achievements to ensure the validity, reliability, and transparency of the evaluation while supplementing the limitations of quantitative evaluation. Second, the main types of research achievements were categorized into journal articles, books, and presentations at academic conferences. Third, as a research achievement evaluation method, a hybrid evaluation using quantitative and qualitative and multiple measurement indicators was proposed. Fourth, a total of 11 steps (required 7 steps) were presented as a procedure for research achievement evaluation. Fifth, publications, evaluation documents, and committee chair's reports were proposed as major documents for research achievement evaluation. The research achievement evaluation improvement plan presented in this study should be flexibly applied in consideration of the characteristics of the academic and research fields and universities.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.12 no.1
• /
• pp.70-79
• /
• 2009

Currently, the investment on Research and Development(R&D) for defense core technology is continuously increasing to maintain advanced country's R&D level. In accordance with this trend, the national defense R&D investment management system is being more strengthening, and importance of performance evaluation is being emphasized more and more. However, the existing indicators of performance evaluation for defense core technology R&D is limited in efficient management because of the qualitative evaluation items and subjective allocation of points. In this paper, we developed a novel indicator for defense core technology R&D performance evaluation through domestic and foreign related literature and inquiry, brainstorming, and analysis techniques by Stepwise Multiple linear Regression(SMR) and Analytic Hierarchy Process(AHP). And we verified effectiveness of proposed indicators of performance evaluation by comparing with the existing evaluation indicators. Our proposed indicators for performance evaluation will create superiority performance on defense R&D fields.

• KIEAE Journal
• /
• v.15 no.5
• /
• pp.113-118
• /
• 2015

Purpose: In Korea, buildings make up 20.5% (2012) of the gross national energy consumption, so they are a major target for greenhouse gas reduction. In particular, energy consumption in multihousing represents approximately 32.6% of the entire building sector. With improving energy performance being the focus, efforts are continuously being made to reinforce standards and systems in greenhouse gas reduction. This study investigated the current status of multihousing in Korea in terms of energy performance as described in the performance evaluation reports submitted (to an institution that specializes in reviewing the performance evaluation of green homes) based on the construction criteria and performance codes for green homes and examined if the evaluation criteria using related methodologies were appropriate. The results will provide helpful information for reviewing the future directions of operations and amendments to the systems. Method: The overall characteristics of the system were examined using the evaluation methodologies (and current state of revisions) of the performance codes for green homes and comparing them with similar systems. Also, the current state of application and energy performance (conducted according to the evaluation methodologies) were compared by the evaluation institution for multihousing neighborhoods that were assessed for five years from 2010 to 2014. Result: It has been confirmed that the performance codes for green homes are different from other similar systems in evaluating performances of multihousing in that they allow both quantitative and qualitative methods of evaluation, and they consider both energy and sustainability simultaneously in the evaluation. Furthermore, regarding the adoption rate of the forms for the two evaluation methods (Form 1 - quantitative and Form 2 - qualitative), the rate preferring Form 2 increased gradually in time to reach 55.3% in 2014. In analyzing the rate of overall energy reduction (submitted in Form 1) and the coefficient of thermal transmission for each part (submitted in Form 2), it was observed that the deviation between the performance submitted and the criteria decreased in line with the level of reinforcement.

• Korea Journal of Hospital Management
• /
• v.4 no.2
• /
• pp.162-191
• /
• 1999

This study was conducted to establish finance performance evaluation model for physicians in each clinical department, by using factors which determines financial outcome(performance) in each clinical department The ultimate aim of study is to develop effective performance-based pay system for physicians. The system, by motivating physicians, should increase their productivity. To do so, it is critical to establish finance performance evaluation model to achieve final goal of this study. 232 private hospitals were chosen from 693 hospitals which were subject to hospital survey by the Korea Institute of Health Services Management and their revenue and expense-related data during 1997 were collected. By adopting multiple regression method, the study shows that the evaluation model for each clinical department was statistically significant. The study suggest the effective performance-based pay system based on financial performance of each clinical department. The pay system includes the level of compensation, the way of how to allocate profits to each department, and criteria whether the compensation should provide or not. In conclusion, the study has following implications. First, the study suggest finance performance evaluation model for each clinical department Second, the study suggest guidelines and plans to establish qualitative measure of financial performance in each clinical department. Third, the study suggest that adopting performance-based pay for physicians could be impetus to achieve organizational goal by motivating them with fair compensation.

• International conference on construction engineering and project management
• /
• 2009.05a
• /
• pp.1248-1253
• /
• 2009

Although there have been many efforts to reduce accidents on construction sites, such accidents continue to occur. New technologies have recently been developed to improve safety and their performance needs to be evaluated to determine their suitability prior to the application. The assessment for safety performance mainly is conducted depending on qualitative and subjective judgment of supervisors. However, there are rarely proper approaches to assess such qualitative measures. Therefore, we propose a fuzzy-based approach to assessing the performance of a new technology. The assessment of a new technology, called a mobile detector (MD), was carried out as a case study. The output is compared with those by a numerical simulation. As a result, the fuzzy-based performance assessment is shown to be appropriate for this evaluation.