• International conference on construction engineering and project management
• /
• 2011.02a
• /
• pp.426-431
• /
• 2011

The quality of performance evaluation on engineering consultants that provide design-related technical services is difficult to be measured, and only a handful of papers discussed the quality during the design stage. Although design cost is relatively far less than construction cost for a project, the decisions made in the design phase have a significant impact on the final products of the project, especially for large public construction projects. Therefore, this research focuses on reviewing and then establishing a performance evaluation framework for the consulting firms that execute detailed design and provide technical services for the Taipei Rapid Transit Systems (TRTS). By interviewing experts, this study first established a set of indicators to evaluate these firms' performance. Then, those indicators were incorporated into the four aspects of balanced scorecard (BSC) to establish the architecture of the evaluation mechanism. The weight of each indicator was calculated by analytic hierarchy process (AHP) from a survey conducted among experts. The results showed that the top-three indicators were quantity take-off, functions conformity, and budgeting. The framework of performance evaluation established by this study can be applied to measure service performance during the design stage. It not only facilitates the monitoring of consulting firms, but also helps to reduce unnecessary change orders and disputes during the construction stage.

• The Korean Journal of Franchise Management
• /
• v.13 no.1
• /
• pp.1-17
• /
• 2022

Purpose: In this study we aim to identify factors affecting successful inter-firm collaboration. We tried to find out whether government subsidies to small-business owners should be made to experienced and competent cooperatives or to cooperatives with potential even if inexperienced. Research design, data and methodology: Using analytic hierarchy process (AHP), we examine if evaluation criteria for the Small Business Collaboration Grant (SBCG) reflect the potential of successful collaboration of applicant cooperatives. Results: We found that experts tend to think that applicant cooperatives without any experience as a recipient for the SBSG need to be evaluated by their growth potential and their preparation of the application rather than by their business performance or achievement history. The weight of the evaluation must be different between the growth potential and the achievements already achieved. By means of an expert survey, we confirmed that Rookies should weigh evaluation indicators that can reflect their growth potential, and experienced groups should give weight to evaluation indicators that can reflect their achievements. Conclusions: For SBCG applicants with experiences, experts tend to weigh more on SBCG business performances and feasible sharing systems. The screening procedure for the first applicant cooperatives need to focus more on "partner selection" stage, whereas elements related to "realization" apply to experienced applicant cooperatives.

• Journal of the Korean Institute of Traditional Landscape Architecture
• /
• v.36 no.4
• /
• pp.113-123
• /
• 2018

The purpose of this research is to develop evaluation indicators forperformance improvement of horticultural therapy garden. In order to achieve a therapeutic purpose, the gardening activity held by the trained horticultural therapist. Moreover, horticultural therapy is 'a medical model' for the treatment and basic premise of the research was set, as horticultural therapy garden is characterized area to support activities of patients and horticultural therapist functionally and efficiently. For this study, three times of Delphi and AHP techniques were proceeded to export panels who were recruited by purposive sampling. Through these techniques, it was possible to deduct the evaluation indicator which maximizes the performance of the horticultural therapy garden. The evaluation items were prioritized by typing and stratification of the indicator. The results and discussions were stated as followings. Firstly, a questionnaire of experts was conducted to horticultural therapists and civil servants who were in charge of horticultural therapy. As results(horticultural therapists: 87.8%, civil servants: 75.2%), It is possible to conclude that both positions have the high recognition and agreed on the necessity of horticultural therapy. Secondly, Delphi investigation was conducted three times in order to develop the evaluation indicator for performance evaluation. After Delphi analysis, total 34 of evaluation elements to improve the performance of the horticultural therapy garden by reliability and validity analysis results. Thirdly, AHP analysis of each evaluation indicator was conducted on the relative importance and weighting. Moreover, the results showed 'interaction between nature and human' as the most important element, and in order of 'plan of the program', 'social interaction', 'sustainable environmental', and 'universal design rule', respectively. On the other hand, the exports from the university and research institute evaluated the importance of 'interaction between nature and human', while horticultural therapists chose 'plan of the program' as the most important element. Fourthly, the total weight was used to develop weight applied evaluation indicator for the performance evaluation of the horticultural therapy garden. The weight applying to evaluation index is generally calculated multiply the evaluation scores and the total weight using AHP analysis. Finally, 'the evaluation indicator and evaluation score sheet for performance improvement of the horticultural therapy garden' was finally stated based on the relative order of priority between evaluation indicators and analyzing the weight. If it was deducted the improvement points for the efficiency of already established horticultural therapy garden using the 'weight applied evaluation sheet', it is possible to expand it by judging the importance with the decision of the priority because the item importance decided by experts was reflected. Moreover, in the condition of new garden establishment, it is expected to be helpful in suggesting ways for performance improvement and in setting the guidelines by understanding the major indicators of performance improvement in horticultural therapy activity.

• Journal of Korea Technology Innovation Society
• /
• v.12 no.1
• /
• pp.113-136
• /
• 2009

The purpose of this study is to develop meta evaluating indicators for Defense R&D Programs in Korea. At first, the four components of this meta evaluation model were designed, which are evaluation context, evaluation input, evaluation process, evaluation output. And fifty two indicators were developed for this meta evaluation. Basic model of meta evaluation was derived from the literature review and brain storming. And this meta evaluation model was determined by adapting the result of experts who performed evaluations for Defense R&D Programs in recent years. Factor Analysis method was used to verify the validity of meta evaluation model. The survey of fifty three members turned out that Cronbach' ${\alpha}$ was over 0.6 in evaluation components and items. And the reliability of evaluation context was 0.877, that of evaluation input was 0.755, that of evaluation process was 0.755, that of evaluation output was 0.755 respectively. Analytic Hierarchy Process (AHP) method was used in assigning the evaluation weight. The survey of twenty two members showed that the Consistency Ratio was 0.09 in evaluation components and items.

• Journal of Korean Society of Rural Planning
• /
• v.28 no.1
• /
• pp.37-47
• /
• 2022

The purpose of this study is to introduce the concept of community resilience to rural society and build an index suitable for the reality of rural areas. Furthermore, by calculating the importance of evaluation factors, it was attempted to present priorities and alternatives for each evaluation factor. By stratifying the derived indicators, a survey was conducted targeting 20 researchers, practitioners, and public officials, three groups of experts working in rural areas who were well aware of the realities and problems of rural areas. In the survey, a pairwise comparison was performed to compare factors 1:1 to calculate the importance, and for rational and consistent decision-making, decisions were made in the 9-grade section. Using the collected data, consistency analysis that can evaluate reliability in the decision-making process and the relative weight of evaluation factors were calculated through AHP analysis. As a result of the analysis, as a result of examining the priority of final importance by summarizing the importance of all evaluation factors, 'Income creation using resources' > 'Population Characteristics' > 'Tolerance' > 'External Support' > 'Social Accessibility' > 'Physical Accessibility' > 'Community Competence' > 'Infrastructure' > 'Leader Competence' > 'Natural Environment' was derived in the order. In the study dealing with urban community resilience indicators, social aspects such as citizen participation, public-private cooperation, and governance were presented as the most important requirements, but this study differs in that the 'income creation' factor is derived as the most important factor. This can be seen through the change in the income difference between rural and urban areas. The income structure of rural areas has changed rapidly, and it is now reaching a very poor level, so it is necessary to prepare alternatives to 'income creation' in the case of rural areas. Unlike urban indicators, 'population characteristics' and 'tolerance' were also derived as important indicators of rural society. However, there are currently no alternatives to supplement the vulnerability by strengthening the resilience of rural communities. Based on the priority indicators derived from the study, we tried to suggest alternatives necessary for rural continuity in the future so that they can be supplemented step by step.

• International journal of advanced smart convergence
• /
• v.9 no.4
• /
• pp.52-61
• /
• 2020

The AHP method was used in 30 provinces of China to construct the index system of creative space efficiency evaluation and determine the weight of each index. The fuzzy comprehensive evaluation method was further used to score the indexes at all levels, and then the total efficiency score was sorted. The purpose of this study is to adjust the regional layout of creative space reasonably and implement financial policies accurately through the evaluation of the efficiency of creative space. The results is ranking top in weight of several indicators, which include the number of incubated Startups, the number of innovation and entrepreneurship mentors, the survival rate of incubator, the innovative training activities, etc. It was also found that Beijing, Shanghai, Jiangsu, Guangdong and Zhejiang ranked first in the score of creative space efficiency. This study is meaningful in that it was In order to effectively solve the problem of the imbalance of the creative space efficiency in China's province, by coordinating the regional pattern, establishing a sound service system and improving the efficiency evaluation system.

• Journal of the Korea Institute of Information Security & Cryptology
• /
• v.28 no.2
• /
• pp.501-511
• /
• 2018

The purpose of this study is to develop the performance evaluation indicator of information security training program for developing the next generation of top security leaders. Through literature review and focus group interview, we derived the performance areas and indicators based on the logic model. We conducted AHP(Analytic Hierarchy Process) questionnaire to calculate the weight of the derived indicators, and developed the performance indicator based on the survey results. Performance indicators were composed of 18 indicators in four main categories.

• The Journal of the Korea Contents Association
• /
• v.21 no.9
• /
• pp.704-713
• /
• 2021

The purpose of this study was to evaluate the relative weight of infectious disease vulnerability indicators that affect the occurrence and spread of infectious diseases in local communities. For this, the infectious disease vulnerability indicators were classified as facilities vulnerable to spread, vulnerable groups of infections, social vulnerable conditions, and response capabilities based on literature and case review, and the relative weights among indicators were determined using Analytic Hierarchy Process(AHP) by 22 experts. As a result of the analysis, the weight of each sector was found to be the highest in the facilities vulnerable to spread, and the overall weight was highest in the following order: sickbed securing rate(1st), density of religious facilities(2nd), medical personnel rate(3rd), elderly person ratio(4th), and entertainment establishment density(5th). These results can be used to prepare the supporting data necessary for the establishment of infectious disease response policies of local governments.

• Korean Journal of Community Nutrition
• /
• v.7 no.4
• /
• pp.495-505
• /
• 2002

A study was performed to develop as a screening tool the Simple Evaluation Questionnaire for Screening the Over-weight-type Dietary Pattern in 30 to 49 Year Old Adults. We used the data from the 30 to 49 year old subjects who participated in the three surveys - the health behavior survey, the dietary habit survey and the food intake survey - as the National Health and Nutrition Survey 1998. The 3,598 adults were classified into to two body fatness groups of normal (including underweight) and overweight (including obese) on the basis of their relative body weight (RBW) When comparing variables between the two groups, significant differences were found in gender, education, job, employment status, perceived health status, sadness / depression state, stress level, age, number of diseases, age when overweightedness started, maximum body weight, sleep length, drinking pattern (yes/no) , amount of alcoholic drinks, frequency of intoxication or drunkeness, amount of alcoholic drinks when drunk, intensity of exercise, frequency of exercise, exercise duration, skipped meals, small meals and drug supplements. In terms of food intake, there were significant differences in the daily food intake in terms of breakfast, dinner, daily kimchi and dairy products. In terms of mealtimes, we found differences in the amount of cooked rice at breakfast, kimchi at lunch, soup / kuk at dinner, fresh vegetables for snacks, fried foods for snacks between breakfast and lunch, and fruits /juices for snacks between lunch and dinner. After developing questions with indicators and analyzing the indicators by logistic regression analysis three times, we chose 10 questions for a simple evaluation of dietary patterns for the overweight-type category in order to give one point each. Among them we selected two questions to add one additional point and one question to add two additional points. The average scores of the overweight and normal groups, as shown by the developed questionnaire, were $5.97 \pm 2.36 \pm 7.36 \pm 2.21$, respectively. A score of seven points was selected as the cut-off point. We examined the sensitivity, specificity and positive predictive value of the questionnaire to the results of 67%, 59% and 62%, respectively.

• Journal of the Korea Safety Management & Science
• /
• v.18 no.1
• /
• pp.209-217
• /
• 2016

This study with the aim to develop a system that can be objectively measured and evaluated as a scientific support and of R&D. To this end, this study aimed at companies participating in the development of national technology transfer support program for SMEs examined the factors affecting performance. By developing metrics that meet the business objectives refer to the applicable national and international case studies and literature reviews, etc. In order to achieve the systematization of technology evaluation index, which was selected indicators. To evaluate the weight through the duality comparing selected indicators in order to take advantage of the AHP analysis conducted targeted surveys.