• Title/Summary/Keyword: Development of evaluation criteria

Search Result 1,092, Processing Time 0.03 seconds

A study on the evaluation system of climate policy measures in the water resource sector: A case study of Chungcheongnam-do's climate change adaptation implementation plan (수자원 분야 기후정책의 평가시스템에 관한 연구: 충청남도 기후변화적응대책 세부시행계획을 중심으로)

  • Park, Hun;Cho, Ara;Choi, Dongjin
    • Journal of Korean Society of Water and Wastewater
    • /
    • v.33 no.6
    • /
    • pp.421-428
    • /
    • 2019
  • This study developed an evaluation system of adaptation countermeasures for climate change in the water resources sector using the Analytic Hierarchy Process (AHP), and the assessment procedures were applied to the Second Chungcheongnam-do Climate Change Adaptation Implementation Plan (Chungnam Implementation Plan). Firstly, the evaluation criteria are composed of two levels according to the hierarchical structure, and AHP gives priority to 4 evaluation criteria of the first level and 16 alternative indicators of the second level. Secondly, after the importance of the evaluation criteria or indicators has been determined, the significance of each measure was evaluated by applying it to the water-sector measures of the Chungnam Implementation Plan, and the effectiveness of the evaluation system was validated. The Chungnam case study shows that the evaluation system will be more effective and efficient when it is applied during development phase rather than after the implementation plan is finalized. It is also expected that the evaluation system will be used to evaluate and prioritize climate change adaptation policies in other regions, and then to compare the means of adaptation to climate change in various regions and to select recommendation policies.

Development of Low Carbon Hydrogen Production Technology Evaluation Model Using Delphi-AHP Method (Delphi-AHP 방법을 이용한 저탄소수소 생산 기술 가치평가 모델 개발)

  • HO SEOK WHANG;UISIK KIM;YOUNGSHIN JANG;JUNGHWAN KIM;KWANG JUN KIM
    • Transactions of the Korean hydrogen and new energy society
    • /
    • v.34 no.2
    • /
    • pp.113-121
    • /
    • 2023
  • Recently, low hydrogen carbon production technology is drawing interest due to lower production costs. Although the pace of research in this field has been accelerating, there is no well-established criteria for evaluation. The most of current evaluation methods needs information related to technology. However the technology is not enough to provide effective evaluation criteria because the technology is not fully developed. In this study, we propose an integrated Delphi-analytic hierarchy process (AHP) method and low carbon hydrogen production technology evaluation model. Experts opinion is used to provide evaluation criteria for the technology. In this study, integrated Delphi-AHP method are utilized for determining factors and calculating their numerical importance based on experts opinion. Then, sensitivity analysis is performed to verify the robustness of the analysis and scenarios of potential changes. As many as 11 factors are identified by Delphi method. Then, numerical importance of the factors are calculated by AHP. Sensitivity analysis is performed. It shows that intellectual property right (IPR) is always more important than other factors. This study proposes the numerical standard for the low carbon hydrogen production technology evaluation. The proposed model can be used for technology evaluation or commercialization.

Methodology for Identifying Issues of User Reviews from the Perspective of Evaluation Criteria: Focus on a Hotel Information Site (사용자 리뷰의 평가기준 별 이슈 식별 방법론: 호텔 리뷰 사이트를 중심으로)

  • Byun, Sungho;Lee, Donghoon;Kim, Namgyu
    • Journal of Intelligence and Information Systems
    • /
    • v.22 no.3
    • /
    • pp.23-43
    • /
    • 2016
  • As a result of the growth of Internet data and the rapid development of Internet technology, "big data" analysis has gained prominence as a major approach for evaluating and mining enormous data for various purposes. Especially, in recent years, people tend to share their experiences related to their leisure activities while also reviewing others' inputs concerning their activities. Therefore, by referring to others' leisure activity-related experiences, they are able to gather information that might guarantee them better leisure activities in the future. This phenomenon has appeared throughout many aspects of leisure activities such as movies, traveling, accommodation, and dining. Apart from blogs and social networking sites, many other websites provide a wealth of information related to leisure activities. Most of these websites provide information of each product in various formats depending on different purposes and perspectives. Generally, most of the websites provide the average ratings and detailed reviews of users who actually used products/services, and these ratings and reviews can actually support the decision of potential customers in purchasing the same products/services. However, the existing websites offering information on leisure activities only provide the rating and review based on one stage of a set of evaluation criteria. Therefore, to identify the main issue for each evaluation criterion as well as the characteristics of specific elements comprising each criterion, users have to read a large number of reviews. In particular, as most of the users search for the characteristics of the detailed elements for one or more specific evaluation criteria based on their priorities, they must spend a great deal of time and effort to obtain the desired information by reading more reviews and understanding the contents of such reviews. Although some websites break down the evaluation criteria and direct the user to input their reviews according to different levels of criteria, there exist excessive amounts of input sections that make the whole process inconvenient for the users. Further, problems may arise if a user does not follow the instructions for the input sections or fill in the wrong input sections. Finally, treating the evaluation criteria breakdown as a realistic alternative is difficult, because identifying all the detailed criteria for each evaluation criterion is a challenging task. For example, if a review about a certain hotel has been written, people tend to only write one-stage reviews for various components such as accessibility, rooms, services, or food. These might be the reviews for most frequently asked questions, such as distance between the nearest subway station or condition of the bathroom, but they still lack detailed information for these questions. In addition, in case a breakdown of the evaluation criteria was provided along with various input sections, the user might only fill in the evaluation criterion for accessibility or fill in the wrong information such as information regarding rooms in the evaluation criteria for accessibility. Thus, the reliability of the segmented review will be greatly reduced. In this study, we propose an approach to overcome the limitations of the existing leisure activity information websites, namely, (1) the reliability of reviews for each evaluation criteria and (2) the difficulty of identifying the detailed contents that make up the evaluation criteria. In our proposed methodology, we first identify the review content and construct the lexicon for each evaluation criterion by using the terms that are frequently used for each criterion. Next, the sentences in the review documents containing the terms in the constructed lexicon are decomposed into review units, which are then reconstructed by using the evaluation criteria. Finally, the issues of the constructed review units by evaluation criteria are derived and the summary results are provided. Apart from the derived issues, the review units are also provided. Therefore, this approach aims to help users save on time and effort, because they will only be reading the relevant information they need for each evaluation criterion rather than go through the entire text of review. Our proposed methodology is based on the topic modeling, which is being actively used in text analysis. The review is decomposed into sentence units rather than considering the whole review as a document unit. After being decomposed into individual review units, the review units are reorganized according to each evaluation criterion and then used in the subsequent analysis. This work largely differs from the existing topic modeling-based studies. In this paper, we collected 423 reviews from hotel information websites and decomposed these reviews into 4,860 review units. We then reorganized the review units according to six different evaluation criteria. By applying these review units in our methodology, the analysis results can be introduced, and the utility of proposed methodology can be demonstrated.

A Study on The Evaluation Criteria of Carbon Emission and the Development of the Evaluation Method in Apartment House (공동주택을 대상으로 한 탄소배출 평가기준 구축 및 평가방법 개발)

  • Choi, Doo-Sung;Chun, Hung-Chan
    • KIEAE Journal
    • /
    • v.13 no.5
    • /
    • pp.79-88
    • /
    • 2013
  • This study creates the evaluation criteria to analyze the $CO_2$ emission quantity in the complex of apartment house among domestic buildings and proposes how to calculate the $CO_2$ emission quantity by the only simple information of apartment house. The study shows that in order to create the index of carbon emission evaluation criteria, $CO_2$ emission quantity for its input materials in these 27 apartment houses are 445,412g-$CO_2/m^2$ for apartment building, 474,322g-$CO_2/m^2$ for the basement parking lot, 483,523g-$CO_2/m^2$ for welfare facility, 729,957g-$CO_2/m^2$ for sales facility, 743,560g-$CO_2/m^2$ for other facility, 26,782g-$CO_2/m^2$ for public facility, 43,659g-$CO_2/m^2$ for landscape, 1,113g-$CO_2/m^2$ for indoor facility, 11,251g-$CO_2/m^2$ for outdoor facility and 891g-$CO_2/m^2$ for common temporary based on the average $CO_2$ emission by facility. We can also see the analysis data that in case of using the selected factors only, the rate of error is 7.51% comparing with the emission quantity by using simplified LCA method this study suggests for the whole range of apartment houses and the rate of error is average 3.24% using selective and main materials. And this it is evaluated that we can get the result which is similar to the actual $CO_2$ emission quantity with only the simple information about the apartment house.

Development of an Evaluation Framework for School Bus Operation Service (어린이 통학버스 운영 서비스 평가체계 개발)

  • Bohyun Pak;Hyeinn Song;Kangwon Shin
    • Journal of Auto-vehicle Safety Association
    • /
    • v.15 no.4
    • /
    • pp.79-87
    • /
    • 2023
  • In recent years, the population of children has been declining in Korea. Moreover, the phenomenon of elementary school closures is on the rise, particularly in non-urban and some new city areas, highlighting the need for school buses for children. Despite the mandatory safety features in place, accidents involving school buses for children are on the rise, underscoring the need for improvement in the safety of these vehicles. While various studies have been conducted to enhance the safety of children during their school commute, there has been a notable gap in research analyzing the school commuting environment concerning the vehicle safety of these buses. Hence, this study aims to develop a set of service evaluation criteria for school bus routes, considering vehicle safety through the Analytic Hierarchy Process (AHP). By conducting a survey to gather information on the current status of school buses for children and through questionnaires targeting stakeholders in the school bus sector, the study analyzed requirements and operating conditions. These results were used to select evaluation criteria and structure the hierarchy based on the external and internal aspects of school bus services. Through AHP surveys conducted based on the designed criteria, experts identified safety as the most crucial aspect, with a specific emphasis on Vehicle Safety. Using these developed service evaluation criteria, the study plans to identify service-vulnerable routes through a real route analysis and recommend improvements, with the ultimate goal of creating a safe and convenient school commuting environment for children.

The Development of the Evaluation Tool of Group Occupational Health Program for Workers of Small and Medium Sized Industries (중소기업 근로자 보건관리대행기관 QA 평가지표의 개발과정)

  • Cho, Soo-Hun;Kim, Sun-Min;Kim, Chang-Yup;Hong, Yun-Chul;Ha, Eun-Hee
    • Quality Improvement in Health Care
    • /
    • v.2 no.2
    • /
    • pp.72-111
    • /
    • 1996
  • Background: Group occupational health program by non-for-profit agency, started five years ago, for management of health problems in small and medium sized industries, is one of the measures to cope with limited human and financial resources in occupational health. The program has been rapidly expanding to include 54 participating institutions, private as well as public, all over the country. In spite of its potential impact on health of employees and practice of occupational health in small and medium sized industries, comprehensive evaluation in terms of quality has not been tried. Objectives : The aim of this study are to develop and apply criteria to assess quality of newly developed Korean group occupational health program. Methods : By defining occupational health services, in particular for small and medium sized industries, as one of the primary health care, we included followings as core elements of sound occupational health program; accessibility, continuity, intersectoral collaboration, comprehensiveness, community participation, technical quality, adequacy, focus on preventive services, acceptability, and workers' satisfaction. Again we divided each elements into five major components of national health system infrastructures developed by World Health Organization; development of health resources organized arrangement or resources, delivery of health care, economic support, and management. In turn, we categorized each component into input, process and outcome aspects. After discussions in expert panel, several criteria were selected for evaluation of program. The criteria were modified according to each group of interviewees. Results: We developed five sets of questionnaire that evaluate the quality of 'Group occupational health program'. Conclusion : The refining of the measurement tool and the continuing evaluation process for the 'Group occupational health institute' should be done further.

  • PDF

Criteria for Critique of Qualitative Nursing Research (질적 연구평가 기준)

  • 신경림
    • Journal of Korean Academy of Nursing
    • /
    • v.26 no.2
    • /
    • pp.497-506
    • /
    • 1996
  • Gradually, there has been increase in the use of qualitative research methods in nursing research. Nursing scholars are using qualitative research methods to explore the essence of nursing and discover its meaning. However, there has been lack of standards for evaluating qualitative nursing research. Often nursing researchers are applying quantitative research evaluation standards to qualitative nursing research. Thus, there has not been any notable qualitative research done to date. In order to improve the quality of nursing research done to discover new knowledge for the nursing, & for development of nursing theory, criteria for critiquing qualitative research should be established. Therefore, this researcher introduced standards as criteria for critiquing qualitative research which are based on literature reviews and re search experiences. The suggested criteria are developed several question's as follows : 1) description of the research phenomena, 2) significance, 3) research purpose, 4) research question, 5) assumptions, 6) researcher's abilities, 7) selection of research samples, 8) data collection, 9) human subjects, 10) data analysis, 11) description of researcher's results, 12) literature review. Follow-up of concrete questions for each of the criterias have been developed.

  • PDF

A guideline for evaluating EIS software packages

  • Byun, Daeho;Suh, Euiho
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 1994.04a
    • /
    • pp.344-354
    • /
    • 1994
  • In the development of executive information systems (EIS) the selection of an appropriate software package as a system building tool is regarded as a key technology. This paper attempts to shed some light on the evolving field of EIS software packages and provides a helpful Guideline for selecting the most suitable product by addressing significant considerations. A framework is presented that includes a six-step evaluation process: need analysis, team building, vendor survey, identification of decision criteria, and building an evaluation model and its verification. The major evaluation criteria of the full-featured software include: special functionality, reporting, graphics. decision support capability user friendliness, general functionality physical requirements, communication linkage, vendor support, cost related factors, performance, and documentation capability. An illustrative model using the analytic hierarchy process (AHP) method is also discussed to prove the appropriateness of our approach.

A Study on the Integration of Local Public Enterprise Evaluation(LPEE) and Malcolm Baldrige Model(MBM) (지방공기업 경영평가와 경영품질모형의 통합화에 관한 연구)

  • Choi, Kil-Soo
    • Journal of Korean Society for Quality Management
    • /
    • v.36 no.4
    • /
    • pp.65-76
    • /
    • 2008
  • The purpose of this study is to contribute to escalation of a management quality of local public enterprise through integrating local public enterprise evaluation(LPEE) and Malcolm Baldrige Model(MBM). In order to achieve the purpose, I suggested that develop an integration model of LPEE and MBM criteria and use AHP(Analytic Hierarchy Process) as a technique posting weight value to criteria. Of two suggests, it is the former to date or discuss seriously. Therefore the integration model is redesigned for leadership/strategy category(leadership, strategy), management system category(customer management system, business management system, measurement/knowledge management system), and management result category(business result, customer satisfaction result, human resource management result, financial management result).