• Title/Summary/Keyword: Evaluation approaches

Search Result 1,165, Processing Time 0.022 seconds

Summarization and Evaluation; Where are we today?!

  • Shamsfard, Mehrnoush;Saffarian, Amir;Ghodratnama, Samaneh
    • Proceedings of the Korean Society for Language and Information Conference
    • /
    • 2007.11a
    • /
    • pp.422-429
    • /
    • 2007
  • The rapid growth of the online information services causes the problem of information explosion. Automatic text summarization techniques are essential for dealing with this problem. There are different approaches to text summarization and different systems have used one or a combination of them. Considering the wide variety of summarization techniques there should be an evaluation mechanism to assess the process of summarization. The evaluation of automatic summarization is important and challenging, since in general it is difficult to agree on an ideal summary of a text. Currently evaluating summaries is a laborious task that could not be done simply by human so automatic evaluation techniques are appearing to help this matter. In this paper, we will take a look at summarization approaches and examine summarizers' general architecture. The importance of evaluation methods is discussed and the need to find better automatic systems to evaluate summaries is studied.

  • PDF

Classification of the Analytic Hierarchy Process Approaches by Application Circumstances

  • Yoon, Min-Suk;Kinoshita, Eizo
    • Management Science and Financial Engineering
    • /
    • v.16 no.1
    • /
    • pp.17-46
    • /
    • 2010
  • This paper studies six different AHP (Analytic Hierarchy Process) approaches and suggests that the features of the approaches are classified by application circumstances in order to contribute to the applicability and quality usage of the AHP. Our study investigates the hierarchical principles and characteristics of the AHP, and historical debates on the AHP evaluation in which the six approaches have been involved. One of six approaches is an ANP (Analytic Network Process) application that is directly connected to AHP usage. The application differences among the six approaches are validated with a plain example. Then, the four circumstances of AHP applications are classified by two dimensions: the first dimension is whether or not the importance (weights) of criteria is independent of restrictively setting alternatives, and the second dimension is whether or not preference (priorities) of alternatives is independent of adding alternative(s) to or removing alternative(s) from the considering set of alternatives. Then featuring way of weighting criteria is classified. We suggest the distinguishing manners and describe the implications of the AHP application. Finally, we discuss rank reversal and multiplicative AHP.

Comparison of a Qualitative and a Quantitative Approach to Evaluate the Performance of R&D Projects: A Case Study (연구개발 프로젝트 정성·정량평가 비교 분석을 통한 성과평가 발전방향 연구 : K연구원 사례를 중심으로)

  • Lee, Suchul;Ko, Mihyun
    • Journal of Korea Technology Innovation Society
    • /
    • v.20 no.2
    • /
    • pp.271-291
    • /
    • 2017
  • This study measures and compares the performance of research and development (R&D) programs in government-funded research institutes (GRIs) in terms of qualitative and quantitative approaches to find out strategic insights for improving performance evaluation policy. In particular, we adopt the evaluation results from the real data of K institute in 2015 for a qualitative evaluation and the results of data envelopment analysis (DEA) for a quantitative evaluation. Comparative analysis of the R&D performance of 14 programs finds that the difference between the evaluation results of qualitative and quantitative approaches is significant. From this finding, we suggest several strategic directions to complement two approaches each other.

Community-Based Participatory Approaches and a Social Ecological Model for School-Based Sex Education (학교 성교육을 위한 지역사회 참여형 접근법과 사회생태학 모델)

  • Yoo, Seung-Hyun
    • The Journal of Korean Society for School & Community Health Education
    • /
    • v.7
    • /
    • pp.19-32
    • /
    • 2006
  • Research supports that participatory strategies are central to the success of school-based sex education. Community-based participatory approaches are increasingly recognized as a central strategy for school-based sex education for their orientation towards participant engagement in program planning, content development, implementation, and evaluation. In combination with the community-based participatory approaches, a social ecological model holds values as a tool for facilitation and planning, and potentially as an evaluation aide for school-based sex education programs. This paper describes core concepts and principles of the community-based participatory research; illustrates a social ecological model organized for school-based sex education based on qualitative evaluation results of an abstinence education program in the United States ; and suggests application strategies of the presented approaches in school-based sex education in Korea.

  • PDF

Ranking Quality Evaluation of PageRank Variations (PageRank 변형 알고리즘들 간의 순위 품질 평가)

  • Pham, Minh-Duc;Heo, Jun-Seok;Lee, Jeong-Hoon;Whang, Kyu-Young
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.46 no.5
    • /
    • pp.14-28
    • /
    • 2009
  • The PageRank algorithm is an important component for ranking Web pages in Google and other search engines. While many improvements for the original PageRank algorithm have been proposed, it is unclear which variations (and their combinations) provide the "best" ranked results. In this paper, we evaluate the ranking quality of the well-known variations of the original PageRank algorithm and their combinations. In order to do this, we first classify the variations into link-based approaches, which exploit the link structure of the Web, and knowledge-based approaches, which exploit the semantics of the Web. We then propose algorithms that combine the ranking algorithms in these two approaches and implement both the variations and their combinations. For our evaluation, we perform extensive experiments using a real data set of one million Web pages. Through the experiments, we find the algorithms that provide the best ranked results from either the variations or their combinations.

Evaluation and Development in Sound Design a Matter of Combining Physical and Perception Data in Noise and Vibration

  • Schulte-Fortkamp, Brigitte
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2010.05a
    • /
    • pp.43-43
    • /
    • 2010
  • Presently, there is the dilemma of uncertainty with respect to the evaluation of sound and vibration based on the fact that there is obviously no agreement upon appropriate methods to measure the "truth" concerning the acceptance of sound and vibration. To evaluate properly physical and perception data in sound and vibration it is necessary to implement new methods and innovative approaches to understand the input of human response in sound design. Fortunately, an elaborate dialogue of the usefulness and applicability of those approaches is in progress. Moreover, the need of using and combining perception and physical data in order to comprehend the process of human perception and evaluation sufficiently is widely accepted. However, still the question remains how the goal of an adequate combination can be achieved. Clearly, themultidimensional human perception cannot be easily reduced to singular numbers. Moreover, factors, among others the meaning of the sound, the composition of the diverse sound sources, the listener's attitude, expectations and experiences, are significant parameters which have to be considered to comprehend the different perceptions and evaluations with regard to specific stimuli. Taking under consideration the physical, psychological, and cognitive dimensions as well as the integration of aspects of design require partially various new approaches. While binaural measurement and analysis technologies and psycho-acoustics are well established as they are proved to be valuable auxiliary tools; it has not been achieved to develop generally acceptable measurement units concerning sound quality. Consequently, there is a need for new approaches and methods which make it possible to comprehend sufficiently the process of perception and evaluation. Going with people's mind will be one solution for the future; thisconcept will be introduced based on the development in sound design.

  • PDF

Evaluation of Power Wheeling Costs Based on the Postage Stamp Method (우편요금제에 기초한 전력탁송 요금의 계산)

  • Park, Jong-Bae;Kim, Bal-Ho;Lim, Ju-Sung;Lee, Sang-Chul
    • Proceedings of the KIEE Conference
    • /
    • 1998.07c
    • /
    • pp.1015-1019
    • /
    • 1998
  • This paper presents the evaluation results of Korea Electric Power Corporation (KEPCO) system's power wheeling costs based on the postage stamp method. The results of several postage-stamp-based methodologies are compared where some of them are the conventional approaches. others are new approaches suggested in this paper. The approaches developed in this paper are suitable for a system where transmission transactions are occurred within a vertically integrated power system just like as Korea, Japan. etc. Also, they can overcome limitations related on the depreciation costs application. Test results show that the computed wheeling costs are around 4.0 [won/kWh] in 1995, and it is anticipated that the cost will increase when considering transmission network losses and ancillary costs.

  • PDF

Unified Reliability and Its Cost Evaluation in Power Distribution Systems Considering the Voltage Magnitude Quality and Demand Varying Load Model (전압 크기의 품질 및 전력수요 변동모델을 고려한 배전계통의 통합적인 신뢰도 및 비용 평가)

  • Yun, Sang-Yun
    • The Transactions of the Korean Institute of Electrical Engineers A
    • /
    • v.52 no.12
    • /
    • pp.705-712
    • /
    • 2003
  • In this paper, we propose new unified methodologies of reliability and its cost evaluation in power distribution systems. The unified method means that the proposed reliability approaches consider both conventional evaluation factor, i.e. sustained interruptions and additional ones, i.e. momentary interruptions and voltage sags. Because the three voltage quality phenomena generally originate from the outages on distribution systems, the basic and additional reliability indices are summarized considering the fault clearing mechanism. The proposed unified method is divided into the reliability evaluation for calculating the reliability indices and reliability cost evaluation for assessing the damage of customer. The analytic and probabilistic methodologies are presented for each unified reliability and its cost evaluation. The time sequential Monte Carlo technique is used for the probabilistic method. The proposed DVL(Demand Varying Load) model is added to the reliability cost evaluation substituting the average load model. The proposed methods are tested using the modified RBTS(Roy Billinton Test System) form and historical reliability data of KEPCO(Korea Electric Power Corporation) system. The daily load profile of the each customer type in domestic are gathered for the DVL model. Through the case studies, it is verified that the proposed methods can be effectively applied to the distribution systems for more detail reliability assessment than conventional approaches.

Strategic Management and Real Options (전략적 경영과 실물 옵션)

  • Sung woon, Choi
    • Proceedings of the Safety Management and Science Conference
    • /
    • 2003.11a
    • /
    • pp.329-333
    • /
    • 2003
  • This paper reviews differences between the traditional investment evaluation methods and real option approaches. This study considers management flexibility, contingency and volatility from a strategic management perspective. The roles of various real option approaches are discussed.

  • PDF

Ex-ante Evaluation Process for Public R&D: Korean Case and its Implications for Indonesian R&D System

  • Lee, Elly Hyanghee;Jang, Young-Sun;Ariyani, Luthfina;Sari, Karlina;Hardiyati, Ria
    • Asian Journal of Innovation and Policy
    • /
    • v.9 no.3
    • /
    • pp.281-307
    • /
    • 2020
  • A variety of approaches are being applied to improve the existing ex-ante evaluation by expert panels in publicly funded R&D. While the objective evaluation criteria are constantly being improved to screen and select the superior projects, alternative approaches such as random prioritization and logical modeling are also underway to overcome the conservative bias of reviewers and to secure disruptive innovation. This study intends to find critical implications for ex-ante evaluation of public R&D system from the comparison of Indonesia and Korea. For the comparative analysis, literature review and expert in-depth interviews are conducted on the national R&D system and the selection evaluation process. In Korea, the selection criteria of projects are legally promulgated for establishing an objective evaluation system, and at the program level, the major considerations in the planning process are specified by Presidential Decree. On the other hand, while Indonesia conducts R&D in 47 strategic fields largely by public research institutes (PRI) based on the non-competitive government contributions. This study draws out implications of institutionalizing the planning process at the level of program, and of increasing the ratio of contract-based competitive funding at the level of project in the national R&D portfolio.