• Title/Summary/Keyword: 정량.정성적 평가

Search Result 799, Processing Time 0.038 seconds

A Case Study on the Correlation between the Quantitative and the Qualitative Evaluation of IT Investment Performance (IT 투자성과의 정량적 평가와 정성적 평가의 상관관계에 관한 연구)

  • Lee, Jae-B.;Hong, Yu-Jin;Chang, Yun-Hi
    • Information Systems Review
    • /
    • v.9 no.2
    • /
    • pp.149-168
    • /
    • 2007
  • As the need for quantitative qualities of IT investment performance heightens, numerous research organizations are developing various measurement methods for the quantitative evaluation and its currency value conversion. Corporations utilizing these methods to evaluate IT investment performance are gradually increasing. However, working-level staff in the corporations that have introduced the quantitative evaluation can not assure if the evaluation sufficiently reflects the actual effect provided by IT since the results arising from the conversion of currency value can't be visibly confirmed. This study tries to identify whether the quantitative evaluation of IT investment performance can be explained in terms of the level of consumer satisfaction proven by the qualitative evaluation by analyzing the level of consumer satisfaction and quantitative evaluation of a case company and identifying the correlation between them. As the result of the case study, the following points have been concluded. Firstly, the currency value of IT effect correlates with the level of consumer satisfaction. Secondly, in order to come up with a rational currency value of IT effect, developing an indicator as well as managing data on currency conversion that will enable the internal system's efficiency to become more quantitative is essential. Thirdly, IT ROI is not appropriate to compare the performance between systems and is utilized as a measurement standard for each system's performance and efficiency. Lastly, quantitative evaluation is still inadequate in the evaluation of the system's strategic side, and consumer satisfaction can be utilized as a supplementary method.

A Study on Evaluating Summarization Performance using Generative Al Model (생성형 AI 모델을 활용한 요약 성능 평가 연구 )

  • Gyuri Choi;Seoyoon Park;Yejee Kang;Hansaem Kim
    • Annual Conference on Human and Language Technology
    • /
    • 2023.10a
    • /
    • pp.228-233
    • /
    • 2023
  • 인간의 수동 평가 시 시간과 비용의 소모, 주석자 간의 의견 불일치, 평가 결과의 품질 등 불가피한 한계가 발생한다. 본 논문에서는 맥락을 고려하고 긴 문장 입출력이 가능한 ChatGPT를 활용한 한국어 요약문 평가가 인간 평가를 대체하거나 보조하는 것이 가능한가에 대해 살펴보았다. 이를 위해 ChatGPT가 생성한 요약문에 정량적 평가와 정성적 평가를 진행하였으며 정량적 지표로 BERTScore, 정성적 지표로는 일관성, 관련성, 문법성, 유창성을 사용하였다. 평가 결과 ChatGPT4의 경우 인간 수동 평가를 보조할 수 있는 가능성이 있음을 확인하였다. ChatGPT가 영어 기반으로 학습된 모델임을 고려하여 오류 발견 성능을 검증하고자 한국어 오류 요약문으로 추가 평가를 진행하였다. 그 결과 ChatGPT3.5와 ChatGPT4의 오류 요약 평가 성능은 불안정하여 인간을 보조하기에는 아직 어려움이 있음을 확인하였다.

  • PDF

Feasibility Study on the Risk Quantification Methodology of Railway Level Crossings (철도건널목 위험도 정량평가 방법론 적용성 연구)

  • Kang, Hyun-Gook;Kim, Man-Cheol;Park, Joo-Nam;Wang, Jong-Bae
    • Proceedings of the KSR Conference
    • /
    • 2007.05a
    • /
    • pp.605-613
    • /
    • 2007
  • In order to overcome the difficulties of quantitative risk analysis such as complexity of model, we propose a systematic methodology for risk quantification of railway system which consists of 6 steps: The identification of risk factors, the determination of major scenarios for each risk factor by using event tree, the development of supplementary fault trees for evaluating branch probabilities, the evaluation of event probabilities, the quantification of risk, and the analysis in consideration of accident situation. In this study, in order to address the feasibility of the propose methodology, this framework is applied to the prototype risk model of nation-wide railway level crossings. And the quantification result based on the data of 2005 in Korea will also be presented.

  • PDF

Developing A Quantitative Evaluation Model for Information System Security Auditing (정보시스템 보안감리평가의 정량화모델 개발)

  • Kim, Dong-Soo;Kim, Hyun-Soo
    • 한국IT서비스학회:학술대회논문집
    • /
    • 2003.05a
    • /
    • pp.363-370
    • /
    • 2003
  • 지금까지 국내 보안감리 평가는 정성적인 평가에 머물러 있어 평가를 담당하는 감리인마다 평가 결과가 서로 상이하여 피 평가자에게 신뢰를 심어주지 못하는 결과가 초래되고 있다. 본 연구에서는 보안감리에 대한 국내의 연구와 해외 사례를 참조하여 SI사업에서의 보안감리평가 효율성을 제고할 수 있는 방안 및 평가체계를 정량화하는 방안을 제시하였다. 이를 위해 SI사업의 소프트웨어 개발 및 개발 환경(네트워크, 서버 등)을 중심으로 한국전산원에서 제시하고 있는 보안감리 지침과 한국정보시스템감리인협회의 보안관련 세부 감리지침을 통합하고 세부 감리지침에 따른 평가를 정량화 하였다. 보안감리 평가의 정량화 방안에 대한 감리전문가의 인터뷰와 사례 프로젝트의 적용을 통하여 연구 모형에 대한 검증을 실시하였다.

  • PDF

An Analysis of Junior High School Students' Open Investigation into Electricity and Magnetism in Two Kinds of Tasks: Qualitative and Quantitative (전기와 자기에 대한 중학생들의 개방적 탐구에서 과제 유형에 따른 탐구 수행 분석)

  • Hwang, Sung-Won;Pak, Sung-Jae
    • Journal of The Korean Association For Science Education
    • /
    • v.21 no.2
    • /
    • pp.255-263
    • /
    • 2001
  • The purpose of this study is to analyse the eighth grade students' performance of open investigations for two kinds of tasks: the qualitative one which involves the descriptive approach through observation, and the quantitative one which involves the quantitative data processing through control of variables. Researcher's observation, interview data as well as students' investigation reports, self-evaluations were analysed. The difficulties of qualitative open investigation lie in detecting and dealing with unexpected observations, of which the acceptance and interpretation were influenced by preconceptions. On the other hand, managing several variables, making reliable and valid measures, and quantitative data processing constituted main difficulties of quantitative open investigation. Some students could recognize the deficiencies of their methods and findings in qualitative one, but few in quantitative one. These results suggest the teaching point for each task of open investigations.

  • PDF

Consideration for evaluation patterns of normalized RMR parameters (정규화한 RMR 변수들의 평가 경향에 대한 고찰)

  • Lee, Seong-Min;Lee, Yeon-Hee;Kim, Sun-Myung
    • Journal of Korean Tunnelling and Underground Space Association
    • /
    • v.14 no.1
    • /
    • pp.23-35
    • /
    • 2012
  • Due to the convenience, RMR has been widely applied in civil engineering works such as tunnel, slope, and so on. Many researchers have studied to suggest more simple and trustable RMR by modifying its parameters. However, those researches have just focused on looking for easy modified-RMRs by reducing number of parameters using various statistical analyses. Therefore, this research studied questions of modified-RMRs and gaps between RMR and its parameters. Approximately 2,000 parameters of 400 RMRs from various tunnel sites were normalized respectively and compared with one another to study their relations and divergences. The comparison results showed that there were common patterns among RMR and parameters. Data of uniaxial compressive strength and RQD, qualitative parameters, were located in upper side of RMR line. Discontinuity condition and ground water, quantitative oriented parameters, were opposite to them. It means if both qualitative and quantitative parameters can be properly combined then it can be easy to make simple and easy modified-RMRs without using difficult statistics. This results also show that the majority of field engineers used to estimate RMR conservatively when they did quantitative oriented parameters.

A Study of Qualitative and Quantitative Risk Assessment for Highway Safety Facilities (고속도로 교통안전시설물의 정성적 및 정량적 위험도분석 연구)

  • Ji, Dong-Han;O, Yeong-Tae;Choi, Hyun-Ho
    • Korean Journal of Construction Engineering and Management
    • /
    • v.8 no.4
    • /
    • pp.99-109
    • /
    • 2007
  • Risk elements of highway safety facilities are affected by complex environments. Thus, risk-based approach for traffic safety facilities is needed. For this, in this study, qualitative and quantitative risk assessment methodology and procedure for highway safety facilities is proposed, which can be used as risk-based approach incorporating VE process. Also, for the quantitative risk assessment, event tree using EPDO(Equivalent Property Damage Only) with respect to frequency and magnitude of risk events is introduced. As a result, risk index of alternative 1(140cm) and 2(127(cm) which can be used as performance factor in VE approach are estimated.

A Study on Selection of Effective Supplier Using Fuzzy Theory in Supply Chain Management (공급체인관리하에서 퍼지이론을 이용한 효율적인 협력업체 선정에 관한 연구)

  • Kim Jin-Ho;Lee Byong-Ki
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 2003.05a
    • /
    • pp.252-257
    • /
    • 2003
  • 공급체인관리(SCM)에서, 고객의 반응에 민감하게 반응할 수 있기 위해서는 무엇보다도 부품이나 자재를 공급하는 협력업체의 능력이 중요한 요인으로 작용한다. 본 논문은 퍼지이론을 이용하여 과학적인고 효율적으로 협력업체를 평가하고, 우수협력업체를 선정하는데 있다. 협력업체의 평가를 위하여 여러 가지 요인을 분석하여야 하는데, 이런 요인들 중에는 수치적으로 표현 가능한 정량적인 요인이 있는 반면에, 협력업체 제품의 품질이나 재정적 상태와 같은 수치적으로 표면 불가능한 정량적인 요인도 포함되어 있다. 본 논문에서는 정량적인 요인과 정성적인 요인을 퍼지추론(Fuzzy Inference)을 통해 분석함으로써 협력업체를 평가하고 최우수 협력 업체를 선정하여, SCM환경에서 성공적인 협력관계를 지속적으로 유지할 수 있는 방법론을 제시하고자 한다.

  • PDF

An Evaulation of University Sites in Korea Based on Information Architecture Criteria (인포메이션 아키텍처의 기준에 의거한 대학사이트 평가에 관한 연구)

  • 오삼균
    • Journal of the Korean Society for information Management
    • /
    • v.18 no.3
    • /
    • pp.115-138
    • /
    • 2001
  • The purpose of this study is to provide general principles to be used in designing university websites from the perspective of information architecture. Quantitative and qualitative evaluation criteria of web sites were developed based on information architecture principles. The students taking IA class were directly involved in constructing the evaluation criteria and they can be classified into four categories: 1) information organization; 2) navigation system; 3) labeling system; and searching system. These criteria were employed in evaluating twenty randomly selected university websites in Korea. General principles to be used in designing university websites were developed based on the findings of the study. They are composed of four major components in designing: 1) systematic information organization; 2) flexible navigation system; 3) consistent labeling system; and 4) efficient searching system.

  • PDF