A Study on the Evaluation of an Expert System에s Performance : Lens Model Analysis

전문가시스템의 성능평가에 관한 연구 : 렌즈모델분석

  • 김충영 (서울시립대학교 경영학부)
  • Published : 2004.03.01

Abstract

Since human decision making behavior is likely to follow nonlinear strategy, it is conjectured that the human decision making behavior can be modeled better by nonlinear models than by linear models. All that linear models can do is to approximate rather than model the decision behavior. This study attempts to test this conjecture by analyzing human decision making behavior and combining the results of the analysis with predictive performance of both linear models and nonlinear models. In this way, this study can examine the relationship between the predictive performance of models and the existence of valid nonlinear strategy in decision making behavior. This study finds that the existence of nonlinear strategy in decision making behavior is highly correlated with the validity of the decision (or the human experts). The second finding concerns the significant correlations between the model performance and the existence of valid nonlinear strategy which is detected by Lens Model. The third finding is that as stronger the valid nonlinear strategy becomes, the better nonlinear models predict significantly than linear models. The results of this study bring an important concept, validity of nonlinear strategy, to modeling human experts. The inclusion of the concept indicates that the prior analysis of human judgement may lead to the selection of proper modeling algorithm. In addition, lens Model Analysis is proved to be useful in examining the valid nonlinearity in human decision behavior.

Keywords