• Title/Summary/Keyword: classification of mathematical errors

Search Result 12, Processing Time 0.02 seconds

Ensemble Learning with Support Vector Machines for Bond Rating (회사채 신용등급 예측을 위한 SVM 앙상블학습)

  • Kim, Myoung-Jong
    • Journal of Intelligence and Information Systems
    • /
    • v.18 no.2
    • /
    • pp.29-45
    • /
    • 2012
  • Bond rating is regarded as an important event for measuring financial risk of companies and for determining the investment returns of investors. As a result, it has been a popular research topic for researchers to predict companies' credit ratings by applying statistical and machine learning techniques. The statistical techniques, including multiple regression, multiple discriminant analysis (MDA), logistic models (LOGIT), and probit analysis, have been traditionally used in bond rating. However, one major drawback is that it should be based on strict assumptions. Such strict assumptions include linearity, normality, independence among predictor variables and pre-existing functional forms relating the criterion variablesand the predictor variables. Those strict assumptions of traditional statistics have limited their application to the real world. Machine learning techniques also used in bond rating prediction models include decision trees (DT), neural networks (NN), and Support Vector Machine (SVM). Especially, SVM is recognized as a new and promising classification and regression analysis method. SVM learns a separating hyperplane that can maximize the margin between two categories. SVM is simple enough to be analyzed mathematical, and leads to high performance in practical applications. SVM implements the structuralrisk minimization principle and searches to minimize an upper bound of the generalization error. In addition, the solution of SVM may be a global optimum and thus, overfitting is unlikely to occur with SVM. In addition, SVM does not require too many data sample for training since it builds prediction models by only using some representative sample near the boundaries called support vectors. A number of experimental researches have indicated that SVM has been successfully applied in a variety of pattern recognition fields. However, there are three major drawbacks that can be potential causes for degrading SVM's performance. First, SVM is originally proposed for solving binary-class classification problems. Methods for combining SVMs for multi-class classification such as One-Against-One, One-Against-All have been proposed, but they do not improve the performance in multi-class classification problem as much as SVM for binary-class classification. Second, approximation algorithms (e.g. decomposition methods, sequential minimal optimization algorithm) could be used for effective multi-class computation to reduce computation time, but it could deteriorate classification performance. Third, the difficulty in multi-class prediction problems is in data imbalance problem that can occur when the number of instances in one class greatly outnumbers the number of instances in the other class. Such data sets often cause a default classifier to be built due to skewed boundary and thus the reduction in the classification accuracy of such a classifier. SVM ensemble learning is one of machine learning methods to cope with the above drawbacks. Ensemble learning is a method for improving the performance of classification and prediction algorithms. AdaBoost is one of the widely used ensemble learning techniques. It constructs a composite classifier by sequentially training classifiers while increasing weight on the misclassified observations through iterations. The observations that are incorrectly predicted by previous classifiers are chosen more often than examples that are correctly predicted. Thus Boosting attempts to produce new classifiers that are better able to predict examples for which the current ensemble's performance is poor. In this way, it can reinforce the training of the misclassified observations of the minority class. This paper proposes a multiclass Geometric Mean-based Boosting (MGM-Boost) to resolve multiclass prediction problem. Since MGM-Boost introduces the notion of geometric mean into AdaBoost, it can perform learning process considering the geometric mean-based accuracy and errors of multiclass. This study applies MGM-Boost to the real-world bond rating case for Korean companies to examine the feasibility of MGM-Boost. 10-fold cross validations for threetimes with different random seeds are performed in order to ensure that the comparison among three different classifiers does not happen by chance. For each of 10-fold cross validation, the entire data set is first partitioned into tenequal-sized sets, and then each set is in turn used as the test set while the classifier trains on the other nine sets. That is, cross-validated folds have been tested independently of each algorithm. Through these steps, we have obtained the results for classifiers on each of the 30 experiments. In the comparison of arithmetic mean-based prediction accuracy between individual classifiers, MGM-Boost (52.95%) shows higher prediction accuracy than both AdaBoost (51.69%) and SVM (49.47%). MGM-Boost (28.12%) also shows the higher prediction accuracy than AdaBoost (24.65%) and SVM (15.42%)in terms of geometric mean-based prediction accuracy. T-test is used to examine whether the performance of each classifiers for 30 folds is significantly different. The results indicate that performance of MGM-Boost is significantly different from AdaBoost and SVM classifiers at 1% level. These results mean that MGM-Boost can provide robust and stable solutions to multi-classproblems such as bond rating.

A Study of Teachers' Pedagogical Content Knowledge about Area of Plane Figure (평면도형의 넓이 지도에 대한 교사의 PCK 분석)

  • Park, Sun Young;Kang, Wan
    • Journal of Educational Research in Mathematics
    • /
    • v.22 no.4
    • /
    • pp.495-515
    • /
    • 2012
  • This study is to diversely analyze teachers' Pedagogical Content Knowledge (PCK) regarding to the area of plane figures and discuss the consideration for the materialization of the effective class in learning the area of plane figures by identifying the improvements based on problems indicated in PCK. The subjects of inquiry are what the problems with teachers' PCK regarding to the area of plane figures are and how they can be improved. In which is the first domain of PCK, teachers need to fully understand the concept of the area and the properties and classification of the area and length, recognized the sequence structure as a subject of guidance and improve the direction which naturally connects the flow of measurement by using random units in guidance of the area. In which is the second domain of PCK, teachers need to establish understanding of the concept for the area and understanding of a formula as a subject matter object and improve the activity, discovery and research oriented class for students as a guidance method by escaping from teacher oriented expository class and calculation oriented repetitive learning. They also need to avoid the biased evaluation of using a formula and evenly evaluate whether students understand the concept of the area as a performance evaluation method. In which is the third domain of PCK, teachers need to fully understand the concept of the area rather than explanation oriented correction and fundamentally teach students about errors by suggesting the activity to explore the properties of the area and length. They also need to plan a method to reflect student's affective aspects besides a compliment and encouragement and apply this method to the class. In which is the fourth domain of PCK, teachers need to increase the use of random units by having an independent consciousness about textbooks and supplementing the activity of textbooks and restructure textbooks by suggesting problematic situations in a real life and teaching the sequence structure. Also, class groups will need to be divided into an entire group, individual group, partner group and normal group.

  • PDF