Browse > Article
http://dx.doi.org/10.5626/JOK.2016.43.11.1270

Value Weighted Regularized Logistic Regression Model  

Lee, Chang-Hwan (Dongguk Univ.)
Jung, Mina (Syracuse University EECS Dept.)
Publication Information
Journal of KIISE / v.43, no.11, 2016 , pp. 1270-1274 More about this Journal
Abstract
Logistic regression is widely used for predicting and estimating the relationship among variables. We propose a new logistic regression model, the value weighted logistic regression, which comprises of a fine-grained weighting method, and assigns adapted weights to each feature value. This gradient approach obtains the optimal weights of feature values. Experiments were conducted on several data sets from the UCI machine learning repository, and the results revealed that the proposed method achieves meaningful improvement in the prediction accuracy.
Keywords
logistic regression; feature weighting; classification;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Menard, Scott, Applied logistic regression analysis, Vol. 106, Sage, 2002.
2 Atkeson, Christopher G., Andrew W. Moore, and Stefan Schaal, "Locally weighted learning for control," Lazy learning, Springer Netherlands, 75-113, 1997.
3 Cleveland, William S., and Susan J. Devlin, "Locally weighted regression: an approach to regression analysis by local fitting," Journal of the American Statistical Association 83.403 (1988): 596-610.   DOI
4 Zhang, Lijun, et al., "Efficient Online Learning for Large-Scale Sparse Kernel Logistic Regression," AAAI, 2012.
5 Hosmer D W, Lemesbow S. Goodness of fit tests for the multiple logistic regression model, Communications in Statistics-Theory and Methods, 9(10), pp. 1043-1069, 1980.   DOI
6 Goeman, Jelle, Rosa Meijer, and Nimisha Chaturvedi, "L1 and L2 penalized regression models," 2014.
7 Hosmer Jr, David W., and Stanley Lemeshow, Applied logistic regression, John Wiley & Sons, 2004.
8 https://archive.ics.uci.edu/ml/datasets.html
9 Kurgan, Lukasz, and Krzysztof J. Cios, "CAIM discretization algorithm," Knowledge and Data Engineering, IEEE Transactions on Knowledge and Data Engineering, pp. 145-153, 2004.
10 Zhu, Ji, and Trevor Hastie, "Kernel logistic regression and the import vector machine," Journal of Computational and Graphical Statistics (2005).