Browse > Article
http://dx.doi.org/10.3837/tiis.2017.05.012

Noisy label based discriminative least squares regression and its kernel extension for object identification  

Liu, Zhonghua (Information Engineering College, Henan University of Science and Technology)
Liu, Gang (Information Engineering College, Henan University of Science and Technology)
Pu, Jiexin (Information Engineering College, Henan University of Science and Technology)
Liu, Shigang (School of Computer Science, Shaanxi Normal University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.11, no.5, 2017 , pp. 2523-2538 More about this Journal
Abstract
In most of the existing literature, the definition of the class label has the following characteristics. First, the class label of the samples from the same object has an absolutely fixed value. Second, the difference between class labels of the samples from different objects should be maximized. However, the appearance of a face varies greatly due to the variations of the illumination, pose, and expression. Therefore, the previous definition of class label is not quite reasonable. Inspired by discriminative least squares regression algorithm (DLSR), a noisy label based discriminative least squares regression algorithm (NLDLSR) is presented in this paper. In our algorithm, the maximization difference between the class labels of the samples from different objects should be satisfied. Meanwhile, the class label of the different samples from the same object is allowed to have small difference, which is consistent with the fact that the different samples from the same object have some differences. In addition, the proposed NLDLSR is expanded to the kernel space, and we further propose a novel kernel noisy label based discriminative least squares regression algorithm (KNLDLSR). A large number of experiments show that our proposed algorithms can achieve very good performance.
Keywords
Noisy label; discriminative least squares regression (DLSR); noisy label based discriminative least squares regression algorithm (NLDLSR); pattern recognition;
Citations & Related Records
연도 인용수 순위
  • Reference
1 J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(2): 210-227, 2009.   DOI
2 Jun Yin, Zhonghua Liu, et al, "Kernel sparse representation based classification," Neurocomputing, 77(11): 120-128, 2012.   DOI
3 Lingfeng Wang, Huaiyu Wu, Chunhong Pan, "Manifold regularized local sparse representation for face recognition," IEEE Transactions on Circuits and Systems for Video Technology, 25(4): 651-659, 2015.   DOI
4 M. Yang and L. Zhang, "Gabor feature based sparse representation for face recognition with Gabor occlusion dictionary," in Proc. of 11th Eur. Conf. Comput. Vis. (ECCV), pp. 448-461, 2010.
5 Ran He, Weishi Zheng, Baogang Hu, "Maximum correntropy criterion for robust face recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(8): 1561-1576, 2011.   DOI
6 W. Liu, P.P. Pokharel, and J.C. Principe, "Correntropy: Properties and Applications in Non-Gaussian Signal Processing," IEEE Trans. Signal Processing, 55(11): 5286-5298, 2007.   DOI
7 X. Yuan and S. Yan, "Visual classification with multi-task joint sparse representation," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), pp. 3493-3500, Jun. 2010.
8 L. Zhang, Meng Yang, Xiangchu Feng, "Sparse Representation or Collaborative Representation: Which Helps Face Recognition?" in ICCV 2011, pp.1-8, 2011.
9 J. Wu, S. Pan, X. Zhu, P. Zhang, and C. Zhang, "Self-Adaptive One-Dependence Estimators for classification," Pattern Recognit., 51: 358-377, 2016.   DOI
10 Meng Yang, Lei Zhang, et al, "Relaxed collaborative representation for pattern classification," in Proc. of International Conference on Wavelet Analysis and Pattern Recognition, pp.13-16, 2014.
11 X. Chai, S. Shan, X. Chen, and W. Gao, "Locally Linear Regression for Pose-Invariant Face Recognition," IEEE Trans. Image Processing, vol. 16, no. 7, pp. 1716-1725, July 2007.   DOI
12 Yong Xu, David Zhang, et al., "A two-phase test sample sparse representation method for use with face recognition," IEEE Transactions on Circuits and Systems for Video Technology, 21(9): 1255-1262, 2011.   DOI
13 R. Barsi and D. Jacobs, "Lambertian Reflection and Linear Subspaces. IEEE Trans," Pattern Analysis and Machine Intelligence, 25(2): 218-233, 2003.   DOI
14 Roberto Togneri, Mohammed Bennamoun, "Linear regression for face recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(11): 2106-2112, 2010.   DOI
15 Shiming Xiang, Feiping Nie, et al, "Discriminative least squares regression for multiclass classification and feature selection," IEEE Transactions on Neural Networks and Learning Systems, 23(11): 1738-1754, 2012.   DOI
16 Yong Xu, Xiaozhao Fang, et al, "Modified minimum squared error algorithm for robust classification and face recognition experiments," Neurocomputing, 135(5): 253-261, 2014.   DOI
17 Jianjun Qian, Jian Yang, "General regression and representation model for face recognition," in Proc. of IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp.166-172, 2013.
18 Feiping Nie, Dong Xu, et al, "Flexible manifold embedding: A framework for semi-supervised and unsupervised dimension reduction," IEEE Transactions on Image Processing, 19(7): 1921-1932, 2010.   DOI
19 X. Cao, W. Shen, et al, "Illumination invariant extraction for face recognition using neighboring wavelet coefficients," Pattern Recognition, 45: 1299-1305, 2012.   DOI
20 Y. Xu, A. Zhong, et al., "LPP solution schemes for use with face recognition," Pattern Recognition, 43(12):4165-4176, 2010.   DOI
21 Wankou Yang, Zhenyu Wang, Changyin Sun., "A collaborative representation based projections method for feature extraction," Pattern Recognition, 48(1): 20-27, 2015.   DOI
22 Z. Lai, Y. Xu, et al, "Multilinear sparse principal component analysis," IEEE Transactions on Neural Networks and learning Systems,25(10): 1942-1950, 2014.   DOI
23 Lingfen Wang, Huaiyu Wu, "Chunhong Pan. Manifold regularized local sparse representation for face recognition," IEEE Transactions on Circuits and Systems for Video Technology, 25(4): 651-659, 2015.   DOI
24 J. Wu, S. Pan, X. Zhu, C. Zhang, and X, Wu, "Positive and Unlabeled Multi-Graph Learning," IEEE Trans. Cybern, 2016.
25 J. Wu, S. Pan, X. Zhu, Z. Cai, "Boosting for Multi-Graph Classification," IEEE Trans. Cybern, 45(3): 416-429, 2015.   DOI
26 J. Wu, X. Zhu, C. Zhang, P. S. Yu, "Bag Constrained Structure Pattern Mining for Multi-Graph Classification," IEEE Trans. Knowl. Data Eng., 26(10): 2382-2396, 2014.   DOI
27 Fujiao Ju, Yangfeng Sun, et al, "Image outlier detection and feature extraction via L1-norm-based 2D probabilistic PCA," IEEE Transactions on Image Processing, 24(12): 4834-4846, 2015.   DOI
28 Yong Xu, Xingjie Zhu, et al, "Using the original and 'symmetrical face training samples to perform representation based two-step face recognition," Pattern Recognition, 46: 1151-1158, 2013.   DOI
29 Meng Yang, Lei Zhang, et al, "Robust kernel representation with statistical local features for face recognition," IEEE Transactions on Neural Networks and Learning Systems, 24(6): 900-912, 2013.   DOI
30 Amirhosein Nabatchian, Esam Abdel-Raheem, Majid Ahmadi, "Illumination invariant feature extraction and mutual-information-based local matching for face recognition under illumination variation and occlusion," Pattern Recognition, 44: 2576-2587, 2011.   DOI
31 Cuicui Kang, Shengcai Liao, et al, "Kernel sparse representation with pixel-level and region-level local feature kernels for face recognition," Neurocomputing, 133(10): 141-152, 2014.   DOI
32 M.A. Turk, A.P. Pentland, "Face recognition using eigenfaces," IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 586-591, 1991.
33 A. Martinevz, and R. benavente, "The AR face database," CVC Tech. Report, No. 24, 1998.
34 Shenghua Gao, Yuting Zhang, et al, "Single sample face recognition via learning deep supervised autoencoders," IEEE Transactions on Information Forensics and Security, 10(10): 2108-2118,2015.   DOI
35 B. Scholkopf, A. Smola, K. R. Muller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural computation, 10:1299-1319, 1998.   DOI
36 Yong Xu, "A new kernel MSE algorithm for constructing efficient classification procedure," International Journal of Innovative Computing, Information and Control, 5(8): 2439-2447, 2009.