Regularized least square discriminant projection and feature selection

Jun Shi; Zhiguo Jiang; Danpei Zhao; Hao Feng; Chao Gao

doi:10.1117/1.JEI.23.1.013003

10 January 2014 Regularized least square discriminant projection and feature selection

Jun Shi, Zhiguo Jiang, Danpei Zhao, Hao Feng, Chao Gao

Author Affiliations +

Journal of Electronic Imaging, Vol. 23, Issue 1, 013003 (January 2014). https://doi.org/10.1117/1.JEI.23.1.013003

Abstract

Conventional graph embedding framework uses the Euclidean distance to determine the similarities of neighbor samples, which causes the graph structure to be sensitive to outliers and lack physical interpretation. Moreover, the graph construction suffers from the difficulty of neighbor parameter selection. Although sparse representation (SR) based graph embedding methods can automatically select the neighbor parameter, the computational cost of SR is expensive. On the other hand, most discriminant projection methods fail to perform feature selection. In this paper, we present a novel joint discriminant analysis and feature selection method that employs regularized least square for graph construction and l_2,1-norm minimization on projection matrix for feature selection. Specifically, our method first uses the regularized least square coefficients to measure the intraclass and interclass similarities from the viewpoint of reconstruction. Based on this graph structure, we formulate an object function with scatter difference criterion for learning the discriminant projections, which can avoid the small sample size problem. Simultaneously, the l_2,1-norm minimization on projection matrix is applied to gain row-sparsity for selecting useful features. Experiments on two face databases (ORL and AR) and COIL-20 object database demonstrate that our method not only achieves better classification performance, but also has lower computational cost than SR.

Citation Download Citation

Jun Shi, Zhiguo Jiang, Danpei Zhao, Hao Feng, and Chao Gao "Regularized least square discriminant projection and feature selection," Journal of Electronic Imaging 23(1), 013003 (10 January 2014). https://doi.org/10.1117/1.JEI.23.1.013003

Published: 10 January 2014

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available