Classification of microarray data with penalized logistic regression

Paul H. C. Eilers; Judith M. Boer; Gert-Jan van Ommen; Hans C. van Houwelingen

doi:10.1117/12.427987

4 June 2001 Classification of microarray data with penalized logistic regression

Paul H. C. Eilers, Judith M. Boer, Gert-Jan van Ommen, Hans C. van Houwelingen

Proceedings Volume 4266, Microarrays: Optical Technologies and Informatics; (2001) https://doi.org/10.1117/12.427987
Event: BiOS 2001 The International Symposium on Biomedical Optics, 2001, San Jose, CA, United States

Abstract

Classification of microarray data needs a firm statistical basis. In principle, logistic regression can provide it, modeling the probability of membership of a class with (transforms of) linear combinations of explanatory variables. However, classical logistic regression does not work for microarrays, because generally there will be far more variables than observations. One problem is multicollinearity: estimating equations become singular and have no unique and stable solution. A second problem is over-fitting: a model may fit well into a data set, but perform badly when used to classify new data. We propose penalized likelihood as a solution to both problems. The values of the regression coefficients are constrained in a similar way as in ridge regression. All variables play an equal role, there is no ad-hoc selection of most relevant or most expressed genes. The dimension of the resulting systems of equations is equal to the number of variables, and generally will be too large for most computers, but it can dramatically be reduced with the singular value decomposition of some matrices. The penalty is optimized with AIC (Akaike's Information Criterion), which essentially is a measure of prediction performance. We find that penalized logistic regression performs well on a public data set (the MIT ALL/AML data).

Citation Download Citation

Paul H. C. Eilers, Judith M. Boer, Gert-Jan van Ommen, and Hans C. van Houwelingen "Classification of microarray data with penalized logistic regression", Proc. SPIE 4266, Microarrays: Optical Technologies and Informatics, (4 June 2001); https://doi.org/10.1117/12.427987

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available