Fearn, T., Brown, Philip J., Besbeas, Panagiotis (2002) A Bayesian decision theory approach to variable selection for discrimination. Statistics and Computing, 12 (3). pp. 253-260. ISSN 0960-3174. (doi:10.1023/A:1020702927247) (The full text of this publication is not currently available from this repository. You may be able to access a copy if URLs are provided) (KAR id:8139)
The full text of this publication is not currently available from this repository. You may be able to access a copy if URLs are provided. | |
Official URL: http://dx.doi.org/10.1023/A:1020702927247 |
Abstract
Motivated by examples in spectroscopy, we study variable selection for discrimination in problems with very many predictor variables. Assuming multivariate normal distributions with common variance for the predictor variables within groups, we develop a Bayesian decision theory approach that balances costs for variables against a loss due to classification errors. The approach is computationally intensive, requiring a simulation to approximate the intractable expected loss and a search, using simulated annealing, over a large space of possible subsets of variables. It is illustrated by application to a spectroscopic example with 3 groups, 100 variables, and 71 training cases, where the approach finds subsets of between 5 and 14 variables whose discriminatory power is comparable with that of linear discriminant analysis using principal components derived from the full 100 variables. We study both the evaluation of expected loss and the tuning of the simulated annealing for the example, and conclude that computational effort should be concentrated on the search.
Item Type: | Article |
---|---|
DOI/Identification number: | 10.1023/A:1020702927247 |
Uncontrolled keywords: | Bayes; decision theory; discriminant analysis; near infrared spectroscopy; simulated annealing; variable selection |
Subjects: |
Q Science > QA Mathematics (inc Computing science) > QA276 Mathematical statistics H Social Sciences > HA Statistics |
Divisions: | Divisions > Division of Computing, Engineering and Mathematical Sciences > School of Mathematics, Statistics and Actuarial Science |
Depositing User: | Philip Brown |
Date Deposited: | 09 Sep 2008 18:48 UTC |
Last Modified: | 16 Nov 2021 09:46 UTC |
Resource URI: | https://kar.kent.ac.uk/id/eprint/8139 (The current URI for this page, for reference purposes) |
- Export to:
- RefWorks
- EPrints3 XML
- BibTeX
- CSV
- Depositors only (login required):