Skip to main content

Prioritizing positive feature values: a new hierarchical feature selection method

da Silva, Pablo Nasciemento, Plastino, Alexandre, Freitas, Alex A. (2020) Prioritizing positive feature values: a new hierarchical feature selection method. Applied Intelligence, . ISSN 0924-669X. E-ISSN 1573-7497. (doi:10.1007/s10489-020-01782-5) (KAR id:82231)

PDF Author's Accepted Manuscript
Language: English
Download (721kB) Preview
[thumbnail of Applied-Intelligence-2020-da-Silva-post-reviews.pdf]
Preview
This file may not be suitable for users of assistive technology.
Request an accessible format
Official URL
https://dx.doi.org/10.1007/s10489-020-01782-5

Abstract

In this work, we address the problem of feature selection for the classification task in hierarchical and sparse feature spaces, which characterise many real-world applications nowadays. A binary feature space is deemed hierarchical when its binary features are related via generalization-specialization relationships, and is considered sparse when in general the instances contain much fewer “positive” than “negative” feature values. In any given instance, a feature value is deemed positive (negative) when the property associated with the feature has been (has not been) observed for that instance. Although there are many methods for the traditional feature selection problem in the literature, the proper treatment to hierarchical feature structures is still a

challenge. Hence, we introduce a novel hierarchical feature selection method that follows the lazy learning paradigm – selecting a feature subset tailored for each instance in the test set. Our strategy prioritizes the selection of features with positive values, since they tend to be more informative – the presence of a relatively rare property is usually a piece of more relevant information than the absence of that property. Experiments on different application domains have shown that the proposed method outperforms previous hierarchical feature selection methods and also traditional methods in terms of predictive accuracy, selecting smaller feature subsets in general.

Item Type: Article
DOI/Identification number: 10.1007/s10489-020-01782-5
Uncontrolled keywords: machine learning, data mining, classification, feature selection
Subjects: Q Science > Q Science (General) > Q335 Artificial intelligence
Divisions: Divisions > Division of Computing, Engineering and Mathematical Sciences > School of Computing
Depositing User: Alex Freitas
Date Deposited: 25 Jul 2020 12:06 UTC
Last Modified: 20 Jul 2021 23:00 UTC
Resource URI: https://kar.kent.ac.uk/id/eprint/82231 (The current URI for this page, for reference purposes)
Freitas, Alex A.: https://orcid.org/0000-0001-9825-4700
  • Depositors only (login required):

Downloads

Downloads per month over past year