On the Relation between Dependence and Diversity in Multiple Classifier Systems

Cheney, Deborah and Sirlantzis, Konstantinos and Hua, Dong and Ma, Xiaobin (2005) On the Relation between Dependence and Diversity in Multiple Classifier Systems. In: ITCC 2005: International Conference on Information Technology: Coding and Computing, Vol 1. IEEE pp. 134-139. ISBN 0-7695-2315-3 . (The full text of this publication is not currently available from this repository. You may be able to access a copy if URLs are provided)

The full text of this publication is not available from this repository. (Contact us about this Publication)
Official URL


In this paper we investigate the issues of independence and diversity among individual classifiers participating in a multiple classifier fusion scheme. First we present a formal definition of statistically independent classifiers. Then we focus on testing the independence between two classifiers. Dependence of two classifiers leads to the conclusion that every ensemble of classifiers in which they participate is not an independent scheme. Previous studies have argued that independence of the classifiers infuses diversity in the multi-classifier system, which is directly related to improved performance. Consequently, we introduce a measure for the degree of diversity as expressed by the agreement among the classifiers' outputs in such an ensemble. A number of examples drawn from diverse domains in pattern recognition are also given to illustrate the relation between classifier dependence and diversity estimation. Our results suggest the measurement of the classifiers' decisions agreement as an informative measure of the strength of association among dependent classifiers.

Item Type: Conference or workshop item (Paper)
Uncontrolled keywords: classifier combination; independent classifiers; diversity; Kappa statistic; Pearson's chi-square statistic
Subjects: T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK7800 Electronics (see also: telecommunications), > TK7880 Applications of electronics (inc industrial & domestic) > TK7885 Computer engineering
Divisions: Faculties > Science Technology and Medical Studies > School of Engineering and Digital Arts
Depositing User: Yiqing Liang
Date Deposited: 15 Aug 2009 17:06
Last Modified: 09 Jun 2014 08:49
Resource URI: https://kar.kent.ac.uk/id/eprint/8927 (The current URI for this page, for reference purposes)
  • Depositors only (login required):


Downloads per month over past year