Skip to main content

Discovering surprising patterns by detecting occurrences of Simpson's paradox

Fabris, Carem C., Freitas, Alex A. (2000) Discovering surprising patterns by detecting occurrences of Simpson's paradox. In: Bramer, Max and Macintosh, Ann and Coenen, Frans, eds. Research and Development in Intelligent Systems XVI. B C S Conference Series . pp. 148-160. Springer-Verlag, Berlin ISBN 1-85233-231-X. (The full text of this publication is not currently available from this repository. You may be able to access a copy if URLs are provided) (KAR id:21712)

The full text of this publication is not currently available from this repository. You may be able to access a copy if URLs are provided. (Contact us about this Publication)

Abstract

This paper addresses the discovery of surprising patterns. Recently, several authors have addressed the task of discovering surprising prediction rules. However, we do not focus on prediction rules, but rather on a quite different kind of pattern, namely the occurrence of Simpson's paradox. Intuitively, the fact that this is a paradox suggests that it has a great potential to be a surprising pattern for the user. With this motivation, we make the detection of Simpson's paradox the central goal of a data mining algorithm explicitly designed to discover surprising patterns. We present computational results showing surprising occurrences of the paradox in some public-domain data sets. In addition, we propose a method for ranking the discovered instances of the paradox in decreasing order of estimated degree of surprisingness.

Item Type: Conference or workshop item (Paper)
Additional information: Proceedings Paper
Subjects: Q Science > QA Mathematics (inc Computing science) > QA 76 Software, computer programming,
Divisions: Divisions > Division of Computing, Engineering and Mathematical Sciences > School of Computing
Depositing User: Mark Wheadon
Date Deposited: 02 Sep 2009 15:44 UTC
Last Modified: 16 Feb 2021 12:32 UTC
Resource URI: https://kar.kent.ac.uk/id/eprint/21712 (The current URI for this page, for reference purposes)
Freitas, Alex A.: https://orcid.org/0000-0001-9825-4700
  • Depositors only (login required):