Skip to main content
Kent Academic Repository

Maximising Entropy Efficiently

Williamson, Jon (2002) Maximising Entropy Efficiently. Electronic Transactions in Artificial Intelligence, 7 . ISSN 1401-9841. (The full text of this publication is not currently available from this repository. You may be able to access a copy if URLs are provided) (KAR id:7376)

The full text of this publication is not currently available from this repository. You may be able to access a copy if URLs are provided.
Official URL:
http://www.ida.liu.se/ext/etai/received/machi/mi19...

Abstract

Determining a prior probability function via the maximum entropy principle can be a computationally intractable task. However one can easily determine - in advance of entropy maximisation - a list of conditional independencies that the maximum entropy function will satisfy. These independencies can be used to reduce the complexity of the entropy maximisation task. In particular, one can use these independencies to construct a direct acyclic graph in a Bayesian network, and then maximise entropy with respect to the numerical parameters of this network. This can result in an efficient representation of a prior probability function, and one that may allow efficient updating and marginalisation. The computational complexity of maximising entropy can be further reduced when knowledge of causal relationships is available. Moreover, the proposed simplification of the entropy maximisation task may be exploited to construct a proof theory for probabilistic logic.

Item Type: Article
Subjects: B Philosophy. Psychology. Religion > B Philosophy (General)
B Philosophy. Psychology. Religion > BC Logic
Q Science > QA Mathematics (inc Computing science) > QA273 Probabilities
Divisions: Divisions > Division of Arts and Humanities > School of Culture and Languages
Depositing User: Jon Williamson
Date Deposited: 17 Oct 2008 11:13 UTC
Last Modified: 16 Nov 2021 09:45 UTC
Resource URI: https://kar.kent.ac.uk/id/eprint/7376 (The current URI for this page, for reference purposes)

University of Kent Author Information

  • Depositors only (login required):

Total unique views for this document in KAR since July 2020. For more details click on the image.