Skip to main content

Branching Time Active Inference with Bayesian Filtering

Champion, Théophile, Grzes, Marek, Bowman, Howard (2022) Branching Time Active Inference with Bayesian Filtering. Neural Computation, . ISSN 0899-7667. (In press) (KAR id:95495)

PDF Author's Accepted Manuscript
Language: English
Download (461kB) Preview
[thumbnail of NECO-NEURCOMP-D-21-00332R1-PDF.pdf]
Preview
This file may not be suitable for users of assistive technology.
Request an accessible format

Abstract

Branching Time Active Inference (Champion et al., 2022b,a) is a framework proposing to look at planning as a form of Bayesian model expansion. Its root can be found in Active Inference (Friston et al., 2016; Da Costa et al., 2020; Champion et al., 2021), a neuroscientific framework widely used for brain modelling, as well as in Monte Carlo Tree Search (Browne et al., 2012), a method broadly applied in the Reinforcement Learning literature. Up to now, the inference of the latent variables was carried out by taking advantage of the flexibility offered by Variational Message Passing (Winn and Bishop, 2005), an iterative process that can be understood as sending messages along the edges of a factor graph (Forney, 2001). In this paper, we harness the efficiency of an alternative method for inference called Bayesian Filtering (Fox et al., 2003), which does not require the iteration of the update equations until convergence of the Variational Free Energy. Instead, this scheme alternates between two phases: integration of evidence and prediction of future states. Both of those phases can be performed efficiently and this provides a forty times speed up over the state-of-the-art.

Item Type: Article
Uncontrolled keywords: Branching Time Active Inference, Bayesian Filtering, Free Energy Principle
Subjects: Q Science > QA Mathematics (inc Computing science) > QA273 Probabilities
Divisions: Divisions > Division of Computing, Engineering and Mathematical Sciences > School of Computing
Depositing User: Marek Grzes
Date Deposited: 19 Jun 2022 16:57 UTC
Last Modified: 20 Jun 2022 09:00 UTC
Resource URI: https://kar.kent.ac.uk/id/eprint/95495 (The current URI for this page, for reference purposes)
Grzes, Marek: https://orcid.org/0000-0003-4901-1539
Bowman, Howard: https://orcid.org/0000-0003-4736-1869
  • Depositors only (login required):

Downloads

Downloads per month over past year