Decomposition Genetic Programming: An Extensive Evaluation on Rainfall Prediction in the Context of Weather Derivatives

Cramer, Sam, Kampouridis, Michael, Freitas, Alex A. (2018) Decomposition Genetic Programming: An Extensive Evaluation on Rainfall Prediction in the Context of Weather Derivatives. Applied Soft Computing, 70 . pp. 208-224. ISSN 1568-4946. (doi:10.1016/j.asoc.2018.05.016)

Abstract

Regression problems provide some of the most challenging research opportunities in the area of machine learning, where the predictions of some target variables are critical to a specific application. Rainfall is a prime example, as it exhibits unique characteristics of high volatility and chaotic patterns that do not exist in other time series data. Moreover, rainfall is essential for applications that surround financial securities, such as rainfall derivatives. This paper extensively evaluates a novel algorithm called Decomposition Genetic Programming (DGP), which is an algorithm that decomposes the problem of rainfall into subproblems. Decomposition allows the GP to focus on each subproblem, before combining back into the full problem. The GP does this by having a separate regression equation for each subproblem, based on the level of rainfall. As we turn our attention to subproblems, this reduces the difficulty when dealing with data sets with high volatility and extreme rainfall values, since these values can be focused on independently. We extensively evaluate our algorithm on 42 cities from Europe and the USA, and compare its performance to the current state-of-the-art (Markov chain extended with rainfall prediction), and six other popular machine learning algorithms (Genetic Programming without decomposition, Support Vector Regression, Radial Basis Neural Networks, M5 Rules, M5 Model trees, and k-Nearest Neighbours). Results show that the DGP is able to consistently and significantly outperform all other algorithms. Lastly, another contribution of this work is to discuss the effect that DGP has had on the coverage of the rainfall predictions and whether it shows robust performance across different climates.

Item Type:	Article
DOI/Identification number:	10.1016/j.asoc.2018.05.016
Uncontrolled keywords:	Weather derivatives, rainfall prediction, problem decomposition, genetic programming, genetic algorithm
Subjects:	Q Science > Q Science (General) > Q335 Artificial intelligence
Divisions:	Faculties > Sciences > School of Computing > Computational Intelligence Group Faculties > Sciences > School of Computing > Data Science
Depositing User:	Michael Kampouridis
Date Deposited:	15 May 2018 09:23 UTC
Last Modified:	09 Jul 2019 09:10 UTC
Resource URI:	https://kar.kent.ac.uk/id/eprint/67024 (The current URI for this page, for reference purposes)
Kampouridis, Michael:	https://orcid.org/0000-0003-0047-7565