Skip to main content
Kent Academic Repository

Proof of Swarm Based Ensemble Learning for Federated Learning Applications

Raza, Ali, Tran, Kim Phuc, Koehl, Ludovic, Li, Shujun (2023) Proof of Swarm Based Ensemble Learning for Federated Learning Applications. In: Proceedings of the 38th ACM/SIGAPP Symposium on Applied Computing. . 152- 155. ACM, New York, USA ISBN 978-1-4503-9517-5. (doi:10.1145/3555776.3578601) (KAR id:101795)

Abstract

Ensemble learning combines results from multiple machine learning models in order to provide a better and optimised predictive model with reduced bias, variance and improved predictions. However, in federated learning it is not feasible to apply centralised ensemble learning directly due to privacy concerns. Hence, a mechanism is required to combine results of local models to produce a global model. Most distributed consensus algorithms, such as Byzantine fault tolerance (BFT), do not normally perform well in such applications. This is because, in such methods predictions of some of the peers are disregarded, so a majority of peers can win without even considering other peers' decisions. Additionally, the confidence score of the result of each peer is not normally taken into account, although it is an important feature to consider for ensemble learning. Moreover, the problem of a tie event is often left un-addressed by methods such as BFT. To fill these research gaps, we propose PoSw (Proof of Swarm), a novel distributed consensus algorithm for ensemble learning in a federated setting, which was inspired by particle swarm based algorithms for solving optimisation problems. The proposed algorithm is theoretically proved to always converge in a relatively small number of steps and has mechanisms to resolve tie events while trying to achieve sub-optimum solutions. We experimentally validated the performance of the proposed algorithm using ECG classification as an example application in healthcare, showing that the ensemble learning model outperformed all local models and even the FL-based global model.

Item Type: Conference or workshop item (Paper)
DOI/Identification number: 10.1145/3555776.3578601
Subjects: Q Science > QA Mathematics (inc Computing science) > QA 75 Electronic computers. Computer science
Q Science > QA Mathematics (inc Computing science) > QA 76 Software, computer programming, > QA76.87 Neural computers, neural networks
T Technology > TK Electrical engineering. Electronics. Nuclear engineering > TK5101 Telecommunications > TK5105 Data transmission systems > TK5105.5 Computer networks
T Technology > TK Electrical engineering. Electronics. Nuclear engineering > TK7800 Electronics > TK7880 Applications of electronics > TK7882.P3 Pattern recognition systems
Divisions: Divisions > Division of Computing, Engineering and Mathematical Sciences > School of Computing
University-wide institutes > Institute of Cyber Security for Society
Funders: Agence Nationale de la Recherche (https://ror.org/00rbzpz17)
Depositing User: Shujun Li
Date Deposited: 21 Jun 2023 18:42 UTC
Last Modified: 22 Jun 2023 14:23 UTC
Resource URI: https://kar.kent.ac.uk/id/eprint/101795 (The current URI for this page, for reference purposes)

University of Kent Author Information

  • Depositors only (login required):

Total unique views for this document in KAR since July 2020. For more details click on the image.