Skip to main content

Entropy4Cloud: Using Entropy-Based Complexity To Optimize Cloud Service Resource Management

Wang, Frank Z. (2018) Entropy4Cloud: Using Entropy-Based Complexity To Optimize Cloud Service Resource Management. IEEE Transactions on Emerging Topics in Computational Intelligence, 2 (1). pp. 13-24. ISSN 2471-285X. E-ISSN 2471-285X. (doi:10.1109/TETCI.2017.2755691) (KAR id:63355)

Abstract

In cloud service resource management system, complexity limits the system’s ability to better satisfy the application’s QoS requirements, e.g. cost budget, average response time and reliability. Numerousness, diversity, variety, uncertainty, etc. are some of the complexity factors which lead to the variation between expected plan and actual running performance of cloud applications. In this paper, after defining the complexity clearly, we identify the origin of complexity in cloud service resource management system through the study of ”Local Activity Principle”. In order to manage complexity, an Entropy-based methodology is presented to use which covers identifying, measuring, analysing and controlling (avoid and reduce) of complexity. Finally, we implement such idea in a popular cloud engine, Apache Spark, for running Analysis as a Service (AaaS). Experiments demonstrate that the new, Entropy-based resource management approach can significantly improve the performance of Spark applications. Compare with the Fair Scheduler in Apache Spark, our proposed Entropy Scheduler is able to reduce overall cost by 23%, improve the average service response time by 15% - 20% and minimized the standard deviation of service response time by 30% - 45%.

Item Type: Article
DOI/Identification number: 10.1109/TETCI.2017.2755691
Uncontrolled keywords: Entropy Theory, Complexity, Cloud Services, Resource Management
Subjects: Q Science > QA Mathematics (inc Computing science) > QA 75 Electronic computers. Computer science
Q Science > QC Physics > QC20 Mathematical Physics
Divisions: Divisions > Division of Computing, Engineering and Mathematical Sciences > School of Computing
Depositing User: Frank Wang
Date Deposited: 10 Sep 2017 19:51 UTC
Last Modified: 16 Jan 2024 03:10 UTC
Resource URI: https://kar.kent.ac.uk/id/eprint/63355 (The current URI for this page, for reference purposes)

University of Kent Author Information

  • Depositors only (login required):

Total unique views for this document in KAR since July 2020. For more details click on the image.