Skip to main content

Human in the Loop: What is the Point of no Return?

de Lemos, Rogério (2020) Human in the Loop: What is the Point of no Return? In: IEEE/ACM 15th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS ’20), October 7–8, 2020, Seoul, Republic of Korea. ACM, New York, USA. ISBN 978-1-4503-7962-5. (In press) (doi:10.1145/3387939.3391597) (Access to this publication is currently restricted. You may be able to access a copy if URLs are provided) (KAR id:80988)

PDF Author's Accepted Manuscript
Language: English

Restricted to Repository staff only
Contact us about this Publication
[img]
Official URL
https://dx.doi.org/10.1145/3387939.3391597

Abstract

The main goal of any feedback control system is essentially to remove humans from the loop.

The MAPE-K loop is the embodiment of a feedback control loop in self-adaptive software systems, but the complete removal of humans from the control loop has not been thoroughly debated.

However, as software self-adaptation progresses, enabling to place higher assurances on the deployment of these systems to the point humans become dispensable, some ethical questions need to be raised.

Similar questions have been raised in past when the first automatic systems became intrinsic to the industrial fabric. The difference between then and now is that then the impact was confined to portions of the society, but now the implications are much wider, if we consider, in particular, software systems that are able to change themselves. If humans are not aware of those changes, and their implications, humans cease to be in tune with the system they are operating, and inevitably accidents will ensue. The point of no return in self-adaptive software systems refers to the moment in their technical maturity when any human involvement with the operation of a system is perceived to create more harm than benefit. Confronted with this situation, software engineers need start asking themselves some basic ethical questions. Do we really need to consider humans as an integral part of self-adaptive software systems? If humans are removed from the control loop, what kind of assurances will be needed for society to accept such systems?

Item Type: Book section
DOI/Identification number: 10.1145/3387939.3391597
Uncontrolled keywords: self-adaptive software systems, human in the loop, MAPE-K, resilience, software configuration, assurances
Subjects: Q Science > QA Mathematics (inc Computing science) > QA 76 Software, computer programming,
Divisions: Faculties > Sciences > School of Computing > Security Group
Depositing User: Rogerio de Lemos
Date Deposited: 24 Apr 2020 16:19 UTC
Last Modified: 27 Apr 2020 10:01 UTC
Resource URI: https://kar.kent.ac.uk/id/eprint/80988 (The current URI for this page, for reference purposes)
de Lemos, Rogério: https://orcid.org/0000-0002-0281-6308
  • Depositors only (login required):

Downloads

Downloads per month over past year