Skip to main content

Design Considerations for Building Credible Security Testbeds: Perspectives from Industrial Control System Use Cases

Ani, Uchenna D., Watson, Jeremy D. McK., Green, Benjamin, Craggs, Barnaby, Nurse, Jason R. C. (2020) Design Considerations for Building Credible Security Testbeds: Perspectives from Industrial Control System Use Cases. Journal of Cyber Security Technology, . ISSN 2374-2917. E-ISSN 2374-2925. (doi:10.1080/23742917.2020.1843822) (KAR id:84063)


This paper presents a mapping framework for design factors and an implementation process for building credible Industrial Control Systems (ICS) security testbeds. The security and resilience of ICSs has become a critical concern to operators and governments following widely publicised cyber security events. The inability to apply conventional Information Technology security practice to ICSs further compounds challenges in adequately securing critical systems. To overcome these challenges, and do so without impacting live environments, testbeds are widely used for the exploration, development, and evaluation of security controls. However, how a testbed is designed and its attributes, can directly impact not only its viability but also its credibility. Combining systematic and thematic analysis, and the mapping of identified ICS security testbed design attributes, we propose a novel relationship map of credibility-supporting design factors (and their associated attributes) and a process implementation flow structure for ICS security testbeds. The framework and implementation process highlight the significance of demonstrating some design factors such as user/experimenter expertise, clearly defined testbed design objectives, simulation implementation approach, covered architectural components, core structural and functional characteristics covered, and evaluations to enhance confidence, trustworthiness and acceptance of ICS security testbeds as credible. These can streamline testbed requirement definition, improve design consistency and quality while reducing implementation costs.

Item Type: Article
DOI/Identification number: 10.1080/23742917.2020.1843822
Uncontrolled keywords: ICS Testbeds, Security Simulations, Security Modelling, Model Credibility, Cyber Security Simulations
Subjects: T Technology
T Technology > TA Engineering (General). Civil engineering (General)
Divisions: Faculties > Sciences > School of Computing
Faculties > Sciences > School of Computing > Security Group
Faculties > Sciences > School of Engineering and Digital Arts
Depositing User: Jason Nurse
Date Deposited: 11 Nov 2020 11:55 UTC
Last Modified: 13 Jan 2021 14:49 UTC
Resource URI: (The current URI for this page, for reference purposes)
Nurse, Jason R. C.:
  • Depositors only (login required):


Downloads per month over past year