Skip to main content
Kent Academic Repository

Evaluating programming systems design

Edwards, Jonathan, Kell, Stephen, Petricek, Tomas, Church, Luke (2019) Evaluating programming systems design. In: PPIG 2019, 28-30 Aug 2019, Newcastle upon Tyne, United Kingdom. (Unpublished) (KAR id:79905)

Abstract

Research on programming systems design needs to consider a wide range of aspects in their full complexity. This includes user interaction, implementation, interoperability but also the sustainability of its ecosystem and wider societal impact. Established methods of evaluation, such as formal proofs or user studies, impose a reductionist view that makes it difficult to see programming systems in their full complexity and, consequently, force researchers to adopt simplistic perspectives.

This paper asks whether we can create more amenable methods of evaluation derived from existing informal practices such as multimedia essays, demos, and interactive tutorials. These popular forms incorporate recorded or scaffolded interaction, often embedded in a text that guides the reader. Can we augment such forms with structure and guidelines to obtain methods of evaluation suitable for peer review? We do not answer this question, but merely seek to identify some of the problems and instigate a community discussion. In that spirit we propose to hold a panel session at the conference.

Item Type: Conference or workshop item (Paper)
Uncontrolled keywords: programming systems design, UI
Subjects: Q Science > QA Mathematics (inc Computing science) > QA 76 Software, computer programming,
Divisions: Divisions > Division of Computing, Engineering and Mathematical Sciences > School of Computing
Depositing User: Stephen Kell
Date Deposited: 31 Jan 2020 13:20 UTC
Last Modified: 16 Feb 2021 14:11 UTC
Resource URI: https://kar.kent.ac.uk/id/eprint/79905 (The current URI for this page, for reference purposes)

University of Kent Author Information

  • Depositors only (login required):

Total unique views for this document in KAR since July 2020. For more details click on the image.