Skip to main content

Evaluating computational creativity: a standardised procedure for evaluating creative systems and its application

Jordanous, Anna (2012) Evaluating computational creativity: a standardised procedure for evaluating creative systems and its application. Doctor of Philosophy (PhD) thesis, University of Sussex. (KAR id:42388)

PDF
Language: English
Download (2MB) Preview
[thumbnail of Jordanous%2C_Anna_Katerina.pdf]
Preview
This file may not be suitable for users of assistive technology.
Request an accessible format
Official URL
http://sro.sussex.ac.uk/44741/1/Jordanous,_Anna_Ka...

Abstract

This thesis proposes SPECS: a Standardised Procedure for Evaluating Creative Systems.

No methodology has been accepted as standard for evaluating the creativity of a system in the

field of computational creativity and the multi-faceted and subjective nature of creativity generates

substantial definitional issues. Evaluative practice has developed a general lack of rigour and systematicity,

hindering research progress.

SPECS is a standardised and systematic methodology for evaluating computational creativity. It

is flexible enough to be applied to a variety of different types of creative system and adaptable to

specific demands in different types of creativity. In the three-stage process of evaluation, researchers

are required to be specific about what creativity entails in the domain they work in and what standards

they test a system’s creativity by. To assist researchers, definitional issues are investigated and a set

of components representing aspects of creativity is presented, which was empirically derived using

computational linguistics analysis. These components are recommended for use within SPECS, being

offered as a general definition of creativity that can be customised to account for any specific priorities

for creativity in a given domain.

SPECS is applied in a case study for detailed comparisons of the creativity of three musical improvisation

systems, identifying which systems are more creative than others and why. In a second

case study, SPECS is used to capture initial impressions on the creativity of systems presented at a

2011 computational creativity research event. Five systems performing different creative tasks are

compared and contrasted.

These case studies exemplify the valuable information that can be obtained on a system’s strengths

and weaknesses. SPECS gives researchers vital feedback for improving their systems’ creativity,

informing further progress in computational creativity research.

Item Type: Thesis (Doctor of Philosophy (PhD))
Subjects: Q Science > Q Science (General) > Q335 Artificial intelligence
Q Science > QA Mathematics (inc Computing science) > QA 75 Electronic computers. Computer science
Divisions: Divisions > Division of Computing, Engineering and Mathematical Sciences > School of Computing
Depositing User: Anna Jordanous
Date Deposited: 18 Aug 2014 10:37 UTC
Last Modified: 16 Nov 2021 10:16 UTC
Resource URI: https://kar.kent.ac.uk/id/eprint/42388 (The current URI for this page, for reference purposes)
Jordanous, Anna: https://orcid.org/0000-0003-2076-8642
  • Depositors only (login required):