Sawicki, Piotr, Grzes, Marek, Goes, Fabricio, Brown, Dan, Peeperkorn, Max, Khatun, Aisha (2023) Bits of grass: does GPT already know how to write like Whitman? In: Pease, Alison and Cunha, Joao Miguel and Ackerman, Maya and Brown, Daniel G., eds. Proceedings of the Fourteenth International Conference on Computational Creativity. . pp. 317-321. Association for Computational Creativity ISBN 978-989-54160-5-9. (KAR id:101550)
|
PDF
Author's Accepted Manuscript
Language: English 
This work is licensed under a Creative Commons Attribution 4.0 International License.
|
|
|
Download this file (PDF/175kB) |
Preview |
| Request a format suitable for use with assistive technology e.g. a screenreader | |
| Official URL: https://computationalcreativity.net/iccc23/proceed... |
|
| Additional URLs: |
|
Abstract
This study examines the ability of GPT-3.5, GPT-3.5-turbo (ChatGPT) and GPT-4 models to generate poems in the style of specific authors using zero-shot and many-shot prompts (which use the maximum context length of 8192 tokens). We assess the performance of models that are not fine-tuned for generating poetry in the style of specific authors, via automated evaluation. Our findings indicate that without finetuning, even when provided with the maximum number of 17 poem examples (8192 tokens) in the prompt, these models do not generate poetry in the desired style.
| Item Type: | Conference or workshop item (Proceeding) |
|---|---|
| Uncontrolled keywords: | GPT; NLP; poetry; fine-tuning; LLMs |
| Subjects: | Q Science > Q Science (General) > Q335 Artificial intelligence |
| Institutional Unit: | Schools > School of Computing |
| Former Institutional Unit: |
Divisions > Division of Computing, Engineering and Mathematical Sciences > School of Computing
|
| Funders: | University of Kent (https://ror.org/00xkeyj56) |
| Depositing User: | Piotr Sawicki |
| Date Deposited: | 05 Jun 2023 17:10 UTC |
| Last Modified: | 16 Oct 2025 11:55 UTC |
| Resource URI: | https://kar.kent.ac.uk/id/eprint/101550 (The current URI for this page, for reference purposes) |
University of Kent Author Information
Sawicki, Piotr.
| Creator's ORCID: | |
|---|---|
| CReDIT Contributor Roles: |
Grzes, Marek.
| Creator's ORCID: |
 https://orcid.org/0000-0003-4901-1539
|
|---|---|
| CReDIT Contributor Roles: |
Peeperkorn, Max.
| Creator's ORCID: |
https://orcid.org/0000-0001-9058-0886
|
|---|---|
| CReDIT Contributor Roles: |
- Link to SensusAccess
- Export to:
- RefWorks
- EPrints3 XML
- BibTeX
- CSV
- Depositors only (login required):
Total Views
Total Views
