The process of replication target selection in psychology: what to consider?

Pittelkow, Merle-Marie, Field, Sarahanne M., Isager, Peder M., van’t Veer, Anna E., Anderson, Thomas, Cole, Scott N., Dominik, Tomáš, Giner-Sorolla, Roger, Gok, Sebahat, Heyman, Tom, and others. (2023) The process of replication target selection in psychology: what to consider? Royal Society Open Science, 10 (2). Article Number 210586. E-ISSN 2054-5703. (doi:10.1098/rsos.210586) (KAR id:99856)

PDF Publisher pdf Language: English This work is licensed under a Creative Commons Attribution 4.0 International License.
Download this file (PDF/1MB)	Preview
Request a format suitable for use with assistive technology e.g. a screenreader
Official URL: https://doi.org/10.1098/rsos.210586

Abstract

Increased execution of replication studies contributes to the effort to restore credibility of empirical research. However, a second generation of problems arises: the number of potential replication targets is at a serious mismatch with available resources. Given limited resources, replication target selection should be well-justified, systematic and transparently communicated. At present the discussion on what to consider when selecting a replication target is limited to theoretical discussion, self-reported justifications and a few formalized suggestions. In this Registered Report, we proposed a study involving the scientific community to create a list of considerations for consultation when selecting a replication target in psychology. We employed a modified Delphi approach. First, we constructed a preliminary list of considerations. Second, we surveyed psychologists who previously selected a replication target with regards to their considerations. Third, we incorporated the results into the preliminary list of considerations and sent the updated list to a group of individuals knowledgeable about concerns regarding replication target selection. Over the course of several rounds, we established consensus regarding what to consider when selecting a replication target. The resulting checklist can be used for transparently communicating the rationale for selecting studies for replication.

Item Type:	Article
DOI/Identification number:	10.1098/rsos.210586
Uncontrolled keywords:	replication; study selection; consensus
Subjects:	B Philosophy. Psychology. Religion > BF Psychology
Divisions:	Divisions > Division of Human and Social Sciences > School of Psychology
Funders:	University of Kent (https://ror.org/00xkeyj56)
Depositing User:	Roger Giner-Sorolla
Date Deposited:	02 Feb 2023 11:17 UTC
Last Modified:	11 Apr 2023 10:57 UTC
Resource URI:	https://kar.kent.ac.uk/id/eprint/99856 (The current URI for this page, for reference purposes)

University of Kent Author Information

Giner-Sorolla, Roger.

Creator's ORCID:	https://orcid.org/0000-0002-6690-8842
CReDIT Contributor Roles:

Depositors only (login required):

Altmetric

Download Statistics

Total unique views for this document in KAR since July 2020. For more details click on the image.