Skip to main content

The process of replication target selection in psychology: what to consider?

Pittelkow, Merle-Marie, Field, Sarahanne M., Isager, Peder M., van’t Veer, Anna E., Anderson, Thomas, Cole, Scott N., Dominik, Tomáš, Giner-Sorolla, Roger, Gok, Sebahat, Heyman, Tom, and others. (2023) The process of replication target selection in psychology: what to consider? Royal Society Open Science, 10 (2). Article Number 210586. E-ISSN 2054-5703. (doi:10.1098/rsos.210586) (KAR id:99856)

PDF Publisher pdf
Language: English

Download (1MB) Preview
[thumbnail of Giner-Sorolla_The process of replication.pdf]
This file may not be suitable for users of assistive technology.
Request an accessible format
Official URL:


Increased execution of replication studies contributes to the effort to restore credibility of empirical research. However, a second generation of problems arises: the number of potential replication targets is at a serious mismatch with available resources. Given limited resources, replication target selection should be well-justified, systematic and transparently communicated. At present the discussion on what to consider when selecting a replication target is limited to theoretical discussion, self-reported justifications and a few formalized suggestions. In this Registered Report, we proposed a study involving the scientific community to create a list of considerations for consultation when selecting a replication target in psychology. We employed a modified Delphi approach. First, we constructed a preliminary list of considerations. Second, we surveyed psychologists who previously selected a replication target with regards to their considerations. Third, we incorporated the results into the preliminary list of considerations and sent the updated list to a group of individuals knowledgeable about concerns regarding replication target selection. Over the course of several rounds, we established consensus regarding what to consider when selecting a replication target. The resulting checklist can be used for transparently communicating the rationale for selecting studies for replication.

Item Type: Article
DOI/Identification number: 10.1098/rsos.210586
Uncontrolled keywords: replication; study selection; consensus
Subjects: B Philosophy. Psychology. Religion > BF Psychology
Divisions: Divisions > Division of Human and Social Sciences > School of Psychology
Funders: University of Kent (
Depositing User: Roger Giner-Sorolla
Date Deposited: 02 Feb 2023 11:17 UTC
Last Modified: 11 Apr 2023 10:57 UTC
Resource URI: (The current URI for this page, for reference purposes)
Pittelkow, Merle-Marie:
Field, Sarahanne M.:
Isager, Peder M.:
van’t Veer, Anna E.:
Anderson, Thomas:
Dominik, Tomáš:
Giner-Sorolla, Roger:
Heyman, Tom:
Jekel, Marc:
Luke, Timothy J.:
Peels, Rik:
Pendrous, Rosina:
Schauer, Jacob M.:
Specker, Eva:
Tran, Ulrich S.:
Vranka, Marek A.:
Wicherts, Jelte M.:
Yoshimura, Naoto:
Zwaan, Rolf A.:
van Ravenzwaaij, Don:
  • Depositors only (login required):


Downloads per month over past year