The process of replication target selection in psychology: what to consider?

Pittelkow, Merle-Marie, Field, Sarahanne M., Isager, Peder M., van’t Veer, Anna E., Anderson, Thomas, Cole, Scott N., Dominik, Tomáš, Giner-Sorolla, Roger, Gok, Sebahat, Heyman, Tom, and others. (2023) The process of replication target selection in psychology: what to consider? Royal Society Open Science, 10 (2). Article Number 210586. E-ISSN 2054-5703. (doi:10.1098/rsos.210586) (KAR id:99856)

PDF Publisher pdf Language: English This work is licensed under a Creative Commons Attribution 4.0 International License.
Download (1MB) Preview	Preview
This file may not be suitable for users of assistive technology. Request an accessible format
Official URL: https://doi.org/10.1098/rsos.210586

Abstract

Increased execution of replication studies contributes to the effort to restore credibility of empirical research. However, a second generation of problems arises: the number of potential replication targets is at a serious mismatch with available resources. Given limited resources, replication target selection should be well-justified, systematic and transparently communicated. At present the discussion on what to consider when selecting a replication target is limited to theoretical discussion, self-reported justifications and a few formalized suggestions. In this Registered Report, we proposed a study involving the scientific community to create a list of considerations for consultation when selecting a replication target in psychology. We employed a modified Delphi approach. First, we constructed a preliminary list of considerations. Second, we surveyed psychologists who previously selected a replication target with regards to their considerations. Third, we incorporated the results into the preliminary list of considerations and sent the updated list to a group of individuals knowledgeable about concerns regarding replication target selection. Over the course of several rounds, we established consensus regarding what to consider when selecting a replication target. The resulting checklist can be used for transparently communicating the rationale for selecting studies for replication.

Item Type:	Article
DOI/Identification number:	10.1098/rsos.210586
Uncontrolled keywords:	replication; study selection; consensus
Subjects:	B Philosophy. Psychology. Religion > BF Psychology
Divisions:	Divisions > Division of Human and Social Sciences > School of Psychology
Funders:	University of Kent (https://ror.org/00xkeyj56)
Depositing User:	Roger Giner-Sorolla
Date Deposited:	02 Feb 2023 11:17 UTC
Last Modified:	11 Apr 2023 10:57 UTC
Resource URI:	https://kar.kent.ac.uk/id/eprint/99856 (The current URI for this page, for reference purposes)
Pittelkow, Merle-Marie:	https://orcid.org/0000-0002-7487-7898
Field, Sarahanne M.:	https://orcid.org/0000-0001-7874-1261
Isager, Peder M.:	https://orcid.org/0000-0002-6922-3590
van’t Veer, Anna E.:	https://orcid.org/0000-0002-2733-1841
Anderson, Thomas:	https://orcid.org/0000-0002-2387-5219
Dominik, Tomáš:	https://orcid.org/0000-0003-3004-8710
Giner-Sorolla, Roger:	https://orcid.org/0000-0002-6690-8842
Heyman, Tom:	https://orcid.org/0000-0003-0565-441X
Jekel, Marc:	https://orcid.org/0000-0002-9146-0306
Luke, Timothy J.:	https://orcid.org/0000-0002-5513-6605
Peels, Rik:	https://orcid.org/0000-0001-8107-5992
Pendrous, Rosina:	https://orcid.org/0000-0002-9085-9876
Schauer, Jacob M.:	https://orcid.org/0000-0002-9041-7082
Specker, Eva:	https://orcid.org/0000-0003-0836-045X
Tran, Ulrich S.:	https://orcid.org/0000-0002-6589-3167
Vranka, Marek A.:	https://orcid.org/0000-0003-3413-9062
Wicherts, Jelte M.:	https://orcid.org/0000-0003-2415-2933
Yoshimura, Naoto:	https://orcid.org/0000-0002-2656-4432
Zwaan, Rolf A.:	https://orcid.org/0000-0001-9967-7879
van Ravenzwaaij, Don:	https://orcid.org/0000-0002-5030-4091

Depositors only (login required):

Altmetric

Download Statistics

Downloads

Downloads per month over past year