How can we make sound replication decisions?

C Clintin P. Davis-Stober (Department of Psychological Sciences) A Alexandra Sarafoglou B Balazs Aczel S Suyog H. Chandramouli (Department of Information and Computer Engineering) T Timothy M. Errington S Sarahanne M. Field (Pedagogical and Educational Sciences) A Ayelet Fishbach (Booth School of Business) J Juliana Freire (Department of Computer Science) J John P. A. Ioannidis (Department of Medicine) K Klaus Oberauer (Department of Psychology) F Franco Pestilli (Department of Psychology) S Susanne Ressl (Department of Neuroscience) D Daniel J. Schad (Institute of Mind, Brain and Behavior, Psychology Department) J Judith ter Schure (Department of Epidemiology and Data Science) K Katya Tentori (Center for Mind/Brain Sciences) D Don van Ravenzwaaij J Joachim Vandekerckhove (Department of Cognitive Sciences) O Odd Erik Gundersen (Department of Computer Science)

Abstract

Replication and the reported crises impacting many fields of research have become a focal point for the sciences. This has led to reforms in publishing, methodological design and reporting, and increased numbers of experimental replications coordinated across many laboratories. While replication is rightly considered an indispensable tool of science, financial resources and researchers’ time are quite limited. In this perspective, we examine different values and attitudes that scientists can consider when deciding whether to replicate a finding and how. We offer a conceptual framework for assessing the usefulness of various replication tools, such as preregistration.

Article Details

Volume / Issue Vol. 122, Issue 5
Published February 04, 2025
ISSN 0027-8424
Publisher National Academy of Sciences

Authors (18)

C

Clintin P. Davis-Stober

Department of Psychological Sciences

A

Alexandra Sarafoglou

B

Balazs Aczel

S

Suyog H. Chandramouli

Department of Information and Computer Engineering

T

Timothy M. Errington

S

Sarahanne M. Field

Pedagogical and Educational Sciences

A

Ayelet Fishbach

Booth School of Business

J

Juliana Freire

Department of Computer Science

J

John P. A. Ioannidis

Department of Medicine

K

Klaus Oberauer

Department of Psychology

F

Franco Pestilli

Department of Psychology

S

Susanne Ressl

Department of Neuroscience

D

Daniel J. Schad

Institute of Mind, Brain and Behavior, Psychology Department

J

Judith ter Schure

Department of Epidemiology and Data Science

K

Katya Tentori

Center for Mind/Brain Sciences

D

Don van Ravenzwaaij

J

Joachim Vandekerckhove

Department of Cognitive Sciences

O

Odd Erik Gundersen

Department of Computer Science