Is Ockham’s razor losing its edge? New perspectives on the principle of model parsimony

M Marina Dubova (Cognitive Science Program, Indiana University) S Suyog Chandramouli (Department of Information and Communications Engineering) G Gerd Gigerenzer (Max Planck Institute for Human Development) P Peter Grünwald (Centrum Wiskunde & Informatica) W William Holmes (Cognitive Science Program) T Tania Lombrozo (Department of Psychology) M Marco Marelli (Department of Psychology) S Sebastian Musslick (Institute for Cognitive Science) B Bruno Nicenboim (Department of Cognitive Science and Artificial Intelligence) L Lauren N. Ross (Department of Logic and Philosophy of Science) R Richard Shiffrin (Cognitive Science Program) M Martha White (Department of Computing Science) E Eric-Jan Wagenmakers P Paul-Christian Bürkner (Department of Statistics) S Sabina J. Sloman (Department of Computer Science, University of Manchester)

Abstract

The preference for simple explanations, known as the parsimony principle, has long guided the development of scientific theories, hypotheses, and models. Yet recent years have seen a number of successes in employing highly complex models for scientific inquiry (e.g., for 3D protein folding or climate forecasting). In this paper, we reexamine the parsimony principle in light of these scientific and technological advancements. We review recent developments, including the surprising benefits of modeling with more parameters than data, the increasing appreciation of the context-sensitivity of data and misspecification of scientific models, and the development of new modeling tools. By integrating these insights, we reassess the utility of parsimony as a proxy for desirable model traits, such as predictive accuracy, interpretability, effectiveness in guiding new research, and resource efficiency. We conclude that more complex models are sometimes essential for scientific progress, and discuss the ways in which parsimony and complexity can play complementary roles in scientific modeling practice.

Article Details

Volume / Issue Vol. 122, Issue 5
Published February 04, 2025
ISSN 0027-8424
Publisher National Academy of Sciences

Authors (15)

M

Marina Dubova

Cognitive Science Program, Indiana University

S

Suyog Chandramouli

Department of Information and Communications Engineering

G

Gerd Gigerenzer

Max Planck Institute for Human Development

P

Peter Grünwald

Centrum Wiskunde & Informatica

W

William Holmes

Cognitive Science Program

T

Tania Lombrozo

Department of Psychology

M

Marco Marelli

Department of Psychology

S

Sebastian Musslick

Institute for Cognitive Science

B

Bruno Nicenboim

Department of Cognitive Science and Artificial Intelligence

L

Lauren N. Ross

Department of Logic and Philosophy of Science

R

Richard Shiffrin

Cognitive Science Program

M

Martha White

Department of Computing Science

E

Eric-Jan Wagenmakers

P

Paul-Christian Bürkner

Department of Statistics

S

Sabina J. Sloman

Department of Computer Science, University of Manchester