Minds and Machines 32 (1):13-42 (2022)

Gustavo Cevolani
IMT School For Advanced Studies Lucca
The idea that “simplicity is a sign of truth”, and the related “Occam’s razor” principle, stating that, all other things being equal, simpler models should be preferred to more complex ones, have been long discussed in philosophy and science. We explore these ideas in the context of supervised machine learning, namely the branch of artificial intelligence that studies algorithms which balance simplicity and accuracy in order to effectively learn about the features of the underlying domain. Focusing on statistical learning theory, we show that situations exist for which a preference for simpler models provably slows down, instead of favoring, the supervised learning process. Our results shed new light on the relations between simplicity and truth approximation, which are briefly discussed in the context of both machine learning and the philosophy of science.
Keywords No keywords specified (fix it)
Categories (categorize this paper)
DOI 10.1007/s11023-022-09592-z
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Translate to english
Revision history

Download options

PhilArchive copy

Upload a copy of this paper     Check publisher's policy     Papers currently archived: 70,214
External links

Setup an account with your affiliations in order to access resources via your University's proxy server
Configure custom proxy (use this if your affiliation does not provide a proxy)
Through your library

References found in this work BETA

Ockham’s Razors: A User’s Manual.Elliott Sober - 2015 - Cambridge University Press.
Making AI Meaningful Again.Jobst Landgrebe & Barry Smith - 2021 - Synthese 198 (March):2061-2081.
Simplicity.Alan Baker - 2008 - Stanford Encyclopedia of Philosophy.

View all 28 references / Add more references

Citations of this work BETA

No citations found.

Add more citations

Similar books and articles

Causal Learning with Occam’s Razor.Oliver Schulte - 2019 - Studia Logica 107 (5):991-1023.
Occam’s Razor and Possible Worlds.Peter Forrest - 1982 - The Monist 65 (4):456-464.
Simple or Simplistic? Scientists’ Views on Occam’s Razor.Hauke Riesch - 2010 - Theoria : An International Journal for Theory, History and Fundations of Science 25 (1):75-90.
Is Occam's Razor a Physical Thing?J. J. C. Smart - 1978 - Philosophy 53 (205):382 - 385.
Simple or Simplistic? Scientists' Views on Occam's Razor.Hauke Riesch - 2010 - Theoria: Revista de Teoría, Historia y Fundamentos de la Ciencia 25 (1):75-90.
Simple or Simplistic? Scientists' Views on Occam's Razor.Hauke Riesch - 2010 - Theoria: Revista de Teoría, Historia y Fundamentos de la Ciencia 25 (1):75-90.
An Automatic Ockham’s Razor for Bayesians?Gordon Belot - 2019 - Erkenntnis 84 (6):1361-1367.
Curve-Fitting for Bayesians?Gordon Belot - 2016 - British Journal for the Philosophy of Science:axv061.


Added to PP index

Total views
4 ( #1,278,552 of 2,507,637 )

Recent downloads (6 months)
4 ( #169,938 of 2,507,637 )

How can I increase my downloads?


My notes