Hostname: page-component-848d4c4894-x5gtn Total loading time: 0 Render date: 2024-05-24T21:24:58.174Z Has data issue: false hasContentIssue false

You can't play 20 questions with nature and win redux

Published online by Cambridge University Press:  06 December 2023

Bradley C. Love
Affiliation:
Experimental Psychology, University College London, London, UK b.love@ucl.ac.uk https://bradlove.org/
Robert M. Mok
Affiliation:
MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK Rob.Mok@mrc-cbu.cam.ac.uk https://sites.google.com/site/robmokbrainbob/

Abstract

An incomplete science begets imperfect models. Nevertheless, the target article advocates for jettisoning deep-learning models with some competency in object recognition for toy models evaluated against a checklist of laboratory findings; an approach which evokes Alan Newell's 20 questions critique. We believe their approach risks incoherency and neglects the most basic test; can the model perform its intended task.

Type
Open Peer Commentary
Copyright
Copyright © The Author(s), 2023. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Dagaev, N., Roads, B. D., Luo, X., Barry, D. N., Patil, K. R., & Love, B. C. (2023). A too-good-to-be-true prior to reduce shortcut reliance. Pattern Recognition Letters, 166, 164171. https://doi.org/10.1016/j.patrec.2022.12.010CrossRefGoogle ScholarPubMed
Newell, A. (1973). You can't play 20 questions with nature and win: Projective comments on the papers of this symposium. In W. G. Chase (Ed.). (1973). Visual information processing: Proceedings of the 8th annual Carnegie symposium on cognition, held at the Carnegie-Mellon University, Pittsburgh, Pennsylvania, May 19, 1972. Academic Press.Google Scholar
Roads, B. D., & Love, B. C. (2021). Enriching ImageNet with human similarity judgments and psychological embeddings. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp. 3547–3557).CrossRefGoogle Scholar
Sexton, N. J., & Love, B. C. (2022). Reassessing hierarchical correspondences between brain and deep networks through direct interface. Science Advances, 8, 19. doi: https://doi.org/www.science.org/doi/10.1126/sciadv.abm2219CrossRefGoogle ScholarPubMed
Winograd, T. (1971). Procedures as a representation for data in a computer program for understanding natural language. AITR-235. http://hdl.handle.net/1721.1/7095Google Scholar