Empiricism without Magic: Transformational Abstraction in Deep Convolutional Neural Networks

Synthese (12):1-34 (2018)
  Copy   BIBTEX


In artificial intelligence, recent research has demonstrated the remarkable potential of Deep Convolutional Neural Networks (DCNNs), which seem to exceed state-of-the-art performance in new domains weekly, especially on the sorts of very difficult perceptual discrimination tasks that skeptics thought would remain beyond the reach of artificial intelligence. However, it has proven difficult to explain why DCNNs perform so well. In philosophy of mind, empiricists have long suggested that complex cognition is based on information derived from sensory experience, often appealing to a faculty of abstraction. Rationalists have frequently complained, however, that empiricists never adequately explained how this faculty of abstraction actually works. In this paper, I tie these two questions together, to the mutual benefit of both disciplines. I argue that the architectural features that distinguish DCNNs from earlier neural networks allow them to implement a form of hierarchical processing that I call “transformational abstraction”. Transformational abstraction iteratively converts sensory-based representations of category exemplars into new formats that are increasingly tolerant to “nuisance variation” in input. Reflecting upon the way that DCNNs leverage a combination of linear and non-linear processing to efficiently accomplish this feat allows us to understand how the brain is capable of bi-directional travel between exemplars and abstractions, addressing longstanding problems in empiricist philosophy of mind. I end by considering the prospects for future research on DCNNs, arguing that rather than simply implementing 80s connectionism with more brute-force computation, transformational abstraction counts as a qualitatively distinct form of processing ripe with philosophical and psychological significance, because it is significantly better suited to depict the generic mechanism responsible for this important kind of psychological processing in the brain.

Similar books and articles

Some Neural Networks Compute, Others Don't.Gualtiero Piccinini - 2008 - Neural Networks 21 (2-3):311-321.
Abstraction Relations Need Not Be Reflexive.Jonathan Payne - 2013 - Thought: A Journal of Philosophy 2 (2):137-147.
Out of their minds: Legal theory in neural networks. [REVIEW]Dan Hunter - 1999 - Artificial Intelligence and Law 7 (2-3):129-151.
The Nuisance Principle in Infinite Settings.Sean C. Ebels-Duggan - 2015 - Thought: A Journal of Philosophy 4 (4):263-268.
The Troubled History of Abstraction.Ignacio Angelelli - 2005 - History of Philosophy & Logical Analysis 8.
Structural-Abstraction Principles.Graham Leach-Krouse - 2015 - Philosophia Mathematica:nkv033.
Marx et les abstractions.André Tosel - 2002 - Archives de Philosophie 2 (2):311-334.


Added to PP

1,001 (#10,167)

6 months
137 (#12,171)

Historical graph of downloads
How can I increase my downloads?

Author's Profile

Cameron Buckner
University of Houston

Citations of this work

Understanding from Machine Learning Models.Emily Sullivan - 2022 - British Journal for the Philosophy of Science 73 (1):109-133.
Deep learning: A philosophical introduction.Cameron Buckner - 2019 - Philosophy Compass 14 (10):e12625.
Insightful artificial intelligence.Marta Halina - 2021 - Mind and Language 36 (2):315-329.

View all 39 citations / Add more citations

References found in this work

A treatise of human nature.David Hume & A. D. Lindsay - 1969 - Harmondsworth,: Penguin Books. Edited by Ernest Campbell Mossner.
Thinking about mechanisms.Peter Machamer, Lindley Darden & Carl F. Craver - 2000 - Philosophy of Science 67 (1):1-25.
A Treatise of Human Nature (1739-40).David Hume - 1969 - Mineola, N.Y.: Oxford University Press. Edited by Ernest Campbell Mossner.
A Treatise of Human Nature.David Hume & A. D. Lindsay - 1958 - Philosophical Quarterly 8 (33):379-380.

View all 48 references / Add more references