A set of hypotheses is formulated for a connectionist approach to cognitive modeling. These hypotheses are shown to be incompatible with the hypotheses underlying traditional cognitive models. The connectionist models considered are massively parallel numerical computational systems that are a kind of continuous dynamical system. The numerical variables in the system correspond semantically to fine-grained features below the level of the concepts consciously used to describe the task domain. The level of analysis is intermediate between those of symbolic cognitive models (...) and neural models. The explanations of behavior provided are like those traditional in the physical sciences, unlike the explanations provided by symbolic models. (shrink)

Engineers use neural networks to control systems too complex for conventional engineering solutions. To examine the behavior of individual hidden units would defeat the purpose of this approach because it would be largely uninterpretable. Yet neurophysiologists spend their careers doing just that! Hidden units contain bits and scraps of signals that yield only arcane hints about network function and no information about how its individual units process signals. Most literature on single-unit recordings attests to this grim fact. On the other (...) hand, knowing a system's function and describing it with elegant mathematics tell one very little about what to expect of interneuronal behavior. Examples of simple networks based on neurophysiology are taken from the oculomotor literature to suggest how single-unit interpretability might decrease with increasing task complexity. It is argued that trying to explain how any real neural network works on a cell-by-cell, reductionist basis is futile and we may have to be content with trying to understand the brain at higher levels of organization. (shrink)

This paper explores the difference between Connectionist proposals for cognitive a r c h i t e c t u r e a n d t h e s o r t s o f m o d e l s t hat have traditionally been assum e d i n c o g n i t i v e s c i e n c e . W e c l a i m t h a t t h (...) e m a j o r d i s t i n c t i o n i s t h a t , w h i l e b o t h Connectionist and Classical architectures postulate representational mental states, the latter but not the former are committed to a symbol-level of representation, or to a ‘language of thought’: i.e., to representational states that have combinatorial syntactic and semantic structure. Several arguments for combinatorial structure in mental representations are then reviewed. These include arguments based on the ‘systematicity’ of mental representation: i.e., on the fact that cognitive capacities always exhibit certain symmetries, so that the ability to entertain a given thought implies the ability to entertain thoughts with semantically related contents. We claim that such arguments make a powerful case that mind/brain architecture is not Connectionist at the cognitive level. We then consider the possibility that Connectionism may provide an account of the neural (or ‘abstract neurological’) structures in which Classical cognitive architecture is implemented. We survey a n u m b e r o f t h e s t a n d a r d a r g u m e n t s t h a t h a v e b e e n o f f e r e d i n f a v o r o f Connectionism, and conclude that they are coherent only on this interpretation. (shrink)

Something remarkable is happening in the cognitive sciences. After a quarter of a century of cognitive models that were inspired by the metaphor of the digital computer, the newest cognitive models are inspired by the properties of the brain itself. Variously referred to as connectionist, parallel distributed processing, or neutral network models, they explore the idea that complex intellectual operations can be carried out by large networks of simple, neuron-like units. The units themselves are identical, very low-level and 'stupid'. Intelligent (...) performance is derived from the pattern of connection strengths between units, and the fundamental cognitive activity is pattern recognition and completion. Connectionism and the Mind provides an introduction to this newly emerging approach to understanding the mind. The first few chapters focus on network architecture, offering accessible treatment of the equations that describe learning and the propagation of activation. Furthermore, the reader is walked step-by-step through the activities of networks engaged in pattern recognition, learning, and cognitive tasks such as memory retrieval and prototype formation. The remainder of the book addresses the implications of connectionism for theories of the mind, both philosophical and psychological. Foe example: What Role is played by pattern recognition and completion as basic as cognitive functions? Connectionist models have particular strength in learning and pattern recognition; should they be limited to those functions, or can they provide an overall account of cognitive functioning? In particular, can connectionist models provide an adequate account of the ability to employ linguistic and other symbol systems, or must an adequate system incorporate symbol processing as a basic cognitive capacity? Finally, Connectionism and the Mind examines the relation of connectionist models to philosophical accounts of propositional attitudes, and to a variety of other inquiries in cognitive psychology, linguistics, developmental psychology, artificial intelligence and neuroscience. (shrink)