Many current neurophysiological, psychophysical, and psychological approaches to vision rest on the idea that when we see, the brain produces an internal representation of the world. The activation of this internal representation is assumed to give rise to the experience of seeing. The problem with this kind of approach is that it leaves unexplained how the existence of such a detailed internal representation might produce visual consciousness. An alternative proposal is made here. We propose that seeing is a way of (...) acting. It is a particular way of exploring the environment. Activity in internal representations does not generate the experience of seeing. The out- side world serves as its own, external, representation. The experience of seeing occurs when the organism masters what we call the gov- erning laws of sensorimotor contingency. The advantage of this approach is that it provides a natural and principled way of accounting for visual consciousness, and for the differences in the perceived quality of sensory experience in the different sensory modalities. Sev- eral lines of empirical evidence are brought forward in support of the theory, in particular: evidence from experiments in sensorimotor adaptation, visual “filling in,” visual stability despite eye movements, change blindness, sensory substitution, and color perception. (shrink)

On the occasion of a first conference on Cognitive Science, it seems appropriate to review the basis of common understanding between the various disciplines. In my estimate, the most fundamental contribution so far of artificial intelligence and computer science to the joint enterprise of cognitive science has been the notion of a physical symbol system, i.e., the concept of a broad class of systems capable of having and manipulating symbols, yet realizable in the physical universe. The notion of symbol so (...) defined is internal to this concept, so it becomes a hypothesis that this notion of symbols includes the symbols that we humans use every day of our lives. In this paper we attempt systematically, but plainly, to lay out the nature of physical symbol systems. Such a review is in ways familiar, but not thereby useless. Restatement of fundamentals is an important exercise. (shrink)

A startling amount of intelligent activity can be controlled without reasoning or thought. By tuning the perceptual system to task relevant properties a creature can cope with relatively sophisticated environments without concepts. There is a limit, however, to how far a creature without concepts can go. Rod Brooks, like many ecologically oriented scientists, argues that the vast majority of intelligent behaviour is concept-free. To evaluate this position I consider what special benefits accrue to concept-using creatures. Concepts are either necessary for (...) certain types of perception, learning, and control, or they make those processes computationally simpler. Once a creature has concepts its capacities are vastly multiplied. (shrink)

We present data and argument to show that in Tetris - a real-time interactive video game - certain cognitive and perceptual problems are more quickly, easily, and reliably solved by performing actions in the world rather than by performing computational actions in the head alone. We have found that some translations and rotations are best understood as using the world to improve cognition. These actions are not used to implement a plan, or to implement a reaction; they are used to (...) change the world in order to simplify the problem-solving task. Thus, we distinguish pragmatic actions ñ actions performed to bring one physically closer to a goal - from epistemic actions - actions performed to uncover information that is hidden or hard to compute mentally. To illustrate the need for epistemic actions, we first develop a standard information-processing model of Tetris-cognition, and show that it cannot explain performance data from human players of the game - even when we relax the assumption of fully sequential processing. Standard models disregard many actions taken by players because they appear unmotivated or superfluous. However, we describe many such actions that are actually taken by players that are far from superfluous, and that play valuable roles in improving human performance. We argue that traditional accounts are limited because they regard action as having a single function: to change the world. By recognizing a second function of action - an epistemic function - we can explain many of the actions that a traditional model cannot. Although, our argument is supported by numerous examples specifically from Tetris, we outline how the one category of epistemic action can be incorporated into theories of action more generally. (shrink)

The objective of research in the foundations of Al is to explore such basic questions as: What is a theory in Al? What are the most abstract assumptions underlying the competing visions of intelligence? What are the basic arguments for and against each assumption? In this essay I discuss five foundational issues: (1) Core Al is the study of conceptualization and should begin with knowledge level theories. (2) Cognition can be studied as a disembodied process without solving the symbol grounding (...) problem. (3) Cognition is nicely described in propositional terms. (4) We can study cognition separately from learning. (5) There is a single architecture underlying virtually all cognition. I explain what each of these implies and present arguments from both outside and inside Al why each has been seen as right or wrong. (shrink)

Existential phenomenologists hold that the two most basic forms of intelligent behavior, learning, and skillful action, can be described and explained without recourse to mind or brain representations. This claim is expressed in two central notions in Merleau-Ponty's Phenomenology of Perception: the intentional arc and the tendency to achieve a maximal grip. The intentional arc names the tight connection between body and world, such that, as the active body acquires skills, those skills are “stored”, not as representations in the mind, (...) but as dispositions to respond to the solicitations of situations in the world. A phenomenology of skill acquisition confirms that, as one acquires expertise, the acquired know-how is experienced as finer and finer discriminations of situations paired with the appropriate response to each. Maximal grip names the body's tendency to refine its responses so as to bring the current situation closer to an optimal gestalt. Thus, successful learning and action do not require propositional mental representations. They do not require semantically interpretable brain representations either.Simulated neural networks exhibit crucial structural features of the intentional arc, and Walter Freeman's account of the brain dynamics underlying perception and action is structurally isomorphic with Merleau-Ponty's account of the way a skilled agent is led by the situation to move towards obtaining a maximal grip. (shrink)

Existential phenomenologists hold that the two most basic forms of intelligent behavior, learning, and skillful action, can be described and explained without recourse to mind or brain representations. This claim is expressed in two central notions in Merleau-Ponty's Phenomenology of Perception: the intentional arc and the tendency to achieve a maximal grip. The intentional arc names the tight connection between body and world, such that, as the active body acquires skills, those skills are stored, not as representations in the mind, (...) but as dispositions to respond to the solicitations of situations in the world. A phenomenology of skill acquisition confirms that, as one acquires expertise, the acquired know-how is experienced as finer and finer discriminations of situations paired with the appropriate response to each. Maximal grip names the body's tendency to refine its responses so as to bring the current situation closer to an optimal gestalt. Thus, successful learning and action do not require propositional mental representations. They do not require semantically interpretable brain representations either.Simulated neural networks exhibit crucial structural features of the intentional arc, and Walter Freeman's account of the brain dynamics underlying perception and action is structurally isomorphic with Merleau-Ponty's account of the way a skilled agent is led by the situation to move towards obtaining a maximal grip. (shrink)

Existential phenomenologists hold that the two most basic forms of intelligent behavior, learning, and skillful action, can be described and explained without recourse to mind or brain representations. This claim is expressed in two central notions in Merleau-Ponty's Phenomenology of Perception: the intentional arc and the tendency to achieve a maximal grip. The intentional arc names the tight connection between body and world, such that, as the active body acquires skills, those skills are “stored”, not as representations in the mind, (...) but as dispositions to respond to the solicitations of situations in the world. A phenomenology of skill acquisition confirms that, as one acquires expertise, the acquired know-how is experienced as finer and finer discriminations of situations paired with the appropriate response to each. Maximal grip names the body's tendency to refine its responses so as to bring the current situation closer to an optimal gestalt. Thus, successful learning and action do not require propositional mental representations. They do not require semantically interpretable brain representations either.Simulated neural networks exhibit crucial structural features of the intentional arc, and Walter Freeman's account of the brain dynamics underlying perception and action is structurally isomorphic with Merleau-Ponty's account of the way a skilled agent is led by the situation to move towards obtaining a maximal grip. (shrink)

This volume will acquaint novice philosophers with one of the most important debates in twentieth-century philosophy, and will provide seasoned readers with a ...

The first comprehensive presentation of the dynamical approach to cognition. It contains a representative sampling of original, current research on topics such as perception, motor control, speech and language, decision making, and development.

""Catching Ourselves in the Act" is no less than an attempt to explain intelligence. Delightful how the author dismantles traditional views in.

The notion of a "mental representation" is, arguably, in the first instance a theoretical construct of cognitive science. As such, it is a basic concept of the Computational Theory of Mind, according to which cognitive states and processes are constituted by the occurrence, transformation and storage (in the mind/brain) of information-bearing structures (representations) of one kind or another.

In recent years, embodied cognitive agents have become a central research focus in Cognitive Science. We suggest that there are at least three aspects of embodiment| physical, social and temporal|which must be treated simultaneously to make possible a realistic implementation of agency. In this paper we detail the ways in which attention to the temporal embodiment of a cognitive agent (perhaps the most neglected aspect of embodiment) can enhance the ability of an agent to act in the world, both in (...) itself, and also by supporting more robust integrations with the physical and social worlds. (shrink)

There has been much discussion recently about the scope and limits of purely symbolic models of the mind and about the proper role of connectionism in cognitive modeling. This paper describes the symbol grounding problem : How can the semantic interpretation of a formal symbol system be made intrinsic to the system, rather than just parasitic on the meanings in our heads? How can the meanings of the meaningless symbol tokens, manipulated solely on the basis of their shapes, be grounded (...) in anything but other meaningless symbols? The problem is analogous to trying to learn Chinese from a Chinese/Chinese dictionary alone. A candidate solution is sketched: Symbolic representations must be grounded bottom-up in nonsymbolic representations of two kinds: iconic representations, which are analogs of the proximal sensory projections of distal objects and events, and categorical representations, which are learned and innate feature-detectors that pick out the invariant features of object and event categories from their sensory projections. Elementary symbols are the names of these object and event categories, assigned on the basis of their categorical representations. Higher-order symbolic representations, grounded in these elementary symbols, consist of symbol strings describing category membership relations. Connectionism is one natural candidate for the mechanism that learns the invariant features underlying categorical representations, thereby connecting names to the proximal projections of the distal objects they stand for. In this way connectionism can be seen as a complementary component in a hybrid nonsymbolic/symbolic model of the mind, rather than a rival to purely symbolic modeling. Such a hybrid model would not have an autonomous symbolic module, however; the symbolic functions would emerge as an intrinsically dedicated symbol system as a consequence of the bottom-up grounding of categories ' names in their sensory representations. Symbol manipulation would be governed not just by the arbitrary shapes of the symbol tokens, but by the nonarbitrary shapes of the icons and category invariants in which they are grounded. (shrink)

I argue that consciousness is an aspect of an agent's intelligence, hence of its ability to deal adaptively with the world. In particular, it allows for the possibility of noting and correcting the agent's errors, as actions performed by itself. This in turn requires a robust self-concept as part of the agent's world model; the appropriate notion of self here is a special one, allowing for a very strong kind of self-reference. It also requires the capability to come to see (...) that world model as residing in its belief base, while then representing the actual world as possibly different, i.e., forming a new world-model. This suggests particular computational mechanisms by which consciousness occurs, ones that conceivably could be discovered by neuroscientists, as well as built into artificial systems that may need such capabilities. Consciousness, then, is not an epiphenomenon at all, but rather a key part of the functional architecture of suitably intelligent agents, hence amenable to study as much as any other architectural feature. I also argue that ignorance of how subjective states could be essentially functional does not itself lend credibility to the view that such states are not essentially functional; the strong self-reference proposal here is one possible functional explanation of consciousness. (shrink)

For many of the authors in this volume, this is the second attempt to explore what McCarthy and Hayes (1969) first called the “Frame Problem”. Since the first compendium (Pylyshyn, 1987), nicely summarized here by Ronald Loui, there have been several conferences and books on the topic. Their goals range from providing a clarification of the problem by breaking it down into subproblems (and sometimes declaring the hard subproblems to not be the_ real_ Frame Problem), to providing formal “solutions” to (...) certain aspects of the problem. But more often the message has been that the problem is not solvable except in a piecemeal way in special circumstances by some sort of heuristic approximations. It has sometimes also been said that solving the Frame Problem is not only an unachievable goal, but it is also an unnecessary one since_ humans_ do not solve it either; we simply get along as best we can and deal with the problem of planning in ways that, to use Dennett’s phrase, is “good enough for government work”. (shrink)

Sometimes the way to make progress on a topic is to turn your back on it for a few years. At least I hope so, since I have just returned to the Frame Problem after several years of concentrating on other topics. It seems to me that I may have picked up a few odds and ends that shed light on the issues.