Perception and Action

According to an influential view, the detection of action possibilities and the selection of a plan for action are two segregated steps throughout the processing of visual information. This classical approach is committed with the assumption that two independent types of processing underlie visual perception: the semantic one, which is at the service of the identification of visually presented objects, and the pragmatic one which serves the execution of actions directed to specific parts of the same objects. However, as our (...) knowledge of vision has improved over the years, this established view has turned out to be only an approximation. This paper sets out the details of a non-modularist approach to visual perception of action possibilities and explains how to resist the lure of cognitive segregation. (shrink)

In this paper, I argue for two claims. First, Alva Noë’s discussions of perceptual presence contain an ambiguity between what I refer to as ‘presence as absence’ (PA) and ‘virtual presence’ (VP). This ambiguity emerges in Noë’s solution to ‘the problem of perceptual presence’, or the problem of how to account for our perceptual experience of that which we ‘strictly speaking’ are not seeing. Second, his account of presence by degrees, i.e. his radical claim that many distant, out-of-view objects are (...) (quasi-perceptually) present to us by various degrees, will not be tenable whether unpacked in terms of PA or VP: e.g. Noë argues that the presence of the tomato in front of him, and the presence of his friend Dominic in a distant country, are different not in kind but in degree only. Neither of the two conceptions of presence renders this plausible. (shrink)

In this paper, I critically examine Dan Zahavi’s multidimensional account of the self and show how the distinction he makes among ‘pre-reflective minimal’, ‘interpersonal’, and ‘normative’ dimensions of selfhood needs to be refined in order to accommodate what I call ‘pre-reflective self-understanding’. The latter is a normative dimension of selfhood manifest not in reflection and deliberation, but in the habits and style of a person’s pre-reflective absorption in the world. After reviewing Zahavi's multidimensional account and revealing this gap in his (...) explanatory taxonomy, I draw upon Heidegger, Merleau-Ponty, and Frankfurt in order to sketch an account of pre-reflective self-understanding. I end by raising an objection to Zahavi’s claim for the primitive and foundational status of pre-reflective self-awareness. To carve off self-awareness from the self’s practical immersion in a situation where things and possibilities already matter and draw one to act is to distort the phenomena. A more careful phenomenology of pre-reflective action shows that pre-reflective self-awareness and pre-reflective self-understanding are co-constitutive, both mutually for each other and jointly for everyday experience. (shrink)

Recently, several theorists have proposed that we can perceive a range of high-level features, including natural kind features (e.g., being a lemur), artifactual features (e.g., being a mandolin), and the emotional features of others (e.g., being surprised). I clarify the claim that we perceive high-level features and suggest one overlooked reason this claim matters: it would dramatically expand the range of actions perception-based theories of action might explain. I then describe the influential phenomenal contrast method of arguing for high-level perception (...) and discuss some of the objections that have been raised against this strategy. Finally, I describe two emerging defenses of high-level perception, one of which appeals to a certain class of perceptual deficits and one of which appeals to adaptation effects. I sketch a challenge for the latter approach. (shrink)

In this paper, I defend an account of how perceptual experience can bear rational relation to our empirical thought. In the first part, I elaborate two claims that are central for the justificational role of perceptual experience, namely, the claim that perception and belief share the same kind of content, and the claim that perception is independent from belief. At first sight, these claims seems not to be compatible, since the first one seems to require the truth of content conceptualism, (...) while the second one seems to require its falsity. In the second part, based on Alva Noë's actionist theory of perception, I argue in favor of a less intellectualist interpretation of the first claim, uncommitted to content conceptualism, and then I show how it can be reconciled with the second claim. Finally, I explain how perception holds rational relationships with our empirical thought through the exercise of observational concepts. These concepts link what I propose to call 'space of actions' to the logical space of reasons. (shrink)

The conclusion of practical reasoning is commonly said to rest upon a diverse pair of representations—a “major” and a “minor” premise—the first of which concerns the end and the second, the means. Modern and contemporary philosophers writing on action and practical reasoning tend to portray the minor premise as a “means-end belief”—a belief about, as Michael Smith puts it, “the ways in which one thing leads to another,” or, as John McDowell puts it, “what can be relied on to bring (...) about what.” On this point there is little difference between followers of Davidson and followers of Anscombe, or between those who invoke Hume’s legacy and those who invoke Aristotle’s. But Aristotle himself held a very different position. According to him, the minor premise concerns particulars, a sphere controlled by perception. The perception of particulars—that is, of the really-existing people and things confronted in the field of action—plays no essential role in the modern account of rational agency. Because it does not, the modern account fails to explain how one could act for a reason, or how practical reasoning could deliver any conclusion. (shrink)

Mead and Merleau-Ponty each portray the perceptual field as a field of spatially and temporally located, ontologically "thick" or resisting objects which are essentially related to the horizon of world, which allow for the very structure of the sensing which gives access to them, and whose manner of emergence undercuts the problematics of the subject-object split. This essay surveys this perceptual field as a focus for eliciting their more fundamental shared understanding of the dimensions of human activity which underlie its (...) emergence. (shrink)

The main idea of this book is that perceiving is a way of acting. Perception is not something that happens to us, or in us. It is something we do. Think of a blind person tap-tapping his or her way around a cluttered space, perceiving that space by touch, not all at once, but through time, by skillful probing and movement. This is, or at least ought to be, our paradigm of what perceiving is. The world makes itself available to (...) the perceiver through physical movement and interaction. In this book I argue that all perception is touch-like in this way: perceptual experience acquires content thanks to our possession of bodily skills. What we perceive is determined by what we do ; it is determined by what we are ready to do. In ways I try to make precise, we enact our perceptual experience; we act it out. (shrink)

Contemporary scientific and philosophical literature on perception often focuses on the relationship between perception and action, emphasizing the ways in which perception can be understood as geared towards action or ‘action-oriented’. In this paper I provide a framework within which to classify approaches to action-oriented perception, and I highlight important differences between the distinct approaches. I show how talk of perception as action-oriented can be applied to the evolutionary history of perception, neural or psychological perceptual mechanisms, the semantic content or (...) phenomenal character of perceptual states, or to the metaphysical nature of perception. I argue that there are no straightforward inferences from one kind of action-oriented perception to another. Using this framework and its insights, I then explore the notion of action-oriented perceptual representation which plays a key role in some approaches to embodied cognitive science. I argue that the concept of action-oriented representation proposed by Clark and Wheeler is less straightforward than it might seem, because it seems to require both that the mechanisms of perceptual representation are action-oriented and that the content of these perceptual representations are action-oriented. Given that neither of these claims can be derived from the other, proponents of action-oriented representation owe us separate justification for each claim. I will argue that such justifications are not forthcoming in the literature, and that attempts to reconstruct them run into trouble: the sorts of arguments offered for the representational mechanisms being action-oriented seem to undermine the sorts of arguments offered for the representational content being action-oriented, and vice-versa. (shrink)

I argue that Husserl’s transcendental account of the role of the lived body in sense-making is a precursor to Alva Noë’s recent work on the enactive, embodied mind, specifically his notion of “sensorimotor knowledge” as a form of embodied sense-making that avoids representationalism and intellectualism. Derrida’s deconstructive account of meaning—developed largely through a critique of Husserl—relies on the claim that meaning is structured through the complication of the “interiority” of consciousness by an “outside,” and thus might be thought to lend (...) itself to theories of mind such as Noë’s that emphasize the ways in which sense-making occurs outside the head. But while Derrida’s notion of “contamination” rightly points to an indeterminateness of meaning in an outside, extended, concrete lived world, he ultimately reduces meaning to a structure of signification. This casts indeterminateness in terms of absence, ignoring the presence of non-linguistic phenomena of embodied sense-making central to both the contemporary enactivist program and to the later Husserl, who is able to account for the indeterminateness of meaning in lived experience through his distinction between sense and more exact linguistic meaning. Husserl’s transcendental theory of meaning also allows for a substantive contribution to sense-making from the side of the perceived object—an aspect missing from Noë’s account. Thus, in contrast to Derrida and to Noë, Husserl accounts for sense-making in terms of both the lived body and the lived world. (shrink)

According to the cognitivist strategy, the desire to bring about P provides reasons for intending to bring about P in a way analogous to how perceiving that P provides reasons for believing that P. However, while perceiving P provides reasons for believing P by representing P as true, desiring to bring about P provides reasons for intending to bring about P by representing P as good. This paper offers an argument against this view. My argument proceeds via an appeal to (...) what I call the non-substitutability of perception, the thesis that, given that there is no independent evidence for P, one cannot substitute something that fails to provide reasons with respect to P for the perceptual experience that P, without altering the rational permissibility of believing that P. By contrast, I argue that it is always possible to substitute something that fails to provide reasons for a desire without altering the rational permissibility of an intention based on said desire. I take this to show that a desire does not provide reasons in a way analogous to perceptual experience. (shrink)

Although predictive coding may offer a computational principle that unifies perception and action, states with different directions of fit are involved (with indicative and imperative contents, respectively). Predictive states are adjusted to fit the world in the course of perception, but in the case of action, the corresponding states act as a fixed target towards which the agent adjusts the world. This well-recognised distinction helps side-step some problems discussed in the target article.

In her paper, ‘Action and Self-location in Perception’, Susanna Schellenberg argues that perceptual experience of an object's intrinsic spatial properties, such as its size and shape, requires a capacity to act. More specifically, Schellenberg argues that, to have a perceptual experience of an object's intrinsic spatial properties, a subject needs to have a certain practical conception of space, or a spatial know-how. That, in turn, requires self-locating representations, which locate the subject, relative to the perceptual object, as a perceiver and (...) an agent, viz., someone who has a capacity for actions. She also makes two objections, viz., the unification objection and the sentient statue objection, to Alva Noë's sensorimotor view, a different account of how perceptual experience depends on actions. I will argue that her objections jointly render problematic not only Noë's but also her own view. (shrink)

Autism has been defined as a disorder of social cognition, interaction and communication where ritualistic, repetitive behaviors are commonly observed. But how should we understand the behavioral and cognitive differences that have been the main focus of so much autism research? Can high-level cognitive processes and behaviors be identified as the core issues people with autism face, or do these characteristics perhaps often rather reflect individual attempts to cope with underlying physiological issues? Much research presented in this volume will point (...) to the latter possibility, i.e. that people on the autism spectrum cope with issues at much lower physiological levels pertaining not only to Central Nervous Systems (CNS) function, but also to peripheral and autonomic systems (PNS, ANS) (Torres, Brincker, et al. 2013). The question that we pursue in this chapter is what might be fruitful ways of gaining objective measures of the large-scale systemic and heterogeneous effects of early atypical neurodevelopment; how to track their evolution over time and how to identify critical changes along the continuum of human development and aging. We suggest that the study of movement variability—very broadly conceived as including all minute fluctuations in bodily rhythms and their rates of change over time (coined micro-movements (Figure 1A-B) (Torres, Brincker, et al. 2013))—offers a uniquely valuable and entirely objectively quantifiable lens to better assess, understand and track not only autism but cognitive development and degeneration in general. This chapter presents the rationale firstly behind this focus on micro-movements and secondly behind the choice of specific kinds of data collection and statistical metrics as tools of analysis (Figure 1C). In brief the proposal is that the micro-movements (defined in Part I – Chapter 1), obtained using various time scales applied to different physiological data-types (Figure 1), contain information about layered influences and temporal adaptations, transformations and integrations across anatomically semi-independent subsystems that crosstalk and interact. Further, the notion of sensorimotor re-afference is used to highlight the fact that these layered micro-motions are sensed and that this sensory feedback plays a crucial role in the generation and control of movements in the first place. In other words, the measurements of various motoric and rhythmic variations provide an access point not only to the “motor systems”, but also access to much broader central and peripheral sensorimotor and regulatory systems. Lastly, we posit that this new lens can also be used to capture influences from systems of multiple entry points or collaborative control and regulation, such as those that emerge during dyadic social interactions. (shrink)

Although the sensorimotor account is a significant step forward, it cannot explain experiences of entoptic phenomena that violate normal sensorimotor contingencies but nonetheless are perceived as visual. Nervous system structure limits how they can be interpreted. Neurophysiology, combined with a sensorimotor theory, can account for space constancy by denying the existence of permanent representations of states that must be corrected or updated.

Two cross-modal experiments provide partial support for O'Regan & Noë's (O&N's) claim that sensorimotor contingencies mediate perception. Differences in locating a target sound accompanied by a spatially disparate neutral light correlate with whether the two stimuli were perceived as spatially unified. This correlation suggests that internal representations are necessary for conscious perception, which may also mediate sensorimotor contingencies.

This commentary addresses three points. First, it is argued that the common coding principles, as developed in the target article, may supplement rather than replace stage views of human information processing. Second, the issue of the properties of an event code is briefly discussed. It is concluded that much remains to be specified so as to allow critical tests. Finally, the question of the limits of common coding is raised. It may be particularly relevant to direct perception and action coupling (...) but less useful for the analysis of cognitive skills. (shrink)

Recent computational models of motor planning have relied heavily on anticipating the consequences of motor acts. Such anticipation is vital for dealing with the redundancy problem of motor control (i.e., the problem of selecting a particular motor solution when more than one is possible to achieve a goal). Computational approaches to motor planning support the Theory of Event Coding (TEC).

The sensorimotor theory of vision is the best attempt yet to explain visual consciousness without implying a Cartesian theatre. I suggest three experiments which might test the theory.

With his massive redeployment hypothesis (MRH), Anderson claims that novel cognitive functions are likely to rely on pre-existing circuits already possessing suitable resources. Here, we put forward recent findings from studies in numerical cognition in order to show that the role of sensorimotor experience in the ontogenetical development of a new function has been largely underestimated in Anderson's proposal.

O'Regan and Noe present a wonderfully detailed and comprehensive defense of a position whose broad outline we absolutely and unreservedly endorse. They are right, it seems to us, to stress the intimacy of conscious content and embodied action, and to counter the idea of a Grand Illusion with the image of an agent genuinely in touch, via active exploration, with the rich and varied visual scene. This is an enormously impressive achievement, and we hope that the comments that follow will (...) be. (shrink)

While applauding the bulk of the account on offer, we question one apparent implication viz, that every difference in sensorimotor contingencies corresponds to a difference in conscious visual experience.

What is the relation between perceptual experience and the suite of sensorimotor skills that enable us to act in the very world we perceive? The relation, according to ‘sensorimotor models’ is tight indeed. Perceptual experience, on these accounts, is enacted via skilled sensorimotor activity, and gains its content and character courtesy of our knowledge of the relations between movement and sensory stimulation. I shall argue that this formulation is too extreme, and that it fails to accommodate the substantial firewalls, dis-integrations, (...) and specialpurpose streamings that form the massed strata of human cognition. In particular, such strong sensorimotor models threaten to obscure the computationally potent insensitivity of key information-processing events to the full subtleties of embodied cycles of sensing and moving. (shrink)

Somewhat in contrast to their proposal of two separate somatosensory streams, Dijkerman & de Haan (D&dH) propose that tactile recognition involves active manual exploration, and therefore involves parietal cortex. I argue that interactions from perception for action to object recognition can be found also in vision. Furthermore, there is evidence that perception for action and perception for recognition rely on similar processing principles.

We commend the argument that perception and action are tightly coupled. We claim that the argument is not new, that uniting stimulus and response codes is not a problem for a cognitive system, only for psychologists who assume them, and that the Theory of Event Coding (TEC)'s event-codes are arbitrary and ungrounded. Affordances and information offer the common basis for perception-action (and even for event-codes).

The claim that perception and action are commonly coded because they are indistinguishable at the distal level is crucial for theories of cognition. However, the consequences of this claim run deep, and the Theory of Event Coding (TEC) is not up to the challenge it poses. We illustrate why through a brief review of the evidence that led to the motor theory of speech perception.

The Theory of Event Coding (TEC) is a new framework for understanding interactions between perception and action. We are concerned that the theory is underspecified, showing that it can easily be used to make exactly opposite predictions. Precise specification of the time course of activation and binding is needed to make the theory useful for understanding the perception-action interface.

We share the authors' general approach to the study of perception and action, but rather than singling out a particular level of “late perceptual” and “early motor” processing for sensorimotor interactions, we argue that these can arise at multiple levels during action preparation and execution. Recent data on action-perception transfer are used to illustrate this perspective.

Sensorimotor contingencies are certainly of great importance for perception but they are no substitute for the internal representation of perceived information. I argue that internal, non-iconic representations of perceptions must, and do, exist and that sensorimotor contingencies are an integral part of them. Further, I argue that mastery of the sensory apparatus or environment is not a prerequisite for perception and that perception is possible in the absence of any control over the perceptual process.

The target article proposes that visual experience arises when sensorimotor contingencies are exploited in perception. This novel analysis of visual experience fares no better than the other proposals that the article rightly dismisses, and for the same reasons. Extracting invariants may be needed for recognition, but it is neither necessary nor sufficient for having a visual experience. While the idea that vision involves the active extraction of sensorimotor invariants has merit, it does not replace the need for perceptual representations. Vision (...) is not just for the immediate controlling of action; it is also for finding out about the world, from which inferences may be drawn and beliefs changed. (shrink)