Elsevier

Cognition

Volume 146, January 2016, Pages 81-89
Cognition

Discussion
Towards a common framework of grounded action cognition: Relating motor control, perception and cognition

https://doi.org/10.1016/j.cognition.2015.09.010Get rights and content

Highlights

  • There is theoretical confusion on the relation between action and cognition.

  • Widely used notions have both overlapping and contradictory implications.

  • Existing accounts can be classified within a framework of grounded action cognition.

  • Grounded action cognition increases comparability of related empirical research.

Abstract

The relation between motor control and action cognition – including action-related thoughts and action-related perception – has been subject to controversial discussions in the last three decades. During these decades, cognitive neuroscience has been increasingly confronted with a huge variety of different accounts trying to understand and explain the relation between these systems, their interdependencies and the mediating mechanisms by establishing notions such as “internal models”, “simulation” or “shared representation”. These accounts, however, include a large array of partly overlapping, partly contradictory theories using similar terms for different mechanisms and different terms for similar mechanisms. In the absence of a systematic work-up and comparison, this array of accounts and theories leads to confusion in the field, duplication of experimental work, and unconnected parallelism of theory formation within and between different disciplines. Here we provide a systematic comparison of current models and prospective theories that deal with the relation between cognition, perception and motor control mechanisms. In a second step, we propose “grounded action cognition” as a comprehensive metatheoretical framework which defines different hypothetical possibilities of the relations between these domains, offers systematic insights into current models and theories and last but not least may help to increase comparability of empirical research in the domain of action and action cognition.

Introduction

There is a long tradition and interest in many different disciplines on the interplay between action and perception. This interest is led by various aims: while some disciplines investigate this interplay with the aim of understanding human ‘cognitive mechanisms’ (cognitive psychology, philosophy), brain mechanisms (cognitive neuroscience) or neurologic and psychiatric diseases (neurology/psychiatry), others study this relation to model skillful movements (robotics) or perceptual abilities (computational and mathematical neuroscience). Some of these traditions date back to 19th century experimental psychology and philosophical theory of voluntary action (James, 1890/1981). Others were developed more recently. For example, approaches from computational and cognitive neuroscience, starting in the early 1990s, aim at describing the precise brain systems and neuronal dynamics underlying the action–perception inter-linkage by means of internal forward/generative models (Friston et al., 2010, Wolpert and Miall, 1996). The focus on the linkage between action and perception has now been expanded to include also conceptual abilities and cognition in general. Specifically, growing interdisciplinary work has now begun to relate different theoretical approaches and empirical findings to explain also higher-cognitive skills like mind reading in social contexts (Gallese & Goldman, 1998) or mental imagery (Grush, 2004).

Here we take an interdisciplinary point of departure with the aim to provide a systematic comparison of current and established theoretical models and prospective theories that deal with the relation between cognition, perception and motor control mechanisms. We will in particular focus on the proposed internal representational mechanisms governing mutual relations between perception and action. Accordingly, the selection criterion for the theories to be compared in the present paper is that they make some substantial claim about the systematic connection between the domains of cognition, perception and motor control.1 It is beyond the scope of the present endeavor to also take dynamic interactions between mind/brain, body and world into account as proposed by some more radical conceptions of embodied cognition (for an overview compare Shapiro, 2011; or Wilson, 2002; for certain conceptions of these radical or dynamic views see Beer, 1995, Hutto and Myin, 2013, Keijzer, 2002). Thus, we will here specifically consider internal representations that appear to draw on motor-related processes. We will use the term ‘grounding’ to refer to the general relation between motor processes and action perception/cognition, which seems underdetermined so far in current theories. Please also note that it is not our aim to provide a systematic review of those single theories in terms of supporting or challenging empirical evidence (for a recent review see, for example, Engel, Maye, Kurthen, & König, 2013). Instead, we here aim to systematically compare the empirical and explanatory foci those theories adopt with respect to the nature of the relation between motor control and action–cognition.

This paper comprises three sections. The first provides a brief overview of different action theories and suggests a classification by target mechanisms. In the second section, we introduce a framework that will be used to illustrate our notion of grounded action cognition as a metatheoretical view. Third and finally, our purpose is to show how existing theories can or cannot be classified into genuine grounding theories. This new classification scheme shall offer new perspectives into commonalities and differences as well as the explanatory scope with respect to the degree to which perceptual and cognitive abilities genuinely draw on motor capacities; however, it is not meant to suggest an evaluation of existing and established theories concerning their theoretical and empirical adequacy.

Section snippets

The three main families of action theories

The large amount of highly heterogeneous, partly overlapping, partly differing theories coming from very different disciplines is often confusing. To facilitate a better overview and understanding, we here classify the existing theories into three major theoretical frameworks/families of grounded action cognition accounts: (1) Common Coding, (2) Internal Models, and (3) Simulation theories (Table 1; for a detailed description and analysis of each of these families, see next paragraph). These

Grounded action cognition: a metatheoretical view

In our approach towards a systematic framework, we will now specify common denominators of the manifold existing assumptions regarding the relation between the three domains of action cognition, perception, control and concepts of action. Current theories and related experimental reports sometimes appear to use the same terms to explain different phenomena or mechanisms, and different terms to explain the same phenomena or similar mechanisms. For example, the term ‘simulation’ has been used to

Action cognition theories and implied constitution relation

In the first part of the present paper, we organized the established action cognition theories into three major families, Common Coding (CC), Internal Models (IM) and Simulation Theories (ST). We will now analyze them in more detail with respect to whether they can be considered genuine grounding theories; that is, they will be compared according to the implied constitution relation between motor control and action cognition. The aim shall be to put the variety of existing accounts of action

Conclusions

Following the modular picture of the mind, cognition and action has commonly been assumed to operate in strictly different domains: cognition draws on abstract conceptual representations, whereas motor control functions are thought to rely on relatively low-level and automatic processes. In recent years, however, cognitive neuroscience has been confronted with an increasingly large array of partly overlapping, partly contradicting theories that diverge broadly with respect to the degree to

Acknowledgments

This project was supported by a grant of the Volkswagen Stiftung to all of the authors (“Grounding thoughts in actions, ThinkAct’’; Az. II/85 068/85 158/85 159) and a Heisenberg fellowship (SCHU 2471/4-1) of German Research Foundation/Deutsche Forschungsgemeinschaft (DFG) to SS-B.

References (64)

  • G. Rizzolatti et al.

    Premotor cortex and the recognition of motor actions

    Brain Research. Cognitive Brain Research

    (1996)
  • L.W. Barsalou

    Perceptual symbol systems

    Behavioral and Brain Sciences

    (1999)
  • L.W. Barsalou

    Grounded cognition

    Annual Review of Psychology

    (2008)
  • C.C. Bell et al.

    Corollary discharge inhibition and preservation of temporal information in a sensory nucleus of mormyrid electric fish

    Journal of Neuroscience

    (1989)
  • S.J. Blakemore et al.

    Spatio-temporal prediction modulates the perception of self-produced stimuli

    Journal of Cognitive Neuroscience

    (1999)
  • V. Chambon et al.

    Premotor or ideomotor: How does the experience of action come about?

  • M. de Vega et al.

    Symbols and embodiment: Debates on meaning and cognition

    (2008)
  • M. Desmurget et al.

    Movement intention after parietal cortex stimulation in humans

    Science

    (2009)
  • R.W. Ditchburn et al.

    Vision with a stabilized retinal image

    Nature

    (1952)
  • B. Elsner et al.

    Effect anticipation and action control

    Journal of Experimental Psychology: Human Perception and Performance

    (2001)
  • J.A. Fodor

    The language of thought

    (1975)
  • K. Friston

    A theory of cortical responses

    Philosophical Transactions of the Royal Society of London, Series B: Biological sciences

    (2005)
  • K. Friston et al.

    Action and behavior: A free-energy formulation

    Biological Cybernetics

    (2010)
  • K. Friston et al.

    Action understanding and active inference

    Biological Cybernetics

    (2011)
  • V. Gallese

    The manifold nature of interpersonal relations: The quest for a common mechanism

    Philosophical Transactions of the Royal Society of London, Series B: Biological sciences

    (2003)
  • V. Gallese et al.

    Action recognition in the premotor cortex

    Brain

    (1996)
  • E.J. Gibson

    Principles of perceptual learning and development

    (1969)
  • A.M. Glenberg et al.

    Grounding language in action

    Psychonomic Bulletin & Review

    (2002)
  • A.I. Goldman

    In defense of the simulation theory

    Mind & Language

    (1992)
  • R.M. Gordon

    Folk psychology as simulation

    Mind & Language

    (1986)
  • A.G. Greenwald

    Sensory feedback mechanisms in performance control: With special reference to the ideo-motor mechanism

    Psychological Review

    (1970)
  • M. Grossman et al.

    Impaired action knowledge in amyotrophic lateral sclerosis

    Neurology

    (2008)
  • Cited by (64)

    • The effect of perceptual-motor continuity compatibility on the temporal control of continuous and discontinuous self-paced rhythmic movements

      2021, Human Movement Science
      Citation Excerpt :

      There is a vast body of research describing the neuronal dynamics and the cognitive mechanisms supporting the action-perception linkage by means of a shared representation (Gentsch, Weber, Synofzik, Vosgerau, & Schütz-Bosbach, 2016; Iacoboni, Woods, & Mazziotta, 1998; Prinz, 1997; Rizzolatti & Craighero, 2004; Schütz-Bosbach & Prinz, 2007; Wolpert, Ghahramani, & Jordan, 1995). According to common coding theories (Greenwald, 1970; Hommel, Müsseler, Aschersleben, & Prinz, 2001; reviewed in Gentsch et al., 2016), the preparation of goal-directed actions automatically activates the representation of their specific sensory effects due to a common or bidirectional representation, with abundant empirical evidence from classical studies on stimulus-response compatibility effects showing a benefit (in terms of speed and accuracy) when the spatial location of the stimulus matches the spatial location of the motor response (for review, see Hughes, Desantis, & Waszak, 2013; Shin, Proctor, & Capaldi, 2010; Waszak, Cardoso-Leite, & Hughes, 2012). One of the questions yet to be fully understood is to what extent the properties of the sensory and the movement information interact to facilitate sensorimotor integration.

    • On the perception of movement vigour

      2023, Quarterly Journal of Experimental Psychology
    View all citing articles on Scopus
    View full text