DiscussionTowards a common framework of grounded action cognition: Relating motor control, perception and cognition
Introduction
There is a long tradition and interest in many different disciplines on the interplay between action and perception. This interest is led by various aims: while some disciplines investigate this interplay with the aim of understanding human ‘cognitive mechanisms’ (cognitive psychology, philosophy), brain mechanisms (cognitive neuroscience) or neurologic and psychiatric diseases (neurology/psychiatry), others study this relation to model skillful movements (robotics) or perceptual abilities (computational and mathematical neuroscience). Some of these traditions date back to 19th century experimental psychology and philosophical theory of voluntary action (James, 1890/1981). Others were developed more recently. For example, approaches from computational and cognitive neuroscience, starting in the early 1990s, aim at describing the precise brain systems and neuronal dynamics underlying the action–perception inter-linkage by means of internal forward/generative models (Friston et al., 2010, Wolpert and Miall, 1996). The focus on the linkage between action and perception has now been expanded to include also conceptual abilities and cognition in general. Specifically, growing interdisciplinary work has now begun to relate different theoretical approaches and empirical findings to explain also higher-cognitive skills like mind reading in social contexts (Gallese & Goldman, 1998) or mental imagery (Grush, 2004).
Here we take an interdisciplinary point of departure with the aim to provide a systematic comparison of current and established theoretical models and prospective theories that deal with the relation between cognition, perception and motor control mechanisms. We will in particular focus on the proposed internal representational mechanisms governing mutual relations between perception and action. Accordingly, the selection criterion for the theories to be compared in the present paper is that they make some substantial claim about the systematic connection between the domains of cognition, perception and motor control.1 It is beyond the scope of the present endeavor to also take dynamic interactions between mind/brain, body and world into account as proposed by some more radical conceptions of embodied cognition (for an overview compare Shapiro, 2011; or Wilson, 2002; for certain conceptions of these radical or dynamic views see Beer, 1995, Hutto and Myin, 2013, Keijzer, 2002). Thus, we will here specifically consider internal representations that appear to draw on motor-related processes. We will use the term ‘grounding’ to refer to the general relation between motor processes and action perception/cognition, which seems underdetermined so far in current theories. Please also note that it is not our aim to provide a systematic review of those single theories in terms of supporting or challenging empirical evidence (for a recent review see, for example, Engel, Maye, Kurthen, & König, 2013). Instead, we here aim to systematically compare the empirical and explanatory foci those theories adopt with respect to the nature of the relation between motor control and action–cognition.
This paper comprises three sections. The first provides a brief overview of different action theories and suggests a classification by target mechanisms. In the second section, we introduce a framework that will be used to illustrate our notion of grounded action cognition as a metatheoretical view. Third and finally, our purpose is to show how existing theories can or cannot be classified into genuine grounding theories. This new classification scheme shall offer new perspectives into commonalities and differences as well as the explanatory scope with respect to the degree to which perceptual and cognitive abilities genuinely draw on motor capacities; however, it is not meant to suggest an evaluation of existing and established theories concerning their theoretical and empirical adequacy.
Section snippets
The three main families of action theories
The large amount of highly heterogeneous, partly overlapping, partly differing theories coming from very different disciplines is often confusing. To facilitate a better overview and understanding, we here classify the existing theories into three major theoretical frameworks/families of grounded action cognition accounts: (1) Common Coding, (2) Internal Models, and (3) Simulation theories (Table 1; for a detailed description and analysis of each of these families, see next paragraph). These
Grounded action cognition: a metatheoretical view
In our approach towards a systematic framework, we will now specify common denominators of the manifold existing assumptions regarding the relation between the three domains of action cognition, perception, control and concepts of action. Current theories and related experimental reports sometimes appear to use the same terms to explain different phenomena or mechanisms, and different terms to explain the same phenomena or similar mechanisms. For example, the term ‘simulation’ has been used to
Action cognition theories and implied constitution relation
In the first part of the present paper, we organized the established action cognition theories into three major families, Common Coding (CC), Internal Models (IM) and Simulation Theories (ST). We will now analyze them in more detail with respect to whether they can be considered genuine grounding theories; that is, they will be compared according to the implied constitution relation between motor control and action cognition. The aim shall be to put the variety of existing accounts of action
Conclusions
Following the modular picture of the mind, cognition and action has commonly been assumed to operate in strictly different domains: cognition draws on abstract conceptual representations, whereas motor control functions are thought to rely on relatively low-level and automatic processes. In recent years, however, cognitive neuroscience has been confronted with an increasingly large array of partly overlapping, partly contradicting theories that diverge broadly with respect to the degree to
Acknowledgments
This project was supported by a grant of the Volkswagen Stiftung to all of the authors (“Grounding thoughts in actions, ThinkAct’’; Az. II/85 068/85 158/85 159) and a Heisenberg fellowship (SCHU 2471/4-1) of German Research Foundation/Deutsche Forschungsgemeinschaft (DFG) to SS-B.
References (64)
- et al.
Grounding conceptual knowledge in modality-specific systems
Trends in Cognitive Sciences
(2003) A dynamical systems perspective on agent-environment interaction
Artificial Intelligence
(1995)- et al.
The timing of mentally represented actions
Behavioural Brain Research
(1989) - et al.
Where’s the action? The pragmatic turn in cognitive science
Trends in Cognitive Sciences
(2013) - et al.
Mirror neurons and the simulation theory of mind-reading
Trends in Cognitive Sciences
(1998) Neural simulation of action: A unifying mechanism for motor cognition
Neuroimage
(2001)- et al.
Mental motor imagery: A window into the representational stages of action
Current Opinion in Neurobiology
(1995) Internal models for motor control and trajectory planning
Current Opinion in Neurobiology
(1999)Representation in dynamical and embodied cognition
Cognitive Systems Research
(2002)- et al.
Microsaccades counteract visual fading during fixation
Neuron
(2006)
Premotor cortex and the recognition of motor actions
Brain Research. Cognitive Brain Research
Perceptual symbol systems
Behavioral and Brain Sciences
Grounded cognition
Annual Review of Psychology
Corollary discharge inhibition and preservation of temporal information in a sensory nucleus of mormyrid electric fish
Journal of Neuroscience
Spatio-temporal prediction modulates the perception of self-produced stimuli
Journal of Cognitive Neuroscience
Premotor or ideomotor: How does the experience of action come about?
Symbols and embodiment: Debates on meaning and cognition
Movement intention after parietal cortex stimulation in humans
Science
Vision with a stabilized retinal image
Nature
Effect anticipation and action control
Journal of Experimental Psychology: Human Perception and Performance
The language of thought
A theory of cortical responses
Philosophical Transactions of the Royal Society of London, Series B: Biological sciences
Action and behavior: A free-energy formulation
Biological Cybernetics
Action understanding and active inference
Biological Cybernetics
The manifold nature of interpersonal relations: The quest for a common mechanism
Philosophical Transactions of the Royal Society of London, Series B: Biological sciences
Action recognition in the premotor cortex
Brain
Principles of perceptual learning and development
Grounding language in action
Psychonomic Bulletin & Review
In defense of the simulation theory
Mind & Language
Folk psychology as simulation
Mind & Language
Sensory feedback mechanisms in performance control: With special reference to the ideo-motor mechanism
Psychological Review
Impaired action knowledge in amyotrophic lateral sclerosis
Neurology
Cited by (64)
Advancing judgment and decision-making research in sport psychology by using the body as an informant in embodied choices
2023, Asian Journal of Sport and Exercise PsychologyMental imagery skill predicts adults’ reading performance
2022, Learning and InstructionMental rotation performance in young adults with and without developmental coordination disorder
2021, Human Movement ScienceThe effect of perceptual-motor continuity compatibility on the temporal control of continuous and discontinuous self-paced rhythmic movements
2021, Human Movement ScienceCitation Excerpt :There is a vast body of research describing the neuronal dynamics and the cognitive mechanisms supporting the action-perception linkage by means of a shared representation (Gentsch, Weber, Synofzik, Vosgerau, & Schütz-Bosbach, 2016; Iacoboni, Woods, & Mazziotta, 1998; Prinz, 1997; Rizzolatti & Craighero, 2004; Schütz-Bosbach & Prinz, 2007; Wolpert, Ghahramani, & Jordan, 1995). According to common coding theories (Greenwald, 1970; Hommel, Müsseler, Aschersleben, & Prinz, 2001; reviewed in Gentsch et al., 2016), the preparation of goal-directed actions automatically activates the representation of their specific sensory effects due to a common or bidirectional representation, with abundant empirical evidence from classical studies on stimulus-response compatibility effects showing a benefit (in terms of speed and accuracy) when the spatial location of the stimulus matches the spatial location of the motor response (for review, see Hughes, Desantis, & Waszak, 2013; Shin, Proctor, & Capaldi, 2010; Waszak, Cardoso-Leite, & Hughes, 2012). One of the questions yet to be fully understood is to what extent the properties of the sensory and the movement information interact to facilitate sensorimotor integration.
Impaired Corollary Discharge in Psychosis and At-Risk States: Integrating Neurodevelopmental, Phenomenological, and Clinical Perspectives
2019, Biological Psychiatry: Cognitive Neuroscience and NeuroimagingOn the perception of movement vigour
2023, Quarterly Journal of Experimental Psychology