When doing mental ontology, we must ask how to individuate distinct categories of mental states, and then, given that individuation, ask how states from distinct categories interact. One promising proposal for how to individuate cognitive from sensorimotor states is in terms of their representational form. On these views, cognitive representations are propositional in structure, while sensorimotor representations have an internal structure that maps to the perceptual and kinematic dimensions involved in an action context. This way of thinking has (...) resulted in worries about the interface between cognition and sensorimotor systems – that is, about how representations of these distinct types might interact in performing actions. I claim that current solutions to the interface problem fail, because they have not sufficiently abandoned intuitions inspired by faculty psychology. In particular, current proposals seek to show how cognitive states can enforce prior decisions on sensorimotor systems. I argue that such “determination” views are the wrong kind of views to adopt, given the form distinction. Instead, I offer a proposal on which propositional representations can at best bias us toward certain kinds of action. This kind of view, I argue, appealingly distributes the explanation of action across distinctive contributions from cognitive and sensorimotor processing. (shrink)

Many digital technologies, designed and controlled by intensive data-driven corporate platforms, have become ubiquitous for many of our daily activities. This has raised political and ethical concerns over how they might be threatening our personal autonomy. However, not much philosophical attention has been paid to the specific role that their hyper-designed (sensorimotor) interfaces play in this regard. In this paper, we aim to offer a novel framework that can ground personal autonomy on sensorimotor interaction and, from there, directly (...) address how technological design affects personal autonomy. To do this, we will draw from enactive sensorimotor approaches to cognition, focusing on the central notion of habits, understood as sensorimotor schemes that, in networked relations, give rise to sensorimotor agency. Starting from sensorimotor agency as a basis for more complex forms of personal autonomy, our approach gives us grounds to analyse our relationship with technology (in general) and to distinguish between autonomy-enhancing and autonomy-diminishing technologies. We argue that, by favouring/obstructing the enactment of certain (networks of) habits over others, technologies can directly act upon our personal autonomy, locally and globally. With this in mind, we then discuss how current digital technologies are often being designed to be autonomy-diminishing (as is the case of “dark patterns” in design), and sketch some ideas on how to build more autonomy-enhancing digital technologies. (shrink)

This paper presents a gamified motor imagery brain-computer interface (MI-BCI) training in immersive virtual reality. Aim of the proposed training method is to increase engagement, attention, and motivation in co-adaptive event-driven MI-BCI training. This was achieved using gamification, progressive increase of the training pace, and virtual reality design reinforcing the body ownership transfer (embodiment) into the avatar. From the 20 healthy participants performing 6 runs of 2-class MI-BCI training (left/right hand), 19 were trained for a basic level of MI-BCI (...) operation, with average peak accuracy in the session equal to 75.84\%. This confirms the proposed training method succeeded in improvement of the MI-BCI skills; moreover, participants were leaving the session in high positive affect. Although the performance was not directly correlated to the degree of embodiment, subjective magnitude of the body ownership transfer illusion correlated with the abilities to modulate the sensorimotor rhythm. (shrink)

Hand function improvement in stroke survivors in the chronic stage usually plateaus by 6 months. Brain-computer interface (BCI)-guided robot-assisted training has been shown to be effective for facilitating upper-limb motor function recovery in chronic stroke. However, the underlying neuroplasticity change is not well understood. This study aimed to investigate the whole-brain neuroplasticity changes after 20-session BCI-guided robot hand training, and whether the changes could be maintained at the 6-month follow-up. Therefore, the clinical improvement and the neurological changes before, immediately (...) after, and 6 months after training were explored in 14 chronic stroke subjects. The upper-limb motor function was assessed by Action Research Arm Test (ARAT) and Fugl-Meyer Assessment for Upper-Limb (FMA), and the neurological changes were assessed using resting-state functional magnetic resonance imaging. Repeated-measure ANOVAs indicated that long-term motor improvement was found by both FMA (F[2,26]= 6.367,p= 0.006) and ARAT (F[2,26]= 7.230,p= 0.003). Seed-based functional connectivity analysis exhibited that significantly modulated FC was observed between ipsilesional motor regions (primary motor cortex and supplementary motor area) and contralesional areas (supplementary motor area, premotor cortex, and superior parietal lobule), and the effects were sustained after 6 months. The fALFF analysis showed that local neuronal activities significantly increased in central, frontal and parietal regions, and the effects were also sustained after 6 months. Consistent results in FC and fALFF analyses demonstrated the increase of neural activities in sensorimotor and fronto-parietal regions, which were highly involved in the BCI-guided training.Clinical Trial Registration:This study has been registered atClinicalTrials.govwith clinical trial registration number NCT02323061. (shrink)

Abstract“Sign stimuli” elicit specific patterns of behavior when an organism's motivation is appropriate. In the toad, visually released prey-catching involves orienting toward the prey, approaching, fixating, and snapping. For these action patterns to be selected and released, the prey must be recognized and localized in space. Toads discriminate prey from nonprey by certain spatiotemporal stimulus features. The stimulus-response relations are mediated by innate releasing mechanisms (RMs) with recognition properties partly modifiable by experience. Striato-pretecto-tectal connectivity determines the RM's recognition and localization (...) properties, whereas medialpallio-thalamo-tectal circuitry makes the system sensitive to changes in internal state and to prior history of exposure to stimuli. RMs encode the diverse stimulus conditions referring to the same prey object through different combinations of “specialized” tectal neurons, involving cells selectively tuned to prey features. The prey-selective neurons express the outcome of information processing in functional units consisting of interconnected cells. Excitatory and inhibitory interactions among feature-sensitive tectal and pretectal neurons specify the perceptual operations involved in distinguishing the prey from its background, selecting its features, and discriminating it from predators. Other connections indicate stimulus location. The results of these analyses are transmitted by specialized neurons projecting from the tectum to bulbar/spinal motor systems, providing a sensorimotor interface. Specific combinations of such projective neurons – mediating feature- and space-related messages – form “command releasing systems” that activate corresponding motor pattern generators for appropriate prey-catching action patterns. (shrink)

Traditional approaches to human information processing tend to deal with perception and action planning in isolation, so that an adequate account of the perception-action interface is still missing. On the perceptual side, the dominant cognitive view largely underestimates, and thus fails to account for, the impact of action-related processes on both the processing of perceptual information and on perceptual learning. On the action side, most approaches conceive of action planning as a mere continuation of stimulus processing, thus failing to (...) account for the goal-directedness of even the simplest reaction in an experimental task. We propose a new framework for a more adequate theoretical treatment of perception and action planning, in which perceptual contents and action plans are coded in a common representational medium by feature codes with distal reference. Perceived events (perceptions) and to-be-produced events (actions) are equally represented by integrated, task-tuned networks of feature codes – cognitive structures we call event codes. We give an overview of evidence from a wide variety of empirical domains, such as spatial stimulus-response compatibility, sensorimotor synchronization, and ideomotor action, showing that our main assumptions are well supported by the data. Key Words: action planning; binding; common coding; event coding; feature integration; perception; perception-action interface. (shrink)

How do questions concerning consciousness and phenomenal experience relate to, or interface with, questions concerning plans, knowledge and intentions? At least in the case of visual experience the relation, we shall argue, is tight. Visual perceptual experience, we shall argue, is fixed by an agent’s direct unmediated knowledge concerning her poise (or apparent poise) over a currently enabled action space. An action space, in this specific sense, is to be understood not as a fine-grained matrix of possibilities for bodily (...) movement, but as a matrix of possibilities for pursuing and accomplishing one’s intentional actions, goals and projects. If this is correct, the links between planning, intention and perceptual experience are tight, while (contrary to some recent accounts invoking the notion of ‘sensorimotor expectations’) the links between embodied activity and perceptual experience, though real, are indirect. What matters is not bodily activity itself, but our practical knowledge (which need not be verbalized or in any way explicit) of our own possibilities for action. Such knowledge, selected, shaped and filtered by the grid of plans, goals, and intentions, plays, we argue, a constitutive role in explaining the content and character of visual perceptual experience. (shrink)

Over recent years, brain-computer interface (BCI) has emerged as an alternative communication system between the human brain and an output device. Deciphered intents, after detecting electrical signals from the human scalp, are translated into control commands used to operate external devices, computer displays and virtual objects in the real-time. BCI provides an augmentative communication by creating a muscle-free channel between the brain and the output devices, primarily for subjects having neuromotor disorders, or trauma to nervous system, notably spinal cord (...) injuries (SCI), and subjects with unaffected sensorimotor functions but disarticulated or amputated residual limbs. This review identifies the potentials of electroencephalography (EEG) based BCI applications for locomotion and mobility rehabilitation. Patients could benefit from its advancements such as wearable lower-limb (LL) exoskeletons, orthosis, prosthesis, wheelchairs, and assistive-robot devices. The EEG communication signals employed by the aforementioned applications that also provide feasibility for future development in the field are sensorimotor rhythms (SMR), event-related potentials (ERP) and visual evoked potentials (VEP). The review is an effort to progress the development of user’s mental task related to LL for BCI reliability and confidence measures. As a novel contribution, the reviewed BCI control paradigms for wearable LL and assistive-robots are presented by a general control framework fitting in hierarchical layers. It reflects informatic interactions, between the user, the BCI operator, the shared controller, the robotic device and the environment. Each sub layer of the BCI operator is discussed in detail, highlighting the feature extraction, classification and execution methods employed by the various systems. All applications’ key features and their interaction with the environment are reviewed for the EEG-based activity mode recognition, and presented in form of a table. It is suggested to structure EEG-BCI controlled LL assistive devices within the presented framework, for future generation of intent-basedmultifunctional controllers. Despite the development of controllers, for BCI-based wearable or assistive devices that can seamlessly integrate user intent, practical challenges associated with such systems exist and have been discerned, which can be constructive for future developments in the field. (shrink)

An increasing number of research teams are investigating the efficacy of brain-computer interface (BCI)-mediated interventions for promoting motor recovery following stroke. A growing body of evidence suggests that of the various BCI designs, most effective are those that deliver functional electrical stimulation (FES) of upper extremity (UE) muscles contingent on movement intent. More specifically, BCI-FES interventions utilize algorithms that isolate motor signals—user-generated intent-to-move neural activity recorded from cerebral cortical motor areas—to drive electrical stimulation of individual muscles or muscle synergies. (...) BCI-FES interventions aim to recover sensorimotor function of an impaired extremity by facilitating and/or inducing long-term motor learning-related neuroplastic changes in appropriate control circuitry. We developed a non-invasive, electroencephalogram (EEG)-based BCI-FES system that delivers closed-loop neural activity-triggered electrical stimulation of targeted distal muscles while providing the user with multimodal sensory feedback. This BCI-FES system consists of three components: (1) EEG acquisition and signal processing to extract real-time volitional and task-dependent neural command signals from cerebral cortical motor areas, (2) FES of muscles of the impaired hand contingent on the motor cortical neural command signals, and (3) multimodal sensory feedback associated with performance of the behavioral task, including visual information, linked activation of somatosensory afferents through intact sensorimotor circuits, and electro-tactile stimulation of the tongue. In this report, we describe device parameters and intervention protocols of our BCI-FES system which, combined with standard physical rehabilitation approaches, has proven efficacious in treating UE motor impairment in stroke survivors, regardless of level of impairment and chronicity. (shrink)

Ten years ago, one of us proposed a dynamic hierarchical model of intentions that brought together philosophical work on intentions and empirical work on motor representations and motor control (Pacherie, 2008). The model distinguished among Distal intentions, Proximal intentions, and Motor intentions operating at different levels of action control (hence the name DPM model). This model specified the representational and functional profiles of each type of intention, as well their local and global dynamics, and the ways in which they interact. (...) A core insight of the model was that action control is the result of integrated, coordinated activity across these levels of intention. Since the proposal of the model, empirical and theoretical works in philosophy and cognitive science have emerged that would seem to support and expand on this central insight. In particular, an updated understanding of the nature of sensorimotor processing and motor representations, as well as of how the different levels of intention and control interface and interact, allows for the further specification and precisification of the original DPM model. (shrink)

The peripersonal space is an adaptive and flexible interface between the body and the environment that fulfills a dual-motor function: preparing the body for voluntary object-oriented actions to interact with incentive stimuli and preparing the body for defensive responses when facing potentially harmful stimuli. In this position article, we provide arguments for the sensorimotor rooting of the peripersonal space representation and highlight the variables that contribute to its flexible and adaptive characteristics. We also demonstrate that peripersonal space represents (...) a mediation zone between the body and the environment contributing to not only the control of goal-directed actions but also the organization of social life. The whole of the data presented and discussed led us to the proposal of a new theoretical framework linking the peripersonal action space and the interpersonal social space and we highlight how this theoretical framework can account for social behaviors in populations with socio-emotional deficits. (shrink)

My topic is the intelligent guidance of action. In this paper I offer an empirically grounded case for four ideas: that [a] cognitive processes of practical reasoning play a key role in the intelligent guidance of action, [b] these processes could not do so without significant enabling work done by both perception and the motor system, [c] the work done by perceptual and motor systems can be characterized as the generation of information specialized for action guidance, which in turn suggests (...) that [d] the cognitive processes of practical reasoning that play a key role in the guidance of intelligent action are not the abstract, syllogistic ones philosophers often treat as the paradigm of practical reasoning. Rather, these cognitive processes are constrained by, and work well with, the specialized concepts outputted by perception and the feedback outputted by sensorimotor processes. (shrink)

There is an overlooked similarity between three classic accounts of the conditions of object experience from three distinct disciplines. Sociology: the “inversion” that accompanies discovery in the natural sciences, as local causes of effects are reattributed to an observed object. Psychology: the “externalization” that accompanies mastery of a visual–tactile sensory substitution interface, as tactile sensations of the proximal interface are transformed into vision-like experience of a distal object. Biology: the “projection” that brings forth an animal’s Umwelt, as impressions (...) on its body’s sensory surfaces are reconfigured into perception of an external object. This similarity between the effects of scientific practice and interface-use on the one hand, and of sensorimotor interaction on the other, becomes intelligible once we accept that skillful engagement with instruments and interfaces constitutes a socio-material augmentation of our basic perceptual capacity. This enactive interpretation stands in contrast to anti-realism about science associated with constructivist interpretations of these three phenomena, which are motivated by viewing them as the internal mental construction of the experienced object. Instead, it favors a participatory realism: the sensorimotor basis of perceptual experience loops not only through our body, but also through the external world. This allows us to conceive of object experience in relational terms, i.e., as one or more subjects directly engaging with the world. Consequently, we can appreciate scientific observation in its full complexity: it is a socio-materially augmented process of becoming acquainted with the observed object that—like tool-use and perceiving more generally—is irreducibly self, other-, and world-involving. (shrink)

In this paper, I make a case for the modularity of the motor system. I start where many do in discussions of modularity, by considering the extent to which the motor system is cognitively penetrable, i.e., the extent to which its processing and outputs are causally influenced, in a semantically coherent way, by states of central cognition. I present some empirical findings from a range of sensorimotor adaptation studies that strongly suggest that there are limits to such influence under (...) certain conditions. These results cry out for an explanation. In the remainder of the paper, I provide one: The motor system is cognitively penetrable, but nonetheless modular along broadly Fodorian lines, insofar as it is informationally encapsulated. This means that its access is limited to its own proprietary database in computing its function from input to output, which does not include the information stored in central cognition. I then offer a model of action control, from distal intention to action outcomes, that further helps to illustrate this picture and can accommodate the target empirical findings. (shrink)

Traditional rehabilitation strategies become difficult in the chronic phase stage of stroke prognosis. Brain–computer interface combined with external devices may improve motor function in chronic stroke patients, but it lacks comprehensive assessments of neurological changes regarding functional rehabilitation. This study aimed to comprehensively and quantitatively investigate the changes in brain activity induced by BCI–FES training in patients with chronic stroke. We analyzed the EEG of two groups of patients with chronic stroke, one group received functional electrical stimulation rehabilitation training (...) and the other group received BCI combined with FES training. We constructed functional networks in both groups of patients based on direct directed transfer function and assessed the changes in brain activity using graph theory analysis. The results of this study can be summarized as follows: after rehabilitation training, the Fugl–Meyer assessment scale score was significantly improved in the BCI–FES group, and there was no significant difference in the FES group. Both the global and local graph theory measures of the brain network of patients with chronic stroke in the BCI–FES group were improved after rehabilitation training. The node strength in the contralesional hemisphere and central region of patients in the BCI–FES group was significantly higher than that in the FES group after the intervention, and a significant increase in the node strength of C4 in the contralesional sensorimotor cortex region could be observed in the BCI–FES group. These results suggest that BCI–FES rehabilitation training can induce clinically significant improvements in motor function of patients with chronic stroke. It can improve the functional integration and functional separation of brain networks and boost compensatory activity in the contralesional hemisphere to a certain extent. The findings of our study may provide new insights into understanding the plastic changes of brain activity in patients with chronic stroke induced by BCI–FES rehabilitation training. (shrink)

A broad sketch for a model of speech production is outlined which describes developmental aspects of its cognitive-linguistic and sensorimotor components. A description of the emergence of phonological knowledge is a central point in our model sketch. It will be shown that the phonological form level emerges during speech acquisition and becomes an important representation at the interface between cognitive-linguistic and sensorimotor processes. Motor planning as well as motor programming are defined as separate processes in our model (...) sketch and it will be shown that both processes revert to the phonological information. Two computational simulation experiments based on quantitative implementations are undertaken to show proof of principle of key ideas of the model sketch: the emergence of phonological information over developmental stages, the adaptation process for generating new motor programs, and the importance of various forms of phonological representation in that process. Based on the ideas developed within our sketch of a production model and its quantitative spell-out within the simulation models, motor planning can be defined here as the process of identifying a succession of executable chunks from a currently activated phoneme sequence and of coding them as raw gesture scores. Motor programming can be defined as the process of building up the complete set of motor commands by specifying all gestures in detail. This full specification of gesture scores is achieved in our model by adapting motor information from phonologically similar syllables or by assembling motor programs from sub-syllabic units. (shrink)

Sign-based semantics and embodied semantics are argued to be mutually beneficial to one another. However, while the body does shape our cognitive activities to a great extent, this does not entail that cognition can be reduced to sensorimotor simulation, i.e that the mind can be reduced to the body. Language itself bears testimony to this, as the mind is construed in ordinary discourse as having the incredible capacity of being free to travel beyond the limits of present time and (...) current spatial location. Nagel has argued famously that mind is a fundamental datum of nature that the materialist version of evolutionary biology is unable to account for, as consciousness has an essentially subjective character to it, a ‘what it is like for the conscious organism itself’ aspect, that cannot be reduced to the matter of which the organism is constituted. Two modern scientific developments refute the contention that the human mind can be explained as a purely material machine: quantum theory in physics and Gödel’s Incompleteness Theorem in mathematics. Just because the mind works through the body does not entail that the mind can be reduced to the body. (shrink)

The role of knowledge has long been seen as problematic in the sensorimotor approach to experience. I offer an amended version of the sensorimotor approach, which replaces knowledge with what I call 'sensorimotor empathy'. Sensorimotor empathy is implicit, sometimes unintentional, skilful perceptual and motor coordination with objects and other people. I argue that sensorimotor empathy is the foundation of social coordination, and the key to understanding our conscious experience. I also explain how sensorimotor empathy (...) can be operationalized and studied in the lab, in terms of interpersonal synergies. (shrink)

The sensorimotor theory of perceptual consciousness offers a form of enactivism in that it stresses patterns of interaction instead of any alleged internal representations of the environment. But how does it relate to forms of enactivism stressing the continuity between life and mind? We shall distinguish sensorimotor enactivism, which stresses perceptual capacities themselves, from autopoietic enactivism, which claims an essential connection between experience and autopoietic processes or associated background capacities. We show how autopoiesis, autonomous agency, and affective dimensions (...) of experience may fit into sensorimotor enactivism, and we identify differences between this interpretation and autopoietic enactivism. By taking artificial consciousness as a case in point, we further sharpen the distinction between sensorimotor enactivism and autopoietic enactivism. We argue that sensorimotor enactivism forms a strong default position for an enactive account of perceptual consciousness. (shrink)

This book analyzes the philosophical foundations of sensorimotor theory and discusses the most recent applications of sensorimotor theory to human computer interaction, child's play, virtual reality, robotics, and linguistics. -/- Why does a circle look curved and not angular? Why doesn't red sound like a bell? Why, as I interact with the world, is there something it is like to be me? These are simple questions to pose but more difficult to answer. An analytic philosopher might respond to (...) the first by merely observing, ``if we ponder the concept `circle' we find that it is the essence of a circle to be round''; but where does this definition come from? Was it set in stone by the gods, the divine arbiters of circle-ness (red-ness and conscious-ness)? It is a measure of the importance of Kevin O'Regan and Alva Noe's 2001 paper `A sensorimotor account of vision and visual consciousness' that it reveals deep scientific and philosophical insight on these foundational issues of perception. -/- Opening with a chapter from Kevin O'Regan, this collection of new essays continues by presenting fifteen additional essays on as many developments achieved in recent years in this field. It provides readers with a critical review of the sensorimotor theory and in so doing introduces them to a radically new approach in cognitive science. (shrink)

Context: Direct realism is a non-reductive, anti-representationalist theory of perception lying at the heart of mainstream analytic philosophy, where it is currently generating a lot of interest. For all that, it is widely held to be both controversial and anti-scientific. On the other hand, the sensorimotor theory of perception initially generated a lot of interest within enactive philosophy of cognitive science, but has arguably not yet delivered on its initial promise. Problem: I aim to show that the sensorimotor (...) theory and direct realism complement each other, and that the result is a philosophically radical, but fully scientifically realised, theory of perception. Method: The article uses philosophical analysis and discussion. It also draws on empirical evidence from the relevant cognitive sciences. Results: Direct realism can be augmented by sensorimotor theory to become a scientifically tractable alternative to the mainstream, representationalist research programme within cognitive science. Implications: The article aims to further clarify the philosophical importance of the sensorimotor approach to perception. It also aims to show that the apparently radical claim that we perceive objects themselves is amenable to normal scientific study. Constructivist content: Objects are analysed as a kind of collaboration between the world and the perceiver. On this account, we can never perceive outside the categories of our own understanding, but we do perceive genuinely outside our own heads. Thus, the approach here is not exactly constructivism, though it shares many goals and results with constructivism. (shrink)

Many current neurophysiological, psychophysical, and psychological approaches to vision rest on the idea that when we see, the brain produces an internal representation of the world. The activation of this internal representation is assumed to give rise to the experience of seeing. The problem with this kind of approach is that it leaves unexplained how the existence of such a detailed internal representation might produce visual consciousness. An alternative proposal is made here. We propose that seeing is a way of (...) acting. It is a particular way of exploring the environment. Activity in internal representations does not generate the experience of seeing. The out- side world serves as its own, external, representation. The experience of seeing occurs when the organism masters what we call the gov- erning laws of sensorimotor contingency. The advantage of this approach is that it provides a natural and principled way of accounting for visual consciousness, and for the differences in the perceived quality of sensory experience in the different sensory modalities. Sev- eral lines of empirical evidence are brought forward in support of the theory, in particular: evidence from experiments in sensorimotor adaptation, visual “filling in,” visual stability despite eye movements, change blindness, sensory substitution, and color perception. (shrink)

Sensorimotor psychology studies the mental processes that control goal-directed bodily motion. Recently, sensorimotor psychologists have provided empirically successful Bayesian models of motor control. These models describe how the motor system uses sensory input to select motor commands that promote goals set by high-level cognition. I highlight the impressive explanatory benefits offered by Bayesian models of motor control. I argue that our current best models assign explanatory centrality to a robust notion of mental representation. I deploy my analysis to (...) defend intentional realism, to rebut eliminativism and instrumentalism regarding mental representation, and to explore the relation between intentionality and normativity. (shrink)

Sensorimotor Theory is the claim that it is our practical know-how of the relations between our environments and us that gives our environmental interactions their experiential qualities. Yet why should such interactions involve or be accompanied by experience? This is the ‘absolute’ gap question. Some proponents of SMT answer this question by arguing that our interactions with an environment involve experience when we cognitively access those interactions. In this paper, I aim to persuade proponents of SMT to accept the (...) following three claims. First, that appeals to cognitive access fail to answer the absolute gap question. Second, that SMT can be read in a way that rejects the gap question. Third, that if proponents of SMT are prepared to read SMT in a way that rejects the absolute gap question, then they can also reject the claim that cognitive access is needed to explain experience. (shrink)

Proponents of enactivism should be interested in exploring what notion of action best captures the type of action-perception link that the view proposes, such that it covers all the aspects in which our doings constitute and are constituted by our perceiving. This article proposes and defends the thesis that the notion of sensorimotor dependencies is insufficient to account for the reality of human perception, and that the central enactive notion should be that of perceptual practices. Sensorimotor enactivism is (...) insufficient because it has no traction on socially dependent perceptions, which are essential to the role and significance of perception in our lives. Since the social dimension is a central desideratum in a theory of human perception, enactivism needs a notion that accounts for such an aspect. This article sketches the main features of the Wittgenstein-inspired notion of perceptual practices as the central notion to understand perception. Perception, I claim, is properly understood as woven into a type of social practices that includes food, dance, dress, music, etc. More specifically, perceptual practices are the enactment of culturally structured, normatively rich techniques of commerce of meaningful multi- and inter-modal perceptible material. I argue that perceptual practices explain three central features of socially dependent perception: attentional focus, aspects’ saliency, and modal-specific harmony-like relations. (shrink)

Sensorimotor theories understand perception to be a process of active, exploratory engagement with the environment, mediated by the possession and exercise of a certain body of knowledge concerning sensorimotor dependencies. This paper aims to characterise that exercise, and to show that it places constraints upon the content of sensorimotor knowledge itself. Sensorimotor mastery is exercised when it is put to use in the service of intentional action-planning and selection, and this rules out certain standard readings of (...) sensorimotor contingency knowledge. Rather than holding between movements and sensory inputs or appearances, sensorimotor contingencies concern the suite of ways in which an object can be revealed through exploration. Sensorimotor knowledge is thus directed through experience to the world itself. (shrink)

Efficient prospective motor control, evident in human activity from birth, reveals an adaptive intentionality of a primary, pre-reflective, and pre-conceptual nature that we identify here as sensorimotor intentionality. We identify a structural continuity between the emergence of this earliest form of prospective movement and the structure of mental states as intentional or content-directed in more advanced forms. We base our proposal on motor control studies, from foetal observations through infancy. These studies reveal movements are guided by anticipations of future (...) effects, even from before birth. This implies that these movements, even if they are simple and discrete, are the actions of an intentional agent. We develop this notion to present a theory of the developing organisation of a core feature of cognition as embodied agent action, from early single actions with proximal prospectivity to the complex serial ordering of actions into projects to reach distal goals. We claim the prospective structural continuity from early and simple actions to later complex projects of serially-ordered actions confirms the existence of an ontogenetically primary form of content–directedness that is a driver for learning and development. Its implications for understanding autism are discussed. (shrink)

The enactive approach offers a distinctive view of how mental life relates to bodily activity at three levels: bodily self-regulation, sensorimotor coupling, and intersubjective interaction. This paper concentrates on the second level of sensorimotor coupling. An account is given of how the subjectively lived body and the living body of the organism are related via dynamic sensorimotor activity, and it is shown how this account helps to bridge the explanatory gap between consciousness and the brain. Arguments by (...) O'Regan, Noë, and Myin that seek to account for the phenomenal character of perceptual consciousness in terms of ‘bodiliness’ and ‘grabbiness’ are considered. It is suggested that their account does not pay sufficient attention to two other key aspects of perceptual phenomenality: the autonomous nature of the experiencing self or agent, and the pre-reflective nature of bodily self-consciousness. (shrink)

Sensorimotor theory claims that what you do and what you know how to do constitutes your visual experience. Central to the theory is the claim that such experience depends on a special kind of knowledge or understanding. I assess this commitment to knowledge in the light of three objections to the theory: the empirical implausibility objection, the learning/post-learning objection and the causal-constitutive objection. I argue that although the theory can respond to the first two objections, its commitment to know-how (...) ultimately renders it vulnerable to the third and arguably most serious objection. I then suggest that sensorimotor theory has two options: concede the causal-constitutive objection or challenge it. I shall argue for the latter. I will claim that a radical sensorimotor theory offers the best means of responding to this objection. (shrink)

Mirror neuron research has come a long way since the early 1990s, and many theorists are now stressing the heterogeneity and complexity of the sensorimotor properties of fronto-parietal circuits. However, core aspects of the initial ‘ mirror mechanism ’ theory, i.e. the idea of a symmetric encapsulated mirroring function translating sensory action perceptions into motor formats, still appears to be shaping much of the debate. This article challenges the empirical plausibility of the sensorimotor segregation implicit in the original (...) mirror metaphor. It is proposed instead that the teleological organization found in the broader fronto-parietal circuits might be inherently sensorimotor. Thus the idea of an independent ‘purely perceptual’ goal understanding process is questioned. Further, it is hypothesized that the often asymmetric, heterogeneous and contextually modulated mirror and canonical neurons support a function of multisensory mapping and tracking of the perceiving agents affordance space. Such a shift in the interpretative framework offers a different theoretical handle on how sensorimotor processes might ground various aspects of intentional action choice and social cognition. Mirror neurons would under the proposed “social affordance model” be seen as dynamic parts of larger circuits, which support tracking of currently shared and competing action possibilities. These circuits support action selection processes—but also our understanding of the options and action potentials that we and perhaps others have in the affordance space. In terms of social cognition ‘ mirror ’ circuits might thus help us understand not only the intentional actions others are actually performing—but also what they could have done, did not do and might do shortly. (shrink)

Sensorimotor expectations concern how visual experience covaries with bodily movement. Sensorimotor theorists argue from such expectations to the conclusion that the phenomenology of vision is constitutively embodied: objects within the visual field are experienced as 3-D because sensorimotor expectations partially constitute our experience of such objects. Critics argue that there are two ways to block the above inference: to explain how we visually experience objects as 3-D, one may appeal to such non-bodily factors as expectations about movements (...) of objects, not the perceiver, or to the role of mental imagery in visual experience. But instead of using sensorimotor expectations to explain how objects are experienced within the visual field, we can instead use them to explain our experience of the visual field itself and, in particular, our experience of its limits; that is, our ever-present visual sense of there being more to see, beyond what’s currently within the visual field. Crucially, this inference from sensorimotor expectations to the constitutive embodiment of visual phenomenology is not threatened by the above two challenges. I thus present here a sensorimotor theory of the phenomenology of the visual field, that is, our experience of our visual fields as such. (shrink)

Anderson suggests that theories of sensorimotor grounding are too narrow to account for his findings of widespread supporting multiple different cognitive I call some of the methodological assumptions underlying this conclusion into question, and suggest that his examples reaffirm rather than undermine the special status of sensorimotor processes in cognitive evolution.

Joint attention is a social-cognitive phenomenon in which two or more agents direct their attention together towards the same object. Definitions range from this rather broad conception to more specific definitions which require that, in addition, attention be directed to the same aspect of that object and that agents need to be mutually aware of their jointly attending. Joint attention is an important coordination mechanism in joint action. The capacity for engaging in joint attention, in particular in the sense of (...) this narrower definition, is frequently taken to indicate the presence of theory of mind in the participating agents, and is also implicated in the development of theory of mind. However, the prominence of sensorimotor components in establishing and sustaining episodes of joint attention — e.g., eye and head movements, pointing and vocalizations — suggests that sensorimotor approaches to social interaction may be well-placed to account for important parts of joint attention without invoking theory-of-mind abilities, and may therefore provide a valuable alternative to approaches emphasizing theory of mind. In particular, sensorimotor accounts may explain aspects of joint attention through the dynamics and regularities in the sensorimotor processes that coordinate the activities of the agents. (shrink)

The environment impacts human health in profound ways, yet few theories define the form of the relationship between human physiology and the environment. It is conjectured that such complex systems cannot interact directly, but rather their interaction requires the formation of an intermediary “interface.” This position contrasts with current epidemiological constructs of causation, which implicitly assume that two complex systems transfer information directly while remaining separate entities. Further, it is contended that dynamic, process‐based interfaces incorporate components from all the (...) interacting systems but exhibit operational independence. This property has many consequences, the foremost being that characteristics of the interface cannot be fully resolved by only studying the systems involved in the interaction. The interface itself must be the subject of inquiry. Without refocusing the attention on biodynamic interfaces, how the environment impacts health cannot be discerned. Also see the video abstract here https://youtu.be/XeyjeZeyo4o. (shrink)

In The Interface Envelope, James Ash develops a series of concepts to understand how digital interfaces work to shape the spatial and temporal perception of players. Drawing upon examples from videogame design and work from post-phenomenology, speculative realism, new materialism and media theory, Ash argues that interfaces create envelopes, or localised foldings of space time, around which bodily and perceptual capacities are organised for the explicit production of economic profit. Modifying and developing Bernard Stiegler's account of psychopower and Warren (...) Neidich's account of neuropower, Ash argues the aim of interface designers and publishers is the production of envelope power. Envelope power refers to the ways that interfaces in games are designed to increase users perceptual and habitual capacities to sense difference. Examining a range of examples from specific videogames, Ash identities a series of logics that are key to producing envelope power and shows how these logics have intensified over the last thirty years. In turn, Ash suggests that the logics of interface envelopes in videogames are spreading to other types of interface. In doing so life becomes enveloped as the environments people inhabit becoming increasingly loaded with digital interfaces. Rather than simply negative, Ash develops a series of responses to the potential problematics of interface envelopes and envelope power and emphasizes their pharmacological nature. (shrink)

The sensorimotor theory is an influential account of perception and phenomenal qualities that builds, in an empirically supported way, on the basic claim that conscious experience is best construed as an attribute of the whole embodied agent's skill-driven interactions with the environment. This paper, in addition to situating the theory as a response to certain well-known problems of consciousness, develops a sensorimotor account of why we are perceptually conscious rather than not.

The EEG activity recorded from the human sensorimotor cortical area exhibits rhythmic activity covering a broad range of frequencies, including alpha, mu, beta, and gamma (40-Hz) rhythms. This commentary elaborates on connections between these sensorimotor rhythms and Nunez's neocortical dynamic theory.

According to the sensorimotor account, vision does not imply theconstruction of internally generated representations of the environment, butit isthe skillful exercise of the sensorimotor contingencies obeying sense-specific laws. In this short study, I focus on the notion of “sensorimotor law” and characterize the kind of explanation providedby the sensorimotor theory as a form of covering law model. I then question the nature of such sensorimotor laws and describe them as mechanisms. I show that a mechanistic (...) interpretation provides a better account of the sensorimotor invariances, which fosters us to rebalance the explanatory burden of sensorimotor action and information. Finally, I show that the question of the roleof representations within the sensorimotor theory should be reconsidered. (shrink)

The sensorimotor theory of cognition holds that human cognition, along with that of other animals, is determined by sensorimotor structures rather than by uniquely human linguistic structures. The theory has been offered to explain the use of bodily terminology in nonphysical contexts, and to recognize the role of experienced embodiment in cognition. This paper defends a version of the theory which specifies that reasoning makes use of mental models constructed by means of action-planning mechanisms. Evidence is offered from (...) cognitive psychology, the neurosciences, and work in primatology and evolutionary theory. Further scientific and philosophical advantages of the theory are discussed: the theory is more parsimonious than its rival, and it offers better accounts of intrinsic intentionality and consciousness. The paper concludes with observations concerning the role of language in thought. (shrink)

[Andy Clark] What is the relation between perceptual experience and the suite of sensorimotor skills that enable us to act in the very world we perceive? The relation, according to 'sensorimotor models' (O'Regan and Noë 2001, Noë 2004) is tight indeed. Perceptual experience, on these accounts, is enacted via skilled sensorimotor activity, and gains its content and character courtesy of our knowledge of the relations between (typically) movement and sensory stimulation. I shall argue that this formulation is (...) too extreme, and that it fails to accommodate the substantial firewalls, dis-integrations, and special-purpose streamings that form the massed strata of human cognition. In particular, such strong sensorimotor models threaten to obscure the computationally potent insensitivity of key information-processing events to the full subtleties of embodied cycles of sensing and moving. /// [Naomi Eilan] The strong sensorimotor account of perception gives self-induced movements two constitutive roles in explaining visual consciousness. The first says that self-induced movements are vehicles of visual awareness, and for this reason consciousness 'does not happen in the brain only'. The second says that the phenomenal nature of visual experiences is consists in the action-directing content of vision. In response I suggest, first, that the sense in which visual awareness is active should be explained by appeal to the role of attention in visual consciousness, rather than self-induced movements; and second, that the sense in which perceptual consciousness does not happen in the brain only should be explained by appeal to the relational nature of perceptual consciousness, appeal to which also shows why links with action cannot exhaust phenomenal content. (shrink)

Despite intensive debates regarding action imitation and sentence imitation, few studies have examined their relationship. In this paper, we argue that the mechanism of action imitation is necessary and in some cases sufficient to describe sentence imitation. We first develop a framework for action imitation in which key ideas of Hurley’s shared circuits model are integrated with Wolpert et al.’s motor selection mechanism and its extensions. We then explain how this action-based framework clarifies sentence imitation without a language-specific faculty. Finally, (...) we discuss the empirical support for and philosophical significance of this perspective. (shrink)

This paper proposes an Interface Transparency Thesis concerning how linguistic meanings are related to the cognitive systems that are used to evaluate sentences for truth/falsity: a declarative sentence S is semantically associated with a canonical procedure for determining whether S is true; while this procedure need not be used as a verification strategy, competent speakers are biased towards strategies that directly reflect canonical specifications of truth conditions. Evidence in favor of this hypothesis comes from a psycholinguistic experiment examining adult (...) judgments concerning ‘Most of the dots are blue’. This sentence is true if and only if the number of blue dots exceeds the number of nonblue dots. But this leaves unsettled, e.g., how the second cardinality is specified for purposes of understanding and/or verification: via the nonblue things, given a restriction to the dots, as in ‘|{x: Dot(x) & ~Blue(x)}|’; via the blue things, given the same restriction, and subtraction from the number of dots, as in ‘|{x: Dot(x)}| – |{x: Dot(x) & Blue(x)}|’; or in some other way. Psycholinguistic evidence and psychophysical modeling support the second hypothesis. (shrink)

How accurate is the picture of the human mind that has emerged from studies in neuroscience, psychology, and cognitive science? Anybody with an interest in how minds work - how we learn about the world and how we remember people and events - may feel dissatisfied with the answers contemporary science has to offer. Sensorimotor Life draws on current theoretical developments in the enactive approach to life and mind. It examines and expands the premises of the sciences of the (...) human mind, while developing an alternative picture closer to people's daily experiences. Enactive ideas are applied and extended, providing a theoretically rich, naturalistic account of meaning and agency. The book includes a dynamical systems description of different types of sensorimotor regularities or sensorimotor contingencies; a dynamical interpretation of Piaget's theory of equilibration to ground the concept of sensorimotor mastery; and a theory of agency as organized networks of sensorimotor schemes, as well as its implications for embodied subjectivity. Written for students and researchers of cognitive science, the authors offer a fuller view of the mind, a view better attuned to the experiences of people who live, work, love, struggle, and age, thrown into a world of meaningful relations they help create. Additionally, the book is of interest to neuroscientists, psychiatrists, and philosophers of science. (shrink)

While applauding the bulk of the account on offer, we question one apparent implication viz, that every difference in sensorimotor contingencies corresponds to a difference in conscious visual experience.