To some it is a shallow platitude that inner speech always has an auditory-phonological component. To others, it is an empirical hypothesis with accumulating support. To yet others it is a false dogma. In this chapter, I defend the claim that inner speech always has an auditory-phonological component, confining the claim to adults with ordinary speech and hearing. It is one thing, I emphasize, to assert that inner speech often, or even typically, has an auditory-phonological component—quite another to propose that (...) it always does. When forced to argue for the stronger point, we stand to make a number of interesting discoveries about inner speech itself, and about our means for discriminating it from other psycholinguistic phenomena. Establishing the stronger conclusion also provides new leverage on debates concerning how we should conceive of, diagnose, and explain auditory verbal hallucinations and “inserted thoughts” in schizophrenia. (shrink)

Autism has been defined as a disorder of social cognition, interaction and communication where ritualistic, repetitive behaviors are commonly observed. But how should we understand the behavioral and cognitive differences that have been the main focus of so much autism research? Can high-level cognitive processes and behaviors be identified as the core issues people with autism face, or do these characteristics perhaps often rather reflect individual attempts to cope with underlying physiological issues? Much research presented in this volume will point (...) to the latter possibility, i.e. that people on the autism spectrum cope with issues at much lower physiological levels pertaining not only to Central Nervous Systems (CNS) function, but also to peripheral and autonomic systems (PNS, ANS) (Torres, Brincker, et al. 2013). The question that we pursue in this chapter is what might be fruitful ways of gaining objective measures of the large-scale systemic and heterogeneous effects of early atypical neurodevelopment; how to track their evolution over time and how to identify critical changes along the continuum of human development and aging. We suggest that the study of movement variability—very broadly conceived as including all minute fluctuations in bodily rhythms and their rates of change over time (coined micro-movements (Figure 1A-B) (Torres, Brincker, et al. 2013))—offers a uniquely valuable and entirely objectively quantifiable lens to better assess, understand and track not only autism but cognitive development and degeneration in general. This chapter presents the rationale firstly behind this focus on micro-movements and secondly behind the choice of specific kinds of data collection and statistical metrics as tools of analysis (Figure 1C). In brief the proposal is that the micro-movements (defined in Part I – Chapter 1), obtained using various time scales applied to different physiological data-types (Figure 1), contain information about layered influences and temporal adaptations, transformations and integrations across anatomically semi-independent subsystems that crosstalk and interact. Further, the notion of sensorimotor re-afference is used to highlight the fact that these layered micro-motions are sensed and that this sensory feedback plays a crucial role in the generation and control of movements in the first place. In other words, the measurements of various motoric and rhythmic variations provide an access point not only to the “motor systems”, but also access to much broader central and peripheral sensorimotor and regulatory systems. Lastly, we posit that this new lens can also be used to capture influences from systems of multiple entry points or collaborative control and regulation, such as those that emerge during dyadic social interactions. (shrink)

Accurate perception of moving objects would be useful; accurate visually guided action is crucial. Visual motion across the scene influences perceived object location and the trajectory of reaching movements to objects. In this commentary, I propose that the visual system assigns the position of any object based on the predominant motion present in the scene, and that this is used to guide reaching movements to compensate for delays in visuomotor processing.

In this paper we discuss an approach called grounded action cognition, which aims to provide a theory of the interdependencies between motor control and action-related cognitive processes, like perceiving an action or thinking about an action. The theory contrasts with traditional views in cognitive science in that it motivates an understanding of cognition as embodied, through application of Barsalou’s general idea of grounded cognition. To guide further research towards an appropriate theory of grounded action cognition we distinguish between grounding qua (...) acquisition and grounding qua constitution. On this basis, we distinguish three possible theoretical conceptions of grounded action cognition. In addition to these methodological and conceptual analyses, we draw on recent empirical evidence to motivate our inclination towards a particular theory. According to this theory certain representations are involved in action cognition and action perception that are not modality-specific as usually proposed by advocates of grounded cognition. Further, the evidence is in favor of our more specific theory stating that for some cognitive abilities, some motor abilites are constitutive. (shrink)

The historical debate on representation in cognitive science and neuroscience construes representations as theoretical posits and discusses the degree to which we have reason to posit them. We reject the premise of that debate. We argue that experimental neuroscientists routinely observe and manipulate neural representations in their laboratory. Therefore, neural representations are as real as neurons, action potentials, or any other well-established entities in our ontology.

The overall goal of this target article is to demonstrate a mechanism for an embodied cognition. The particular vehicle is a much-studied, but still widely debated phenomenon seen in 7–12 month-old-infants. In Piaget's classic “A-not-B error,” infants who have successfully uncovered a toy at location “A” continue to reach to that location even after they watch the toy hidden in a nearby location “B.” Here, we question the traditional explanations of the error as an indicator of infants' concepts of objects (...) or other static mental structures. Instead, we demonstrate that the A-not-B error and its previously puzzling contextual variations can be understood by the coupled dynamics of the ordinary processes of goal-directed actions: looking, planning, reaching, and remembering. We offer a formal dynamic theory and model based on cognitive embodiment that both simulates the known A-not-B effects and offers novel predictions that match new experimental results. The demonstration supports an embodied view by casting the mental events involved in perception, planning, deciding, and remembering in the same analogic dynamic language as that used to describe bodily movement, so that they may be continuously meshed. We maintain that this mesh is a pre-eminently cognitive act of “knowing” not only in infancy but also in everyday activities throughout the life span. Key Words: cognitive development; dynamical systems theory; embodied cognition; infant development; motor control; motor planning; perception and action. (shrink)

Cybernetics promoted machine-supported investigations of adaptive sensorimotor behaviours observed in biological systems. This methodological approach receives renewed attention in contemporary robotics, cognitive ethology, and the cognitive neurosciences. Its distinctive features concern machine experiments, and their role in testing behavioural models and explanations flowing from them. Cybernetic explanations of behavioural events, regularities, and capacities rely on multiply realizable mechanism schemata, and strike a sensible balance between causal and unifying constraints. The multiple realizability of cybernetic mechanism schemata paves the way to principled (...) comparisons between biological systems and machines. Various methodological issues involved in the transition from mechanism schemata to their machine instantiations are addressed here, by reference to a simple sensorimotor coordination task. These concern the proper treatment of ceteris paribus clauses in experimental settings, the significance of running experiments with correct but incomplete machine instantiations of mechanism schemata, and the advantage of operating with real machines ??? as opposed to simulated ones ??? immersed in real environments. (shrink)

There is an increasing amount of empirical work investigating the sense of agency, i.e. the registration that we are the initiators of our own actions. Many studies try to relate the sense of agency to an internal feed-forward mechanism, called the ‘‘comparator model’’. In this paper, we draw a sharp distinction between a non-conceptual level of feeling of agency and a conceptual level of judgement of agency. By analyzing recent empirical studies, we show that the comparator model is not able (...) to explain either. Rather, we argue for a two-step account: a multifactorial weighting process of different agency indicators accounts for the feeling of agency, which is, in a second step, further processed by conceptual modules to form an attribution judgement. This new framework is then applied to disruptions of agency in schizophrenia, for which the comparator model also fails. Two further extensions are discussed: We show that the comparator model can neither be extended to account for the sense of ownership (which also has to be differentiated into a feeling and a judgement of ownership) nor for the sense of agency for thoughts. Our framework, however, is able to provide a unified account for the sense of agency for both actions and thoughts. (shrink)

This paper explores a novel form of Mental Fictionalism: Fictionalism about talk of neural representations in cognitive science. This type of Fictionalism promises to (i) avoid the hard problem of naturalising representations, without (ii) incurring the high costs of eliminating useful representation talk. In this paper, I motivate and articulate this form of Fictionalism, and show that, despite its apparent advantages, it faces two serious objections. These objections are: (1) Fictionalism about talk of neural representations ultimately does not avoid the (...) problem of naturalising representations; (2) Fictional representations cannot play the explanatory role required by cognitive science. (shrink)

The characteristic temporal relationship between actions and their sensory outcomes allows us to distinguish self- from externally generated sensory events. However, the complex sensory environment can cause transient delays between action and outcome calling for flexible recalibration of predicted sensorimotor timing. Since the neural underpinnings of this process are largely unknown this study investigated the involvement of the cerebellum by means of cerebellar transcranial direct current stimulation. While receiving anodal, cathodal, dual-hemisphere or sham ctDCS, in an adaptation phase, participants were (...) exposed to constant delays of 150 ms between actively or passively generated button presses and visual sensory outcomes. Recalibration in the same and in another sensory modality was assessed in a subsequent test phase during which variable delays between button press and visual or auditory outcome had to be detected. Results indicated that temporal recalibration occurred in audition after anodal ctDCS while it was absent in vision. As the adaptation modality was visual, effects in audition suggest that recalibration occurred on a supra-modal level. In active conditions, anodal ctDCS improved sensorimotor recalibration at the delay level closest to the adaptation delay, suggesting a precise cerebellar-dependent temporal recalibration mechanism. In passive conditions, the facilitation of inter-sensory recalibration by anodal ctDCS was overall stronger and tuned to larger delays. These findings point to a role of the cerebellum in supra-modal temporal recalibration across sensorimotor and perceptual domains, but the differential manifestation of the effect across delay levels in active and passive conditions points to differences in the underlying mechanisms depending on the availability of action-based predictions. Furthermore, these results suggest that anodal ctDCS can be a promising tool for facilitating effects of temporal recalibration in sensorimotor and inter-sensory contexts. (shrink)

The present paper proposes a definition for the complex polysemic concepts of consciousness and awareness (in humans as well as in other species), and puts forward the idea of a progressive ontological development of consciousness from a state of ‘childhood’ awareness, in order to explain that humans are not only able to manipulate objects, but also their mental representations. The paper builds on the idea of qualia intended as entities posing regular invariant requests to neural processes, trough the permanence of (...) different properties. The concept of semantic differential introduces the properties of metaphorical qualia as an exclusively human ability. Furthermore this paper proposes a classification of qualia, according to the models–with different levels of abstraction–they are implied in, in a taxonomic perspective. This, in turn, becomes a source of categorization of divergent representations, sign systems, and forms of intentionality, relying always on biological criteria. New emerging image-of-the-world-devices are proposed, whose qualia are likely to be only accessible to humans: emotional qualia, where emotion accounts for the invariant and dominant property; and the qualic self where continuity, combined with the oneness of the self, accounts for the invariant and dominant property. The concept of congruence between different domains in a metaphor introduces the possibility of a general evaluation of truth and falsity of all kinds of metaphorical constructs, while the work of Matte Blanco enables us to classify conscious versus unconscious metaphors, both in individuals and in social organizations. (shrink)

The shared circuits model (SCM) relies on well-regarded theories of perception-action, mirror neurons, and forward models, but the functional/informational level of the model limits its ability to explain complex behavior such as true imitation. Data from our lab and others confirm the more general details of the model, accepted by most, but specify the neural mechanisms involved in perception-action processes.

We represent the world in a variety of ways: through percepts, concepts, propositional attitudes, words, numerals, recordings, musical scores, photographs, diagrams, mimetic paintings, etc. Some of these representations are mental. It is customary for philosophers to distinguish two main kinds of mental representations: perceptual representation (e.g., vision, auditory, tactile) and conceptual representation. This essay presupposes a version of this dichotomy and explores the way in which a further kind of representation – procedural representation – represents. It is argued that, in (...) some important respects, procedural representations represent differently from both purely conceptual representations and purely perceptual representations. Although procedural representations, just like conceptual and perceptual representations, involve modes of presentation, their modes of presentation are distinctively practical, in a sense which I will clarify. It is argued that an understanding of this sort of practical representation has important consequences for the debate on the nature of know-how. (shrink)

Car driving is supported by perceptual, cognitive, and motor skills trained through continuous daily practice. One of the skills that characterize experienced drivers is to detect changes in the driving environment and then flexibly switch their driving modes in response to the changes. Previous functional neuroimaging studies on motor control investigated the mechanisms underlying behaviors adaptive to changes in control properties or parameters of experimental devices such as a computer mouse or a joystick. The switching of multiple internal models mainly (...) engages adaptive behaviors and underlies the interplay between the cerebellum and frontoparietal network regions as the neural process. However, it remains unclear whether the neural mechanisms identified in previous motor control studies also underlie practical driving behaviors. In the current study, we measure functional magnetic resonance imaging activities while participants control a realistic driving simulator inside the MRI scanner. Here, the accelerator sensitivity of a virtual car is abruptly changed, requiring participants to respond to this change flexibly to maintain stable driving. We first compare brain activities before and after the sensitivity change. As a result, sensorimotor areas, including the left cerebellum, increase their activities after the sensitivity change. Moreover, after the change, activity significantly increases in the inferior parietal lobe and dorsolateral prefrontal cortex, parts of the FPN regions. By contrast, the posterior cingulate cortex, a part of the default mode network, deactivates after the sensitivity change. Our results suggest that the neural bases found in previous experimental studies can serve as the foundation of adaptive driving behaviors. At the same time, this study also highlights the unique contribution of non-motor regions to addressing the high cognitive demands of driving. (shrink)

A full account of purposive action must appeal not only to propositional attitude states like beliefs, desires, and intentions, but also to motor representations, i.e., non-propositional states that are thought to represent, among other things, action outcomes as well as detailed kinematic features of bodily movements. This raises the puzzle of how it is that these two distinct types of state successfully coordinate. We examine this so-called “Interface Problem”. First, we clarify and expand on the nature and role of motor (...) representations in explaining intentional action. Next, we characterize the respective functions of intentions and motor representations, the differences in representational format and content that these imply, and the interface challenge these differences in turn raise. We then evaluate Butterfill and Sinigaglia’s recent answer to this interface challenge, according to which intentions refer to action outcomes by way of demonstrative deference to motor representations. We present some worries for this proposal, arguing that, among other things, it implicitly presupposes a solution to the problem, and so cannot help to resolve it. Finally, we suggest that we may make some progress on this puzzle by positing a “content-preserving causal process” taking place between intentions and motor representations, and we offer a proposal for how this might work. (shrink)

Human adaptive behavior in sensorimotor control is aimed to increase the confidence in feedforward mechanisms when sensory afferents are uncertain. It is thought that these feedforward mechanisms rely on predictions from internal models. We investigate whether the brain uses an internal model of physical laws to help estimate body equilibrium when tactile inputs from the foot sole are depressed by carrying extra weight. As direct experimental evidence for such a model is limited, we used Judoka athletes thought to have built (...) up internal models of external loads as compared with Non-Athlete participants and Dancers. Using electroencephalography, we first tested the hypothesis that the influence of tactile inputs was amplified by descending cortical efferent signals. We compared the amplitude of P1N1 somatosensory cortical potential evoked by electrical stimulation of the foot sole in participants standing still with their eyes closed. We showed smaller P1N1 amplitudes in the Load compared to No Load conditions in both Non-Athletes and Dancers. This decrease neural response to tactile stimulation was associated with greater postural oscillations. By contrast in the Judoka’s group, the neural early response to tactile stimulation was unregulated in the Load condition. This suggests that the brain can selectively increase the functional gain of sensory inputs, during challenging equilibrium tasks when tactile inputs were mechanically depressed by wearing a weighted vest. In Judokas, the activation of regions such as the right posterior inferior parietal cortex as early as the P1N1 is likely the source of the neural responses being maintained similar in both Load and No Load conditions. An overweight internal model stored in the right PPC known to be involved in maintaining a coherent representation of one’s body in space can optimize predictive mechanisms in situations with high balance constraints. This hypothesis has been confirmed by showing that postural reaction evoked by a translation of the support surface on which participants were standing wearing extra-weight was improved in Judokas. (shrink)

This is a contribution to a book symposium on Joelle Proust’s The Philosophy of Metacognition: Mental Agency and Self-Awareness (OUP). While there is much to admire in Proust’s book, the legitimacy of her distinction between “procedural” and “analytic” metacognition can be questioned. Doing so may help us better understand the relevance of animal metacognition studies to human self-knowledge.

Many philosophers and psychologists have sought to explain experiences of auditory verbal hallucinations and “inserted thoughts” in schizophrenia in terms of a failure on the part of patients to appropriately monitor their own inner speech. These self-monitoring accounts have recently been challenged by some who argue that AVHs are better explained in terms of the spontaneous activation of auditory-verbal representations. This paper defends two kinds of self-monitoring approach against the spontaneous activation account. The defense requires first making some important clarifications (...) concerning what is at issue in the dispute between the two forms of theory. A popular but problematic self-monitoring theory is then contrasted with two more plausible conceptions of what the relevant self-monitoring deficits involve. The first appeals to deficits in the neural mechanisms that normally filter or attenuate sensory signals that are the result of one’s own actions. The second, less familiar, form of self-monitoring approach draws an important analogy between Wernicke’s aphasia and AVHs in schizophrenia. This style of self-monitoring theory pursues possible connections among AVHs, inserted thoughts, and the disorganized speech characteristic formal thought disorder. (shrink)

Abstract: How it is that one's own thoughts can seem to be someone else's? After noting some common missteps of other approaches to this puzzle, I develop a novel cognitive solution, drawing on and critiquing theories that understand inserted thoughts and auditory verbal hallucinations in schizophrenia as stemming from mismatches between predicted and actual sensory feedback. Considerable attention is paid to forging links between the first-person phenomenology of thought insertion and the posits (e.g. efference copy, corollary discharge) of current cognitive (...) theories. I show how deficits in the subconscious mechanisms regulating inner speech may lead to a 'fractured phenomenology' responsible for schizophrenic patients' reports of inserted thoughts and auditory verbal hallucinations. Supporting work on virtual environments is discussed, and lessons concerning the fixity of delusional belief are drawn. (shrink)

Evidence for motion extrapolation at motion offset is scarce. In contrast, there is abundant evidence that subjects mentally extrapolate the future trajectory of weak motion signals at motion offset. Further, pointing movements overshoot at motion offset. We believe that mental and sensorimotor extrapolation is sufficient to solve the problem of perceptual latencies. Both present the advantage of being much more flexible than motion extrapolation.

Imitation, deliberation, and mindreading are characteristically human sociocognitive skills. Research on imitation and its role in social cognition is flourishing across various disciplines; it is here surveyed under headings of behavior, subpersonal mechanisms, and functions of imitation. A model is then advanced within which many of the developments surveyed can be located and explained. The shared circuits model explains how imitation, deliberation, and mindreading can be enabled by subpersonal mechanisms of control, mirroring and simulation. It is cast at a middle, (...) functional level of description, between the level of neural implementation and the level of conscious perceptions and intentional actions. The shared circuits model connects shared informational dynamics for perception and action with shared informational dynamics for self and other, while also showing how the action/perception, self/other and actual/possible distinctions can be overlaid on these shared informational dynamics. It avoids the common conception of perception and action as separate and peripheral to central cognition. Rather, it contributes to the situated cognition movement by showing how mechanisms for perceiving action can be built on those for active perception. (shrink)

Schizophrenia is associated with a series of visual perception impairments, which might impact on the patients’ every day life and be related to clinical symptoms. However, the heterogeneity of the visual disorders make it a challenge to understand both the mechanisms and the consequences of these impairments, i.e., the way patients experience the outer world. Based on earlier psychiatry literature, we argue that issues regarding time might shed a new light on the disorders observed in patients with schizophrenia.We will briefly (...) review the mechanisms involved in the sense of time continuity and clinical evidence that they are impaired in patients with schizophrenia.We will then summarize a recent experimental approach regarding the coding of time-event structure in time, namely the ability to discriminate between simultaneous and asynchronous events. The use of an original method of analysis allowed us to distinguish between explicit and implicit judgments of synchrony.We showed that for SOAs below 20ms neither patients nor controls fuse events in time. On the contrary subjects distinguish events at an implicit level even when judging them as synchronous. In addition, the implicit responses of patients and controls differ qualitatively. It is as if controls always put more weight on the last occurred event, whereas patients have a difficulty to follow events in time at an implicit level. In patients, there is a clear dissociation between results at short and large asynchronies, that suggest selective mechanisms for the implicit coding of time-event structure. These results might explain the disruption of the sense of time continuity in patients.We argue that this line of research might also help us to better understand the mechanisms of the visual impairments in patients and how they see their environment. (shrink)

Disorders of consciousness and the self are at the forefront of schizophrenia symptomatology. Patients are impaired in feeling themselves as the authors of their thoughts and actions. In addition, their flow of consciousness is disrupted, and thought fragmentation has been suggested to be involved in the patients’ difficulties in feeling as being one unique, unchanging self across time. Both impairments are related to self disorders, and both have been investigated at the experimental level. Here we review evidence that both mechanisms (...) of motor control and the temporal structure of signal processing are impaired in schizophrenia patients. Based on this review, we propose that the sequencing of action and perception plays a key role in the patients’ impairments. Furthermore, the millisecond time scale of the disorders, as well as the impaired sequencing, highlights the cooperation between brain networks including the cerebellum, as proposed by Andreasen (1999). We examine this possibility in the light of recent knowledge on the anatomical and physiological properties of the cerebellum, its role in timing, and its involvement in known physiological impairments in patients with schizophrenia, e.g., resting states and brain dynamics. A disruption in communication between networks involving the cerebellum, related to known impairments in dopamine, glutamate and GABA transmission, may help to better explain why patients experience reduced attunement with the external world and possibly with themselves. (shrink)

According to sensorimotor theory perceiving is a bodily skill involving exercise of an implicit know-how of the systematic ways that sensations change as a result of potential movements, that is, of sensorimotor contingencies. The theory has been most successfully applied to vision and touch, while perceptual modalities that rely less on overt exploration of the environment have not received as much attention. In addition, most research has focused on philosophically grounding the theory and on psychologically elucidating sensorimotor laws, but the (...) theory’s ramifications for neuroscience still remain underexamined. Here we sketch the beginnings of a research program that could address these two outstanding challenges in terms of auditory perception. We review the neuroscience literature on passive listening, which is defined as listening without overt bodily movement, and conclude that sensorimotor theory provides a unique perspective on the consistent finding of motor system activation. In contrast to competing theories, this activation is predicted to be involved not only in the perception of speech- and action-related sounds, but in auditory perception in general. More specifically, we propose that the auditory processing associated with supplementary motor areas forms part of the neural basis of the exercise of sensorimotor know-how: these areas’ recognized role in facilitating spontaneous motor responses to sound and supporting flexible engagement of sensorimotor processes to guide auditory experience and enable auditory imagery, can be understood in terms of two key characteristics of sensorimotor interaction, its “alerting capacity” and “corporality”, respectively. We also highlight that there is more to the inside of the body than the brain: there is an opportunity to develop sensorimotor theory into new directions in terms of the still poorly understood active processes of the peripheral auditory system. (shrink)

When speaking or producing music, people rely in part on auditory feedback – the sounds associated with the performed action. Three experiments investigated the degree to which alterations of auditory feedback during music performances influence the experience of agency and the possible link between agency and the disruptive effect of AAF on production. Participants performed short novel melodies from memory on a keyboard. Auditory feedback during performances was manipulated with respect to its pitch contents and/or its synchrony with actions. Participants (...) rated their experience of agency after each trial. In all experiments, AAF reduced judgments of agency across conditions. Performance was most disrupted when AAF led to an ambiguous experience of agency, suggesting that there may be some causal relationship between agency and disruption. However, analyses revealed that these two effects were probably independent. A control experiment verified that performers can make veridical judgments of agency. (shrink)

The function of the brain is intricately woven into the fabric of time. Functions such as (i) storing and accessing past memories, (ii) dealing with immediate sensorimotor needs in the present, and (iii) projecting into the future for goal-directed behavior are good examples of how key brain processes are integrated into time. Moreover, it can even seem that the brain generates time (in the psychological sense, not in the physical sense) since, without the brain, a living organism cannot have the (...) notion of past nor future. When combined with an evolutionary perspective, this seemingly straightforward idea that the brain enables the conceptualization of past and future can lead to deeper insights into the principles of brain function, including that of consciousness. In this paper, we systematically investigate, through simulated evolution of artificial neural networks, conditions for the emergence of past and future in simple neural architectures, and discuss the implications of our findings for consciousness and mind uploading. (shrink)