Rational accounts of language use such as the uniform information density hypothesis, which asserts that speakers distribute information uniformly across their utterances, and the rational speech act (RSA) model, which suggests that speakers optimize the formulation of their message by reasoning about what the comprehender would understand, have been hypothesized to account for a wide range of language use phenomena. We here specifically focus on the production of discourse connectives. While there is some prior work indicating that discourse connective production (...) may be governed by RSA, that work uses a strongly gamified experimental setting. In this study, we aim to explore whether speakers reason about the interpretation of their conversational partner also in more realistic settings. We thereby systematically vary the task setup to tease apart effects of task instructions and effects of the speaker explicitly seeing the interpretation alternatives for the listener. Our results show that the RSA-predicted effect of connective choice based on reasoning about the listener is only found in the original setting where explicit interpretation alternatives of the listener are available for the speaker. The effect disappears when the speaker has to reason about listener interpretations. We furthermore find that rational effects are amplified by the gamified task setting, indicating that meta-reasoning about the specific task may play an important role and potentially limit the generalizability of the found effects to more naturalistic every-day language use. (shrink)

Using the method of Descriptive Experience Sampling, some subjects report experiences of thinking that do not involve words or any other symbols [Hurlburt, R. T., and C. L. Heavey. 2006. Exploring Inner Experience. Amsterdam: John Benjamins; Hurlburt, R. T., and S. A. Akhter. 2008. “Unsymbolized Thinking.” Consciousness and Cognition 17 : 1364–1374]. Even though the possibility of this unsymbolized thinking has consequences for the debate on the phenomenological status of cognitive states, the phenomenon is still insufficiently examined. This paper analyzes (...) the main properties of unsymbolized thinking and advances an explanation of its origin. According to our analysis, unsymbolized thoughts appear as propositional states, that is, they are experienced as compositional conceptual phenomena, with semantic and syntactic features analogous to those of the contents of utterances. Based on this characterization, we hypothesize that UT is continuous with the activity of inner speech, in particular, it i... (shrink)

In this paper we address the question of what determines the content of our conscious episodes of thinking, considering recent claims that phenomenal character individuates thought contents. We present one prominent way for defenders of phenomenal intentionality to develop that view and then examine ‘sensory inner speech views’, which provide an alternative way of accounting for thought-content determinacy. We argue that such views fare well with inner speech thinking but have problems accounting for unsymbolized thinking. Within this dialectic, we present (...) an account of the nature of unsymbolized thinking that accords with and can be seen as a continuation of the activity of inner speech, while offering a way of explaining thought-content determinacy in terms of linguistic structures and representations. (shrink)

Autistic individuals are commonly said – and also consider themselves – to be excessively literalist, in the sense that they tend to prefer literal interpretations of words and utterances. This literalist bias seems to be fairly specific to autism and still lacks a convincing explanation. In this paper we explore a novel hypothesis that has the potential to account for the literalist bias in autism. We argue that literalism results from an atypical functioning of the predictive system: specifically, an atypical (...) balance between predictions and error signals in language processing may make individuals more uncertain about their own predictions. Such uncertainty is then often resolved by resorting to the safest interpretation, that is, the literal one. We start by reviewing existing explanations of other autistic traits that appeal to predictive processing. We then apply these insights to language, by showing that predictions play a key role in everyday comprehension and that a low level of confidence in one’s own predictions is likely to escalate comprehension difficulties. Finally, we take a deeper look at non-literal uses of language by discussing the case of metaphors, to illustrate how a predictive processing account offers a promising explanation of the literalist bias in autism. (shrink)

Here, we used event-related potentials to test the predictions of two prominent accounts of code-switching in bilinguals: The Matrix Language Framework (MLF; Myers-Scotton, 1993) and an application of the Minimalist Program (MP; Cantone & MacSwan, 2009). We focused on the relative order of the noun with respect to the adjective in mixed Welsh-English nominal constructions given the clear contrast between pre- and post-nominal adjective position between Welsh and English. MP would predict that the language of the adjective should determine felicitous (...) word order (i.e., English adjectives should appear pre-nominally and Welsh adjectives post-nominally). In contrast, MLF contends that it is the language of the finite verb inflection rather than that of a particular word that governs felicitous word order. To assess the predictions of the two models, we constructed sentences featuring a code-switch between the adjective and the noun, that complied with either English or Welsh word-order. Highly proficient Welsh-English bilinguals made semantic acceptability judgements upon reading the last word of sentences which could violate MP assumptions, MLF assumptions, both assumptions, or neither. Behaviourally, MP violations had no significant effect, whereas MLF violations induced an average drop of 11% in acceptability judgements. Neurophysiologically, MP violations elicited a significant Left Anterior Negativity (LAN) modulation, whereas MLF violations modulated both P600 and LAN mean amplitudes. In addition, there was a significant interaction between MP and MLF status in the P600 range: When MP was violated, MLF status did not matter, and when MP criteria were met, MLF violations resulted in a P600 modulation. This interaction possibly reflects a general preference for noun over adjective insertions, and may provide support for MLF over MP at a global sentence processing level. Model predictions also manifested differently in each of the matrix languages: When the matrix language was Welsh, MP and MLF violations elicited greater P600 mean amplitudes than MP and MLF adherences, however this pattern was not observed when the matrix language was English. We discuss methodological considerations relating to the neuroscientific study of code-switching, and the extent to which our results shed light on adjective-noun code-switching beyond findings from production and experimental-behavioural studies. (shrink)

In conversation, individuals work together to achieve communicative goals, complementing and aligning language and body with each other. An important emerging question is whether interlocutors entrain with one another equally across linguistic levels (e.g., lexical, syntactic, and semantic) and modalities (i.e., speech and gesture), or whether there are complementary patterns of behaviors, with some levels or modalities diverging and others converging in coordinated fashions. This study assesses how kinematic and linguistic entrainment interact with one another across levels of measurement, and (...) according to communicative context. We analyzed data from two matched corpora of dyadic interaction between—respectively—Danish and Norwegian native speakers engaged in affiliative conversations and task‐oriented conversations. We assessed linguistic entrainment at the lexical, syntactic, and semantic level, and kinetic alignment of the head and hands using video‐based motion tracking and dynamic time warping. We tested whether—across the two languages—linguistic alignment correlates with kinetic alignment, and whether these kinetic‐linguistic associations are modulated either by the type of conversation or by the language spoken. We found that kinetic entrainment was positively associated with low‐level linguistic (i.e., lexical) entrainment, while negatively associated with high‐level linguistic (i.e., semantic) entrainment, in a cross‐linguistically robust way. Our findings suggest that conversation makes use of a dynamic coordination of similarity and complementarity both between individuals as well as between different communicative modalities, and provides evidence for a multimodal, interpersonal synergy account of interaction. (shrink)

A key emergent property of group social dynamic is synchrony–the coordination of actions, emotions, or physiological processes between group members. Despite this fact and the inherent nested structure of groups, little research has assessed physiological synchronization between group members from a multi-level perspective, thus limiting a full understanding of the dynamics between members. To address this gap of knowledge we re-analyzed a large dataset comprising physiological and psychological data that were collected in two laboratory studies that involved two different social (...) group tasks. In both studies, following the group task, members reported their experience of group cohesion via questionnaires. We utilized a non-linear analysis method-multidimensional recurrence quantification analysis that allowed us to represent physiological synchronization in cardiological interbeat intervals between group members at the individual-level and at the group-level. We found that across studies and their conditions, the change in physiological synchrony from baseline to group interaction predicted a psychological sense of group cohesion. This result was evident both at the individual and the group levels and was not modified by the context of the interaction. The individual- and group-level effects were highly correlated. These results indicate that the relationship between synchrony and cohesion is a multilayered construct. We re-affirm the role of physiological synchrony for cohesion in groups. Future studies are needed to crystallize our understanding of the differences and similarities between synchrony at the individual-level and synchrony at the group level to illuminate under which conditions one of these levels has primacy, or how they interact. (shrink)

The Ouroboros Model proposes a brain inspired cognitive architecture including detailed suggestions for the main processing steps in an overall conceptualization of cognition as embodied and embedded computing. All memories are structured into schemata, which are firmly grounded in the body of an actor. A cyclic and iterative data-acquisition and -processing loop forms the backbone of all cognitive activity. Ever more sophisticated schemata are built up incrementally from the wide combination of neural activity, concurrent at the point in time when (...) the memory is established; i.e., distinct representations are accrued. Later on, an entire schema can be reinstated from diverse subsets of its constituent features. In order to decode or compile ever more elaborate constructions, extant building blocks are concatenated. They are serially linked via common or “connection-attributes” of different representations and symbols, and they are employed for serial perception, processing and action, in particular, also for language production. At various levels, commonalities between different schemata lead to a similar preferred use of their respective tokens and subsequently shared categorizations. Rules, for the concatenation of words, akin to the ones governing chemical reactions, can be abstracted. As special kinds of symbols, words and word-classes along with the whole grammar of a language can thus be seen as a direct consequence of the processes outlined in the Ouroboros Model. Strong emphasis is put on the dimension of time over short intervals during active experience and performance, and, in particular, during interactions with other agents. (shrink)

Natural languages make prolific use of conventional constituent‐ordering patterns to indicate “who did what to whom,” yet the mechanisms through which these regularities arise are not well understood. A series of recent experiments demonstrates that, when prompted to express meanings through silent gesture, people bypass native language conventions, revealing apparent biases underpinning word order usage, based on the semantic properties of the information to be conveyed. We extend the scope of these studies by focusing, experimentally and computationally, on the interpretation (...) of silent gesture. We show cross‐linguistic experimental evidence that people use variability in constituent order as a cue to obtain different interpretations. To illuminate the computational principles that govern interpretation of non‐conventional communication, we derive a Bayesian model of interpretation via biased inductive inference and estimate these biases from the experimental data. Our analyses suggest people's interpretations balance the ambiguity that is characteristic of emerging language systems, with ordering preferences that are skewed and asymmetric, but defeasible. (shrink)

Natural languages make prolific use of conventional constituent‐ordering patterns to indicate “who did what to whom,” yet the mechanisms through which these regularities arise are not well understood. A series of recent experiments demonstrates that, when prompted to express meanings through silent gesture, people bypass native language conventions, revealing apparent biases underpinning word order usage, based on the semantic properties of the information to be conveyed. We extend the scope of these studies by focusing, experimentally and computationally, on the interpretation (...) of silent gesture. We show cross‐linguistic experimental evidence that people use variability in constituent order as a cue to obtain different interpretations. To illuminate the computational principles that govern interpretation of non‐conventional communication, we derive a Bayesian model of interpretation via biased inductive inference and estimate these biases from the experimental data. Our analyses suggest people's interpretations balance the ambiguity that is characteristic of emerging language systems, with ordering preferences that are skewed and asymmetric, but defeasible. (shrink)

In recent years, a number of philosophers and cognitive scientists have advocated for an ‘interactive turn’ in the methodology of social-cognition research: to become more ecologically valid, we must design experiments that are interactive, rather than merely observational. While the practical aim of improving ecological validity in the study of social cognition is laudable, we think that the notion of ‘interaction’ is not suitable for this task: as it is currently deployed in the social cognition literature, this notion leads to (...) serious conceptual and methodological confusion. In this paper, we tackle this confusion on three fronts: 1) we revise the ‘interactionist’ definition of interaction; 2) we demonstrate a number of potential methodological confounds that arise in interactive experimental designs; and 3) we show that ersatz interactivity works just as well as the real thing. We conclude that the notion of ‘interaction’, as it is currently being deployed in this literature, obscures an accurate understanding of human social cognition. (shrink)

The native language changes as a result of contact with a second language, and the pattern and degree of such change depend on a variety of factors like the bilingual experience or the linguistic level. Here, we present a systematic review and meta-analysis of works that explore variations in native sentence comprehension and production by comparing monolinguals and bilinguals. Fourteen studies in the meta-analysis provided information regarding the bilingual experience and differences at the morphosyntactic level using behavioral methods. Overall, we (...) observed that first language processing is subject to small transformations in bilinguals that occur in sentence comprehension and production. The magnitude of the changes depended on bilingual experiences, but only length of residence in an L2 setting predicted the degree of change, where shorter length of residence was associated with larger changes. Results are discussed and related to the cognitive processes that potentially cause the transformations in the first language. The present work reveals some limitations in the field that should be addressed in future studies to better understand the mechanisms behind language attrition. (shrink)

We trained a computational model (the Chunk-Based Learner; CBL) on a longitudinal corpus of child–caregiver interactions in English to test whether one proposed statistical learning mechanism—backward transitional probability—is able to predict children's speech productions with stable accuracy throughout the first few years of development. We predicted that the model less accurately reconstructs children's speech productions as they grow older because children gradually begin to generate speech using abstracted forms rather than specific “chunks” from their speech environment. To test this idea, (...) we trained the model on both recently encountered and cumulative speech input from a longitudinal child language corpus. We then assessed whether the model could accurately reconstruct children's speech. Controlling for utterance length and the presence of duplicate chunks, we found no evidence that the CBL becomes less accurate in its ability to reconstruct children's speech with age. (shrink)

Journal Name: Cognitive Linguistics Issue: Ahead of print.

How does the human brain link relational concepts to perceptual experience? For example, a speaker may say “the cup to the left of the computer” to direct the listener's attention to one of two cups on a desk. We provide a neural dynamic account for both perceptual grounding, in which relational concepts enable the attentional selection of objects in the visual array, and for the generation of descriptions of the visual array using relational concepts. In the model, activation in neural (...) populations evolves dynamically under the influence of both inputs and strong interaction as formalized in dynamic field theory. Relational concepts are modeled as patterns of connectivity to perceptual representations. These generalize across the visual array through active coordinate transforms that center the representation of target objects in potential reference objects. How the model perceptually grounds or generates relational descriptions is probed in 104 simulations that systematically vary the spatial and movement relations employed, the number of feature dimensions used, and the number of matching and nonmatching objects. We explain how sequences of decisions emerge from the time‐ and state‐continuous neural dynamics, how relational hypotheses are generated and either accepted or rejected, followed by the selection of new objects or the generation of new relational hypotheses. Its neural realism distinguishes the model from information processing accounts, its capacity to autonomously generate sequences of processing steps distinguishes it from deep neural network accounts. The model points toward a neural dynamic theory of higher cognition. (shrink)

The objective of this article was to review existing research to assess the evidence for predictive processing in sign language, the conditions under which it occurs, and the effects of language mastery on the neural bases of PP. This review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses framework. We searched peer-reviewed electronic databases and gray literature. We also searched the reference lists of records selected for the review and forward citations to identify all relevant publications. We searched (...) for records based on five criteria. To reduce the risk of bias, the remaining two authors with expertise in sign language processing and a variety of research methods reviewed the results. Disagreements were resolved through extensive discussion. In the final review, 7 records were included, of which 5 were published articles and 2 were dissertations. The reviewed records provide evidence for PP in signing populations, although the underlying mechanism in the visual modality is not clear. The reviewed studies addressed the motor simulation proposals, neural basis of PP, as well as the development of PP. All studies used dynamic sign stimuli. Most of the studies focused on semantic prediction. The question of the mechanism for the interaction between one’s sign language competence and PP in the manual-visual modality remains unclear, primarily due to the scarcity of participants with varying degrees of language dominance. There is a paucity of evidence for PP in sign languages, especially for frequency-based, phonetic, and syntactic prediction. However, studies published to date indicate that Deaf native/native-like L1 signers predict linguistic information during sign language processing, suggesting that PP is an amodal property of language processing.Systematic Review Registration[https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021238911], identifier [CRD42021238911]. (shrink)

Philosophers and psychologists assume that mental imagery is a cognitive state, that it represents things as being a certain way. However, I argue that imagery is a conative state: it represents things as to be made a certain way. I challenge the traditional assumption by targeting an increasingly popular cognitive account that identifies mental imagery, such as inner speech, with predictions of sensory input. This predictive account faces both empirical and theoretical problems. The account not only fails to capture the (...) salience effects exhibited by mental imagery, it also cannot explain why subjects should not spend their lives minimizing prediction error by engaging in fantasy. These shortcomings highlight what I call the conative profile of imagery, which includes its salience, motivational, and performance effects. I argue that an alternative, conative view of imagery, according to which mental images are goal states, is best able to account for its conative profile. (shrink)

Theorists have found it difficult to reconcile the unity of inner speech as a mental state kind with the diversity of its manifestations. I argue that existing views concerning the content of inner speech fail to accommodate both of these features because they mistakenly assume that its content is to be found in the ‘speech processing hierarchy’, which includes semantic, syntactic, phonemic, phonetic, and articulatory levels. Upon rejecting this assumption, I offer a position on which the content of inner speech (...) is determined by voice processing, of which speech processing is but one component. The resulting view does justice to the idea that inner speech is a motley assortment of episodes that nevertheless form a kind. (shrink)

A common but overlooked form of explanation in psychiatry is what I label ‘empathetic explanation’. Empathetic explanations invoke empathetic variables, which, in addition to providing an explanation of the target phenomenon, also afford an empathetic understanding of it. Focusing on the case of auditory verbal hallucination (AVH), I argue that empathetic explanation fails to provide an adequate account of the phenomenon, perniciously shapes empirical research, and confuses empathetic understanding with scientific understanding. I close by providing a general condition on the (...) legitimate application of empathetic explanation. (shrink)

It has been shown that Recurrent Artificial Neural Networks automatically acquire some grammatical knowledge in the course of performing linguistic prediction tasks. The extent to which such networks can actually learn grammar is still an object of investigation. However, being mostly data-driven, they provide a natural testbed for usage-based theories of language acquisition. This mini-review gives an overview of the state of the field, focusing on the influence of the theoretical framework in the interpretation of results.

Recent work by Stout and colleagues indicates that the neural correlates of language and Early Stone Age toolmaking overlap significantly. The aim of this paper is to add computational detail to their findings. I use an error minimisation model to outline where the information processing overlap between toolmaking and language lies. I argue that the Early Stone Age signals the emergence of complex structured representations. I then highlight a feature of my account: It allows us to understand the early evolution (...) of syntax in terms of an increase in the number and complexity of models in a cognitive system, rather than the development of new types of processing. (shrink)

In updating our beliefs on the basis of our background attitudes and evidence we frequently employ objects in our environment to represent pertinent information. For example, we may write our premises and lemmas on a whiteboard to aid in a proof or move the beads of an abacus to assist in a calculation. In both cases, we generate extramental (that is, occurring outside of the mind) representational states, and, at least in the case of the abacus, we operate over these (...) states in light of their contents (e.g., the integers represented by the beads) to generate new representations. In this paper, I argue that our belief updating processes and the grounds of their rational evaluation are partly constituted by extramental representations and operations. In other words, we don’t merely update our attitudes through an internal process of reasoning on the basis of available evidence. If we are to accurately understand and rationally evaluate our belief updating processes and resultant attitudes, we need to examine how we representationally appropriate our extramental environment in the updating process. (shrink)

Our conscious thought, at least at times, seems suffused with language. We may experience thinking as if we were “talking in our head”, thus using inner speech to verbalize, e.g., our premises, lemmas, and conclusions. I take inner speech to be part of a larger phenomenon I call inner semiotics, where inner semiotics involves the subjective experience of expressions in a semiotic (or symbol) system absent the overt articulation of the expressions. In this paper, I argue that inner semiotics allows (...) us to bootstrap our way into entertaining thoughts about exact numbers and quantities that we couldn't prior to our competence with a numeric code. I establish that our arithmetic thoughts literally occur as (internal ‘articulations’ of) expressions in a numeric code. However, a problem arises for my view: just as we can slip in overt speech, producing an utterance that deviates from what we mean to say, there is very good evidence that we can slip in inner speech as well. If our arithmetic thought occurs in a numeric code, it's far from clear how we determine when a covert utterance constitutes a slip. In closing, I provide an account of what makes an inner speech utterance a slip. (shrink)

We present a theoretical framework bearing on the evolution of written communication. We analyze writing as a special kind of graphic code. Like languages, graphic codes consist of stable, conventional mappings between symbols and meanings, but (unlike spoken or signed languages) their symbols consist of enduring images. This gives them the unique capacity to transmit information in one go across time and space. Yet this capacity usually remains quite unexploited, because most graphic codes are insufficiently informative. They may only be (...) used for mnemonic purposes or as props for oral communication in real-time encounters. Writing systems, unlike other graphic codes, work by encoding a natural language. This allows them to support asynchronous communication in a more powerful and versatile way than any other graphic code. Yet, writing systems will not automatically unlock the capacity to communicate asynchronously. We argue that this capacity is a rarity in non-literate societies, and not so frequent even in literate ones. Asynchronous communication is intrinsically inefficient because asynchrony constrains the amount of information that the interlocutors share and limits possibilities for repair. This would explain why synchronous, face-to-face communication always fosters the development of sophisticated codes (natural languages), but similar codes for asynchronous communication evolve with more difficulties. It also implies that writing cannot have evolved, at first, for supporting asynchronous communication. (shrink)

Most discussions frame the Liar Paradox as a formal logical-linguistic puzzle. Attempts to resolve the paradox have focused very little so far on aspects of cognitive psychology and processing, because semantic and cognitive-psychological issues are generally assumed to be disjunct. I provide a motivation and carry out a cognitive-computational treatment of the liar paradox based on a model of language and conceptual knowledge within the Predictive Processing framework. I suggest that the paradox arises as a failure of synchronization between two (...) ways of generating the liar situation in two different PP sub-models, one corresponding to language processing and the other to the processing of meaning and world-knowledge. In this way, I put forward the claim that the liar sentence is meaningless but has an air of meaningfulness. I address the possible objection that the proposal violates the Principle of Unrestricted Compositionality, which purportedly regulates the conceptual competence of thinkers. (shrink)

Predictive Processing (PP) is an increasingly influential neurocognitive-computational framework. PP research has so far focused predominantly on lower level perceptual, motor, and various psychological phenomena. But PP seems to face a “scale-up challenge”: How can it be extended to conceptual thought, language, and other higher cognitive competencies? Compositionality, arguably a central feature of conceptual thought, cannot easily be accounted for in PP because it is not couched in terms of classical symbol processing. I argue, using the example of language, that (...) there is no strong reason to think that PP cannot be scaled up to higher cognition. I suggest that the tacitly assumed common-sense conception of language as Generative Grammar (“folk linguistics”) and its notion of composition leads to the scale-up concerns. Fodor’s Language of Thought Hypothesis (LOTH) plays the role of a cognitive computational paradigm for folk linguistics. Therefore, we do not take LOTH as facing problems with higher cognition, at least with regard to compositionality. But PP can plausibly play the role of a cognitive-computational paradigm for an alternative conception of language, namely Construction Grammar. If Construction Grammar is a plausible alternative to folk linguistics, then PP is not in a worse position than LOTH. (shrink)

Second-language learners rarely arrive at native proficiency in a number of linguistic domains, including morphological and syntactic processing. Previous approaches to understanding the different outcomes of first- versus second-language learning have focused on cognitive and neural factors. In contrast, we explore the possibility that children and adults may rely on different linguistic units throughout the course of language learning, with specific focus on the granularity of those units. Following recent psycholinguistic evidence for the role of multiword chunks in online language (...) processing, we explore the hypothesis that children rely more heavily on multiword units in language learning than do adults learning a second language. To this end, we take an initial step toward using large-scale, corpus-based computational modeling as a tool for exploring the granularity of speakers' linguistic units. Employing a computational model of language learning, the Chunk-Based Learner, we compare the usefulness of chunk-based knowledge in accounting for the speech of second-language learners versus children and adults speaking their first language. Our findings suggest that while multiword units are likely to play a role in second-language learning, adults may learn less useful chunks, rely on them to a lesser extent, and arrive at them through different means than children learning a first language. (shrink)

Most discussions frame the Liar Paradox as a formal logical-linguistic puzzle. Attempts to resolve the paradox have focused very little so far on aspects of cognitive psychology and processing, because semantic and cognitive-psychological issues are generally assumed to be disjunct. I provide a motivation and carry out a cognitive-computational treatment of the liar paradox based on a model of language and conceptual knowledge within thePredictive Processing(PP) framework. I suggest that the paradox arises as a failure of synchronization between two ways (...) of generating the liar situation in two different (idealized) PP sub-models, one corresponding to language processing and the other to the processing of meaning and world-knowledge. In this way, I put forward the claim that the liar sentence is meaningless but has an air of meaningfulness. I address the possible objection that the proposal violates thePrinciple of Unrestricted Compositionality, which purportedly regulates the conceptual competence of thinkers. (shrink)