Currently, production and comprehension are regarded as quite distinct in accounts of language processing. In rejecting this dichotomy, we instead assert that producing and understanding are interwoven, and that this interweaving is what enables people to predict themselves and each other. We start by noting that production and comprehension are forms of action and action perception. We then consider the evidence for interweaving in action, action perception, and joint action, and explain such evidence in terms of prediction. Specifically, we assume (...) that actors construct forward models of their actions before they execute those actions, and that perceivers of others' actions covertly imitate those actions, then construct forward models of those actions. We use these accounts of action, action perception, and joint action to develop accounts of production, comprehension, and interactive language. Importantly, they incorporate well-defined levels of linguistic representation. We show how speakers and comprehenders use covert imitation and forward modeling to make predictions at these levels of representation, how they interweave production and comprehension processes, and how they use these predictions to monitor the upcoming utterances. We show how these accounts explain a range of behavioral and neuroscientific data on language processing and discuss some of the implications of our proposal. (shrink)

In relation to semantics, “grounding” has two relevant meanings. “Symbol grounding” is the process of connecting symbols to perception and the world. “Communicative grounding” is the process of interactively adding to common ground in dialog. Strategies for grounding in human communication include, crucially, strategies for resolving troubles caused by various kinds of miscommunication. As it happens, these two processes of grounding are closely related. As a side-effect of grounding an utterance, dialog participants may adjust the meanings they assign to linguistic (...) expressions, in a process of semantic coordination. Meanings of at least some expressions include perceptual aspects which enable DPs to classify entities as falling under the expression or not based on their perception of those entities. We show how perceptual grounding of symbols can be achieved in a process of interactively adding to common ground. This requires that perceptual aspects of meaning can be updated as a result of participating in linguistic interaction, thereby enabling fine-grained semantic coordination of perceptually grounded linguistic meanings. A formal semantics for low-level perceptual aspects of meaning is presented, tying these together with the logical-inferential aspects of meaning traditionally studied in formal semantics. The key idea is to model perceptual meanings as classifiers of perceptual input. This requires a framework where intensions are represented independently of extensions, and structured objects which can be modified as a result of learning. We use Type Theory with Records, a formal semantics framework which starts from the idea that information and meaning are founded on our ability to perceive and classify the world, that is, to perceive objects and situations as being of types. As an example of our approach, we show how a simple classifier of spatial information based on the Perceptron can be cast in TTR. (shrink)

The emergence of shared symbol systems is considered to be a pivotal moment in human evolution and human development. These changes are normally explained by reference to changes in people's internal cognitive processes. We present 2 experiments which provide evidence that changes in the external, collaborative processes that people use to communicate can also affect the structure and organization of symbol systems independently of cognitive change. We propose that mutual‐modifiability—opportunities for people to edit or manipulate each other's contributions—is a key (...) constraint on the emergence of complex symbol systems. We discuss the implications for models of language development and the origins of compositionality. (shrink)

Clarification requests, queries posed in response to a “problematic” (misheard, misunderstood, etc.) utterance, are a challenge to mainstream semantic theories because they call into question notions such as “shared content” or “the context.” Given their strong parallelism requirements, elliptical clarification requests introduce in addition significant complexities concerning the need for long-term maintenance of non-semantic information in context. In this paper, we consider a puzzle concerning the emergence of elliptical clarification requests in child English: Data from the Belfast and Manchester corpora (...) from CHILDES demonstrate that reprise fragments, the highest frequency clarification request construction among adults, emerges with significant delay in comparison with reprise sluices, bare wh-phrases used to request clarification. This is a puzzling finding a priori: first, since reprise fragments are by most plausible measures the most readily available clarification request form in that it involves mere repetition of material primed by the previous utterance and children have the ability to repeat parts of the previous utterance from the earliest stages of speech. Moreover, as we show, reprise fragments predominate—in some cases vastly so, over sluicing in the input of fragmentary clarification requests available to the child—and it would, therefore, be difficult to construct an explanation for order of emergence primarily based on frequency of the construction in the children's input. Our account is based on grammatical explication of the difference between the constructions, how constructional difference is represented in a hierarchy of constructions, and in terms of a notion of semantic complexity that suggests reprise sluicing is, in fact, less complex than reprise fragments. (shrink)

Anecdotal evidence suggests that participants in conversation can sometimes act as a coalition. This implies a level of conversational organization in which groups of individuals form a coherent unit. This paper investigates the implications of this phenomenon for psycholinguistic and semantic models of shared context in dialog. We present a corpus study of multiparty dialog which shows that, in certain circumstances, people with different levels of overt involvement in a conversation, that is, one responding and one not, can nonetheless access (...) the same shared context. We argue that contemporary models of shared context need to be adapted to capture this situation. To address this, we propose “grounding by proxy,” in which one person can respond on behalf of another, as a simple mechanism by which shared context can accumulate for a coalition as a whole. We explore this hypothesis experimentally by investigating how people in a task-oriented coalition respond when their shared context appears to be weakened. The results provide evidence that, by default, coalition members act on each other's behalf, and when this fails they work to compensate. We conclude that this points to the need for a new concept of collective grounding acts and a corresponding concept of collective contexts in psycholinguistic and semantic models of dialog. (shrink)

For people to contribute to discourse, they must do more than utter the right sentence at the right time. The basic requirement is that they add to their common ground in an orderly way. To do this, we argue, they try to establish for each utterance the mutual belief that the addressees have understood what the speaker meant well enough for current purposes. This is accomplished by the collective actions of the current contributor and his or her partners, and these (...) result in units of conversation called contributions. We present a model of contributions and show how it accounts for a variety of features of everyday conversations. (shrink)

Memory is fleeting. New material rapidly obliterates previous material. How, then, can the brain deal successfully with the continual deluge of linguistic input? We argue that, to deal with this “Now-or-Never” bottleneck, the brain must compress and recode linguistic input as rapidly as possible. This observation has strong implications for the nature of language processing: (1) the language system must “eagerly” recode and compress linguistic input; (2) as the bottleneck recurs at each new representational level, the language system must build (...) a multilevel linguistic representation; and (3) the language system must deploy all available information predictively to ensure that local linguistic ambiguities are dealt with “Right-First-Time”; once the original input is lost, there is no way for the language system to recover. This is “Chunk-and-Pass” processing. Similarly, language learning must also occur in the here and now, which implies that language acquisition is learning to process, rather than inducing, a grammar. Moreover, this perspective provides a cognitive foundation for grammaticalization and other aspects of language change. Chunk-and-Pass processing also helps explain a variety of core properties of language, including its multilevel representational structure and duality of patterning. This approach promises to create a direct relationship between psycholinguistics and linguistic theory. More generally, we outline a framework within which to integrate often disconnected inquiries into language processing, language acquisition, and language change and evolution. (shrink)