Sentence comprehension - the way we process and understand spoken and written language - is a central and important area of research within psycholinguistics. This book explores the contribution of computational linguistics to the field, showing how computational models of sentence processing can help scientists in their investigation of human cognitive processes. It presents the leading computational model of retrieval processes in sentence processing, the Lewis and Vasishth cue-based retrieval mode, and develops a principled methodology for (...) parameter estimation and model comparison/evaluation using benchmark data, to enable researchers to test their own models of retrieval against the present model. It also provides readers with an overview of the last 20 years of research on the topic of retrieval processes in sentence comprehension, along with source code that allows researchers to extend the model and carry out new research. Comprehensive in its scope, this book is essential reading for researchers in cognitive science. (shrink)

This target article discusses the verbal working memory system used in sentence comprehension. We review the concept of working memory as a short-duration system in which small amounts of information are simultaneously stored and manipulated in the service of accomplishing a task. We summarize the argument that syntactic processing in sentence comprehension requires such a storage and computational system. We then ask whether the working memory system used in syntactic processing is the same as that used (...) in verbally mediated tasks that involve conscious controlled processing. Evidence is brought to bear from various sources: the relationship between individual differences in working memory and individual differences in the efficiency of syntactic processing; the effect of concurrent verbal memory load on syntactic processing; and syntactic processing in patients with poor short-term memory, patients with poor working memory, and patients with aphasia. Experimental results from these normal subjects and patients with various brain lesions converge on the conclusion that there is a specialization in the verbal working memory system for assigning the syntactic structure of a sentence and using that structure in determining sentence meaning that is separate from the working memory system underlying the use of sentence meaning to accomplish other functions. We present a theory of the divisions of the verbal working memory system and suggestions regarding its neural basis. (shrink)

The argument that Broca's area is preferentially involved in specific syntactic operations is based on a strong assertion regarding patterns of sentence comprehension found among patients with Broca's aphasia. This assertion is shown to be largely inconsistent with the available evidence from published studies, which indicates that only a subgroup of Broca patients demonstrate the target pattern.

Neuroimaging evidence suggests that the left inferior frontal gyrus (LIFG) supports temporary storage of linguistic material during linguistic tasks rather than computing a syntactic representation. The LIFG is not activated by simple sentences but by complex sentences and maintenance of word lists. Under this hypothesis, agrammatism should only disturb comprehension for constructions in which storage is essential.

How could the kinds of grammars that linguists write actually be used in models of perceptual processing? This book relates grammars to cognitive architecture. It shows how incremental parsing works, step-by-step, and how specific learning rules might lead to frequency-sensitive preferences. Along the way, Hale reconsiders garden-pathing, the parallel/serial distinction and information-theoretical complexity metrics such as surprisal. A "must" for cognitive scientists of language. ".

Sentence comprehension involves maintaining and continuously integrating linguistic information and, thus, makes demands on working memory. Past research has demonstrated that semantic WM, but not phonological WM, is critical for integrating word meanings across some distance and resolving semantic interference in sentence comprehension. Here, we examined the relation between phonological and semantic WM and the comprehension of center-embedded relative clause sentences, often argued to make heavy demands on WM. Additionally, we examined the relation between phonological (...) and semantic WM and the comprehension of transitive and dative active and passive sentences, which may also draw on WM resources depending on the number of propositions that must be maintained and the difficulty of processing passive clauses. In a large sample of individuals with aphasia, we assessed whether comprehension performance on more complex vs. simpler active-passive or embedded relative clause sentences would be predicted by semantic but not phonological WM when controlling for single word comprehension. For performance on the active-passive comprehension task, we found that semantic WM, but not phonological WM, predicted comprehension of dative sentences when controlling for comprehension of transitive sentences. We also found that phonological WM, but not semantic WM, predicted mean comprehension for reversible active-passive sentences when controlling for trials with lexical distractors. On the relative clause comprehension task, consistent with prior results, we found that semantic WM, but not phonological WM, predicted comprehension of object relative clause sentences and relative clause sentences with a passive construction. However, both phonological WM and semantic WM predicted mean comprehension across all relative clause types for reversible trials when controlling for trials with lexical distractors. While we found evidence of semantic WM’s role in comprehension, we also observed unpredicted relations between phonological WM and comprehension in some conditions. Post-hoc analyses provided preliminary evidence that phonological WM maintains a backup phonological representation of the sentence that may be accessed when sentence comprehension processing is less efficient. Future work should investigate possible roles that phonological WM may play across sentence types. (shrink)

Agreement attraction is a cross-linguistic phenomenon where a verb occasionally agrees not with its subject, as required by grammar, but instead with an unrelated noun (“The key to the cabinets were…”). Despite the clear violation of grammatical rules, comprehenders often rate these sentences as acceptable. Contenders for explaining agreement attraction fall into two broad classes: Morphosyntactic accounts specifically designed to explain agreement attraction, and more general sentence processing models, such as the Lewis and Vasishth model, which explain attraction as (...) a consequence of how linguistic structure is stored and accessed in content-addressable memory. In the present research, we disambiguate between these two classes by testing a surprising prediction made by the Lewis and Vasishth model but not by the morphosyntactic accounts, namely, that attraction should not be limited to morphosyntax, but that semantic features of unrelated nouns equally induce attraction. A recent study by Cunnings and Sturt provided initial evidence that this may be the case. Here, we report three single-trial experiments in English that compared semantic and agreement attraction and tested whether and how the two interact. All three experiments showed strong semantically induced attraction effects closely mirroring agreement attraction effects. We complement these results with computational simulations which confirmed that the Lewis and Vasishth model can faithfully reproduce the observed results. In sum, our findings suggest that attraction is a more general phenomenon than is commonly believed, and therefore favor more general sentence processing models, such as the Lewis and Vasishth model. (shrink)

There is substantial support for the general idea that a formalization of comprehenders' expectations about the likely next word in a sentence helps explaining data related to online sentence processing. While much research has focused on syntactic, semantic, and discourse expectations, the present event‐related potentials (ERPs) study investigates neurolinguistic correlates of pragmatic expectations, which arise when comprehenders expect a sentence to conform to Gricean Maxims of Conversation. For predicting brain responses associated with pragmatic processing, we introduce a (...) formal model of such Gricean pragmatic expectations, using an idealized incremental interpreter. We examine whether pragmatic expectancies derived from this model modulate the amplitude of the N400, a component that has been associated with predictive processing. As part of its parameterization, the model distinguishes genuine pragmatic interpreters, who expect maximally informative true utterances, from literal interpreters, who only expect truthfulness. We explore the model's non‐trivial predictions for an experimental setup which uses picture‐sentence verification with ERPs recorded at several critical positions in sentences containing the scalar implicature trigger some. We find that Gricean expectations indeed affect the N400, largely in line with the predictions of our model, but also discuss discrepancies between model predictions and observations critically. (shrink)

Cognitive Science, Volume 46, Issue 2, February 2022.

Reaction time to detect a phoneme target in a sentence was found to be faster when the word in which the target occurred formed part of the semantic focus of the sentence. Focus was determined by asking a question before the sentence; that part of the sentence which comprised the answer to the sentence was assumed to be focussed. This procedure made it possible to vary position of focus within the sentence while holding all (...) acoustic aspects of the sentence itself constant. It is argued that sentence understanding is facilitated by rapid identification of focussed information. Since focussed words are usually accented, it is further argued that the active search for accented words demonstrated in previous research should be interpreted as a search for semantic focus. (shrink)

Caplan & Waters argue that the processing resources used for sentence comprehension are not drawn from an undifferentiated verbal working memory resource. This commentary cites data from normal aging to support this position. Still lacking in theory development is a specification of the transient memory representations necessary for interpretive and post-interpretive operations.

We present a computational evaluation of three hypotheses about sources of deficit in sentence comprehension in aphasia: slowed processing, intermittent deficiency, and resource reduction. The ACT-R based Lewis and Vasishth model is used to implement these three proposals. Slowed processing is implemented as slowed execution time of parse steps; intermittent deficiency as increased random noise in activation of elements in memory; and resource reduction as reduced spreading activation. As data, we considered subject vs. object relative sentences, presented in (...) a self-paced listening modality to 56 individuals with aphasia and 46 matched controls. The participants heard the sentences and carried out a picture verification task to decide on an interpretation of the sentence. These response accuracies are used to identify the best parameters that correspond to the three hypotheses mentioned above. We show that controls have more tightly clustered parameter values than IWA; specifically, compared to controls, among IWA there are more individuals with slow parsing times, high noise, and low spreading activation. We find that individual IWA show differential amounts of deficit along the three dimensions of slowed processing, intermittent deficiency, and resource reduction, overall, there is evidence for all three sources of deficit playing a role, and IWA have a more variable range of parameter values than controls. An important implication is that it may be meaningless to talk about sources of deficit with respect to an abstract verage IWA; the focus should be on the individual's differential degrees of deficit along different dimensions, and on understanding the causes of variability in deficit between participants. (shrink)

Traxler, Pickering, and Clifton found that ambiguous sentences are read faster than their unambiguous counterparts. This so-called ambiguity advantage has presented a major challenge to classical theories of human sentence comprehension because its most prominent explanation, in the form of the unrestricted race model, assumes that parsing is non-deterministic. Recently, Swets, Desmet, Clifton, and Ferreira have challenged the URM. They argue that readers strategically underspecify the representation of ambiguous sentences to save time, unless disambiguation is required by task (...) demands. When disambiguation is required, however, readers assign sentences full structure—and Swets et al. provide experimental evidence to this end. On the basis of their findings, they argue against the URM and in favor of a model of task-dependent sentence comprehension. We show through simulations that the Swets et al. data do not constitute evidence for task-dependent parsing because they can be explained by the URM. However, we provide decisive evidence from a German self-paced reading study consistent with Swets et al.'s general claim about task-dependent parsing. Specifically, we show that under certain conditions, ambiguous sentences can be read more slowly than their unambiguous counterparts, suggesting that the parser may create several parses, when required. Finally, we present the first quantitative model of task-driven disambiguation that subsumes the URM, and we show that it can explain both Swets et al.'s results and our findings. (shrink)

This study presents a web-based sentence comprehension test aimed at identifying high school students who are at risk for a language delay. By assessing linguistic skills on a sample of high school students with Italian as an L2 and their monolingual peers, attending a vocational school, we were able to identify a subgroup of L2 students with consistent difficulties in sentence comprehension, though their reading skills were within the average range. The same subgroup revealed to experience (...) a lack of support within the school context, suggesting that poor L2 skills might be a critical variable to consider in order to identify students at risk for school exclusion. Regarding the test, accuracy to the on-line sentence comprehension task was significantly predicted by reading abilities and vocabulary skills, thus indicating that this test might represent a rapid but efficient way to assess linguistic abilities at school. We recommend that establishing a valid and practical procedure for the evaluation of linguistic skills in bilingual students who struggle with their L2 is the first step towards promoting social inclusion in the multilingual classroom, in order to increase their ability to actively participate in school and social activities. (shrink)

The entropy-reduction hypothesis claims that the cognitive processing difficulty on a word in sentence context is determined by the word's effect on the uncertainty about the sentence. Here, this hypothesis is tested more thoroughly than has been done before, using a recurrent neural network for estimating entropy and self-paced reading for obtaining measures of cognitive processing load. Results show a positive relation between reading time on a word and the reduction in entropy due to processing that word, supporting (...) the entropy-reduction hypothesis. Although this effect is independent from the effect of word surprisal, we find no evidence that these two measures correspond to cognitively distinct processes. (shrink)

Sentences such as "The author started the book" are indeterminate because they do not make explicit what the subject (the author) started doing with the object (the book). In principle, indeterminate sentences allow for an infinite number of interpretations. One theory, however, assumes that these sentences are resolved by semantic coercion, a linguistic process that forces the noun "book" to be interpreted as an activity (e.g., writing the book) or by a process that interpolates this activity information in the resulting (...) enriched semantic composition. An alternative theory, pragmatic, assumes classical semantic composition, whereby meaning arises from the denotation of words and how they are combined syntactically, with enrichment obtained via pragmatic inferences beyond linguistic-semantic processes. Cognitive neuroscience studies investigating the neuroanatomical and functional correlates of indeterminate sentences have shown activations either at the ventromedial pre-frontal cortex or at the left inferior frontal gyrus. These studies have supported the semantic coercion theory assuming that one of these regions is where enriched semantic composition takes place. Employing fMRI, we found that indeterminate sentences activate bilaterally the superior temporal gyrus, the right inferior frontal gyrus, and the anterior cingulate cortex, more so than control sentences ("The author wrote the book"). Activation of indeterminate sentences exceeded that of anomalous sentences ("…drank the book") and engaged more left- and right-hemisphere areas than other sentence types. We suggest that the widespread activations for indeterminate sentences represent the deployment of pragmatic-inferential processes, which seek to enrich sentence content without necessarily resorting to semantic coercion. (shrink)

There is mounting evidence that language comprehension involves the activation of mental imagery of the content of utterances (Barsalou, 1999;Bergen, Chang, & Narayan, 2004;Bergen, Narayan, & Feldman, 2003;Narayan, Bergen, & Weinberg, 2004;Richardson, Spivey, McRae, & Barsalou, 2003;Stanfield & Zwaan, 2001;Zwaan, Stanfield, & Yaxley, 2002). This imagery can have motor or perceptual content. Three main questions about the process remain under‐explored, however. First, are lexical associations with perception or motion sufficient to yield mental simulation, or is the integration of lexical (...) semantics into larger structures, like sentences, necessary? Second, what linguistic elements (e.g., verbs, nouns, etc.) trigger mental simulations? Third, how detailed are the visual simulations that are performed? A series of behavioral experiments address these questions, using a visual object categorization task to investigate whether up‐ or down‐related language selectively interferes with visual processing in the same part of the visual field (followingRichardson et al., 2003). The results demonstrate that either subject nouns or main verbs can trigger visual imagery, but only when used in literal sentences about real space—metaphorical language does not yield significant effects—which implies that it is the comprehension of the sentence as a whole and not simply lexical associations that yields imagery effects. These studies also show that the evoked imagery contains detail as to the part of the visual field where the described scene would take place. (shrink)

Anticipation plays a role in language comprehension. In this article, we explore the extent to which verb sense influences expectations about upcoming structure. We focus on change of state verbs like shatter, which have different senses that are expressed in either transitive or intransitive structures, depending on the sense that is used. In two experiments we influence the interpretation of verb sense by manipulating the thematic fit of the grammatical subject as cause or affected entity for the verb, and (...) test whether readers’ expectations for a transitive or intransitive structure change as a result. This sense‐biasing context influenced reading times in the postverbal regions. Reading times for transitive sentences were faster following good‐cause than good‐theme subjects, but the opposite pattern was found for intransitive sentences. We conclude that readers use sense‐contingent subcategorization preferences during on‐line comprehension. (shrink)

In explicit memory recall and recognition tasks, elaboration and contextual isolation both facilitate memory performance. Here, we investigate these effects in the context of sentence processing: targets for retrieval during online sentence processing of English object relative clause constructions differ in the amount of elaboration associated with the target noun phrase, or the homogeneity of superficial features (text color). Experiment 1 shows that greater elaboration for targets during the encoding phase reduces reading times at retrieval sites, but elaboration (...) of non-targets has considerably weaker effects. Experiment 2 illustrates that processing isolated superficial features of target noun phrases --- here, a green word in a sentence with words colored white --- does not lead to enhanced memory performance, despite triggering longer encoding times. These results are interpreted in the light of the memory models of Nairne 1990, 2001, 2006, which state that encoding remnants contribute to the set of retrieval cues that provide the basis for similarity-based interference effects. (shrink)

We investigated the influence of globally ungrammatical local syntactic constraints on sentence comprehension, as well as the corresponding activation of global and local representations. In Experiment 1, participants viewed visual scenes with objects like a carousel and motorbike while hearing sentences with noun phrase (NP) or verb phrase (VP) modifiers like “The girl who likes the man (from London/very much) will ride the carousel.” In both cases, “girl” and “ride” predicted carousel as the direct object; however, the locally (...) coherent combination “the man from London will ride…” in NP cases alternatively predicted motorbike. During “ride,” local constraints, although ruled out by the global constraints, influenced prediction as strongly as global constraints: While motorbike was fixated less than carousel in VP cases, it was fixated as much as carousel in NP cases. In Experiment 2, these local constraints likewise slowed reading times. We discuss implications for theories of sentence processing. (shrink)

We present a visual world eye-tracking study on Tseltal (a Mayan language) and investigate whether verbal information can be used to anticipate an upcoming referent. Basic word order in transitive sentences in Tseltal is Verb–Object–Subject (VOS). The verb is usually encountered first, making argument structure and syntactic information available at the outset, which should facilitate anticipation of the post-verbal arguments. Tseltal speakers listened to verb-initial sentences with either an object-predictive verb (e.g., “eat”) or a general verb (e.g., “look for”) (e.g., (...) “Ya slo’/sle ta stukel on te kereme,” Is eating/is looking (for) by himself the avocado the boy/ “The boy is eating/is looking (for) an avocado by himself”) while seeing a visual display showing one potential referent (e.g., avocado) and three distractors (e.g., bag, toy car, coffee grinder). We manipulated verb type (predictive vs. general) and recorded participants' eye movements while they listened and inspected the visual scene. Participants’ fixations to the target referent were analyzed using multilevel logistic regression models. Shortly after hearing the predictive verb, participants fixated the target object before it was mentioned. In contrast, when the verb was general, fixations to the target only started to increase once the object was heard. Our results suggest that Tseltal hearers pre-activate semantic features of the grammatical object prior to its linguistic expression. This provides evidence from a verb-initial language for online incremental semantic interpretation and anticipatory processing during language comprehension. These processes are comparable to the ones identified in subject-initial languages, which is consistent with the notion that different languages follow similar universal processing principles. (shrink)

We present interpretation‐based processing—a theory of sentence processing that builds a syntactic and a semantic representation for a sentence and assigns an interpretation to the sentence as soon as possible. That interpretation can further participate in comprehension and in lexical processing and is vital for relating the sentence to the prior discourse. Our theory offers a unified account of the processing of literal sentences, metaphoric sentences, and sentences containing semantic illusions. It also explains how text (...) can prime lexical access. We show that word literality is a matter of degree and that the speed and quality of comprehension depend both on how similar words are to their antecedents in the preceding text and how salient the sentence is with respect to the preceding text. Interpretation‐based processing also reconciles superficially contradictory findings about the difference in processing times for metaphors and literals. The theory has been implemented in ACT‐R [Anderson and Lebiere, The Atomic Components of Thought, Lawrence Erlbaum Associates Publishers, Mahwah, NJ, 1998]. (shrink)

The present study aimed to investigate the effects of type of noise, age and gender on children’s speech intelligibility and sentence comprehension. The experiment was conducted with 171 children between 11 and 13 years old in ecologically-valid conditions (collective presentation in real, reverberating classrooms). Two standardized tests were used to assess speech intelligibility (SI) and sentence comprehension (SC). The two tasks were presented in three listening conditions: quiet; traffic noise; and classroom noise (non-intelligible noise with the (...) same spectrum and temporal envelope of speech, plus typical classroom sound events). Both task performance accuracy and listening effort were considered in the analyses, the latter tracked by recording the response time using a single-task paradigm. Classroom noise was found to have the worst effect on both tasks (worsening task performance accuracy and slowing response times), due to its spectro-temporal characteristics. A developmental effect was seen in the range of ages (11-13 years), which depended on the task and listening condition. Gender effects were also seen in both tasks, girls being more accurate and quicker to respond in most listening conditions. A significant interaction emerged between type of noise, age and task, indicating that classroom noise had a greater impact on response times for SI than for SC. Overall, these results indicate that, for 11- to 13-year-old children, performance in SI and SC tasks is influenced by aspects relating to both the sound environment and the listener (age, gender). The presence of significant interactions between these factors and the type of task suggests that the acoustic conditions that guarantee optimal SI might not be equally adequate for SC. Our findings have implications for the development of standard requirements for the acoustic design of classrooms. (shrink)

Putting the principles of multisensory teaching into practice, this study investigated the effect of audio-visual vocabulary repetition on L2 sentence comprehension. Forty participants were randomly assigned to experimental and control groups. A sensory-based model of instruction was used to teach a list of unfamiliar vocabularies to the two groups. Following the instruction, the experimental group repeated the instructed words twice, while the control group received no vocabulary repetition. Afterward, their electrophysiological neural activities were recorded through electroencephalography while doing (...) a sentence acceptability judgment task with 216 sentences under acceptable and unacceptable conditions. A one-way analysis of variance, a multivariate analysis of variance, and a Bayesian repeated-measures ANOVA were used to compare the behavioral and neurocognitive responses [N400 as the main language-related event-related brain potential effect] of the two groups. The results showed no significant N400 amplitude difference in favor of any of the groups. The findings corroborated the ineffectiveness of two repetitions preceded by multisensory instruction on L2 sentence comprehension. (shrink)

We discuss several issues raised by Caplan & Waters's distinction between interpretative and post-interpretative processes in sentence comprehension, including the nature and properties of the two systems, problems with measuring their respective capacities, and the relationship between the hypothesized separate-language-interpretation-resource (SLIR) and the general verbal working memory system that supports post-interpretive processing.