Expectation-based theories of language comprehension, in particular Surprisal Theory, go a long way in accounting for the behavioral correlates of word-by-word processing difficulty, such as reading times. An open question, however, is in which component of the Event-Related brain Potential signal Surprisal is reflected, and how these electrophysiological correlates relate to behavioral processing indices. Here, we address this question by instantiating an explicit neurocomputational model of incremental, word-by-word language comprehension that produces estimates of the N400 and the P600—the two most (...) salient ERP components for language processing—as well as estimates of “comprehension-centric” Surprisal for each word in a sentence. We derive model predictions for a recent experimental design that directly investigates “world-knowledge”-induced Surprisal. By relating these predictions to both empirical electrophysiological and behavioral results, we establish a close link between Surprisal, as indexed by reading times, and the P600 component of the ERP signal. The resultant model thus offers an integrated neurobehavioral account of processing difficulty in language comprehension. (shrink)

Previous electrophysiological studies that have examined temporal agreement violations in (Indo-European) languages that use grammatical affixes to mark time reference, have found a Left Anterior Negativity (LAN) and/or P600 ERP components, reflecting morpho-syntactic and syntactic processing, respectively. The current study investigates the electrophysiological processing of temporal relations in an African language (Akan) that uses grammatical tone, rather than morphological inflection, for time reference. Twenty-four native speakers of Akan listened to sentences with time reference violations. Our results demonstrate that a violation (...) of a present context by a past verb yields a P600 time-locked to the verb. There was no such effect when a past context was violated by a present verb. In conclusion, while there are similarities in both Akan and Indo-European languages, as far as the modulation of the P600 effect is concerned, the nature of this effect seems to be different for these languages. (shrink)

We tested two accounts of the cognitive process underlying the N400 event‐related potential component: one that it reflects meaning‐based processing and one that it reflects the processing of specific words. The experimental design utilized separable Persian phrasal verbs, which form a strongly probabilistic, long‐distance dependency, ideal for the study of probabilistic processing. In sentences strongly constraining for a particular continuation, we show evidence that between two low‐probability words, only the word that changed the expected meaning of the sentence increased N400 (...) amplitude, while a synonym of the most probable target word did not. The findings support an account of the N400 in which its underlying process is driven by the processing of meaning rather than of specific words. (shrink)

Studies of native syntactic processing often target phrase structure violations that do not occur in natural production. In contrast, this study examines how variation in basic word order is processed, looking specifically at structures traditionally labelled as violations but that do occur naturally. We examined Swedish verb-second and verb-third word order processing in adult native Swedish speakers, manipulating sentence-initial adverbials in acceptability judgements, in simultaneously recorded event-related potentials to visually presented sentences and in a written sentence completion task. An initial (...) corpus study showed that the adverbials differ in frequency in fronted position, and although all occur mainly with V2 word order, kanske occurs more frequently with V3 in natural production than both idag and hemma. The experimental results reflected these patterns such that V2 sentences were overall more frequently produced and were deemed more acceptable than V3 sentences. The ERP results consisted of a biphasic N400/P600 response to V3 word order that indicated effects of word retrieval and sentence reanalysis. We also found consistent effects of adverbials. As predicted, V3 was produced more frequently and judged as more acceptable in Kanske sentences than in sentences with the other two adverbials. The ERP analyses showed stronger effects for idag and hemma with V3, especially regarding the P600. The results suggest that the naturally occurring word order ‘violation’, V3 with kanske, is processed differently than V3 with other adverbials where the V2 norm is stronger. Moreover, these patterns are related to individuals’ own production patterns. Overall, the results suggest a more varied native word order processing than previously reported. (shrink)

One of the most important social cognitive skills in humans is the ability to “put oneself in someone else’s shoes,” that is, to take another person’s perspective. In socially situated communication, perspective taking enables the listener to arrive at a meaningful interpretation of what is said and what is meant by the speaker. To successfully decode the speaker’s meaning, the listener has to take into account which information he/she and the speaker share in their common ground. We here further investigated (...) competing accounts about when and how CG information affects language comprehension by means of reaction time measures, accuracy data, event-related potentials, and eye-tracking. Early integration accounts would predict that CG information is considered immediately and would hence not expect to find costs of CG integration. Late integration accounts would predict a rather late and effortful integration of CG information during the parsing process that might be reflected in integration or updating costs. Other accounts predict the simultaneous integration of privileged ground and CG perspectives. We used a computerized version of the referential communication game with object triplets of different sizes presented visually in CG or PG. In critical trials, CG information had to be integrated while privileged information had to be suppressed. Listeners mastered the integration of CG. Yet, slower RTs, and enhanced late positivities in the ERPs showed that CG integration had its costs. Moreover, eye-tracking data indicated an early anticipation of referents in CG but an inability to suppress looks to the privileged competitor, resulting in later and longer looks to targets in those trials, in which CG information had to be considered. Our data therefore support accounts that foresee an early anticipation of referents to be in CG but a rather late and effortful integration if conflicting information has to be processed. We show that both perspectives, PG and CG, contribute to socially situated language processing and discuss the data with reference to theoretical accounts and recent findings on the use of CG information for reference resolution. (shrink)

Neurocognitive models (e.g., Schirmer & Kotz, 2006) have helped to characterize how listeners incrementally derive meaning from vocal expressions of emotion in spoken language, what neural mechanisms are involved at different processing stages, and their relative time course. But how can these insights be applied to communicative situations in which prosody serves a predominantly interpersonal function? This comment examines recent data highlighting the dynamic interplay of prosody and language, when vocal attributes serve the sociopragmatic goals of the speaker or reveal (...) interpersonal information that listeners use to construct a mental representation of what is being communicated. Our comment serves as a beacon to researchers interested in how the neurocognitive system “makes sense” of socioemotive aspects of prosody. (shrink)

Event-related potential components are sensitive to the processes underlying how questions are understood. We use so-called “covert” wh-questions in Mandarin to probe how such components generalize across different kinds of constructions. This study shows that covert Mandarin wh-questions do not elicit anterior negativities associated with memory maintenance, even when such a dependency is unambiguously cued. N = 37 native speakers of Mandarin Chinese read Chinese questions and declarative sentences word-by-word during EEG recording. In contrast to prior studies, no sustained anterior (...) negativity was observed between the cue word, such as the question-embedding verb “wonder,” and the in-situ wh-filler. SANs have been linked with working memory maintenance, suggesting that grammatical features may not impose the same maintenance demands as the content words used in prior work. (shrink)