The focus of this chapter is the relationship between synaesthesia, attention and eye movements. The measurement of eye movements as a core experimental tool for gaining insight into complex cognitive processes in general and attentional mechanisms more specifically, is now firmly established. By means of eye movements, the neural basis of higher cognitive processes, such as target selection, working memory, and response suppression, can be investigated. It therefore seems logical that eye movement recordings can also be used to investigate a (...) complex phenomenon like synaesthesia. In this chapter, we will start with a section summarizing the relationship between eye movements and attention in general. Then the focus moves to synaesthesia and what we currently know about synaesthesia based on the method of measuring eye movements. Finally, we discuss pupillometry which provides a window on changes in the 'allocation' of attention and the 'consolidation' of perception. Consequently, it offers a useful technique for probing 'changes' in mental states due synaesthetic perceptions. (shrink)

Cognitive Science, Volume 46, Issue 9, September 2022.

Psycholinguistic methods hold great promise for experimental philosophy. Many philosophical thought experiments and arguments proceed from verbal descriptions of possible cases. Many relevant intuitions and conclusions are driven by spontaneous inferences about what else must also be true in the cases described. Such inferences are continually made in language comprehension and production. This chapter explains how methods from psycholinguistics can be employed to study such routine automatic inferences, with a view to assessing intuitions and reconstructing arguments. We demonstrate how plausibility (...) ratings, pupillometry, and reading time measurements can be used to examine hypotheses about automatic inferences in speech and text comprehension. Two experiments on inferences from polysemous (perception-)verbs provide evidence of a potentially consequential ‘salience bias’. Findings help assess intuitions about unusual cases and analyse a philosophical paradox (‘argument from hallucination’). The paper thus illustrates how we can adapt psycholinguistic methods for philosophical purposes and demonstrates the methods’ philosophical usefulness. (shrink)

Many philosophical thought experiments and arguments involve unusual cases. We present empirical reasons to doubt the reliability of intuitive judgments and conclusions about such cases. Inferences and intuitions prompted by verbal case descriptions are influenced by routine comprehension processes which invoke stereotypes. We build on psycholinguistic findings to determine conditions under which the stereotype associated with the most salient sense of a word predictably supports inappropriate inferences from descriptions of unusual (stereotype-divergent) cases. We conduct an experiment that combines plausibility ratings (...) with pupillometry to document this “salience bias.” We find that under certain conditions, competent speakers automatically make stereotypical inferences they know to be inappropriate. (shrink)

There is considerable evidence that listeners’ understanding of a spoken sentence need not always follow from a full analysis of the words and syntax of the utterance. Rather, listeners may instead conduct a superficial analysis, sampling some words and using presumed plausibility to arrive at an understanding of the sentence meaning. Because this latter strategy occurs more often for sentences with complex syntax that place a heavier processing burden on the listener than sentences with simpler syntax, shallow processing may represent (...) a resource conserving strategy reflected in reduced processing effort. This factor may be even more important for older adults who as a group are known to have more limited working memory resources. In the present experiment, 40 older adults and 20 younger adults were tested for comprehension of plausible and implausible sentences with a simpler subject-relative embedded clause structure or a more complex object-relative embedded clause structure. Dilation of the pupil of the eye was recorded as an index of processing effort. Results confirmed greater comprehension accuracy for plausible than implausible sentences, and for sentences with simpler than more complex syntax, with both effects amplified for the older adults. Analysis of peak pupil dilations for implausible sentences revealed a complex three-way interaction between age, syntactic complexity, and plausibility. Results are discussed in terms of models of sentence comprehension, and pupillometry as an index of intentional task engagement. (shrink)

Changes in pupil size can reflect social interest or affect, and tend to get mimicked by observers during eye contact. Pupil mimicry has recently been observed in young infants, whereas it is unkno...

Earlier studies have shown that musically trained individuals may have a benefit in adverse listening situations when compared to non-musicians, especially in speech-on-speech perception. However, the literature provides mostly conflicting results. In the current study, by employing different measures of spoken language processing, we aimed to test whether we could capture potential differences between musicians and non-musicians in speech-on-speech processing. We used an offline measure of speech perception, which reveals a post-task response, and online measures of real time spoken language (...) processing: gaze-tracking and pupillometry. We used stimuli of comparable complexity across both paradigms and tested the same groups of participants. In the sentence recall task, musicians recalled more words correctly than non-musicians. In the eye-tracking experiment, both groups showed reduced fixations to the target and competitor words’ images as the level of speech maskers increased. The time course of gaze fixations to the competitor did not differ between groups in the speech-in-quiet condition, while the time course dynamics did differ between groups as the two-talker masker was added to the target signal. As the level of two-talker masker increased, musicians showed reduced lexical competition as indicated by the gaze fixations to the competitor. The pupil dilation data showed differences mainly in one target-to-masker ratio. This does not allow to draw conclusions regarding potential differences in the use of cognitive resources between groups. Overall, the eye-tracking measure enabled us to observe that musicians may be using a different strategy than non-musicians to attain spoken word recognition as the noise level increased. However, further investigation with more fine-grained alignment between the processes captured by online and offline measures is necessary to establish whether musicians differ due to better cognitive control or sound processing. (shrink)

As driving functions become increasingly automated, motorists run the risk of becoming cognitively removed from the driving process. Psychophysiological measures may provide added value not captured through behavioral or self-report measures alone. This paper provides a selective review of the psychophysiological measures that can be utilized to assess cognitive states in real-world driving environments. First, the importance of psychophysiological measures within the context of traffic safety is discussed. Next, the most commonly used physiology-based indices of cognitive states are considered as (...) potential candidates relevant for driving research. These include: electroencephalography and event-related potentials, optical imaging, heart rate and heart rate variability, blood pressure, skin conductance, electromyography, thermal imaging, and pupillometry. For each of these measures, an overview is provided, followed by a discussion of the methods for measuring it in a driving context. Drawing from recent empirical driving and psychophysiology research, the relative strengths and limitations of each measure are discussed to highlight each measures’ unique value. Challenges and recommendations for valid and reliable quantification from lab to (less predictable) real-world driving settings are considered. Finally, we discuss measures that may be better candidates for a near real-time assessment of motorists’ cognitive states that can be utilized in applied settings outside the lab. This review synthesizes the literature on in-vehicle psychophysiological measures to advance the development of effective human-machine driving interfaces and driver support systems. (shrink)

Eye behavior is increasingly used as an indicator of internal versus external focus of attention both in research and application. However, available findings are partly inconsistent, which might be attributed to the different nature of the employed types of internal and external cognition tasks. The present study, therefore, investigated how consistently different eye parameters respond to internal versus external attentional focus across three task modalities: numerical, verbal, and visuo‐spatial. Three eye parameters robustly differentiated between internal and external attentional focus across (...) all tasks. Blinks, pupil diameter variance, and fixation disparity variance were consistently increased during internally directed attention. We also observed substantial attentional focus effects on other parameters (pupil diameter, fixation disparity, saccades, and microsaccades), but they were moderated by task type. Single‐trial analysis of our data using machine learning techniques further confirmed our results: Classifying the focus of attention by means of eye tracking works well across participants, but generalizing across tasks proves to be challenging. Based on the effects of task type on eye parameters, we discuss what eye parameters are best suited as indicators of internal versus external attentional focus in different settings. (shrink)

The current paper investigates the value and application of a range of physiological and neuroscientific techniques in applied marketing research and consumer science, highlighting new insights from research in social psychology and neuroscience. We review measures of sweat secretion, heart rate, facial muscle activity, eye movements, and electrical brain activity, using techniques including skin conductance, pupillometry, eyetracking and magnetic brain imaging. For each measure, after a brief explanation of the underlying technique, we illustrate concepts and mechanisms that the measure (...) allows researchers in marketing and consumer science to investigate, with a focus on consumer attitudes and behavior. By providing reviews on recent research that applied these methods in consumer science and relevant related fields, we also highlight methodological and theoretical strengths and limitations, with an emphasis on ecological validity. We argue that the inclusion of physiological and neuroscientific techniques can advance consumer research by providing insights into the often unconscious mechanisms underlying consumer behavior. Therefore, such technologies can help researchers and marketing practitioners understand the mechanisms of consumer behavior and improve predictions of consumer behavior. (shrink)

Pupillary responses and associated vergence eye movements were monitored during imagery of objects of differing sizes (“large” or “small”) from varying distances (“near” or “far”). Objects’ imagined size and distance affected oculomotor behavior. Objects visualized as “far” resulted in the larger pupil dilations and smaller visual angle, while small objects imagined “near” were associated with smaller pupils in contrast to relatively larger pupils when imagined as “far” away. Furthermore, near objects resulted in larger visual angle, and particularly, vergence adjustments were (...) observed that were dependent on imagined size and distance of the small objects. The findings are consistent with the idea that imagery emulates perception, also at the embodied level of oculomotor behaviors. (shrink)

Asking students to generate a prediction before presenting the correct answer is a popular instructional strategy. This study tested whether a person’s degree of confidence in a prediction is related to their curiosity and surprise regarding the answer. For a series of questions about numerical facts, participants (N = 29) generated predictions and rated their confidence in the prediction before seeing the correct answer. The increase in pupil size before viewing the correct answer was used as a physiological marker of (...) curiosity, and the increase in pupil size after viewing the correct answer was used as a physiological marker of surprise. The results revealed that the pupillometric marker of curiosity was most pronounced if students were slightly more confident in their prediction than usual, and it was lower for predictions made with either very high or very low confidence. Furthermore, the results showed that high-confidence prediction errors and low-confidence correct responses yielded a pupillary surprise response, suggesting that highly unexpected results evoke surprise, independent of the correctness of the prediction. Together, results suggest that confidence in a prediction plays an important role in the occurrence of epistemic emotions such as curiosity and surprise. (shrink)

Grammatical categories represent implicit knowledge, and it is not known if such abstract linguistic knowledge can be continuously grounded in real-life experiences, nor is it known what types of mental states can be simulated. A former study showed that attention bias in peripersonal space affects reaction times in grammatical congruency judgments of nominal classifiers, suggesting that simulated semantics may include reenactment of attention. In this study, we contrasted a Chinese nominal classifier used with nouns denoting pinch grip objects with a (...) classifier for nouns with big object referents in a pupil dilation experiment. Twenty Chinese native speakers read grammatical and ungrammatical classifier-noun combinations and made grammaticality judgment while their pupillary responses were measured. It was found that their pupils dilated significantly more to the pinch grip classifier than to the big object classifier, indicating attention simulation in PPS. Pupil dilations were also significantly larger with congruent trials on the whole than in incongruent trials, but crucially, congruency and classifier semantics were independent of each other. No such effects were found in controls. (shrink)

We investigated how two cues to contrast—beat gesture and contrastive pitch accenting—affect comprehenders' cognitive load during processing of spoken referring expressions. In two visual‐world experiments, we orthogonally manipulated the presence of these cues and their felicity, or fit, with the local (sentence‐level) referential context in critical referring expressions while comprehenders' task‐evoked pupillary responses (TEPRs) were examined. In Experiment 1, beat gesture and contrastive accenting always matched the referential context of filler referring expressions and were therefore relatively felicitous on the global (...) (experiment) level, whereas in Experiment 2, beat gesture and contrastive accenting never fit the referential context of filler referring expressions and were therefore infelicitous on the global level. The results revealed that both beat gesture and contrastive accenting increased comprehenders' cognitive load. For beat gesture, this increase in cognitive load was driven by both local and global infelicity. For contrastive accenting, this increase in cognitive load was unaffected when cues were globally felicitous but exacerbated when cues were globally infelicitous. Together, these results suggest that comprehenders' cognitive resources are taxed by processing infelicitous use of beat gesture and contrastive accenting to convey contrast on both the local and global levels. (shrink)