Cognitive Science 42 (S4):940-973 (2018)

Abstract
Speakers’ perception of a visual scene influences the language they use to describe it—which objects they choose to mention and how they characterize the relationships between them. We show that visual complexity can either delay or facilitate description generation, depending on how much disambiguating information is required and how useful the scene's complexity can be in providing, for example, helpful landmarks. To do so, we measure speech onset times, eye gaze, and utterance content in a reference production experiment in which the target object is either unique or non-unique in a visual scene of varying size and complexity. Speakers delay speech onset if the target object is non-unique and requires disambiguation, and we argue that this reflects the cost of deciding on a high-level strategy for describing it. The eye-tracking data demonstrate that these delays increase when speakers are able to conduct an extensive early visual search, implying that when speakers scan too little of the scene early on, they may decide to begin speaking before becoming aware that their description is underspecified. Speakers’ content choices reflect the visual makeup of the scene—the number of distractors present and the availability of useful landmarks. Our results highlight the complex role of visual perception in reference production, showing that speakers can make good use of complexity in ways that reflect their visual processing of the scene.
Keywords Psycholinguistics  Referring expression generation  Sentence processing  Visual search
Categories No categories specified
(categorize this paper)
Reprint years 2017, 2018
DOI 10.1111/cogs.12507
Options
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

PhilArchive copy


Upload a copy of this paper     Check publisher's policy     Papers currently archived: 63,263
Through your library

References found in this work BETA

Visual Search: The Role of Memory for Rejected Distractors.Todd S. Horowitz & J. M. Wolfe - 2005 - In Laurent Itti, Geraint Rees & John K. Tsotsos (eds.), Neurobiology of Attention. Academic Press. pp. 264.

View all 16 references / Add more references

Citations of this work BETA

Add more citations

Similar books and articles

Analytics

Added to PP index
2017-06-26

Total views
22 ( #492,623 of 2,448,509 )

Recent downloads (6 months)
1 ( #449,843 of 2,448,509 )

How can I increase my downloads?

Downloads

My notes