Impulse Processing: A Dynamical Systems Model of Incremental Eye Movements in the Visual World Paradigm
Cognitive Science 35 (6):1009-1051 (2011)
The Visual World Paradigm (VWP) presents listeners with a challenging problem: They must integrate two disparate signals, the spoken language and the visual context, in support of action (e.g., complex movements of the eyes across a scene). We present Impulse Processing, a dynamical systems approach to incremental eye movements in the visual world that suggests a framework for integrating language, vision, and action generally. Our approach assumes that impulses driven by the language and the visual context impinge minutely on a dynamical landscape of attractors corresponding to the potential eye-movement behaviors of the system. We test three unique predictions of our approach in an empirical study in the VWP, and describe an implementation in an artificial neural network. We discuss the Impulse Processing framework in relation to other models of the VWP
|Keywords||Embodied cognition Artificial neural networks Visual World Paradigm Connectionist modeling Dynamical systems Ambiguity resolution Eye tracking Sentence processing Local coherence Self‐organization|
|Categories||categorize this paper)|
References found in this work BETA
Perceptual Symbol Systems.Lawrence W. Barsalou - 1999 - Behavioral and Brain Sciences 22 (4):577-660.
On the Proper Treatment of Connectionism.Paul Smolensky - 1988 - Behavioral and Brain Sciences 11 (1):1-23.
Grounding Conceptual Knowledge in Modality-Specific Systems.Lawrence W. Barsalou, W. Kyle Simmons, Aron K. Barbey & Christine D. Wilson - 2003 - Trends in Cognitive Sciences 7 (2):84-91.
Citations of this work BETA
Interaction Between Phonological and Semantic Representations: Time Matters.Qi Chen & Daniel Mirman - 2015 - Cognitive Science 39 (3):538-558.
Fractal Analysis Illuminates the Form of Connectionist Structural Gradualness.Whitney Tabor, Pyeong Whan Cho & Emily Szkudlarek - 2013 - Topics in Cognitive Science 5 (3):634-667.
Similar books and articles
Problems with a “Cortical Screen” for Visual Imagery.David Ingle - 2002 - Behavioral and Brain Sciences 25 (2):195-196.
The E-Z Reader Model of Eye-Movement Control in Reading: Comparisons to Other Models.Erik D. Reichle, Keith Rayner & Alexander Pollatsek - 2003 - Behavioral and Brain Sciences 26 (4):445-476.
Looking and Acting: Vision and Eye Movements in Natural Behaviour.Michael Land & Benjamin Tatler - 2009 - Oxford University Press.
Visual Word Recognition and Oculomotor Control in Reading.Lynn Huestegge, Jonathan Grainger & Ralph Radach - 2003 - Behavioral and Brain Sciences 26 (4):487-488.
Eye Movements in Reading: Models and Data.Keith Rayner, Alexander Pollatsek & Erik D. Reichle - 2003 - Behavioral and Brain Sciences 26 (4):507-518.
Evolutionary and Intellectual Antecedents of Primate Visual Processing Streams.Colin G. Ellard - 2001 - Behavioral and Brain Sciences 25 (1):104-105.
E-Z Reader 7 Provides a Platform for Explaining How Low- and High-Level Linguistic Processes Influence Eye Movements.Gary E. Raney - 2003 - Behavioral and Brain Sciences 26 (4):498-499.
Visual Awareness and the on-Line Modification of Action.Jillian H. Fecteau, Romeo Chua, Ian Franks & James T. Enns - 2001 - Canadian Journal of Experimental Psychology 55 (2):104-110.
Are Dynamical Systems the Answer?Arthur B. Markman - 2001 - Behavioral and Brain Sciences 24 (1):50-51.
Failure to Detect Displacements of the Visual World During Saccadic Eye Movements.Bruce Bridgeman, David Hendry & L. Stark - 1975 - Vision Research 15:719-22.
The Role of Awareness in the Error-Processing of Involuntary Eye Movements.Artem V. Belopolsky - manuscript
Eye-Movement Control in Reading: Models and Predictions.Eyal M. Reingold - 2003 - Behavioral and Brain Sciences 26 (4):500-501.
The Education of the Eye: Painting, Landscape, and Architecture in Eighteenth-Century Britain.Peter De Bolla - 2003 - Stanford University Press.
Visual Perception is Not Visual Awareness.Valerie Gray Hardcastle - 2001 - Behavioral and Brain Sciences 24 (5):985-985.
A Sensorimotor Account of Vision and Visual Consciousness.J. Kevin O'Regan & Alva Noë - 2001 - Behavioral and Brain Sciences 24 (5):883-917.
Added to index2011-05-25
Total downloads23 ( #210,412 of 2,146,210 )
Recent downloads (6 months)8 ( #91,524 of 2,146,210 )
How can I increase my downloads?
There are no threads in this forum
Nothing in this forum yet.