Impulse Processing: A Dynamical Systems Model of Incremental Eye Movements in the Visual World Paradigm

Cognitive Science 35 (6):1009-1051 (2011)
Abstract
The Visual World Paradigm (VWP) presents listeners with a challenging problem: They must integrate two disparate signals, the spoken language and the visual context, in support of action (e.g., complex movements of the eyes across a scene). We present Impulse Processing, a dynamical systems approach to incremental eye movements in the visual world that suggests a framework for integrating language, vision, and action generally. Our approach assumes that impulses driven by the language and the visual context impinge minutely on a dynamical landscape of attractors corresponding to the potential eye-movement behaviors of the system. We test three unique predictions of our approach in an empirical study in the VWP, and describe an implementation in an artificial neural network. We discuss the Impulse Processing framework in relation to other models of the VWP
Keywords Embodied cognition  Artificial neural networks  Visual World Paradigm  Connectionist modeling  Dynamical systems  Ambiguity resolution  Eye tracking  Sentence processing  Local coherence  Self‐organization
Categories (categorize this paper)
DOI 10.1111/j.1551-6709.2011.01180.x
Options
 Save to my reading list
Follow the author(s)
My bibliography
Export citation
Find it on Scholar
Edit this record
Mark as duplicate
Revision history
Request removal from index
Download options
Our Archive


Upload a copy of this paper     Check publisher's policy     Papers currently archived: 25,687
Through your library
References found in this work BETA
Perceptual Symbol Systems.Lawrence W. Barsalou - 1999 - Behavioral and Brain Sciences 22 (4):577-660.
On the Proper Treatment of Connectionism.Paul Smolensky - 1988 - Behavioral and Brain Sciences 11 (1):1-23.
Finding Structure in Time.Jeffrey L. Elman - 1990 - Cognitive Science 14 (2):179-211.
Expectation-Based Syntactic Comprehension.Roger Levy - 2008 - Cognition 106 (3):1126-1177.

View all 16 references / Add more references

Citations of this work BETA

Add more citations

Similar books and articles
Problems with a “Cortical Screen” for Visual Imagery.David Ingle - 2002 - Behavioral and Brain Sciences 25 (2):195-196.
Eye Movements in Reading: Models and Data.Keith Rayner, Alexander Pollatsek & Erik D. Reichle - 2003 - Behavioral and Brain Sciences 26 (4):507-518.
Visual Awareness and the on-Line Modification of Action.Jillian H. Fecteau, Romeo Chua, Ian Franks & James T. Enns - 2001 - Canadian Journal of Experimental Psychology 55 (2):104-110.
Are Dynamical Systems the Answer?Arthur B. Markman - 2001 - Behavioral and Brain Sciences 24 (1):50-51.
Eye-Movement Control in Reading: Models and Predictions.Eyal M. Reingold - 2003 - Behavioral and Brain Sciences 26 (4):500-501.
Visual Perception is Not Visual Awareness.Valerie Gray Hardcastle - 2001 - Behavioral and Brain Sciences 24 (5):985-985.
A Sensorimotor Account of Vision and Visual Consciousness.J. Kevin O'Regan & Alva Noë - 2001 - Behavioral and Brain Sciences 24 (5):883-917.

Monthly downloads

Added to index

2011-05-25

Total downloads

23 ( #210,412 of 2,146,210 )

Recent downloads (6 months)

8 ( #91,524 of 2,146,210 )

How can I increase my downloads?

My notes
Sign in to use this feature


Discussion
Order:
There  are no threads in this forum
Nothing in this forum yet.

Other forums