Composition in Distributional Models of Semantics
Cognitive Science 34 (8):1388-1429 (2010)
| Abstract | Vector-based models of word meaning have become increasingly popular in cognitive science. The appeal of these models lies in their ability to represent meaning simply by using distributional information under the assumption that words occurring within similar contexts are semantically similar. Despite their widespread use, vector-based models are typically directed at representing words in isolation, and methods for constructing representations for phrases or sentences have received little attention in the literature. This is in marked contrast to experimental evidence (e.g., in sentential priming) suggesting that semantic similarity is more complex than simply a relation between isolated words. This article proposes a framework for representing the meaning of word combinations in vector space. Central to our approach is vector composition, which we operationalize in terms of additive and multiplicative functions. Under this framework, we introduce a wide range of composition models that we evaluate empirically on a phrase similarity task | |||||||||
| Keywords | No keywords specified (fix it) | |||||||||
| Categories | ||||||||||
| Options |
|
|||||||||
| PhilPapers Archive |
Upload a copy of this paper Check publisher's policy on self-archival Papers currently archived: 5,653 |
| External links |
|
| Through your library | Configure |
Francesco Amigoni & Viola Schiaffonati (2008). A Multiagent Approach to Modelling Complex Phenomena. Foundations of Science 13 (2).
David J. Chalmers (1990). Syntactic Transformations on Distributed Representations. Connection Science 2:53-62.
Timothy P. McNamara (2005). Semantic Priming: Perspectives From Memory and Word Recognition. Psychology Press.
Benjamin Stone, Simon Dennis & Peter J. Kwantes (2011). Comparing Methods for Single Paragraph Similarity Analysis. Topics in Cognitive Science 3 (1):92-122.
Tony A. Plate (1998). Chunks, Bindings, STAR, and Holographic Reduced Representations. Behavioral and Brain Sciences 21 (6):844-845.
David Galles & Judea Pearl (1998). An Axiomatic Characterization of Causal Counterfactuals. Foundations of Science 3 (1):151-182.
Anne Preller & Mehrnoosh Sadrzadeh (2011). Semantic Vector Models and Functional Models for Pregroup Grammars. Journal of Logic, Language and Information 20 (4):419-443.
Brian Riordan & Michael N. Jones (2011). Redundancy in Perceptual and Linguistic Experience: Comparing Feature-Based and Distributional Models of Semantic Representation. Topics in Cognitive Science 3 (2):303-345.
Monthly downloads |
Added to index2010-08-11Total downloads36 ( #32,922 of 548,977 )Recent downloads (6 months)1 ( #63,511 of 548,977 )How can I increase my downloads? |

