Context Matters: Recovering Human Semantic Structure from Machine Learning Analysis of Large‐Scale Text Corpora

Cognitive Science 46 (2):e13085 (2022)
  Copy   BIBTEX

Abstract

Applying machine learning algorithms to automatically infer relationships between concepts from large-scale collections of documents presents a unique opportunity to investigate at scale how human semantic knowledge is organized, how people use it to make fundamental judgments (“How similar are cats and bears?”), and how these judgments depend on the features that describe concepts (e.g., size, furriness). However, efforts to date have exhibited a substantial discrepancy between algorithm predictions and human empirical judgments. Here, we introduce a novel approach to generating embeddings for this purpose motivated by the idea that semantic context plays a critical role in human judgment. We leverage this idea by constraining the topic or domain from which documents used for generating embeddings are drawn (e.g., referring to the natural world vs. transportation apparatus). Specifically, we trained state-of-the-art machine learning algorithms using contextually-constrained text corpora (domain-specific subsets of Wikipedia articles, 50+ million words each) and showed that this procedure greatly improved predictions of empirical similarity judgments and feature ratings of contextually relevant concepts. Furthermore, we describe a novel, computationally tractable method for improving predictions of contextually-unconstrained embedding models based on dimensionality reduction of their internal representation to a small number of contextually relevant semantic features. By improving the correspondence between predictions derived automatically by machine learning methods using vast amounts of data and more limited, but direct empirical measurements of human judgments, our approach may help leverage the availability of online corpora to better understand the structure of human semantic representations and how people make judgments based on those.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 76,479

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Analytics

Added to PP
2022-02-11

Downloads
8 (#989,686)

6 months
1 (#455,463)

Historical graph of downloads
How can I increase my downloads?

Author's Profile

Jonathan Cohen
University of South Carolina

Citations of this work

No citations found.

Add more citations

References found in this work

Features of similarity.Amos Tversky - 1977 - Psychological Review 84 (4):327-352.
An Integrative Theory of Prefrontal Cortex Function.Earl K. Miller & Jonathan D. Cohen - 2001 - Annual Review of Neuroscience 24 (1):167-202.
Principles of categorization [Електронний ресурс]/Eleonora Rosch.E. Rosch - 1978 - In Eleanor Rosch & Barbara Lloyd (eds.), Cognition and Categorization. Lawrence Elbaum Associates.

View all 13 references / Add more references