Philosophy and Technology 34 (1):149-214 (2021)

The present paper intends to draw the conception of language implied in the technique of word embeddings that supported the recent development of deep neural network models in computational linguistics. After a preliminary presentation of the basic functioning of elementary artificial neural networks, we introduce the motivations and capabilities of word embeddings through one of its pioneering models, word2vec. To assess the remarkable results of the latter, we inspect the nature of its underlying mechanisms, which have been characterized as the implicit factorization of a word-context matrix. We then discuss the ordinary association of the “distributional hypothesis” with a “use theory of meaning,” often justifying the theoretical basis of word embeddings, and contrast them to the theory of meaning stemming from those mechanisms through the lens of matrix models. Finally, we trace back the principles of their possible consistency through Harris’s original distributionalism up to the structuralist conception of language of Saussure and Hjelmslev. Other than giving access to the technical literature and state of the art in the field of natural language processing to non-specialist readers, the paper seeks to reveal the conceptual and philosophical stakes involved in the recent application of new neural network techniques to the computational treatment of language.
Keywords No keywords specified (fix it)
Categories (categorize this paper)
DOI 10.1007/s13347-020-00393-9
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

PhilArchive copy

Upload a copy of this paper     Check publisher's policy     Papers currently archived: 62,388
External links

Setup an account with your affiliations in order to access resources via your University's proxy server
Configure custom proxy (use this if your affiliation does not provide a proxy)
Through your library

References found in this work BETA

Finding Structure in Time.Jeffrey L. Elman - 1990 - Cognitive Science 14 (2):179-211.
{Finding Structure in Time}.J. Elman - 1993 - {Cognitive Science} 48:71-99.
Function and Concept.Gottlob Frege - 1997 - In D. H. Mellor & Alex Oliver (eds.), Properties. Oxford University Press. pp. 130-149.

View all 13 references / Add more references

Citations of this work BETA

No citations found.

Add more citations

Similar books and articles

Chomskyan Theory of Language: A Phenomenological Re-Evaluation.Shiva Rahman - 2019 - Journal of the Indian Council of Philosophical Research 36 (2):281-294.
Natural Language Semantics and Computability.Richard Moot & Christian Retoré - 2019 - Journal of Logic, Language and Information 28 (2):287-307.
Meaning and Linguistic Sound: Why Are Sounds Imposed on Our Minds?Abolfazl Sabramiz - 2013 - Dialogue: Journal of Phi Sigma Tau 56 (1):14-23.
The Language of Word Meaning.Pierrette Bouillon & Federica Busa (eds.) - 2001 - Cambridge University Press.


Added to PP index

Total views
21 ( #512,018 of 2,445,477 )

Recent downloads (6 months)
15 ( #46,908 of 2,445,477 )

How can I increase my downloads?


My notes