Learning a Generative Probabilistic Grammar of Experience: A Process‐Level Model of Language Acquisition

Cognitive Science 38 (4):227-267 (2014)

Shimon Edelman
Cornell University
We introduce a set of biologically and computationally motivated design choices for modeling the learning of language, or of other types of sequential, hierarchically structured experience and behavior, and describe an implemented system that conforms to these choices and is capable of unsupervised learning from raw natural-language corpora. Given a stream of linguistic input, our model incrementally learns a grammar that captures its statistical patterns, which can then be used to parse or generate new data. The grammar constructed in this manner takes the form of a directed weighted graph, whose nodes are recursively (hierarchically) defined patterns over the elements of the input stream. We evaluated the model in seventeen experiments, grouped into five studies, which examined, respectively, (a) the generative ability of grammar learned from a corpus of natural language, (b) the characteristics of the learned representation, (c) sequence segmentation and chunking, (d) artificial grammar learning, and (e) certain types of structure dependence. The model's performance largely vindicates our design choices, suggesting that progress in modeling language acquisition can be made on a broad front—ranging from issues of generativity to the replication of human experimental findings—by bringing biological and computational considerations, as well as lessons from prior efforts, to bear on the modeling approach.
Keywords Language learning  Generative grammar  Incremental learning  Statistical learning  Graph‐based representation  Grammar of behavior  Linguistic experience  Learning
Categories (categorize this paper)
DOI 10.1111/cogs.12140
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

Our Archive

Upload a copy of this paper     Check publisher's policy     Papers currently archived: 43,728
Through your library

References found in this work BETA

Rules and Representations.Noam A. Chomsky - 1980 - Behavioral and Brain Sciences 3 (127):1-61.
Finding Structure in Time.Jeffrey L. Elman - 1990 - Cognitive Science 14 (2):179-211.

View all 30 references / Add more references

Citations of this work BETA

Grammatical Constructions as Relational Categories.B. Goldwater Micah - 2017 - Topics in Cognitive Science 9 (3):776-799.

Add more citations

Similar books and articles

Grammar as a Developmental Phenomenon.Guy Dove - 2012 - Biology and Philosophy 27 (5):615-637.
Weighted Constraints in Generative Linguistics.Joe Pater - 2009 - Cognitive Science 33 (6):999-1035.


Added to PP index

Total views
81 ( #100,353 of 2,264,683 )

Recent downloads (6 months)
22 ( #35,819 of 2,264,683 )

How can I increase my downloads?


My notes

Sign in to use this feature