In language learning, learners engage with their environment, incorporating cues from different sources. However, in lab‐based experiments, using artificial languages, many of the cues and features that are part of real‐world language learning are stripped away. In three experiments, we investigated the role of positive, negative, and mixed feedback on the gradual learning of language‐like statistical regularities within an active guessing game paradigm. In Experiment 1, participants received deterministic feedback (100%), whereas probabilistic feedback (i.e., 75% or 50%) was introduced in (...) Experiment 2. Finally, Experiment 3 explored the impact of mixed probabilistic feedback (33% positive, 33% negative, 33% no feedback). The results showed that cross‐situational learning of words was observed without feedback, but participants were able to learn structural regularities of the miniature language only when feedback was provided. Interestingly, the presence of positive feedback was particularly helpful for the learner, promoting more in‐depth learning of the artificial language. (shrink)

The uncertainty associated with paradigmatic families has been shown to correlate with their phonetic characteristics in speech, suggesting that representations of complex sublexical relations between words are part of speaker knowledge. To better understand this, recent studies have used two-layer neural network models to examine the way paradigmatic uncertainty emerges in learning. However, to date this work has largely ignored the way choices about the representation of inflectional and grammatical functions in models strongly influence what they subsequently learn. To explore (...) the consequences of this, we investigate how representations of IFS in the input-output structures of learning models affect the capacity of uncertainty estimates derived from them to account for phonetic variability in speech. Specifically, we examine whether IFS are best represented as outputs to neural networks or as inputs by building models that embody both choices and examining their capacity to account for uncertainty effects in the formant trajectories of word final [ɐ], which in German discriminates around sixty different IFS. Overall, we find that formants are enhanced as the uncertainty associated with IFS decreases. This result dovetails with a growing number of studies of morphological and inflectional families that have shown that enhancement is associated with lower uncertainty in context. Importantly, we also find that in models where IFS serve as inputs—as our theoretical analysis suggests they ought to—its uncertainty measures provide better fits to the empirical variance observed in [ɐ] formants than models where IFS serve as outputs. This supports our suggestion that IFS serve as cognitive cues during speech production, and should be treated as such in modeling. It is also consistent with the idea that when IFS serve as inputs to a learning network. This maintains the distinction between those parts of the network that represent message and those that represent signal. We conclude by describing how maintaining a “signal-message-uncertainty distinction” can allow us to reconcile a range of apparently contradictory findings about the relationship between articulation and uncertainty in context. (shrink)

Sequence learning is fundamental to a wide range of cognitive functions. Explaining how sequences—and the relations between the elements they comprise—are learned is a fundamental challenge to cognitive science. However, although hundreds of articles addressing this question are published each year, the actual learning mechanisms involved in the learning of sequences are rarely investigated. We present three experiments that seek to examine these mechanisms during a typing task. Experiments 1 and 2 tested learning during typing single letters on each trial. (...) Experiment 3 tested for “chunking” of these letters into “words.” The results of these experiments were used to examine the mechanisms that could best account for them, with a focus on two particular proposals: statistical transitional probability learning and discriminative error-driven learning. Experiments 1 and 2 showed that error-driven learning was a better predictor of response latencies than either n-gram frequencies or transitional probabilities. No evidence for chunking was found in Experiment 3, probably due to interspersing visual cues with the motor response. In addition, learning occurred across a greater distance in Experiment 1 than Experiment 2, suggesting that the greater predictability that comes with increased structure leads to greater learnability. These results shed new light on the mechanism responsible for sequence learning. Despite the widely held assumption that transitional probability learning is essential to this process, the present results suggest instead that the sequences are learned through a process of discriminative learning, involving prediction and feedback from prediction error. (shrink)

It is a reasonable assumption that universal properties of natural languages are not accidental. They occur either because they are underwritten by genetic code, because they assist in language processing or language learning, or due to some combination of the two. In this paper we investigate one such language universal: the suffixing preference across the world’s languages, whereby inflections tend to be added to the end of words. A corpus analysis of child‐directed speech in English found that suffixes were more (...) accurate at cuing the grammatical category of the root word than were prefixes. An artificial language experiment found that there was a learning advantage for suffixes over prefixes in terms of grammatical categorization within an artificial language. The results are consistent with an account of language universals that originate in general purpose learning mechanisms. (shrink)

Name der Zeitschrift: Cognitive Linguistics Jahrgang: 27 Heft: 4 Seiten: 507-526.

Over the past 10 years, Cognitive Linguistics has taken a quantitative turn. Yet, concerns have been raised that this preoccupation with quantification and modelling may not bring us any closer to understanding how language works. We show that this objection is unfounded, especially if we rely on modelling techniques based on biologically and psychologically plausible learning algorithms. These make it possible to take a quantitative approach, while generating and testing specific hypotheses that will advance our understanding of how knowledge of (...) language emerges from exposure to usage. (shrink)

Symbols enable people to organize and communicate about the world. However, the ways in which symbolic knowledge is learned and then represented in the mind are poorly understood. We present a formal analysis of symbolic learning—in particular, word learning—in terms of prediction and cue competition, and we consider two possible ways in which symbols might be learned: by learning to predict a label from the features of objects and events in the world, and by learning to predict features from a (...) label. This analysis predicts significant differences in symbolic learning depending on the sequencing of objects and labels. We report a computational simulation and two human experiments that confirm these differences, revealing the existence of Feature-Label-Ordering effects in learning. Discrimination learning is facilitated when objects predict labels, but not when labels predict objects. Our results and analysis suggest that the semantic categories people use to understand and communicate about the world can only be learned if labels are predicted from objects. We discuss the implications of this for our understanding of the nature of language and symbolic thought, and in particular, for theories of reference. (shrink)

Children with developmental language disorder (DLD) have significant deficits in language ability that cannot be attributed to neurological damage, hearing impairment, or intellectual disability. The symptoms displayed by children with DLD differ across languages. In English, DLD is often marked by severe difficulties acquiring verb inflection. Such difficulties are less apparent in languages with rich verb morphology like Spanish and Italian. Here we show how these differential profiles can be understood in terms of an interaction between properties of the input (...) language, and the child's ability to learn predictive relations between linguistic elements that are separated within a sentence. We apply a simple associative learning model to sequential English and Spanish stimuli and show how the model's ability to associate cues occurring earlier in time with later outcomes affects the acquisition of verb inflection in English more than in Spanish. We relate this to the high frequency of the English bare form (which acts as a default) and the English process of question formation, which means that (unlike in Spanish) bare forms frequently occur in third‐person singular contexts. Finally, we hypothesize that the pro‐drop nature of Spanish makes it easier to associate person and number cues with the verb inflection than in English. Since the factors that conspire to make English verb inflection particularly challenging for learners with weak sequential learning abilities are much reduced or absent in Spanish, this provides an explanation for why learning Spanish verb inflection is relatively unaffected in children with DLD. (shrink)

Intuitively, the accuracy of initial word-referent mappings should be positively correlated with the outcome of learning. Yet recent evidence suggests an inverse effect of initial accuracy in adults, whereby greater accuracy of initial mappings is associated with poorer outcomes in a cross-situational learning task. Here, we examine the impact of initial accuracy on 4-year-olds, 10-year-olds, and adults. For half of the participants most word-referent mappings were initially correct and for the other half most mappings were initially incorrect. Initial accuracy was (...) positively related to learning outcomes in 4-year-olds, had no effect on 10-year-olds' learning, and was inversely related to learning outcomes in adults. Examination of item learning patterns revealed item interdependence for adults and 4-year-olds but not 10-year-olds. These findings point to a qualitative change in language learning processes over development. (shrink)

We examined how language supports the expression of temporality within sentence boundaries in English, which has a rich inventory of grammatical means to express temporality. Using a computational model that mimics how humans learn from exposure we explored what the use of different tense and aspect combinations reveals about the interaction between our experience of time and the cognitive demands that talking about time puts on the language user. Our model was trained on n-grams extracted from the BNC to select (...) the TA combination that fits the context best. It revealed the existence of two different sub-systems within the set of TA combinations, a “simplex” one that is supported lexically and is easy to learn, and a “complex” one that is supported contextually and is hard to learn. The finding that some TA combinations are essentially lexical in nature necessitates a rethink of tense and aspect as grammatical categories that form the axes of the temporal system. We argue that the system of temporal reference may be more fruitfully thought of as the result of learning a system that is steeped in experience and organised along a number of functional principles. (shrink)

A number of studies report that frequency is a poor predictor of acceptability, in particular at the lower end of the frequency spectrum. Because acceptability judgments provide a substantial part of the empirical foundation of dominant linguistic traditions, understanding how acceptability relates to frequency, one of the most robust predictors of human performance, is crucial. The relation between low frequency and acceptability is investigated using corpus‐ and behavioral data on the distribution of infinitival and finite that‐complements in Polish. Polish verbs (...) exhibit substantial subordination variation and for the majority of verbs taking an infinitival complement, the that‐complement occurs with low frequency (<0.66 ipm). These low‐frequency that‐clauses, in turn, exhibit large differences in how acceptable they are to native speakers. It is argued that acceptability judgments are based on configurations of internally structured exemplars, the acceptability of which cannot reliably be assessed until sufficient evidence about the core component has accumulated. (shrink)

Cognitive control refers to the regulation of mental activity to support flexible cognition across different domains. Cragg and Nation (2010) propose that the development of cognitive control in children parallels the development of language abilities, particularly inner speech. We suggest that children’s late development of cognitive control also mirrors their limited ability to revise misinterpretations of sentence meaning. Moreover, we argue that for certain tasks, a tradeoff between bottom-up (data-driven) and top-down (rule-based) thinking may actually benefit performance in both children (...) and adults. Specifically, we propose that a lack of cognitive control may promote important aspects of cognitive development, like language acquisition and creativity. (shrink)

The aim of this study was to test the claim that languages universally employ morphosyntactic marking to differentiate events of more‐ versus less‐direct causation, preferring to mark them with less‐ and more‐ overt marking, respectively (e.g., Somebody broke the window vs. Somebody MADE the window break; *Somebody cried the boy vs. Somebody MADE the boy cry). To this end, we investigated whether a recent computational model which learns to predict speakers’ by‐verb relative preference for the two causatives in English, Hebrew, (...) Hindi, Japanese, and K'iche’ Mayan is able to generalize to a sixth language on which it has never been trained: Balinese. Judgments of the relative acceptability of the less‐ and more‐transparent causative forms of 60 verbs were collected from 48 native‐speaking Balinese adults. The composite crosslinguistic computational model was able to predict these judgments, not only for verbs that it had seen, but also––in a split‐half validation test––to verbs that it had never seen in any language. A “random‐semantics” model showed only a relatively small decrement in performance with seen verbs, whose behavior can be learned on a verb‐by‐verb basis, but achieved zero correlation with human judgments when generalizing to unseen verbs. Together, these findings suggest that Balinese conceptualizes directness of causation in a similar way to these unrelated languages, and therefore constitute support for the view that the distinction between more‐ versus less‐distinct causation constitutes a morphosyntactic universal. (shrink)

A paradox at the heart of language acquisition research is that, to achieve adult-like competence, children must acquire the ability to generalize verbs into non-attested structures, while avoiding utterances that are deemed ungrammatical by native speakers. For example, children must learn that, to denote the reversal of an action, un- can be added to many verbs, but not all (e.g., roll/unroll; close/*unclose). This study compared theoretical accounts of how this is done. Children aged 5–6 (N = 18), 9–10 (N = (...) 18), and adults (N = 18) rated the acceptability of un- prefixed forms of 48 verbs (and, as a control, bare forms). Across verbs, a negative correlation was observed between the acceptability of ungrammatical un- prefixed forms (e.g., *unclose) and the frequency of (a) the bare form and (b) alternative forms (e.g., open), supporting the entrenchment and pre-emption hypotheses, respectively. Independent ratings of the extent to which verbs instantiate the semantic properties characteristic of a hypothesized semantic cryptotype for un- prefixation were a significant positive predictor of acceptability, for all age groups. The relative importance of each factor differed for attested and unattested un- forms and also varied with age. The findings are interpreted in the context of a new hybrid account designed to incorporate the three factors of entrenchment, pre-emption, and verb semantics. (shrink)

A central tenet of cognitive linguistics is that adults’ knowledge of language consists of a structured inventory of constructions, including various two-argument constructions such as the active, the passive and “fronting” constructions. But how do speakers choose which construction to use for a particular utterance, given constraints such as discourse/information structure and the semantic fit between verb and construction? The goal of the present study was to build a computational model of this phenomenon for two-argument constructions in Mandarin. First, we (...) conducted a grammaticality judgment study with 60 native speakers which demonstrated that, across 57 verbs, semantic affectedness – as determined by further 16 native speakers – predicted each verb’s relative acceptability in the bei-passive and ba-active constructions, but not the Notional Passive and SVO Active constructions. Second, in order to simulate acquisition of these competing constraints, we built a computational model that learns to map from corpus-derived input to an output representation corresponding to these four constructions. The model was able to predict judgments of the relative acceptability of the test verbs in the ba-active and bei-passive constructions obtained in Study 1, with model-human correlations in the region of r = 0.5 and r = 0.3, respectively. Surprisingly, these correlations increased when lexical verb identity was removed; perhaps because this information leads to over-fitting of the training set. These findings suggest the intriguing possibility that acquiring constructions involves forgetting as a mechanism for abstracting across certain fine-grained lexical details and idiosyncrasies. (shrink)

This chapter presents a new semantics for inductive empirical knowledge. The epistemic agent is represented concretely as a learner who processes new inputs through time and who forms new beliefs from those inputs by means of a concrete, computable learning program. The agent’s belief state is represented hyper-intensionally as a set of time-indexed sentences. Knowledge is interpreted as avoidance of error in the limit and as having converged to true belief from the present time onward. Familiar topics are re-examined within (...) the semantics, such as inductive skepticism, the logic of discovery, Duhem’s problem, the articulation of theories by auxiliary hypotheses, the role of serendipity in scientific knowledge, Fitch’s paradox, deductive closure of knowability, whether one can know inductively that one knows inductively, whether one can know inductively that one does not know inductively, and whether expert instruction can spread common inductive knowledge—as opposed to mere, true belief—through a community of gullible pupils. (shrink)