The ability to process center‐embedded structures has been claimed to represent a core function of the language faculty. Recently, several studies have investigated the learning of center‐embedded dependencies in artificial grammar settings. Yet some of the results seem to question the learnability of these structures in artificial grammar tasks. Here, we tested under which exposure conditions learning of center‐embedded structures in an artificial grammar is possible. We used naturally spoken syllable sequences and varied the presence of prosodic cues. (...) The results suggest that mere distributional information does not suffice for successful learning. Prosodic cues marking the boundaries of the major relevant units, however, can lead to learning success. Thus, our data are consistent with the hypothesis that center‐embedded syntactic structures can be learned in artificial grammar tasks if language‐like acoustic cues are provided. (shrink)

It is sometimes argued that if PDP networks can be trained to make correct judgements of grammaticality we have an existence proof that there is enough information in the stimulus to permit learning grammar by inductive means alone. This seems inconsistent superficially with Gold's theorem and at a deeper level with the fact that networks are designed on the basis of assumptions about the domain of the function to be learned. To clarify the issue I consider what we should learn (...) from Gold's theorem, then go on to inquire into what it means to say that knowledge is domain specific. I first try sharpening the intuitive notion of domain specific knowledge by reviewing the alleged difference between processing limitations due to shortage of resources vs shortages of knowledge. After rejecting different formulations of this idea, I suggest that a model is language specific if it transparently refer to entities and facts about language as opposed to entities and facts of more general mathematical domains. This is a useful but not necessary condition. I then suggest that a theory is domain specific if it belongs to a model family which is attuned in a law-like way to domain regularities. This leads to a comparison of PDP and parameter setting models of language learning. I conclude with a novel version of the poverty of stimulus argument. (shrink)

It is sometimes argued that if PDP networks can be trained to make correct judgements of grammaticality we have an existence proof that there is enough information in the stimulus to permit learning grammar by inductive means alone. This seems inconsistent superficially with Gold's theorem and at a deeper level with the fact that networks are designed on the basis of assumptions about the domain of the function to be learned. To clarify the issue I consider what we should learn (...) from Gold's theorem, then go on to inquire into what it means to say that knowledge is domain specific. I first try sharpening the intuitive notion of domain specific knowledge by reviewing the alleged difference between processing limitatons due to shartage of resources vs shortages of knowledge. After rejecting different formulations of this idea, I suggest that a model is language specific if it transparently refer to entities and facts about language as opposed to entities and facts of more general mathematical domains. This is a useful but not necessary condition. I then suggest that a theory is domain specific if it belongs to a model family which is attuned in a law-like way to domain regularities. This leads to a comparison of PDP and parameter setting models of language learning. I conclude with a novel version of the poverty of stimulus argument. (shrink)

In his pioneering work in the field of inductive inference, Gold (Inf Control 10:447–474, 1967) proved that a set containing all finite languages and at least one infinite language over the same fixed alphabet is not identifiable in the limit (learnable in the exact sense) from complete texts. Gold’s work paved the way for computational learning theories of language and has implications for two linguistically relevant classes in the Chomsky hierarchy (cf. Chomsky in Inf Control 2:137–167, 1959, Chomsky (...) in Knowledge of language: its nature, origin, and use, Praeger, 1986; Shieber in Linguist Philos 8:333–343, 1985; Heinz in Linguist Inq 41:623–661, 2010). Within that same framework, Angluin (Inf Control 45:117–135, 1980) provided a complete characterization for the learnability of language families. Mathematically, the concept of identification in the limit from that classical setting can be seen as the use of a particular type of metric for learning in the limit (Wharton in Inf Control 26:236–255, 1974). In this research note, I use Niyogi’s extended version of a theorem by Blum and Blum (Inf Control 28:125–155, 1975) on the existence of locking data sets to prove a necessary condition for learnability in the limit of any family of languages with the Gold property in any given metric. This recovers the most general version of Gold’s Theorem as a particular case. Moreover, when the language family is further assumed to contain all finite languages, the same condition also becomes sufficient for learnability in the limit. Finally, we discuss questions that are left open and outline a research program regarding language learnability in the limit from other input types and cognitive feasibility. (shrink)

The papers collected in this volume exemplify some of the trends in current approaches to logic, language and computation. Written by authors with varied academic backgrounds, the contributions are intended for an interdisciplinary audience. The first part of this volume addresses issues relevant for multi-agent systems: reasoning with incomplete information, reasoning about knowledge and beliefs, and reasoning about games. Proofs as formal objects form the subject of Part II. Topics covered include: contributions on logical frameworks, linear logic, and different (...) approaches to formalized reasoning. Part III focuses on representations and formal methods in linguistic theory, addressing the areas of comparative and temporal expressions, modal subordination, and compositionality. (shrink)

This interdisciplinary new work explores one of the central theoretical problems in linguistics: learnability. The authors, from different backgrounds---linguistics, philosophy, computer science, psychology and cognitive science-explore the idea that language acquisition proceeds through general purpose learning mechanisms, an approach that is broadly empiricist both methodologically and psychologically. Written by four researchers in the full range of relevant fields: linguistics, psychology, computer science, and cognitive science, the book sheds light on the central problems of learnability and language, (...) and traces their implications for key questions of theoretical linguistics and the study of language acquisition. (shrink)

Natural language is full of patterns that appear to fit with general linguistic rules but are ungrammatical. There has been much debate over how children acquire these “linguistic restrictions,” and whether innate language knowledge is needed. Recently, it has been shown that restrictions in language can be learned asymptotically via probabilistic inference using the minimum description length (MDL) principle. Here, we extend the MDL approach to give a simple and practical methodology for estimating how much linguistic data (...) are required to learn a particular linguistic restriction. Our method provides a new research tool, allowing arguments about natural language learnability to be made explicit and quantified for the first time. We apply this method to a range of classic puzzles in language acquisition. We find some linguistic rules appear easily statistically learnable from language experience only, whereas others appear to require additional learning mechanisms (e.g., additional cues or innate constraints). (shrink)

This paper explores the link between rules of grammar, grammar formalisms and the architecture of the language faculty. In doing so, it provides a flexible meta-level theory of the language faculty through the postulation of general axioms that govern the interaction of different components of grammar. The idea is simply that such an abstract formulation allows us to view the structure of the language faculty independently of specific theoretical frameworks/formalisms. It turns out that the system of rules, (...) axioms and constraints of grammar cannot beexplicitlyrepresented in a general architecture of the language faculty — which circumvents the ontological mismatch of mental representations and formal/axiomatic properties of language. Rather, the system of rules, axioms, constraints of grammar isintentionallyprojected by humans, and this projection realizes/instantiates what Dascal (1992) calls ‘psychopragmatics’. Relevant implications for linguistic theory, learnability and (computational) models of language processing are also explored. (shrink)

The primary goal of modern linguistic theory (at least in the circles I inhabit) is an explanation of the human language capacity and how it enables the child to acquire adult competence in language.1 Adult competence in turn is understood as the ability (or knowledge) to creatively map between sound and meaning, using a rich combinatorial system – the lexicon and grammar of the language. An adequate theory must satisfy at least three crucial constraints, which I will (...) call the Descriptive Constraint, the Learnability Constraint, and the Evolutionary Constraint. (shrink)

One of the great successes of the application of generalized quantifiers to natural language has been the ability to formulate robust semantic universals. When such a universal is attested, the question arises as to the source of the universal. In this paper, we explore the hypothesis that many semantic universals arise because expressions satisfying the universal are easier to learn than those that do not. While the idea that learnability explains universals is not new, explicit accounts of learning (...) that can make good on this hypothesis are few and far between. We propose a model of learning — back-propagation through a recurrent neural network — which can make good on this promise. In particular, we discuss the universals of monotonicity, quantity, and conservativity and perform computational experiments of training such a network to learn to verify quantifiers. Our results are able to explain monotonicity and quantity quite well. We suggest that conservativity may have a different source than the other universals. (shrink)

It is argued that donald davidson has not succeeded in showing that we need a constructive theory of meaning--A theory for a natural language which davidson considers to have as its base a finite number of semantic primitives--In order to explain language learning and, In particular, Linguistic productivity. This linguistic productivity is the ability of a speaker who has mastered the meaning of a finite stock of words and a finite number of grammatical rules, To produce and understand (...) sentences which he has not constructed or encountered before. (shrink)

A fundamental goal of linguistic theory is to explain how natural languages are acquired. This paper describes some recent findings on how learners acquire syntactic knowledge for which there is little, if any, decisive evidence from the environment. The first section presents several general observations about language acquisition that linguistic theory has tried to explain and discusses the thesis that certain linguistic properties are innate because they appear universally and in the absence of corresponding experience. A third diagnostic for (...) innateness, early emergence, is the focus of the second section of the paper, in which linguistic theory is tested against recent experimental evidence on children's acquisition of syntax. (shrink)

The impetus for this volume developed from the 1982 University of Western Ontario Learnability Workshop, which was organized by the editors and sponsored by that University's Department of Philosophy and the Centre for Cognitive Science. The volume e~plores the import of learnability theory for contemporary linguistic theory, focusing on foundational learning-theoretic issues associated with the parametrized Government-Binding framework. Written by prominent re searchers in the field, all but two of the eight contributions are pre viously unpublished. The editor's (...) introduction provides an overview that interrelates the separate papers and elucidates the foundational issues addressed by the volume. Osherson, Stob, and Weinstein's "Learning Theory and Natural Language" first appeared in Cognition ; Matthews's "The Plausi bility of Rationalism" was published in the Journal of Philosophy. The editors would like to thank the publishers for permission to reprint these papers. Mr. Marin Marinov assisted with the preparation of the indices for the volume. VB ROBERT 1. MATTHEWS INTRODUCTION: LEARNABILITY AND LINGUISTIC THEORY 1. INTRODUCTION Formal learning theory, as the name suggests, studies the learnability of different classes of formal objects under different formal models of learning. The specification of such a model, which specifies a learning environment, a learn ing strategy, and a criterion for successful learning, determines a class of formal objects, namely, the class that can be acquired to the level of the specified success criterion by a learner implementing the specified strategy in the specified enviroment. (shrink)

In the first part of my paper I discuss eight arguments in favour of the theory-dependence of observation: realistic content, guidance function of theories, perception as cognitive construction, expectation-dependence of perception, theory-dependence of scientific data, continuity between observational and theoretical concepts, language-dependence, and meaning holism. I argue that although these arguments make correct points, they do not exclude the existence of observations that are weakly theory-neutral in the sense that they don’t depend on acquired background knowledge. In the second (...) part I suggest an experimental method, the method of ostensive learning experiments, by which the degree of theory- and language-independence of a concept can be tested. (shrink)

In recent articles Fodor and Lepore have argued that not only do considerations of learnability dictate that meaning must be compositional in the wellknown sense that the meanings of all sentences are determined by the meanings of a finite number of primitive expressions and a finite number of operations on them, but also that meaning must be 'reverse compositional' as well, in the sense that the meanings of the primitive expressions of which a complex expression is composed must be (...) determined by the meaning of that complex expression plus the manner of its composition. I argue against the requirement of reverse compositionality and against the claim that learnability requires it. I consider some objections and close the paper by arguing against the related claim that concepts are reverse compositional. (shrink)

Richard Holton has drawn attention to a new semantic universal, according to which (almost) no natural language has contrafactive attitude verbs. This semantic universal is part of an asymmetry between factive and contrafactive attitude verbs. Whilst factives are abundant, contrafactives are scarce. We propose that this asymmetry is partly due to a difference in learnability. The meaning of contrafactives is significantly harder to learn than that of factives. We tested our hypothesis by conducting a computational experiment using an (...) artificial neural network. The results of this experiment support our hypothesis. (shrink)

Holton has drawn attention to a new semantic universal, according to which no natural language has contrafactive attitude verbs. Because factives are universal across natural languages, Holton’s universal is part of a major asymmetry between factive and contrafactive attitude verbs. We previously proposed that this asymmetry arises partly because the meaning of contrafactives is significantly harder to learn than that of factives. Here we extend our work by describing an additional computational experiment that further supports our hypothesis.

Ernest Gellner's final book, first published in 1998, is a synoptic interpretation of the thought of Wittgenstein and Malinowski.

We examined how language supports the expression of temporality within sentence boundaries in English, which has a rich inventory of grammatical means to express temporality. Using a computational model that mimics how humans learn from exposure we explored what the use of different tense and aspect combinations reveals about the interaction between our experience of time and the cognitive demands that talking about time puts on the language user. Our model was trained on n-grams extracted from the BNC (...) to select the TA combination that fits the context best. It revealed the existence of two different sub-systems within the set of TA combinations, a “simplex” one that is supported lexically and is easy to learn, and a “complex” one that is supported contextually and is hard to learn. The finding that some TA combinations are essentially lexical in nature necessitates a rethink of tense and aspect as grammatical categories that form the axes of the temporal system. We argue that the system of temporal reference may be more fruitfully thought of as the result of learning a system that is steeped in experience and organised along a number of functional principles. (shrink)

In language, recombination of a discrete set of meaningless building blocks forms an unlimited set of possible utterances. How such combinatorial structure emerged in the evolution of human language is increasingly being studied. It has been shown that it can emerge when languages culturally evolve and adapt to human cognitive biases. How the emergence of combinatorial structure interacts with the existence of holistic iconic form-meaning mappings in a language is still unknown. The experiment presented in this paper (...) studies the role of iconicity and human cognitive learning biases in the emergence of combinatorial structure in artificial whistled languages. Participants learned and reproduced whistled words for novel objects with the use of a slide whistle. Their reproductions were used as input for the next participant, to create transmission chains and simulate cultural transmission. Two conditions were studied: one in which the persistence of iconic form-meaning mappings was possible and one in which this was experimentally made impossible. In both conditions, cultural transmission caused the whistled languages to become more learnable and more structured, but this process was slightly delayed in the first condition. Our findings help to gain insight into when and how words may lose their iconic origins when they become part of an organized linguistic system. (shrink)

This paper gives a perspectival overview of the semantics of potential property-referring terms and presents new and surprising generalizations about explicit property-referring terms like 'the property of being wise', which raise fundamental issues regarding ontology and learnability and a core-periphery distinction in natural language ontology.

Reporting systems based on mobile technologies and feedback from regular citizens are becoming increasingly popular, especially as far as protection of environmental and cultural heritage is concerned. Reporting life-threatening situations, such as sudden natural disasters or traffic accidents, belongs to the same class of problems and could be aided by IT systems of a similar architecture. Designing and developing systems for reporting life-threatening situations is not a trivial task, requiring close cooperation between software developers and experts in different domains, who (...) could possibly find industrially recognized languages and notations difficult. Thus, the question is whether using simplified graphical domain-specific languages (SGDSLs) could help in creating a common communication platform. It has been revealed that domain experts have a preference for such languages as they offer good learnability, readability and ability to focus on the idea of application. The perspective of developers (technical persons) is introduced on the basis of feedback obtained from 84 students of Computer Science at the Lublin University of Technology, who attended comprehensive workshops followed by an anonymous survey. All participants received theoretical and practical training in modeling mobile software using the same set of languages as domain experts. An analysis of the results revealed that opinions expressed by technical and nontechnical persons concerning SGDSLs oriented on defining a flow of actions is consistent. Most respondents claimed that such languages might be valuable as tools for creating a common communication platform. (shrink)

Converging findings from English, Mandarin, and other languages suggest that observed “universals” may be algorithmic. First, computational principles behind recently developed algorithms that acquire productive constructions from raw texts or transcribed child-directed speech impose family resemblance on learnable languages. Second, child-directed speech is particularly rich in statistical (and social) cues that facilitate learning of certain types of structures.

According to a “selective” (as opposed to “instructive”) model of human language capacity, people come to know more than they experience. The discrepancy between experience and eventual capacity (the “poverty of the stimulus”) is bridged by genetically provided information. Hence any hypothesis about the linguistic genotype (or “Universal Grammar,” UG) has consequences for what experience is needed and what form people's mature capacities (or “grammars”) will take. This BBS target article discusses the “trigger experience,” that is, the experience that (...) actually affects a child's linguistic development. It is argued that this must be a subset of a child's total linguistic experience and hence that much of what a child hears has no consequence for the form of the eventual grammar. UG filters experience and provides an upper bound on what constitutes the triggering experience. This filtering effect can often be seen in the way linguistic capacity can change between generations. Children only need access to robust structures of minimal (“degree-0”) complexity. Everything can be learned from simple, unembedded “domains” (a grammatical concept involved in defining an expression's logical form). Children do not need access to more complex structures. (shrink)

In the first section of this paper I present a well known objection to meaning holism, according to which holism is inconsistent with natural language being learnable. Then I show that the objection fails if language acquisition includes stages of partial grasp of the meaning of at least some expressions, and I argue that standard model theoretic semantics cannot fully capture such stages. In the second section the above claims are supported through a review of current research into (...) language acquisition. Finally, in the third section it is argued that contemporary algebraic logical systems consist in a superior formal vehicle through which to capture stages of partial grasp of meaning; this claim is supported by concrete examples. (shrink)

As Cary J. Nederman writes in the foreword to this new edition, "Marsilius continues to speak to many of the salient issues of modern political life, expressing his doctrines in a language that has resonance and relevance. Whether in addressing the role of citizenship as a buffer between individual and community, or in explicating the foundations of religious toleration, the _Defensor pacis_ (and Marsilius' other writings) affords a distinctive theoretical perspective that rivals that of any of the great thinkers (...) of the Western political tradition.". (shrink)

This volume contains the first critical edition of the Scriptum super III-VIII libros Politicorum by Peter of Auvergne as well as a pragmatical edition of Books III-VIII of the medieval Latin translation of Aristotle's Politics. Intended as the continuation of Aquinas' unfinished commentary on the first three books of the Politics, the Scriptum became-together with Aquinas' commentary-the commentary on the Politics. From its appearance in the late thirteenth century to the end of the sixteenth century, the Scriptum represented the most (...) authoritative and influential interpretation of Books III-VIII of the Politics.The introduction to the volume provides both an overview of Peter's political thought and a case study of the production and dissemination of a university text. An examination of the manuscripts traces the preparation of the text from its first transcription and revision by a scribe close to the author-if not the author himself-to the preparation of the finished exemplar and its diffusion through the system of peciae. The introduction also explains how the text was adapted to fit the standards of humanistic Latin when it was first printed in the fifteenth century: its language was adjusted to humanistic standards, many formulations were reshaped, and passages were suppressed. These changes were subsequently preserved in all later editions of the text. Freed from this humanistic patina with which it has been transmitted since the early age of printing age, the Scriptum is now restored to its original version. (shrink)

Children learn their native language by exposure to their linguistic and communicative environment, but apparently without requiring that their mistakes be corrected. Such learning from “positive evidence” has been viewed as raising “logical” problems for language acquisition. In particular, without correction, how is the child to recover from conjecturing an over-general grammar, which will be consistent with any sentence that the child hears? There have been many proposals concerning how this “logical problem” can be dissolved. In this study, (...) we review recent formal results showing that the learner has sufficient data to learn successfully from positive evidence, if it favors the simplest encoding of the linguistic input. Results include the learnability of linguistic prediction, grammaticality judgments, language production, and form-meaning mappings. The simplicity approach can also be “scaled down” to analyze the learnability of specific linguistic constructions, and it is amenable to empirical testing as a framework for describing human language acquisition. (shrink)

The last 14 chapters of book 1 of Aristotle's "Prior Analytics" are concerned with the representation in the formal language of syllogistic of propositions and arguments expressed in more or less everyday Greek. In his commentary on those chapters, Alexander of Aphrodisias explains some of Aristotle's more opaque assertions and discusses post-Aristotelian ideas in semantics and the philosophy of language. In doing so he provides an unusual insight into the way in which these disciplines developed in the Hellenistic (...) era. He also shows a more sophisticated understanding of these fields than Aristotle himself, while remaining a staunch defender of Aristotle's emphasis on meaning as opposed to Stoics concern with verbal formulation. In his commentary on the final chapter of book 1 Alexander offers a thorough discussion of Aristotle's distinction between denying that something is, e.g., white and asserting that it is non-white. (shrink)

First published in 1982. Routledge is an imprint of Taylor & Francis, an informa company.

Attributed to Alexander of Aphrodisias -the leading ancient commentator on Aristotle -the Quaestiones exemplify the process through which Aristotle's thought was organized and came to be interpreted as "Aristotelianism." This volume of R.W. Sharples's translation, together with his earlier translation of Quaestiones 1.1-2.15, makes the Quaestiones available in its entirety for the first time in a modern language. The Quaestiones are concerned with problems of physics and metaphysics, psychology and divine providence. Readers interested in Aristotle's psychological views will find (...) the second half of the Quaestiones particularly valuable. Ten of the problems discussed involve issues raised in Aristotle's On the Soul, including the unity of apperception and the transition from first to second actuality in the act of contemplation. An additional twelve problems relate to aspects of physical theory such as infinity, necessity, and potentiality. Quaestio 2.21 concerns divine providence and helps supplement our knowledge of Alexander's position. A study of the Quaestiones also suggests how interpretations of Aristotle were influenced by doctrines of Hellenistic philosophy. Translated first into Arabic and then into Latin, excerpts from the Quaestiones played a significant role in the transmission of ancient Greek philosophy to the medieval world. (shrink)

Learning theory has frequently been applied to language acquisition, but discussion has largely focused on information theoretic problems—in particular on the absence of direct negative evidence. Such arguments typically neglect the probabilistic nature of cognition and learning in general. We argue first that these arguments, and analyses based on them, suffer from a major flaw: they systematically conflate the hypothesis class and the learnable concept class. As a result, they do not allow one to draw significant conclusions about the (...) learner. Second, we claim that the real problem for language learning is the computational complexity of constructing a hypothesis from input data. Studying this problem allows for a more direct approach to the object of study—the language acquisition device—rather than the learnable class of languages, which is epiphenomenal and possibly hard to characterize. The learnability results informed by complexity studies are much more insightful. They strongly suggest that target grammars need to be objective, in the sense that the primitive elements of these grammars are based on objectively definable properties of the language itself. These considerations support the view that language acquisition proceeds primarily through data-driven learning of some form. (shrink)

Computational learning theory explores the limits of learnability. Studying language acquisition from this perspective involves identifying classes of languages that are learnable from the available data, within the limits of time and computational resources available to the learner. Different models of learning can yield radically different learnability results, where these depend on the assumptions of the model about the nature of the learning process, and the data, time, and resources that learners have access to. To the extent (...) that such assumptions accurately reflect human language learning, a model that invokes them can offer important insights into the formal properties of natural languages, and the way in which their representations might be efficiently acquired. In this chapter we consider several computational learning models that have been applied to the language learning task. Some of these have yielded results that suggest that the class of natural languages cannot be efficiently learned from the primary linguistic data (PLD) available to children, through.. (shrink)