In recent years, the family of algorithms collected under the term ``deep learning'' has revolutionized artificial intelligence, enabling machines to reach human-like performances in many complex cognitive tasks. Although deep learning models are grounded in the connectionist paradigm, their recent advances were basically developed with engineering goals in mind. Despite of their applied focus, deep learning models eventually seem fruitful for cognitive purposes. This can be thought as a kind of biological exaptation, where a physiological structure becomes applicable for a (...) function different from that for which it was selected. In this paper, it will be argued that it is time for cognitive science to seriously come to terms with deep learning, and we try to spell out the reasons why this is the case. First, the path of the evolution of deep learning from the connectionist project is traced, demonstrating the remarkable continuity, and the differences as well. Then, it will be considered how deep learning models can be useful for many cognitive topics, especially those where it has achieved performance comparable to humans, from perception to language. It will be maintained that deep learning poses questions that cognitive sciences should try to answer. One of such questions is the reasons why deep convolutional models that are disembodied, inactive, unaware of context, and static, are by far the closest to the patterns of activation in the brain visual system. (shrink)

This paper addresses a fundamental line of research in neuroscience: the identification of a putative neural processing core of the cerebral cortex, often claimed to be “canonical”. This “canonical” core would be shared by the entire cortex, and would explain why it is so powerful and diversified in tasks and functions, yet so uniform in architecture. The purpose of this paper is to analyze the search for canonical explanations over the past 40 years, discussing the theoretical frameworks informing this research. (...) It will highlight a bias that, in my opinion, has limited the success of this research project, that of overlooking the dimension of cortical development. The earliest explanation of the cerebral cortex as canonical was attempted by David Marr, deriving putative cortical circuits from general mathematical laws, loosely following a deductive-nomological account. Although Marr’s theory turned out to be incorrect, one of its merits was to have put the issue of cortical circuit development at the top of his agenda. This aspect has been largely neglected in much of the research on canonical models that has followed. Models proposed in the 1980s were conceived as mechanistic. They identified a small number of components that interacted as a basic circuit, with each component defined as a function. More recent models have been presented as idealized canonical computations, distinct from mechanistic explanations, due to the lack of identifiable cortical components. Currently, the entire enterprise of coming up with a single canonical explanation has been criticized as being misguided, and the premise of the uniformity of the cortex has been strongly challenged. This debate is analyzed here. The legacy of the canonical circuit concept is reflected in both positive and negative ways in recent large-scale brain projects, such as the Human Brain Project. One positive aspect is that these projects might achieve the aim of producing detailed simulations of cortical electrical activity, a negative one regards whether they will be able to find ways of simulating how circuits actually develop. (shrink)

This paper analyzes the rapid and unexpected rise of deep learning within Artificial Intelligence and its applications. It tackles the possible reasons for this remarkable success, providing candidate paths towards a satisfactory explanation of why it works so well, at least in some domains. A historical account is given for the ups and downs, which have characterized neural networks research and its evolution from “shallow” to “deep” learning architectures. A precise account of “success” is given, in order to sieve out (...) aspects pertaining to marketing or sociology of research, and the remaining aspects seem to certify a genuine value of deep learning, calling for explanation. The alleged two main propelling factors for deep learning, namely computing hardware performance and neuroscience findings, are scrutinized, and evaluated as relevant but insufficient for a comprehensive explanation. We review various attempts that have been made to provide mathematical foundations able to justify the efficiency of deep learning, and we deem this is the most promising road to follow, even if the current achievements are too scattered and relevant for very limited classes of deep neural models. The authors’ take is that most of what can explain the very nature of why deep learning works at all and even very well across so many domains of application is still to be understood and further research, which addresses the theoretical foundation of artificial learning, is still very much needed. (shrink)

In this paper we defend structural representations, more specifically neural structural representation. We are not alone in this, many are currently engaged in this endeavor. The direction we take, however, diverges from the main road, a road paved by the mathematical theory of measure that, in the 1970s, established homomorphism as the way to map empirical domains of things in the world to the codomain of numbers. By adopting the mind as codomain, this mapping became a boon for all those (...) convinced that a representation system should bear similarities with what was being represented, but struggled to find a precise account of what such similarities mean. The euforia was brief, however, and soon homomorphism revealed itself to be affected by serious weaknesses, the primary one being that it included systems embarrassingly alien to representations. We find that the defense attempts that have followed, adopt strategies that share a common format: valid structural representations come as “homomorphism plus X”, with various “X”, provided in descriptive format only. Our alternative direction stems from the observation of the overlooked departure from homomorphism as used in the theory of measure and its later use in mental representations. In the former case, the codomain or the realm of numbers, is the most suited for developing theorems detailing the existence and uniqueness of homomorphism for a wide range of empirical domains. In the latter case, the codomain is the realm of the mind, possibly more vague and more ill-defined than the empirical domain itself. The time is ripe for articulating the mapping between represented domains and the mind in formal terms, by exploiting what is currently known about coding mechanisms in the brain. We provide a sketch of a possible development in this direction, one that adopts the theory of neural population coding as codomain. We will show that our framework is not only not in disagreement with the “plus X” proposals, but can lead to natural derivation of several of the “X”. (shrink)

In this paper we defend structural representations, more specifically neural structural representation. We are not alone in this, many are currently engaged in this endeavor. The direction we take, however, diverges from the main road, a road paved by the mathematical theory of measure that, in the 1970s, established homomorphism as the way to map empirical domains of things in the world to the codomain of numbers. By adopting the mind as codomain, this mapping became a boon for all those (...) convinced that a representation system should bear similarities with what was being represented, but struggled to find a precise account of what such similarities mean. The euforia was brief, however, and soon homomorphism revealed itself to be affected by serious weaknesses, the primary one being that it included systems embarrassingly alien to representations. We find that the defense attempts that have followed, adopt strategies that share a common format: valid structural representations come as “homomorphism plus X”, with various “X”, provided in descriptive format only. Our alternative direction stems from the observation of the overlooked departure from homomorphism as used in the theory of measure and its later use in mental representations. In the former case, the codomain or the realm of numbers, is the most suited for developing theorems detailing the existence and uniqueness of homomorphism for a wide range of empirical domains. In the latter case, the codomain is the realm of the mind, possibly more vague and more ill-defined than the empirical domain itself. The time is ripe for articulating the mapping between represented domains and the mind in formal terms, by exploiting what is currently known about coding mechanisms in the brain. We provide a sketch of a possible development in this direction, one that adopts the theory of neural population coding as codomain. We will show that our framework is not only not in disagreement with the “plus X” proposals, but can lead to natural derivation of several of the “X”. (shrink)

: Autonomous driving systems promise important changes for future of transport, primarily through the reduction of road accidents. However, ethical concerns, in particular, two central issues, will be key to their successful development. First, situations of risk that involve inevitable harm to passengers and/or bystanders, in which some individuals must be sacrificed for the benefit of others. Secondly, and identification responsible parties and liabilities in the event of an accident. Our work addresses the first of these ethical problems. We are (...) interested in investigating how humans respond to critical situations and what reactions they consider to be morally right or at least preferable to others. Our experimental approach relies on the trolley dilemma and knowledge gained from previous research on this. More specifically, our main purpose was to test the difference between what human drivers actually decide to do in an emergency situations whilst driving a realistic simulator and the moral choices they make when they pause to consider what they would do in the same situation and to better understand why these choices may differs. Keywords: Self-driving Cars; Trolley Problem; Moral Choices; Moral Responsibility; Virtual Reality Dilemmi morali nelle automobili a guida autonoma Riassunto: I sistemi di guida autonomi promettono importanti cambiamenti per il futuro dei trasporti, principalmente attraverso la riduzione degli incidenti stradali. Tuttavia, vi sono preoccupazioni etiche, in particolare due questioni centrali, fondamentali per il loro sviluppo. In primo luogo, le situazioni di rischio che comportano inevitabili danni ai passeggeri e/o ai pedoni, ovvero situazioni in cui alcune persone devono essere sacrificate a beneficio di altri. In secondo luogo, l’identificazione delle parti responsabili in caso di incidente. Il nostro lavoro affronta il primo di questi problemi etici. Siamo interessati a studiare come gli umani rispondono a situazioni critiche e quali reazioni considerano moralmente giuste o almeno preferibili. Il nostro approccio sperimentale si basa sul trolley problem e sulle conoscenze acquisite da precedenti ricerche su questo ambito. Più specificamente, il nostro scopo principale è quello di testare la differenza tra ciò che i conducenti umani decidono effettivamente di fare in una situazione di emergenza, mentre guidano un simulatore realistico, e le scelte morali che compiono se posti nella stessa situazione e hanno la possibilità di decidere senza limiti di tempo. Lo scopo è inoltre comprendere come e perché queste scelte possono differire. Parole chiave: Automobili a guida autonoma; Trolley problem; Scelte morali; Responsabilità morale, Realtà virtuale. (shrink)

There is a diffuse sentiment that to anthropomorphize is a mild vice that people tend to do easily and pleasingly, but that an adult well educated person should avoid. In this paper it will be provided an elucidation of ``anthropomorphism'' in the field of common sense knowledge, the issue of animal rights, and about the use of humans as a model in the scientific explanation. It will be argued for a ``constructive anthropomorphism'', i.e., the idea that anthropomorphism is a natural (...) attutude to attribute human psychological features to other individuals, no matter they are actually rational agents, or not. If we know the ``grammar'' of this attutude, we can avoid the risks in overestimating the environmental inputs towards anthropomor­phism and, at the same time, take the heuristic advantages of anthropomor­phism in the use of human mind as a model for both everyday circumstances and scientific enterprise. (shrink)

Neurosemantics is not yet a common term and in current neuroscience and philosophy it is used with two different sorts of objectives. One deals with the meaning of the electrical and the chemical activities going on in neural circuits. This way of using the term regards the project of explaining linguistic meaning in terms of the computations done by the brain. This book explores this second sense of neurosemantics, but in doing so, it will address much of the first as (...) well, for we believe that the capacity of neural circuits to support linguistic meaning, hinges on their peculiar role in coding entities and facts of the world. It is an enterprise at the edge of the available state-of-the-art knowledge in neuroscience and specifically, in the growing understanding of brain computational mechanisms. We conceive neurosemantics, however, as the natural evolution of a long standing project that began in the early days of Boole’s logic, the idea that semantics can be construed and explained in mathematical terms. Classical formal semantics, for a very long time, excluded from the analysis of language any account of mental processes, which on the contrary, became the central focus during the cognitive turn. Cognitive semantics, however, failed to provide a rigorous mathematical framework for semantic processes. Today, it is possible to begin explaining language by way of a new mathematical foundation, one that is empirically grounded in how the brain computes: neurosemantics. The way this book intends to contribute is twofold. One is to present a series of existing examples of neurosemantics in practice: early models addressing aspects of linguistic semantics purely in neurocomputational terms. The other is to try to identify the principles upon which models of this kind can be constructed, and their corresponding neural bases. (shrink)

This book examines the concept of “ Neurosemantics”, a term currently used in two different senses: the informational meaning of the physical processes in the neural circuits, and semantics in its classical sense, as the meaning of language, explained in terms of neural processes. The book explores this second sense of neurosemantics, yet in doing so, it addresses much of the first meaning as well. Divided into two parts, the book starts with a description and analysis of the mathematics of (...) the brain, including computational units, representational mechanisms and algorithmic principles. This first part pays special attention to the neural architecture which has been used in developing models of neurosemantics. The second part of the book presents a collection of models, and describes each model reproducing specific aspects of the semantics of language. Some of these models target one of the core problems of semantics, the reference of nouns, and in particular of nouns with a strong perceptual characterization. Others address the semantics of predicates, with a detailed analysis of colour attributes. While this book represents a radical shift from traditional semantics, it still pursues a line of continuity that is based on the idea that meaning can be captured, and explained, by a sort of computation. (shrink)

This paper sheds light on the shift that is taking place from the practice of ‘coding’, namely developing programs as conventional in the software community, to the practice of ‘curing’, an activity that has emerged in the last few years in Deep Learning (DL) and that amounts to curing the data regime to which a DL model is exposed during training. Initially, the curing paradigm is illustrated by means of a study-case on autonomous vehicles. Subsequently, the shift from coding to (...) curing is analysed taking into consideration the epistemological notions, central in the philosophy of computer science, of function, implementation, and correctness. First, it is illustrated how, in the curing paradigm, the functions performed by the trained model depend much more on dataset curation rather than on the model algorithms which, in contrast with the coding paradigm, do not comply with requested specifications. Second, it is highlighted how DL models cannot be considered implementations according to any of the available definitions of implementation that follow an intentional theory of functions. Finally, it is argued that DL models cannot be evaluated in terms of their correctness but rather in their experimental computational validity. (shrink)

Ce texte se propose d'examiner en quoi le discours oral se différencie de la composition écrite. La logique orale a pour caractéristique principale de recourir à des prémisses ou à des conclusions qui ont déjà valeur de “maxime” pour l'auditeur. Il s'agit donc d'une véritable “mise à l'épreuve” de chaque position. La logique orale touche directement le contenu. Elle s'oppose à la dialectique — elle est liée à une logique formelle — tout en étant complémentaire.

This book examines the concept of “ Neurosemantics”, a term currently used in two different senses: the informational meaning of the physical processes in the neural circuits, and semantics in its classical sense, as the meaning of language, explained in terms of neural processes. The book explores this second sense of neurosemantics, yet in doing so, it addresses much of the first meaning as well. Divided into two parts, the book starts with a description and analysis of the mathematics of (...) the brain, including computational units, representational mechanisms and algorithmic principles. This first part pays special attention to the neural architecture which has been used in developing models of neurosemantics. The second part of the book presents a collection of models, and describes each model reproducing specific aspects of the semantics of language. Some of these models target one of the core problems of semantics, the reference of nouns, and in particular of nouns with a strong perceptual characterization. Others address the semantics of predicates, with a detailed analysis of colour attributes. While this book represents a radical shift from traditional semantics, it still pursues a line of continuity that is based on the idea that meaning can be captured, and explained, by a sort of computation. (shrink)

Neural plasticity has been invoked as a powerful argument against nativism. However, there is a line of argument, which is well exemplified by Pinker and more recently by Laurence and Margolis The conceptual mind: new directions in the study of concepts, MIT, Cambridge, 2015) with respect to concept nativism, according to which even extreme cases of plasticity show important innate constraints, so that one should rather speak of “constrained plasticity”. According to this view, cortical areas are not really equipotential, they (...) perform instead different kinds of computation, follow essentially different learning rules, or have a fixed internal structure acting as a filter for specific categories of inputs. We intend to analyze this argument, in the light of a review of current neuroscientific literature on plasticity. Our conclusion is that Laurence and Margolis are right in their appeal to innate constraints on connectivity—a thesis that is nowadays welcome to both nativists and non-nativists —but there is little support for their claim of further innate differentiation between and within cortical areas. As we will show, there is instead strong evidence that the cortex is characterized by the indefinite repetition of substantially identical computational units, giving rise in any of its portions to Hebbian, input-dependent plasticity. Although this is entirely compatible with the existence of innate constraints on the brain’s connectivity, the cerebral cortex architecture based on a multiplicity of maps correlating with one another has important computational consequences, a point that has been underestimated by traditional connectionist approaches. (shrink)

In recent years, a number of different disciplines have begun to investigate the fundamental role context appears to play in a number of cognitive phenomena. Traditionally, linguistics, and the fields of communication and pragmatics in particular, have been the areas that have focused the most on contextual effects. Context has increasingly been studied for its role in influencing mental concepts, for some scholars being considered constitutive for most – if not all – concepts. Cognitive neuroscience is now starting to consider (...) in a systematic way how context interacts with neural responses, although this research is still scattered and concentrated in a small number of specific cases only. In this chapter, we attempt to tie these three levels together, since only from their integration can a comprehensive explanation of how context affects cognition be constructed. The way context drives language comprehension depends on the effects of context on the conceptual scaffolding of the listener, which in turn, is the result of his neural responses in combination to context. These neural responses derive from learning throughout the history of experiences of the individual, and the association between possible contexts and heard utterances. The road we take to accomplishing the multi-level integration between what appear to be distant domains, is a computational one. This approach meets with the mechanistic framework of explanation, which is currently held as the most appropriate way of approaching cognitive phenomena that is often characterized by a multiplicity of levels, as is the case with context. The core underlying concept of the neurocomputational framework here proposed, is an account of neural representation, based on structural similarity. Structural representations are still the best option on the market in cognitive science, but in their traditional form, derived from classical measurement theory, are affected by a number of serious drawbacks, including not being able to account for context. We suggest a different account of structural similarity, one informed by current neuroscience, where the homomorphic relations required for structural similarity are derived from neural population coding. In a preliminary mathematical sketch, we indicate how this approach can construct neural aggegations that are sensitive to context. (shrink)