Several approaches to implementing symbol-like representations in neurally plausible models have been proposed. These approaches include binding through synchrony, “mesh” binding, and conjunctive binding. Recent theoretical work has suggested that most of these methods will not scale well, that is, that they cannot encode structured representations using any of the tens of thousands of terms in the adult lexicon without making implausible resource assumptions. Here, we empirically demonstrate that the biologically plausible structured representations employed in the Semantic (...) Pointer Architecture approach to modeling cognition do scale appropriately. Specifically, we construct a spiking neural network of about 2.5 million neurons that employs semantic pointers to successfully encode and decode the main lexical relations in WordNet, which has over 100,000 terms. In addition, we show that the same representations can be employed to construct recursively structured sentences consisting of arbitrary WordNet concepts, while preserving the original lexical structure. We argue that these results suggest that semantic pointers are uniquely well-suited to providing a biologically plausible account of the structured representations that underwrite human cognition. (shrink)

We present techniques for integrating low‐level neurobiological constraints into high‐level, functional cognitive models. In particular, we use these techniques to construct a model of eyeblink conditioning in the cerebellum based on temporal representations in the recurrent Granule‐Golgi microcircuit.

This paper describes how Tononi’s information integration theory of consciousness was used to make detailed predictions about the distribution of phenomenal states in a spiking neural network. This network had approximately 18,000 neurons and 700,000 connections and it used models of emotion and imagination to control the eye movements of a virtual robot and avoid ‘negative’ stimuli. The first stage in the analysis was the development of a formal definition of Tononi’s theory of consciousness. The network was then (...) analysed for information integration and detailed predictions were made about the distribution of consciousness for each time step of recorded activity. This work demonstrates how an artificial system can be analysed for consciousness using a particular theory and in the future this approach could be used to make predictions about the phenomenal states associated with biological systems. (shrink)

A fundamental claim associated with parallel distributed processing theories of cognition is that knowledge is coded in a distributed manner in mind and brain. This approach rejects the claim that knowledge is coded in a localist fashion, with words, objects, and simple concepts, that is, coded with their own dedicated representations. One of the putative advantages of this approach is that the theories are biologically plausible. Indeed, advocates of the PDP approach often highlight the close parallels between distributed (...) representations learned in connectionist models and neural coding in brain and often dismiss localist theories as biologically implausible. The author reviews a range a data that strongly challenge this claim and shows that localist models provide a better account of single-cell recording studies. The author also contrast local and alternative distributed coding schemes and argues that common rejection of grandmother cell theories in neuroscience is due to a misunderstanding about how localist models behave. The author concludes that the localist representations embedded in theories of perception and cognition are consistent with neuroscience; biology only calls into question the distributed representations often learned in PDP models. (shrink)

A dynamic threshold, which controls the nature and course of learning, is a pivotal concept in Page's general localist framework. This commentary addresses various issues surrounding biologically plausible implementations for such thresholds. Relevant previous research is noted and the particular difficulties relating to the creation of so-called instance representations are highlighted. It is stressed that these issues also apply to distributed models.

Deep neural networks (DNNs) have had extraordinary successes in classifying photographic images of objects and are often described as the best models of biological vision. This conclusion is largely based on three sets of findings: (1) DNNs are more accurate than any other model in classifying images taken from various datasets, (2) DNNs do the best job in predicting the pattern of human errors in classifying objects taken from various behavioral datasets, and (3) DNNs do the best job (...) in predicting brain signals in response to images taken from various brain datasets (e.g., single cell responses or fMRI data). However, these behavioral and brain datasets do not test hypotheses regarding what features are contributing to good predictions and we show that the predictions may be mediated by DNNs that share little overlap with biological vision. More problematically, we show that DNNs account for almost no results from psychological research. This contradicts the common claim that DNNs are good, let alone the best, models of human object recognition. We argue that theorists interested in developing biologically plausible models of human vision need to direct their attention to explaining psychological findings. More generally, theorists need to build models that explain the results of experiments that manipulate independent variables designed to test hypotheses rather than compete on making the best predictions. We conclude by briefly summarizing various promising modeling approaches that focus on psychological data. (shrink)

Quilty-Dunn et al. argue that deep convolutional neural networks (DCNNs) optimized for image classification exemplify structural disanalogies to human vision. A different kind of artificial vision – found in reinforcement-learning agents navigating artificial three-dimensional environments – can be expected to be more human-like. Recent work suggests that language-like representations substantially improves these agents’ performance, lending some indirect support to the language-of-thought hypothesis (LoTH).

Further tests of Amit's model are indicated. One strategy is to use the apparent coding sparseness of the model to make predictions about coding sparseness in Miyashita's network. A second approach is to use memory overload to induce false positive responses in modules and biological systems. In closing, the importance of temporal coding and timing requirements in developing biologically plausible attractor networks is mentioned.

Chaos in nervous system is a fascinating but controversial field of investigation. To approach the role of chaos in the real brain, we theoretically and numerically investigate the occurrence of chaos inartificial neural networks. Most of the time, recurrent networks (with feedbacks) are fully connected. This architecture being not biologically plausible, the occurrence of chaos is studied here for a randomly diluted architecture. By normalizing the variance of synaptic weights, we produce a bifurcation parameter, dependent (...) on this variance and on the slope of the transfer function, that allows a sustained activity and the occurrence of chaos when reaching a critical value. Even for weak connectivity and small size, we find numerical results in accordance with the theoretical ones previously established for fully connected infinite sized networks. The route towards chaos is numerically checked to be a quasi-periodic one, whatever the type of the first bifurcation is. Our results suggest that such high-dimensional networks behave like low-dimensional dynamical systems. (shrink)

Artificial neural networks (ANNs) are new mathematical techniques which can be used for modelling real neural networks, but also for data categorisation and inference tasks in any empirical science. This means that they have a twofold interest for the philosopher. First, ANN theory could help us to understand the nature of mental phenomena such as perceiving, thinking, remembering, inferring, knowing, wanting and acting. Second, because ANNs are such powerful instruments for data classification and inference, their use (...) also leads us into the problems of induction and probability. Ever since David Hume expressed his famous doubts about induction, the principles of scientific inference have been a central concern for philosophers. (shrink)

The ability to improve in speed and accuracy as a result of repeating some task is an important hallmark of intelligent biological systems. Although gradual behavioral improvements from practice have been modeled in spiking neural networks, few such models have attempted to explain cognitive development of a task as complex as addition. In this work, we model the progression from a counting-based strategy for addition to a recall-based strategy. The model consists of two networks working in (...) parallel: a slower basal ganglia loop and a faster cortical network. The slow network methodically computes the count from one digit given another, corresponding to the addition of two digits, whereas the fast network gradually “memorizes” the output from the slow network. The faster network eventually learns how to add the same digits that initially drove the behavior of the slower network. Performance of this model is demonstrated by simulating a fully spiking neural network that includes basal ganglia, thalamus, and various cortical areas. Consequently, the model incorporates various neuroanatomical data, in terms of brain areas used for calculation and makes psychologically testable predictions related to frequency of rehearsal. Furthermore, the model replicates developmental progression through addition strategies in terms of reaction times and accuracy, and naturally explains observed symptoms of dyscalculia. (shrink)

Eye movement desensitization and reprocessing therapy is a well-established therapeutic method to treat post-traumatic stress disorder. However, how EMDR exerts its therapeutic action has been studied in many types of research but still needs to be completely understood. This is in part due to limited knowledge of the neurobiological mechanisms underlying EMDR, and in part to our incomplete understanding of PTSD. In order to model PTSD, we used a biologically inspired computational model based on firing rate units, encompassing the (...) cortex, hippocampus, and amygdala. Through the modulation of its parameters, we fitted real data from patients treated with EMDR or classical exposure therapy. This allowed us to gain insights into PTSD mechanisms and to investigate how EMDR achieves trauma remission. (shrink)

Human decision making shows systematic simplifications and deviations from the tenets of rationality (‘heuristics’) that may lead to suboptimal decisional outcomes (‘cognitive biases’). There are currently three prevailing theoretical perspectives on the origin of heuristics and cognitive biases: a cognitive-psychological, an ecological and an evolutionary perspective. However, these perspectives are mainly descriptive and none of them provides an overall explanatory framework for the underlying mechanisms of cognitive biases. To enhance our understanding of cognitive heuristics and biases we propose a (...) class='Hi'>neural network framework for cognitive biases, which explains why our brain systematically tends to default to heuristic (‘Type 1’) decision making. We argue that many cognitive biases arise from intrinsic brain mechanisms that are fundamental for the working of biological neural networks. In order to substantiate our viewpoint, we discern and explain four basic neural network principles: (1) Association, (2) Compatibility (3) Retainment, and (4) Focus. These principles are inherent to (all) neural networks which were originally optimized to perform concrete biological, perceptual, and motor functions. They form the basis for our inclinations to associate and combine (unrelated) information, to prioritize information that is compatible with our present state (such as knowledge, opinions and expectations), to retain given information that sometimes could better be ignored, and to focus on dominant information while ignoring relevant information that is not directly activated. The supposed mechanisms are complementary and not mutually exclusive. For different cognitive biases they may all contribute in varying degrees to distortion of information. The present viewpoint not only complements the earlier three viewpoints, but also provides a unifying and binding framework for many cognitive bias phenomena. (shrink)

Inductive reasoning is a fundamental and complex aspect of human intelligence. In particular, how do subjects, given a set of particular examples, generate general descriptions of the rules governing that set? We present a biologically plausible method for accomplishing this task and implement it in a spiking neuron model. We demonstrate the success of this model by applying it to the problem domain of Raven's Progressive Matrices, a widely used tool in the field of intelligence testing. The (...) model is able to generate the rules necessary to correctly solve Raven's items, as well as recreate many of the experimental effects observed in human subjects. (shrink)

Although great progress in neuroanatomy and physiology has occurred lately, we still cannot go directly to those levels to discover the neural mechanisms of higher cognition and consciousness. But we can use neurocomputational methods based on these details to push this project forward. Here we describe vector subtraction as an operation that computes sequential paths through high-dimensional vector spaces. Vector-space interpretations of network activity patterns are a fruitful resource in recent computational neuroscience. Vector subtraction also appears to be implemented (...) neurally in primate frontal eye field activity, which computes dimensions of saccadic eye movements. We use this apparent neural implementation as a model and construct from it a general neurocomputational account of an important type of sequential cognitive and conscious process. We defend the biological plausibility of all components of the general model and show that it yields testable anatomical and physiological predictions. We close by suggesting some interesting consequences for consciousness if our model characterizes correctly the neural mechanisms producing a common type of episode in our conscious streams. (shrink)

Two universal functional principles of Grossberg’s Adaptive Resonance Theory decipher the brain code of all biological learning and adaptive intelligence. Low-level representations of multisensory stimuli in their immediate environmental context are formed on the basis of bottom-up activation and under the control of top-down matching rules that integrate high-level, long-term traces of contextual configuration. These universal coding principles lead to the establishment of lasting brain signatures of perceptual experience in all living species, from aplysiae to primates. They are re-visited in (...) this concept paper on the basis of examples drawn from the original code and from some of the most recent related empirical findings on contextual modulation in the brain, highlighting the potential of Grossberg’s pioneering insights and groundbreaking theoretical work for intelligent solutions in the domain of developmental and cognitive robotics. (shrink)

Choice Outstanding Academic Title, 1996. In hundreds of articles by experts from around the world, and in overviews and "road maps" prepared by the editor, The Handbook of Brain Theory and Neural Networkscharts the immense progress made in recent years in many specific areas related to two great questions: How does the brain work? and How can we build intelligent machines? While many books have appeared on limited aspects of one subfield or another of brain theory and neural (...) networks, the Handbookcovers the entire sweep of topics—from detailed models of single neurons, analyses of a wide variety of biological neural networks, and connectionist studies of psychology and language, to mathematical analyses of a variety of abstract neural networks, and technological applications of adaptive, artificial neural networks. The excitement, and the frustration, of these topics is that they span such a broad range of disciplines including mathematics, statistical physics and chemistry, neurology and neurobiology, and computer science and electrical engineering as well as cognitive psychology, artificial intelligence, and philosophy. Thus, much effort has gone into making the Handbookaccessible to readers with varied backgrounds while still providing a clear view of much of the recent, specialized research in specific topics. The heart of the book, part III, comprises of 267 original articles by leaders in the various fields, arranged alphabetically by title. Parts I and II, written by the editor, are designed to help readers orient themselves to this vast range of material. Part I, Background, introduces several basic neural models, explains how the present study of brain theory and neural networks integrates brain theory, artificial intelligence, and cognitive psychology, and provides a tutorial on the concepts essential for understanding neural networks as dynamic, adaptive systems. Part II, Road Maps, provides entry into the many articles of part III through an introductory "Meta-Map" and twenty-three road maps, each of which tours all the Part III articles on the chosen theme. (shrink)

As an imitation of the biological nervous systems, neural networks, which have been characterized as powerful learning tools, are employed in a wide range of applications, such as control of complex nonlinear systems, optimization, system identification, and patterns recognition. This article aims to bring a brief review of the state-of-the-art NNs for the complex nonlinear systems by summarizing recent progress of NNs in both theory and practical applications. Specifically, this survey also reviews a number of NN based robot (...) control algorithms, including NN based manipulator control, NN based human-robot interaction, and NN based cognitive control. (shrink)

Bowers et al. propose to use controlled behavioral experiments when evaluating deep neural networks as models of biological vision. We agree with the sentiment and draw parallels to the notion that “neuroscience needs behavior.” As a promising path forward, we suggest complementing image recognition tasks with increasingly realistic and well-controlled task environments that engage real-world object recognition behavior.

Two universal functional principles of Grossberg’s Adaptive Resonance Theory [19] decipher the brain code of all biological learning and adaptive intelligence. Low-level representations of multisensory stimuli in their immediate environmental context are formed on the basis of bottom-up activation and under the control of top-down matching rules that integrate high-level long-term traces of contextual configuration. These universal coding principles lead to the establishment of lasting brain signatures of perceptual experience in all living species, from aplysiae to primates. They are re-visited (...) in this concept paper here on the basis of examples drawn from the original code and from some of the most recent related empirical findings on contextual modulation in the brain, highlighting the potential of Grossberg’s pioneering insights and groundbreaking theoretical work for intelligent solutions in the domain of developmental and cognitive robotics. (shrink)

For millions of years, biological creatures have dealt with the world without being able to see it; however, the change in the atmospheric condition during the Cambrian period and the subsequent increase of light, triggered the sudden evolution of vision and the consequent evolutionary benefits. Nevertheless, how from simple organisms to more complex animals have been able to generate meaning from the light who fell in their eyes and successfully engage the visual world remains unknown. As shown by many psychophysical (...) experiments, biological visual systems cannot measure the physical properties of the world. The light projected onto the retina is, in fact, unable to specify the physical properties of the world in which humans and other visually ‘intelligent’ animals behave; however, visual behaviours are habitually successful. Through psychophysical evidence, examples of the functioning of Artificial Neural Networks and a reflection upon visual appreciation in the cultural and artistic context, this paper shows how vision emerged by random trial and error during evolution and lifetime learning; how the functioning of ANNs may provide evidence and insights on how machine and human vision works; and how rethinking vision theory in terms of trial and error may offer a new approach to better understand vision—biological and artificial—and reveal new insights into why we like what we like. (shrink)

Page has done connectionist researchers a valuable service in this target article. He points out that connectionist models using localized representations often work as well or better than models using distributed representations. I point out that models using distributed representations are difficult to understand and often lack parsimony and plausibility. In conclusion, I give an example – the case of the missing fundamental in music – that can easily be explained by a model using localist representations but can be explained (...) only with great difficulty and implausibility by a model using distributed representations. (shrink)

In their account of learning and behavior, the authors define an interactor as emitted behavior that operates on the environment, which excludes Pavlovian learning. A unified neural-network account of the operant-Pavlovian dichotomy favors interpreting neurons as interactors and synaptic efficacies as replicators. The latter interpretation implies that single-synapse change is inherently Lamarckian.

Travelling waves crossing the nervous networks at mesoscopic/macroscopic scales have been correlated with different brain functions, from long-term memory to visual stimuli. Here we investigate a feasible relationship between wave generation/propagation in recurrent nervous networks and a physical/chemical model, namely the Belousov–Zhabotinsky reaction. Since BZ’s nonlinear, chaotic chemical process generates concentric/intersecting waves that closely resemble the diffusive nonlinear/chaotic oscillatory patterns crossing the nervous tissue, we aimed to investigate whether wave propagation of brain oscillations could be described in terms (...) of BZ features. We compared experimentally detected oscillations during the spontaneous activity of the brain with BZ-like concentric waves simulated by a recently introduced artificial network. The observed overlap and agreement between simulated and measured oscillatory patterns suggests that changes in cortical areas’ neural activity might be described in terms of a recognizable diffusion pattern. We describe biological plausibility, benefits and limits of our approach and discuss the relationship among BZ-like networks, Pandemonium-like architectures and the spontaneous activity of the brain. ER -. (shrink)

Purely parallel neural networks can model object recognition in brief displays – the same conditions under which illusory conjunctions have been demonstrated empirically. Correcting errors of illusory conjunction is the “tag-assignment” problem for a purely parallel processor: the problem of assigning a spatial tag to nonspatial features, feature combinations, and objects. This problem must be solved to model human object recognition over a longer time scale. Our model simulates both the parallel processes that may underlie illusory conjunctions and (...) the serial processes that may solve the tag-assignment problem in normal perception. One component of the model extracts pooled features and another provides attentional tags that correct illusory conjunctions. Our approach addresses two questions: How can objects be identified from simultaneously attended features in a parallel, distributed representation? How can the spatial selectional requirements of such an attentional process be met by a separation of pathways for spatial and nonspatial processing? Our analysis of these questions yields a neurally plausible simulation of tag assignment based on synchronizing feature processing activity in a spatial focus of attention. (shrink)

We recognize today's deep neural network (DNN) models of language behaviors as engineering achievements. However, what we know intuitively and scientifically about language shows that what DNNs are and how they are trained on bare texts, makes them poor models of mind and brain for language organization, as it interacts with infant biology, maturation, experience, unique principles, and natural law.

Current cognitive science models of perception and action assume that the objects that we move toward and perceive are represented as determinate in our experience of them. A proper phenomenology of perception and action, however, shows that we experience objects indeterminately when we are perceiving them or moving toward them. This indeterminacy, as it relates to simple movement and perception, is captured in the proposed phenomenologically based recurrent network models of brain function. These models provide a possible foundation from which (...) predicative structures may arise as an emergent phenomenon without the positing of a representing subject. These models go some way in addressing the dual constraints of phenomenological accuracy and neurophysiological plausibility that ought to guide all projects devoted to discovering the physical basis of human experience. (shrink)

On the basis of recent advancements in both neuroscience and archaeology, we propose a plausible biocultural mechanism at the basis of cultural evolution. The proposed mechanism, which relies on the notions of cultural exaptation and cultural neural reuse, may account for the asynchronous, discontinuous, and patchy emergence of innovations around the globe. Cultural exaptation refers to the reuse of previously devised cultural features for new purposes. Cultural neural reuse refers to cases in which exposure to cultural practices (...) induces the formation, activation, and stabilization of new functional and/or structural brain networks during the individual lifespan. The invention of writing is interpreted as a case of cultural exaptation of previous devices to record information, in use since at least the Early Later Stone Age and the beginning of the Upper Paleolithic. The measurable changes in brain structure and functioning caused by learning to read are proposed as an exemplar case of cultural neural reuse. It is argued that repeated cycles of cultural exaptation, development of appropriate strategies of cultural transmission, and ensuing cultural neural reuse represent the fundamental mechanism that has regulated the cultural evolution of our lineage. A general predictive model of when and under which circumstances the proposed mechanism should be expected to occur is proposed, and the relationship of our mechanism with gene-culture coevolutionary models is discussed. (shrink)

Symmetry in biological and physical systems is a product of self-organization driven by evolutionary processes, or mechanical systems under constraints. Symmetry-based feature extraction or representation by neural networks may unravel the most informative contents in large image databases. Despite significant achievements of artificial intelligence in recognition and classification of regular patterns, the problem of uncertainty remains a major challenge in ambiguous data. In this study, we present an artificial neural network that detects symmetry uncertainty states in human (...) observers. To this end, we exploit a neural network metric in the output of a biologically inspired Self- Organizing Map Quantization Error (SOM-QE). Shape pairs with perfect geometry mirror symmetry but a non-homogenous appearance, caused by local variations in hue, saturation, or lightness within and/or across the shapes in a given pair produce, as shown here, a longer choice response time (RT) for “yes” responses relative to symmetry. These data are consistently mirrored by the variations in the SOM-QE from unsupervised neural network analysis of the same stimulus images. The neural network metric is thus capable of detecting and scaling human symmetry uncertainty in response to patterns. Such capacity is tightly linked to the metric’s proven selectivity to local contrast and color variations in large and highly complex image data. (shrink)

Choice Outstanding Academic Title, 1996. In hundreds of articles by experts from around the world, and in overviews and "road maps" prepared by the editor, The Handbook of Brain Theory and Neural Networks charts the immense progress made in recent years in many specific areas related to great questions: How does the brain work? How can we build intelligent machines? While many books discuss limited aspects of one subfield or another of brain theory and neural networks, (...) the Handbook covers the entire sweep of topics—from detailed models of single neurons, analyses of a wide variety of biological neural networks, and connectionist studies of psychology and language, to mathematical analyses of a variety of abstract neural networks, and technological applications of adaptive, artificial neural networks. Expository material makes the book accessible to readers with varied backgrounds while still offering a clear view of the recent, specialized research on specific topics. (shrink)

The present commentary addresses the Quartz & Sejnowski (Q&S) target article from the point of view of the dynamical learning algorithm for neural networks. These techniques implicitly adopt Q&S's neural constructivist paradigm. Their approach hence receives support from the biological and psychological evidence. Limitations of constructive learning for neural networks are discussed with an emphasis on grammar learning.

It was recently shown that the Madelung equations, that is, a hydrodynamic form of the Schrödinger equation, can be derived from a canonical ensemble of neural networks where the quantum phase was identified with the free energy of hidden variables. We consider instead a grand canonical ensemble of neural networks, by allowing an exchange of neurons with an auxiliary subsystem, to show that the free energy must also be multivalued. By imposing the multivaluedness condition on the (...) free energy we derive the Schrödinger equation with “Planck’s constant” determined by the chemical potential of hidden variables. This shows that quantum mechanics provides a correct statistical description of the dynamics of the grand canonical ensemble of neural networks at the learning equilibrium. We also discuss implications of the results for machine learning, fundamental physics and, in a more speculative way, evolutionary biology. (shrink)

In recent years, neural networks have attracted much attention in the machine learning and the deep learning technologies. Bio-inspired functions and intelligence are also expected to process efficiently and improve existing technologies. In the visual pathway, the prominent features consist of nonlinear characteristics of squaring and rectification functions observed in the retinal and visual cortex networks, respectively. Further, adaptation is an important feature to activate the biological systems, efficiently. Recently, to overcome short-comings of the deep learning techniques, (...) orthogonality for the weights in the networks has been developed for the signal propagation and the efficient optimization of the learning. In this paper, bio-inspired asymmetric networks with nonlinear characteristics are proposed, which are derived from the retinal networks in the biological visual pathway. The asymmetric network proposed here was verified to detect the movement of the object, efficiently in our previous studies. This paper shows a new characteristic of the adaptive orthogonality in the asymmetric networks. First, it is shown that the asymmetric network with nonlinear characteristics is effective for generating orthogonality. Second, the proposed asymmetric network with Gabor filters is compared with the conventional energy model from the point of the orthogonality characteristics. Finally, the asymmetric networks with nonlinear characteristics can generate the extended orthogonal bases in independent subspaces, which are useful for classification and efficient learning. (shrink)

In this paper I discuss one of the key issuesin the philosophy of neuroscience:neurosemantics. The project of neurosemanticsinvolves explaining what it means for states ofneurons and neural systems to haverepresentational contents. Neurosemantics thusinvolves issues of common concern between thephilosophy of neuroscience and philosophy ofmind. I discuss a problem that arises foraccounts of representational content that Icall ``the economy problem'': the problem ofshowing that a candidate theory of mentalrepresentation can bear the work requiredwithin in the causal economy of a mind (...) and anorganism. My approach in the current paper isto explore this and other key themes inneurosemantics through the use of computermodels of neural networks embodied and evolvedin virtual organisms. The models allow for thelaying bare of the causal economies of entireyet simple artificial organisms so that therelations between the neural bases of, forinstance, representation in perception andmemory can be regarded in the context of anentire organism. On the basis of thesesimulations, I argue for an account ofneurosemantics adequate for the solution of theeconomy problem. (shrink)

Psychologically faithful deep neural networks (DNNs) could be constructed by training with psychophysics data. Moreover, conventional DNNs are mostly monocular vision based, whereas the human brain relies mainly on binocular vision. DNNs developed as smaller vision agent networks associated with fundamental and less intelligent visual activities, can be combined to simulate more intelligent visual activities done by the biological brain.

In today’s era of rapid development in science and technology, the development of digital technology has increasingly higher requirements for data processing functions. The matrix signal commonly used in engineering applications also puts forward higher requirements for processing speed. The eigenvalues of the matrix represent many characteristics of the matrix. Its mathematical meaning represents the expansion of the inherent vector, and its physical meaning represents the spectrum of vibration. The eigenvalue of a matrix is the focus of matrix theory. The (...) problem of matrix eigenvalues is widely used in many research fields such as physics, chemistry, and biology. A neural network is a neuron model constructed by imitating biological neural networks. Since it was proposed, the application research of its typical models, such as recurrent neural networks and cellular neural networks, has become a new hot spot. With the emergence of deep neural network theory, scholars continue to combine deep neural networks to calculate matrix eigenvalues. This article aims to study the estimation and application of matrix eigenvalues based on deep neural networks. This article introduces the related methods of matrix eigenvalue estimation based on deep neural networks, and also designs experiments to compare the time of matrix eigenvalue estimation methods based on deep neural networks and traditional algorithms. It was found that under the serial algorithm, the algorithm based on the deep neural network reduced the calculation time by about 7% compared with the traditional algorithm, and under the parallel algorithm, the calculation time was reduced by about 17%. Experiments are also designed to calculate matrix eigenvalues with Obj and recurrent neural networks (RNNS) models, which proves that the Oja algorithm is only suitable for calculating the maximum eigenvalues of non-negative matrices, while RNNS is commonly used in general models. (shrink)

Head direction (HD) cells, abundant in the rat postsubiculum and anterior thalamic nuclei, fire maximally when the rat’s head is facing a particular direction. The activity of a population of these cells forms a distributed representation of the animal’s current heading. We describe a neural network model that creates a stable, distributed representation of head direction and updates that representation in response to angular velocity information. In contrast to earlier models, our model of the head direction system accurately tracks (...) a series of actual rat head rotations, and, using biologically plausible neurons, it fits the single-cell tuning curves of real HD cells recorded from rats executing those same rotations. The model makes neurophysiological predictions that can be tested using current technologies. (shrink)

The TV show rating analysis and prediction system can collect and transmit information more quickly and quickly upload the information to the database. The convolutional neural network is a multilayer neural network structure that simulates the operating mechanism of biological vision systems. It is a neural network composed of multiple convolutional layers and downsampling layers sequentially connected. It can obtain useful feature descriptions from original data and is an effective method to extract features from data. At present, (...) convolutional neural networks have become a research hotspot in speech recognition, image recognition and classification, natural language processing, and other fields and have been widely and successfully applied in these fields. Therefore, this paper introduces the convolutional neural network structure to predict the TV program rating data. First, it briefly introduces artificial neural networks and deep learning methods and focuses on the algorithm principles of convolutional neural networks and support vector machines. Then, we improve the convolutional neural network to fit the TV program rating data and finally apply the two prediction models to the TV program rating data prediction. We improve the convolutional neural network TV program rating prediction model and combine the advantages of the convolutional neural network to extract effective features and good classification and prediction capabilities to improve the prediction accuracy. Through simulation comparison, we verify the feasibility and effectiveness of the TV program rating prediction model given in this article. (shrink)

We are living in a time of meta-organics and post-biology, where we perceive everything in our world as customizable and changeable. Modelling biology within a technological context allows us to investigate GEO-volutionary alternatives/alterations to our original natural systems, where augmentation and transmutation become standards in search of overall betterment (Genetically Engineered Organics). Our expectations for technology exceeds ubiquitous access and functional perfection and enters the world of technoetics, where our present hyper-functional, immersively multi-apped, borderline-prosthetic, global village devices fail to satiate (...) our desires to be synaptically surpassed. Most real-time interactive behavioural systems in art utilize two and three dimensions. Artificial neural networks and prediction (Latin: from pr- before plus dicere to say) systems give rise to experimentation within the third-plus-one (3+1) dimension of the spacetime continuum. Spacetime in accordance with string theory requires the where and when to describe something in existence, rather than mere points in space. It explains the workings of the universe from both super-galactic and subatomic levels. Physical cosmology studies the motions of the celestial bodies in relation to the first cause (ie. primum movens) or the source of all-being. In book 12 of Metaphysics, Aristotle spoke of something which moves without (itself) being moved (by anything), and referred to being as motion. In quantum mechanics, a particle is described by a wave. Physiognomy is an evolving area of psychological research that describes a direct correlation between human gesture (or movement) and thought. Early twentieth-century Persian philosopher Abdul-Baha mentioned that the reality of man is his thought, not his material body. Prediction systems apply models of the mind, or artificial neural networks and machine learning strategies, to use the recorded past with the present to anticipate the future. This article investigates existing human and artificial psychic systems in hopes of identifying tools necessary in building a gesture prediction system. The relationship of intent to gesture and whether intent can be perceived without the evidence of gesture are two factors that must be tested. (shrink)

This article develops a biosemiotic ´hyper-narrative model´ for the purposes of investigating emergent motor behaviors. It proposes to understand such behaviors in terms of the following associations: the organization of information acquired from the environment, focusing on narrative; the organizational dynamics of epigenetic mechanisms that underly the neural processes facilitating the processing of information; and the evolution of emergent motor behaviors that enable the informational acquisition. The article describes and explains these associations as part of a multi-ordered and multi-causal (...) generative principle of biological phenotype emergence that supersedes the theory of the arbitrary coding of life. Preceeding from narrative’s operations in a biological dimension, the article presents scientific research dealing with the associations of action-oriented organization of narrative information and underlying psychological and physiological dynamics and depicts the relations with a distributed multi-directional mapping dynamic. The article presents the explanatory implications of such a hyper-narrative dynamic model on an example of emergent motor behaviors – bruxism. Central to this discussion is the exploration of the possible mechanisms of emergence and etiopathogenesis of bruxism, based on its neurobiology. The article takes the perspective that complex systems dynamics themselves with a tendency to narrative form are found not to be underlain merely by arbitrary coded mechanisms but, rather, biological neural networks that render context-dependent bio-informational mapping analogous to that of the narrative possible. (shrink)

It is possible to predict future life forms? In this paper it is argued that the answer to this question may well be positive. As a basis for predictions a rationale is used that is derived from historical data, e.g. from a hierarchical classification that ranks all building block systems, that have evolved so far. This classification is based on specific emergent properties that allow stepwise transitions, from low level building blocks to higher level ones. This paper shows how this (...) hierarchy can be used for predicting future life forms.The extrapolations suggest several future neural network organisms. Major aspects of the structures of these organisms are predicted. The results can be considered of fundamental importance for several reasons. Firstly, assuming that the operator hierarchy is a proper basis for predictions, the result yields insight into the structure of future organisms. Secondly, the predictions are not extrapolations of presently observed trends, but are fully integrated with all historical system transitions in evolution. Thirdly, the extrapolations suggest the structures of intelligences that, one day, will possess more powerful brains than human beings.This study ends with a discussion of possibilities for falsification of the present theory, the implications of the present predictions in relation to recent developments in artificial intelligence and the philosophical implications of the role of humanity in evolution with regard to the creation of future neural network organisms. (shrink)