It is worthwhile to search for forms of coding, processing, and learning common to various cortical regions and cognitive functions. Local cortical processors may coordinate their activity by maximizing the transmission of information coherently related to the context in which it occurs, thus forming synchronized population codes. This coordination involves contextual field (CF) connections that link processors within and between cortical regions. The effects of CF connections are distinguished from those mediating receptive field (RF) input; it is (...) shown how CFs can guide both learning and processing without becoming confused with the transmission of RF information. Simulations explore the capabilities of networks built from local processors with both RF and CF connections. Physiological evidence for synchronization, CFs, and plasticity of the RF and CF connections is described. Coordination via CFs is related to perceptual grouping, the effects of context on contrast sensitivity, amblyopia, implicit influences of color in achromotopsia, object and word perception, and the discovery of distal environmental variables and their interactions through self-organization. Cortical computation could thus involve the flexible evaluation of relations between input signals by locally specialized but adaptive processors whose activity is dynamically associated and coordinated within and between regions through specialized contextual connections. Key Words: cell assemblies; cerebral cortex; context; coordination; dynamic binding; epistemology; functional specialization; learning; neural coding; neural computation; neuropsychology; object recognition; perception; reading; self-organization; synaptic plasticity; synchronization. (shrink)

The additional data, perspectives, questions, and criticisms contributed by the commentaries strengthen our view that local cortical processors coordinate their activity with the context in which it occurs using contextual fields and synchronized population codes. We therefore predict that whereas the specialization of function has been the keynote of this century the coordination of function will be the keynote of the next.

Phillips & Singer's compelling presentation is weakest in its demonstration of commonalities between sensory plasticity and higher forms of learning and behavior. We propose that available data on schizophrenia can provide such evidence, because of the presence of impairments in a number of functions central to their model, and strong relationships between these dysfunctions and behavior.

Simple hypotheses are intrinsically attractive, and, for this reason, need to be formulated with utmost precision if they are to be testable. Unfortunately, it is hard to see how Phillips & Singer's hypothesis might be unambiguously refuted. Despite this, the authors have provided much evidence consistent with the hypothesis, and have proposed a natural and powerful extension for information theoretic approaches to learning.

The question is, How does the brain make its mind? In Cognition, computation and consciousness [Ito et al. (Eds) (1997) Oxford & New York: Oxford University Press], a variety of noted theoreticians from the fields of cognitive psychology, computer science, and philosophy postulate answer-blueprints rather than full-blown explanatory solutions to this most nettlesome question. Coming to the problem from quite different starting points and perspectives, they nevertheless succeed in reaching consensus on the idea that the contingencies of the brain's (...) evolution have resulted in an organ that generates its mind by a complex process of information exchange among its constituents. Put in the vernacular, the brain produces its mind by having its parts, especially those most recently evolved, talk to each other. In this essay I take a critical look at proposals of several celebrated (neuro)scientists and philosophers in their specific areas of expertise. The underlying theme of brain component communication suggests the image of conversations in the cortex. From such cortical conversations arise selves (the mind/brain's I) and their stories and projects. This in turn suggests the idea that the brain is a stage where a Pirandello-like play is continually rehearsed. (shrink)

The cerebral cortex is a rich and diverse structure that is the basis of intelligent behavior. One of the deepest mysteries of the function of cortex is that neural processing times are only about one hundred times as fast as the fastest response times for complex behavior. At the very least, this would seem to indicate that the cortex does massive amounts of parallel computation.This paper explores the hypothesis that an important part of the cortex can be modeled as (...) a connectionist computer that is especially suited for parallel problem solving. The connectionist computer uses a special representation, termed value unit encoding, that represents small subsets of parameters in a way that allows parallel access to many different parameter values. This computer can be thought of as computing hierarchies of sensorimotor invariants. The neural substrate can be interpreted as a commitment to data structures and algorithms that compute invariants fast enough to explain the behavioral response times. A detailed consideration of this model has several implications for the underlying anatomy and physiology. (shrink)

Freeman's pioneering work -- and neurodynamics in general -- has largely ignored specification of an anatomical framework within which features of coherent objects are represented, associated, deleted, and manipulated in computations. Recent theoretical work suggests such a framework can emerge during embryogenesis by selection of neuron ensembles and synaptic connections that maximize the magnitude of synchrony while approaching ultra-small-world connectivity. The emergent structures correspond to those of both columnar and non-columnar cortex. With initial connections thus organized, spatio-temporal information in sensory (...) inputs can generate systematic and specific patterns of synchronous oscillation, with consequent synaptic storage. The theoretical assemblies of connections resemble experimentally observed 'lego sets', while facilitation and interference among synchronous patterns, particularly when executed by fast synapses under metabolic entanglement, imply powerful parallel computation. (shrink)

A fundamental characteristic of human visual perception is the ability to group together disparate elements in a scene and treat them as a single unit. The mechanisms by which humans create such groupings remain unknown, but grouping seems to play an important role in a wide variety of visual phenomena, and a good understanding of these mechanisms might provide guidance for how to improve machine vision algorithms. Here, we build on a proposal that some groupings are the result of connections (...) in cortical area V2 that join disparate elements, thereby allowing them to be selected and segmented together. In previous instantiations of this proposal, connection formation was based on the anatomy (e.g., extent) of receptive fields, which made connection formation obligatory when the stimulus conditions stimulate the corresponding receptive fields. We now propose dynamic circuits that provide greater flexibility in the formation of connections and that allow for top-down control of perceptual grouping. With computer simulations we explain how the circuits work and show how they can account for a wide variety of Gestalt principles of perceptual grouping, texture segmentation tasks, amodal illusory contours, and ratings of perceived groupings. We propose that human observers use such top-down control to implement task-dependent connection strategies that encourage particular groupings of stimulus elements in order to promote performance on various visual tasks. (shrink)

IntroductionSymptoms of schizophrenia are closely related to aberrant language comprehension and production. Macroscopic brain changes seen in some patients with schizophrenia are suspected to relate to impaired language production, but this is yet to be reliably characterized. Since heterogeneity in language dysfunctions, as well as brain structure, is suspected in schizophrenia, we aimed to first seek patient subgroups with different neurobiological signatures and then quantify linguistic indices that capture the symptoms of “negative formal thought disorder”.MethodsAtlas-based cortical thickness values of (...) 66 patients with first-episode psychosis and 36 healthy controls were analyzed with hierarchical clustering algorithms to produce neuroanatomical subtypes. We then examined the generated subtypes and investigated the quantitative differences in MRS-based glutamate levels [in the dorsal anterior cingulate cortex ] as well as in three aspects of language production features: fluency, syntactic complexity, and lexical cohesion.ResultsTwo neuroanatomical subtypes among patients were observed, one with near-normal cortical thickness patterns while the other with widespread cortical thinning. Compared to the subgroup of patients with relatively normal cortical thickness patterns, the subgroup with widespread cortical thinning was older, with higher glutamate concentration in dACC and produced speech with reduced mean length of T-units and lower repeats of content words, despite being equally fluent.ConclusionWe characterized a patient subgroup with thinner cortex in first-episode psychosis. This subgroup, identifiable through macroscopic changes, is also distinguishable in terms of neurochemistry and language behavior. This study supports the hypothesis that glutamate-mediated cortical thinning may contribute to a phenotype that is detectable using the tools of computational linguistics in schizophrenia. (shrink)

Background and ObjectivesFocal cortical dysplasia is a type of malformations of cortical development and one of the leading causes of drug-resistant epilepsy. Postoperative results improve the diagnosis of lesions on structural MRIs. Advances in quantitative algorithms have increased the identification of FCD lesions. However, due to significant differences in size, shape, and location of the lesion in different patients and a big deal of time for the objective diagnosis of lesion as well as the dependence of individual interpretation, (...) sensitive approaches are required to address the challenge of lesion diagnosis. In this research, a FCD computer-aided diagnostic system to improve existing methods is presented.MethodsMagnetic resonance imaging data were collected from 58 participants. Morphological and intensity-based features were calculated for each cortical surface and inserted into an artificial neural network. Statistical examinations evaluated classifier efficiency.ResultsNeural network evaluation metrics—sensitivity, specificity, and accuracy—were 96.7, 100, and 98.6%, respectively. Furthermore, the accuracy of the classifier for the detection of the lobe and hemisphere of the brain, where the FCD lesion is located, was 84.2 and 77.3%, respectively.ConclusionAnalyzing surface-based features by automated machine learning can give a quantitative and objective diagnosis of FCD lesions in presurgical assessment and improve postsurgical outcomes. (shrink)

It is sometimes suggested that the history of computation in cognitive science is one in which the formal apparatus of Turing-equivalent computation, or effective computability, was exported from mathematical logic to ever wider areas of cognitive science and its environs. This paper, however, indicates some respects in which this suggestion is inaccurate. Computability theory has not been focused exclusively on Turing-equivalent computation. Many essential features of Turing-equivalent computation are not captured in definitions of computation as (...) symbol manipulation. Turing-equivalent computation did not play the role in McCulloch and Pitts’s early cybernetic work that is sometimes attributed to it. Finally, various segments of the neuroscientific community invoke a notion of computation that differs from the Turing-equivalent notion.Keywords: Circular causality; Computation; Cortical maps; Neural networks; Symbol manipulation; Turing-equivalent computation. (shrink)

The segregation of image parts into foreground and background is an important aspect of the neural computation of 3D scene perception. To achieve such segregation, the brain needs information about border ownership; that is, the belongingness of a contour to a specific surface represented in the image. This article presents psychophysical data derived from 3D percepts of figure and ground that were generated by presenting 2D images composed of spatially disjoint shapes that pointed inward or outward relative to the (...) continuous boundaries that they induced along their collinear edges. The shapes in some images had the same contrast (black or white) with respect to the background gray. Other images included opposite contrasts along each induced continuous boundary. Psychophysical results demonstrate conditions under which figure-ground judgment probabilities in response to these ambiguous displays are determined by the orientation of contrasts only, not by their relative contrasts, despite the fact that many border ownership cells in cortical area V2 respond to a preferred relative contrast. Studies are also reviewed in which both polarity-specific and polarity-invariant properties obtain perceptual figure-ground grouping results. The FACADE and 3D LAMINART models are used to explain these data. Keywords: figure-ground separation, border ownership, perceptual grouping, surface filling-in, V2, V4, FACADE Theory. (shrink)

BackgroundPhysical activity is known to improve mental health, and is regarded as safe and desirable for uncomplicated pregnancy. In this novel study, we aim to evaluate whether there are associations between maternal physical activity during pregnancy and neonatal brain cortical development.MethodsForty-four mother/newborn dyads were included in this longitudinal study. Healthy pregnant women were recruited and their physical activity throughout pregnancy were documented using accelerometers worn for 3–7 days for each of the 6 time points at 4–10, ∼12, ∼18, ∼24, (...) ∼30, and ∼36 weeks of pregnancy. Average daily total steps and daily total activity count as well as daily minutes spent in sedentary/light/moderate/vigorous activity modes were extracted from the accelerometers for each time point. At ∼2 weeks of postnatal age, their newborns underwent an MRI examination of the brain without sedation, and 3D T1-weighted brain structural images were post-processed by the iBEAT2.0 software utilizing advanced deep learning approaches. Cortical surface maps were reconstructed from the segmented brain images and parcellated to 34 regions in each brain hemisphere, and mean cortical thickness for each region was computed for partial correlation analyses with physical activity measures, with appropriate multiple comparison corrections and potential confounders controlled.ResultsAt 4–10 weeks of pregnancy, mother’s daily total activity count positively correlated (FDR corrected P ≤ 0.05) with newborn’s cortical thickness in the left caudal middle frontal gyrus (rho = 0.48, P = 0.04), right medial orbital frontal gyrus (rho = 0.48, P = 0.04), and right transverse temporal gyrus (rho = 0.48, P = 0.04); mother’s daily time in moderate activity mode positively correlated with newborn’s cortical thickness in the right transverse temporal gyrus (rho = 0.53, P = 0.03). At ∼24 weeks of pregnancy, mother’s daily total activity count positively correlated (FDR corrected P ≤ 0.05) with newborn’s cortical thickness in the left (rho = 0.56, P = 0.02) and right isthmus cingulate gyrus (rho = 0.50, P = 0.05).ConclusionWe identified significant relationships between physical activity in healthy pregnant women during the 1st and 2nd trimester and brain cortical development in newborns. Higher maternal physical activity level is associated with greater neonatal brain cortical thickness, presumably indicating better cortical development. (shrink)

In cortical neurones, analogue dendritic potentials are thought to be encoded into patterns of digital spikes. According to this view, neuronal codes and computations are based on the temporal patterns of spikes: spike times, bursts or spike rates. Recently, we proposed an ‘action potential waveform code’ for cortical pyramidal neurones in which the spike shape carries information. Broader somatic action potentials are reliably produced in response to higher conductance input, allowing for four times more information transfer than spike (...) times alone. This information is preserved during synaptic integration in a single neurone, as back‐propagating action potentials of diverse shapes differentially shunt incoming postsynaptic potentials and so participate in the next round of spike generation. An open question has been whether the information in action potential waveforms can also survive axonal conduction and directly influence synaptic transmission to neighbouring neurones. Several new findings have now brought new light to this subject, showing cortical information processing that transcends the classical models. BioEssays 29: 178–187, 2007. © 2007 Wiley Periodicals, Inc. (shrink)

The electric activities of cortical pyramidal neurons are supported by structurally stable, morphologically complex axo-dendritic trees. Anatomical differences between axons and dendrites in regard to their length or caliber reflect the underlying functional specializations, for input or output of neural information, respectively. For a proper assessment of the computational capacity of pyramidal neurons, we have analyzed an extensive dataset of three-dimensional digital reconstructions from the NeuroMorphoOrg database, and quantified basic dendritic or axonal morphometric measures in different regions and layers (...) of the mouse, rat or human cerebral cortex. Physical estimates of the total number and type of ions involved in neuronal electric spiking based on the obtained morphometric data, combined with energetics of neurotransmitter release and signaling fueled by glucose consumed by the active brain, support highly efficient cerebral computation performed at the thermodynamically allowed Landauer limit for implementation of irreversible logical operations. Individual proton tunneling events in voltage-sensing S4 protein alpha-helices of Na+, K+ or Ca2+ ion channels are ideally suited to serve as single Landauer elementary logical operations that are then amplified by selective ionic currents traversing the open channel pores. This miniaturization of computational gating allows the execution of over 1.2 zetta logical operations per second in the human cerebral cortex without combusting the brain by the released heat. (shrink)

Background We report a randomised controlled clinical trial of neurofeedback therapy intervention for ADHD/ADD in adults. We focus on internal mechanics of neurofeedback learning, to elucidate the primary role of cortical self-regulation in neurofeedback. We report initial results; more extensive analysis will follow. Methods Trial has two phases: intervention and follow-up. The intervention consisted of neurofeedback treatment, including intake and outtake measurements, using a waiting-list control group. Treatment involved $\sim$40 hour-long sessions 2-5 times per week. Training involved either theta/beta (...) or sensorimotor-rhythm regimes, adapted by adding a novel 'inverse-training' condition to promote self-regulation. Follow-up (ongoing) will consist of self-report and executive function tests. Setting Intake and outtake measurements were conducted at University of Helsinki. Treatment was administered at partner clinic Mental Capital Care, Helsinki. Randomisation We randomly allocated half the sample then adaptively allocated the remainder to minimise baseline differences in prognostic variables. Blinding Waiting-list control design meant trial was not blinded. Participants 54 adult Finnish participants (mean age 36 years; 29 females) were recruited after screening by psychiatric review. 44 had ADHD diagnoses, 10 had ADD. Measurements Symptoms were assessed by computerised attention test (T.O.V.A.) and self-report scales, at intake and outtake. Performance during neurofeedback trials was recorded. Results Participants were recruited and completed intake measurements during summer 2012, before assignment to treatment and control, September 2012. Outtake measurements ran April-August 2013. After dropouts, 23 treatment and 21 waiting-list participants remained for analysis. Initial analysis showed that, compared to waiting-list control, neurofeedback promoted improvement of self-reported ADHD symptoms, but did not show transfer of learning to T.O.V.A. Comprehensive analysis will be reported elsewhere. Trial Registration "Computer Enabled Neuroplasticity Treatment (CENT)", ISRCTN13915109. Partly funded by Finnish science agency TEKES, project #440078. (shrink)

This paper presents a computer model of cortical broadcast and competition based on spiking neurons and inspired by the hypothesis of a global neuronal workspace underlying conscious information processing in the human brain. In the model, the hypothesised workspace is realised by a collection of recurrently inter-connected regions capable of sustaining and disseminating a reverberating spatial pattern of activation. At the same time, the workspace remains susceptible to new patterns arriving from outlying cortical populations. Competition among these (...) class='Hi'>cortical populations for influence on the workspace is effected by a combination of mutual inhibition and top-down amplification. (shrink)

Computer users are often the last line of defense in computer security. However, with repeated exposures to system messages and computer security warnings, neural and behavioral responses show evidence of habituation. Habituation has been demonstrated at a neural level as repetition suppression where responses are attenuated with subsequent repetitions. In the brain, repetition suppression to visual stimuli has been demonstrated in multiple cortical areas, including the occipital lobe and medial temporal lobe. Prior research into the repetition suppression effect has (...) generally focused on a single repetition and has not examined the pattern of signal suppression with repeated exposures. We used complex, everyday stimuli, in the form of images of computer programs or security warning messages, to examine the repetition suppression effect across repeated exposures. The use of computer warnings as stimuli also allowed us to examine the activation of learned fearful stimuli. We observed widespread linear decreases in activation with repeated exposures, suggesting that repetition suppression continues after the first repetition. Further, we found greater activation for warning messages compared to neutral images in the anterior insula, pre-supplemental motor area, and inferior frontal gyrus, suggesting differential processing of security warning messages. However, the repetition suppression effect was similar in these regions for both warning messages and neutral images. Additionally, we observed an increase of activation in the default mode network with repeated exposures, suggestive of increased mind wandering with continuing habituation. (shrink)

A central problem in the cognitive sciences is identifying the link between consciousness and neural computation. The key features of consciousness—including the emergence of representative information content and the initiation of volitional action—are correlated with neural activity in the cerebral cortex, but not computational processes in spinal reflex circuits or classical computing architecture. To take a new approach toward considering the problem of consciousness, it may be worth re‐examining some outstanding puzzles in neuroscience, focusing on differences between the cerebral (...) cortex and spinal reflex circuits. First, the mammalian cerebral cortex exhibits exascale computational power, a feature that is not strictly correlated with the number of binary computational units; second, individual computational units engage in noisy coding, allowing random electrical events to gate signaling outcomes; third, this noisy coding results in the synchronous firing of statistically random populations of cells across the neural network, at a range of nested frequencies; fourth, the system grows into a more ordered state over time, as it encodes the predictive value gained through observation; and finally, the cerebral cortex is extraordinarily energy efficient, with very little free energy lost to entropy during the work of information processing. Here, I argue that each of these five key features suggest the mammalian brain engages in probabilistic computation. Indeed, by modeling the physical mechanisms of probabilistic computation, we may find a better way to explain the unique emergent features arising from cortical neural networks. (shrink)

The abstract basis of modern computation is the formal description of a finite state machine, the Universal Turing Machine, based on manipulation of integers and logic symbols. In this contribution to the discourse on the computer-brain analogy, we discuss the extent to which analog computing, as performed by the mammalian brain, is like and unlike the digital computing of Universal Turing Machines. We begin with ordinary reality being a permanent dialog between continuous and discontinuous worlds. So it is with (...) computing, which can be analog or digital, and is often mixed. The theory behind computers is essentially digital, but efficient simulations of phenomena can be performed by analog devices; indeed, any physical calculation requires implementation in the physical world and is therefore analog to some extent, despite being based on abstract logic and arithmetic. The mammalian brain, comprised of neuronal networks, functions as an analog device and has given rise to artificial neural networks that are implemented as digital algorithms but function as analog models would. Analog constructs compute with the implementation of a variety of feedback and feedforward loops. In contrast, digital algorithms allow the implementation of recursive processes that enable them to generate unparalleled emergent properties. We briefly illustrate how the cortical organization of neurons can integrate signals and make predictions analogically. While we conclude that brains are not digital computers, we speculate on the recent implementation of human writing in the brain as a possible digital path that slowly evolves the brain into a genuine (slow) Turing machine. (shrink)

Neurofeedback (NF) aims to alter neural activity by enhancing self-regulation skills. Over the past decade NF has received considerable attention as a potential intervention option for many somatic and mental conditions and ADHD in particular. However, placebo-controlled trials have demonstrated insufficient superiority of NF compared to treatment as usual and sham conditions. It has been argued that the reason for limited NF effects may be attributable to participants' challenges to self-regulate the targeted neural activity. Still, there is support of NF (...) efficacy when only considering so-called “standard protocols,” such as Slow Cortical Potential NF training (SCP-NF). This PROSPERO registered systematic review following PRISMA criteria searched literature databases for studies applying SCP-NF protocols. Our review focus concerned the operationalization of self-regulatory success, and protocol-details that could influence the evaluation of self-regulation. Such details included; electrode placement, number of trials, length per trial, proportions of training modalities, handling of artifacts and skill-transfer into daily-life. We identified a total of 63 eligible reports published in the year 2000 or later. SCP-NF protocol-details varied considerably on most variables, except for electrode placement. However, due to the increased availability of commercial systems, there was a trend to more uniform protocol-details. Although, token-systems are popular in SCP-NF for ADHD, only half reported a performance-based component. Also, transfer exercises have become a staple part of SCP-NF. Furthermore, multiple operationalizations of regulatory success were identified, limiting comparability between studies, and perhaps usefulness of so-called transfer-exercises, which purpose is to facilitate the transfer of the self-regulatory skills into every-day life. While studies utilizing SCP as Brain-Computer-Interface mainly focused on the acquisition of successful self-regulation, clinically oriented studies often neglected this. Congruently, rates of successful regulators in clinical studies were mostly low (<50%). The relation between SCP self-regulation and behavior, and how symptoms in different disorders are affected, is complex and not fully understood. Future studies need to report self-regulation based on standardized measures, in order to facilitate both comparability and understanding of the effects on symptoms. When applied as treatment, future SCP-NF studies also need to put greater emphasis on the acquisition of self-regulation (before evaluating symptom outcomes).Systematic review registrationhttps://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021260087, Identifier: CRD42021260087. (shrink)

Physical fatigue negatively affects postural control, resulting in impaired balance performance in young and older adults. Similar effects on postural control can be observed for mental fatigue mainly in older adults. Controversial results exist for young adults. There is a void in the literature on the effects of fatigue on balance and cortical activity. Therefore, this study aimed to examine the acute effects of PF and MF on postural sway and cortical activity. Fifteen healthy young adults aged 28 (...) ± 3 years participated in this study. MF and PF protocols comprising of an all-out repeated sit-to-stand task and a computer-based attention network test, respectively, were applied in random order. Pre and post fatigue, cortical activity and postural sway were tested during a challenging bipedal balance board task. Absolute spectral power was calculated for theta, alpha-2, beta-1, and beta-2 in frontal, central, and parietal regions of interest and baseline-normalized. Inference statistics revealed a significant time-by-fatigue interaction for CoPd and CoPv, and a significant main effect of time for CoP variability. Post hoc analyses showed a significant increase in CoPd and CoPv following PF but not MF. For cortical activity, a significant time-by-fatigue interaction was found for relative alpha-2 power in parietal areas. Post hoc tests indicated larger alpha-2 power increases after PF compared to MF. In addition, changes in parietal alpha-2 power and measures of postural sway did not correlate significantly, irrespective of the applied fatigue protocol. No significant changes were found for the other frequency bands, irrespective of the fatigue protocol and ROI under investigation. Thus, the applied PF protocol resulted in increased postural sway and CoP variability accompanied by enhanced alpha-2 power in the parietal ROI while MF led to increased CoP variability and alpha-2 power in our sample of young adults. Potential underlying cortical mechanisms responsible for the greater increase in parietal alpha-2 power after PF were discussed but could not be clearly identified as cause. Therefore, further future research is needed to decipher alternative interpretations. (shrink)

The attempt to derive mental function from brain structure is highly constrained by study of the allometric changes among brain components with evolution. In particular, even if homologous structures in different species produce similar computations, they may be constituents of larger systems (e.g., cortical-subcortical loops) that exhibit different composite operations as a function of relative size and connectivity in different-sized brains. The resulting evolutionary constraints set useful and specific conditions on candidate hypotheses of brain circuit computation.

The discrepancy between syntax and semantics is a painstaking issue that hinders a better comprehension of the underlying neuronal processes in the human brain. In order to tackle the issue, we at first describe a striking correlation between Wittgenstein's Tractatus, that assesses the syntactic relationships between language and world, and Perlovsky's joint language-cognitive computational model, that assesses the semantic relationships between emotions and “knowledge instinct”. Once established a correlation between a purely logical approach to the language and computable psychological activities, (...) we aim to find the neural correlates of syntax and semantics in the human brain. Starting from topological arguments, we suggest that the semantic properties of a proposition are processed in higher brain's functional dimensions than the syntactic ones. In a fully reversible process, the syntactic elements embedded in Broca's area project into multiple scattered semantic cortical zones. The presence of higher functional dimensions gives rise to the increase in informational content that takes place in semantic expressions. Therefore, diverse features of human language and cognitive world can be assessed in terms of both the logic armor described by the Tractatus, and the neurocomputational techniques at hand. One of our motivations is to build a neuro-computational framework able to provide a feasible explanation for brain's semantic processing, in preparation for novel computers with nodes built into higher dimensions. (shrink)

Predictive processing as a computational motif of the neocortex needs to be elaborated into theories of higher cognitive functions that include simulating future behavioural outcomes. We contribute to the neuroscientific perspective of predictive processing as a foundation for the proposed representational architectures of the mind.

Isolated feedforward networks (FFNs) of spiking neurons have been studied extensively for their ability to propagate transient synchrony and asynchronous firing rates, in the presence of activity independent synaptic background noise (Diesmann et al., 1999; van Rossum et al., 2002). In a biologically realistic scenario, however, the FFN should be embedded in a recurrent network, such that the activity in the FFN and the network activity may dynamically interact. Previously, transient synchrony propagating in an FFN was found to destabilize the (...) dynamics of the embedding network (Mehring et al., 2003). Here, we show that by modeling synapses as conductance transients, rather than current sources, it is possible to embed and propagate transient synchrony in the FFN, without destabilizing the background network dynamics. However, the network activity has a strong impact on the type of activity that can be propagated in the embedded FFN. Global synchrony and high firing rates in the embedding network prohibit the propagation of both, synchronous and asynchronous spiking activity. In contrast, asynchronous low-rate network states support the propagation of both, synchronous spiking and asynchro- nous, but only low firing rates. In either case, spiking activity tends to synchronize as it propagates, challenging the feasibility to transmit information in asynchronous firing rates. Finally, asynchronous network activity allows to embed more than one FFN, with the amount of cross talk depending on the degree of overlap in the FFNs. This opens the possibility of computational mechanisms using transient synchrony among the activities in multiple FFNs. (shrink)

People with post-stroke motor aphasia know what they would like to say but cannot express it through motor pathways due to disruption of cortical circuits. We present a theoretical background for our hypothesized connection between attention and aphasia rehabilitation and suggest why in this context, Brain-Computer Interfaces (BCI) use might be beneficial for patients diagnosed with aphasia. Not only could BCI technology provide a communication tool, it might support neuronal plasticity by activating language circuits and thereby boost aphasia recovery. (...) However, stroke may lead to heterogeneous symptoms that might hinder BCI use which is why the feasibility of this approach needed to be investigated first. In this pilot study, we included five participants diagnosed with post-stroke aphasia. Four participants were initially unable to use the visual P300 speller paradigm. By adjusting the paradigm to their needs, all participants could successfully learn to use the speller for communication with accuracies up to 100%. We describe necessary adjustments to the paradigm and present future steps to further investigate the here presented approach. (shrink)

Based on theoretical considerations of Aurell (1979) and Block (1995), we argue that object recognition awareness is distinct from purely sensory awareness and that the former is mediated by neuronal activities in areas that are separate and distinct from cortical sensory areas. We propose that two of the principal functions of neuronal activities in sensory cortex, which are to provide sensory awareness and to effect the computations that are necessary for object recognition, are dissociated. We provide examples of how (...) this dissociation might be achieved and argue that the components of the neuronal activities which carry the computations do not directly enter the awareness of the subject. The results of these computations are sparse representations (i.e., vector or distributed codes) which are activated by the presentation of particular sensory objects and are essentially engrams for the recognition of objects. These final representations occur in the highest order areas of sensory cortex; in the visual analyzer, the areas include the anterior part of the inferior temporal cortex and the perirhinal cortex. We propose, based on lesion and connectional data, that the two areas in which activities provide recognition awareness are the temporopolar cortex and the medial orbitofrontal cortex. Activities in the temporopolar cortex provide the recognition awareness of objects learned in the remote past (consolidated object recognition), and those in the medial orbitofrontal cortex provide the recognition awareness of objects learned in the recent past. The activation of the sparse representation for a particular sensory object in turn activates neurons in one or both of these regions of cortex, and it is the activities of these neurons that provide the awareness of recognition of the object in question. The neural circuitry involved in the activation of these representations is discussed. (shrink)

A fundamental question in visual neuroscience is: Why are the response properties of visual neurons as they are? A modern approach to this problem emphasizes the importance of adaptation to ecologically valid input, and it proceeds by modeling statistical regularities in ecologically valid visual input (natural images). A seminal model was linear sparse coding, which is equivalent to independent component analysis (ICA), and provided a very good description of the receptive fields of simple cells. Further models based on modeling residual (...) dependencies of the ‘‘independent” components have later been introduced. These models lead to emergence of further properties of visual neurons: the complex cell receptive fields, the spatial organization of the cells, and some surround suppression and Gestalt effects. So far, these models have concentrated on the response properties of neurons, but they hold great potential to model various forms of inference and learning. (shrink)

Contextual signals might supervise the discovery of coherently varying information between cortical modules computing different functions of their receptive field input. This hypothesis is explored in two sets of computational experiments, one studying the effects on learning of long-range unidirectional contextual signals mediated by intervening processors, and the other showing contextually supervised discovery of a high-order variable in a multilayer network.

Entropy-based algorithms have been suggested as robust estimators of electroencephalography (EEG) predictability or regularity. This study aimed to examine possible disturbances in EEG complexity as a means to elucidate the pathophysiological mechanisms in chronic stroke, before and after a brain computer interface (BCI)-motor observation intervention. Eleven chronic stroke subjects and nine unimpaired subjects were recruited to examine the differences in their EEG complexity. The BCI-motor observation intervention was designed to promote functional recovery of the hand in stroke subjects. Fuzzy approximate (...) entropy (fApEn), a novel entropy-based algorithm designed to evaluate complexity in physiological systems, was applied to assess the EEG signals acquired from unimpaired subjects and stroke subjects, both before and after training. The results showed that stroke subjects had significantly lower EEG fApEn than unimpaired subjects (p < 0.05) in the motor cortex area of the brain (C3, C4, FC3, FC4, CP3, CP4) in both hemispheres before training. After training, motor function of the paretic upper limb, assessed by the Fugl-Meyer Assessment-Upper Limb (FMA-UL), Action Research Arm Test (ARAT), and Wolf Motor Function Test (WMFT) improved significantly (p < 0.05). Furthermore, the EEG fApEn in stroke subjects increased considerably in the central area of the contralesional hemisphere after training (p < 0.05). A significant correlation was noted between clinical scales (FMA-UL, ARAT, and WMFT) and EEG fApEn in C3/C4 in the contralesional hemisphere (p < 0.05). This finding suggests that the increase in EEG fApEn could be an estimator of the variance in upper limb motor function improvement. In summary, fApEn can be used to identify abnormal EEG complexity in chronic stroke, when used with BCI-motor observation training. Moreover, these findings based on the fApEn of EEG signals also expand the existing interpretation of training-induced functional improvement in stroke subjects. Entropy-based analysis might serve as a novel approach to understanding the abnormal cortical dynamics of stroke and the neurological changes induced by rehabilitation training. (shrink)

Self-initiated action effects are often perceived as less intense than identical but externally generated stimuli. It is thought that forward models within the sensorimotor system pre-activate cortical representations of predicted action effects, reducing perceptual sensitivity and attenuating neural responses. As self-agency and predictability are seldom manipulated simultaneously in behavioral experiments, it is unclear if self-other differences depend on predictable action effect contingencies, or if both self- and externally generated stimuli are modulated similarly by predictability. We factorially combined variation in (...) predictability of action effects, spatial congruence, and performance by the self or computer to dissociate these influences on a visual discrimination task. Participants performed 2AFC speed judgments. Self-initiated motion was judged to be slower than computer-initiated motion when action effect contingencies were predictable, while spatial congruence influenced speed judgments only when action effect contingencies were unpredictable. Results are discussed in relation to current theories of sensory attenuation. (shrink)

The relationship between the neurobiology of speech and music has been investigated for more than a century. There remains no widespread agreement regarding how (or to what extent) music perception utilizes the neural circuitry that is engaged in speech processing, particularly at the cortical level. Prominent models such as Patel’s Shared Syntactic Integration Resource Hypothesis (SSIRH) and Koelsch’s neurocognitive model of music perception suggest a high degree of overlap, particularly in the frontal lobe, but also perhaps more distinct representations (...) in the temporal lobe with hemispheric asymmetries. The present meta-analysis study used activation likelihood estimate analyses to identify the brain regions consistently activated for music as compared to speech across the functional neuroimaging (fMRI and PET) literature. Eighty music and 91 speech neuroimaging studies of healthy adult control subjects were analyzed. Peak activations reported in the music and speech studies were divided into four paradigm categories: passive listening, discrimination tasks, error/anomaly detection tasks and memory-related tasks. We then compared activation likelihood estimates within each category for music versus speech, and each music condition with passive listening. We found that listening to music and to speech preferentially activate distinct temporo-parietal bilateral cortical networks. We also found music and speech to have shared resources in the left pars opercularis but speech-specific resources in the left pars triangularis. The extent to which music recruited speech-activated frontal resources was modulated by task. While there are certainly limitations to meta-analysis techniques particularly regarding sensitivity, this work suggests that the extent of shared resources between speech and music may be task-dependent and highlights the need to consider how task effects may be affecting conclusions regarding the neurobiology of speech and music. (shrink)

In philosophy of language, a distinction has been proposed between two aspects of lexical competence, i.e. referential and inferential competence (Marconi 1997). The former accounts for the relationship of words to the world, the latter for the relationship of words among themselves. The distinction may simply be a classification of patterns of behaviour involved in ordinary use of the lexicon. Recent research in neuropsychology and neuroscience, however, suggests that the distinction might be neurally implemented, i.e., that different cognitive architectures with (...) partly distinct neural realizations might be responsible for cognitive performances involving inferential and referential aspects of semantics. This hypothesis is strongly consistent with patient data supporting the notion of a functional double dissociation between inferential and referential abilities, and with a set of direct cortical mapping studies and neuroimaging experiments suggesting that inferential and referential abilities are underpinned by at least partly different regions of the human brain (e.g., Marconi et al. 2013; review in Calzavarini 2017). The initial hypotheses formulated in the setting of the philosophy of language, along with the neuropsychological experimental evidence (about how referential and inferential competences may be neurally instantiated) can be the input to computational modelling activities involving the inferential and the referential aspects of lexical competence. The aim of the talk is to offer a critical discussion of the kind of formalisms that can be used to model the two aspects of lexical competence, and of the main difficulties related to the use of these computational techniques. -/- Inferential (=symbolic) vs referential (=connectionist) formalisms. (shrink)

I propose that primary conscious awareness arises from synchronized activity in dendrites of neurons in dorsal thalamic nuclei, mediated particularly by inhibitory interactions with thalamic reticular neurons. In support, I offer four evidential pillars: consciousness is restricted to the results of cortical computations; thalamus is the common locus of action of brain injury in vegetative state and of general anesthetics; the anatomy and physiology of the thalamus imply a central role in consciousness; neural synchronization is a neural correlate of (...) consciousness. (shrink)

The neural substrates of context effects in word perception are still largely unclear. Interhemispheric priming phenomena in word recognition, typically observed in normal subjects, are absent in commissurotomized patients. This suggests that callosal fibers may provide contextual integration. In addition, certain characteristics of human frontal cortical fields subserving sensorimotor learning, as investigated by positron emission tomography, provide evidence for contextual integration not confined to the visual system. This supports the notion of common aspects of cortical computations in different (...) cerebral areas. (shrink)

The cerebral cortex is a rich and diverse structure that is the basis of intelligent behavior. One of the deepest mysteries of the function of cortex is that neural processing times are only about one hundred times as fast as the fastest response times for complex behavior. At the very least, this would seem to indicate that the cortex does massive amounts of parallel computation.This paper explores the hypothesis that an important part of the cortex can be modeled as (...) a connectionist computer that is especially suited for parallel problem solving. The connectionist computer uses a special representation, termed value unit encoding, that represents small subsets of parameters in a way that allows parallel access to many different parameter values. This computer can be thought of as computing hierarchies of sensorimotor invariants. The neural substrate can be interpreted as a commitment to data structures and algorithms that compute invariants fast enough to explain the behavioral response times. A detailed consideration of this model has several implications for the underlying anatomy and physiology. (shrink)

Recent computational models of perception conceptualize auditory oddball responses as signatures of a learning process, in line with the influential view of the mismatch negativity as a prediction error signal. Novel MMN experimental paradigms have put an emphasis on neurophysiological effects of manipulating regularity and predictability in sound sequences. This raises the question of the contextual adaptation of the learning process itself, which on the computational side speaks to the mechanisms of gain-modulated prediction error. In this study using electrocorticographic signals, (...) we manipulated the predictability of oddball sound sequences with two objectives: Uncovering the computational process underlying trial-by-trial variations of the cortical responses. The fluctuations between trials, generally ignored by approaches based on averaged evoked responses, should reflect the learning involved. We used a general linear model and Bayesian Model Reduction to assess the respective contributions of experimental manipulations and learning mechanisms under probabilistic assumptions. To validate and expand on previous findings regarding the effect of changes in predictability using simultaneous EEG-MEG recordings. Our trial-by-trial analysis revealed only a few stimulus-responsive sensors but the measured effects appear to be consistent over subjects in both time and space. In time, they occur at the typical latency of the MMN. In space, we found a dissociation between time-independent effects in more anterior temporal locations and time-dependent effects in more posterior locations. However, we could not observe any clear and reliable effect of our manipulation of predictability modulation onto the above learning process. Overall, these findings clearly demonstrate the potential of trial-to-trial modeling to unravel perceptual learning processes and their neurophysiological counterparts. (shrink)

Differences in socioeconomic status (SES) correlate both with differences in cognitive development and in brain structure. Associations between SES and brain measures such as cortical surface area and cortical thickness mediate differences in cognitive skills such as executive function and language. However, causal accounts that link SES, brain, and behavior are challenging because SES is a multidimensional construct: correlated environmental factors, such as family income and parental education, are only distal markers for proximal causal pathways. Moreover, the causal (...) accounts themselves must span multiple levels of description, employ a developmental perspective, and integrate genetic effects on individual differences. Nevertheless, causal accounts have the potential to inform policy and guide interventions to reduce gaps in developmental outcomes. In this article, we review the range of empirical data to be integrated in causal accounts of developmental effects on the brain and cognition associated with variation in SES. We take the specific example of language development and evaluate the potential of a multiscale computational model of development, based on an artificial neural network, to support the construction of causal accounts. We show how, with bridging assumptions that link properties of network structure to magnetic resonance imaging (MRI) measures of brain structure, different sets of empirical data on SES effects can be connected. We use the model to contrast two possible causal pathways for environmental influences that are associated with SES: differences in prenatal brain development and differences in postnatal cognitive stimulation. We then use the model to explore the implications of each pathway for the potential to intervene to reduce gaps in developmental outcomes. The model points to the cumulative effects of social disadvantage on multiple pathways as the source of the poorest response to interventions. Overall, we highlight the importance of implemented models to test competing accounts of environmental influences on individual differences. (shrink)

This article responds to two unresolved and crucial problems of cognitive science: (1) What is actually accomplished by functions of the nervous system that we ordinarily describe in the intentional idiom? and (2) What makes the information processing involved in these functions semantic? It is argued that, contrary to the assumptions of many cognitive theorists, the computational approach does not provide coherent answers to these problems, and that a more promising start would be to fall back on mathematical communication theory (...) and, with the help of evolutionary biology and neurophysiology, to attempt a characterization of the adaptive processes involved in visual perception. Visual representations are explained as patterns of cortical activity that are enabled to focus on objects in the changing visual environment by constantly adjusting to maintain levels of mutual information between pattern and object that are adequate for continuing perceptual control. In these terms, the answer proposed to (1) is that the intentional functions of vision are those involved in the establishment and maintenance of such representations, and to (2) that semantic features are added to the information processes of vision with the focus on objects that these representations accomplish. The article concludes with proposals for extending this account of intentionality to the higher domains of conceptualization and reason, and with speculation about how semantic information-processing might be achieved in mechanical systems. (shrink)

Neural plasticity has been invoked as a powerful argument against nativism. However, there is a line of argument, which is well exemplified by Pinker and more recently by Laurence and Margolis The conceptual mind: new directions in the study of concepts, MIT, Cambridge, 2015) with respect to concept nativism, according to which even extreme cases of plasticity show important innate constraints, so that one should rather speak of “constrained plasticity”. According to this view, cortical areas are not really equipotential, (...) they perform instead different kinds of computation, follow essentially different learning rules, or have a fixed internal structure acting as a filter for specific categories of inputs. We intend to analyze this argument, in the light of a review of current neuroscientific literature on plasticity. Our conclusion is that Laurence and Margolis are right in their appeal to innate constraints on connectivity—a thesis that is nowadays welcome to both nativists and non-nativists —but there is little support for their claim of further innate differentiation between and within cortical areas. As we will show, there is instead strong evidence that the cortex is characterized by the indefinite repetition of substantially identical computational units, giving rise in any of its portions to Hebbian, input-dependent plasticity. Although this is entirely compatible with the existence of innate constraints on the brain’s connectivity, the cerebral cortex architecture based on a multiplicity of maps correlating with one another has important computational consequences, a point that has been underestimated by traditional connectionist approaches. (shrink)

“The Matrix is a computer-generated dreamworld built to keep us under control” Morpheus, early in The Matrix. “ In dreaming, you are not only out of control, you don’t even know it…I was completely duped again and again the minute my pons, my amygdala, my perihippocampal cortex, my anterior cingulate, my visual association and parietal opercular cortices were revved up and my dorsolateral prefrontal cortex was muffled” ” J. Allan Hobson, The Dream Drugstore, p.64 The Matrix is an exercise in (...) ambivalence, and at the very heart of that ambivalence lies the Dream. In our dreams, we are not in control. Real dreaming, unlike many popular philosophers’ fictions, is an altered state, closely related to the states induced by chemical manipulations such as the use of (certain) medical or recreational drugs. The dreaming brain is not like the wakeful brain. Normal sensory input is blocked, attentional capacities are impaired or lost, memory is distorted, reasoning and logic are weakened, narratives run wild, self-reflection is dampened or destroyed, emotion and instinct are hyperstimulated, and forms of ‘top-down’ willed control and decision-making diluted and easily overwhelmed. (shrink)

The human urge to represent the three-dimensional world using two-dimensional pictorial representations dates back at least to Paleolithic times. Artists from ancient to modern times have struggled to understand how a few contours or color patches on a flat surface can induce mental representations of a three-dimensional scene. This article summarizes some of the recent breakthroughs in scientifically understanding how the brain sees that shed light on these struggles. These breakthroughs illustrate how various artists have intuitively understand paradoxical properties about (...) how the brain sees, and have used that understanding to create great art. These paradoxical properties arise from how the brain forms the units of conscious visual perception; namely, representations of threedimensional boundaries and surfaces. Boundaries and surfaces are computed in parallel cortical processing streams that obey computationally complementary properties. These streams interact at multiple levels to overcome their complementary weaknesses and to transform their complementary properties into consistent percepts. The article describes how properties of complementary consistency have guided the creation of many great works of art. (shrink)

An increasing number of research teams are investigating the efficacy of brain-computer interface (BCI)-mediated interventions for promoting motor recovery following stroke. A growing body of evidence suggests that of the various BCI designs, most effective are those that deliver functional electrical stimulation (FES) of upper extremity (UE) muscles contingent on movement intent. More specifically, BCI-FES interventions utilize algorithms that isolate motor signals—user-generated intent-to-move neural activity recorded from cerebral cortical motor areas—to drive electrical stimulation of individual muscles or muscle synergies. (...) BCI-FES interventions aim to recover sensorimotor function of an impaired extremity by facilitating and/or inducing long-term motor learning-related neuroplastic changes in appropriate control circuitry. We developed a non-invasive, electroencephalogram (EEG)-based BCI-FES system that delivers closed-loop neural activity-triggered electrical stimulation of targeted distal muscles while providing the user with multimodal sensory feedback. This BCI-FES system consists of three components: (1) EEG acquisition and signal processing to extract real-time volitional and task-dependent neural command signals from cerebral cortical motor areas, (2) FES of muscles of the impaired hand contingent on the motor cortical neural command signals, and (3) multimodal sensory feedback associated with performance of the behavioral task, including visual information, linked activation of somatosensory afferents through intact sensorimotor circuits, and electro-tactile stimulation of the tongue. In this report, we describe device parameters and intervention protocols of our BCI-FES system which, combined with standard physical rehabilitation approaches, has proven efficacious in treating UE motor impairment in stroke survivors, regardless of level of impairment and chronicity. (shrink)

Neurosemantics is not yet a common term and in current neuroscience and philosophy it is used with two different sorts of objectives. One deals with the meaning of the electrical and the chemical activities going on in neural circuits. This way of using the term regards the project of explaining linguistic meaning in terms of the computations done by the brain. This book explores this second sense of neurosemantics, but in doing so, it will address much of the first as (...) well, for we believe that the capacity of neural circuits to support linguistic meaning, hinges on their peculiar role in coding entities and facts of the world. It is an enterprise at the edge of the available state-of-the-art knowledge in neuroscience and specifically, in the growing understanding of brain computational mechanisms. We conceive neurosemantics, however, as the natural evolution of a long standing project that began in the early days of Boole’s logic, the idea that semantics can be construed and explained in mathematical terms. Classical formal semantics, for a very long time, excluded from the analysis of language any account of mental processes, which on the contrary, became the central focus during the cognitive turn. Cognitive semantics, however, failed to provide a rigorous mathematical framework for semantic processes. Today, it is possible to begin explaining language by way of a new mathematical foundation, one that is empirically grounded in how the brain computes: neurosemantics. The way this book intends to contribute is twofold. One is to present a series of existing examples of neurosemantics in practice: early models addressing aspects of linguistic semantics purely in neurocomputational terms. The other is to try to identify the principles upon which models of this kind can be constructed, and their corresponding neural bases. (shrink)