It is widely assumed that language in some form or other originated by piggybacking on pre-existing learning mechanism not dedicated to language. Using evolutionary connectionist simulations, we explore the implications of such assumptions by determining the effect of constraints derived from an earlier evolved mechanism for sequential learning on the interaction between biological and linguistic adaptation across generations of language learners. Artificial neural networks were initially allowed to evolve “biologically” to improve their sequential learning abilities, after which language (...) was introduced into the population. We compared the relative contribution of biological and linguistic adaptation by allowing both networks and language to change over time. The simulation results support two main conclusions: First, over generations, a consistent head-ordering emerged due to linguistic adaptation. This is consistent with previous studies suggesting that some apparently arbitrary aspects of linguistic structure may arise from cognitive constraints on sequential learning. Second, when networks were selected to maintain a good level of performance on the sequential learning task, language learnability is significantly improved by linguistic adaptation but not by biological adaptation. Indeed, the pressure toward maintaining a high level of sequential learning performance prevented biological assimilation of linguistic-specific knowledge from occurring. (shrink)

It is widely assumed that language in some form or other originated by piggybacking on pre-existing learning mechanism not dedicated to language. Using evolutionary connectionist simulations, we explore the implications of such assumptions by determining the effect of constraints derived from an earlier evolved mechanism for sequential learning on the interaction between biological and linguistic adaptation across generations of language learners. Artificial neural networks were initially allowed to evolve “biologically” to improve their sequential learning abilities, after which language (...) was introduced into the population. We compared the relative contribution of biological and linguistic adaptation by allowing both networks and language to change over time. The simulation results support two main conclusions: First, over generations, a consistent head-ordering emerged due to linguistic adaptation. This is consistent with previous studies suggesting that some apparently arbitrary aspects of linguistic structure may arise from cognitive constraints on sequential learning. Second, when networks were selected to maintain a good level of performance on the sequential learning task, language learnability is significantly improved by linguistic adaptation but not by biological adaptation. Indeed, the pressure toward maintaining a high level of sequential learning performance prevented biological assimilation of linguistic-specific knowledge from occurring. (shrink)

Sequential action makes up the bulk of human daily activity, and yet much remains unknown about how people learn such actions. In one motor learning paradigm, the serial reaction time (SRT) task, people are taught a consistent sequence of button presses by cueing them with the next target response. However, the SRT task only records keypress response times to a cued target, and thus it cannot reveal the full time‐course of motion, including predictive movements. This paper describes a mouse (...) movement trajectory SRT task in which the cursor must be moved to a cued location. We replicated keypress SRT results, but also found that predictive movement—before the next cue appears—increased during the experiment. Moreover, trajectory analyses revealed that people developed a centering strategy under uncertainty. In a second experiment, we made prediction explicit, no longer cueing targets. Thus, participants had to explore the response alternatives and learn via reinforcement, receiving rewards and penalties for correct and incorrect actions, respectively. Participants were not told whether the sequence of stimuli was deterministic, nor if it would repeat, nor how long it was. Given the difficulty of the task, it is unsurprising that some learners performed poorly. However, many learners performed remarkably well, and some acquired the full 10‐item sequence within 10 repetitions. Comparing the high‐ and low‐performers’ detailed results in this reinforcement learning (RL) task with the first experiment's cued trajectory SRT task, we found similarities between the two tasks, suggesting that the effects in Experiment 1 are due to predictive, rather than reactive processes. Finally, we found that two standard model‐free reinforcement learning models fit the high‐performing participants, while the four low‐performing participants provide better fit with a simple negative recency bias model. (shrink)

Prediction‐based processes appear to play an important role in language. Few studies, however, have sought to test the relationship within individuals between prediction learning and natural language processing. This paper builds upon existing statistical learning work using a novel paradigm for studying the on‐line learning of predictive dependencies. Within this paradigm, a new “prediction task” is introduced that provides a sensitive index of individual differences for developing probabilistic sequential expectations. Across three interrelated experiments, the prediction task and results thereof (...) are used to bridge knowledge of the empirical relation between statistical learning and language within the context of nonadjacency processing. We first chart the trajectory for learning nonadjacencies, documenting individual differences in prediction learning. Subsequent simple recurrent network simulations then closely capture human performance patterns in the new paradigm. Finally, individual differences in prediction performances are shown to strongly correlate with participants’ sentence processing of complex, long‐distance dependencies in natural language. (shrink)

This paper presents a novel learning model Clarion , which is a hybrid model based on the two-level approach proposed in Sun (1995). The model integrates neural, reinforcement, and symbolic learning methods to perform on-line, bottom-up learning (i.e., learning that goes from neural to symbolic representations). The model utilizes both procedural and declarative knowledge (in neural and symbolic representations respectively), tapping into the synergy of the two types of processes. It was applied to deal with sequential decision tasks. Experiments (...) and analyses in various ways are reported that shed light on the advantages of the model. (shrink)

Learning the structure of event sequences is a ubiquitous problem in cognition and particularly in language. One possible solution is to learn a probabilistic generative model of sequences that allows making predictions about upcoming events. Though appealing from a neurobiological standpoint, this approach is typically not pursued in connectionist modeling. Here, we investigated a sequential version of the restricted Boltzmann machine, a stochastic recurrent neural network that extracts high-order structure from sensory data through unsupervised generative learning and can encode (...) contextual information in the form of internal, distributed representations. We assessed whether this type of network can extract the orthographic structure of English monosyllables by learning a generative model of the letter sequences forming a word training corpus. We show that the network learned an accurate probabilistic model of English graphotactics, which can be used to make predictions about the letter following a given context as well as to autonomously generate high-quality pseudowords. The model was compared to an extended version of simple recurrent networks, augmented with a stochastic process that allows autonomous generation of sequences, and to non-connectionist probabilistic models. We conclude that sequential RBMs and stochastic simple recurrent networks are promising candidates for modeling cognition in the temporal domain. (shrink)

We deal with situations incongruent with our automatic response tendencies much better right after having done so on a previous trial than after having reacted to a congruent trial. The nature of the mechanisms responsible for these sequential congruency effects is currently a hot topic of debate. According to the conflict monitoring model these effects depend on the adjustment of control triggered by the detection of conflict on the preceding situation. We tested whether these conflict monitoring processes can operate (...) implicitly in an implicit learning procedure, modulating the expression of knowledge of which participants are not aware. We reanalyze recently published data, and present an experiment with a probabilistic sequence learning procedure, both showing consistent effects of implicit sequence learning. Despite being implicit, the expression of learning was reduced or completely eliminated right after trials incongruent with the learned sequence, thus showing that sequential congruency effects can be obtained even when the source of congruency itself remains implicit. (shrink)

We introduce a set of biologically and computationally motivated design choices for modeling the learning of language, or of other types of sequential, hierarchically structured experience and behavior, and describe an implemented system that conforms to these choices and is capable of unsupervised learning from raw natural-language corpora. Given a stream of linguistic input, our model incrementally learns a grammar that captures its statistical patterns, which can then be used to parse or generate new data. The grammar constructed in (...) this manner takes the form of a directed weighted graph, whose nodes are recursively (hierarchically) defined patterns over the elements of the input stream. We evaluated the model in seventeen experiments, grouped into five studies, which examined, respectively, (a) the generative ability of grammar learned from a corpus of natural language, (b) the characteristics of the learned representation, (c) sequence segmentation and chunking, (d) artificial grammar learning, and (e) certain types of structure dependence. The model's performance largely vindicates our design choices, suggesting that progress in modeling language acquisition can be made on a broad front—ranging from issues of generativity to the replication of human experimental findings—by bringing biological and computational considerations, as well as lessons from prior efforts, to bear on the modeling approach. (shrink)

The ability to appropriately sequence a list of discrete items is an important facet in performing routine cognitive tasks and may play a significant role in the acquisition of early communication skills. Though the serial learning abilities of some species, such as chimpanzees and rhesus macaques are well documented, there is virtually no information on the extent of these skills with gorillas. In this study, a young female western lowland gorilla has demonstrated the ability to learn a list of seven (...) Arabic numerals by selecting them on a monitor behind an infrared touchframe. As list length increased, Rollie required fewer trials to reach the criterion, suggesting an acquisition of skills associated with serial learning. Rollie was most likely to correctly select the first item in the sequence and least likely to select the penultimate item in the sequence. Her performance suggests serial learning abilities in the range of other non-verbal species and provides preliminary evidence that supports the assertion that gorillas can succeed at this form of serial learning task. (shrink)

We introduce a set of biologically and computationally motivated design choices for modeling the learning of language, or of other types of sequential, hierarchically structured experience and behavior, and describe an implemented system that conforms to these choices and is capable of unsupervised learning from raw natural-language corpora. Given a stream of linguistic input, our model incrementally learns a grammar that captures its statistical patterns, which can then be used to parse or generate new data. The grammar constructed in (...) this manner takes the form of a directed weighted graph, whose nodes are recursively (hierarchically) defined patterns over the elements of the input stream. We evaluated the model in seventeen experiments, grouped into five studies, which examined, respectively, (a) the generative ability of grammar learned from a corpus of natural language, (b) the characteristics of the learned representation, (c) sequence segmentation and chunking, (d) artificial grammar learning, and (e) certain types of structure dependence. The model's performance largely vindicates our design choices, suggesting that progress in modeling language acquisition can be made on a broad front—ranging from issues of generativity to the replication of human experimental findings—by bringing biological and computational considerations, as well as lessons from prior efforts, to bear on the modeling approach. (shrink)

Previous research suggests that implicit sequence learning is superior for believers in the paranormal and individuals with increased cerebral dopamine. Thirty-five healthy participants performed feedback-guided anticipations of four arrow directions. A 100-trial random sequence preceded two 100-trial biased sequences in which visual targets on trial t tended to be displaced 90° clockwise or counter-clockwise from those on t − 1. ISL was defined as a positive change during the course of the biased run in the difference between pro-bias and counter-bias (...) responses. It was hypothesized that this difference would be greater for believers in the paranormal than for skeptics, for those who received dopamine than for those who received placebo, and for believers who received dopamine than for the other groups. None of the hypotheses were supported by the data. It is suggested that a simple binary guessing task with a focus on prediction accuracy during early trials should be considered for future explorations. (shrink)

Two key research issues in the field of causal learning are how people acquire causal knowledge when observing data that are presented sequentially, and the level of abstraction at which learning takes place. Does sequential causal learning solely involve the acquisition of specific cause-effect links, or do learners also acquire knowledge about abstract causal constraints? Recent empirical studies have revealed that experience with one set of causal cues can dramatically alter subsequent learning and performance with entirely different cues, suggesting (...) that learning involves abstract transfer, and such transfer effects involve sequential presentation of distinct sets of causal cues. It has been demonstrated that pre-training can modulate classic causal learning phenomena such as forward and backward blocking. To account for these effects, we propose a Bayesian theory of sequential causal learning. The theory assumes that humans are able to consider and use several alternative causal generative models, each instantiating a different causal integration rule. Model selection is used to decide which integration rule to use in a given learning environment in order to infer causal knowledge from sequential data. Detailed computer simulations demonstrate that humans rely on the abstract characteristics of outcome variables to select a causal integration rule, which in turn alters causal learning in a variety of blocking and overshadowing paradigms. When the nature of the outcome variable is ambiguous, humans select the model that yields the best fit with the recent environment, and then apply it to subsequent learning tasks. Based on sequential patterns of cue-outcome co-occurrence, the theory can account for a range of phenomena in sequential causal learning, including various blocking effects, primacy effects in some experimental conditions, and apparently abstract transfer of causal knowledge. (shrink)

Abstract:The Confucian classic Great Learning (Daxue 大學) articulates in a sequence eight human aims for the good life. There have been various interpretations of the relations of these aims. This essay problematizes these interpretations and proposes a solution that the sequence of these Confucian human aims is developmentally temporal yet not stage-exclusive. I illustrate such an account by drawing on the model of Erik Erikson's developmental theory. Accordingly, while there is a temporal progression in achieving these aims, they nevertheless should (...) be pursued concurrently throughout most of a person's life. (shrink)

This study investigated visual statistical learning (VSL) in 24 deaf signers and 24 hearing non‐signers. Previous research with hearing individuals suggests that SL mechanisms support literacy. Our first goal was to assess whether VSL was associated with reading ability in deaf individuals, and whether this relation was sustained by a link between VSL and sign language skill. Our second goal was to test the Auditory Scaffolding Hypothesis, which makes the prediction that deaf people should be impaired in sequential processing (...) tasks. For the VSL task, we adopted a modified version of the triplet learning paradigm, with stimuli presented sequentially across space and time. Results revealed that measures of sign language skill (sentence comprehension/repetition) did not correlate with VSL scores, possibly due to the sequential nature of our VSL task. Reading comprehension scores (PIAT‐R) were a significant predictor of VSL accuracy in hearing but not deaf people. This finding might be due to the sequential nature of the VSL task and to a less salient role of the sequential orthography‐to‐phonology mapping in deaf readers compared to hearing readers. The two groups did not differ in VSL scores. However, when reading ability was taken into account, VSL scores were higher for the deaf group than the hearing group. Overall, this evidence is inconsistent with the Auditory Scaffolding Hypothesis, suggesting that humans can develop efficient sequencing abilities even in the absence of sound. (shrink)

This paper introduces a hybrid model that unifies connectionist, symbolic, and reinforcement learning into an integrated architecture for bottom-up skill learning in reactive sequential decision tasks. The model is designed for an agent to learn continuously from on-going experience in the world, without the use of preconceived concepts and knowledge. Both procedural skills and high-level knowledge are acquired through an agent’s experience interacting with the world. Computational experiments with the model in two domains are reported.

The goal of the present set of studies is to explore the boundary conditions of category transfer in causal learning. Previous research has shown that people are capable of inducing categories based on causal learning input, and they often transfer these categories to new causal learning tasks. However, occasionally learners abandon the learned categories and induce new ones. Whereas previously it has been argued that transfer is only observed with essentialist categories in which the hidden properties are causally relevant for (...) the target effect in the transfer relation, we here propose an alternative explanation, the unbroken mechanism hypothesis. This hypothesis claims that categories are transferred from a previously learned causal relation to a new causal relation when learners assume a causal mechanism linking the two relations that is continuous and unbroken. The findings of two causal learning experiments support the unbroken mechanism hypothesis. (shrink)

A serial reaction time experiment tested the hypothesis that there are two independent forms of implicit learning: learning that is linked to making judgments about stimuli, and learning that is linked to motor processing. Participants performed 2, 6, or 12 blocks of single task SRT, dual task SRT, or observation with one of five sequences; each sequence had the same underlying structure. Participants then performed two implicit tests, SRT and pattern judgment, as well as a generation test and an explicit (...) knowledge test. There was a double dissociation of the effect of sequence surface structure on SRT and pattern judgment. SRT and pattern judgment competence developed independently of each other across length of acquisition task. Performance on both implicit tasks did not depend on explicit knowledge. These results indicate that the SRT and pattern judgment measures tap independent forms of implicit learning, which is consistent with the modular nature of memory and cognition. (shrink)

Topics in Cognitive Science, Volume 14, Issue 2, Page 241-257, April 2022.

Sequential action makes up the bulk of human daily activity, and yet much remains unknown about how people learn such actions. In one motor learning paradigm, the serial reaction time (SRT) task, people are taught a consistent sequence of button presses by cueing them with the next target response. However, the SRT task only records keypress response times to a cued target, and thus it cannot reveal the full time‐course of motion, including predictive movements. This paper describes a mouse (...) movement trajectory SRT task in which the cursor must be moved to a cued location. We replicated keypress SRT results, but also found that predictive movement—before the next cue appears—increased during the experiment. Moreover, trajectory analyses revealed that people developed a centering strategy under uncertainty. In a second experiment, we made prediction explicit, no longer cueing targets. Thus, participants had to explore the response alternatives and learn via reinforcement, receiving rewards and penalties for correct and incorrect actions, respectively. Participants were not told whether the sequence of stimuli was deterministic, nor if it would repeat, nor how long it was. Given the difficulty of the task, it is unsurprising that some learners performed poorly. However, many learners performed remarkably well, and some acquired the full 10‐item sequence within 10 repetitions. Comparing the high‐ and low‐performers’ detailed results in this reinforcement learning (RL) task with the first experiment's cued trajectory SRT task, we found similarities between the two tasks, suggesting that the effects in Experiment 1 are due to predictive, rather than reactive processes. Finally, we found that two standard model‐free reinforcement learning models fit the high‐performing participants, while the four low‐performing participants provide better fit with a simple negative recency bias model. (shrink)

Three‐ to 4‐month‐old infants show asymmetric exclusivity in the acquisition of cat and dog perceptual categories. The cat perceptual category excludes dog exemplars, but the dog perceptual category does not exclude cat exemplars. We describe a connectionist autoencoder model of perceptual categorization that shows the same asymmetries as infants. The model predicts the presence of asymmetric retroactive interference when infants acquire cat and dog categories sequentially. A subsequent experiment conducted with 3‐ to 4‐month‐olds verifies the predicted pattern of looking time (...) behaviors. We argue that bottom‐up, associative learning systems with distributed representations are appropriate for modeling the operation of short‐term visual memory in early perceptual category learning. (shrink)

Topics in Cognitive Science, Volume 14, Issue 2, Page 311-326, April 2022.

Several canonical experimental paradigms have been proposed to study the typical behavioral phenomenon and the nature of learning in sequential keypress tasks. A characteristic feature of most paradigms is that they are representative of externally-specified sequencing—motor tasks where the environment or task paradigm extrinsically provides the sequence of stimuli, i.e., the responses are stimulus-driven. Previous studies utilizing such canonical paradigms have largely overlooked the learning behaviors in a more realistic class of motor tasks that involve internally-guided sequencing—where the sequence (...) of motor actions is self-generated or internally-specified. In this work, we use the grid-navigation task as an instance of internally-guided sequencing to investigate the nature of learning in such paradigms. The participants performed Grid-Sailing Task, which required navigating a 5 × 5 grid from start to goal position while using a particular key-mapping among the three cursor-movement directions and the three keyboard buttons. The participants performed two behavioral experiments—Single-SG and Mixed-SG condition. The Single-SG condition required performing GST on a single SG position repeatedly, whereas the Mixed-SG condition involved performing GST using the same KM on two novel SG positions presented in a random, inter-mixed manner. In the Single-SG condition, we show that motor learning contributes to the sequence-specific learning in GST with the repeated execution of the same trajectories. In the Mixed-SG condition, since the participants utilize the previously learned KM, we anticipate a transfer of learning from the Single-SG condition. The acquisition and transfer of a KM-specific internal model facilitates efficient trajectory planning on novel SG conditions. The acquisition of such a KM-specific internal model amounts to trajectory-independent cognitive learning in GST. We show that cognitive learning contributes to the learning in GST by showing transfer-related performance improvements in the Mixed-SG condition. In sum, we show the role of cognitive and motor learning processes in internally-guided sequencing and further make a case for using GST-like grid-navigation paradigms in investigating internally guided skill learning. (shrink)

To deal with reactive sequential decision tasks we present a learning model which is a hybrid connectionist model consisting of both localist and distributed representations based on the two level approach proposed in..

Reflective journal writing has been recognized as an effective pedagogical tool for nurturing students’ lifelong learning skills. With the paucity of empirical work on the dimensionality of reflective writing, this research sought to qualitatively analyze students’ RJ writing and design a generic reflection scheme for identifying dimensions of reflective thinking. Drawing on the theoretical scheme, another aim was to design and validate a questionnaire to measure students’ perceptions of their reflective writing experiences. The last aim was to quantitatively measure the (...) link between perceived reflective writing and students’ tendency to use RJs in their future careers and personal lives. This exploratory sequential research included the following steps: First, experts’ review and analysis of 1312 RJ entries were attained. This step led to the design of a theoretical scheme of reflective writing and a 31-item questionnaire, used to gather data from 171 students. Partial Least Squares analysis corroborated the structure suggested by the theoretical scheme: two timelines–reflections regarding the current course assignments and those related to the student’s future development. Students’ tendency to use reflective skills in their future professional lives was highly connected to their long-term reflections, including learning experiences linked to academic, professional, personal, and multicultural development. The current study’s suggested validated generic scheme can be adapted and integrated into different curricula, thereby possibly increasing the potential of infusing RJ instructional strategies into higher education curricula, improving the quality of reflection in student journals, and promoting lifelong learning skills. (shrink)

With renewable energy being increasingly connected to power grids, pumped storage plants play a very important role in restraining the fluctuation of power grids. However, conventional control strategy could not adapt well to the different control tasks. This paper proposes an intelligent nonlinear model predictive control strategy, in which hydraulic-mechanical and electrical subsystems are combined in a synchronous control framework. A newly proposed online sequential extreme learning machine algorithm with forgetting factor is introduced to learn the dynamic behaviors of (...) the coupling system. Specifically, the initial learning parameters are optimized by prior-knowledge learning and a new self-adaptive adjustment strategy is also put forward. Subsequently, the stair-like control strategy and artificial sheep algorithm are used in rolling the optimization mechanism to replace the existing complex differential geometric solutions. Comparative experiments are carried out under different working conditions based on a PSP in China. The results show that the influence from coupling factors can be considerable and the proposed MPC strategy indicates superiority in voltage and load adjustment as well as the frequency oscillation suppression. (shrink)

To deal with reactive sequential decision tasks we present a learning model Clarion which is a hybrid connectionist model consisting of both localist and dis tributed representations based on the two level ap proach proposed in Sun The model learns and utilizes procedural and declarative knowledge tapping into the synergy of the two types of processes It uni es neural reinforcement and symbolic methods to perform on line bottom up learning Experiments in various situations are reported that shed light (...) on the working of the model.. (shrink)

Background: Recently, attention has grown toward cerebellar neuromodulation in motor learning using transcranial direct current stimulation. An important point of discussion regarding this modulation is the optimal timing of tDCS, as this parameter could significantly influence the outcome. Hence, this study aimed to investigate the effects of the timing of cerebellar anodal tDCS on motor learning using a sequential finger-tapping task.Methods: One hundred and twenty two healthy young, right-handed subjects were randomized into four groups. They performed 2 days of (...) FTT with their non-dominant hand on a custom keyboard. The task consisted of 40 s of typing followed by 20 s rest. Each participant received ca-tDCS at the appropriate timing and performed 20 trials on the first day. On the following day, only 10 trials of FTT were performed without tDCS. Motor skill performance and retention were assessed.Results: All participants showed a time-dependent increase in learning. Motor performance was not different between groups at the end of T1. ca-tDCS did not facilitate the retention of the motor skill in the FTT at T2. Thus, our findings indicate an absence of the effect of ca-tDCS on motor performance or retention of the FTT independently from the timing of stimulation.Conclusion: The present results suggest that the outcome of ca-tDCS is highly dependent on the task and stimulation parameters. Future studies need to establish a clear basis for the successful and reproducible clinical application of ca-tDCS. (shrink)