Off-campus access
Using PhilPapers from home?
Click here to configure this browser for off-campus access.
- Axel Cleeremans, Applying Forward Models to Sequence Learning: A Connectionist Implementation.The ability to process events in their temporal and sequential context is a fundamental skill made mandatory by constant interaction with a dynamic environment. Sequence learning studies have demonstrated that subjects exhibit detailed — and often implicit — sensitivity to the sequential structure of streams of stimuli. Current connectionist models of performance in the so-called Serial Reaction Time Task (SRT), however, fail to capture the fact that sequence learning can be based not only on sensitivity to the sequential associations between successive stimuli, but also on sensitivity to the associations between successive responses, and on the predictive relationships that exist between these sequences of responses and their effects in the environment. In this paper, we offer an initial exploration of an alternative architecture for sequence learning, based on the principles of Forward Models.
Similar books and articles
Running head: Implicit sequence learning ABSTRACT Can we learn without awareness? Although this issue has been extensively explored through studies of implicit learning, there is currently no agreement about the extent to which knowledge can be acquired and projected onto performance in an unconscious way. The controversy, like that surrounding implicit memory, seems to be at least in part attributable to unquestioned acceptance of the unrealistic assumption that tasks are process-pure, that is, that a given task exclusively involves either implicit or explicit knowledge.
Jackson and Jackson (1995) argue that most current tests used to assess awareness of sequential material are flawed because of their emphasis on accuracy. They propose to distinguish two forms of sequence knowledge: Serial knowledge, that is, knowledge about the specific sequence that stimuli follow, which involves information about the statistical relationship between many sequence elements, and statistical knowledge, or knowledge about the probability of different transitions between adjacent sequence elements. Further, they suggest a new method to analyze generation performance, which involves considering the correlation between subjects' responses and the distribution of transition probabilities, regardless of the accuracy of generation performance. In this comment, we first suggest that the distinction between serial and statistical knowledge is unwarranted except in one case which is not addressed by Jackson and Jackson. We propose instead that all sequence knowledge is essentially statistical in nature. Second, we suggest that using probabilistic instead of deterministic sequences is a better way to approach the assessment of explicit knowledge, and illustrate this contention with empirical and simulated examples based on previous and current research (Cleeremans, 1993; Cleeremans and McClelland, 1991; Jimenez, Mendez and Cleeremans, 1996).
No categories
Through the use of double task conditions, the sequence learning (SL) paradigm offers unique opportunities to study the relationships between learning and attention. In their original study, Nissen & Bullemer (1987) argued that a secondary tone-counting task prevents SL because it exhausts participants’ attentional resources. Other authors have instead suggested that the detrimental effects of tone-counting are due to scheduling conflicts between performing the main and secondary tasks rather than to attentional load. Frensch & Miner (1994), for instance, suggested that the secondary task impairs sequence learning because it lengthens the response-to-stimulus interval (RSI) and hence makes it less likely for relevant contingencies to be represented together in short-term memory, — a condition for learning. Stadler (1995), on the other hand, argued that the secondary task introduces variability in the RSI and disrupts the organization of the sequence into chunks. Further, according to Willingham, Greenberg & Cannon Thomas (1997) manipulation of the RSI influences performance but not sequence learning..
Studies of implicit learning have shown that individuals exposed to a rule-governed environment often learn to exploit 'rules' which describe the structural relationship between environmental events. While some authors have interpreted such demonstrations as evidence for functionally separate implicit learning systems, others have argued that the observed changes in performance result from explicit knowledge which has been inadequately assessed. In this paper we illustrate this issue by considering one commonly used implicit learning task, the Serial reaction time task, and outline what we see as an important problem associated with each of the commonly used methods used to assess explicit knowledge. This is that each measure requires a form of response which is dependent on the subjects having some knowledge of the serial-order of the sequence. We argue that such methods, or more specifically their analyses, seriously underestimate other sources of knowledge, which may be available to subjects during their performance of the SRT task. In support of this argument we demonstrate that subjects' serial-order knowledge can, in principle, be independent of subjects' knowledge of the statistical structure of the sequence, and we propose an alternative method for analysing performance on the Generate task which avoids this problem.
As linguistic competence so clearly illustrates, processing sequences of events is a fundamental aspect of human cognition. For this reason perhaps, sequence learning behavior currently attracts considerable attention in both cognitive psychology and computational theory. In typical sequence learning situations, participants are asked to react to each element of sequentially structured visual sequences of events. An important issue in this context is to determine whether essentially associative processes are sufficient to understand human performance, or whether more powerful learning mechanisms are necessary. To address this issue, we explore how well human participants and connectionist models are capable of learning sequential material that involves complex, disjoint, longdistance contingencies. We show that the popular Simple Recurrent Network model (Elman, 1990), which has otherwise been shown to account for a variety of empirical findings (Cleeremans, 1993), fails to account for human performance in several experimental situations meant to test the model’s specific predictions. In previous research (Cleeremans, 1993) briefly described in this paper, the structure of center-embedded sequential structures was manipulated to be strictly identical or probabilistically different as a function of the elements surrounding the embedding. While the SRN could only learn in the second case, human subjects were found to be insensitive to the manipulation. In the new experiment described in this paper, we tested the idea that performance benefits from “starting small effects” (Elman, 1993) by contrasting two conditions in which the training regimen was either incremental or not. Again, while the SRN is only capable of learning in the first case, human subjects were able to learn in both. We suggest an alternative model based on Maskara & Noetzel’s (1991) Auto-Associative Recurrent Network as a way to overcome the SRN model’s failure to account for the empirical findings..
No categories
Can associative learning take place without awareness? We explore this issue in a sequence learning paradigm with amnesic and control participants, who were simply asked to react to one of four possible stimuli on each trial. Unknown to them, successive stimuli occurred in a sequence. We manipulated the extent to which stimuli followed the sequence in a deterministic manner (noiseless condition) or only probabilistically so (noisy condition). Through this paradigm, we aimed at addressing two central issues: first, we asked whether sequence learning takes place in either condition with amnesic patients. Second, we asked whether this learning takes place without awareness. To answer this second question, participants were asked to perform a subsequent sequence generation task under inclusion and exclusion conditions, as well as a recognition task. Reaction times results show that amnesic patients learned the sequence only in the deterministic condition. However, they failed to be able to reproduce the sequence in the generation task. In contrast, we found learning for both sequence structures in control participants, but only control participants exposed to a deterministic sequence were successful in performing the generation task, thus suggesting that the acquired knowledge can be used consciously in this condition. Neither amnesic nor control participants showed correct old/new judgments in the recognition task. The results strengthen the claim that implicit learning is at least partly spared in amnesia, and the role of contextual information available for learning is discussed. © 2006 Elsevier Ltd. All rights reserved.
In two H215O PET scan experiments, we investigated the cerebral correlates of explicit and implicit knowledge in a serial reaction time (SRT) task. To do so, we used a novel application of the Process Dissociation Procedure, a behavioral paradigm that makes it possible to separately assess conscious and unconscious contributions to performance during a subsequent sequence generation task. To manipulate the extent to which the repeating sequential pattern was learned explicitly, we varied the pace of the choice reaction time task—a variable that is known to have differential effects on the extent to which sensitivity to sequence structure involves implicit or explicit knowledge. Results showed that activity in the striatum subtends the implicit component of performance during recollection of a learned sequence, whereas the anterior cingulate/mesial prefrontal cortex (ACC/MPFC) supports the explicit component. Most importantly, we found that the ACC/MPFC exerts control on the activity of the striatum during retrieval of the sequence after explicit learning, whereas the activity of these regions is uncoupled when learning had been essentially implicit. These data suggest that implicit learning processes can be successfully controlled by conscious knowledge when learning is essentially explicit. They also supply further evidence for a partial dissociation between the neural substrates supporting conscious and nonconscious components of performance during recollection of a learned sequence.
No categories
Over the past decade, sequence learning has gradually become a central paradigm through which to study implicit learning. In this chapter, we start by briefly summarizing the results obtained with different variants of the sequence learning paradigm. We distinguish three subparadigms in terms of whether the stimulus material is generated either by following a fixed and repeating sequence (e.g., Nissen & Bullemer, 1987), by relying on a complex set of rules from which one can produce several alternative deterministic sequences (e.g., Lewicki, Hill & Bizot, 1988; Stadler, 1989), or by following the output of a probabilistic set of rules such as instantiated by noisy finite-state grammars (Cleeremans & McClelland, 1991; Jiménez, Mendéz & Cleeremans, 1996). Next, we focus on the processes involved in sequence representation and acquisition. We suggest that the sensitivity to the sequential structure observed in the probabilistic subparadigm can only be a result of the acquisition of a representation of the statistical constraints of the material, and that this sensitivity emerges through the operation of mechanisms that are well instantiated by connectionist models such as the Simple Recurrent Network (Elman, 1990; Cleeremans, 1993b). We present new simulation work meant to explore to what extent the model can also account for specific data obtained in a paradigmatic instance of deterministic, rule-based sequence learning task: Lewicki et al. (1988)'s situation. Finally, we report on the results of an experiment that compares learning on otherwise similar deterministic and probabilistic structures, and we show that learning of both types of structures is equivalent only under conditions that maximally hinder explicit acquisition. Taken together, these simulation and experimental data lend support to the claim that implicit learning in all three sequence learning subparadigms can amount to a form of statistical sequence learning. They also suggest that distinguishing among several theories of sequence representation and acquisition may require us to analize the data in great detail. Hopefully, however, some truth can be found in such details..
Sequential behavior is essential to intelligence, and it is a fundamental part of human activities ranging from reasoning to language, and from everyday skills to complex problem solving. In particular, sequence learning is an important component of learning in many task domains — planning, reasoning, robotics, natural language processing, speech recognition, adaptive control, time series prediction, financial engineering, DNA sequencing, and so on. Naturally, there are many different approaches towards sequence learning, resulting from different perspectives taken in different task domains. These approaches deal with somewhat differently formulated sequential learning problems (for example, some with actions and some without), and/ or different aspects of sequence learning (for example, sequence prediction vs. sequence recognition). Sequence learning is clearly a difiicult task. More powerful algorithms for sequence learning are needed in all of these afore-mentioned domains. It is our view that the right approach to develop better techniques, algorithms, models.
What do people learn when they do not know that they are learning? Until recently, all of the work in the area of implicit learning focused on empirical questions and methods. In this book, Axel Cleeremans explores unintentional learning from an information-processing perspective. He introduces a theoretical framework that unifies existing data and models on implicit learning, along with a detailed computational model of human performance in sequence-learning situations.
Discussion of Axel Cleeremans, Applying forward models to sequence learning: A connectionist implementation
|
|
There are no threads in this forum |
Nothing in this forum yet.

