Although seemingly irrational choice abounds, the rules governing these mis‐steps that might provide hints about the factors limiting normative behavior are unclear. We consider three experimental tasks, which probe different aspects of non‐normative choice under uncertainty. We argue for systematic statistical, algorithmic, and implementational sources of irrationality, including incomplete evaluation of long‐run future utilities, Pavlovian actions, and habits, together with computational and statistical noise and uncertainty. We suggest structural and functional adaptations that minimize their maladaptive effects.

Decision making in any brain is imperfect and costly in terms of time and energy. Operating under such constraints, an organism could be in a position to improve performance if an opportunity arose to exploit informative patterns in the environment being searched. Such an improvement of performance could entail both faster and more accurate (i.e., reward-maximizing) decisions. The present study investigated the extent to which human participants could learn to take advantage of immediate patterns in the spatial arrangement of serially (...) presented foods such that a region of space would consistently be associated with greater subjective value. Eye movements leading up to choices demonstrated rapidly induced biases in the selective allocation of visual fixation and attention that were accompanied by both faster and more accurate choices of desired goods as implicit learning occurred. However, for the control condition with its spatially balanced reward environment, these subjects exhibited preexisting lateralized biases for eye and hand movements (i.e., leftward and rightward, respectively) that could act in opposition not only to each other but also to the orienting biases elicited by the experimental manipulation, producing an asymmetry between the left and right hemifields with respect to performance. Potentially owing at least in part to learned cultural conventions (e.g., reading from left to right), the findings herein particularly revealed an intrinsic leftward bias underlying initial saccades in the midst of more immediate feedback-directed processes for which spatial biases can be learned flexibly to optimize oculomotor and manual control in value-based decision making. The present study thus replicates general findings of learned attentional biases in a novel context with inherently rewarding stimuli and goes on to further elucidate the interactions between endogenous and exogenous biases. (shrink)

The target article sketched and explored a mechanism (action-oriented predictive processing) most plausibly associated with core forms of cortical processing. In assessing the attractions and pitfalls of the proposal we should keep that element distinct from larger, though interlocking, issues concerning the nature of adaptive organization in general.

Ability to recall the timing of events is a crucial aspect of associative learning. Yet, traditional theories of associative learning have often overlooked the role of time in learning association and shaping the behavioral outcome. They address temporal learning as an independent and parallel process. Temporal Coding Hypothesis is an attempt to bringing together the associative and non-associative aspects of learning. This account proposes temporal maps, a representation that encodes several aspects of a learned association, but attach considerable importance to (...) the temporal aspect. A temporal map helps an agent to make inferences about missing information by applying an integration mechanism over a common element present in independently acquired temporal maps. We review the empirical evidence demonstrating the construct of temporal maps and discuss the importance of this concept in clinical and behavioral interventions. (shrink)

Taste-aversion learning has been a popular paradigm for examining associative processes because it often produces outcomes that are different from those observed in other classical conditioning paradigms. One such outcome is taste-mediated odor potentiation in which aversion conditioning with a weak odor and a strong taste results in increased or synergistic conditioning to the odor. Because this strengthened odor aversion was not anticipated by formal models of learning, investigation of taste-mediated odor potentiation was a hot topic in the 1980s. The (...) present manuscript reviews the history of potentiation research with particular focus given to the stimuli that produce potentiation, the conditions that produce potentiation, the possible mechanism of this phenomenon, and possible reasons for the decline of research in this area. Although the number of published reports of potentiation has decreased since the 1980s, recent physiological and behavioral assessments have advanced the field considerably, and the opportunities for future research are bountiful. Recent physiological experiments, for example, have identified the basolateral nucleus of the amygdala as the key brain region to produce taste-mediated odor potentiation (e.g., Hatfield andGallagher, 1995). Also, recent behavioral experiments have extended the generality of synergistic conditioning effects. Studies have shown that odor can potentiate responding to taste (Slotnick, Westbrook and Darling, 1997) and that augmented responding can be produced in the A+/AX+blocking design (e.g., Batsell and Batson, 1999). With the current understanding of where synergistic conditioning may occur in the brain and the new tools to explore synergistic conditioning, we propose various directions for future research to determine whether taste-aversion learning and synergistic conditioning require unique explanations. (shrink)

Food uncertainty has the effect of invigorating food-related responses. Psychologists have noted that mammals and birds respond more to a conditioned stimulus that unreliably predicts food delivery, and ecologists have shown that animals consume and/or hoard more food and can get fatter when access to that resource is unpredictable. Are these phenomena related? We think they are. Psychologists have proposed several mechanistic interpretations, while ecologists have suggested a functional interpretation: The effect of unpredictability on fat reserves and hoarding behavior is (...) an evolutionary strategy acting against the risk of starvation when food is in short supply. Both perspectives are complementary, and we argue that the psychology of incentive motivational processes can shed some light on the causal mechanisms leading animals to seek and consume more food under uncertainty in the wild. Our theoretical approach is in agreement with neuroscientific data relating to the role of dopamine, a neurotransmitter strongly involved in incentive motivation, and its plausibility has received some explanatory and predictive value with respect to Pavlovian phenomena. Overall, we argue that the occasional and unavoidable absence of food rewards has motivational effects that facilitate foraging effort. We show that this hypothesis is computationally tenable, leading foragers in an unpredictable environment to consume more food items and to have higher long-term energy storage than foragers in a predictable environment. (shrink)

A motivational system approach to avoidance behavior is presented. According to this approach, a motivational state increases the probability of relevant response patterns and establishes the appropriate or “ideal” consummatory stimuli as positive reinforcers. In the case of feeding motivation, for example, hungry rats are likely to explore and gnaw, and to learn to persist in activities correlated with the reception of consummatory stimuli produced by ingestion of palatable substances. In the case of defense motivation, fearful rats are likely to (...) flee or freeze, and to learn to persist in activities correlated with consummatory stimuli produced by flight from a dangerous place. Defense system activation is distinct from alarm reactions. The latter prepare the animal for probable noxious events, involve relatively intense negative affect and extinguish rapidly in situations where the noxious event no longer occurs. In contrast, defense system activation potentiates innate and modified defense reactions, thus preparing the animal for possible, but not necessarily probable, noxious events; it involves little or no negative affect and extinguishes very slowly when the noxious event no longer occurs. With these assumptions and the resulting model we attempt to resolve several long-standing problems in avoidance learning, including the low correlation between negative affect and avoidance performance, differential rates of extinction for avoidance performance and conditioned emotional responses, and evidence that some avoidance responses are much more easily learned than others. In addition, the model has implications for the study of parallels between appetitive and aversive motivation, sign tracking in aversive conditioning, and orientation of flight responses. Historical antecedents and alternative approaches are discussed. (shrink)

Creativity is an important quality that has been linked with problem solving, achievement, and scientific advancement. It has previously been proposed that creative individuals pay greater attention to and are able to utilize information that others may consider irrelevant, in order to generate creative ideas (e.g., Eysenck, 1995). In this study we investigated whether there was a relationship between creativity and greater learning about irrelevant information. To answer this question, we used a self-report measure of creative ideation and a blocking (...) task, which involved learning about irrelevant stimuli. We failed to find evidence for this association, with a Bayes Factor indicating support for no relationship between these measures. While it is possible that a different measure of creative ideation, for example one which does not rely on self-report, may produce different results, a more lucrative research direction may be focusing on the link between creativity and cognitive flexibility, in line with suggestions by Zabelina and Robinson (2010). (shrink)

Cross-situational word learning, like any statistical learning problem, involves tracking the regularities in the environment. However, the information that learners pick up from these regularities is dependent on their learning mechanism. This article investigates the role of one type of mechanism in statistical word learning: competition. Competitive mechanisms would allow learners to find the signal in noisy input and would help to explain the speed with which learners succeed in statistical learning tasks. Because cross-situational word learning provides information at multiple (...) scales—both within and across trials/situations—learners could implement competition at either or both of these scales. A series of four experiments demonstrate that cross-situational learning involves competition at both levels of scale, and that these mechanisms interact to support rapid learning. The impact of both of these mechanisms is considered from the perspective of a process-level understanding of cross-situational learning. (shrink)