Graduate studies at Western
Cognitive Science 36 (2):333-358 (2012)
|Abstract||Reinforcement learning approaches to cognitive modeling represent task acquisition as learning to choose the sequence of steps that accomplishes the task while maximizing a reward. However, an apparently unrecognized problem for modelers is choosing when, what, and how much to reward; that is, when (the moment: end of trial, subtask, or some other interval of task performance), what (the objective function: e.g., performance time or performance accuracy), and how much (the magnitude: with binary, categorical, or continuous values). In this article, we explore the problem space of these three parameters in the context of a task whose completion entails some combination of 36 state–action pairs, where all intermediate states (i.e., after the initial state and prior to the end state) represent progressive but partial completion of the task. Different choices produce profoundly different learning paths and outcomes, with the strongest effect for moment. Unfortunately, there is little discussion in the literature of the effect of such choices. This absence is disappointing, as the choice of when, what, and how much needs to be made by a modeler for every learning model|
|Keywords||Adaptive behavior Reinforcement learning Strategy selection Expected utility Skill acquisition and learning Choice Expected value Cognitive architecture|
|Categories||categorize this paper)|
|Through your library||Configure|
Similar books and articles
Vladislav D. Veksler, Wayne D. Gray & Michael J. Schoelles (2013). Goal‐Proximity Decision‐Making. Cognitive Science 37 (4):757-774.
Reiko Yakushijin & Robert A. Jacobs (2011). Are People Successful at Learning Sequences of Actions on a Perceptual Matching Task? Cognitive Science 35 (5):939-962.
Cailin O.’Connor (forthcoming). The Evolution of Vagueness. Erkenntnis:1-21.
Irving Kupfermann (2000). Reward: Wanted – a Better Definition. Behavioral and Brain Sciences 23 (2):208-208.
Arthur Markman, W. Maddox & G. C. Baldwin (2007). Using Regulatory Focus to Explore Implicit and Explicit Processing in Concept Learning. Journal of Consciousness Studies 14 (s 9-10):132-155.
Varsha Singh & Azizuddin Khan (2008). Heterogeneity in Choices on Iowa Gambling Task: Preference for Infrequent–High Magnitude Punishment. [REVIEW] Mind and Society 8 (1):43-57.
Added to index2012-01-19
Total downloads2 ( #246,325 of 739,303 )
Recent downloads (6 months)1 ( #61,243 of 739,303 )
How can I increase my downloads?