Model-Based Influences on Humans' Choices and Striatal Prediction Errors

Neuron 69 (6):1204-1215 (2011)

Abstract

The mesostriatal dopamine system is prominently implicated in model-free reinforcement learning, with fMRI BOLD signals in ventral striatum notably covarying with model-free prediction errors. However, latent learning and devaluation studies show that behavior also shows hallmarks of model-based planning, and the interaction between model-based and model-free values, prediction errors, and preferences is underexplored. We designed a multistep decision task in which model-based and model-free influences on human choice behavior could be distinguished. By showing that choices reflected both influences we could then test the purity of the ventral striatal BOLD signal as a model-free report. Contrary to expectations, the signal reflected both model-free and model-based predictions in proportions matching those that best explained choice behavior. These results challenge the notion of a separate model-free learner and suggest a more integrated computational architecture for high-level human decision-making

Download options

PhilArchive



    Upload a copy of this work     Papers currently archived: 72,722

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Analytics

Added to PP
2016-05-26

Downloads
18 (#613,883)

6 months
2 (#259,476)

Historical graph of downloads
How can I increase my downloads?

Author's Profile

References found in this work

No references found.

Add more references

Similar books and articles

A Model of Decision-Making Incorporating Ethical Values.David J. Fritzsche - 1991 - Journal of Business Ethics 10 (11):841 - 852.
Values and Uncertainties in Climate Prediction, Revisited.Wendy Parker - 2014 - Studies in History and Philosophy of Science Part A 46:24-30.
A Model of the Universe: Space-Time, Probability, and Decision.Storrs McCall - 1994 - Oxford and New York: Oxford University Press.
Rationalizable Irrationalities of Choice.Peter Dayan - 2014 - Topics in Cognitive Science 6 (2):204-228.
Spinoza's Model of Human Nature.Andrew Youpa - 2010 - Journal of the History of Philosophy 48 (1):pp. 61-76.
Free Will in Psychology—In Search of a Geniuin Compatibilism.Preben Bertelsen - 1999 - Journal of Theoretical and Philosophical Psychology 19 (1):41-77.
The Direct-Perception Model of Empathy: A Critique. [REVIEW]Pierre Jacob - 2011 - Review of Philosophy and Psychology 2 (3):519-540.