The Superintelligent Will: Motivation and Instrumental Rationality in Advanced Artificial Agents [Book Review]
Graduate studies at Western
Minds and Machines 22 (2):71-85 (2012)
|Abstract||This paper discusses the relation between intelligence and motivation in artificial agents, developing and briefly arguing for two theses. The first, the orthogonality thesis, holds (with some caveats) that intelligence and final goals (purposes) are orthogonal axes along which possible artificial intellects can freely vary—more or less any level of intelligence could be combined with more or less any final goal. The second, the instrumental convergence thesis, holds that as long as they possess a sufficient level of intelligence, agents having any of a wide range of final goals will pursue similar intermediary goals because they have instrumental reasons to do so. In combination, the two theses help us understand the possible range of behavior of superintelligent agents, and they point to some potential dangers in building such an agent|
|Keywords||Superintelligence Artificial intelligence AI Goal Instrumental reason Intelligent agent|
|Categories||categorize this paper)|
|Through your library||Configure|
Similar books and articles
Ralph Wedgwood (2011). Instrumental Rationality. Oxford Studies in Metaethics 6:280-309.
Danny Frederick, Adversus Homo Economicus: Critique of Lester’s Account of Instrumental Rationality.
Donald C. Hubin (1999). What's Special About Humeanism. Noûs 33 (1):30-45.
Stephen Ellis (2008). The Varieties of Instrumental Rationality. Southern Journal of Philosophy 46 (2):199-220.
Markos Valaris (2012). Instrumental Rationality. European Journal of Philosophy 20 (4).
Michael Bratman (2009). Intention, Belief, and Instrumental Rationality. In David Sobel & Steven Wall (eds.), Reasons for Action. Cambridge University Press.
Thomas Kelly (2007). Evidence and Normativity: Reply to Leite. Philosophy and Phenomenological Research 75 (2):465–474.
Bruno Verbeek (2001). Consequentialism, Rationality and the Relevant Description of Outcomes. Economics and Philosophy 17 (2):181-205.
Thomas Kelly (2003). Epistemic Rationality as Instrumental Rationality: A Critique. Philosophy and Phenomenological Research 66 (3):612–640.
Michael Smith (2004). Instrumental Desires, Instrumental Rationality. Aristotelian Society Supplementary Volume 78 (1):93–109.
Edward Harcourt (2004). Instrumental Desires, Instrumental Rationality. Aristotelian Society Supplementary Volume 78 (1):111–129.
John Brunero (2005). Instrumental Rationality and Carroll's Tortoise. Ethical Theory and Moral Practice 8 (5):557 - 569.
Nick Lacey & Mark Lee (2003). The Influence of Epistemology on the Design of Artificial Agents. Minds and Machines 13 (3):367-395.
Mark van Roojen (1995). Humean Motivation and Humean Rationality. Philosophical Studies 79 (1):37-57.
Added to index2012-06-14
Total downloads16 ( #81,852 of 739,403 )
Recent downloads (6 months)2 ( #37,287 of 739,403 )
How can I increase my downloads?