The objective of this book is to produce a theory of rational decision making for realistically resource-bounded agents. My interest is not in “What should I do if I were an ideal agent?”, but rather, “What should I do given that I am who I am, with all my actual cognitive limitations?” The book has three parts. Part One addresses the question of where the values come from that agents use in rational decision making. The most comon view among philosophers (...) is that they are based on preferences, but I argue that this is computationally impossible. I propose an alternative theory somewhat reminiscent of Bentham, and explore how human beings actually arrive at values and how they use them in decision making. Part Two investigates the knowledge of probability that is required for decision-theoretic reasoning. I argue that subjective probability makes no sense as applied to realistic agents. I sketch a theory of objective probability to put in its place. Then I use that to define a variety of causal probability and argue that this is the kind of probability presupposed by rational decision making. So what is to be defended is a variety of causal decision theory. Part Three explores how these values and probabilities are to be used in decision making. In chapter eight, it is argued first that actions cannot be evaluated in terms of their expected values as ordinarily defined, because that does not take account of the fact that a cognizer may be unable to perform an action, and may even be unable to try to perform it. An alternative notion of “expected utility” is defined to be used in place of expected values. In chapter nine it is argued that individual actions cannot be the proper objects of decision-theoretic evaluation. We must instead choose plans, and select actions indirectly on the grounds that they are prescribed by the plans we adopt. However, our objective cannot be to find plans with maximal expected utilities. Plans cannot be meaningfully compared in that way. (shrink)

Counterexamples are constructed for the theory of rational choice that results from a direct application of classical decision theory to ordinary actions. These counterexamples turn on the fact that an agent may be unable to perform an action, and may even be unable to try to perform an action. An alternative theory of rational choice is proposed that evaluates actions using a more complex measure, and then it is shown that this is equivalent to applying classical decision theory to "conditional (...) policies" rather than ordinary actions. (shrink)

A theory of rational choice is a theory of how an agent should, rationally, go about deciding what actions to perform at any given time. For example, I may want to decide whether to go to a movie this evening or stay home and read a book. The actions between which we want to choose are perfectly ordinary actions, and the presumption is that to make such a decision we should attend to the likely consequences of our decision. It is (...) assumed that these decisions must be made in the face of uncertainty regarding both the agent’s initial situation and the consequences of his actions. (shrink)

In this book Pollock deals with the subject of probabilistic reasoning, making general philosophical sense of objective probabilities and exploring their ...

Practical reasoning aims at deciding what actions to perform in light of the goals a rational agent possesses. This has been a topic of interest in both philosophy and artificial intelligence, but these two disciplines have produced very different models of practical reasoning. The purpose of this paper is to examine each model in light of the other and produce a unified model adequate for the purposes of both disciplines and superior to the standard models employed by either.The philosophical (decision-theoretic) (...) model directs activity by evaluating acts one at a time in terms of their expected utilities. It is argued that, except in certain special cases, this constitutes an inadequate theory of practical reasoning leading to intuitively incorrect action prescriptions. Acts must be viewed as parts of plans, and plans evaluated as coherent units rather than piecemenal in terms of the acts comprising them. Rationality dictates choosing acts by first choosing the plans prescribing them. Plans, in turn, are compared by looking at their expected values. However, because plans can be embedded in one another, we cannot select plans just by maximizing expected values. Instead, we must employ a more complex criterion here named coextendability. (shrink)

Cognitive agents form beliefs representing the world, evaluate the world as represented, form plans for making the world more to their liking, and perform actions executing the plans. Then the cycle repeats. This is the doxastic-conative loop, diagrammed in figure one.1 Both human beings and the autonomous rational agents envisaged in AI are cognitive agents in this sense. The cognition of a cognitive agent can be subdivided into two parts. Epistemic cognition is that kind of cognition responsible for producing and (...) maintaining beliefs. Practical cognition evaluates the world, adopts plans, and initiates action. There is a massive literature both in philosophy and artificial intelligence concerning various aspects of epistemic cognition, and large parts of it are well understood. Practical cognition is less well understood. We can usefully divide practical cognition into five parts: (1) the evaluation of the world as represented by the agent’s beliefs, (2) the adoption of goals for changing it, (3) the construction of plans for achieving goals, (4) the adoption of plans, and (5) the execution of plans. There is a substantial literature in AI concerning the construction and execution of plans, and I will say nothing further about those topics here. This paper will focus on the evaluative aspects of practical cognition. Evaluation plays an essential role in both goal selection and plan adoption. My concern here is the investigation of evaluation as a cognitive enterprise performed by cognitive agents. I am interested both in how it is performed in human beings and how it might be performed in artificial rational agents. (shrink)

Examples growing out of the Newcomb problem have convinced many people that decision theory should proceed in terms of some kind of causal probability. I endorse this view and define and investigate a variety of causal probability. My definition is related to Skyrms' definition, but proceeds in terms of objective probabilities rather than subjective probabilities and avoids taking causal dependence as a primitive concept.

Newcomb's problem and similar cases show the need to incorporate causal distinctions into the theory of rational decision; the usual noncausal decision theory, though simpler, does not always give the right answers. I give my own version of causal decision theory, compare it with versions offered by several other authors, and suggest that the versions have more in common than meets the eye.

Examples growing out of the Newcomb problem have convinced many people that decision theory should proceed in terms of some kind of causal probability. I endorse this view and define and investigate a variety of causal probability. My definition is related to Skyrms' definition, but proceeds in terms of objective probabilities rather than subjective probabilities and avoids taking causal dependence as a primitive concept.

Classic analysis of the subject and the development of personal probability; one of the greatest controversies in modern statistcal thought.

Pollock argues that theories of ideal rationality are largely irrelevant to the decision making of real agents. Thinking about Acting aims to provide a theory of "real rationality.".

This paper addresses the logical foundations of goal-regression planning in autonomous rational agents. It focuses mainly on three problems. The first is that goals and subgoals will often be conjunctions, and to apply goal-regression planning to a conjunction we usually have to plan separately for the conjuncts and then combine the resulting subplans. A logical problem arises from the fact that the subplans may destructively interfere with each other. This problem has been partially solved in the AI literature (e.g., in (...) SNLP and UCPOP), but the solutions proposed there work only when a restrictive assumption is satisfied. This assumption pertains to the computability of threats. It is argued that this assumption may fail for an autonomous rational agent operating in a complex environment. Relaxing this assumption leads to a theory of defeasible planning. The theory is formulated precisely and an implementation in the OSCAR architecture is discussed. (shrink)