When we ask a decision maker to express her preferences, it is typically assumed that we are eliciting a pre-existing set of preferences. However, empirical research has suggested that our preferences are often constructed on the fly for the decision problem at hand. This paper explores the ramifications of this empirical research for our understanding of instrumental rationality. First, I argue that these results pose serious challenges for the traditional decision-theoretic view of instrumental rationality, which demands global coherence amongst all of one's beliefs and desires. To address these challenges, I first develop a minimal notion of instrumental rationality that issues in localized, goal-relative demands of coherence. This minimal conception of instrumental rationality is then used to offer a more sophisticated account of the global aspects of instrumental rationality. The resulting view abandons all-or-nothing assessments of rationality and allows us to evaluate decision makers as being rational to varying degrees. My aim is to propose a theory that is both psychologically and normatively plausible.