This is the second of three parts of an introduction to the philosophy of climate science. In this second part about modelling climate change, the topics of climate modelling, confirmation of climate models, the limits of climate projections, uncertainty and finally model ensembles will be discussed.

There are a variety of topics in the philosophy of science that need to be rethought, in varying degrees, after one pays careful attention to the ways in which computer simulations are used in the sciences. There are a number of conceptual issues internal to the practice of computer simulation that can benefit from the attention of philosophers. This essay surveys some of the recent literature on simulation from the perspective of the philosophy of science and argues that philosophers have (...) a lot to learn by paying closer attention to the practice of simulation. (shrink)

Neuroscientists have in recent years turned to building models that aim to generate predictions rather than explanations. This “predictive turn” has swept across domains including law, marketing, and neuropsychiatry. Yet the norms of prediction remain undertheorized relative to those of explanation. I examine two styles of predictive modeling and show how they exemplify the normative dynamics at work in prediction. I propose an account of how predictive models, conceived of as technological devices for aiding decision-making, can come to be adequate (...) for purposes that are defined by both their guiding research questions and their larger social context of application. (shrink)

This paper argues that the difference between contemporary software intensive scientific practice and more traditional non-software intensive varieties results from the characteristically high conditionality of software. We explain why the path complexity of programs with high conditionality imposes limits on standard error correction techniques and why this matters. While it is possible, in general, to characterize the error distribution in inquiry that does not involve high conditionality, we cannot characterize the error distribution in inquiry that depends on software. Software intensive (...) science presents distinctive error and uncertainty modalities that pose new challenges for the epistemology of science. (shrink)

We argue that concerns about double-counting—using the same evidence both to calibrate or tune climate models and also to confirm or verify that the models are adequate—deserve more careful scrutiny in climate modelling circles. It is widely held that double-counting is bad and that separate data must be used for calibration and confirmation. We show that this is far from obviously true, and that climate scientists may be confusing their targets. Our analysis turns on a Bayesian/relative-likelihood approach to incremental confirmation. (...) According to this approach, double-counting is entirely proper. We go on to discuss plausible difficulties with calibrating climate models, and we distinguish more and less ambitious notions of confirmation. Strong claims of confirmation may not, in many cases, be warranted, but it would be a mistake to regard double-counting as the culprit. 1 Introduction2 Remarks about Models and Adequacy-for-Purpose3 Evidence for Calibration Can Also Yield Comparative Confirmation3.1 Double-counting I3.2 Double-counting II4 Climate Science Examples: Comparative Confirmation in Practice4.1 Confirmation due to better and worse best fits4.2 Confirmation due to more and less plausible forcings values5 Old Evidence6 Doubts about the Relevance of Past Data7 Non-comparative Confirmation and Catch-Alls8 Climate Science Example: Non-comparative Confirmation and Catch-Alls in Practice9 Concluding Remarks. (shrink)

Reports of quantitative experimental results often distinguish between the statistical uncertainty and the systematic uncertainty that characterize measurement outcomes. This article discusses the practice of estimating systematic uncertainty in high-energy physics. The estimation of systematic uncertainty in HEP should be understood as a minimal form of quantitative robustness analysis. The secure evidence framework is used to explain the epistemic significance of robustness analysis. However, the empirical value of a measurement result depends crucially not only on the resulting systematic uncertainty estimate, (...) but on the learning aims for which that result will be used. Important conceptual and practical questions regarding systematic uncertainty assessment call for further investigation. _1_ Introduction _2_ Systematic Uncertainty: The Very Idea _3_ Systematic Uncertainty in High-Energy Physics _4_ Methodological Debates in High-Energy Physics _5_ The Secure Evidence Framework _6_ Systematic Uncertainty Assessment as Robustness Analysis _7_ Security and Sensitivity _8_ Conclusion Appendix. (shrink)

This article identifies conditions under which robust predictive modeling results have special epistemic significance---related to truth, confidence, and security---and considers whether those conditions hold in the context of present-day climate modeling. The findings are disappointing. When today’s climate models agree that an interesting hypothesis about future climate change is true, it cannot be inferred---via the arguments considered here anyway---that the hypothesis is likely to be true or that scientists’ confidence in the hypothesis should be significantly increased or that a claim (...) to have evidence for the hypothesis is now more secure. (shrink)

This article highlights a use of analogies in science that so far has received relatively little systematic discussion: providing reasons for pursuing a model or theory. Using the development of the liquid drop model as a test case, I critically assess two extant pursuit worthiness accounts: that analogies justify pursuit by supporting plausibility arguments and that analogies can serve as a guide to potential theoretical unification. Neither of these fit the liquid drop model case. Instead, I develop an alternative account, (...) based on the idea that analogies facilitate the transfer of a well-understood modelling strategy to a new domain. 1Introduction2Case Study: The Development of the Liquid Drop Model3Plausibility Accounts 3.1Bartha on plausibility and analogical inference3.2Plausibility and the drop analogy4Analogies as a Guide to Unification5Generative Accounts 5.1Analogy-based modelling strategies5.2Did analogies play a merely generative role?6A New Pursuit Worthiness Account of Analogies 6.1Transferring understanding-with through analogies6.2Understanding-with and the liquid drop model7Conclusion. (shrink)

Recent philosophical attention to climate models has highlighted their weaknesses and uncertainties. Here I address the ways that models gain support through observational data. I review examples of model fit, variety of evidence, and independent support for aspects of the models, contrasting my analysis with that of other philosophers. I also investigate model robustness, which often emerges when comparing climate models simulating the same time period or set of conditions. Starting from Michael Weisberg’s analysis of robustness, I conclude that his (...) approach involves a version of reasoning from variety of evidence, enabling this robustness to be a confirmatory virtue.. (shrink)

It is argued in this paper that amalgamating confirmation from various sources is relevantly different from social-choice contexts, and that proving an impossibility theorem for aggregating confirmation measures directs attention to irrelevant issues.

I bring out the limitations of four important views of what the target of useful climate model assessment is. Three of these views are drawn from philosophy. They include the views of Elisabeth Lloyd and Wendy Parker, and an application of Bayesian confirmation theory. The fourth view I criticise is based on the actual practice of climate model assessment. In bringing out the limitations of these four views, I argue that an approach to climate model assessment that neither demands too (...) much of such assessment nor threatens to be unreliable will, in typical cases, have to aim at something other than the confirmation of claims about how the climate system actually is. This means, I suggest, that the Intergovernmental Panel on Climate Change ’s focus on establishing confidence in climate model explanations and predictions is misguided. So too, it means that standard epistemologies of science with pretensions to generality, e.g., Bayesian epistemologies, fail to illuminate the assessment of climate models. I go on to outline a view that neither demands too much nor threatens to be unreliable, a view according to which useful climate model assessment typically aims to show that certain climatic scenarios are real possibilities and, when the scenarios are determined to be real possibilities, partially to determine how remote they are. (shrink)

I examine, from Mayo's severe testing perspective, the case found in the Intergovernmental Panel on Climate Change fourth report for the claim that increases in anthropogenic greenhouse gas concentrations caused most of the post-1950 global warming. My examination begins to provide an alternative to standard, probabilistic assessments of OUR FAULT. It also brings out some of the limitations of variety of evidence considerations in assessing this and other hypotheses about the causes of climate change, and illuminates the epistemology of optimal (...) fingerprinting studies. Finally, it shows that some features of Mayo's perspective should be kept in whatever approach is preferred for assessing hypotheses about the causes of climate change. (shrink)

I examine the warrants we have in light of the empirical successes of a kind of model I call ‘ hybrid models ’, a kind that includes climate models among its members. I argue that these warrants ’ strengths depend on inferential virtues that are not just explanatory virtues, contrary to what would be the case if inference to the best explanation provided the warrants. I also argue that the warrants in question, unlike those IBE provides, guide inferences only to (...) model implications about which there is real uncertainty. My conclusion provides criteria of adequacy for epistemologies of climate and other hybrid models. (shrink)

The present paper draws on climate science and the philosophy of science in order to evaluate climate-model-based approaches to assessing climate projections. We analyze the difficulties that arise in such assessment and outline criteria of adequacy for approaches to it. In addition, we offer a critical overview of the approaches used in the IPCC working group one fourth report, including the confidence building, Bayesian and likelihood approaches. Finally, we consider approaches that do not feature in the IPCC reports, including three (...) approaches drawn from the philosophy of science. We find that all available approaches face substantial challenges, with IPCC approaches having as a primary source of difficulty their goal of providing probabilistic assessments. (shrink)

Robustness concepts are often invoked to manage two obstacles confronting models of ecological systems: complexity and uncertainty. The intuitive idea is that any result derived from many idealized but credible models is thereby made more reliable or is better confirmed. An appropriate basis for this inference has proven elusive. Here, several representations of robustness analysis are vetted, paying particular attention to complex models of ecosystems and the global climate. The claim that robustness is itself confirmatory because robustness analysis employs a (...) Bayesian variety-of-evidence argument is criticized, but recent overwhelming pessimism about robustness may have a silver lining. (shrink)

Empirical agreement is often used as an important criterion when assessing the validity of scientific models. However, it is by no means a sufficient criterion as a model can be so adjusted as to fit available data even though it is based on hypotheses whose plausibility is known to be questionable. Our aim in this paper is to investigate into the uses of empirical agreement within the process of model validation.

While it is widely acknowledged that science is not “free” of non-epistemic values, there is disagreement about the roles that values can appropriately play. Several have argued that non-epistemic values can play important roles in modeling decisions, particularly in addressing uncertainties ; Risbey 2007; Biddle and Winsberg 2010; Winsberg : 111-137, 2012); van der Sluijs 359-389, 2012). On the other hand, such values can lead to bias ; Bray ; Oreskes and Conway 2010). Thus, it is important to identify when (...) it is legitimate to appeal to non-epistemic values in modeling decisions. An approach is defended here whereby such value judgments are legitimate when they promote democratically endorsed epistemological and social aims of research. This framework accounts for why it is legitimate to appeal to non-epistemic values in a range of modeling decisions, while addressing concerns that the presence of such values will lead to bias or give scientists disproportionate power in deciding what values ought to be endorsed. (shrink)

When attendant to the agency of models and the general context in which they perform, climate models can be seen as instrumental policy tools that may be evaluated in terms of their adequacy for purpose. In contrast, when analysed independently of their real-world usage for informing decision-making, the tendency can be to prioritise their representative role rather than their instrumental role. This paper takes as a case study the development of the UK Climate Projections 2009 in relation to its probabilistic (...) treatment of uncertainties and the implications of this approach for adaptation decision-making. It is considered that the move towards ensemble-based probabilistic climate projections has the benefit of encouraging organisations to reshape their adaptation strategies and decisions towards a risk-based approach, where they are confronted definitively with climate modelling uncertainties and drawn towards a more nuanced understanding of how climate impacts could affect their operations. This is further illustrated through the example of the built environment sector, where it can be seen that the probabilistic approach may be of limited salience for the urban heat island in the absence of a corresponding effort towards a more place-based analysis of climate vulnerabilities. Therefore, further assessment of the adequacy-for-purpose of climate models might also consider the usability of climate projections at the urban scale. (shrink)

Cognitive values like simplicity, broad scope, and easy handling are properties of a scientific representation that result from the idealization which is involved in the construction of a representation. These properties may facilitate the application of epistemic values to credibility assessments, which provides a rationale for assigning an auxiliary function to cognitive values. In this paper, I defend a further rationale for cognitive values which consists in the assessment of the usefulness of a representation. Usefulness includes the relevance of a (...) representation regarding the investigation of a given problem and its practicability for the users. This rationale builds on the claim that any evaluation of scientific representations should pursue two aims: providing information about their credibility and providing information about their usefulness. Cognitive values relating to the usefulness of a representation and epistemic values relating to its credibility both perform a first-order function. Cognitive values are abstract, and several values with first-order functions may conflict in their application. Thus, in order for cognitive values to account for the sort of problem that is to be investigated by means of a representation, they need to be appropriately specified and weighed. Comprehensiveness, complexity, high resolution, and easy handling, for instance, may be required in a first-order function for model-based prediction of regional climate impacts but not for explaining how the global climate system works. Specifying and weighing cognitive and epistemic values relative to a given problem is a legitimate second-order function of social values. (shrink)

The translation of a mathematical model into a numerical one employs various modifications in order to make the model accessible for computation. Such modifications include discretizations, approximations, heuristic assumptions, and other methods. The paper investigates the divergent styles of mathematical and numerical models in the case of a specific piece of code in a current atmospheric model. Cognizance of these modifications means that the question of the role and function of scientific models has to be reworked. Neither are numerical models (...) pure intermediaries between theory and data, nor are they autonomous tools of inquiry. Instead, theory and data are transformed into a new symbolic form of research due to the fact that computation has become an essential requirement for every scientific practice. Therefore the question is posed: What do numerical (climate) models really represent? (shrink)

Many climate scientists have made claims that may suggest that evidence used in tuning or calibrating a climate model cannot be used to evaluate the model. By contrast, the philosophers Katie Steele and Charlotte Werndl have argued that, at least within the context of Bayesian confirmation theory, tuning is simply an instance of hypothesis testing. In this paper I argue for a weak predictivism and in support of a nuanced reading of climate scientists’ concerns about tuning: there are cases, model-tuning (...) among them, in which predictive successes are more highly confirmatory of a model than accommodation of evidence. (shrink)

This contribution provides an assessment of the epistemological role of scientific models. The prevalent view that all scientific models are representations of the world is rejected. This view points to a unified way of resolving epistemic issues for scientific models. The emerging consensus in philosophy of science that models have many different epistemic roles in science is presented and defended.

Criticism is a staple of the scientific enterprise and of the social epistemology of science. Philosophical discussions of criticism have traditionally focused on its roles in relation to objectivity, confirmation, and theory choice. However, attention to criticism and to criticizability should also inform our thinking about scientific pursuits: the allocation of resources with the aim of developing scientific tools and ideas. In this paper, we offer an account of scientific pursuitworthiness which takes criticizability as its starting point. We call this (...) the apokritic model of pursuit. Its core ideas are that pursuits are practices governed by norms for asking and answering questions, and that criticism arises from the breach of these norms. We illustrate and advertise our approach using examples from institutional grant review, neuroscience, and sociology. We show that the apokritic model can unify several indices of criticizability, that it can account for the importance of criticizing pursuits in scientific practice, and that it can offer ameliorative advice to erstwhile pursuers. (shrink)

Philosophy of science has witnessed substantial recent debate over the existence of a structural analogue of chaos, which is alleged to spell trouble for certain uses of climate models. The debate over the analogy can and should be separated from its alleged epistemic implications: chaos-like behavior is neither necessary nor sufficient for small dynamical misrepresentations to generate erroneous results. The kind of sensitivity that matters in epistemology is one that induces unsafe beliefs, and the existence of a structural analogue to (...) chaos is better seen as an explanation for known safety failures than as providing evidence for unknown ones. (shrink)

I develop an account of productive surprise as an epistemic virtue of scientific investigations which does not turn on psychology alone. On my account, a scientific investigation is potentially productively surprising when results can conflict with epistemic expectations, those expectations pertain to a wide set of subjects. I argue that there are two sources of such surprise in science. One source, often identified with experiments, involves bringing our theoretical ideas in contact with new empirical observations. Another, often identified with simulations, (...) involves articulating and bringing together different parts of our knowledge. Both experiments and simulations, then, can surprise. (shrink)

Climate models don’t give us probabilistic forecasts. To interpret their results, alternatively, as serious possibilities seems problematic inasmuch as climate models rely on contrary-to-fact assumptions: why should we consider their implications as possible if their assumptions are known to be false? The paper explores a way to address this possibilistic challenge. It introduces the concepts of a perfect and of an imperfect credible world, and discusses whether climate models can be interpreted as imperfect credible worlds. That would allow one to (...) use models for possibilistic prediction and salvage widespread scientific practice. (shrink)

The paper discusses Bayesian convergence when the truth is excluded from the analysis by means of a simple coin-tossing example. In the fair-balance paradox a fair coin is tossed repeatedly. A Bayesian agent, however, holds the a priori view that the coin is either biased towards heads or towards tails. As a result the truth is ignored by the agent. In this scenario the Bayesian approach tends to confirm a false model as the data size goes to infinity. I argue (...) that the fair-balance paradox reveals an unattractive feature of the Bayesian approach to scientific inference and explore a modification of the paradox. (shrink)

A central component to scientific practice is the construction and use of scientific models. Scientists believe that the success of a model justifies making claims that go beyond the model itself. However, philosophical analysis of models suggests that drawing inferences about the world from successful models is more complex. In this dissertation I develop a framework that can help disentangle the related strands of evaluation of model success, model extendibility, and the ability to draw ampliative inferences about the world from (...) models. I present and critically assess two leading accounts of model assessment, arguing that neither is sufficient to provide a complete understanding of model evaluation. I introduce a more powerful framework incorporating elements of the two views, which can help answer these three questions: What is the target of evaluation in model assessment? How does that evaluation proceed? What licenses us in making inferences about the real world, based on the evaluation of our models as successful? The framework identifies two distinct targets of model evaluation: representational similarity between the model and target system, and the adequacy of the model as a tool to answer questions. Both assessments must be relativized to a purpose, of which there are three general kinds: descriptive, predictive, and explanatory. These purposes differ in the way they inform the similarity relation, which is relevant for the similarity assessment, and the output they produce, which is relevant for the adequacy assessment. Any model can be assessed relative to any purpose, however a model encodes certain decisions made during the model’s construction, which impact its ability to be applied to a new purpose or new domain. My framework shows that extending a model, and drawing inferences from it, depends on its representational similarity. I apply this framework to several examples taken from astrophysics showing in detail how it can help illuminate the structure of the models, as well as make the justification for inferences made from them clear. The final chapter is a detailed analysis of a contemporary debate surrounding the use of models in astrophysics, between proponents of MOND and the standard ΛCDM model. (shrink)

The goal of this dissertation is to contribute to the epistemology of science by addressing a set of related questions arising from current discussions in the philosophy and science of climate change: (1) Given the imperfection of computer models, how do they provide information about large and complex target systems? (2) What is the relationship between consilient reasoning and robust evidential support in the production of scientific knowledge? (3) Does taking the mean of a set of model outputs provide epistemic (...) advantages over using the output of a single ‘best model’? Synthesizing research in philosophy and science, the thesis analyzes connections among consilient inductions, robustness analysis, and the aggregation of various sources of evidence, including computer simulations, by investigating case studies of climate change that exemplify the strength of consilient reasoning and the security of robust evidential support. It also explains the rationale and epistemic conditions for improving estimates by averaging multiple estimates, comparing a simple case of averaging estimates to practices in multi-model ensemble studies. I argue: (A) the concepts of consilience and robustness account for the strength and security of inferences that rely on imperfect computer modelling methods, (B) consilient reasoning is conducive to attaining robust evidential support, and (C) an analogy can explain why averaging the outputs of multiple models can improve estimates of a target system, given that conditions of model independence, skill and unequal weighting are taken into account. (shrink)

In engineering, as in other scientific fields, researchers seek to confirm their models with real-world data. It is common practice to assess models in terms of the distance between the model outputs and the corresponding experimental observations. An important question that arises is whether the model should then be ‘tuned’, in the sense of estimating the values of free parameters to get a better fit with the data, and furthermore whether the tuned model can be confirmed with the same data (...) used to tune it. This dual use of data is often disparagingly referred to as ‘double-counting’. Here, we analyse these issues, with reference to selected research articles in engineering. Our example studies illustrate more and less controversial practices of model tuning and double-counting, both of which, we argue, can be shown to be legitimate within a Bayesian framework. The question nonetheless remains as to whether the implied scientific assumptions in each case are apt from the engineering point of view. (shrink)