Prediction in Science

The paper will compare two methods used in the design of diagnostic strategies. The first one is a method that precises predictive value of diagnostic tests. The second one is based on the use of Bayes’ theorem. The main aim of this article is to identify the epistemological assumptions underlying both of these methods. For the purpose of this objective, example projects of one and multi-stage diagnostic strategy developed using both methods will be considered.

In recent years the problem of scientific prediction has attracted a constantly increasing number of researchers. The fact that a number of philosophers, logicians, and representatives of concrete disciplines have turned to investigating the nature of scientific prediction is first of all because of the needs of the development of scientific knowledge itself, as well as of industry. The rapid progress of the natural and the social sciences puts in the foreground the task of studying the internal regularities of the (...) process of acquisition of knowledge, the techniques and methods of research, and in particular, so very important a function of science as prediction. (shrink)

I critically examine Stewart’s suggestion that we should weigh the various predictions Mendeleev made differently. I argue that in his effort to justify discounting the weight of some of Mendeleev’s failures, Stewart invokes a principle that will, in turn, reduce the weight of some of the successful predictions Mendeleev made. So Stewart’s strategy will not necessarily lead to a net gain in Mendeleev’s favor.

Several authors have claimed that prediction is essentially impossible in the general theory of relativity, the case being particularly strong, it is said, when one fully considers the epistemic predicament of the observer. Each of these claims rests on the support of an underdetermination argument and a particular interpretation of the concept of prediction. I argue that these underdetermination arguments fail and depend on an implausible explication of prediction in the theory. The technical results adduced in these arguments can be (...) related to certain epistemic issues, but can only be misleadingly or mistakenly characterized as related to prediction. (shrink)

This paper investigates whether there is a discrepancy between stated and actual aims in biomechanical research, particularly with respect to hypothesis testing. We present an analysis of one hundred papers recently published in The Journal of Experimental Biology and Journal of Biomechanics, and examine the prevalence of papers which have hypothesis testing as a stated aim, contain hypothesis testing claims that appear to be purely presentational, and have exploration as a stated aim. We found that whereas no papers had exploration (...) as a stated aim, 58 per cent of papers had hypothesis testing as a stated aim. We had strong suspicions, at the bare minimum, that presentational hypotheses were present in 31 per cent of the papers in this latter group. (shrink)

The cosmic censorship hypothesis states that the general theory of relativity has built in mechanisms to prevent the formation of "naked singularities," pathologies in the spacetime structure that lead to a breakdown in predictability and determinism. This paper discusses some attempts to turn the vague hypothesis into a precise conjecture. Evidence in favor of and against the conjecture is briefly reviewed. Finally the possibility of forming naked singularities via black hole evaporation due to Hawking radiation is discussed.

Deterministic Chaos: Some Interesting Points of View from the Philosophy of Science. A comparatively simple example is used to present some of the main features of deterministic chaos. From the point of view of the philosophy of science, three questions are dealt with: if the equations of motion of chaotic systems are falsifiable in a strict sense; whether experiments on chaotic systems are reproducible; to what extent the development of chaotic systems is predictable. It emerges that in these respects chaotic (...) systems, though being deterministic, behave essentially in the same way as stochastic (indeterministic) systems do. (shrink)

Abstract Reichenbach emphasizes the central importance of prediction, which is?for him?the principal aim of science. This paper offers a critical reconstruction of his concept of prediction, taking into account the different periods of his thought. First, prediction is studied as a key factor in rejecting the positivism of the Vienna Circle. This part of the discussion concentres on the general features of prediction before Experience and Prediction (EP) (section 1). Second, prediction is considered in the context of Reichenbach's disagreements with (...) his contemporaries?Carnap and Popper?(section 2). Pointing out these differences gives an additional basis for understanding how Reichenbach saw ?prediction? in the period when EP was written. Third, Reichenbach's theoretical framework of prediction is analysed following EP. This analysis studies the semantical, logical, epistemological and methodological bases of his concept of prediction (section 3). Fourth, Reichenbach's conception of prediction, based on an objectivist interpretation of probabilities, is compared with the perspective on prediction of subjective Bayesians (the present personalists). This comparison (section 4) illustrates Reichenbach's views regarding the links of prediction with probability. Fifth, innovations and elements of continuity after EP are noted which give a more complete picture of Reichenbach's thought on prediction (section 5). This contributes to a comprehensive characterization of his concept of prediction. Finally, there is an assessment of his whole view of the matter and a presentation of the ingredients for a satisfactory alternative (section 6). (shrink)

The view that large-scale, long-range social theories cannot be predictive other than "in principle" is sufficiently widespread as to be considered the orthodox view. It is widely held that, lacking this predictive quality, social theories are cut off from a crucial form of vindication enjoyed by the experimental sciences. Thus many would agree with Ryan's assessment that while with regard to large-scale social changes "long-range prediction is not in principle impossible," nonetheless as a matter of practical methodology such a goal (...) is of "dubious value." ;The reason commonly proffered as to why social theories cannot be predictive is the causal complexity of social life. Because of this feature, it is held, while we may be able to unearth interesting social generalizations, we will not be able to predict the many initial conditions together with which they predict. Alternately, due to this complexity we are able to achieve no better than tendency laws which do not permit predictions of sufficient precision to allow for predictive testing. This has been held to be true for other causally complex fields as well. Thus, Scriven has argued that Darwin was "the paradigm of the explanatory but non-predictive scientist" due to the constraints imposed on his methodology by the causal complexity of the biosphere. ;As a result of both an uncritical acceptance of the orthodox view and an inadequate analysis of Marx's methodology, Daniel Little has argued that Marxian theory is non-predictive. However, a thorough analysis of Marx's labour process theory shows it to be both clearly predictive and subject to justification by predictive assessment. Moreover, a formalization of the theory indicates that available data confirm it as regards both its central hypothesis and the matrix of social causation it exhibits. ;Little's position in regard to Marxian theory is strongly similar to Scriven's in regard to Darwinian theory. In both cases, faulty theoretical presuppositions combine with inadequate analysis to buttress false conclusions as to the asymmetry of explanation and prediction. Adequate analysis dispels Little's and Scriven's conclusions and exhibits important methodological parallels between Marx and Darwin. (shrink)

The paper presents a further articulation and defence of the view on prediction and accommodation that I have proposed earlier. It operates by analysing two accounts of the issue-by Patrick Maher and by Marc Lange-that, at least at first sight, appear to be rivals to my own. Maher claims that the time-order of theory and evidence may be important in terms of degree of confirmation, while that claim is explicitly denied in my account. I argue, however, that when his account (...) is analysed, Maher reveals no scientifically significant way in which the time-order counts, and that indeed his view is in the end best regarded as a less than optimally formulated version of my own. Lange has also responded to Maher by arguing that the apparent relevance of temporal considerations is merely apparent: what is really involved, according to Lange, is whether or not a hypothesis constitutes an "arbitrary conjunction." I argue that Lange's suggestion fails: the correct analysis of his and Maher's examples is that provided by my account. (shrink)

Accurate estimation of risk and benefit is integral to good clinical research planning, ethical review, and study implementation. Some commentators have argued that various actors in clinical research systems are prone to biased or arbitrary risk/benefit estimation. In this commentary, we suggest the evidence supporting such claims is very limited. Most prior work has imputed risk/benefit beliefs based on past behavior or goals, rather than directly measuring them. We describe an approach – forecast analysis – that would enable direct and (...) effective measure of the quality of risk/benefit estimation. We then consider some objections and limitations to the forecasting approach. (shrink)

As climate policy decisions are decisions under uncertainty, being based on a range of future climate change scenarios, it becomes a crucial question how to set up this scenario range. Failing to comply with the precautionary principle, the scenario methodology widely used in the Third Assessment Report of the International Panel on Climate Change (IPCC) seems to violate international environmental law, in particular a provision of the United Nations Framework Convention on Climate Change. To place climate policy advice on a (...) sound methodological basis would imply that climate simulations which are based on complex climate models had, in stark contrast to their current hegemony, hardly an epistemic role to play in climate scenario analysis at all. Their main function might actually consist in ‘foreseeing future ozone-holes’. In order to argue for these theses, I explain first of all the plurality of climate models used in climate science by the failure to avoid the problem of underdetermination. As a consequence, climate simulation results have to be interpreted as modal sentences, stating what is possibly true of our climate system. This indicates that climate policy decisions are decisions under uncertainty. Two general methodological principles which may guide the construction of the scenario range are formulated and contrasted with each other: modal inductivism and modal falsificationism. I argue that modal inductivism, being the methodology implicitly underlying the third IPCC report, is severely flawed. Modal falsificationism, representing the sound alternative, would in turn require an overhaul of the IPCC practice. (shrink)

Philosophers and historians of philosophy have come to recognize that at the core of logical positivism was an attachment to prediction as the necessary condition for scientific knowledge.1 The inheritors of their tradition, especially the Bayesians among us, continue to seek a theory of confirmation that reflects this epistemic commitment. The importance of prediction in the growth of scientific knowledge is a commitment I share with the positivists, so I do not blanch at that designation, much less employ it as (...) a term of abuse. Precisely expressing and conclusively establishing the claims of prediction as a necessary condition for certifying claims as increments of knowledge is a goal that has so far eluded us post-positivists. Philosophers know the problems well: defining a positive instance, distinguishing projectible from nonprojectible predicates, deciding whether retrodiction is as epistemically probative as prediction. 2 But I can't help thinking that these problems are technicalities - important and arresting, but not impediments to embracing the positivist demand that increments in scientific knowledge withstand tests of predictive success. (shrink)

Evidence for a hypothesis typically confirms the hypothesis more if the evidence was predicted than if it was accommodated. Or so I argued in previous papers, where I also developed an analysis of why this should be so. But this was all a mistake if Howson and Franklin (1991) are to be believed. In this paper, I show why they are not to be believed. I also identify a grain of truth that may have been dimly grasped by those Bayesians (...) who deny the confirmatory value of prediction. (shrink)

The aim of this paper is to defend some of C. G. Hempel's basic theses concerning the logic of explanation and prediction against criticisms recently made by W. Stegmüller. It is argued (very concisely) thatthese is no need for essentially pragmatic conditions in DN-arguments;only the structural identity sub-thesis “Every adequate prediction is ... an adequate explanation” can be held instead of the one Hempel has in mind;the notion of the ambiguity of probabilistic explanations should be reformulated;there is no need for (...) more than one knowledge situation;systematizations with low inductive probability do not give rational predictions or explanations of singular events. (shrink)

With the ascent of modern epidemiology in the Twentieth Century came a new standard model of prediction in public health and clinical medicine. In this article, we describe the structure of the model. The standard model uses epidemiological measures-most commonly, risk measures-to predict outcomes (prognosis) and effect sizes (treatment) in a patient population that can then be transformed into probabilities for individual patients. In the first step, a risk measure in a study population is generalized or extrapolated to a target (...) population. In the second step, the risk measure is particularized or transformed to yield probabilistic information relevant to a patient from the target population. Hence, we call the approach the Risk Generalization-Particularization (Risk GP) Model. There are serious problems at both stages, especially with the extent to which the required assumptions will hold and the extent to which we have evidence for the assumptions. Given that there are other models of prediction that use different assumptions, we should not inflexibly commit ourselves to one standard model. Instead, model pluralism should be standard in medical prediction. (shrink)

RATIONALE, AIMS AND OBJECTIVES: Increased awareness of the gap between controlled research and medical practice has raised concerns over whether the special attention of doctors to probability estimates from clinical trials really improves the care of individuals. Evidence-based medicine has acknowledged that research results are not applicable to all kinds of patients, and consequently, has attempted to overcome this limitation by introducing improvements in the design and analysis of clinical trials. METHODS: A clinical case is used to highlight the premises (...) required to support reasonable extrapolations from controlled research to individuals. Then, the prospects of two key methodological improvements - pragmatic randomized controlled trials and subgroup analysis - are critically appraised. RESULTS: A principle to guide therapeutic inferences is suggested. According to this principle, the probabilities of interest for purposes of therapeutic decision making are those of the set defined by everything that is relevant to the patient and the outcome of interest at the time of the decision. It is argued that the conditions necessary to authorize automatic extrapolations of research results to specific patients are highly demanding. Furthermore, these requirements are rarely accomplished in real practice, even in the event that probability estimates come from samples generally taken as representative and are derived from specific subsets of patients. CONCLUSIONS: Clinicians should generally avoid unreflective extrapolations from research and address, as explicitly as possible, the challenge of estimating probabilities for individual patients. A key element of this task is the integration of data from research and non-research sources. (shrink)

In their critique of Klein (2014a), Trafimow and Earp present two theses. First, they argue that, contra Klein, a well-specified theory is not a necessary condition for successful replication. Second, they contend that even when there is a well-specified theory, replication depends more on auxiliary assumptions than on theory proper. I take issue with both claims, arguing that (a) their first thesis confuses a material conditional (what I said) with a modal claim (T&E’s misreading of what I said), and (b) (...) their second thesis has the unfortunate consequence of refuting their first thesis. (shrink)

Climate models don’t give us probabilistic forecasts. To interpret their results, alternatively, as serious possibilities seems problematic inasmuch as climate models rely on contrary-to-fact assumptions: why should we consider their implications as possible if their assumptions are known to be false? The paper explores a way to address this possibilistic challenge. It introduces the concepts of a perfect and of an imperfect credible world, and discusses whether climate models can be interpreted as imperfect credible worlds. That would allow one to (...) use models for possibilistic prediction and salvage widespread scientific practice. (shrink)

In einer Welt, in der der Umgang mit Komplexität und Unsicherheit an Bedeutung gewinnt, sind politische Entscheidungsträger immer stärker auf eine wissenschaftliche Beratung angewiesen. Trotz des Bedarfs der politischen Akteure nach konkreten Handlungsempfehlungen sollte seriöse Politikberatung die grundlegenden Werte wissenschaftlichen Arbeitens nicht aus den Augen verlieren.

It is taken for granted that the explanation of the Universe’s space-time dimension belongs to the host of the arguments that exhibit the superiority of modern (inflationary) cosmology over the standard model. In the present paper some doubts are expressed . They are based upon the fact superstring theory is too formal to represent genuine unification of general relativity and quantum field theory. Neveretheless, the fact cannot exclude the opportunity that in future the superstring theory can become more physical. Hence (...) this paper does not aim to query neither string cosmology, nor superstring theory; it asks for “tolerance in the matters cosmological”. It advices the researchers not to dwell on the common way of unification and to take into consideration the other ways as well. (shrink)

Even though social scientists continue to discuss the problems posed by self-fulfilling and self-frustrating predictions, philosophers of science have ignored the topic since the 1970s. Back then, the prevailing view was that the methodological problems posed by reflexive predictions are either minor or easily avoided. I believe that this consensus was premature, ultimately relying on an overly narrow understanding of the phenomenon. I present an improved way to understand reflexive predictions (framed in probabilistic terms) and show that, once such predictions (...) are understood this way, the methodological problems they pose may turn out to be neither minor nor easily avoided. (shrink)

All major research ethics policies assert that the ethical review of clinical trial protocols should include a systematic assessment of risks and benefits. But despite this policy, protocols do not typically contain explicit probability statements about the likely risks or benefits involved in the proposed research. In this essay, I articulate a range of ethical and epistemic advantages that explicit forecasting would offer to the health research enterprise. I then consider how some particular confidence levels may come into conflict with (...) the principles of ethical research. (shrink)

A major difficulty for currently existing theories of inductive inference involves the question of what to do when novel, unknown, or previously unsuspected phenomena occur. In this paper one particular instance of this difficulty is considered, the so-called sampling of species problem.The classical probabilistic theories of inductive inference due to Laplace, Johnson, de Finetti, and Carnap adopt a model of simple enumerative induction in which there are a prespecified number of types or species which may be observed. But, realistically, this (...) is often not the case. In 1838 the English mathematician Augustus De Morgan proposed a modification of the Laplacian model to accommodate situations where the possible types or species to be observed are not assumed to be known in advance; but he did not advance a justification for his solution. (shrink)

The paper provides a formal proof that efficient estimates of parameters, which vary as as little as possible when measurements are repeated, may be expected to provide more accurate predictions. The definition of predictive accuracy is motivated by the work of Akaike (1973). Surprisingly, the same explanation provides a novel solution for a well known problem for standard theories of scientific confirmation — the Ravens Paradox. This is significant in light of the fact that standard Bayesian analyses of the paradox (...) fail to account for the predictive utility of universal laws like All ravens are black. (shrink)

WE AIM HERE to outline a theory of evidence for use. More specifically we lay foundations for a guide for the use of evidence in predicting policy effectiveness in situ, a more comprehensive guide than current standard offerings, such as the Maryland rules in criminology, the weight of evidence scheme of the International Agency for Research on Cancer (IARC), or the US ‘What Works Clearinghouse’. The guide itself is meant to be well-grounded but at the same time to give practicable (...) advice, that is, advice that can be used by policy-makers not expert in the natural and social sciences, assuming they are well-intentioned and have a reasonable but limited amount of time and resources available for searching out evidence and deliberating. (shrink)

The received view of an ad hochypothesis is that it accounts for only the observation(s) it was designed to account for, and so non-ad hocness is generally held to be necessary or important for an introduced hypothesis or modification to a theory. Attempts by Popper and several others to convincingly explicate this view, however, prove to be unsuccessful or of doubtful value, and familiar and firmer criteria for evaluating the hypotheses or modified theories so classified are characteristically available. These points (...) are obscured largely because the received view fails to adequately separate psychology from methodology or to recognise ambiguities in the use of ''ad hoc''. (shrink)

Our aim in this paper is to bring the woefully neglected literature on predictive modeling to bear on some central questions in the philosophy of science. The lesson of this literature is straightforward: For a very wide range of prediction problems, statistical prediction rules (SPRs), often rules that are very easy to implement, make predictions than are as reliable as, and typically more reliable than, human experts. We will argue that the success of SPRs forces us to reconsider our views (...) about what is involved in understanding, explanation, good reasoning, and about how we ought to do philosophy of science. (shrink)