In this commentary to Napoletani et al. (Foundations of Science 16:1–20, 2011), we put agnostic science in a wider historical context of philosophy of mathematics. Secondly, the parallel to Tukey’s “exploratory data analysis” will be discussed. Thirdly, it will be argued that what is new is the mutually interdependent dynamics of data (on which Napoletani et al. focus) and of computational modeling—which puts science closer to engineering and vice versa.

We analyse the issue of using prior information in frequentist statistical inference. For that purpose, we scrutinise different kinds of sampling designs in Jerzy Neyman’s theory to reveal a variety of ways to explicitly and objectively engage with prior information. Further, we turn to the debate on sampling paradigms (design-based vs. model-based approaches) to argue that Neyman’s theory supports an argument for the intermediate approach in the frequentism vs. Bayesianism debate. We also demonstrate that Neyman’s theory, by allowing non-epistemic values (...) to influence evidence collection and formulation of statistical conclusions, does not compromise the epistemic reliability of the procedures and may improve it. This undermines the value-free ideal of scientific inference. (shrink)

Scientific methods are heuristic in nature. Heuristics are simplifying, incomplete, underdetermined and fallible problem-solving rules that can nevertheless serve certain goals in certain contexts better than truth-preserving algorithms. Because of their goal- and context-dependence, a framework is needed for systematic choosing between them. This is the domain of scientific methodology. Such a methodology, I argue, relies on a form of instrumental rationality. Three challenges to such an instrumentalist account are addressed. First, some authors have argued that the rational choice of (...) at least some methods, namely those supporting belief formation, is not goal-dependent. Second, some authors have observed that some method choices seem intuitively rational, even though relevant goals are lacking. Thirdly, some authors have argued that instrumental rationality itself depends on a goal-independent form of rationality. It is the heuristic nature of scientific methods that affords me the arguments against these challenges. This heuristic-instrumentalist account provides the means-ends analysis needed to evaluate heuristic method choice. The paper thus offers the conceptual basis for a scientific methodology that is both compatible with the heuristic nature of actual scientific practice and also normatively relevant for assessing method choice. (shrink)

Entropy is ubiquitous in physics, and it plays important roles in numerous other disciplines ranging from logic and statistics to biology and economics. However, a closer look reveals a complicated picture: entropy is defined differently in different contexts, and even within the same domain different notions of entropy are at work. Some of these are defined in terms of probabilities, others are not. The aim of this chapter is to arrive at an understanding of some of the most important notions (...) of entropy and to clarify the relations between them, After setting the stage by introducing the thermodynamic entropy, we discuss notions of entropy in information theory, statistical mechanics, dynamical systems theory and fractal geometry. (shrink)

1. Overview and organizing themes 2. Historical Review: Aristotle to Mill 3. Logic of method and critical responses 3.1 Logical constructionism and Operationalism 3.2. H-D as a logic of confirmation 3.3. Popper and falsificationism 3.4 Meta-methodology and the end of method 4. Statistical methods for hypothesis testing 5. Method in Practice 5.1 Creative and exploratory practices 5.2 Computer methods and the ‘third way’ of doing science 6. Discourse on scientific method 6.1 “The scientific method” in science education and as seen (...) by scientists 6.2 Privileged methods and ‘gold standards’ 6.3 Scientific method in the court room 6.4 Deviating practices 7. Conclusion Bibliography Academic Tools Other Internet Resources Related Entries . (shrink)

This thesis has two goals. Firstly, we consider the problem of model selection for the purposes of prediction. In modern science predictive mathematical models are ubiquitous and can be found in such diverse fields as weather forecasting, economics, ecology, mathematical psychology, sociology, etc. It is often the case that for a given domain of inquiry there are several plausible models, and the issue then is how to discriminate between them – this is the problem of model selection. We consider approaches (...) to model selection that are used in classical [also known as frequentist] statistics, and fashionable in recent years methods of Akaike Information Criterion [AIC] and Bayes Information Criterion [BIC], the latter being a part of a broader Bayesian approach. We show the connection between AIC and BIC, and provide comparison of performance of these methods. Secondly, we consider some philosophical arguments that arise within the setting of the model selection approaches investigated in the first part. These arguments aim to provide counterexamples to the epistemic thesis of scientific realism, viz., that predictively successful scientific theories are approximately true, and to the idea that truth and predictive accuracy go together. We argue for the following claims: 1) that none of the criticisms brought forward in the philosophical literature against the AIC methodology are devastating, and AIC remains a viable method of model selection; 2) that the BIC methodology likewise survives the numerous criticisms; 3) that the counterexamples to scientific realism that ostensibly arise within the framework of model selection are flawed; 4) that in general the model selection methods discussed in this thesis are neutral with regards to the issue of scientific realism; 5) that a plurality of methodologies should be applied to the problem of model selection with full awareness of the foundational issues that each of these methodologies has. (shrink)