How experimental algorithmics can benefit from Mayo's extensions to neyman–pearson theory of testing

Synthese 163 (3):385 - 396 (2008)
Although theoretical results for several algorithms in many application domains were presented during the last decades, not all algorithms can be analyzed fully theoretically. Experimentation is necessary. The analysis of algorithms should follow the same principles and standards of other empirical sciences. This article focuses on stochastic search algorithms, such as evolutionary algorithms or particle swarm optimization. Stochastic search algorithms tackle hard real-world optimization problems, e.g., problems from chemical engineering, airfoil optimization, or bio-informatics, where classical methods from mathematical optimization fail. Nowadays statistical tools that are able to cope with problems like small sample sizes, non-normal distributions, noisy results, etc. are developed for the analysis of algorithms. Although there are adequate tools to discuss the statistical significance of experimental data, statistical significance is not scientifically meaningful per se. It is necessary to bridge the gap between the statistical significance of an experimental result and its scientific meaning. We will propose some ideas on how to accomplish this task based on Mayo’s learning model (NPT*).
Keywords New experimentalism  Experimental algorithmics  Optimization  Theory of testing  Mayo’s learning model  Significance
Categories No categories specified
(categorize this paper)
DOI 10.1007/s11229-007-9297-z
 Save to my reading list
Follow the author(s)
Edit this record
My bibliography
Export citation
Find it on Scholar
Mark as duplicate
Request removal from index
Revision history
Download options
Our Archive

Upload a copy of this paper     Check publisher's policy     Papers currently archived: 29,827
Through your library
References found in this work BETA
Error and the Growth of Experimental Knowledge.Deborah G. Mayo - 1996 - International Studies in the Philosophy of Science 15 (1):455-459.
Severe Testing as a Basic Concept in a Neyman–Pearson Philosophy of Induction.Deborah G. Mayo & Aris Spanos - 2006 - British Journal for the Philosophy of Science 57 (2):323-357.

Add more references

Citations of this work BETA

No citations found.

Add more citations

Similar books and articles
Added to PP index

Total downloads
49 ( #115,675 of 2,210,098 )

Recent downloads (6 months)
10 ( #36,243 of 2,210,098 )

How can I increase my downloads?

Monthly downloads
My notes
Sign in to use this feature