How experimental algorithmics can benefit from Mayo’s extensions to Neyman–Pearson theory of testing

Synthese 163 (3):385 - 396 (2008)
  Copy   BIBTEX


Although theoretical results for several algorithms in many application domains were presented during the last decades, not all algorithms can be analyzed fully theoretically. Experimentation is necessary. The analysis of algorithms should follow the same principles and standards of other empirical sciences. This article focuses on stochastic search algorithms, such as evolutionary algorithms or particle swarm optimization. Stochastic search algorithms tackle hard real-world optimization problems, e.g., problems from chemical engineering, airfoil optimization, or bio-informatics, where classical methods from mathematical optimization fail. Nowadays statistical tools that are able to cope with problems like small sample sizes, non-normal distributions, noisy results, etc. are developed for the analysis of algorithms. Although there are adequate tools to discuss the statistical significance of experimental data, statistical significance is not scientifically meaningful per se. It is necessary to bridge the gap between the statistical significance of an experimental result and its scientific meaning. We will propose some ideas on how to accomplish this task based on Mayo’s learning model (NPT*).



    Upload a copy of this work     Papers currently archived: 77,869

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library


Added to PP

76 (#164,945)

6 months
1 (#483,919)

Historical graph of downloads
How can I increase my downloads?

Citations of this work

No citations found.

Add more citations

References found in this work

Error and the growth of experimental knowledge.Deborah Mayo - 1996 - International Studies in the Philosophy of Science 15 (1):455-459.
Error and the Growth of Experimental Knowledge.Deborah Mayo - 1997 - British Journal for the Philosophy of Science 48 (3):455-459.
Severe testing as a basic concept in a neyman–pearson philosophy of induction.Deborah G. Mayo & Aris Spanos - 2006 - British Journal for the Philosophy of Science 57 (2):323-357.

View all 6 references / Add more references