Skip to main content
Log in

Some issues in the foundation of statistics

  • The Foundation of Statistics
  • Published:
Foundations of Science Aims and scope Submit manuscript

Abstract

After sketching the conflict between objectivists and subjectivists on the foundations of statistics, this paper discusses an issue facing statisticians of both schools, namely, model validation. Statistical models originate in the study of games of chance, and have been successfully applied in the physical and life sciences. However, there are basic problems in applying the models to social phenomena; some of the difficulties will be pointed out. Hooke's law will be contrasted with regression models for salary discrimination, the latter being a fairly typical application in the social sciences.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Bayes, Thomas (1764), An Essay Towards Solving a Problem in the Doctrine of Chances,Philosophical Transactions of the Royal Society of London 53, 370–418.

    Article  Google Scholar 

  • Berger, J. (1985),Statistical Decision Theory and Bayesian Analysis. 2nd ed. New York, Springer-Verlag.

    Book  Google Scholar 

  • Berger, J. and Wolpert, R. (1988),The Likelihood Principle. 2nd ed. Hayward, Calif., Institute of Mathematical Statistics.

    Google Scholar 

  • Bickel, P. J. and Doksum, K. A. (1977),Mathematical Statistics: Basic Ideas and Selected Topics. San Francisco, Holden-Day.

    Google Scholar 

  • Box, G. E. P. and Tiao, G. C. (1992),Bayesian Inference in Statistical Analysis. New York, Wiley.

    Book  Google Scholar 

  • Casella, G. and Berger, R. L. (1990),Statistical Inference. Pacific Grove, Calif., Wadsworth & Brooks/Cole.

    Google Scholar 

  • Clogg, C. C. and Haritou, A. (1994), The Regression Method of Causal Inference and a Dilemma with this Method. Technical report, Department of Sociology, Pennsylvania State University. To appear in V. McKim and S. Turner (eds),Proceedings of the Notre Dame Conference on Causality in Crisis.

  • deFinetti, B. (1959),La probabilità, la statistica, nei rapporti con l'induzione, secondo diversi punti di vista. Rome, Centro Internazionale Matematica Estivo Cremonese. English translation in de Finetti (1972).

    Google Scholar 

  • deFinetti, B. (1972),Probability, Induction, and Statistics. New York, Wiley.

    Google Scholar 

  • Diaconis, P. and Freedman, D. (1980a), de Finetti's Generalizations of Exchangeability, pp.233–50 in Richard C.Jeffrey (ed),Studies in Inductive Logic and Probability. Vol. 2. Berkeley, University of California Press.

    Google Scholar 

  • Diaconis, P. and Freedman, D. (1980b), Finite Exchangeable Sequences,Annals of Probability 8, 745–64.

    Article  Google Scholar 

  • Diaconis, P. and Freedman, D. (1981), Partial Exchangeability and Sufficiency, pp.205–36 inProceedings of the Indian Statistical Institute Golden Jubilee International Conference on Statistics: Applications and New Directions. Sankhya. Calcutta, Indian Statistical Institute.

    Google Scholar 

  • Diaconis, P. and Freedman, D. (1986), On the Consistency of Bayes' Estimates,Annals of Statistics 14, 1–87, with discussion.

    Article  Google Scholar 

  • Diaconis, P. and Freedman, D. (1988), Conditional Limit Theorems for Exponential Families and Finite Versions of de Finetti's Theorem,Journal of Theoretical Probability 1, 381–410.

    Article  Google Scholar 

  • Diaconis, P. and Freedman, D. (1990), Cauchy's Equation and de Finetti's Theorem,Scandinavian Journal of Statistics 17, 235–50.

    Google Scholar 

  • Efron, B. (1986), Why Isn't Everyone a Bayesian?The American Statistician 40, 1–11, with discussion.

    Google Scholar 

  • Ehrenberg, A. S. C. and Bound, J. A. (1993), Predictability and Prediction,Journal of the Royal Statistical Society,Series A, Part 2,156, 167–206.

    Article  Google Scholar 

  • Ferguson, T. (1967),Mathematical Statistics: a Decision Theoretic Approach. New York, Academic Press.

    Google Scholar 

  • Fisher, F. M. (1980), Multiple Regression in Legal Proceedings,Columbia Law Review 80, 702–36.

    Article  Google Scholar 

  • Fisher, R. A. (1959),Smoking: The Cancer Controversy. Edinburgh, Oliver & Boyd. see pp.25–29 on relevant subsets.

    Google Scholar 

  • Freedman, D. (1983), A Note on Screening Regression Equations,The American Statistician 37, 152–55.

    Google Scholar 

  • Freedman, D. (1985), Statistics and the Scientific Method, pp.343–90 in W. M.Mason and S. E.Fienberg (eds),Cohort Analysis in Social Research: Beyond the Identification Problem. New York, Springer.

    Chapter  Google Scholar 

  • Freedman, D. (1987), As Others See Us: A Case Study in Path Analysis,Journal of Educational Statistics 12, no. 2, 101–223, with discussion.

    Google Scholar 

  • Freedman, D. (1991), Statistical Models and Shoe Leather, chapter 10 in Peter Marsden (ed),Sociological Methodology 1991, with discussion.

  • Freedman, D. (1994), From Association to Causation Via Regression. Technical report no. 408, Statistics Department, University of California, Berkeley. To appear in V. McKim and S. Turner (eds),Proceedings of the Notre Dame Conference on Causality in Crisis.

    Google Scholar 

  • Freedman, D. and Purves, R. (1969), Bayes Method for Bookies,Annals of Mathematical Statistics 40, 1177–86.

    Article  Google Scholar 

  • Freedman, D., Pisani, R., Purves, R. and Adhikari, A. (1991),Statistics, 2nd ed. New York, Norton.

    Google Scholar 

  • Gatsonis, C. et al., eds. (1993),Case Studies in Bayesian Statistics. New York, Springer-Verlag, Lecture Notes in Statistics, vol. 83.

    Google Scholar 

  • Gauss, C. F. (1809),Theoria Motus Corporum Coelestium, Hamburg, Perthes et Besser. Reprinted in 1963 by Dover, New York.

    Google Scholar 

  • Jeffrey, R. C. (1983),The Logic of Decision. 2nd ed. University of Chicago Press.

  • Kahneman, D., Slovic, P. and Tversky, A., eds. (1982),Judgment under Uncertainty: Heuristics and Biases. Cambridge University Press.

  • Kaye, D. and Freedman, D. (1994),Reference Manual on Statistics. Washington, D.C., Federal Judicial Center.

    Google Scholar 

  • Klein, S. and Freedman, D. (1993), Ecological Regression in Voting Rights Cases,Chance Magazine 6, 38–43.

    Google Scholar 

  • Kolmogorov, A. N. (1933), Grundbegriffe der Wahrscheinlichkeitstheorie,Ergebnisse Mathematische 2 no. 3.

    Google Scholar 

  • Kreps, D. (1988),Notes on the Theory of Choice. Boulder, Westview Press.

    Google Scholar 

  • Laplace, P. S. (1774), Memoire sur la probabilité des causes par les évenements,Memoires de mathématique et de physique presentés a l'académie royale des sciences, par divers savants, et lûs dans ses assemblées 6. Reprinted in Laplace'sOeuvres Complètes 8, 27–65. English translation by S. Stigler (1986),Statistical Science 1, 359–378.

  • LeCam, Lucien M. (1977), A Note on Metastatistics or “An Essay Toward Stating a Problem in the Doctrine of Chances”,Synthese 36, 133–60.

    Article  Google Scholar 

  • LeCam, Lucien M. (1986),Asymptotic Methods in Statistical Decision Theory. New York, Springer-Verlag.

    Book  Google Scholar 

  • LeCam, Lucien M. and Yang, Grace Lo (1990),Asymptotics in Statistics: Some Basic Concepts, New York, Springer-Verlag.

    Book  Google Scholar 

  • Lehmann, E. (1986),Testing Statistical Hypotheses. 2nd ed. Pacific Grove, Calif., Wadsworth & Brooks/Cole.

    Book  Google Scholar 

  • Lehmann, E. (1983),Theory of Point Estimation. Pacific Grove, Calif., Wadsworth & Brooks/Cole.

    Book  Google Scholar 

  • McNeil, B., Pauker, S., Sox, H.Jr., and Tversky, A. (1982), On the Elicitation of Preferences for Alternative Therapies,New England Journal of Medicine 306, 1259–62.

    Article  Google Scholar 

  • Oakes, M. (1990),Statistical Inference. Chestnut Hill, Mass., Epidemiology Rescurces, Inc.

    Google Scholar 

  • O'Hagan, A. (1988),Probability: Methods and Measurement. London, Chapman and Hall.

    Book  Google Scholar 

  • Peirce, C. S. (1878), The Doctrine of Chances,Popular Science Monthly 12 (March 1878), pp. 604–615. Reprinted as pp.142–54 in N. Houser and C. Kloesel (eds) (1992),The Essential Peirce. Indiana University Press.

    Google Scholar 

  • Popper, K. (1983),Realism and the Aim of Science. Totowa, N.J., Rowman and Littlefield.

    Google Scholar 

  • Prakasa Rao, B. L. S. (1987),Asymptotic Theory of Statistical Inference. New York, Wiley.

    Google Scholar 

  • Ramsey, F. P. (1926), in R. B. Braithwaite (1931),The Foundations of Mathematics and other Logical Essays. London, Routledge and Kegan Paul.

    Google Scholar 

  • Rao, C. R. (1973),Linear Statistical Inference and Its Applications. 2nd ed. New York, Wiley.

    Book  Google Scholar 

  • Savage, Leonard J. (1972),The Foundations of Statistics. 2d rev. ed. New York, Dover Publications.

    Google Scholar 

  • Stigler, S. (1986),The History of Statistics. Harvard University Press.

  • Tversky, A. and Kahneman, D. (1986), Rational Choice and the Framing of Decisions,Journal of Business 59, no. 4, part 2, pp.S251–78.

    Article  Google Scholar 

  • Tversky, A. and Kahneman, D. (1983), Extensional versus Intuitive Reasoning: The Conjunction Fallacy in Probability Judgment,Psychological Review 90, 293–315.

    Article  Google Scholar 

  • vonMises, R. (1964),Mathematical Theory of Probability and Statistics. H.Geiringer (ed). New York, Academic Press.

    Google Scholar 

  • von Neumann, J. and Morgenstern, O. (1944),Theory of Games and Economic Behavior. Princeton University Press.

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Freedman, D. Some issues in the foundation of statistics. Found Sci 1, 19–39 (1995). https://doi.org/10.1007/BF00208723

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00208723

Key words

Navigation