Abstract
It is sometimes argued that experimental economists do not have to worry about external validity so long as the design sticks closely to a theoretical model. This position mistakes the model for the theory. As a result, applied economics designs often study phenomena distinct from their stated objects of inquiry. Because the implemented models are abstract, they may provide improbable analogues to their stated subject matter. This problem is exacerbated by the relational character of the social world, which also sets epistemic limits for the social science laboratory more generally.
Similar content being viewed by others
Notes
Games in this sense can be informally defined as situations in which two or more individuals interact knowingly with each other. See Hargreaves Heap et al. (1992, Chap. 7) for an introduction. Applied economics is the use of general economic principles and theories, such as decision- and game- theory to study specific settings and situations.
The other formulations sometimes refer to more inductively-oriented designs; I do not treat these separately as I doubt that there is a clear distinction in practice between theory testing and inductive exercises.
Bardsley et al. (2010, Chap. 5) argue that the relationship between theory and (formal) model can be clarified if we represent the theory as the claim MCx, where M denotes the formal model propositions, x is the economic domain of interest and C specifies the kind of relationship alleged to obtain between the two, which could be, for example, either realist or instrumentalist in character.
It is not my intention to deny the importance of experimental control, nor of the importance of theory to experimentation, as urged for example by Deaton (2009). But neither control nor attention to theory should not be equated with implementing models. This follows straightforwardly from the distinction drawn in Sect. 2 between theories and models.
At least, not without the involvement of the judicial system. If the exercise did satisfy the criteria for being a real trial it would no longer be purely experimental, as participants could be convicted and fined or imprisoned.
An RCT is a design in which the experimental control is achieved by random allocation to treatment. The rationale of RCTs is that in a large enough sample, randomisation guarantees control on all characteristics, whether observed or not. Laboratory economics experiments tend to use smaller samples than medicinal trials where the RCT method originates from, but nonetheless tend to follow the protocol of random allocation to treatment. It is worth noting that medical experts often recommend minimisation as an alternative to randomisation when sample sizes are small, that is, minimising the differences on observed sample characteristics between treatments (Treasure and MacRae 1998). This procedure may merit adoption in behavioural experiments.
Public goods in the economics literature are ones which are non-rival (more for you does not mean less for me) and non-excludable (you cannot be stopped from consuming even if you do not pay). They give rise to collective action problems. There is an enormous experimental economics literature on public goods; for an entrée see Croson (2008).
References
Allingham MG, Sandmo A (1972) Income tax evasion: a theoretical analysis. J Public Econ 1:323–338
Bardsley N (2005) Experimental economics and the artificiality of alteration. J Econ Methodol 12:239–253
Bardsley N (2008) Dictator game giving: altruism or artefact? Exp Econ 11:122–133
Bardsley N, Cubitt R, Loomes G, Moffatt P, Starmer C, Sugden R (2010) Experimental economics: rethinking the rules. Princeton University Press, Princeton
Bicchieri C (2004) Cooperation and communication: group identity or social norms? In: Gold N (ed) Teamwork: multidisciplinary perspectives. Palgrave, MacMillan, Basingstoke
Croson RTA (2008) Public goods experiments. In: Durlauf SN, Blume LE (eds) The new palgrave dictionary of economics, vol 2. Palgrave, Macmillan, Basingstoke
Cubitt RP (2005) Experiments and the domain of economic theory. J Econ Methodol 12:197–210
Deaton A (2009) Instruments of development: randomization in the tropics and the search for the elusive keys to development. In: Proceedings of the British Academy 2008 Lectures, 162, pp 123–160
Dolbear FT, Lave LB, Bowman G, Lieberman A, Prescott E, Reuter F, Sherman R (1968) Collusion in oligopoly: an experiment on the effect of numbers and information. Quart J Econ 82:240–259
Feld LP, Frey BS (2002) Trust breeds trust, how taxpayers are treated. Econ Governance 3:87–99
Friedman JW (1963) Individual behavior in oligopolistic markets. Yale Econ Essays 3:359–417
Greenwood JG (1982) On the Relation between laboratory experiments and social behaviour: causal explanation and generalisation. J Theory Soc Behav 12:225–249
Guala F (2002) On the scope of experiments in economics: comments on siakantaris. Cambridge J Econ 26:261–267
Guala F (2005) The methodology of experimental economics. Cambridge University Press, Cambridge
Güth W, Mackscheidt K (1985). Die Erforschung der Steuermoral. Universität zu Köln, working paper
Hargreaves Heap S, Hollis M, Lyons B, Sugden R, Weale A (1992) The theory of choice, a critical guide. Basil Blackwell, Oxford
Harré R, Secord P (1972) The explanation of social behaviour. Basil Blackwell, Oxford
Holt CA (1985) An experimental test of the consistent conjectures hypothesis. Am Econ Rev 75:314–325
Holt CA (1995) Industrial organiszation: a survey of experimental research. In: Kagel J, Roth A (eds) The handbook of experimental economics. Princeton University Press, Princeton
Irlenbusch B, Sutter M (2006) An experimental analysis of voting in the stability and growth pact in the european monetary union. Public Choice 129:417–434
Kirchler E (2007) The economic psychology of taxation. Cambridge University Press, Cambridge
Ledyard JO (1995) Public goods: a survey of the experimental research. In: Kagel J, Roth A (eds) The handbook of experimental economics. Princeton University Press, Princeton
Mäki U (2005) Models are experiments, experiments are models. J Econ Methodol 12:303–315
Morgan J, Orzen H, Sefton M (2006) An experimental study of price dispersion. Games Econ Behav 54:134–158
Orne MT (1962) On the social psychology of the psychological experiment: with particular reference to demand characteristics and their implications. Am Psychol 17:776–783
Orne MT (1973) Communication by the total experimental situation. In: Pliner P, Krames L, Alloway T (eds) Affect communication, 2nd edn. Academic Press, London, pp 157–191
Pawson R, Tilley N (1997) Realistic evaluation. Sage, London
Schelling TC (1978) Micromotives and macrobehavior. Norton, New York
Schram A (2005) Artificiality: the tension between internal and external validity in economics experiments. J Econ Methodol 12:225–238
Sherman L (1992) Policing domestic violence. Free Press, New York
Sherman L, Berk R (1984) The minneapolis domestic violence experiment. The police foundation
Smith V (1982) Microeconomic systems as an experimental science. Am Econ Rev 72:923–955
Starmer C (1999) Experiments in economics. Should we trust the dismal scientists in white coats? J Econ Methodol 6:1–30
Sugden R (2000) Credible worlds: the status of theoretical models in economics. J Econ Methodol 7:1–31
Tilley N (2001) Evaluation and evidence-led crime reduction policy and practice. Chap. 3 of Matthews R, Pitts J (eds) Crime, Disorder and Community Safety. London, Routledge
Tirole J (1988) The theory of industrial organization. MIT Press, Cambridge
Torgler B (2002) Speaking to theorists and searching for facts: tax morale and tax compliance in experiments. J Econ Surveys 16:657–658
Treasure T, MacRae D (1998) Minimisation: the platinum standard for trials? Br Med J 317:362–363
Watson AJ, Lovelock JE (1983) Biological homeostasis of the global environment: the parable of daisyworld. Tellus 35B:284–289
Webley P, Morris I, Amstutz F (1985) Tax evasion during a small business simulation. In: Brandstätter H, Kirchler E (eds) Economic Psychology. Trauner, Linz
Zizzo D (2010) Experimenter demand effects in economic experiments. Exp Econ 13:75–98
Acknowledgments
Comments from participants at the 2008 Research Methods Festival at St Catherine’s College, University of Oxford, and from anonymous referees, are gratefully acknowledged.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bardsley, N. Sociality and external validity in experimental economics. Mind Soc 9, 119–138 (2010). https://doi.org/10.1007/s11299-010-0075-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11299-010-0075-0