Mind and Society 4 (1):3-12 (2005)

We offer a case-study in irrationality, showing that even in a high stakes context, intelligent and well trained professionals may adopt dominated practices. In multiple-choice tests one cannot distinguish lucky guesses from answers based on knowledge. Test-makers have dealt with this problem by lowering the incentive to guess, through penalizing errors (called formula scoring), and by eliminating various cues for outperforming random guessing (e.g., a preponderance of correct answers in middle positions), through key balancing. These policies, though widespread and intuitively appealing, are in fact ‘‘irrational’’, and are dominated by alternative solutions. Number-right scoring is superior to formula scoring, and key randomization is superior to key balancing. We suggest that these policies have persisted since all stake-holders – test-makers, test-takers and test-coaches – share the same faulty intuitions
Keywords Formula scoring  Guessing  Key balancing  Multiple-choice tests  Randomization  Rationality  Testwiseness
Categories (categorize this paper)
DOI 10.1007/s11299-005-0001-z
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

PhilArchive copy

Upload a copy of this paper     Check publisher's policy     Papers currently archived: 63,194
External links

Setup an account with your affiliations in order to access resources via your University's proxy server
Configure custom proxy (use this if your affiliation does not provide a proxy)
Through your library

References found in this work BETA

No references found.

Add more references

Citations of this work BETA

No citations found.

Add more citations

Similar books and articles


Added to PP index

Total views
31 ( #350,843 of 2,448,310 )

Recent downloads (6 months)
1 ( #450,727 of 2,448,310 )

How can I increase my downloads?


My notes