This article reviews current methods for evaluating models in the cognitive sciences, including theoretically based approaches, such as Bayes factors and minimum description length measures; simulation approaches, including model mimicry evaluations; and practical approaches, such as validation and generalization measures. This article argues that, although often useful in specific settings, most of these approaches are limited in their ability to give a general assessment of models. This article argues that hierarchical methods, generally, and hierarchical Bayesian methods, specifically, can provide a (...) more thorough evaluation of models in the cognitive sciences. This article presents two worked examples of hierarchical Bayesian analyses to demonstrate how the approach addresses key questions of descriptive adequacy, parameter interference, prediction, and generalization in principled and coherent ways. (shrink)

We apply the “wisdom of the crowd” idea to human category learning, using a simple approach that combines people's categorization decisions by taking the majority decision. We first show that the aggregated crowd category learning behavior found by this method performs well, learning categories more quickly than most or all individuals for 28 previously collected datasets. We then extend the approach so that it does not require people to categorize every stimulus. We do this using a model‐based method that predicts (...) the categorization behavior people would produce for new stimuli, based on their behavior with observed stimuli, and uses the majority of these predicted decisions. We demonstrate and evaluate the model‐based approach in two case studies. In the first, we use the general recognition theory decision‐bound model of categorization (Ashby & Townsend, ) to infer each person's decision boundary for two categories of perceptual stimuli, and we use these inferences to make aggregated predictions about new stimuli. In the second, we use the generalized context model exemplar model of categorization (Nosofsky, ) to infer each person's selective attention for face stimuli, and we use these inferences to make aggregated predictions about withheld stimuli. In both case studies, we show that our method successfully predicts the category of unobserved stimuli, and we emphasize that the aggregated crowd decisions arise from psychologically interpretable processes and parameters. We conclude by discussing extensions and potential real‐world applications of the approach. (shrink)

Diffusion models are widely-used and successful accounts of the time course of two-choice decision making. Most diffusion models assume constant boundaries, which are the threshold levels of evidence that must be sampled from a stimulus to reach a decision. We summarize theoretical results from statistics that relate distributions of decisions and response times to diffusion models with time-varying boundaries. We then develop a computational method for finding time-varying boundaries from empirical data, and apply our new method to two problems. The (...) first problem involves finding the time-varying boundaries that make diffusion models equivalent to the alternative sequential sampling class of accumulator models. The second problem involves finding the time-varying boundaries, at the individual level, that best fit empirical data for perceptual stimuli that provide equal evidence for both decision alternatives. We discuss the theoretical and modeling implications of using time-varying boundaries in diffusion models, as well as the limitations and potential of our approach to their inference. (shrink)

We consider human performance on an optimal stopping problem where people are presented with a list of numbers independently chosen from a uniform distribution. People are told how many numbers are in the list, and how they were chosen. People are then shown the numbers one at a time, and are instructed to choose the maximum, subject to the constraint that they must choose a number at the time it is presented, and any choice below the maximum is incorrect. We (...) present empirical evidence that suggests people use threshold-based models to make decisions, choosing the first currently maximal number that exceeds a fixed threshold for that position in the list. We then develop a hierarchical generative account of this model family, and use Bayesian methods to learn about the parameters of the generative process, making inferences about the threshold decision models people use. We discuss the interesting aspects of human performance on the task, including the lack of learning, and the presence of large individual differences, and consider the possibility of extending the modeling framework to account for individual differences. We also use the modeling results to discuss the merits of hierarchical, generative and Bayesian models of cognitive processes more generally. (shrink)

This article demonstrates the potential of using hierarchical Bayesian methods to relate models and data in the cognitive sciences. This is done using a worked example that considers an existing model of category representation, the Varying Abstraction Model (VAM), which attempts to infer the representations people use from their behavior in category learning tasks. The VAM allows for a wide variety of category representations to be inferred, but this article shows how a hierarchical Bayesian analysis can provide a unifying explanation (...) of the representational possibilities using 2 parameters. One parameter controls the emphasis on abstraction in category representations, and the other controls the emphasis on similarity. Using 30 previously published data sets, this work shows how inferences about these parameters, and about the category representations they generate, can be used to evaluate data in terms of the ongoing exemplar versus prototype and similarity versus rules debates in the literature. Using this concrete example, this article emphasizes the advantages of hierarchical Bayesian models in converting model selection problems to parameter estimation problems, and providing one way of specifying theoretically based priors for competing models. (shrink)

We apply a cognitive modeling approach to the problem of measuring expertise on rank ordering problems. In these problems, people must order a set of items in terms of a given criterion (e.g., ordering American holidays through the calendar year). Using a cognitive model of behavior on this problem that allows for individual differences in knowledge, we are able to infer people's expertise directly from the rankings they provide. We show that our model-based measure of expertise outperforms self-report measures, taken (...) both before and after completing the ordering of items, in terms of correlation with the actual accuracy of the answers. These results apply to six general knowledge tasks, like ordering American holidays, and two prediction tasks, involving sporting and television competitions. Based on these results, we discuss the potential and limitations of using cognitive models in assessing expertise. (shrink)

While Tenenbaum and Griffiths impressively consolidate and extend Shepard's research in the areas of stimulus representation and generalization, there is a need for complexity measures to be developed to control the flexibility of their “hypothesis space” approach to representation. It may also be possible to extend their concept learning model to consider the fundamental issue of representational adaptation. [Tenenbaum & Griffiths].

Jones & Love (J&L) should have given more attention to Agnostic uses of Bayesian methods for the statistical analysis of models and data. Reliance on the frequentist analysis of Bayesian models has retarded their development and prevented their full evaluation. The Ecumenical integration of Bayesian statistics to analyze Bayesian models offers a better way to test their inferential and predictive capabilities.

Glenberg's account falls short in several respects. Besides requiring clearer explication of basic concepts, his account fails to recognize the autonomous nature of perception. His account of what is remembered, and its description, is too static. His strictures against connectionist modeling might be overcome by combining the notions of psychological space and principled learning in an embodied and situated network.

Two experiments investigated whether infants represent goal‐directed actions of others in a way that allows them to draw inferences to unobserved states of affairs (such as unseen goal states or occluded obstacles). We measured looking times to assess violation of infants' expectations upon perceiving either a change in the actions of computer‐animated figures or in the context of such actions. The first experiment tested whether infants would attribute a goal to an action that they had not seen completed. The second (...) experiment tested whether infants would infer from an observed action the presence of an occluded object that functions as an obstacle. The looking time patterns of 12‐month‐olds indicated that they were able to make both types of inferences, while 9‐month‐olds failed in both tasks. These results demonstrate that, by the end of the first year of life, infants use the principle of rational action not only for the interpretation and prediction of goal‐directed actions, but also for making productive inferences about unseen aspects of their context. We discuss the underlying mechanisms that may be involved in the developmental change from 9 to 12 months of age in the ability to infer hypothetical (unseen) states of affairs in teleological action representations. (shrink)

Inductive generalization, where people go beyond the data provided, is a basic cognitive capability, and it underpins theoretical accounts of learning, categorization, and decision making. To complete the inductive leap needed for generalization, people must make a key ‘‘sampling’’ assumption about how the available data were generated. Previous models have considered two extreme possibilities, known as strong and weak sampling. In strong sampling, data are assumed to have been deliberately generated as positive examples of a concept, whereas in weak sampling, (...) data are assumed to have been generated without any restrictions. We develop a more general account of sampling that allows for an intermediate mixture of these two extremes, and we test its usefulness. In two experiments, we show that most people complete simple one-dimensional generalization tasks in a way that is consistent with their believing in some mixture of strong and weak sampling, but that there are large individual differences in the relative emphasis different people give to each type of sampling. We also show experimentally that the relative emphasis of the mixture is influenced by the structure of the available information. We discuss the psychological meaning of mixing strong and weak sampling, and possible extensions of our modeling approach to richer problems of inductive generalization. (shrink)

The “wisdom of the crowd” phenomenon refers to the finding that the aggregate of a set of proposed solutions from a group of individuals performs better than the majority of individual solutions. Most often, wisdom of the crowd effects have been investigated for problems that require single numerical estimates. We investigate whether the effect can also be observed for problems where the answer requires the coordination of multiple pieces of information. We focus on combinatorial problems such as the planar Euclidean (...) traveling salesperson problem, minimum spanning tree problem, and a spanning tree memory task. We develop aggregation methods that combine common solution fragments into a global solution and demonstrate that these aggregate solutions outperform the majority of individual solutions. These case studies suggest that the wisdom of the crowd phenomenon might be broadly applicable to problem-solving and decision-making situations that go beyond the estimation of single numbers. (shrink)

As scientific and engineering efforts become increasingly global in nature, the need to understand differences in perceptions of research ethics issues across countries and cultures is imperative. However, investigations into the connection between nationality and ethical decision-making in the sciences have largely generated mixed results. In Study 1 of this paper, a measure of biases and compensatory strategies that could influence ethical decisions was administered. Results from this study indicated that graduate students from the United States and international graduate students (...) studying in the US are prone to different biases. Based on these findings, recommendations are made for developing ethics education interventions to target these decision-making biases. In Study 2, we employed an ethics training intervention based on ethical sensemaking and used a well-established measure of ethical decision-making that more fully captures the content of ethical judgment. Similar to Study 1, the results obtained in this study suggest differences do exist between graduate students from the US and international graduate students in ethical decision-making prior to taking the research ethics training. However, similar effects were observed for both groups following the completion of the ethics training intervention. (shrink)

We study the wisdom of the crowd in three sequential decision‐making tasks: the Balloon Analogue Risk Task (BART), optimal stopping problems, and bandit problems. We consider a behavior‐based approach, using majority decisions to determine crowd behavior and show that this approach performs poorly in the BART and bandit tasks. The key problem is that the crowd becomes progressively more extreme as the decision sequence progresses, because the diversity of opinion that underlies the wisdom of the crowd is lost. We also (...) consider model‐based approaches to each task. This involves inferring cognitive models for each individual based on their observed behavior, and using these models to predict what each individual would do in any possible task situation. We show that this approach performs robustly well for all three tasks and has the additional advantage of being able to generalize to new problems for which there are no behavioral data. We discuss potential applications of the model‐based approach to real‐world sequential decision problems and discuss how our approach contributes to the understanding of collective intelligence. (shrink)

In most decision-making situations, there is a plethora of information potentially available to people. Deciding what information to gather and what to ignore is no small feat. How do decision makers determine in what sequence to collect information and when to stop? In two experiments, we administered a version of the German cities task developed by Gigerenzer and Goldstein (1996), in which participants had to decide which of two cities had the larger population. Decision makers were not provided with the (...) names of the cities, but they were able to collect different kinds of cues for both response alternatives (e.g., “Does this city have a university?”) before making a decision. Our experiments differed in whether participants were free to determine the number of cues they examined. We demonstrate that a novel model, using hierarchical latent mixtures and Bayesian inference (Lee & Newell, 2011) provides a more complete description of the data from both experiments than simple conventional strategies, such as the take–the–best or the Weighted Additive heuristics. (shrink)

As scientific and engineering efforts become increasingly global in nature, the need to understand differences in perceptions of research ethics issues across countries and cultures is imperative. However, investigations into the connection between nationality and ethical decision-making in the sciences have largely generated mixed results. In Study 1 of this paper, a measure of biases and compensatory strategies that could influence ethical decisions was administered. Results from this study indicated that graduate students from the United States and international graduate students (...) studying in the US are prone to different biases. Based on these findings, recommendations are made for developing ethics education interventions to target these decision-making biases. In Study 2, we employed an ethics training intervention based on ethical sensemaking and used a well-established measure of ethical decision-making that more fully captures the content of ethical judgment. Similar to Study 1, the results obtained in this study suggest differences do exist between graduate students from the US and international graduate students in ethical decision-making prior to taking the research ethics training. However, similar effects were observed for both groups following the completion of the ethics training intervention. (shrink)

This paper explores the significant – albeit little-known – impact that physicist Albert Einstein's theory of relativity had on the development of the science of linguistics. Both Max Talmey, a physician who played a key role in the development of early twentieth-century constructed-language movements, and Benjamin Lee Whorf, who is closely associated with the notion of ‘linguistic relativity’, drew on their understanding of relativity to develop their ideas (and, in Talmey's case, also on his personal relationship with Einstein). Linguistic relativity, (...) which posits that humans’ linguistic categories shape their perceptions of nature, has often been tied to ‘relativism’ in the social sciences and humanities. In contrast, Talmey's commitment to reformulating the language of Einsteinian relativity – especially through a constructed language he built in the 1920s and 1930s – emphasized the significance of ‘invariance’ simultaneously in the scientific doctrine and in the language in which it was discussed. The semiotic flexibility of Einstein's ‘relativity theory’ as it was widely (and wildly) appropriated outside the small community of theoretical physicists enabled the two opposing moves, while obscuring the historical linkage between physics and linguistics for both. (shrink)

In lieu of an abstract, here is a brief excerpt of the content:February 19, 2011 (11:48 am) E:\CPBR\RUSSJOUR\TYPE3002\russell 30,2 040 red.wpd Reviews 179 THE EARLY “IRON CURTAIN” Michael D. Stevenson Schulich School of Business, York U. / Russell Research Centre, McMaster U. Toronto, on m3j 1p3 / Hamilton, on l8s 4l6, Canada [email protected] Patrick Wright. Iron Curtain: from Stage to Cold War. Oxford: Oxford U. P., 2007. Pp. xvii, 488. isbn 978-0-19-923150-8. £18.99 (hb); £12.99 (pb). In his famous Westminster (...) College address on 5 March 1946 in Fulton, Missouri, Winston Churchill Wred one of the opening salvos of the Cold War by proclaiming that from “Stettin in the Baltic to Trieste in the Adriatic an iron curtain” had been lowered across Europe. Patrick Wright’s intriguing and provocative book does not examine the phrase “iron curtain” in its popular Cold War context. Instead, he maintains that many characteristics of this metaphor, “including the pronounced sense of theatricality it would bring to international politics, were inherited from the period before the Second World War” (p. 18). Wright divides Iron Curtain into two primary chronological sections, the Wrst covering the period from 1914 to 1920. An iron curtain originally referred to the steel safety screen that descended in English theatres, beginning in the lateeighteenth century, to separate the audience from the often catastrophic Wres that broke out on the stage. The phrase entered the lexicon of international relations in January 1915 when British author and paciWst Violet Page (writing under the pseudonym Vernon Lee) published an article lamenting that “War’s cruelties and recriminations, War’s monstrous iron curtain” (p. 80) had alienated European nations such as England and Germany sharing a common cultural heritage. But the barrier quickly moved east in the aftermath of the 1917 Russian Revolution and “took the form not just of exaggerated political rhetoric, but of an economic blockade enforced by naval power” (p. 171), as the Allies sought to contain the infection of Bolshevism. Wright devotes most attention in this section to documenting the 1920 visit to Russia by the British delegation jointly sponsored by the Trades Union Congress and the Labour Party, which sought to penetrate the dense fog of Allied anti-Bolshevik propaganda and validate the delegation members’ own preconceived views about the nascent socialist utopia in Russia. British delegates witnessed images both of progress carefully stagemanaged by their hosts and of terrible economic dislocation and poverty caused by the Allied blockade and the civil war, which allowed the majority of them to return home to lavish praise on the Soviet experiment that would, in their minds, inevitably fulWl its potential once the Bolshevik government became stable. February 19, 2011 (11:48 am) E:\CPBR\RUSSJOUR\TYPE3002\russell 30,2 040 red.wpd 180 Reviews 1 “The Future of Europe”, European AVairsz 1, no. 1 (April 1949): 3. The second section of Wright’s book examines Western reports of life behind the iron curtain between 1920 and 1939. Here, the author focuses heavily on the theatrical nature of Soviet attempts to create modern-day Potemkin villages that werez—zwith a limited number of exceptionsz—zaccepted as reality by an endless parade of left-wing visitors. A second British Trades Union Congress delegation in 1924, for example, received a dramatically embellished picture of Soviet economic progress that included a train journey past a long-abandoned factory belching smoke created by burning wet straw frantically provided by Russian peasants; the resulting report of the delegation “repeatedly collapsed into the most abject conformity with the Soviet view of reality” (p. 245). The most tragic examples of Western visitors’ blindness to the truth occurred during the 1930s famine deliberately induced by Stalin, and Wright exposes a wide cast of characters who adopted a blinkered view of conditions in the ussr. Among intellectuals, Wright documents the 1931 visit of George Bernard Shaw, who cavalierly dismissed reports of widespread food shortages while dining sumptuously in Moscow’s Hotel Metropole. Among journalists, Wright develops the case of Walter Duranty, the New York Timesz correspondent who knuckled under to demands of Soviet censors to produce sanitized accounts denying or ignoring the famine in order to protect his privileged place in that... (shrink)

Comparative Political Theory and Cross-Cultural Philosophy explores new forms of philosophizing in the age of globalization by challenging the conventional border between the East and the West, as well as the traditional boundaries among different academic disciplines. This rich investigation demonstrates the importance of cross-cultural thinking in our reading of philosophical texts and explores how cross-cultural thinking transforms our understanding of the traditional philosophical paradigm.

* This paper was originally given as one of the Doris Lee Lectures on February 20th 1975, at the University of London Institute of Education.

Biologists study life in its various physical forms, while philosophers of biology seek answers to questions about the nature, purpose, and impact of this research. What permits us to distinguish between living and nonliving things even though both are made of the same minerals? Is the complex structure of organisms proof that a creative force is working its will in the physical universe, or are existing life-forms the random result of an evolutionary process working itself out over eons of time? (...) What moral and social questions arise regarding modern advances in biotechnology? What is more relevant to human nature: genetics or sociocultural influences? Is Darwinism the death-knell of God? These are just some of the vital questions addressed by a distinguished group of philosophers and scientists which includes: Aristotle, Francisco J. Ayala, , Michael Benton, Tom Bethell, Joe Cain, David Castle, Charles Darwin, Richard Dawkins, Michael Denton, A.G.N. Flew, Stephen Jay Gould, J.B.S. Haldane, John F. Haught, D. W. E. Hone, James W. Kirchner, James Lovelock, Jane Maienschein, Ernst Mayr, Gregory M. Mikkelson, Leslie Orgal, William Paley, the Prince of Wales, Christopher Pynes, Richard A. Richards, Mark Ridley, Holmes Rolston III, Michael Ruse, Lee Silver, Elliott Sober, Kim Sterelny, Derek Turner, and Edward O. Wilson. This second edition contains material on design without selection, testing macroevolutionary claims, recent biotechnological issues, key ecological concerns, the Gaia hypothesis, genetically modified foods, and the so-called intelligent design movement. (shrink)

Previous ed. by : Lord Lloyd of Hampstead and M.D.A. Freeman.

Brown famously held that in the field of public education, segregation has no place. But segregation was undefined. Was segregation constituted by mere racial classification, by the fact that the state had divided children into racial groups? Or did Brown condemn a caste system whose effect was to stigmatize black children. In Parents Involved v. Seattle Justice Roberts says segregation is about children not black children. This colorblind approach represents both a rewriting and appropriation of Brown in the service of (...) formalism. The Roberts court writes not only a new version of Brown but a new historical narrative about the meaning of segregation. The theme of this new story is formal equality - equality of opportunity only - as a universal ideal. This new story is woven entirely out of the language of Brown detached from all historical context. Conservatives have long canonized Brown. It has been a kind of second constitution for the second reconstruction. But how does this new story compare to the original understanding ?: Was this the evil that Brown denounced? By framing the issue in this way the paper seeks to make an end run around an impasse in our social and legal debate. Many progressive scholars have challenged the conservative conception of formal equality by suggesting alternative ways of thinking about it: anti-subordination models, a heightened call that equality should take issues of racial caste into account. But this external critique has stalled, perhaps in part because of the slippery indeterminacy of normative ideals. Segregation is far more determinate; it is something that has been concretized not only by the lived experience of black people, but by an earlier realist tradition on the part of the Warren court which saw it as it was. Retelling the two parts of this forgotten history we expose the disconnect between the Supreme Court's universalism and the actual meaning of segregation in context. Also, by focusing on the original understanding we seek a kind of internal critique showing how the politics of historical revision does not withstand the conservatives own interpretive approach. (shrink)

The HRAF databases, eHRAF World Cultures and eHRAF Archaeology, each containing large corpora of curated text subject-indexed at the paragraph-level by anthropologists, were designed to facilitate rapid retrieval of information. The texts describe social and cultural life in past and present societies around the world. As of the spring of 2018, eHRAF contains almost three million indexed “paragraph” units from over 8000 documents describing over 400 societies and archaeological traditions. This chapter first discusses concrete problems of scale resulting from large (...) numbers of complex elements retrieved by any given search. Second, we discuss potential and partial solutions that resolve these problems to advance research, whether based on specific hypotheses, classification or identifying and evaluating embedded patterns of relationships. Third, we discuss new kinds of research possibilities that can be further advanced, have not yet been successfully attempted, or have not even been considered using anthropological data because of scale and complexity of achieving a result. (shrink)

In this chapter I offer a critique of the received way of thinking about responsibility for collective inaction and propose an alternative approach that takes as its point of departure the epistemic agency exhibited by people navigating impossible situations together. One such situation is becoming increasingly common in the context of climate change: so-called “natural” disasters wreaking havoc on communities—flooding homes, collapsing infrastructures, and straining the capacities of existing organizations to safeguard lives and livelihoods. What happens when philosophical reflection begins (...) here—in places where the institutions and practices that have emerged over the last century seem incapable of addressing the problems communities face now, and where people find themselves turning to one another for the sake of their own survival? (shrink)

The essence of Dussel's thought is presented through the concept of "ethical hermeneutics" which seeks to interpret reality from the viewpoint of what Emmanuel Levinas presents as the "other" - those who are vanquished, forgotten, or excluded from existent socio-political or cultural systems. Barber traces Dussel's development toward Levinas' philosophy through his discussion of the Hegelian dialectic and through the stages of Dussel's own ethical theory.

John McDowell rejects the idea that non-conceptual content can rationally justify empirical claims—a task for which it is ill-fitted by its non-conceptual nature. This paper considers three possible objections to his views: he cannot distinguish empty conception from the perceptual experience of an object; perceptual discrimination outstrips the capacity of concepts to keep pace; and experience of the empirical world is more extensive than the conceptual focusing within it. While endorsing McDowell’s rejection of what he means by non-conceptual content, and (...) appreciating his insight into the experiential synthesis of intuition and conception (in particular, its role in grasping objects), I will argue that Edmund Husserl presents an even more comprehensive account of perceptual experience that explains how we experience the contribution of receptivity and sensibility and how they cooperate in perceptual discrimination. Further, it reveals “horizons”—a unique kind of contents, surplus content (rather than independent non-conceptual content)—beyond the synthesis of intuitive and conceptual contents through which objects are grasped. Such horizons play a constitutive role, making experience with its conceptual dimensions and justificatory potential possible; they in no way function like a bare given that is to fulfill some independent justificatory role. Whereas McDowell focuses on how experience does not take place in isolation from the exercise of conceptual capacities, Husserl complements his view by situating experience in a more encompassing whole and by elucidating the surplus-horizons that exceed the conceptual content of experience; play an inseparable, constitutive role within it; and indicate the limits of conceptual comprehension. (shrink)