This paper looks at the question of what it means for a psychological test to have construct validity. I approach this topic by way of an analysis of recent debates about the measurement of implicit social cognition. After showing that there is little theoretical agreement about implicit social cognition, and that the predictive validity of implicit tests appears to be low, I turn to a debate about their construct validity. I show that there are two questions at stake: First, (...) what level of detail and precision does a construct have to possess such that a test can in principle be valid relative to it? And second, what kind of evidence needs to be in place such that a test can be regarded as validated relative to a given construct? I argue that construct validity is not an all-or-nothing affair. It can come in degrees, because both our constructs and our knowledge of the explanatory relation between constructs and data can vary in accuracy and level of detail, and a test can fail to measure all of the features associated with a construct. I conclude by arguing in favor of greater philosophical attention to processes of construct development. (shrink)

This chapter has two main goals: to update philosophers on the state of the art in the scientific psychology of intelligence, and to explain and evaluate challenges to the measurement invariance of intelligence tests. First, we provide a brief history of the scientific psychology of intelligence. Next, we discuss the metaphysics of intelligence in light of scientific studies in psychology and neuroimaging. Finally, we turn to recent skeptical developments related to measurement invariance. These have largely focused on attributability: Where do (...) the mechanisms and dispositions that explain people’s performance on tests of intelligence inhere – in the agent, in the local testing environment, in the culture, or in the interactions among these? After explaining what measurement invariance is in the context of intelligence testing, we explore the phenomenon of stereotype threat as a challenge to measurement invariance, as well as more recent work on overcoming or buffering against stereotype threat. (shrink)

One of the chief branches of Industrial Psychology is Vocational Guidance. This attempts to discover the capacities required for different types of work and to guide young people into occupations for which their endowments fit them. Investigations have been made to determine vocational fitness in a variety of occupations; for instance, in many engineering processes, in printing, in telegraphic and telephonic work, and in clerical occupations. The article which follows gives a practical illustration of some of the methods used in (...) ovcational investigations. (shrink)

In lieu of an abstract, here is a brief excerpt of the content:Diagnostic Criteria, Psychological Tests, and Ratings Scales: Extending the HistoryPeter Zachar, PhD (bio)Le moigne narrates a history of the development of psychiatric ratings scales as hybrids between psychological tests and diagnostic categories. In his telling, psychological tests seek to quantify population-based traits on which every person has a position and which tend to be conceptualized as being stable. Personality traits are often conceptualized as dispositions. Diagnostic (...) categories represent not trait-like properties of populations but episodic states consisting of clusters of symptoms experienced by individuals with disorders. Ratings, scales, he notes, are hybrids between the two. They are used to quantify psychiatric symptom clusters so that change over time can be measured. Le Moigne argues that these distinctions were initially suggested during the development of measures that could assess outcomes in psychopharmacological treatment studies.With respect to depression, Le Moigne writes that in the 1970s and 1980s something akin to depressive personality was reconceptualized as a temperament. A key move, somewhat reflective of Kraepelin’s notion of a depressive temperament, was to view a dysthymic temperament as both a predisposing factor and an attenuated form of depression. Thus, an episodic state commandeered the predisposing–dispositional role that was assigned to stable personality traits.This conceptual shift allowed test-like ratings scales to be seen as useful for quantifying not just stable traits, but salient features of episodic states that are potentially subject to change in response to interventions. To put it another way, in the development of a psychological test, one goal is to have high test-retest reliability (i.e., stability of measurement). With rating scales used to measure change, one wants the scores to not be as stable; ideally the scores on the later assessments will be lower. According to Le Moigne, when dysthymia was subsequently placed on axis I of the Diagnostic and Statistical Manual of Mental Disorders (DSM)-III (as a syndrome) and segregated from personality disorders which were placed on axis II, personality traits were evicted from the conceptualization of depressive disorders.One perennial feature of psychiatry and psychology is that even if an older idea is superseded [End Page 253] in the view of some thinkers, it can still attract adherents. Indeed, interest in understanding a relationship between personality and attenuated states did not fully disappear. For example, based on research in genetics, the schizophrenia spectrum concept included not only schizophrenia, but also milder conditions such that were conceptualized as personality disorders; that is, schizotypal personality disorder and paranoid personality disorder (Kety, Rosenthal, Wender, & Schulsinger, 1971).During the development of the DSM-IV, some people wanted to add depressive personality disorder to the manual (Phillips, Hirschfeld, Shea, & Gunderson, 1995). It seems to have become a territorial dispute between mood disorder specialists and personality disorder specialists The mood disorders specialists challenged the personality disorder specialists to differentiate depressive personality disorder from early onset, chronic dysthymia. They were able to do so by using criteria such as critical, blaming, and derogatory toward self. After the mood disorders work group proposed incorporating some of those criteria into a revised criteria set for dysthymia, the two sets overlapped. The result was the old criteria for dysthymia were printed in DSM-IV and criteria for depressive personality disorder and the revised criteria for dysthymia were both placed in the appendix.In the DSM-5, Axis II was eliminated and personality disorders were placed alongside all the syndromic symptom clusters at the same level. Even so, interest in attenuated presentations as personality-related lingered still. During the development of the DSM-5 there was some thought to using diagnostic spectra as a meta-structure for organizing the manual (Andrews et al., 2009). One idea was to move some personality disorders into a best fitting spectrum, akin to attenuated forms. This did occur with schizotypal personality disorder which is both in the DSM-5 chapter on schizophrenia and in the chapter on personality disorder. In the schizophrenia chapter it is positioned as the earliest emerging disorder on the spectrum. There was also some interest in grouping avoidant personality disorder with the anxiety disorders, but the evidence supporting such a change was not available.These issues may... (shrink)

The administration of psychological tests is highly regulated. Test manuals prescribe the instructions to the test subject, the time the test should take, where it should take place, whether and how the test administrator should answer questions from the test subject, and other aspects of the testing situation. Through the manual, the behaviour of test administrator and test subject is disciplined so that the subject may become measurable. The manuals of four tests are analysed, and the disciplinary mechanisms (...) that operate in the administration of these tests are described. Attention is then given to the question whether the discipline of the test is repressive or productive. It is concluded that test manuals, while being central to the production of a psychological subject, also articulate an excess subjectivity in the measures they prescribe to exclude it from the testing situation. (shrink)

In William Angoff's recent article in Theoretical and Philosophical Psychology, he presented several thought-provoking philosophical issues of concern to measurement-oriented psychologists. The first of these issues, the notion of test and item bias, is the topic of the present paper. In his article, he reports that average score differences in the performance on many cognitive tests have appeared among racial or ethnic groups. Twenty to thirty years ago, differential psychologists, summarizing and critically evaluating studies demonstrating performance differences on tests and (...) in other behavior among cultural, ethnic and racial groups, agreed that such group differences indeed existed, but that causal interpretations differed markedly among the investigators at the time. More recently, the focus has shifted to what has been termed test fairness, with the focus falling more upon tests and their inadequacies than the behavior which underlies the tests. Similar findings and conclusions were frequently advanced in physiological tests of strength and endurance which are often used for civil service positions such as those in the fire fighting service and which frequently disadvantage women. The question raised is simply whether the discrimination is fair or not; that is, do given test score differences reflect variation in performance between groups which are reflective of true behavioral differences or are these differences artifactual and embedded in the assessment device itself, whether intentional or not. 2012 APA, all rights reserved). (shrink)

In this article, on the basis of questionnaire data collected for other purposes, the Authors want to show the consequences of various methods of shortening of tests and what may result from such an action for diagnosticians, researchers and examined individuals. The research aim of the work is to show the best method of shortening of the scale of questionnaires. Will shortening of a questionnaire according to different statistical techniques bring the same results? Will the quality of shortened scales be (...) comparable? Is any of statistical techniques better for shortening of the scale of a questionnaire? The obtained results suggest a poorly controlable effect of the methods of questionnaire shortening. Moreover creating a short version on the basis of the results collected with the use of the full version leads to obtaining a tool with unknown diagnostic and psychometric properties. (shrink)

In response to the rapidly increasing application and abuse of psychological tests in China, the Psychometrics Division of the Chinese Psychological Society published the 2008 revisions of the Chinese Code of Ethical Use of Psychological Tests. We investigated the implementation status of the code 2½ years after its promulgation. Sample included 284 psychological professionals and psychology graduate students. The average accuracy rate for the appropriate use of psychological tests was 67.1% (range = 25.5?97.5%), with 10 (...) items having accuracy rates below 45%. Participants remained uncertain about the clients' rights to information about the purpose, psychometric properties, and scores of the tests. The most frequent violations involved ?using psychological tests without psychometric information for entertainment purposes? and ?using SCL-90 to measure mental health of normal people.? (shrink)

Sporting excellence is a function of physical, cognitive and psychological capacities: its standard requires demonstration of superlative physical and strategic skills and the performance of these...

We examined the attitudes of 600 students in large introductory algebra and psychology classes toward an actual or hypothetical cheating incident and the subsequent retake procedure. Overall, 57% of students in one class and 49Y0 in the other reported that they either cheated or would have cheated if given the opportunity. More men (59%) than women (53%) reported cheating or potential cheating. Students who had actually experienced a retake procedure to handle cheating were more satisfied with such a procedure than (...) others were about a hypothetical situation. Despite having a retake, cheaters were significantly more likely than noncheaters to predict that they would cheat again. Results suggest that instructors who require a retake following extensive cheating should devote class time to a discussion of the issue and all possible alternatives. (shrink)

First Published in 1999. Routledge is an imprint of Taylor & Francis, an informa company.

Prenatal screening and testing are preference‐based health care options. They are offered so that pregnant women and their partners can learn genetic information about the developing fetus. In this literature review, I summarize studies of women’s and their partners’ psychological responses to prenatal testing and screening. These studies investigate the experiences of pregnant women, largely in the United States, who have access to health care services. Although the results indicate that these women are receptive to prenatal (...) class='Hi'>testing and screening and seem to have limited negative psychological consequences, pregnant women without access to these services are not represented and may have different experiences. With that caveat in mind, based on the evidence, women generally do well psychologically as they manage the options that arise for them in the prenatal context. (shrink)

For historians of psychology, Hugo Münsterberg is best remembered as William James’ successor as director of the Harvard Psychological Laboratory and a pioneer of applied psychology. By contrast, for film and media studies scholars, Münsterberg is recognized less for his contributions to experimental psychology than for those to film theory, a field in which his penultimate book, The Photoplay: A Psychological Study (1916), is frequently claimed as an inaugural text. However, lost in the blind spots of both disciplinary (...) perspectives has been a thorough examination of Münsterberg's collaboration with Paramount Pictures, translating psychological tests into experimental short films. Despite reaching millions of moviegoers in 1916, Münsterberg’s ‘Testing the Mind’ series has received little attention from historians of science and early cinema alike. One reason for this neglect is that, to date, not a single extant copy of a ‘Testing the Mind’ release has been located. This article is about the author's efforts, in collaboration with students, to reanimate these lost psychological tests for the screen through meticulous historical reconstruction based on the original scripts, journalistic accounts, and correspondence between Münsterberg and Paramount. This reconstructive process, I show, yields new insights into the relationship between psychology and early cinema and an opportunity for reflection on this promising new space for research at the intersection of media archaeology, the history of psychology, and experimental history of science. Film URL: https://archive.org/details/munsterberg_paramount.pictographs. (shrink)

One of the most notorious — and dismissive — passages in Wittgenstein’s Philosophical Investigations is Part II section xiv, which begins like this: The confusion and barrenness of psychology is not to be explained by calling it a “young science”; its state is not comparable with that of physics, for instance, in its beginnings. (Rather with that of certain branches of mathematics. Set theory.) For in psychology there are experimental methods and conceptual confusion. (As in the other case conceptual confusion (...) and methods of proof.) The existence of the experimental method makes us think we have the means of solving the problems which trouble us; though problem and method pass one another by. Strong words. But we know that at one stage in his life Wittgenstein’s interest in psychology was sufficient for him to have done some experimental research, and that he was well acquainted with the work of at least some of the prominent psychologists active in his own lifetime. That is, his quoted remarks were not made from ignorance; and we should accordingly take them seriously enough to consider why he made them, what he had in mind, and to what extent — if any — they may have been (and, though this was all a long time ago, may still be) justified. (shrink)

Because physical theories typically predict numerical values, an improvement in experimental precision reduces the tolerance range and hence increases corroborability. In most psychological research, improved power of a statistical design leads to a prior probability approaching 1/2 of finding a significant difference in the theoretically predicted direction. Hence the corroboration yielded by "success" is very weak, and becomes weaker with increased precision. "Statistical significance" plays a logical role in psychology precisely the reverse of its role in physics. This problem (...) is worsened by certain unhealthy tendencies prevalent among psychologists, such as a premium placed on experimental "cuteness" and a free reliance upon ad hoc explanations to avoid refutation. (shrink)

This target article argues that the Turing test implicitly rests on a "naive psychology," a naturally evolved psychological faculty which is used to predict and understand the behaviour of others in complex societies. This natural faculty is an important and implicit bias in the observer's tendency to ascribe mentality to the system in the test. The paper analyses the effects of this naive psychology on the Turing test, both from the side of the system and the side of the (...) observer, and then proposes and justifies an inverted version of the test which allows the processes of ascription to be analysed more directly than in the standard version. (shrink)

The Internet and social media have opened niches for political exploitation of human dispositions to hyper-alarmed states that amplify perceived threats relative to their objective probabilities of occurrence. Researchers should aim to observe the dynamic “ramping up” of security threat mechanisms under controlled experimental conditions. Such research necessarily begins from a clear model of standard baseline states, and should involve adding treatments to established experimental protocols developed by experimental economists. We review these protocols, which allow for joint estimation of risk (...) preferences and subjective beliefs about probabilities and their distributions. Results we have obtained on such estimates, from populations in various countries, are gathered for comparison. Most people show moderate risk aversion in non-alarmed states. We also find universal heterogeneity in risk preference structures, with substantial sub-samples weighting probabilities in such a way as to display “probability pessimism”, while others make risky choices in accordance with expected utility theory. (shrink)

Becoming a crime victim is often associated with the development of psychological distress symptoms. In turn, these symptoms have been found to be related to a decrease in perceived social support by the victim. From a uses and gratifications point of view, the increase in distress and the decrease in perceived social support could well affect a victim’s television use. Furthermore, the compensation hypothesis proposes that people with little social contact use mass media to compensate for social isolation. It (...) could therefore be hypothesized that increased use of television for reasons of companionship is related to higher levels of psychological distress and lower levels of perceived social support. The present study used a structural equation model to test this hypothesis. The sample consisted of 212 Flemish victims of crime. The results confirm the proposed relationships and hypotheses. Directions for future research are discussed. (shrink)

Research on distributive justice has shown that people’s judgments on how to distribute resources justly are shaped by various criteria including equity, need, equality, and prior ownership. Yet, an important question remains open: do people’s judgments about justice take the power of the actors under consideration? In other words, to people deem the powerful to deserve a larger share even when their contribution, need, and prior ownership are equal? The paper addresses this question. Online, participants had to judge the just (...) distribution of resources among actors who were equal in all respects except regarding power. Results revealed that a substantial proportion of participants believed that more powerful actors deserved more resources, an effect referred to as power justification. The effect was related with social dominance orientation (SDO), indicating that high-SDO participants manifested enhanced power justification. These results were replicated in three countries, suggesting that, although cultural differences are possibly important, in most societies power justification might be a criterion advocated by some people in certain occasions. These findings can inspire research about important domains where judgments about justice and power are at play, such as about how juries deliberate and about how public opinion reacts to international conflicts. (shrink)

The expanded use of genetic testing raises key ethical and policy questions about possible benefits and harms for those receiving disease‐risk information. As predictive testing for Huntington’s was initiated in a clinical setting, survey research posing hypothetical test scenarios suggested that the vast majority of at‐risk relatives wanted to know whether they carried a disease‐causing mutation. However, only a small minority ultimately availed themselves of this opportunity. Many at‐risk individuals concluded that a positive test result would be too (...) psychologically overwhelming. A substantial literature suggests that individuals are often more resilient than anticipated in coping with many different health‐related stresses. Much of my own work in the field has been through the Risk Evaluation & Education for Alzheimer’s Disease study (REVEAL), a series of randomized clinical trials assessing the impact of genetic susceptibility testing on asymptomatic individuals at risk for Alzheimer’s disease. Our experience in developing and implementing four successive, multisite trials provides some potentially useful lessons for the field. More people will be asking for their personal genetic information. Better understanding will help us decide when access is appropriate and how best to disclose results in a manner that supports adjustment to test findings and promotes use of genetic information to improve human health. (shrink)

One of the clearest signs that Psychology has impacted popular culture is the public’s familiarity with the Rorschach ink-blot test. An excellent example of the Rorschach in popular culture can be found in Watchmen, the comic/graphic novel written by Alan Moore and Dave Gibbons. In the mid-20th century Psychology had an especially contentious relationship with comics; some psychologists were very anxious about the impact comics had on young people, whereas others wrote comics to subvert dominant norms about gender and sexuality. (...) Yet historians of Psychology have had almost nothing to say about this popular and critically acclaimed novel. We read Watchmen here for its narratives that most concern the history of Psychology. We focus on such themes as anti-psychiatry, sexual violence, homophobia, lesbian erasure and social psychological research on bystander intervention. We argue it is possible to align Psychology and comics more closely despite their sometimes contentious history. In doing so we demonstrate the active role of the public in the history of the Rorschach, and the public engagement of Psychology via comics, and also reveal what is possible when historians consider comics within their histories. (shrink)

The crisis of replication has led many to blame statistical significance tests for making it too easy to find impressive looking effects that do not replicate. However, the very fact it becomes difficult to replicate effects when features of the tests are tied down actually serves to vindicate statistical significance tests. While statistical significance tests, used correctly, serve to bound the probabilities of erroneous interpretations of data, this error control is nullified by data-dredging, multiple testing, and other biasing selection (...) effects. Arguments claiming to vitiate statistical significance tests attack straw person variants of tests that commit well-known fallacies and misinterpretations. There is a tension between popular calls for preregistration – arguably, one of the most promising ways to boost replication – and accounts that downplay error probabilities: Bayes Factors, Bayesian posteriors, likelihood ratios. By underscoring the importance of error control for well testedness, the replication crisis points to reformulating tests so as to avoid fallacies and report the extent of discrepancies that are and are not indicated with severity. (shrink)