How should we measure metacognitive sensitivity, i.e. the efficacy with which observers’ confidence ratings discriminate between their own correct and incorrect stimulus classifications? We argue that currently available methods are inadequate because they are influenced by factors such as response bias and type 1 sensitivity . Extending the signal detection theory approach of Galvin, Podd, Drga, and Whitmore , we propose a method of measuring type 2 sensitivity that is free from these confounds. We call our measure meta-d′, which (...) reflects how much information, in signal-to-noise units, is available for metacognition. Applying this novel method in a 2-interval forced choice visual task, we found that subjects’ metacognitive sensitivity was close to, but significantly below, optimality. We discuss the theoretical implications of these findings, as well as related computational issues of the method. We also provide free Matlab code for implementing the analysis. (shrink)

Detection theory has been applied to a host of varied problems (for example, measuring the accuracy of diagnostic systems or reliability of lie detection tests) and extends far beyond the detection of signals. This book is a primer on the subject.

Threshold- and signal-detection-based models have dominated theorizing about recognition memory. Building upon these theoretical frameworks, we have argued for a dual-process model in which conscious recollection and familiarity contribute to memory performance. In the current paper we assessed several memory models by examining the effects of levels of processing and the number of presentations on recognition memory receiver operating characteristics . In general, when the ROCs were plotted in probability space they exhibited an inverted U shape; however, when they (...) were plotted inzspace they exhibited a U shape. An examination of the ROCs showed that the dual-process model could account for the observed ROCs, but that models based solely on either threshold or signal-detection processes failed to provide a sufficient account of the data. Furthermore, an examination of subjects' introspective reports using the remember/know procedure showed that subjects were aware of recollection and familiarity and were able to consistently report on their occurrence. The remember/know data were used to accurately predict the shapes of the ROCs, and estimates of recollection and familiarity derived from the ROC data mirrored the subjective reports of these processes. (shrink)

Introspection is a fundamental part of our mental lives. Nevertheless, its reliability and its underlying cognitive architecture have been widely disputed. Here, I propose a principled way to model introspection. By using time-tested principles from signal detection theory (SDT) and extrapolating them from perception to introspection, I offer a new framework for an introspective signal detection theory (iSDT). In SDT, the reliability of perceptual judgments is a function of the strength of an internal perceptual response (signal- to-noise (...) ratio) which is, to a large extent, driven by the intensity of the stimulus. In parallel to perception, iSDT models the reliability of introspective judgments as a function of the strength of an internal introspective response (signal-to-noise ratio) which is, to a large extent, driven by the intensity of conscious experiences. Thus, by modelling introspection after perception, iSDT can calibrate introspection’s reliability across a whole range of contexts. iSDT offers a novel, illuminating way of thinking about introspection and the cognitive processes that support it. (shrink)

When we are fatigued, we feel that our performance is worse than when we are fresh. Yet, for over 100 years, researchers have been unable to identify an objective, behavioral measure that covaries with the subjective experience of fatigue. Previous work suggests that the metrics of signal detection theory —response bias and perceptual certainty —may change as a function of fatigue, but no work has yet been done to examine whether these metrics covary with fatigue. Here, we investigated cognitive (...) fatigue using SDT. We induced fatigue through repetitive performance of the n-back working memory task, while functional magnetic resonance imaging data was acquired. We also assessed cognitive fatigue at intervals throughout. This enabled us to assess not only whether criterion and d’ covary with cognitive fatigue but also whether similar patterns of brain activation underlie cognitive fatigue and SDT measures. Our results show that both criterion and d’ were correlated with changes in cognitive fatigue: as fatigue increased, subjects became more conservative in their response bias and their perceptual certainty declined. Furthermore, activation in the striatum of the basal ganglia was also related to cognitive fatigue, criterion, and d’. These results suggest that SDT measures represent an objective measure of cognitive fatigue. Additionally, the overlap and difference in the fMRI results between cognitive fatigue and SDT measures indicate that these measures are related while also separate. In sum, we show the relevance of SDT measures in the understanding of fatigue, thus providing researchers with a new set of tools with which to better understand the nature and consequences of cognitive fatigue. (shrink)

Block [Block, N. . Two neural correlates of consciousness. Trends in Cognitive Science, 9, 46–52] and Snodgrass claim that a signal detection theory analysis of qualitative difference paradigms, in particular the exclusion failure paradigm, reveals cases of phenomenal consciousness without access consciousness. This claim is unwarranted on several grounds. First, partial cognitive access rather than a total lack of cognitive access can account for exclusion failure results. Second, Snodgrass’s Objective Threshold/Strategic model of perception relies on a problematic ‘enable’ approach (...) to perception that denies the possibility of intentional control of unconscious perception and any effect of following different task instructions on the presence/absence of phenomenal consciousness. Many of Block’s purported examples of phenomenal consciousness without cognitive access also rely on this problematic approach. Third, qualitative difference paradigms may index only a subset of access consciousness. Thus, qualitative difference paradigms like exclusion failure cannot be used to isolate phenomenal consciousness, any attempt to do so still faces serious methodological problems. (shrink)

Phillips argues that blindsight is due to response criterion artefacts under degraded conscious vision. His view provides alternative explanations for some studies, but may not work well when one considers several key findings in conjunction. Empirically, not all criterion effects are decidedly non-perceptual. Awareness is not completely abolished for some stimuli, in some patients. But in other cases, it was clearly impaired relative to the corresponding visual sensitivity. This relative dissociation is what makes blindsight so important and interesting.

Collerton et al.'s Perception and Attention Deficit model argues that all recurrent complex visual hallucinations result from maladaptive, deficient sensory and attentional processing. We outline a constructivist-based representation of perception using signal detection theory, in which hallucinations are modeled as false alarms when confirmational perceptual information is lacking. This representation allows for some individuals to have RCVH due to a criterion shift associated with attentional proficiency that results in an increased awareness of the environment.

The Hilbert space formalism is a powerful language to express many cognitive phenomena. Here, relevant concepts from signal detection theory are recast in that language, allowing an empirically testable extension of the quantum probability formalism to psychophysical measures, such as detectability and discriminability.

Do dissociations imply independent systems? In the memory field, the view that there are independent implicit and explicit memory systems has been predominantly supported by dissociation evidence. Here, we argue that many of these dissociations do not necessarily imply distinct memory systems. We review recent work with a single-system computational model that extends signal-detection theory (SDT) to implicit memory. SDT has had a major influence on research in a variety of domains. The current work shows that it can be (...) broadened even further in its range of application. Indeed, the single-system model that we present does surprisingly well in accounting for some key dissociations that have been taken as evidence for independent implicit and explicit memory systems. (shrink)

We propose that the six mechanisms identified by Juslin & Vll (J&V) fall into two categories: signal detection and amplification. Signal detection mechanisms are unmediated and induce emotion by directly detecting emotive signals in music. Amplifiers act in conjunction with signal detection mechanisms. We also draw attention to theoretical and empirical challenges associated with the proposed mechanisms.