This thesis investigates the representation of phonological language aspects in the healthy human brain, especially the contribution of the right hemisphere. Using functional magnetic resonance imaging and transcranial magnetic stimulation, it is demonstrated that the left and right supramarginal gyri are essential for phonological processing. It is also shown that the left as well as the right posterior inferior frontal gyri contribute to efficient phonological decisions. Finally, an fMRI study reveals a frontal network for phonological aspects of language production. These (...) results demonstrate a contribution of both hemispheres to efficient phonological aspects of language comprehension as well as production. Together, these results question the notion of a left-dominant network of brain regions for language processing. (shrink)

Journal Name: Cognitive Linguistics Issue: Ahead of print.

Observing others in conversation is a common format for comprehending language, yet little work has been done to understand dialog comprehension. We tested whether overhearers use addressee backchannels as predictive cues for how to integrate information across speaker turns during comprehension of spontaneously produced collaborative narration. In Experiment 1, words that followed specific backchannels were recognized more slowly than words that followed either generic backchannels or pauses. In Experiment 2, we found that when the turn after the backchannel was a (...) continuation of the narrative, specific backchannels prompted the fastest verification of prior information. When the turn after was an elaboration, they prompted the slowest, indicating that overhearers took specific backchannels as cues to integrate preceding talk with subsequent talk. These findings demonstrate that overhearers capitalize on the predictive relationship between backchannels and the development of speakers’ talk, coordinating information across conversational roles. (shrink)

Understanding spoken words involves a rapid mapping from speech to conceptual representations. One distributed feature-based conceptual account assumes that the statistical characteristics of concepts’ features—the number of concepts they occur in and likelihood of co-occurrence —determine conceptual activation. To test these claims, we investigated the role of distinctiveness/sharedness and correlational strength in speech-to-meaning mapping, using a lexical decision task and computational simulations. Responses were faster for concepts with higher sharedness, suggesting that shared features are facilitatory in tasks like lexical decision (...) that require access to them. Correlational strength facilitated responses for slower participants, suggesting a time-sensitive co-occurrence-driven settling mechanism. The computational simulation showed similar effects, with early effects of shared features and later effects of correlational strength. These results support a general-to-specific account of conceptual processing, whereby early activation of shared features is followed by the gradual emergence of a specific target representation. (shrink)

Narratives are an integral part of human expression. In the graphic form, they range from cave paintings to Egyptian hieroglyphics, from the Bayeux Tapestry to modern day comic books (Kunzle, 1973; McCloud, 1993). Yet not much research has addressed the structure and comprehension of narrative images, for example, how do people create meaning out of sequential images? This piece helps fill the gap by presenting a theory of Narrative Grammar. We describe the basic narrative categories and their relationship to a (...) canonical narrative arc, followed by a discussion of complex structures that extend beyond the canonical schema. This demands that the canonical arc be reconsidered as a generative schema whereby any narrative category can be expanded into a node in a tree structure. Narrative “pacing” is interpreted as a reflection of various patterns of this embedding: conjunction, left-branching trees, center-embedded constituencies, and others. Following this, diagnostic methods are proposed for testing narrative categories and constituency. Finally, we outline the applicability of this theory beyond sequential images, such as to film and verbal discourse, and compare this theory with previous approaches to narrative and discourse. (shrink)

A new framework for the study of the human moral faculty is currently receiving much attention: the so-called ‘universal moral grammar' framework. It is based on an intriguing analogy, first pointed out by Rawls, between the study of the human moral sense and Chomsky's research program into the human language faculty. In order to assess UMG, we ask: is moral competence modular? Does it have an underlying hierarchical grammatical structure? Does moral diversity rest on culture-dependent parameters? We review evidence that (...) supports negative answers and argue that formal grammatical concepts are of limited value for the study of moral judgments, moral development and moral diversity. (shrink)

Mental imagery (varieties of which are sometimes colloquially refered to as “visualizing,” “seeing in the mind's eye,” “hearing in the head,” “imagining the feel of,” etc.) is quasi-perceptual experience; it resembles perceptual experience, but occurs in the absence of the appropriate external stimuli. It is also generally understood to bear intentionality (i.e., mental images are always images of something or other), and thereby to function as a form of mental representation. Traditionally, visual mental imagery, the most discussed variety, was thought (...) to be caused by the presence of picturelike representations (mental images) in the mind, soul, or brain, but this is no longer universally accepted. (shrink)

Prior to the twentieth century, theories of knowledge were inherently perceptual. Since then, developments in logic, statis- tics, and programming languages have inspired amodal theories that rest on principles fundamentally different from those underlying perception. In addition, perceptual approaches have become widely viewed as untenable because they are assumed to implement record- ing systems, not conceptual systems. A perceptual theory of knowledge is developed here in the context of current cognitive science and neuroscience. During perceptual experience, association areas in the (...) brain capture bottom-up patterns of activation in sensory-motor areas. Later, in a top-down manner, association areas partially reactivate sensory-motor areas to implement perceptual symbols. The stor- age and reactivation of perceptual symbols operates at the level of perceptual components – not at the level of holistic perceptual expe- riences. Through the use of selective attention, schematic representations of perceptual components are extracted from experience and stored in memory (e.g., individual memories of green, purr, hot). As memories of the same component become organized around a com- mon frame, they implement a simulator that produces limitless simulations of the component (e.g., simulations of purr). Not only do such simulators develop for aspects of sensory experience, they also develop for aspects of proprioception (e.g., lift, run) and introspec- tion (e.g., compare, memory, happy, hungry). Once established, these simulators implement a basic conceptual system that represents types, supports categorization, and produces categorical inferences. These simulators further support productivity, propositions, and ab- stract concepts, thereby implementing a fully functional conceptual system. Productivity results from integrating simulators combinato- rially and recursively to produce complex simulations. Propositions result from binding simulators to perceived individuals to represent type-token relations. Abstract concepts are grounded in complex simulations of combined physical and introspective events. Thus, a per- ceptual theory of knowledge can implement a fully functional conceptual system while avoiding problems associated with amodal sym- bol systems. Implications for cognition, neuroscience, evolution, development, and artificial intelligence are explored. (shrink)

There is no doubt that the model presented here is incomplete. Many important categories, particularly negation and the adverbials, have been entirely ignored, and the treatment of Tense and the affixes is certainly inadequate. It also remains to be seen how the many constructions that have been ignored here are to be accommodated within the framework that has been outlined. However, the fact that a standard categorial lexicon, plus the four rule schemata, seems to come close to exhaustively specifying the (...) main clause constructions of English, and also seems to explain a number of major constraints on transformations, encourages us to compare the theory with certain alternatives, and to examine its broader implications. (shrink)

Investigations of the function of consciousness in human information processing have focused mainly on two questions: (1) where does consciousness enter into the information processing sequence and (2) how does conscious processing differ from preconscious and unconscious processing. Input analysis is thought to be initially "preconscious," "pre-attentive," fast, involuntary, and automatic. This is followed by "conscious," "focal-attentive" analysis which is relatively slow, voluntary, and flexible. It is thought that simple, familiar stimuli can be identified preconsciously, but conscious processing is needed (...) to identify complex, novel stimuli. Conscious processing has also been thought to be necessary for choice, learning and memory, and the organization of complex, novel responses, particularly those requiring planning, reflection, or creativity. (shrink)

This paper replies to the first 36 commentaries on my target article on “Is human information processing conscious?” (Behavioral and Brain Sciences,1991, pp.651-669). The target article focused largely on experimental studies of how consciousness relates to human information processing, tracing their relation from input through to output, while discussion of the implications of the findings both for cognitive psychology and philosophy of mind was relatively brief. The commentaries reversed this emphasis, and so, correspondingly, did the reply. The sequence of topics (...) in the reply roughly follows that of the target article. The discussion begins with a reconsideration of the details of the empirical findings, whether they can be extrapolated to non-laboratory settings, and the extent to which one can rely on their use of subjective reports. This is followed by an in-depth discussion of what is meant by “conscious processing” and of how phenomenal consciousness relates to attentional processing. We then turn to broader philosophical and theoretical issues. I point out some of the reasons why I do not support epiphenomenalism, dualist-interactionism, or reductionism, and elaborate on how first- and third-person views of the mind can be regarded as complementary and mutually irreducible. I suggest how the relation of conscious experiences to their neural correlates can be understood in terms of a dual-aspect theory of information,and how this might be used to resolve some of the paradoxes surrounding the causal interactions of consciousness and brain. I also suggest that, viewed from a first-person perspective, consciousness gives purpose to existence, which allows a different way of viewing its role in evolution. (shrink)

Perceptual processes, in particular modular processes, have long been understood as being mandatory. But exactly what mandatoriness amounts to is left to intuition. This paper identifies a crucial ambiguity in the notion of mandatoriness. Discussions of mandatory processes have run together notions of automaticity and ballisticity. Teasing apart these notions creates an important tool for the modularist's toolbox. Different putatively modular processes appear to differ in their kinds of mandatoriness. Separating out the automatic from the ballistic can help the modularist (...) diagnose and explain away some putative counterexamples to multimodal and central modules, thereby helping us to better evaluate the evidentiary status of modularity theory. (shrink)