Why do people create extra representations to help them make sense of situations, diagrams, illustrations, instructions and problems? The obvious explanation – external representations save internal memory and computation – is only part of the story. I discuss eight ways external representations enhance cognitive power: they provide a structure that can serve as a shareable object of thought; they create persistent referents; they change the cost structure of the inferential landscape; they facilitate re-representation; they are (...) often a more natural representation of structure than mental representations; they facilitate the computation of more explicit encoding of information; they enable the construction of arbitrarily complex structure; and they lower the cost of controlling thought – they help coordinate thought. (shrink)

Why do people create extra representations to help them make sense of situations, diagrams, illustrations, instructions and problems? The obvious explanation— external representations save internal memory and com- putation—is only part of the story. I discuss seven ways external representations enhance cognitive power: they change the cost structure of the inferential landscape; they provide a structure that can serve as a shareable object of thought; they create persistent referents; they facilitate re- representation; they are often (...) a more natural representation of structure than mental representations; they facilitate the computation of more explicit encoding of information; they enable the construction of arbitrarily complex structure; and they lower the cost of controlling thought—they help coordinate thought. Jointly, these functions allow people to think more powerfully with external representations than without. They allow us to think the previously unthinkable. (shrink)

This paper provides an inferentialist account of model-based understanding by combining a counterfactual account of explanation and an inferentialist account of representation with a view of modeling as extended cognition. This account makes it understandable how the manipulation of surrogate systems like models can provide genuinely new empirical understanding about the world. Similarly, the account provides an answer to the question how models, that always incorporate assumptions that are literally untrue of the model target, can still provide factive explanations. Finally, (...) the paper shows how the contrastive counterfactual theory of explanation can provide tools for assessing the explanatory power of models. (shrink)

According to ‘internalism’, what mental states people are in depends wholly on what obtains inside their heads. This paper challenges that view without relying on arguments about the identity‐conditions of concepts that make up the content of mental states. Instead, it questions the internalist’s underlying assumption that, in Searle’s words, “the brain is all we have for the purpose of representing the world to ourselves”, which neglects the fact that human beings have used their brains to devise methods for extending (...) and enhancing the brain’s own functions, in particular for storing information externally. Although Popper draws attention to this fact, he fails to grasp its psychological implications, concluding instead that there can be knowledge “without a knowing subject”, and so repeating the internalist’s mistake. With equal justice one can conclude, absurdly, that there are ownerless plans, resolutions and shopping‐lists. The paper goes on to meet possible internalist counter‐arguments. (shrink)

Vehicle externalism maintains that the vehicles of our mental representations can be located outside of the head, that is, they need not be instantiated by neurons located inside the brain of the cogniser. But some disagree, insisting that ‘non-derived’, or ‘original’, content is the mark of the cognitive and that only biologically instantiated representational vehicles can have non-derived content, while the contents of all extra-neural representational vehicles are derived and thus lie outside the scope of the cognitive. In this (...) paper we develop one aspect of Menary’s vehicle externalist theory of cognitive integration—the process of enculturation—to respond to this longstanding objection. We offer examples of how expert mathematicians introduce new symbols to represent new mathematical possibilities that are not yet understood, and we argue that these new symbols have genuine non-derived content, that is, content that is not dependent on an act of interpretation by a cognitive agent and that does not derive from conventional associations, as many linguistic representations do. (shrink)

What I call theoretical abduction (sentential and model-based) certainly illustrates much of what is important in abductive reasoning, especially the objective of selecting and creating a set of hypotheses that are able to dispense good (preferred) explanations of data, but fails to account for many cases of explanations occurring in science or in everyday reasoning when the exploitation of the environment is crucial. The concept of manipulative abduction is devoted to capture the role of action in many interesting situations: action (...) provides otherwise unavailable information that enables the agent to solve problems by starting and performing a suitable abductive process of generation or selection of hypotheses. Many external things, usually inert from the epistemological point of view, can be transformed into what I call epistemic mediators, which are illustrated in the last part of the paper, together with an analysis of the related notion of external representation . Finally, some examples of computational programs that simulate geometrical reasoning are illustrated. The computational embodiment generates a kind of squared epistemic mediator: geometrical construction, as an example of epistemic mediator, is further mediated. (shrink)

I argue that the concept of representation is ambiguous: a picture of 'a man', when there is no actual man that it depicts, both does, in one sense, and does not, in another sense, represent 'a man'--hence the need for a distinction of internal from external representation. Internal representation is also defended from reductive, non-referential alternative views, and from 'prosthesis' views of picturing, according to which seeing a picture of an actual man just is seeing through the picture to (...) that actual man himself. The view also provides a strong foundation for a theory of reference to fictional entities. (shrink)

Our epistemic access to mathematical objects, like numbers, is mediated through our external representations of them, like numerals. Nevertheless, the role of formal notations and, in particular, of the internal structure of these notations has not received much attention in philosophy of mathematics and cognitive science. While systems of number words and of numerals are often treated alike, I argue that they have crucial structural differences, and that one has to understand how the external representation works in (...) order to form an advanced conception of numbers. The relation between external representations and mathematical cognition will be discussed by drawing on experimental results from cognitive science and mathematics education, and I argue for the constitutive role of external representations for the development of an advanced conception of numbers. (shrink)

Many scientific discoveries have depended on external diagrams or visualizations. Many scientists also report to use an internal mental representation or mental imagery to help them solve problems and reason. How do scientists connect these internal and external representations? We examined working scientists as they worked on external scientific visualizations. We coded the number and type of spatial transformations (mental operations that scientists used on internal or external representations or images) and found that there (...) were a very large number of comparisons, either between different visualizations or between a visualization and the scientists’ internal mental representation. We found that when scientists compared visualization to visualization, the comparisons were based primarily on features. However, when scientists compared a visualization to their mental representation, they were attempting to align the two representations. We suggest that this alignment process is how scientists connect internal and external representations. (shrink)

Clark & Thornton speculate that intervening in the real world might be a way of transforming type-2 problems into type-1, but they state that they are not aware of any definite cases. It is argued that the active construction of external representations often performs exactly this function, and that recoding via the real world is therefore common, if not ubiquitous.

This paper takes an embodied and extended cognition perspective to ER integration – a cognitive process through which a learner integrates external representations in a domain, with her internal model, as she interacts with, uses, understands and transforms between those ERs. In the paper, I argue for a theoretical as well as empirical shift in future investigations of ER integration, by proposing a model of cognitive mechanisms underlying the process, based on recent advances in extended and embodied cognition. (...) I present this new model in contrast to the still dominant classical cognitivist approaches to ER integration, and the educational technology intervention designs such approaches inspire. I then exemplify this distinction between the information processing model and the new model through a case of arithmetic problem solving. Corroborative neuroscience evidence presented in relation to this case provides empirical support for the new model by showing how bodily actions are critical to ER integration and learning. Finally, as educational implications of the new model, I demonstrate the need for: re-viewing the development of ER integration and expertise as fine-tuning of the learner's action or sensorimotor system, and a shift of focus in new-media intervention design principles based on this newer understanding of ER integration in science, technology, engineering and mathematics. (shrink)

We outline three challenges involved in designing external representations that promote sustainable use of natural resources. First, the task environment of sustainable resource-use is highly unstructured, and involves many uncoordinated and asynchronous actions. Following from this complex nature of the task environment, more task constraints and task interactions are involved in designing representations promoting sustainability, compared to representations that seek to make tasks easier in structured task environments, such as aircraft cockpits and control rooms. Second, (...) class='Hi'>external representations promoting sustainable resource-use need to motivate people to make decisions that sustain resources, and persist with this behavior, even though alternate behaviors are easier and commonplace. Third, external representations promoting sustainability also need to lower the cognitive load involved in sustainability decisions. This three-tiered function (meeting complex task constraints, providing motivation, lowering cognitive load) makes such representations challenging to design. However, some early prototype designs promoting sustainable resource-use have appeared recently, primarily addressing electricity use. Analyzing these digital prototypes, we outline three design principles they share, and show how these seek to address the complexities of the sustainability problem-space (complexity of task environments, goals, and representations). We then argue that at least two further cognitive scaffolds are required for effectively promoting sustainable resource use (action scripts, deconstruction). We close with some of the limitations of this approach to promoting sustainability, and outline future work. (shrink)

Our brains make up a series of signs and are engaged in making or manifesting or reacting to a series of signs: through this semiotic activity they are at the same time engaged in “being minds” and so in thinking intelligently. An important effect of this semiotic activity of brains is a continuous process of “externalization of the mind” that exhibits a new cognitive perspective on the mechanisms underling the semiotic emergence of abductive processes of meaning formation. To illustrate this (...) process I will take advantage of the analysis of some aspects of the cognitive interplay between internal and external representations. I consider this interplay critical in analyzing the relation between meaningful semiotic internal resources and devices and their dynamical interactions with the externalized semiotic materiality suitably stocked in the environment. Hence, minds are material, “extended” and artificial in themselves. A considerable part of human abductive thinking is occurring through an activity consisting in a kind of reification in the external environment and a subsequent re-projection and reinterpretation through new configurations of neural networks and chemical processes. I also illustrate how this activity takes advantage of hybrid representations and how it can nicely account for various processes of creative and selective abduction, bringing up the question of how multimodal aspects involving a full range of sensory modalities are important in hypothetical reasoning. (shrink)

Cognitive representations are typically analysed in terms of content, vehicle and format. While current work on formats appeals to intuitions about external representations, such as words and maps, in this paper we develop a computational view of formats that does not rely on intuitions. In our view, formats are individuated by the computational profiles of vehicles, i.e., the set of constraints that fix the computational transformations vehicles can undergo. The resulting picture is strongly pluralistic, it makes space (...) for a variety of different formats, and is intimately tied to the computational approach to cognition in cognitive science and artificial intelligence. (shrink)

Spatial Representation presents original, specially written essays by leading psychologists and philosophers on a fascinating set of topics at the intersection of these two disciplines. They address such questions as these: Do the extraordinary navigational abilities of birds mean that these birds have the same kind of grip on the idea of a spatial world as we do? Is there a difference between the way sighted and blind subjects represent the world 'out there'? Does the study of brain-injured subjects, such (...) as 'blind seers', tell us anything about the working of normal spatial consciousness? -/- The essays are arranged into five sections, each of which reflects a central area of research into spatial cognition, and opens with a short introduction by the editors, designed to facilitate cross-disciplinary reading. The volume as a whole offers a rich and compelling expression of the view that to advance our understanding of the way we represent the external world it is necessary to draw on both philosophical and psychological approaches. (shrink)

Internal relations are those relations that are intrinsic to the nature of one or more of the relata. They are a kind of essential relation, rather than an essential property. For example, an arc of a circle is internally related to the center of that circle in the sense that.

In this book Han Thomas Adriaenssen offers the first comparative exploration of the sceptical reception of representationalism in medieval and early modern philosophy. Descartes is traditionally credited with inaugurating a new kind of scepticism by saying that the direct objects of perception are images in the mind, not external objects, but Adriaenssen shows that as early as the thirteenth century, critics had already found similar problems in Aquinas's theory of representation. He charts the attempts of philosophers in both periods (...) to grapple with these problems, and shows how in order to address the challenges of scepticism and representation, modern philosophers in the wake of Descartes often breathed new life into old ideas, remoulding them in ways that we are just beginning to understand. His book will be valuable for historians interested in the medieval background to early modern thought, and to medievalists looking at continuity with the early modern period. -/- . (shrink)

I argue that there are no plausible non-representational explanations of episodes of hallucination. To make the discussion more specific, I focus on visual hallucinations in Charles Bonnet syndrome. I claim that the character of such hallucinatory experiences cannot be explained away non-representationally, for they cannot be taken as simple failures of cognizing or as failures of contact with external reality—such failures being the only genuinely non-representational explanations of hallucinations and cognitive errors in general. I briefly introduce a recent computational (...) model of hallucination, which relies on generative models in the brain, and argue that the model is a prime example of a representational explanation referring to representational mechanisms. The notion of the representational mechanism is elucidated, and it is argued that hallucinations—and other kinds of representations—cannot be exorcised from the cognitive sciences. (shrink)

In this article we propose a theoretical framework of distributed representations and a methodology of representational analysis for the study of distributed cognitive tasks—tasks that require the processing of information distributed across the internal mind and the external environment. The basic principle of distributed representations Is that the representational system of a distributed cognitive task is a set of internal and external representations, which together represent the abstract structure of the task. The basic strategy of (...) representational analysis is to decompose the representation of a hierarchical task into its component levels so that the representational properties at each level can be independently examined. The theoretical framework and the methodology are used to analyze the hierarchical structure of the Tower of Hanoi problem. Based on this analysis, four experiments are designed to examine the representational properties of the Tower of Hanoi. Finally, the nature of external representations is discussed. (shrink)

Mathematicians’ use of external representations, such as symbols and diagrams, constitutes an important focal point in current philosophical attempts to understand mathematical practice. In this paper, we add to this understanding by presenting and analyzing how research mathematicians use and interact with external representations. The empirical basis of the article consists of a qualitative interview study we conducted with active research mathematicians. In our analysis of the empirical material, we primarily used the empirically based frameworks provided (...) by distributed cognition and cognitive semantics as well as the broader theory of cognitive integration as an analytical lens. We conclude that research mathematicians engage in generative feedback loops with material representations, that they use representations to facilitate the use of experiences of handling the physical world as a resource in mathematical work, and that their use of representations is socially sanctioned and enabled. These results verify the validity of the cognitive frameworks used as the basis for our analysis, but also show the need for augmentation and revision. Especially, we conclude that the social and cultural context cannot be excluded from cognitive analysis of mathematicians’ use of external representations. Rather, representations are socially sanctioned and enabled in an enculturation process. (shrink)

In this commentary on Berwick and Chomsky's “Why Only Us,” I discuss three key points. I first offer a brief critique of their scholarship, notably their often unjustified dismissal of previous thinking about language evolution. But my main focus concerns two arguments central to the book's thesis: the irrelevance of externalization to language evolution and the discontinuity between human conceptual representations and those of other animals. I argue against both stances, using cognitive data from nonhuman species to show that (...) externalization is not irrelevant to understanding the biology of language, and that many human conceptual structures have clear animal homologs. (shrink)

First of all I would like to describe inductive and abductive reasoning in the light of the agent–based framework to the aim of clarifying their fallacious character and the role of the so-called ideal systems (logical and computational). Then I will analyze some inductive and abductive types of reasoning that in the perspective of classical and informal logic are defined fallacies. I will describe how in an agent-based reasoning this kind of fallacious reasoning can in some cases be redefined and (...) considered as a good way of reasoning. Finally, I will illustrate how what I call manipulative abduction can be interpreted as a form of practical reasoning a better understanding of which can furnish a description of human beings as hybrid reasoners in so far they are users of ideal and computational agents. (shrink)

The physical interpretation of induced representation intertwining as a process of materialization or localization is extrapolated to mappings (which are not intertwinings) between configuration and momentum representations. Propagation of extended particles composed of an external and an internal mode is a combination of two generalized materializations and two generalized localizations. Our aim is to submit, in the spinless case, the idea that mappings from external representations to internal ones are possible alternatives, probability amplitudes of which must (...) be summed up in the whole propagator. However, it turns out that they lead to different final states and then correspond to 64 different propagators and not to alternatives of the same propagation. In addition to being transitions from one location to another, these propagations contain processes of interconversion between internal and external modes which are responsible for creation and annihilation of the extended particle. The physical interpretations are striking, while the mathematical stricture is poor. Inconsistencies of the model are outlined. (shrink)

This paper reconsiders Ockham's critique of the species theory of cognition. As Ockham understands this theory, it says that the direct objects of cognition are mental representations, or species. According to many commentators, one of Ockham's main objections to this theory was that, if the direct objects of cognition are species rather than external objects, we will never be able to establish whether or not a given species is a veridical representation of the world. In this paper I (...) argue that this line of interpretation sits uneasily with Ockham's epistemology, and offer a new interpretation of Ockham's critique of species. (shrink)

Our brains make up a series of signs and are engaged in making or manifesting or reacting to a series of signs: through this semiotic activity they are at the same time engaged in “being minds.” An important effect of this semiotic activity of brains is a continuous process of “externalization of the mind” that exhibits a new cognitive perspective on the mechanisms underlying the semiotic emergence of abductive processes of meaning formation. I consider this process of externalization interplay critical (...) in analyzing the relation between meaningful semiotic internal resources and devices and their dynamical interactions with the externalized semiotic materiality suitably stocked in the environment. The last part of the paper will describe some aspects of this interplay between external diagrammatization and internal recapitulation showing the specificity of their co-evolution. (shrink)

Integrative and naturalistic philosophy of mind can both learn from and contribute to the contemporary cognitive sciences of dreaming. Two related phenomena concerning self-representation in dreams demonstrate the need to bring disparate fields together. In most dreams, the protagonist or dream self who experiences and actively participates in dream events is or represents the dreamer: but in an intriguing minority of cases, self-representation in dreams is displaced, disrupted, or even absent. Working from dream reports in established databanks, we examine two (...) key forms of polymorphism of self-representation: dreams in which I take an external visuospatial perspective on myself, and those in which I take someone else's perspective on events. In remembering my past experiences or imagining future or possible experiences when awake, I sometimes see myself from an external or 'observer' perspective. By relating the issue of perspective in dreams to established research traditions in the study of memory and imagery, and noting the flexibility of perspective in dreams, we identify new lines of enquiry. In other dreams, the dreamer does not appear to figure at all, and the first person perspective on dream events is occupied by someone else, some other person or character. We call these puzzling cases 'vicarious dreams' and assess some potential ways to make sense of them. Questions about self-representation and perspectives in dreams are intriguing in their own right and pose empirical and conceptual problems about the nature of self-representation with implications beyond the case of dreaming. (shrink)

This article describes a representation-based framework of distributed cognition. This framework considers distributed cognition as a cognitive system whose structures and processes are distributed between internal and external representations, across a group of individuals, and across space and time. The major issue for distributed research, under this framework, are the distribution, transformation, and propagation of information across the components of the distributed cognitive system and how they affect the performance of the system as a whole. To demonstrate the (...) value of this representation-based approach, the framework was used to describe and explain an important, challenging, and controversial issue — the concept of affordance. (shrink)

Advocates of dynamical systems theory (DST) sometimes employ revolutionary rhetoric. In an attempt to clarify how DST models differ from others in cognitive science, I focus on two issues raised by DST: the role for representations in mental models and the conception of explanation invoked. Two features of representations are their role in standing-in for features external to the system and their format. DST advocates sometimes claim to have repudiated the need for stand-ins in DST models, but (...) I argue that they are mistaken. Nonetheless, DST does offer new ideas as to the format of representations employed in cognitive systems. With respect to explanation, I argue that some DST models are better seen as conforming to the covering-law conception of explanation than to the mechanistic conception of explanation implicit in most cognitive science research. But even here, I argue, DST models are a valuable complement to more mechanistic cognitive explanations. (shrink)

Whilst the topic of representations is one of the key topics in philosophy of mind, it has only occasionally been noted that representations and representational features may be gradual. Apart from vague allusions, little has been said on what representational gradation amounts to and why it could be explanatorily useful. The aim of this paper is to provide a novel take on gradation of representational features within the neuroscientific framework of predictive processing. More specifically, we provide a gradual (...) account of two features of structural representations: structural similarity and decoupling. We argue that structural similarity can be analysed in terms of two dimensions: number of preserved relations and state space granularity. Both dimensions can take on different values and hence render structural similarity gradual. We further argue that decoupling is gradual in two ways. First, we show that different brain areas are involved in decoupled cognitive processes to a greater or lesser degree depending on the cause (internal or external) of their activity. Second, and more importantly, we show that the degree of decoupling can be further regulated in some brain areas through precision weighting of prediction error. We lastly argue that gradation of decoupling (via precision weighting) and gradation of structural similarity (via state space granularity) are conducive to behavioural success. (shrink)

Pictorial representation is a subject of interest to both cognitive science and aesthetics. Standard theories of depiction often draw on vision science, and vision science must give an account of picture perception. I offer a critical overview of standard theories of depiction and argue that none of them is adequate. I then describe ways in which new theories of perception blend elements of representationalism with an emphasis on attention and motor control. Such theories, in effect, limit the reliance on mental (...) representation in perceptual tasks. This work provides the basis for a theory of depiction in which pictorial representation is explained in terms of both mental representations and perceptual strategies. I argue that, in the case, the mental representations are most plausibly individuated by the functional and conceptual roles, rather than by causal links to the external world. (shrink)

Shepard's concept of internalization does not suggest mechanisms which help to understand how the brain adapts to changes, how representations of a steadily changing environment are updated or, in short, how brain learning continues throughout life. Neural mechanisms, as suggested by Barlow, may prove a more powerful alternative. Brain theories such as Adaptive Resonance Theory (ART) propose mechanisms to explain how representational activities may be linked in space and time. Some predictions of ART are confirmed by psychophysical and neurophysiological (...) data. [Barlow; Shepard]. (shrink)

Novel computational representations, such as simulation models of complex systems and video games for scientific discovery, are dramatically changing the way discoveries emerge in science and engineering. The cognitive roles played by such computational representations in discovery are not well understood. We present a theoretical analysis of the cognitive roles such representations play, based on an ethnographic study of the building of computational models in a systems biology laboratory. Specifically, we focus on a case of model-building by (...) an engineer that led to a remarkable discovery in basic bioscience. Accounting for such discoveries requires a distributed cognition analysis, as DC focuses on the roles played by external representations in cognitive processes. However, DC analyses by and large have not examined scientific discovery, and they mostly focus on memory offloading, particularly how the use of existing external representations changes the nature of cognitive tasks. In contrast, we study discovery processes and argue that discoveries emerge from the processes of building the computational representation. The building process integrates manipulations in imagination and in the representation, creating a coupled cognitive system of model and modeler, where the model is incorporated into the modeler's imagination. This account extends DC significantly, and we present some of the theoretical and application implications of this extended account. (shrink)

What do pictures and mental images have in common? The contemporary tendency to reject mental picture theories of imagery suggests that the answer is: not much. We show that pictures and visual imagery have something important in common. They both contribute to mental simulations: pictures as inputs and mental images as outputs. But we reject the idea that mental images involve mental pictures, and we use simulation theory to strengthen the anti-pictorialist's case. Along the way we try to account for (...) caricature and for some basic features of pictorial representations. (shrink)

The terms nested sets, partitive frequencies, inside-outside view, and dual processes add little but confusion to our original analysis (Gigerenzer & Hoffrage 1995; 1999). The idea of nested set was introduced because of an oversight; it simply rephrases two of our equations. Representation in terms of chances, in contrast, is a novel contribution yet consistent with our computational analysis System 1.dual process theory” is: Unless the two processes are defined, this distinction can account post hoc for almost everything. In contrast, (...) an ecological view of cognition helps to explain how insight is elicited from the outside (the external representation of information) and, more generally, how cognitive strategies match with environmental structures. (shrink)

Cinematic motion is, I argue, a genuine and intrinsic property of some cinematic works and not just a matter of how things look to us. It is an event—an item's change of position—happening prior and external to our sensory responses to movies. I therefore defend against common-sense illusionism a minority opinion within cinema studies: that movie viewing normally occasions veridical perceptions of a kind of objective displacement. I also dispute another version of anti-illusionist realism about cinematic motion, the implication (...) that cinematic motion, like colour, is a response-dependent property. The impression of motion, I contend, is not produced by the visual system's operations. It is a sensory representation of a physical property of a particular type of external object. (shrink)