This paper traces the application of information theory to philosophical problems of mind and meaning from the earliest days of the creation of the mathematical theory of communication. The use of information theory to understand purposive behavior, learning, pattern recognition, and more marked the beginning of the naturalization of mind and meaning. From the inception of information theory, Wiener, Turing, and others began trying to show how to make a mind from informational and computational materials. Over the last 50 years, (...) many philosophers saw different aspects of the naturalization of the mind, though few saw at once all of the pieces of the puzzle that we now know. Starting with Norbert Wiener himself, philosophers and information theorists used concepts from information theory to understand cognition. This paper provides a window on the historical sequence of contributions made to the overall project of naturalizing the mind by philosophers from Shannon, Wiener, and MacKay, to Dennett, Sayre, Dretske, Fodor, and Perry, among others. At some time between 1928 and 1948, American engineers and mathematicians began to talk about `Theory of Information' and `Information Theory,' understanding by these terms approximately and vaguely a theory for which Hartley's `amount of information' is a basic concept. I have been unable to find out when and by whom these names were first used. Hartley himself does not use them nor does he employ the term `Theory of Transmission of Information,' from which the two other shorter terms presumably were derived. It seems that Norbert Wiener and Claude Shannon were using them in the Mid-Forties. (shrink)

The influence of historical-causal theories of reference developed in the late sixties and early seventies by Donnellan, Kripke, Putnam and Devitt has been so strong that any semantic theory that has the consequence of assigning disjunctive representational content to the mental states of twins (e.g. [H2O or XYZ]) has been thereby taken to refute itself. Similarly, despite the strength of pre-theoretical intuitions that exact physical replicas like Davidson's Swampman have representational mental states, people have routinely denied that they have any (...) intentional/representational states. I want to focus on a particular brand of causal theory that is not historical, the so-called pure informational or nomic covariance theories, and examine how they propose to handle twin cases and replicas like Swampman. In particular, I will take up Fodor. (shrink)

This is how guidance of behavior to goal grounds and explains cognition and the main forms in which it manages information.

Information is the fuel of cognition. At its most basic level, information is a matter of structures interacting under laws. The notion of information thus reflects the (relational) fact that a structure is created by the impact of another structure. The impacted structure is an encoding, in some concrete form, of the interaction with the impacting structure. Information is, essentially, the structural trace in some system of an interaction with another system; it is also, as a consequence, the structural fuel (...) which drives the impacted system's subsequent processes and behavior. Information takes various forms because the world has many levels of compositional and functional complexity, under different constraints. The key constraints that matter in the understanding of information are natural patterns of organization, or types, and systematic correlations among types, or laws. These level- sensitive constraints, in the form of types and laws, shape the very form in which information is tokened in some structure, that is, the very form in which it is encoded. As a result, the information-producing interactions bring about different sorts of structures, with various sorts of causal effects and functions, whence so many ways in which information is coded and utilized. (shrink)

What is it that one thinks or believes when one thinks or believes something? A mental formula? A sentence in some natural language? Its truth conditions? Or perhaps an abstract proposition? The current story of content is fairly ecumenical. It says that a number of aspects, some mental, other semantic, go into our understanding of content. Yet the current story is incomplete. It leaves out a very important aspect of content, one which I call incremental information. It is information in (...) a specific format, information as a limited or local increment, structured by a number of underlying parameters. It is in the form of such increments that information drives cognition and behavior. This is why, perhaps of all aspects of content, it is incremental information which matters most when we want to understand cognitive attitudes and performances. This in turn must have an impact on our philosophical notions of content, propositional attitudes, inference, justification and knowledge. (shrink)

In this paper, I argue that informational semantics, the most well-known and worked-out naturalistic account of intentional content, conflicts with a fundamental psychological principle about the conditions of belief-formation. Since this principle is an important premise in the argument for informational semantics, the upshot is that the view is self-contradictory??indeed, it turns out to be guilty of a sophisticated version of the fallacy famously committed by Euthyphro in the eponymous Platonic dialogue. Criticisms of naturalistic accounts of content typically proceed piecemeal (...) by narrowly constructed counterexamples, but I argue that the current result is more robust. It affects a broad family of accounts, and provokes a wider doubt about the possibility of successful execution of the naturalistic project. (shrink)

To commit Euthyphro’s fallacy is to endorse a pair of incompatible explanations, one constitutive and the other causal. Asked to explain the nature of piety, Euthyphro hazards that being pious consists in being an object of the gods’ love. But asked what causes the gods to love what they do, he holds with the commonsensical thought that the gods love pious people because they are pious. As Socrates points out (and for reasons we shall shortly rehearse), Euthyphro cannot have it (...) both ways. To hold that one’s god-belovedness is constitutive of one’s status as a pious person is to rule out its being one’s piety that prompts the gods’ affection. More generally, we commit the fallacy when we hold of two properties f and g both of the following: possession of f constitutes possession of g, and possession of g causes possession of f. (shrink)

Philosophers have worried that research on animal mind-reading faces a “logical problem”: the difficulty of experimentally determining whether animals represent mental states (e.g. seeing) or merely the observable evidence for those states (e.g. line-of-gaze). The most impressive attempt to confront this problem has been mounted recently by Robert Lurz (2009, 2011). However, Lurz’ approach faces its own logical problem, revealing this challenge to be a special case of the more general problem of distal content. Moreover, participants in this debate do (...) not appear to agree on criteria for representation. As such, future debate on this question should either abandon the representational idiom or confront differences in underlying semantics. (shrink)

Do psychologists and computer/cognitive scientists mean the same thing by the term `information'? In this essay, I answer this question by comparing information as understood by Gibsonian, ecological psychologists with information as understood in Barwise and Perry's situation semantics. I argue that, with suitable massaging, these views of information can be brought into line. I end by discussing some issues in (the philosophy of) cognitive science and artificial intelligence.

We offer a novel theory of information that differs from traditional accounts in two respects: (i) it explains information in terms of counterfactuals rather than conditional probabilities, and (ii) it does not make essential reference to doxastic states of subjects, and consequently allows for the sort of objective, reductive explanations of various notions in epistemology and philosophy of mind that many have wanted from an account of information.

Mental states differ from most other entities in the world in having semantic or intentional properties: they have meanings, they are about other things, they have satisfaction- or truth-conditions, they have representational content. Mental states are not the only entities that have intentional properties - so do linguistic expressions, some paintings, and so on; but many follow Grice, 1957 ] in supposing that we could understand the intentional properties of these other entities as derived from the intentional properties of mental (...) states (viz., the mental states of their producers). Of course, accepting this supposition leaves us with a puzzle about how the non-derivative bearers of intentional properties (mental states) could have these properties. In particular, intentional properties seem to some to be especially difficult to reconcile with a robust commitment to ontological naturalism - the view that the natural properties, events, and individuals are the only properties, events, and individuals that exist. Fodor puts this intuition nicely in this oft-quoted passage:

I suppose that sooner or later the physicists will complete the catalogue they've been compiling of the
ultimate and irreducible properties of things. When they do, the likes of _spin_, _charm_, and _charge_ will perhaps
appear upon their list. But _aboutness_ surely won't; intentionality simply doesn't go that deep.... If aboutness is
real, it must be really something else ([ Fodor, 1987 ], 97).

Some philosophers have reacted to this clash by giving up one of the two views generating the tension. For example, Churchland, 1981 ] opts for intentional irrealism in order to save ontological naturalism, while. (shrink)

In Book II of the _Essay_, at the beginning of his discussion of language in Chapter II ("Of the Signification of Words"), John Locke writes that we humans have a variety of thoughts which might profit others, but that unfortunately these thoughts lie invisible and hidden from others. And so we use language to communicate these thoughts. As a result, "words, in their primary or immediate signification,stand for nothing but _the ideas in the mind of him that uses them_.

This collection of essays by eminent philosopher Fred Dretske brings together work on the theory of knowledge and philosophy of mind spanning thirty years. The two areas combine to lay the groundwork for a naturalistic philosophy of mind. The fifteen essays focus on perception, knowledge, and consciousness. Together, they show the interconnectedness of Dretske's work in epistemology and his more contemporary ideas on philosophy of mind, shedding light on the links which can be made between the two. The first section (...) of the book argues the point that knowledge consists of beliefs with the right objective connection to facts; two essays discuss this conception of knowledge's implications for naturalism. The next section articulates a view of perception, attempting to distinguish conceptual states from phenomenal states. A naturalized philosophy of mind, and thus a naturalized epistemology, is articulated in the third section. This collection will be a valuable resource for a wide range of philosophers and their students, and will also be of interest to cognitive scientists, psychologists, and philosophers of biology. (shrink)

This book presents an attempt to develop a theory of knowledge and a philosophy of mind using ideas derived from the mathematical theory of communication developed by Claude Shannon. Information is seen as an objective commodity defined by the dependency relations between distinct events. Knowledge is then analyzed as information caused belief. Perception is the delivery of information in analog form (experience) for conceptual utilization by cognitive mechanisms. The final chapters attempt to develop a theory of meaning (or belief content) (...) by viewing meaning as a certain kind of information-carrying role. (shrink)

This paper defends a reference-based approach to concept individuation against the objection that such an approach is unable to make sense of concepts that fail to refer. The main line of thought pursued involves clarifying how the referentialist should construe the relationship between a concept's (referential) content and its role in mental processes. While the central goal of the paper is to defend a view aptly titled Concept Referentialism , broader morals are drawn regarding reference-based approaches in general. The paper (...) closes by calling for a shift in the current debate between referentialists and their opponents. (shrink)

Questions concerning the nature of representation and what representations are about have been a staple of Western philosophy since Aristotle. Recently, these same questions have begun to concern neuroscientists, who have developed new techniques and theories for understanding how the locus of neurobiological representation, the brain, operates. My dissertation draws on philosophy and neuroscience to develop a novel theory of representational content.

This volume collects thirteen papers by one of the leading philosophers of his generation, who died prematurely in 1980.

There is no consensus yet on the definition of semantic information. This paper contributes to the current debate by criticising and revising the Standard Definition of semantic Information (SDI) as meaningful data, in favour of the Dretske-Grice approach: meaningful and well-formed data constitute semantic information only if they also qualify as contingently truthful. After a brief introduction, SDI is criticised for providing necessary but insufficient conditions for the definition of semantic information. SDI is incorrect because truth-values do not supervene on (...) semantic information, and misinformation (that is, false semantic information) is not a type of semantic information, but pseudo-information, that is not semantic information at all. This is shown by arguing that none of the reasons for interpreting misinformation as a type of semantic information is convincing, whilst there are compelling reasons to treat it as pseudo-information. As a consequence, SDI is revised to include a necessary truth-condition. The last section summarises the main results of the paper and indicates some interesting areas of application of the revised definition. (shrink)

The renowned philosopher Jerry Fodor, a leading figure in the study of the mind for more than twenty years, presents a strikingly original theory on the basic constituents of thought. He suggests that the heart of cognitive science is its theory of concepts, and that cognitive scientists have gone badly wrong in many areas because their assumptions about concepts have been mistaken. Fodor argues compellingly for an atomistic theory of concepts, deals out witty and pugnacious demolitions of rival theories, and (...) suggests that future work on human cognition should build upon new foundations. This lively, conversational, and superbly accessible book is the first volume in the Oxford Cognitive Science Series, where the best original work in this field will be presented to a broad readership. Concepts will fascinate anyone interested in contemporary work on mind and language. Cognitive science will never be the same again. (shrink)

In this paper I apply an old problem of Quine's (the inscrutability of reference in translation) to a new style of theory about mental content (causal/nomological/informational accounts of meaning) and conclude that no "naturalization" of content of the sort currently popular can solve Quine's "gavagai" enigma. I show how failure to solve the problem leads to absurd conclusions not about one's own mental life, but about the non-mental world. I discuss various ways of attempting to remedy the accounts so as (...) to avoid the problem and explain why each attempt at solving the problem would take the information theorists further from their self-assigned task of "naturalizing" semantics. (shrink)

In this paper I discuss Fred Dretske's account of knowledge critically, and try to bring out how his account of informational content leads to cases of extreme epistemic good luck in his treatment of knowledge. My main interest, however, is to establish that the cases of epistemic luck arise because Dretske's account of knowledge in a fundamental way fails to take into account the role our actual recognitional capacities and powers of discrimination play in perceptually based knowledge. This result is, (...) I believe, new. The paper has three sections. In Section 1 I give a short exposition of Dretske's theory, and make some necessary qualifications about how it is to be understood. In Section 2 I discuss in greater detail how the theory actually works, and provide some examples I think are very troublesome for Dretske. In Section 3 I argue that these cases establish my main claim. I also show that there are cases of epistemic bad luck due to Dretske's account of how information causes belief. (shrink)

The goal of philosophy of information is to understand what information is, how it operates, and how to put it to work. But unlike ‘information’ in the technical sense of information theory, what we are interested in is meaningful information. To understand the nature and dynamics of information in this sense we have to understand meaning. What we offer here are simple computational models that show emergence of meaning and information transfer in randomized arrays of neural nets. These we take (...) to be formal instantiations of a tradition of theories of meaning as use. What they offer, we propose, is a glimpse into the origin and dynamics of at least simple forms of meaning and information transfer as properties inherent in behavioral coordination across a community. (shrink)

In his Explaining Behavior, Fred Dretske uses a reliabilist theory of representation to try to vindicate the use of intentional explanation for behaviour against latter-day elitninativism. Although Dretske's indicator semantics turns on the notion of function, he himself never explicitly defines what function means. Dretske's reticence in discussing function may ultimately be an error, for, as I argue, his implicit understanding of what a function amounts to does not fit with data from op rant conditioning. Still, this need not be (...) a deep flaw in Dretske and I offer one way in which we may patch up the notion of function via the changes known to occur with learning in the brain. Ultimately, I conclude that the only facts needed to explain behaviour are (1) the conditions in the world that are paired with neuronal circuit activation (as picked out by goals in some circumstances); and (2) what motor output that condition triggers. (shrink)

Naturalistic theories of content and whether or not reason-giving explanations of human behavior are causal explanations have been central topics in recent philosophy of mind. Fred Dretske, in his book Explaining Behavior, attempts to construct a naturalistic theory of the contents of beliefs and desires that gives these mental states an important role in the causation of behavior. Even if Dretske is granted that the theory adequately accounts for individual behaviors the theory still faces problems in offering an adequate account (...) of important features of extended sequences of behavior. Some sequences of behavior exhibit coherence in the sense that the elements of the sequence either contribute to the atttainment of a goal state or only make sense on the supposition that the goal state will be attained. Two ways of attaining coherence are distinguished. In chaining behavior coherence is guaranteed by the fit between the internal structure of the organism and the structure of the external environment. In other cases of coherence chaining is not available as an explanation. It is argued that Dretske. (shrink)

Full understanding ofrepresentation requires both an accountofrepresentational content and of reference. Fred Dretske has proposed a powerful theory of representational content, the teleological theory of indicator functions. And he has indicated that he thinks an informational account of reference is basically correct. According to this account, reference is determined by a certain informational relation, the relation of carrying primary information about an object. However, a closer examination will show that the informational account cannot adequately deal with our intuitions about certain (...) cases of illusion. In these cases, the informational account will lead to an unwelcome loss of the referential object. For reasons of causal underdetermination, a purely causal account of reference will not work either. So ultimately, the informational account has to be replaced by a mixed account that relies both on satisfaction (of representational content) and a causal relation. This means that the turn away from an informational theory of representational content to a teleological theory has to be accompanied by a corresponding turn away from the informational theory of reference to the mixed causal-satisfactional theory. (shrink)

The main thesis of this paper is twofold. In the first half of the paper, (§§1-2), I argue that there are two notions of mental representation, which I call objective and subjective. In the second part (§§3-7), I argue that this casts familiar tracking theories of mental representation as incomplete: while it is clear how they might account for objective representation, they at least require supplementation to account for subjective representation.

The main aim of this work is to contribute tothe elucidation of the concept of informationby comparing three different views about thismatter: the view of Fred Dretske's semantictheory of information, the perspective adoptedby Peter Kosso in his interaction-informationaccount of scientific observation, and thesyntactic approach of Thomas Cover and JoyThomas. We will see that these views involvevery different concepts of information, eachone useful in its own field of application. This comparison will allow us to argue in favorof a terminological `cleansing': it (...) is necessaryto make a terminological distinction among thedifferent concepts of information, in order toavoid conceptual confusions when the word`information' is used to elucidate relatedconcepts as knowledge, observation orentropy. (shrink)

It is a live possibility that certain of our experiences reliably misrepresent the world around us. I argue that tracking theories of mental representation (e.g. those of Dretske, Fodor, and Millikan) have difficulty allowing for this possibility, and that this is a major consideration against them.

"According to informational semantics, if it's necessary that a creature can't distinguish Xs from Ys, it follows that the creature can't have a concept that applies to Xs but not Ys." (Jerry Fodor, The Elm and the Expert, p.32).

Fred Dretske's "Knowledge and the Flow of Information" is an extended attempt to develop a philosophically useful theory of information. Dretske adapts central ideas from Shannon and Weaver's mathematical theory of communication, and applies them to some traditional problems in epistemology. In doing so, he succeeds in building for philosophers a much-needed bridge to important work in cognitive science. The pay-off for epistemologists is that Dretske promises a way out of a long-standing impasse -- the Gettier problem. He offers an (...) alternative model of knowledge as information-based belief, which purports to avoid the problems justificatory accounts face. This essay looks closely at Dretske's theory. I argue that while the information-theoretic framework is attractive, it does not provide an adequate account of knowledge. And there seems to be no way of tightening the theory without introducing some version of a theory of justification -- the very notion Dretske's theory was designed to avoid. (shrink)

In this paper I discuss critically Stalnaker's views on content.

The constructive reformulation of the semantic theory suggests two basic principles to be assumed: first, the distinction between proper knowledge, expressed in judgemental form, and the assertion conditions for such knowledge; second, ...

One of the most important objections to information-based semantic theories is that they are incapable of explaining Frege cases. The worry is that if a concept’s intentional content is a function of its informational content, as such theories propose, then it would appear that coreferring expressions have to be synonymous, and if this is true, it’s difficult to see how an agent could believe that a is F without believing that b is F whenever a and b are identical. I (...) argue that this appearance is deceptive. If we heed the distinction between the analog and digital contents of a signal, it is actually possible to reconstruct something akin to Frege’s sense/reference distinction in purely information-theoretic terms. This allows informational semanticists to treat coreferring expressions as semantically distinct and to solve Frege cases in the same way that Frege did—namely, by appealing to the different contents of coreferring expressions. (shrink)

John is currently thinking that the sun is bright. Consider his occurrent belief or judgement that the sun is bright. Its content is that the sun is bright. This is a truth- evaluable content (which shall be our main concern) because it is capable of being true or false. In virtue of what natural, scientifically accessible facts does John’s judgement have this content? To give the correct answer to that question, and to explain why John’s judgement and other contentful mental (...) states have the contents they do in virtue of such facts, would be to naturalize mental content. (shrink)

In Knowledge and the Flow of Information, Fred Dretske explains representational content by appealing to natural indication: a mental representation has its content in virtue of being a reliable natural indicator of a particular type of state of the world. His account fails for several reasons, not the least of which is that it cannot account for misrepresentation. Recognizing this, Dretske adds a twist in his more recent work on representational content (sketched in 'Misrepresentation' and elaborated in Explaining Behavior): a (...) mental representation acquires its semantic content when the fact that it naturally indicates some type of state of the world acquires explanatory relevance. This shift in emphasis from natural indication to function (and, so, to behaviour) is intended to address the disjunction problem. Whether or not it succeeds (I argue that it does not), new problems emerge as a direct result of the shift to emphasis on behaviour. First, although Dretske appeals to appropriate response behaviours for particular types of representations, it is not at all clear that such behaviours exist. Second, Dretske's theory cannot account for representations that never figure in the behaviour of the organism of which they are a part. In response to these problems, I suggest two possible routes to recovery: one, an appeal to implicit beliefs (or dispositions); and, two, an appeal to compositionality. Although it seems clear that Dretske must enlist one of these options if he is to formulate a successful causal naturalist theory of representational content, given his theoretical commitments, neither option is readily available to him. (shrink)

Jerry Fodor has charged that Fred Dretske's account of content suffers from indeterminacy to the extent that we should reject it in favor of Fodor‘s own account. In this paper, we ask what the problem of indeterminacy really is; we distinguish a relatively minor problem we call ‘looseness of fit’ from a major problem of failing to show how to point to what is not there. We sketch Dretske's account of content and how it is supposed to solve the major (...) problem. After presenting Fodor's challenge as the claim that Dretske has failed to solve the major problem, we articulate a response available to Dretske. Although we do not think the response is ultimately successful, we argue that it is every bit as good as the response Fodor has offered to a similar challenge, in his so-called ‘mixed theory.’ The upshot is this: despite advertisements to the contrary, Fodor's theory, in its mixed version, offers no real advantages over Dretske's regarding the serious problem of indeterminacy. (shrink)

Information theoretic semantics proposes to construe predicate reference in terms of nomological relations between distal properties and properties of representational mental events. Research on the model has largely concentrated on the problem of choosing the nomological relation in terms of which distal properties are to be singled out. I argue that, in addition to this, an information theoretic account has to provide a specification of which properties of representational mental events will play a role in determining reference, qua bearers of (...) nomological relations. I contend that this task poses a serious additional challenge to the viability of the model. (shrink)