Skip to main content
Log in

Information and Meaning: Use-Based Models in Arrays of Neural Nets

  • Published:
Minds and Machines Aims and scope Submit manuscript

Abstract

The goal of philosophy of information is to understand what information is, how it operates, and how to put it to work. But unlike ‘information’ in the technical sense of information theory, what we are interested in is meaningful information. To understand the nature and dynamics of information in this sense we have to understand meaning. What we offer here are simple computational models that show emergence of meaning and information transfer in randomized arrays of neural nets. These we take to be formal instantiations of a tradition of theories of meaning as use. What they offer, we propose, is a glimpse into the origin and dynamics of at least simple forms of meaning and information transfer as properties inherent in behavioral coordination across a community.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Ackley, D. and Littman, M. (1994), ‘Altruism in the Evolution of Communication’, in R.A. Brooks and P. Maes, eds., Artificial Life IV: Proceedings of the Fourth International Workshop on the Synthesis and Simulation of Living Systems, Cambridge, MA: MIT Press, pp. 40–48.

    Google Scholar 

  • Aristotle (c 330 BC), De Interpretatione, in R. McKeon, ed., Basic Works of Aristotle, New York: Random House, 1971.

    Google Scholar 

  • Augustine (c 400) Confessions, in J.J. O'Donnell, ed., Oxford: Oxford University Press, 1992.

    Google Scholar 

  • Batali, J. (1995), ‘Small Signaling Systems Can Evolve in the Absence of Benefit to the Information Sender’, unpublished.

  • Cangelosi, A., and Parisi, D. (1998), ‘The Emergence of a ‘Language’ in an Evolving Population of Neural Networks’, Connection Science 10, pp. 83–97.

    Google Scholar 

  • Cariani, P. (1991), ‘Emergence and Artificial Life’, in C. Langton, C. Taylor, J. D. Farmer and S. Rasmussen, eds., Artificial Life II, SFI Studies in the Sciences of Complexity, vol. X, Reading, MA: Addison-Wesley, pp. 775–797.

    Google Scholar 

  • Chalmers, D., 1990, ‘Thoughts on Emergence’, http://www.u.arizona.edu/~chalmers/notes/emergence.html.

  • Davidson, D. (1967), ‘Truth and Meaning’, Synthese 17, pp. 304–323.

    Google Scholar 

  • Dawkins, R. (1976), The Selfish Gene, Oxford: Oxford University Press.

    Google Scholar 

  • de Saussure, F. (1916), Cours de Linguistique Generale, Trans. as Course in General Linguistics, R. Harris, trans., Duckworth, 1983.

  • Fausett, L. (1994), Fundamentals of Neural Networks, Prentice-Hall.

  • Fodor, J. (1975), The Language of Thought, New York: Crowell.

    Google Scholar 

  • Frege, G. (1879), Begriffsschrift, in Jean van Heijenoort, ed., From Frege to Gödel: A Source Book in Mathematical Logic, 1879–1931, Harvard University Press, 1967.

  • Grim, P. (1995), ‘Greater Generosity in the Spatialized Prisoner's Dilemma’, Journal of Theoretical Biology 173, pp. 353–359.

    Google Scholar 

  • Grim, P. (1996), ‘Spatialization and Greater Generosity in the Stochastic Prisoner's Dilemma’, Biosystems 37, pp. 3–17.

    Google Scholar 

  • Grim, P., Mar, G. and St. Denis, P. (1998), The Philosophical Computer: Exploratory Essays in Philosophical Computer Modeling, MIT Press/Bradford Books.

  • Grim, P., Kokalis, T., Tafti, A., and Kilb, N. (2000), ‘Evolution of Communication in Perfect and Imperfect Worlds’, World Futures: The Journal of General Evolution 56, pp. 179–197.

    Google Scholar 

  • Grim, P., Kokalis, T., and Kilb, N. (2001), ‘Evolution of Communication with a Spatialized Genetic Algorithm’, Evolution of Communication 3, pp. 105–134.

    Google Scholar 

  • Grim, P., St. Denis, P. and Kokalis, T. (2002), ‘Learning to Communicate: The Emergence of Signaling in Spatialized Arrays of Neural Nets’, Adaptive Behavior 10, pp. 45–70.

    Google Scholar 

  • Grim, P., Wardach, S. and Beltrani, V. (2003), ‘Location, Location, Location: The Importance of Spatialization in Modeling Cooperation and Communication’, Research Report #03-01, Group for Logic & Formal Semantics, Dept. of Philosophy, SUNY at Stony Brook.

  • Hobbes, T. (1651), Leviathan, in R.E. Flathman and D. Johnston, eds., Norton Critical Edition, 1997.

  • Hutchins, E. and Hazlehurst, B. (1991), ‘Learning in the Cultural Process’, in C. G. Langton, C. Taylor, J. D. Farmer and S. Rasmussen, eds., Artificial Life II, SFI Studies in the Sciences of Complexity, vol. X, Reading, MA: Addison-Wesley, pp. 689–708.

    Google Scholar 

  • Hutchins, E. and Hazlehurst, B. (1995), ‘How To Invent a Lexicon: The Development of Shared Symbols in Interaction’, in N. Gilbert and R. Conte, eds., Artificial Socities: The Computer Simulation of Social Life, UCL Press, pp. 157–189.

  • Larson, R. and Segal, G. (1995), Knowledge of Meaning: An Introduction to Semantic Theory, Cambridge, MA: MIT Press/Bradford Books.

    Google Scholar 

  • Levin, M. (1995), ‘The Evolution of Understanding: A Genetic Algorithm Model of the Evolution of Communication’, BioSystems 36, pp. 167–178.

    Google Scholar 

  • Lewis, D. (1969), Convention: A Philosophical Study, Harvard University Press.

  • Locke, J. (1689), Essay Concerning Human Understanding, in Peter H. Nidditch, ed., Oxford University Press, 1979.

  • Ludlow, P., ed. (1997), Readings in the Philosophy of Language, MIT Press/Bradford Books.

  • MacLennan, B.J. (1991), ‘Synthetic Ethology: An Approach to the Study of Communication’, in C. G. Langton, C. Taylor, J. D. Farmer and S. Rasmussen, eds., Artificial Life III, SFI Studies in the Sciences of Complexity, vol. X, Reading, MA: Addison-Wesley, pp. 631–655.

    Google Scholar 

  • MacLennan, B.J. and Burghardt, G.M. (1994), ‘Synthetic Ethology and the Evolution of Cooperative Communication’, Adaptive Behavior 2, pp. 161–188.

    Google Scholar 

  • McClelland, J. L. and Rumelhart, D.E. (1988), Explorations in Parallel Distributed Processing, Cambridge, MA: MIT Press.

    Google Scholar 

  • Mill, J.S. (1884), A System of Logic, Ratiocinative and Inductive, Being a Connected View of the Principles of Evidence and the Methods of Scientific Investigation, London: Longmans, Green, and Co.

    Google Scholar 

  • Minsky, M. and Papert, S. (1969, 1990), Perceptrons: An Introduction to Computational Geometry, Cambridge, MA: MIT Press.

    Google Scholar 

  • Noble, J. and Cliff, D. (1996), ‘On Simulating the Evolution of Communication’, in P. Maes, M. Mataric, J. Meyer, J. Pollack and S. Wilson, eds., From Animals to Animats 4: Proceedings of the Fourth International Conference on Simulation of Adaptive Behavior, MIT Press, pp. 608–617.

  • Nowak, M.A., Plotkin, J.B. and Krakauer, D.C. (1999), ‘The Evolutionary Language Game’, Journal of Theoretical Biology 200, pp. 147–162.

    Google Scholar 

  • Nowak, M.A., Plotkin, J.B. and Jansen, V.A. (2000), ‘The Evolution of Syntactic Communication’, Nature 404, pp. 495–498.

    Google Scholar 

  • Nowak, M.A. and Sigmund, K. (1990), ‘The Evolution of Stochastic Strategies in the Prisoner's Dilemma’, Acta Applicandae Mathematicae 20, pp. 247–265.

    Google Scholar 

  • Nowak, M.A. and Sigmund, K. (1992) ‘Tit for Tat in Heterogeneous Populations’, Nature 355, pp. 250–252.

    Google Scholar 

  • Oliphant, M. and Batali, J. (1997) ‘Learning and the Emergence of Coordinated Communication’, Center for Research on Language Newsletter 11(1).

  • Parisi, D. (1997), ‘An Artificial Life Approach to Language’, Brain and Language 59, pp. 121–146.

    Google Scholar 

  • Quine, W.V.O. (1960), Word and Object, Cambridge, MA: MIT Press

    Google Scholar 

  • Rosenblatt, F. (1962), Principles of Neurodynamics, New York: Spartan Press.

    Google Scholar 

  • Russell, B. (1921), The Analysis of Mind, London: George Allen & Unwin.

    Google Scholar 

  • Russell, B. (1940), An Inquiry into Meaning and Truth, London: George Allen & Unwin.

    Google Scholar 

  • Saunders, G.M. and Pollack, J.B. (1996), ‘The Evolution of Communication Schemes Over Continuous Channels’, in P. Maes, M. Mataric, J. Meyer, J. Pollack and S. Wilson, eds., From Animals to Animats 4: Proceedings of the Fourth International Conference on Simulation of Adaptive Behavior, MIT Press, pp. 580–589.

  • Shannon, C. (1949), The Mathematical Theory of Communication, University of Illinois Press.

  • Shelley, M. (1831), Frankenstein, Everyman's Library, 1922.

  • Skyrms, B. (1996), Evolution of the Social Contract, Cambridge University Press.

  • Steels, Luc (1996), ‘Emergent Adaptive Lexicons’, in P. Maes, M. Mataric, J. Meyer, J. Pollack, and S. Wilson, eds., From Animals to Animats 4: Proceedings of the Fourth International Conference on Simulation of Adaptive Behavior, MIT Press, pp. 562–567.

  • Steels, L. (1998), ‘Synthesizing the Origins of Language and Meaning Using Co-Evolution, Self-Organization and Level Formation’, in J. R. Hurford, M. Studdert-Kennedy and C. Knight, eds., Approaches to the Evolution of Language: Social and Cognitive Bases, Cambridge University Press, pp. 384–404.

  • Wagner, Kyle (2000), ‘Cooperative Strategies and the Evolution of Communication’, Artificial Life 6, pp. 149–179.

    Google Scholar 

  • Werner, G. and Dyer, M. (1991), ‘Evolution of Communication in Artificial Organisms’, in C. G. Langton, C. Taylor, J. D. Farmer, and S. Rasmussen, eds., Artificial Life II, SFI Studies in the Sciences of Complexity, vol. X, Addison-Wesley, pp. 659–687.

  • White, H. (1990), ‘Connectionist Nonparametric Regression: Multilayer Feedforward Networks Can Learn Arbitrary Mappings’, Neural Networks 5, pp. 535–549.

    Google Scholar 

  • Wittgenstein, L. (1953), Philosophical Investigations, Macmillan.

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Grim, P., Denis, P.S. & Kokalis, T. Information and Meaning: Use-Based Models in Arrays of Neural Nets. Minds and Machines 14, 43–66 (2004). https://doi.org/10.1023/B:MIND.0000005135.23580.9a

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/B:MIND.0000005135.23580.9a

Keywords

Navigation