Abstract
The past decade has witnessed the emergence of a novel stance on semantic representation, and its relationship to context sensitivity. Connectionist-minded philosophers, including Clark and van Gelder, have espoused the merits of viewing hidden-layer, context-sensitive representations as possessing semantic content, where this content is partially revealed via the representations' position in vector space. In recent work, Bodén and Niklasson have incorporated a variant of this view of semantics within their conception of semantic systematicity. Moreover, Bodén and Niklasson contend that they have produced experimental results which not only satisfy a kind of context-based, semantic systematicity, but which, to the degree that reality permits, effectively deals with challenges posed by Fodor and Pylyshyn (1988), and Hadley (1994a). The latter challenge involved well-defined criteria for strong semantic systematicity. This paper examines the relevant claims and experiments of Bodén and Niklasson. It is argued that their case fatally involves two fallacies of equivocation; one concerning 'semantic content' and the other concerning 'novel test sentences'. In addition, it is argued that their ultimate construal of context sensitive semantics contains serious confusions. These confusions are also found in certain publications dealing with "latent semantic analysis". Thus, criticisms presented here have relevance beyond the work of Bodén and Niklasson.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bodén, M. and Niklasson, L. (2000), 'Semantic Systematicity and Context in Connectionist Networks', Connection Science 12, pp. 111–142.
Clark, A. (1993), Associative Engines, Cambridge, MA: MIT Press.
Elman, J. (1990), 'Finding Structure in Time', Cognitive Science 14, pp. 179–212.
Fodor, J.A. and Pylyshyn, Z.W. (1988), 'Connectionism and Cognitive Architecture: A Critical Analysis', Cognition 28, pp. 3–71.
Hadley, R.F. (2002), 'Systematicity in Connectionist Generalization', in M.A. Arbib, ed., The Handbook of Brain Theory and Neural Networks, second edition, Cambridge, MA: MIT Press.
Hadley, R.F. (1994a), 'Systematicity in Connectionist Language Learning', Mind and Language 9, pp. 247–272.
Hadley, R.F. (1994b), 'Systematicity Revisited', Mind and Language 9, pp. 431–444.
Hadley, R.F. (1992), 'Compositionality and Systematicity in Connectionist Language Learning', in Proceedings of the Fourteenth Annual Conference of the Cognitive Science Society, Bloomington, IN: Lawrence Erlbaum Associates, pp. 659–664.
Hadley, R.F. (1989), 'A Default-Based Theory of Procedural Semantics', Cognitive Science 13, pp. 107–137.
Hadley, R.F., Rotaru-Varga, A., Arnold, D.V. and Cardei, V.C. (2001), 'Syntactic Systematicity Arising from Semantic Predictions in a Hebbian-Competitive Network', Connection Science 13, pp. 73–94.
Hadley, R.F. and Hayward, M.B. (1997), 'Strong Semantic Systematicity from Hebbian Connectionist Learning', Minds and Machines 7, pp. 1–37.
Horgan, T. and Tiensen, J. (1996), Connectionsim and the Philosophy of Psychology, Cambridge, MA: MIT Press.
Landauer, T.K. and Dumais, S.T. (1997), 'A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge', Psychological Review 104, pp. 211–240.
Marcus, G. (2001), The Algebraic Mind, Cambridge, MA: MIT Press.
Niklasson, L.F. and van Gelder, T. (1994), 'On Being Systematically Connectionist', Mind and Language 9, pp. 288–302.
Pollack, J.B. (1990), 'Recursive Distributed Representations', Artificial Intelligence 46, pp. 77–105.
Phillips, S. (1994), 'Strong Systematicity within Connectionism: The Tensor-Recurrent Network', in Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society, Hillsdale, NJ: Lawrence Erlbaum Associates, pp. 723–727.
St. John, M.F. and McClelland, J.L. (1990), 'Learning and Applying Contextual Constraints in Sentence Comprehension', Artificial Intelligence 46, pp. 217–257.
van Gelder, T. (1991), 'What Is the 'D' in 'PDP'? A Survey of the Concept of Distribution', in W. Ramsey, S. Stich and D.E. Rumelhart, eds., Philosophy and Connectionist Theory, Hillsdale, NJ: Lawrence Erlbaum Associates, pp. 33–60.
van Heijenoort, J. (1967), 'Gödel's Theorem', in Encyclopedia of Philosophy, Vol. 3, New York: MacMillan Publishing, pp. 348–357.
Wiemer-Hastings, P. and Zipitria, I. (2001), 'Rules for Syntax, Vectors for Semantics', in Proceedings of the Twenty-Third Annual Conference of the Cognitive Science Society, Hillsdale, NJ: Lawrence Erlbaum Associates, pp. 1112–1117.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Hadley, R.F. On The Proper Treatment of Semantic Systematicity. Minds and Machines 14, 145–172 (2004). https://doi.org/10.1023/B:MIND.0000021693.67203.46
Issue Date:
DOI: https://doi.org/10.1023/B:MIND.0000021693.67203.46