This article explicates the interaction between implicit and explicit processes in skill learning, in contrast to the tendency of researchers to study each type in isolation. It highlights various effects of the interaction on learning (including synergy effects). The authors argue for an integrated model of skill learning that takes into account both implicit and explicit processes. Moreover, they argue for a bottom-up approach (first learning implicit knowledge and then explicit knowledge) in the integrated model. A variety of qualitative data (...) can be accounted for by the approach. A computational model, CLARION, is then used to simulate a range of quantitative data. The results demonstrate the plausibility of the model, which provides a new perspective on skill learning. (PsycINFO Database Record (c) 2012 APA, all rights reserved). (shrink)

Synthesizing situated cognition, reinforcement learning, and hybrid connectionist modeling, a generic cognitive architecture focused on situated involvement and interaction with the world is developed in this book. The architecture notably incorporates the distinction of implicit and explicit processes.

This article proposes a unified framework for understanding creative problem solving, namely, the explicit–implicit interaction theory. This new theory of creative problem solving constitutes an attempt at providing a more unified explanation of relevant phenomena (in part by reinterpreting/integrating various fragmentary existing theories of incubation and insight). The explicit–implicit interaction theory relies mainly on 5 basic principles, namely, (a) the coexistence of and the difference between explicit and implicit knowledge, (b) the simultaneous involvement of implicit and explicit processes in most (...) tasks, (c) the redundant representation of explicit and implicit knowledge, (d) the integration of the results of explicit and implicit processing, and (e) the iterative (and possibly bidirectional) processing. A computational implementation of the theory is developed based on the CLARION cognitive architecture and applied to the simulation of relevant human data. This work represents an initial step in the development of process-based theories of creativity encompassing incubation, insight, and various other related.. (shrink)

This book is a definitive reference source for the growing, increasingly more important, and interdisciplinary field of computational cognitive modeling, that is, computational psychology. It combines breadth of coverage with definitive statements by leading scientists in this field. Research in computational cognitive modeling explores the essence of cognition through developing detailed, process-based understanding by specifying computational mechanisms, structures, and processes. Computational models provide both conceptual clarity and precision at the same time. This book substantiates this approach through overviews and many (...) examples. (shrink)

It is highly likely that, to achieve full human–machine symbiosis, truly intelligent cognitive systems—human-like —may have to be developed first. Such systems should not only be capable of performing human-like thinking, reasoning, and problem solving, but also be capable of displaying human-like motivation, emotion, and personality. In this opinion article, I will argue that such systems are indeed possible and needed to achieve true and full symbiosis with humans. A computational cognitive architecture is used in this article to illustrate, in (...) a preliminary way, what can be achieved in this regard. It is shown that Clarion involves complex structures, representations, and mechanisms, and is capable of capturing human cognitive performance as well as human motivation, emotion, personality, and other relevant aspects. It is further argued that the cognitive architecture can enable and facilitate true human–machine symbiosis. (shrink)

This paper discusses essential motivational representations necessary for a comprehensive computational cognitive architecture. It hypothesizes the need for implicit drive representations, as well as explicit goal representations. Drive representations consist of primary drives — both low-level primary drives (concerned mostly with basic physiological needs) and high-level primary drives (concerned more with social needs), as well as derived (secondary) drives. On the basis of drives, explicit goals may be generated on the fly during an agent’s interaction with various situations. These motivational (...) representations help to make cognitive architectural models more comprehensive and provide deeper explanations of psychological processes. This work represents a step forward in making computational cognitive architectures better reflections of the human mind and all its motivational complexity and intricacy. (shrink)

This paper explores the interaction between implicit and explicit processes during skill learning, in terms of top-down learning (that is, learning that goes from explicit to implicit knowledge) versus bottom-up learning (that is, learning that goes from implicit to explicit knowledge). Instead of studying each type of knowledge (implicit or explicit) in isolation, we stress the interaction between the two types, especially in terms of one type giving rise to the other, and its effects on learning. The work presents an (...) integrated model of skill learning that takes into account both implicit and explicit processes and both top-down and bottom-up learning. We examine and simulate human data in the Tower of Hanoi task. The paper shows how the quantitative data in this task may be captured using either top-down or bottom-up approaches, although top-down learning is a more apt explanation of the human data currently available. These results illustrate the two different directions of learning (top-down versus bottom-up), and thereby provide a new perspective on skill learning. Ó 2003 Elsevier B.V. All rights reserved. (shrink)

This paper compares two theories and their two corresponding computational models of human moral judgment. In order to better address psychological realism and generality of theories of moral judgment, more detailed and more psychologically nuanced models are needed. In particular, a motivationally based theory of moral judgment is developed in this paper that provides a more accurate account of human moral judgment than an existing emotion-reason conflict theory. Simulations based on the theory capture and explain a range of relevant human (...) data. They account not only for the original data that were used to support the emotion–reason conflict theory, but also for a wider range of data and phenomena. (shrink)

This article explores the view that computational models of cognition may constitute valid theories of cognition, often in the full sense of the term ‘‘theory”. In this discussion, this article examines various (existent or possible) positions on this issue and argues in favor of the view above. It also connects this issue with a number of other relevant issues, such as the general relationship between theory and data, the validation of models, and the practical benefits of computational modeling. All the (...) discussions point to the position that computational cognitive models can be true theories of cognition. Ó 2008 Elsevier B.V. All rights reserved. (shrink)

_role, especially in learning, and through devising hybrid neural network models that (in a qualitative manner) approxi-_ _mate characteristics of human consciousness. In doing so, the paper examines explicit and implicit learning in a variety_ _of psychological experiments and delineates the conscious/unconscious distinction in terms of the two types of learning_ _and their respective products. The distinctions are captured in a two-level action-based model C_larion_. Some funda-_ _mental theoretical issues are also clari?ed with the help of the model. Comparisons with (...) existing models of conscious-_. (shrink)

Most of the work in agent-based social simulation has assumed highly simplified agent models, with little attention being paid to the details of individual cognition. Here, in an effort to counteract that trend, we substitute a realistic cognitive agent model (CLARION) for the simpler models previously used in an organizational design task. On that basis, an exploration is made of the interaction between the cognitive parameters that govern individual agents, the placement of agents in different organizational structures, and the performance (...) of the organization. It is suggested that the two disciplines, cognitive modeling and social simulation, which have so far been pursued in relative isolation from each other, can be profitably integrated. (shrink)

The article first addresses the importance of cognitive modeling, in terms of its value to cognitive science (as well as other social and behavioral sciences). In particular, it emphasizes the use of cognitive architectures in this undertaking. Based on this approach, the article addresses, in detail, the idea of a multi-level approach that ranges from social to neural levels. In physical sciences, a rigorous set of theories is a hierarchy of descriptions/explanations, in which causal relationships among entities at a high (...) level can be reduced to causal relationships among simpler entities at a more detailed level. We argue that a similar hierarchy makes possible an equally productive approach toward cognitive modeling. The levels of models that we conceive in relation to cognition include, at the highest level, sociological/anthropological models of collective human behavior, behavioral models of individual performance, cognitive models involving detailed mechanisms, representations, and processes, as well as biological/physiological models of neural circuits, brain regions, and other detailed biological processes. (shrink)

This article addresses issues in developing cognitive architectures--generic computational models of cognition. Cognitive architectures are believed to be essential in advancing understanding of the mind, and therefore, developing cognitive architectures is an extremely important enterprise in cognitive science. The article proposes a set of essential desiderata for developing cognitive architectures. It then moves on to discuss in detail some of these desiderata and their associated concepts and ideas relevant to developing better cognitive architectures. It argues for the importance of taking (...) into full consideration these desiderata in developing future architectures that are more cognitively and ecologically realistic. A brief and preliminary evaluation of existing cognitive architectures is attempted on the basis of these ideas. (shrink)

This paper argues for an explanation of the mechanistic (computational) basis of consciousness that is based on the distinction between localist (symbolic) representation and distributed representation, the ideas of which have been put forth in the connectionist literature. A model is developed to substantiate and test this approach. The paper also explores the issue of the functional roles of consciousness, in relation to the proposed mechanistic explanation of consciousness. The model, embodying the representational difference, is able to account for the (...) functional role of consciousness, in the form of the synergy between the conscious and the unconscious. The fit between the model and various cognitive phenomena and data (documented in the psychological literatures) is discussed to accentuate the plausibility of the model and its explanation of consciousness. Comparisons with existing models of consciousness are made in the end. (shrink)

Research in computational cognitive modeling investigates the nature of cognition through developing process-based understanding by specifying computational models of mechanisms (including representations) and processes. In this enterprise, a cognitive architecture is a domaingeneric computational cognitive model that may be used for a broad, multiple-level, multipledomain analysis of behavior. It embodies generic descriptions of cognition in computer algorithms and programs. Developing cognitive architectures is a difficult but important task. In this article, discussions of issues and challenges in developing cognitive architectures will (...) be undertaken, and an example cognitive architecture (CLARION) will be described. (shrink)

This paper addresses weighting and partitioning in complex reinforcement learning tasks, with the aim of facilitating learning. The paper presents some ideas regarding weighting of multiple agents and extends them into partitioning an input/state space into multiple regions with di erential weighting in these regions, to exploit di erential characteristics of regions and di erential characteristics of agents to reduce the learning complexity of agents (and their function approximators) and thus to facilitate the learning overall. It analyzes, in reinforcement learning (...) tasks, di erent ways of partitioning a task and using agents selectively based on partitioning. Based on the analysis, some heuristic methods are described and experimentally tested. We nd that some o -line heuristic methods performed the best, signi cantly better than single-agent models. (shrink)

In the current research on multi-agent systems (MAS), many theoretical issues related to sociocultural processes have been touched upon. These issues are in fact intellectually profound and should prove to be significant for MAS. Moreover, these issues should have equally significant impact on cognitive science, if we ever try to understand cognition in the broad context of sociocultural environments in which cognitive agents exist. Furthermore, cognitive models as studied in cognitive science can help us in a substantial way to better (...) probe multi-agent issues, by taking into account essential characteristics of cognitive agents and their various capacities. In this paper, we systematically examine the interplay among social sciences, MAS, and cognitive science. We try to justify an integrated approach for MAS which incorporates different perspectives. We show how a new cognitive model, CLARION, can embody such an integrated approach through a combination of autonomous learning and assimilation. (shrink)

Symbols should be grounded, as has been argued before. But we insist that they should be grounded not only in subsymbolic activities, but also in the interaction between the agent and the world. The point is that concepts are not formed in isolation (from the world), in abstraction, or "objectively." They are formed in relation to the experience of agents, through their perceptual/motor apparatuses, in their world and linked to their goals and actions. This paper takes a detailed look at (...) this relatively old issue, with a new perspective, aided by our work of computational cognitive model development. To further our understanding, we also go back in time to link up with earlier philosophical theories related to this issue. The result is an account that extends from computational mechanisms to philosophical abstractions. (shrink)

This paper introduces a hybrid model that unifies connectionist, symbolic, and reinforcement learning into an integrated architecture for bottom-up skill learning in reactive sequential decision tasks. The model is designed for an agent to learn continuously from on-going experience in the world, without the use of preconceived concepts and knowledge. Both procedural skills and high-level knowledge are acquired through an agent’s experience interacting with the world. Computational experiments with the model in two domains are reported.

ABSTRACTThis article focuses on the relationship between cultural and cognitive-psychological processes, and discusses the potential impact of the cognitive sciences on understand...

This paper describes how meta-cognitive processes (i.e., the self monitoring and regulating of cognitive processes) may be captured within a cognitive architecture Clarion. Some currently popular cognitive architectures lack sufficiently complex built-in meta-cognitive mechanisms. However, a sufficiently complex meta-cognitive mechanism is important, in that it is an essential part of cognition and without it, human cognition may not function properly. We contend that such a meta-cognitive mechanism should be an integral part of a cognitive architecture. Thus such a mechanism has (...) been developed within the Clarion cognitive architecture. The paper demonstrates how human data of two meta-cognitive experiments are simulated using Clarion. The simulations show that the meta-cognitive processes represented by the experimental data (and beyond) can be adequately captured within the Clarion framework. (shrink)

Learners are able to use 2 different types of knowledge to perform a skill. One type is a conscious mental model, and the other is based on memories of instances. The authors conducted 3 experiments that manipulated training conditions designed to affect the availability of 1 or both types of knowledge about an artificial grammar. Participants were tested for both speed and accuracy of their ability to generate letter sequences. Results indicate that model-based training leads to slow accurate responding. Memorybased (...) training leads to fast, less accurate responding and highest achievement when perfect accuracy was not required. Evidence supports participants’ preference for using the memory-based mode when exposed to both types of training. Finally, the accuracy contributed by model-based training declined over a retention interval. (shrink)

We present a skill learning model CLARION. Different from existing models of high-level skill learning that use a topdown approach (that is, turning declarative knowledge into procedural knowledge), we adopt a bottom-up approach toward low-level skill learning, where procedural knowledge develops first and declarative knowledge develops later. CLAR- ION is formed by integrating connectionist, reinforcement, and symbolic learning methods to perform on-line learning. We compare the model with human data in a minefield navigation task. A match between the model and (...) human data is found in several respects. (shrink)

This paper aims to explore mechanistic and teleological explanations of consciousness. In terms of mechanistic explanations, it critiques various existing views, especially those embodied by existing computational cognitive models. In this regard, the paper argues in favor of the explanation based on the distinction between localist (symbolic) representation and distributed representation (as formulated in the connectionist literature), which reduces the phenomenological difference to a mechanistic difference. Furthermore, to establish a teleological explanation of consciousness, the paper discusses the issue of the (...) functional role of consciousness on the basis of the aforementioned mechanistic explanation. A proposal based on synergistic interaction between the conscious and the unconscious is advanced that encompasses various existing views concerning the functional role of consciousness. This two-step deepening explanation has some empirical support, in the form of a cognitive model and various cognitive data that it captures. © 2001 Elsevier Science B.V. All rights reserved. (shrink)

This paper explores an approach for autonomous generation of symbolic representations from an agent's subsymbolic activities within the agent-environment interaction. The paper describes a psychologically plausible general framework and its various methods for autonomously creating symbolic representations. The symbol generation is accomplished within, and is intrinsic to, a generic and comprehensive cognitive architecture for capturing a wide variety of psychological processes (namely, CLARION). This work points to ways of obtaining more psychologically/cognitively realistic symbolic and subsymbolic representations within the framework of (...) a cognitive architecture, and accentuates the relevance of such an approach to cognitive science and psychology. (shrink)

Computational cognitive models hypothesize internal mental processes of human cognitive activities and express such activities by computer programs Such computational models often consist of many components and aspects Claims are often made that certain aspects of the models play a key role in modeling but such claims are sometimes not well justi ed or explored In this paper we rst review some fundamental distinctions and issues in computational modeling We then discuss in principle systematic ways of identifying the source of (...) power in the models.. (shrink)

To deal with reactive sequential decision tasks we present a learning model which is a hybrid connectionist model consisting of both localist and distributed representations based on the two level approach proposed in..

Co-learning of multiple agents has been studied in co-learning settings, and how do they help, or many different disciplines under various guises. For hamper, learning and cooperation? example, the issue has been tackled by distributed • How do we characterize the process and the artificial intelligence, parallel and distributed com- dynamics of co-learning, conceptually, mathe- puting, cognitive psychology, social psychology, matically, or computationally? game theory (and other areas of mathematical econ- • how do social structures and relations interact omics), sociology, (...) anthropology, and many other with co-learning of multiple agents? related disciplines. (shrink)

In the physical sciences a rigorous theory is a hierarchy of descriptions in which causal relationships between many general types of entity at a phenomenological level can be derived from causal relationships between smaller numbers of simpler entities at more detailed levels. The hierarchy of descriptions resembles the modular hierarchy created in electronic systems in order to be able to modify a complex functionality without excessive side effects. Such a hierarchy would make it possible to establish a rigorous scientific theory (...) of consciousness. The causal relationships implicit in definitions of access consciousness and phe- nomenal consciousness are made explicit, and the corresponding causal relationships at the more detailed levels of perception, memory, and skill learning described. Extension of these causal relationships to physiological and neural levels is discussed. The general capability of a range of current consciousness models to support a modular hierarchy which could generate these causal relationships is reviewed, and the specific capabilities of two models with good general capabilities are compared in some detail. Ó 2003 Elsevier Inc. All rights reserved. (shrink)

The models used in social simulation to date have mostly been very simplistic cognitively, with little attention paid to the details of individual cognition. This work proposes a more cognitively realistic approach to social simulation. It begins with a model created by Gilbert (1997) for capturing the growth of academic science. Gilbert’s model, which was equation-based, is replaced here by an agent-based model, with the cognitive architecture CLARION providing greater cognitive realism. Using this cognitive agent model, results comparable to previous (...) simulations and to human data are obtained. It is found that while different cognitive settings may affect the aggregate number of scientific articles produced, they do not generally lead to different distributions of number of articles per author. The paper concludes with a discussion of the correspondence between our model and the constructivist view of academic science. It is argued that using more cognitively realistic models in simulations may lead to novel insights. (shrink)

The goal of this research is to explore implicit and explicit processes in shaping an individual’s characteristic behavioral patterns, that is, personality. The questions addressed are how psychological processes may be separated into implicit and explicit types, and how such a separation figures into personality. In particular, it focuses on the role of instinct and intuition in determining personality. This paper argues that personality may be fundamentally based on instincts resulting from basic human motivation, along with related processes, within a (...) comprehensive cognitive architecture. This approach is implemented as a computational model. Various tests and simulations show that this model captures major personality traits and accounts for empirical data. The work shows how a cognitive architecture with the implicit–explicit distinction may capture instinct, intuition, and personality. (shrink)

The goal of this research is to understand the interaction of implicit and explicit psychological processes in dealing with emotional distractions and meta-cognitive control of such distractions. The questions are how emotional and meta-cognitive processes can be separated into implicit and explicit components, and how such a separation can be utilized to improve self-regulation of emotion, which can have significant theoretical and practical implications.

chical reinforcement learning that does not rely on a pri ori hierarchical structures Thus the approach deals with a more di cult problem compared with existing work It in volves learning to segment sequences to create hierarchical structures based on reinforcement received during task ex ecution with di erent levels of control communicating with each other through sharing reinforcement estimates obtained by each others The algorithm segments sequences to re duce non Markovian temporal dependencies to facilitate the learning of the (...) overall task Initial experiments demon strated the basic promise of the approach.. (shrink)

This paper explicates the interaction between the implicit and explicit learning processes in skill acquisition, contrary to the common tendency in the literature of studying each type of learning in isolation. It highlights the interaction between the two types of processes and its various effects on learning, including the synergy effect. This work advocates an integrated model of skill learning that takes into account both implicit and explicit processes; moreover, it embodies a bottom-up approach (first learning implicit knowledge and then (...) explicit knowledge on its basis) towards skill learning. The paper shows that this approach accounts for various effects in the process control task data, in addition to accounting for other data reported elsewhere. (shrink)

suggests that incubation is a diverse phenomenon, involving diverse cognitive processes. Hence, distracting activities can..

The models used in social simulation to date have mostly been very simplistic cognitively, with little attention paid to the details of individual cognition. This work proposes a more cognitively realistic approach to social simulation. It begins with a model created by Gilbert (1997) for capturing the growth of academic science. Gilbert’s model, which was equation-based, is replaced here by an agent-based model, with the cognitive architecture CLARION providing greater cognitive realism. Using this cognitive agent model, results comparable to previous (...) simulations and to human data are obtained. It is found that while different cognitive settings may affect the aggregate number of scientific articles produced, they do not generally lead to different distributions of number of articles per author. The paper concludes with a discussion of the correspondence between our model and the constructivist view of academic science. It is argued that using more cognitively realistic models in simulations may lead to novel insights. (shrink)

The present issue is the beginning of a new journal from various sub-disciplines and paradigms in order – Cognitive Systems Research – which we have to construct a coherent picture of how the various developed in response to what we perceive to be an pieces fit together overall. Such a synthesis is unfilled niche in the current literature in the areas of essential to the discovery of designs for general Cognitive Science and Artificial Intelligence.

The performance of symbolic inference tasks has long been a challenge to connectionists. In this paper, we present an extended survey of this area. Existing connectionist inference systems are reviewed, with particular reference to how they perform variable binding and rule- based reasoning and whether they involve distributed or localist representations. The bene®ts and disadvantages of different representations and systems are outlined, and conclusions drawn regarding the capabilities of connectionist inference systems when compared with symbolic inference systems or when used (...) for cognitive modelling. q 2001 Elsevier Science Ltd. All rights reserved. (shrink)

Variable binding has long been a challenge to connectionists. Attempts to perform variable binding using localist and distributed connectionist representations are discussed, and problems inherent in each type of representation are outlined.

Implicit processes are thought to be relatively fast, inaccessible, holistic, and imprecise, while explicit processes are slow, accessible and precise (e.g., Reber, 1989, Sun 2002). This dichotomy is closely related to some other well-known dichotomies including symbolic versus subsymbolic processing (Rumelhart et al., 1986), conceptual versus subconceptual processing (Smolensky, 1988), and conscious versus unconscious processing (Jacoby et al., 1994). This dichotomy has been justified by extensive studies of implicit and explicit learning, implicit and explicit memory, and implicit versus explicit metacognition (...) (Reder, 1996). (shrink)

This paper introduces a hybrid model that combines connectionist, symbolic, and reinforcement learning for tackling reactive sequential decision tasks by a situated agent. Both procedural skills and high-level symbolic representations are acquired through an agent's experience interacting with the world, in a bottom-up direction. It deals with on-line learning, that is, learning continuously from on-going experience in the world, without the use of preconstructed data sets or preconceived concepts. The model is a connectionist one based on a two-level approach proposed (...) earlier. Acknowledgements: This work is supported in part by O ce of Naval Research grant N00014-95-1-0440. (shrink)