This article explicates the interaction between implicit and explicit processes in skill learning, in contrast to the tendency of researchers to study each type in isolation. It highlights various effects of the interaction on learning (including synergy effects). The authors argue for an integrated model of skill learning that takes into account both implicit and explicit processes. Moreover, they argue for a bottom-up approach (first learning implicit knowledge and then explicit knowledge) in the integrated model. A variety of qualitative data (...) can be accounted for by the approach. A computational model, CLARION, is then used to simulate a range of quantitative data. The results demonstrate the plausibility of the model, which provides a new perspective on skill learning. (PsycINFO Database Record (c) 2012 APA, all rights reserved). (shrink)

Synthesizing situated cognition, reinforcement learning, and hybrid connectionist modeling, a generic cognitive architecture focused on situated involvement and interaction with the world is developed in this book. The architecture notably incorporates the distinction of implicit and explicit processes.

This paper discusses essential motivational representations necessary for a comprehensive computational cognitive architecture. It hypothesizes the need for implicit drive representations, as well as explicit goal representations. Drive representations consist of primary drives — both low-level primary drives (concerned mostly with basic physiological needs) and high-level primary drives (concerned more with social needs), as well as derived (secondary) drives. On the basis of drives, explicit goals may be generated on the fly during an agent’s interaction with various situations. These motivational (...) representations help to make cognitive architectural models more comprehensive and provide deeper explanations of psychological processes. This work represents a step forward in making computational cognitive architectures better reflections of the human mind and all its motivational complexity and intricacy. (shrink)

The article first addresses the importance of cognitive modeling, in terms of its value to cognitive science (as well as other social and behavioral sciences). In particular, it emphasizes the use of cognitive architectures in this undertaking. Based on this approach, the article addresses, in detail, the idea of a multi-level approach that ranges from social to neural levels. In physical sciences, a rigorous set of theories is a hierarchy of descriptions/explanations, in which causal relationships among entities at a high (...) level can be reduced to causal relationships among simpler entities at a more detailed level. We argue that a similar hierarchy makes possible an equally productive approach toward cognitive modeling. The levels of models that we conceive in relation to cognition include, at the highest level, sociological/anthropological models of collective human behavior, behavioral models of individual performance, cognitive models involving detailed mechanisms, representations, and processes, as well as biological/physiological models of neural circuits, brain regions, and other detailed biological processes. (shrink)

Symbols should be grounded, as has been argued before. But we insist that they should be grounded not only in subsymbolic activities, but also in the interaction between the agent and the world. The point is that concepts are not formed in isolation (from the world), in abstraction, or "objectively." They are formed in relation to the experience of agents, through their perceptual/motor apparatuses, in their world and linked to their goals and actions. This paper takes a detailed look at (...) this relatively old issue, with a new perspective, aided by our work of computational cognitive model development. To further our understanding, we also go back in time to link up with earlier philosophical theories related to this issue. The result is an account that extends from computational mechanisms to philosophical abstractions. (shrink)

Research in computational cognitive modeling investigates the nature of cognition through developing process-based understanding by specifying computational models of mechanisms (including representations) and processes. In this enterprise, a cognitive architecture is a domaingeneric computational cognitive model that may be used for a broad, multiple-level, multipledomain analysis of behavior. It embodies generic descriptions of cognition in computer algorithms and programs. Developing cognitive architectures is a difficult but important task. In this article, discussions of issues and challenges in developing cognitive architectures will (...) be undertaken, and an example cognitive architecture (CLARION) will be described. (shrink)

This paper explores the interaction between implicit and explicit processes during skill learning, in terms of top-down learning (that is, learning that goes from explicit to implicit knowledge) versus bottom-up learning (that is, learning that goes from implicit to explicit knowledge). Instead of studying each type of knowledge (implicit or explicit) in isolation, we stress the interaction between the two types, especially in terms of one type giving rise to the other, and its effects on learning. The work presents an (...) integrated model of skill learning that takes into account both implicit and explicit processes and both top-down and bottom-up learning. We examine and simulate human data in the Tower of Hanoi task. The paper shows how the quantitative data in this task may be captured using either top-down or bottom-up approaches, although top-down learning is a more apt explanation of the human data currently available. These results illustrate the two different directions of learning (top-down versus bottom-up), and thereby provide a new perspective on skill learning. Ó 2003 Elsevier B.V. All rights reserved. (shrink)

This article addresses issues in developing cognitive architectures--generic computational models of cognition. Cognitive architectures are believed to be essential in advancing understanding of the mind, and therefore, developing cognitive architectures is an extremely important enterprise in cognitive science. The article proposes a set of essential desiderata for developing cognitive architectures. It then moves on to discuss in detail some of these desiderata and their associated concepts and ideas relevant to developing better cognitive architectures. It argues for the importance of taking (...) into full consideration these desiderata in developing future architectures that are more cognitively and ecologically realistic. A brief and preliminary evaluation of existing cognitive architectures is attempted on the basis of these ideas. (shrink)

This paper describes how meta-cognitive processes (i.e., the self monitoring and regulating of cognitive processes) may be captured within a cognitive architecture Clarion. Some currently popular cognitive architectures lack sufficiently complex built-in meta-cognitive mechanisms. However, a sufficiently complex meta-cognitive mechanism is important, in that it is an essential part of cognition and without it, human cognition may not function properly. We contend that such a meta-cognitive mechanism should be an integral part of a cognitive architecture. Thus such a mechanism has (...) been developed within the Clarion cognitive architecture. The paper demonstrates how human data of two meta-cognitive experiments are simulated using Clarion. The simulations show that the meta-cognitive processes represented by the experimental data (and beyond) can be adequately captured within the Clarion framework. (shrink)

Most of the work in agent-based social simulation has assumed highly simplified agent models, with little attention being paid to the details of individual cognition. Here, in an effort to counteract that trend, we substitute a realistic cognitive agent model (CLARION) for the simpler models previously used in an organizational design task. On that basis, an exploration is made of the interaction between the cognitive parameters that govern individual agents, the placement of agents in different organizational structures, and the performance (...) of the organization. It is suggested that the two disciplines, cognitive modeling and social simulation, which have so far been pursued in relative isolation from each other, can be profitably integrated. (shrink)

This paper explores an approach for autonomous generation of symbolic representations from an agent's subsymbolic activities within the agent-environment interaction. The paper describes a psychologically plausible general framework and its various methods for autonomously creating symbolic representations. The symbol generation is accomplished within, and is intrinsic to, a generic and comprehensive cognitive architecture for capturing a wide variety of psychological processes (namely, CLARION). This work points to ways of obtaining more psychologically/cognitively realistic symbolic and subsymbolic representations within the framework of (...) a cognitive architecture, and accentuates the relevance of such an approach to cognitive science and psychology. (shrink)

This paper introduces a hybrid model that unifies connectionist, symbolic, and reinforcement learning into an integrated architecture for bottom-up skill learning in reactive sequential decision tasks. The model is designed for an agent to learn continuously from on-going experience in the world, without the use of preconceived concepts and knowledge. Both procedural skills and high-level knowledge are acquired through an agent’s experience interacting with the world. Computational experiments with the model in two domains are reported.

In the physical sciences a rigorous theory is a hierarchy of descriptions in which causal relationships between many general types of entity at a phenomenological level can be derived from causal relationships between smaller numbers of simpler entities at more detailed levels. The hierarchy of descriptions resembles the modular hierarchy created in electronic systems in order to be able to modify a complex functionality without excessive side effects. Such a hierarchy would make it possible to establish a rigorous scientific theory (...) of consciousness. The causal relationships implicit in definitions of access consciousness and phe- nomenal consciousness are made explicit, and the corresponding causal relationships at the more detailed levels of perception, memory, and skill learning described. Extension of these causal relationships to physiological and neural levels is discussed. The general capability of a range of current consciousness models to support a modular hierarchy which could generate these causal relationships is reviewed, and the specific capabilities of two models with good general capabilities are compared in some detail. Ó 2003 Elsevier Inc. All rights reserved. (shrink)

_role, especially in learning, and through devising hybrid neural network models that (in a qualitative manner) approxi-_ _mate characteristics of human consciousness. In doing so, the paper examines explicit and implicit learning in a variety_ _of psychological experiments and delineates the conscious/unconscious distinction in terms of the two types of learning_ _and their respective products. The distinctions are captured in a two-level action-based model C_larion_. Some funda-_ _mental theoretical issues are also clari?ed with the help of the model. Comparisons with (...) existing models of conscious-_. (shrink)

This article proposes a unified framework for understanding creative problem solving, namely, the explicit–implicit interaction theory. This new theory of creative problem solving constitutes an attempt at providing a more unified explanation of relevant phenomena (in part by reinterpreting/integrating various fragmentary existing theories of incubation and insight). The explicit–implicit interaction theory relies mainly on 5 basic principles, namely, (a) the coexistence of and the difference between explicit and implicit knowledge, (b) the simultaneous involvement of implicit and explicit processes in most (...) tasks, (c) the redundant representation of explicit and implicit knowledge, (d) the integration of the results of explicit and implicit processing, and (e) the iterative (and possibly bidirectional) processing. A computational implementation of the theory is developed based on the CLARION cognitive architecture and applied to the simulation of relevant human data. This work represents an initial step in the development of process-based theories of creativity encompassing incubation, insight, and various other related.. (shrink)

This paper argues for an explanation of the mechanistic (computational) basis of consciousness that is based on the distinction between localist (symbolic) representation and distributed representation, the ideas of which have been put forth in the connectionist literature. A model is developed to substantiate and test this approach. The paper also explores the issue of the functional roles of consciousness, in relation to the proposed mechanistic explanation of consciousness. The model, embodying the representational difference, is able to account for the (...) functional role of consciousness, in the form of the synergy between the conscious and the unconscious. The fit between the model and various cognitive phenomena and data (documented in the psychological literatures) is discussed to accentuate the plausibility of the model and its explanation of consciousness. Comparisons with existing models of consciousness are made in the end. (shrink)

In the current research on multi-agent systems (MAS), many theoretical issues related to sociocultural processes have been touched upon. These issues are in fact intellectually profound and should prove to be significant for MAS. Moreover, these issues should have equally significant impact on cognitive science, if we ever try to understand cognition in the broad context of sociocultural environments in which cognitive agents exist. Furthermore, cognitive models as studied in cognitive science can help us in a substantial way to better (...) probe multi-agent issues, by taking into account essential characteristics of cognitive agents and their various capacities. In this paper, we systematically examine the interplay among social sciences, MAS, and cognitive science. We try to justify an integrated approach for MAS which incorporates different perspectives. We show how a new cognitive model, CLARION, can embody such an integrated approach through a combination of autonomous learning and assimilation. (shrink)

This paper addresses weighting and partitioning in complex reinforcement learning tasks, with the aim of facilitating learning. The paper presents some ideas regarding weighting of multiple agents and extends them into partitioning an input/state space into multiple regions with di erential weighting in these regions, to exploit di erential characteristics of regions and di erential characteristics of agents to reduce the learning complexity of agents (and their function approximators) and thus to facilitate the learning overall. It analyzes, in reinforcement learning (...) tasks, di erent ways of partitioning a task and using agents selectively based on partitioning. Based on the analysis, some heuristic methods are described and experimentally tested. We nd that some o -line heuristic methods performed the best, signi cantly better than single-agent models. (shrink)

Co-learning of multiple agents has been studied in co-learning settings, and how do they help, or many different disciplines under various guises. For hamper, learning and cooperation? example, the issue has been tackled by distributed • How do we characterize the process and the artificial intelligence, parallel and distributed com- dynamics of co-learning, conceptually, mathe- puting, cognitive psychology, social psychology, matically, or computationally? game theory (and other areas of mathematical econ- • how do social structures and relations interact omics), sociology, (...) anthropology, and many other with co-learning of multiple agents? related disciplines. (shrink)

This book is a definitive reference source for the growing, increasingly more important, and interdisciplinary field of computational cognitive modeling, that is, computational psychology. It combines breadth of coverage with definitive statements by leading scientists in this field. Research in computational cognitive modeling explores the essence of cognition through developing detailed, process-based understanding by specifying computational mechanisms, structures, and processes. Computational models provide both conceptual clarity and precision at the same time. This book substantiates this approach through overviews and many (...) examples. (shrink)

This paper aims to explore mechanistic and teleological explanations of consciousness. In terms of mechanistic explanations, it critiques various existing views, especially those embodied by existing computational cognitive models. In this regard, the paper argues in favor of the explanation based on the distinction between localist (symbolic) representation and distributed representation (as formulated in the connectionist literature), which reduces the phenomenological difference to a mechanistic difference. Furthermore, to establish a teleological explanation of consciousness, the paper discusses the issue of the (...) functional role of consciousness on the basis of the aforementioned mechanistic explanation. A proposal based on synergistic interaction between the conscious and the unconscious is advanced that encompasses various existing views concerning the functional role of consciousness. This two-step deepening explanation has some empirical support, in the form of a cognitive model and various cognitive data that it captures. © 2001 Elsevier Science B.V. All rights reserved. (shrink)

This article explores the view that computational models of cognition may constitute valid theories of cognition, often in the full sense of the term ‘‘theory”. In this discussion, this article examines various (existent or possible) positions on this issue and argues in favor of the view above. It also connects this issue with a number of other relevant issues, such as the general relationship between theory and data, the validation of models, and the practical benefits of computational modeling. All the (...) discussions point to the position that computational cognitive models can be true theories of cognition. Ó 2008 Elsevier B.V. All rights reserved. (shrink)

We present a skill learning model CLARION. Different from existing models of high-level skill learning that use a topdown approach (that is, turning declarative knowledge into procedural knowledge), we adopt a bottom-up approach toward low-level skill learning, where procedural knowledge develops first and declarative knowledge develops later. CLAR- ION is formed by integrating connectionist, reinforcement, and symbolic learning methods to perform on-line learning. We compare the model with human data in a minefield navigation task. A match between the model and (...) human data is found in several respects. (shrink)

To deal with reactive sequential decision tasks we present a learning model which is a hybrid connectionist model consisting of both localist and distributed representations based on the two level approach proposed in..

suggests that incubation is a diverse phenomenon, involving diverse cognitive processes. Hence, distracting activities can..

b>: A cooperative team of agents may perform many tasks better than isolated agents. The question is how coopera-.

This paper explicates the interaction between the implicit and explicit learning processes in skill acquisition, contrary to the common tendency in the literature of studying each type of learning in isolation. It highlights the interaction between the two types of processes and its various effects on learning, including the synergy effect. This work advocates an integrated model of skill learning that takes into account both implicit and explicit processes; moreover, it embodies a bottom-up approach (first learning implicit knowledge and then (...) explicit knowledge on its basis) towards skill learning. The paper shows that this approach accounts for various effects in the process control task data, in addition to accounting for other data reported elsewhere. (shrink)

�� This work describes a cognitively realistic ap- proach to social simulation. It begins with a model created by Gilbert [4] for capturing the growth of academic science. Gilbert’s model, which was equation-based, is replaced here by an agent-based (neural network) model, with the (neural net- work based) cognitive architecture CLARION providing greater cognitive realism. Using this agent model, results comparable to previous simulations and to human data are obtained. It is found that while different cognitive settings may affect the (...) aggregate number of scientific articles produced by the model, they do not generally lead to different distributions of number of articles per author. It is argued that using more cognitively realistic models in simulations may lead to novel insights. (shrink)

Variable binding has long been a challenge to connectionists. Attempts to perform variable binding using localist and distributed connectionist representations are discussed, and problems inherent in each type of representation are outlined.

The goal of this research is to understand the interaction of implicit and explicit psychological processes in dealing with emotional distractions and meta-cognitive control of such distractions. The questions are how emotional and meta-cognitive processes can be separated into implicit and explicit components, and how such a separation can be utilized to improve self-regulation of emotion, which can have significant theoretical and practical implications.

As we know, a cognitive architecture is a domain-generic computational cognitive model that may be used for a broad analysis of cognition and behavior. Cognitive architectures embody theories of cognition in computer algorithms and programs. Social simulation with multi-agent systems can benefit from incorporating cognitive architectures, as they provide a realistic basis for modeling individual agents (as argued in Sun 2001). In this survey, an example cognitive architecture will be given, and its application to social simulation will be sketched.

Most psychological theories of problem solving have focused on modeling explicit processes that gradually bring the solver closer to the solution in a mostly explicit and deliberative way. This approach to problem solving is typically inefficient when the problem is too complex, ill-understood, or ambiguous. In such a case, a ‘creative’ approach to problem solving might be more appropriate. In the present paper, we propose a computational psychological model implementing the Explicit-Implicit Interaction theory of creative problem solving that involves integrating (...) the results of implicit and explicit processing. In this paper, the new model is used to simulate insight in creative problem solving and the overshadowing effect. (shrink)

In: E. Vargios (ed.), Educational Psychology Research Focus, pp.1-26. Nova Science Publishers, Hauppauge, NY. 2007.

The models used in social simulation to date have mostly been very simplistic cognitively, with little attention paid to the details of individual cognition. This work proposes a more cognitively realistic approach to social simulation. It begins with a model created by Gilbert (1997) for capturing the growth of academic science. Gilbert’s model, which was equation-based, is replaced here by an agent-based model, with the cognitive architecture CLARION providing greater cognitive realism. Using this cognitive agent model, results comparable to previous (...) simulations and to human data are obtained. It is found that while different cognitive settings may affect the aggregate number of scientific articles produced, they do not generally lead to different distributions of number of articles per author. The paper concludes with a discussion of the correspondence between our model and the constructivist view of academic science. It is argued that using more cognitively realistic models in simulations may lead to novel insights. (shrink)

We believe that the distinction between procedural and declarative knowledge unnecessarily confounds two issues: action-centeredness and accessibility, and can be made clearer through separating the two aspects. The work presents an integrated model of skill learning that takes into account both implicit and explicit processes and both action-centered and non-action-centered knowledge. We examine and simulate human data in the Letter Counting task. The work shows how the data may be captured using either the action-centered knowledge alone or the combined action-centered (...) and non-action-centered knowledge. The results provide a new perspective on skill learning. (shrink)

Implicit processes are thought to be relatively fast, inaccessible, holistic, and imprecise, while explicit processes are slow, accessible and precise (e.g., Reber, 1989, Sun 2002). This dichotomy is closely related to some other well-known dichotomies including symbolic versus subsymbolic processing (Rumelhart et al., 1986), conceptual versus subconceptual processing (Smolensky, 1988), and conscious versus unconscious processing (Jacoby et al., 1994). This dichotomy has been justified by extensive studies of implicit and explicit learning, implicit and explicit memory, and implicit versus explicit metacognition (...) (Reder, 1996). (shrink)

This paper presents a GA-based multi-agent reinforce- ment learning bidding approach (GMARLB) for perform- ing multi-agent reinforcement learning. GMARLB inte- grates reinforcement learning, bidding and genetic algo- rithms. The general idea of our multi-agent systems is as follows: There are a number of individual agents in a team, each agent of the team has two modules: Q module and CQ module. Each agent can select actions to be performed at each step, which are done by the Q module. While the (...) CQ module determines at each step whether the agent should continue or relinquish control. Once an agent relinquishes its control, a new agent is selected by bidding algorithms. We applied GA-based GMARLB to the Backgammon game. The experimental results show GMARLB can achieve a su- perior level of performance in game-playing, outperforming PubEval, while the system uses zero built-in knowledge. (shrink)

Although computational models of cognitive agents that incorporate a wide range of cognitive functionalities have been developed in cognitive science, most of the work in social simulation still assumes rudimentary cognition on the part of the agents. In contrast, in this work, the interaction of cognition and social structures/processes is explored, through simulating survival strategies of tribal societies. The results of the simulation demonstrate interactions between cognitive and social factors. For example, we show that cognitive capabilities and tendencies may be (...) relevant to what social institutions may be adopted. This work points to a cognitively based approach towards social simulation, as well as a new area of research—exploring the cognitive–social interaction through cognitively based social simulation. (shrink)

This work explores the importance of similarity-based processes in human everyday reasoning, beyond purely rule-based processes prevalent in AI and cognitive science. A unified framework encompassing both rulebased and similarity-based reasoning may provide explanations for a variety of human reasoning data.

Implicit processes are thought to be relatively fast, inaccessible, holistic, and imprecise, while explicit processes are slow, accessible and precise (e.g., Reber, 1989, Sun 2002). This dichotomy is closely related to some other wellknown dichotomies including symbolic versus subsymbolic processing (Rumelhart et al., 1986), conceptual versus subconceptual processing (Smolensky, 1988), and conscious versus unconscious processing (Jacoby et al., 1994). This dichotomy has been justified by extensive studies of implicit and explicit learning, implicit and explicit memory, and implicit versus explicit metacognition (...) (Reder, 1996). (shrink)

The present issue is the beginning of a new journal from various sub-disciplines and paradigms in order – Cognitive Systems Research – which we have to construct a coherent picture of how the various developed in response to what we perceive to be an pieces fit together overall. Such a synthesis is unfilled niche in the current literature in the areas of essential to the discovery of designs for general Cognitive Science and Artificial Intelligence.

Agent-based social simulation (with multi-agent systems), which is an important aspect of social computing, can benefit from incorporating cognitive architectures, as they provide a realistic basis for modeling individual agents and therefore their social interactions. A cognitive architecture is a domain-generic computational cognitive model that may be used for a broad multiple-domain analysis of individual behavior. In this article, an example of a cognitive architecture is given, and its applications to social simulation described. Some challenging issues in this regard are (...) outlined. (shrink)

The performance of symbolic inference tasks has long been a challenge to connectionists. In this paper, we present an extended survey of this area. Existing connectionist inference systems are reviewed, with particular reference to how they perform variable binding and rule- based reasoning and whether they involve distributed or localist representations. The bene®ts and disadvantages of different representations and systems are outlined, and conclusions drawn regarding the capabilities of connectionist inference systems when compared with symbolic inference systems or when used (...) for cognitive modelling. q 2001 Elsevier Science Ltd. All rights reserved. (shrink)

Learners are able to use 2 different types of knowledge to perform a skill. One type is a conscious mental model, and the other is based on memories of instances. The authors conducted 3 experiments that manipulated training conditions designed to affect the availability of 1 or both types of knowledge about an artificial grammar. Participants were tested for both speed and accuracy of their ability to generate letter sequences. Results indicate that model-based training leads to slow accurate responding. Memorybased (...) training leads to fast, less accurate responding and highest achievement when perfect accuracy was not required. Evidence supports participants’ preference for using the memory-based mode when exposed to both types of training. Finally, the accuracy contributed by model-based training declined over a retention interval. (shrink)

The models used in social simulation to date have mostly been very simplistic cognitively, with little attention paid to the details of individual cognition. This work proposes a more cognitively realistic approach to social simulation. It begins with a model created by Gilbert (1997) for capturing the growth of academic science. Gilbert’s model, which was equation-based, is replaced here by an agent-based model, with the cognitive architecture CLARION providing greater cognitive realism. Using this cognitive agent model, results comparable to previous (...) simulations and to human data are obtained. It is found that while different cognitive settings may affect the aggregate number of scientific articles produced, they do not generally lead to different distributions of number of articles per author. The paper concludes with a discussion of the correspondence between our model and the constructivist view of academic science. It is argued that using more cognitively realistic models in simulations may lead to novel insights. (shrink)