A novel theory of reflective consciousness, will and self is presented, based on modeling each of these entities using self-referential mathematical structures called hypersets. Pattern theory is used to argue that these exotic mathematical structures may meaningfully be considered as parts of the minds of physical systems, even finite computational systems. The hyperset models presented are hypothesized to occur as patterns within the "moving bubble of attention" of the human brain and any roughly human-mind-like AI system. These ideas appear to (...) be compatible with both panpsychist and materialist views of consciousness, and probably other views as well. Their relationship with the CogPrime AI design and its implementation in the OpenCog software framework is elucidated in detail. (shrink)

This chapter discusses nine ways to bias open‐source artificial general intelligence (AGI) toward friendliness. There is no way to guarantee that advanced AGI, once created and released into the world, will behave according to human ethical standards. The primary objective of the chapter is to suggest some potential ways to do so. First it discusses an engineer the capability to acquire integrated ethical knowledge, and provides rich ethical interaction and instruction, respecting developmental stages. The chapter creates stable, hierarchy‐dominated goal systems, (...) and ensures that the early stages of recursive self‐improvement occur relatively slowly and with rich human involvement. It tightly links AGI with the Global Brain, and focuses on foster deep, consensus‐building interactions and commensurability between divergent viewpoints. The chapter creates a mutually supportive community of AGIs, and encourages measured co‐advancement of AGI software and AGI ethics theory. Finally it develops advanced AGI sooner. (shrink)

This is the first work to apply complex systems science to the psychological interplay of order and chaos. The author draws on thought from a wide range of disciplines-both conventional and unorthodox-to address such questions as the nature of consciousness, the relation between mind and reality, and the justification of belief systems. The material should provoke thought among systems scientists, theoretical psychologists, artificial intelligence researchers, and philosophers.

“Only a small community has concentratedon general intelligence. No one has tried to make a thinking machine... The bottom line is that we really haven’t progressed too far toward a truly intelligent machine. We have collections of dumb specialists in small domains; the true majesty of general intelligence still awaits our attack.... We have got to get back to the deepest questions of AI and general intelligence... ” –MarvinMinsky as interviewed in Hal’s Legacy, edited by David Stork, 2000. Our goal (...) in creating this edited volume has been to?ll an apparent gap in the scienti?c literature, by providing a coherent presentation of a body of contemporary research that, in spite of its integral importance, has hitherto kept a very low pro?le within the scienti?c and intellectual community. This body of work has not been given a name before; in this book we christen it “Arti?cial General Intelligence”. What distinguishes AGI work from run-of-the-mill “arti?cial intelligence” research is that it is explicitly focused on engineering general intelligence in the short term. We have been active researchers in the AGI?eld for many years, and it has been a pleasure to gather together papers from our colleagues working on related ideas from their own perspectives. In the Introduction we give a conceptual overview of the AGI?eld, and also summarize and interrelate the key ideas of the papers in the subsequent chapters. (shrink)

While it seems unlikely that any method of guaranteeing human-friendliness on the part of advanced Artificial General Intelligence systems will be possible, this doesn’t mean the only alternatives are throttling AGI development to safeguard humanity, or plunging recklessly into the complete unknown. Without denying the presence of a certain irreducible uncertainty in such matters, it is still sensible to explore ways of biasing the odds in a favorable way, such that newly created AI systems are significantly more likely than not (...) to be Friendly. Several potential methods of effecting such biasing are explored here, with a particular but non-exclusive focus on those that are relevant to open-source AGI projects, and with illustrative examples drawn from the OpenCog open-source AGI project. Issues regarding the relative safety of open versus closed approaches to AGI are discussed and then nine techniques for biasing AGIs in favor of Friendliness are presented: 1. Engineer the capability to acquire integrated ethical knowledge.2. Provide rich ethical interaction and instruction, respecting developmental stages.3. Develop stable, hierarchical goal systems.4. Ensure that the early stages of recursive self-improvement occur relatively slowly and with rich human involvement.5. Tightly link AGI with the Global Brain.6. Foster deep, consensus-building interactions between divergent viewpoints.7. Create a mutually supportive community of AGIs.8. Encourage measured co-advancement of AGI software and AGI ethics theory.9. Develop advanced AGI sooner not later. In conclusion, and related to the final point, we advise the serious co-evolution of functional AGI systems and AGI-related ethical theory as soon as possible, before we have so much technical infrastructure that parties relatively unconcerned with ethics are able to rush ahead with brute force approaches to AGI development. (shrink)

Chalmers suggests that, if a Singularity fails to occur in the next few centuries, the most likely reason will be 'motivational defeaters' i.e. at some point humanity or human-level AI may abandon the effort to create dramatically superhuman artificial general intelligence. Here I explore one plausible way in which that might happen: the deliberate human creation of an 'AI Nanny' with mildly superhuman intelligence and surveillance powers, designed either to forestall Singularity eternally, or to delay the Singularity until humanity more (...) fully understands how to execute a Singularity in a positive way. It is suggested that as technology progresses, humanity may find the creation of an AI Nanny desirable as a means of protecting against the destructive potential of various advanced technologies such as AI, nanotechnology and synthetic biology. (shrink)

Safeguarding GenAI models against threats and aligning them with security requirements is imperative yet challenging. This chapter provides an overview of the security landscape for generative models. It begins by elucidating common vulnerabilities and attack vectors, including adversarial attacks, model inversion, backdoors, data extraction, and algorithmic bias. The practical implications of these threats are discussed, spanning domains like finance, healthcare, and content creation. The narrative then shifts to exploring mitigation strategies and innovative security paradigms. Differential privacy, blockchain-based provenance, quantum-resistant algorithms, (...) and human-guided reinforcement learning are analyzed as potential techniques to harden generative models. Broader ethical concerns surrounding transparency, accountability, deepfakes, and model interpretability are also addressed. The chapter aims to establish a conceptual foundation encompassing both the technical and ethical dimensions of security for generative AI. It highlights open challenges and lays the groundwork for developing robust, trustworthy, and human-centric solutions. The multifaceted perspective spanning vulnerabilities, implications, and solutions is intended to further discourse on securing society’s growing reliance on generative models. Frontier model security is discussed using Anthropic proposed approach. (shrink)

First published in 1993. Routledge is an imprint of Taylor & Francis, an informa company.

Oxford philosopher Nick Bostrom; in his recent and celebrated book Superintelligence; argues that advanced AI poses a potentially major existential risk to humanity; and that advanced AI development should be heavily regulated and perhaps even restricted to a small set of government-approved researchers. Bostrom’s ideas and arguments are reviewed and explored in detail; and compared with the thinking of three other current thinkers on the nature and implications of AI: Eliezer Yudkowsky of the Machine Intelligence Research Institute ; and David (...) Weinbaum and Viktoras Veitas of the Global Brain Institute. Relevant portions of Yudkowsky’s book Rationality: From AI to Zombies are briefly reviewed; and it is found that nearly all the core ideas of Bostrom’s work appeared previously or concurrently in Yudkowsky’s thinking. However; Yudkowsky often presents these shared ideas in a more plain-spoken and extreme form; making clearer the essence of what is being claimed. For instance; the elitist strain of thinking that one sees in the background in Bostrom is plainly and openly articulated in Yudkowsky; with many of the same practical conclusions. Bostrom and Yudkowsky view intelligent systems through the lens of reinforcement learning – they view them as “reward-maximizers” and worry about what happens when a very powerful and intelligent reward-maximizer is paired with a goal system that gives rewards for achieving foolish goals like tiling the universe with paperclips. Weinbaum and Veitas’s recent paper “Open-Ended Intelligence” presents a starkly alternative perspective on intelligence; viewing it as centered not on reward maximization; but rather on complex self-organization and self-transcending development that occurs in close coupling with a complex environment that is also ongoingly self-organizing; in only partially knowable ways. It is concluded that Bostrom and Yudkowsky’s arguments for existential risk have some logical foundation; but are often presented in an exaggerated way. For instance; formal arguments whose implication is that the “worst case scenarios” for advanced AI development are extremely dire; are often informally discussed as if they demonstrated the likelihood; rather than just the possibility; of highly negative outcomes. And potential dangers of reward-maximizing AI are taken as problems with AI in general; rather than just as problems of the reward-maximization paradigm as an approach to building superintelligence. If one views past; current; and future intelligence as “open-ended;” in the vernacular of Weaver and Veitas; the potential dangers no longer appear to loom so large; and one sees a future that is wide-open; complex and uncertain; just as it has always been. (shrink)

Two theses are proposed; regarding the future evolution of the value systems of advanced AGI systems. The Value Learning Thesis is a semi-formalized version of the idea that; if an AGI system is taught human values in an interactive and experiential way as its intelligence increases toward human level; it will likely adopt these human values in a genuine way. The Value Evolution Thesis is a semi-formalized version of the idea that if an AGI system begins with human-like values; and (...) then iteratively modifies itself; it will end up in roughly the same future states as a population of human beings engaged with progressively increasing their own intelligence. Taken together; these theses suggest a worldview in which raising young AGIs to have human-like values is a sensible thing to do; and likely to produce a future that is generally desirable in a human sense. While these two theses are far from definitively proven; I argue that they are more solid and more relevant to the actual future of AGI than Bostrom’s “Instrumental Convergence Thesis” and “Orthogonality Thesis” which are core to the basis of his argument for fearing ongoing AGI development and placing AGI R&D under strict governmental control. In the context of fleshing out this argument; previous publications and discussions by Richard Loosemore and Kaj Sotala are discussed in some detail. (shrink)

What will be the next huge leap in humanity's progress? We cannot know for sure, but I am reasonably confident that it will involve the radical extension of technology into the domain of thought. Ray Kurzweil (2000, 2005) has eloquently summarized the arguments in favor of this position.

Pei Wang, Ben Goertzel. [3] [4] [5] [6] [7] [8] [9] [10] [11] [12] [13] [14] [15] [16] [17] [ 18] [19] [20] [21] [22] [23] [24] [25] [26] [27] Bach, J. (2009). Principles ofSynthetic Intelligence PSI: An Architecture ofMotivated Cognition (Oxford University Press,  ...

Images of mindis an exciting book, well-written and wellorganized, but many of the connections the authors draw between PET scan results and more general psychological issues are somewhat strained.

Ideas from random graph theory are used to give an heuristic argument that associative memory structure depends discontinuously on pattern recognition ability. This argument suggests that there may be a certain minimal size for intelligent systems.

Leslie Kean’s Surviving Death is a wonderfully readable, carefully constructed summary of the evidence for the existence of what is colloquially called an “afterlife.” That is, she considers evidence for the hypothesis that individual human minds and personalities possess an existence going beyond their attachment to any particular body – so that, for instance, an individual with a certain name and certain traits may sometimes continue to perceive and act, even when the body typically associated with that individual is dead (...) and gone. Most of the book comprises moderately detailed descriptions of specific cases, involving specific people, which indicate the existence of some sort of “afterlife” for individual human minds, or potentially give some information regarding the nature of this afterlife. Kean considers a gamut of phenomena such as past-life memories, near-death experiences, mediumistic trances, poltergeists, and so forth. However, she also makes a significant effort to draw general conclusions, lessons and hypotheses from the totality of these cases, while maintaining respect for the confusing and in many ways still mysterious nature of the phenomena under discussion. Each of the topics considered in the book has been reviewed and analyzed in more depth elsewhere. What Kean does, however, is provide a clear, evocative and rational survey of the many types of evidence that are directly relevant to the possibility and nature of an afterlife for individual human minds. (shrink)

Akin''s determinism paradox involves a physical system that predicts its own behavior, and then spitefully defies it. Here this paradox is reformulated in purely computational language, in terms of virtual machines. The paradox is related to the theory of self-reproducing automata; and a mathematical conjecture is given which, if verified, would resolve the paradox.

0. 0 Psychology versus Complex Systems Science Over the last century, psychology has become much less of an art and much more of a science. Philosophical speculation is out; data collection is in. In many ways this has been a very positive trend. Cognitive science (Mandler, 1985) has given us scientific analyses of a variety of intelligent behaviors: short-term memory, language processing, vision processing, etc. And thanks to molecular psychology (Franklin, 1985), we now have a rudimentary understanding of the chemical (...) processes underlying personality and mental illness. However, there is a growing feeling-particularly among non-psychologists (see e. g. Sommerhoff, 1990) - that, with the new emphasis on data collection, something important has been lost. Very little attention is paid to the question of how it all fits together. The early psychologists, and the classical philosophers of mind, were concerned with the general nature of mentality as much as with the mechanisms underlying specific phenomena. But the new, scientific psychology has made disappointingly little progress toward the resolution of these more general questions. One way to deal with this complaint is to dismiss the questions themselves. After all, one might argue, a scientific psychology cannot be expected to deal with fuzzy philosophical questions that probably have little empirical signifi cance. It is interesting that behaviorists and cognitive scientists tend to be in agreement regarding the question of the overall structure of the mind. (shrink)

It has been proposed that natural selection occurs on a hierarchy of levels, of which the organismic level is neither the top nor the bottom. This hypothesis leads to the following practical problem: in general, how does one tell if a given phenomenon is a result of selection on level X or level Y. How does one tell what the units of selection actually are?It is convenient to assume that a unit of selection may be defined as a type of (...) entity for which there exists, among all entities on the same level as that entity, an additive component of variance for some specific component F of fitness which does not appear as an additive component of variance in any decomposition of this F among entities at any lower level. But such a definition implicitly assumes that if f(x, y) depends nonadditively on its arguments, there must be interaction between the quantities which x and y represent. This assumption is incorrect. And one cannot avoid this error by speaking of transformability to additivity instead of merely additivity. (shrink)

This book explores the revolutionary intersection of Generative AI (GenAI) and cybersecurity. It presents a comprehensive guide that intertwines theories and practices, aiming to equip cybersecurity professionals, CISOs, AI researchers, developers, architects and college students with an understanding of GenAI’s profound impacts on cybersecurity. The scope of the book ranges from the foundations of GenAI, including underlying principles, advanced architectures, and cutting-edge research, to specific aspects of GenAI security such as data security, model security, application-level security, and the emerging fields (...) of LLMOps and DevSecOps. It explores AI regulations around the globe, ethical considerations, the threat landscape, and privacy preservation. Further, it assesses the transformative potential of GenAI in reshaping the cybersecurity landscape, the ethical implications of using advanced models, and the innovative strategies required to secure GenAI applications. Lastly, the book presents an in-depth analysis of the security challenges and potential solutions specific to GenAI, and a forward-looking view of how it can redefine cybersecurity practices. By addressing these topics, it provides answers to questions on how to secure GenAI applications, as well as vital support with understanding and navigating the complex and ever-evolving regulatory environments, and how to build a resilient GenAI security program. The book offers actionable insights and hands-on resources for anyone engaged in the rapidly evolving world of GenAI and cybersecurity. (shrink)

The Conference on Artificial General Intelligence is the only major conference series devoted wholly and specifically to the creation of AI systems possessing general intelligence at the human level and ultimately beyond. Its second installation, AGI-09, in Arlington, Virginia, March 6-9, 2009, attracted 67 paper submissions, which is a substantial increase from the previous year. Of these submissions, 33 (i.e., 49%) were accepted as full papers for presentation at the conference. Additional 13 papers were included as position papers. The program (...) also included a keynote address by Juergen Schmidhuber on 'The New AI', a post-conference workshop on 'The Future of AI', and a number of pre-conference tutorials on various topics related to AGI. (shrink)

Well-Being and Death addresses philosophical questions about death and the good life: what makes a life go well? Is death bad for the one who dies? How is this possible if we go out of existence when we die? Is it worse to die as an infant or as a young adult? Is it bad for animals and fetuses to die? Can the dead be harmed? Is there any way to make death less bad for us? Ben Bradley defends the (...) following views: pleasure, rather than achievement or the satisfaction of desire, is what makes life go well; death is generally bad for its victim, in virtue of depriving the victim of more of a good life; death is bad for its victim at times after death, in particular at all those times at which the victim would have been living well; death is worse the earlier it occurs, and hence it is worse to die as an infant than as an adult; death is usually bad for animals and fetuses, in just the same way it is bad for adult humans; things that happen after someone has died cannot harm that person; the only sensible way to make death less bad is to live so long that no more good life is possible. (shrink)

This book explores the role of causal constraints in science, shifting our attention from causal relations between individual events--the focus of most philosophical treatments of causation--to a broad family of concepts and principles generating constraints on possible change. Yemima Ben-Menahem looks at determinism, locality, stability, symmetry principles, conservation laws, and the principle of least action-causal constraints that serve to distinguish events and processes that our best scientific theories mandate or allow from those they rule out. Ben-Menahem's approach reveals that causation (...) is just as relevant to explaining why certain events fail to occur as it is to explaining events that do occur. She investigates the conceptual differences between, and interrelations of, members of the causal family, thereby clarifying problems at the heart of the philosophy of science. Ben-Menahem argues that the distinction between determinism and stability is pertinent to the philosophy of history and the foundations of statistical mechanics, and that the interplay of determinism and locality is crucial for understanding quantum mechanics. Providing historical perspective, she traces the causal constraints of contemporary science to traditional intuitions about causation, and demonstrates how the teleological appearance of some constraints is explained away in current scientific theories such as quantum mechanics. (shrink)

This paper considers whether an analogy between distance and dissimilarlity supports the thesis that degree of dissimilarity is distance in a metric space. A straightforward way to justify the thesis would be to define degree of dissimilarity as a function of number of properties in common and not in common. But, infamously, this approach has problems with infinity. An alternative approach would be to prove representation and uniqueness theorems, according to which if comparative dissimilarity meets certain qualitative conditions, then it (...) is representable by distance in a metric space. I will argue that this approach faces equally severe problems with infinity. (shrink)

This paper defends the view, put roughly, that to think that p is to guess that p is the answer to the question at hand, and that to think that p rationally is for one’s guess to that question to be in a certain sense non-arbitrary. Some theses that will be argued for along the way include: that thinking is question-sensitive and, correspondingly, that ‘thinks’ is context-sensitive; that it can be rational to think that p while having arbitrarily low credence (...) that p; that, nonetheless, rational thinking is closed under entailment; that thinking does not supervene on credence; and that in many cases what one thinks on certain matters is, in a very literal sense, a choice. Finally, since there are strong reasons to believe that thinking just is believing, there are strong reasons to think that all this goes for belief as well. (shrink)

The map is not the territory - from ontology to epistemology in knowledge construction -- Dialectics: a mechanism of knowledge construction -- Reflectivity reconsidered -- Reflectivity and the researchers' perspective -- Reflectivity and the participants' perspective -- Ethical differences and similarities as sources of reflection and knowledge construction -- Research relations and power differentials: from resistance to collaboration and in-between -- Frames of reference and the control of knowledge -- Reciprocity: the nature and attributes of research relations and power -- (...) Epilogue: from dialectics to dialog across liminal spaces. (shrink)

The shortest stories are zero words long. There is no maximum length.

The evil God challenge is an argumentative strategy that has been pursued by a number of philosophers in recent years. It is apt to be understood as a parody argument: a wholly evil, omnipotent and omniscient God is absurd, as both theists and atheists will agree. But according to the challenge, belief in evil God is about as reasonable as belief in a wholly good, omnipotent and omniscient God; the two hypotheses are roughly epistemically symmetrical. Given this symmetry, thesis belief (...) in an evil God and belief in a good God are taken to be similarly preposterous. In this paper, we argue that the challenge can be met, suggesting why the three symmetries that need to hold between evil God and good God – intrinsic, natural theology and theodicy symmetries – can all be broken. As such, we take it that the evil God challenge can be met. (shrink)

A key question for research on the evolutionary origins of morality concerns just what the target of an evolutionary explanation of morality should be. Some researchers focus on behaviors, others on systems of norms, yet others on moral emotions. Richard Joyce (2006) offers an evolutionary explanation for the trait of making moral judgments. Here, I defend Joyce’s account of moral judgment against two objections from Stephen Stich (2008). Stich’s first objection concerns the supposed universality of moral judgments as Joyce conceives (...) of them. I respond by undermining the empirical evidence upon which this objection is based. Stich’s second objection concerns the extent of the moral domain, which he takes to include far more than the considerations of harm and fairness central to Joyce’s account. In response, I outline several strategies for reconciling Stich’s observations with Joyce’s account. (shrink)

One prominent argument in international law and religious thought for abolishing capital punishment is that it violates individuals’ right to life. Notably, this _right-to-life argument_ emerged from normative and legal frameworks that recognize deadly force against aggressors as justified when necessary to stop their unjust threat of grave harm. Can capital punishment be necessary in this sense—and thus justified defensive killing? If so, the right-to-life argument would have to admit certain exceptions where executions are justified. Drawing on work by Hugo (...) Bedau, I identify a thought experiment where executions are justified defensive killing but explain why they cannot be in our world. A state’s obligations to its prisoners include the _obligation to use nonlethal incapacitation_ (ONI), which applies as long as prisoners pose no imminent threat. ONI precludes executions for reasons of future dangerousness. By subjecting the right-to-life argument to closer scrutiny, this article ultimately places it on firmer ground. (shrink)

This paper argues against definitions of depiction in terms of the syntactic and semantic properties of symbol systems. In particular, it is argued that John Kulvicki's definition of depictive symbol systems in terms of relative repleteness, semantic richness, syntactic sensitivity and transparency is susceptible to similar counterexamples as Nelson Goodman's in terms of syntactic density, semantic density and relative repleteness. The general moral drawn is that defining depiction requires attention not merely to descriptive questions about syntax and semantics, but also (...) to foundational questions about what makes it the case that depictions have the syntactic and semantic properties they do. (shrink)

In recent years Mullins and Craig have argued that there is a problem for a timeless God creating, with Mullins formulating the argument as follows: (1) If God begins to be related to creation, then God changes. (2) God begins to be related to creation. (3) Therefore, God changes. (4) If God changes, then God is neither immutable nor timeless. (5) Therefore, God is neither immutable nor timeless. In this paper I argue that all the premises, (1), (2), and (4) (...) are false, and then provide a revised formulation of the argument which more clearly represents what Mullins and Craig wish to argue, given the explication and commentary they give when discussing this objection to timelessness. I then call into question this argument, and conclude by stating what I think Mullins and Craig should really be arguing given the specific views they have about creation ex nihilo and in virtue of what timelessness requires. (shrink)

This paper examines the implications of the context-sensitivity of counterfactuals for the correctness of emotions and attitudes towards death. I argue that the correctness of an attitude such as fear must be explained by appeal to its causal relations to certain preferences.

Descartes was the first to hold that, when we perceive, the representation need not resemble what it represents but should correspond to it. Descartes developed this ground-breaking, influential conception in his work on analytic geometry and then transferred it to his theory of perception. I trace the development of the idea in Descartes’ early mathematical works; his articulation of it in Rules for the Direction of the Mind; his first suggestions there to apply this kind of representation-by-correspondence in the scientific (...) inquiry of colours; and, finally, the transfer of the idea to the theory of perception in The World. (shrink)

This important book brings together leading environmental thinkers to debate a central conflict within environmental philosophy: Should we appreciate nature ...

In this article I defend a new argument against moralist theories of legitimacy and in favour of realist theories. Moralist theories, I argue, are vulnerable to ideological and wishful thinking because they do not connect the demands of legitimacy with the interests of rulers. Realist theories, however, generally do manage to make this connection. This is because satisfying the usual realist criteria for legitimacy – the creation of a stable political order that transcends brute coercion – is usually necessary for (...) rulers to preserve their rule. (shrink)

This book explores the key motif of the religious Other in devotional (bhakti) literatures and practices from across the Indian subcontinent. The primary aim of this book is to reconsider and challenge inherited notions of the bhakta's or devotee's Other and unmask processes of representation that involve adoption, appropriation, and rejection of different social and religious agents. The book considers the ways in which bhakti might be conceived as having an inter-regional impact--as a force, discourse, network, mythology, ethic--while critically engaging (...) with extant scholarly narratives about what bhakti is and tracing when and how those narratives have been used. The sheer diversity of South Asia's devotional traditions renders them an especially rich resource for examining social and religious fault lines, thereby furthering scholarly understanding of how communalism and sectarianism originate and develop on local or regional levels, with wider geographic implications. Bringing together studies from a subcontinent-wide variety of linguistic, geographical, and historical frames for the first time, this book will be an important contribution to the literature on bhakti, and it will be of interest to scholars of South Asian Religion and Asian Religion. (shrink)