I survey four categories of factors that might give a digital mind, such as an upload or an artificial general intelligence, an advantage over humans. Hardware advantages include greater serial speeds and greater parallel speeds. Self-improvement advantages include improvement of algorithms, design of new mental modules, and modification of motivational system. Co-operative advantages include copyability, perfect co-operation, improved communication, and transfer of skills. Human handicaps include computational limitations and faulty heuristics, human-centric biases, and socially motivated cognition. The shape of hardware (...) growth curves, as well as the ease of modifying minds, are found to have a major impact on how quickly a digital mind may take advantage of these factors. (shrink)

We present a hypothetical process of mind coalescence, where arti cial connections are created between two or more brains. This might simply allow for an improved form of communication. At the other extreme, it might merge the minds into one in a process that can be thought of as a reverse split-brain operation. We propose that one way mind coalescence might happen is via an exocortex, a prosthetic extension of the biological brain which integrates with the brain as seamlessly as (...) parts of the biological brain integrate with each other. An exocortex may also prove to be the easiest route for mind uploading, as a person's personality gradually moves away from the aging biological brain and onto the exocortex. Memories might also be copied and shared even without minds being permanently merged. Over time, the borders of personal identity may become loose or even unnecessary. (shrink)

Many researchers have argued that humanity will create artificial general intelligence (AGI) within the next twenty to one hundred years. It has been suggested that AGI may inflict serious damage to human well-being on a global scale ('catastrophic risk'). After summarizing the arguments for why AGI may pose such a risk, we review the fieldʼs proposed responses to AGI risk. We consider societal proposals, proposals for external constraints on AGI behaviors and proposals for creating AGIs that are safe due to (...) their internal design. (shrink)

Discussions about the possible consequences of creating superintelligence have included the possibility of existential risk, often understood mainly as the risk of human extinction. We argue that suffering risks (s-risks) , where an adverse outcome would bring about severe suffering on an astronomical scale, are risks of a comparable severity and probability as risks of extinction. Preventing them is the common interest of many different value systems. Furthermore, we argue that in the same way as superintelligent AI both contributes to (...) existential risk but can also help prevent it, superintelligent AI can both be a suffering risk or help avoid it. Some types of work aimed at making superintelligent AI safe will also help prevent suffering risks, and there may also be a class of safeguards for AI that helps specifically against s-risks. (shrink)

What kinds of fundamental limits are there in how capable artificial intelligence (AI) systems might become? Two questions in particular are of interest: (1) How much more capable could AI become relative to humans, and (2) how easily could superhuman capability be acquired? To answer these questions, we will consider the literature on human expertise and intelligence, discuss its relevance for AI, and consider how AI could improve on humans in two major aspects of thought and expertise, namely simulation and (...) pattern recognition. We find that although there are very real limits to prediction, it seems like AI could still substantially improve on human intelligence. (shrink)

Purpose This paper aims to formalize long-term trajectories of human civilization as a scientific and ethical field of study. The long-term trajectory of human civilization can be defined as the path that human civilization takes during the entire future time period in which human civilization could continue to exist. -/- Design/methodology/approach This paper focuses on four types of trajectories: status quo trajectories, in which human civilization persists in a state broadly similar to its current state into the distant future; catastrophe (...) trajectories, in which one or more events cause significant harm to human civilization; technological transformation trajectories, in which radical technological breakthroughs put human civilization on a fundamentally different course; and astronomical trajectories, in which human civilization expands beyond its home planet and into the accessible portions of the cosmos. -/- Findings Status quo trajectories appear unlikely to persist into the distant future, especially in light of long-term astronomical processes. Several catastrophe, technological transformation and astronomical trajectories appear possible. -/- Originality/value Some current actions may be able to affect the long-term trajectory. Whether these actions should be pursued depends on a mix of empirical and ethical factors. For some ethical frameworks, these actions may be especially important to pursue. (shrink)

A class of probability functions is studied. This class contains the probability functions of half-spin particles and spinning classical objects. A notion of realisability for these functions is defined. In terms of this notion two versions of Bell's theorem and their inverses are stated and proved.

I formulate the Zermelo-Russell paradox for naive set theory. A sketch is given of Zermelo’s solution to the paradox: the cumulative type structure. A careful analysis of the set formation process shows a missing component in this solution: the necessity of an assumed imaginary jump out of an infinite universe. Thus a set is formed by a suitable combination of concrete and imaginary operations all of which can be made or assumed by a Turing machine. Some consequences are drawn from (...) this improved analysis of the concept of set, for the theory of sets and for the philosophy and foundations of mathematics. (shrink)

This essay is a critical analysis of some themes in Wittgenstein’s later philosophy. It is not primarily Wittgenstein-exegesis. Much more modestly, my purpose is to express my own thoughts about some questions which Wittgenstein has treated in his writings. It is the second in a series of two articles. The first article, “Remarks on Wittgenstein’s Philosophy: Private Language and Meaning", was published in Volume 42, 2007, of the present YEARBOOK. Section 1, “Philosophical Method”. Wittgenstein’s conception of philosophy as language therapy (...) is criticised. Instead philosophy is construed as foundational research. Wittgenstein’s statement that mathematical logic cannot contribute to progress in philosophy is repudiated. Several examples of ideas and results in mathematical logic which have led to the solution of philosophical problems are given. Section 2, “Contradictions: The Wittgenstein- Turing Debate”. In lectures on the foundations of mathematics given in 1939, Wittgenstein claimed that contradictions in mathematical theories are harmless. A debate ensued on this question between him and Alan Turing. In support of Turing's standpoint, I use the theorem on Taylor series, Church's Theorem, and Gentzen’s Cut-Elimination Theorem to show that Wittgenstein’s standpoint is untenable. For orientation, I also include here the abstract for the first article in the series, “Remarks on Wittgenstein’s Philosophy: Private Language and Meaning”. Section 1, “The Private Language Argument”. An independent argument is given for Wittgenstein’s thesis that there is no private language. I show that psychological terms in ordinary language, in contrast to an implication of Wittgenstein’s own private language argument, in their meanings do contain references to inner states, processes, and events. Section 2, “Meaning”. Wittgenstein’s definition of meaning as use in the language is criticised. Meaning is instead identified with something in the content of a conscious mind. Applications are given to some suggestions in the philosophy of language by Chomsky, Harman and Fodor, Grice, and Kripke. (shrink)

This essay is a critical analysis of some themes in Wittgenstein’s later philosophy. It is not primarily Wittgenstein-exegesis. Much more modestly, my purpose is to express my own thoughts about some questions which Wittgenstein has treated in his writings. It is the first in a series of two articles. The second article, “Remarks on Wittgenstein’s Philosophy: Philosophical Method and Contradictions”, will occur in next year’s issue of the present YEARBOOK. Section 1, “The Private Language Argument”. An independent argument is given (...) for Wittgenstein’s thesis that there is no private language. I show that psychological terms in ordinary language, in contrast to an implication of Wittgenstein’s own private language argument, in their meanings do contain references to inner states, processes, or events. Section 2, “Meaning”. Wittgenstein’s definition of meaning as use in the language is criticised. Meaning is instead identified with something in the content of a conscious mind. Applications are given to some suggestions in philosophy of language by Chomsky, Grice, Harman and Fodor, and Kripke. For orientation, I also include here the abstract for the second article, “Remarks on Wittgenstein’s Philosophy: Philosophical Method and Contradictions”. Section 1, “Philosophical Method”. Wittgenstein’s conception of philosophy as language therapy is criticised. Instead philosophy is construed as foundational research. Wittgenstein’s statement that mathematical logic cannot contribute to progress in philosophy is repudiated. Several examples of ideas and results in mathematical logic which have led to the solution of philosophical problems are given. Section 2, “Contradictions: The Wittgenstein-Turing Debate”. In lectures on the foundations of mathematics given in 1939, Wittgenstein claimed that contradictions in mathematical theories are harmless. A debate ensued on this question between him and Alan Turing. In support of Turing’s standpoint, I use the theorem on Taylor series, Church’s Theorem, and Gentzen’s Cut-Elimination Theorem to show that Wittgenstein’s standpoint is untenable. (shrink)

Eight derivations of Bell’s inequality are given. First a simple and concrete derivation is given drawing on the full strength of the two hypotheses of locality and hidden variables. Two attempts at deriving Bell’s inequality without locality are made. They fail, but give valuable insight into the form which nonlocality must take in quantum physics. Arguments are given against this form of nonlocality. Ontological ideas which allow separation, realism, and locality in quantum mechanics are indicated. In the following five derivations, (...) a number of variants of the assumption of hidden variables are tried. Among the insights which these derivations give rise to are: Particles cannot be assumed to have spin or polarisation values for as much as one fixed direction. The classical picture of electromagnetic radiation is incompatible with QM. Heisenberg’s idea of potentiality in elementary particles is incompatible with QM. There is a weakest form of hidden variables, called realisability, which is sufficient to yield Bell’s inequality. Quantum states cannot be identified with physical states. The mathematical problem of the integration of quantum states into physical states is nontrivial. (shrink)

This study assesses how versatile are the techniques of classical anthropology when confronted by the ethnographically unfamiliar. Each essay seeks to elucidate an empirical problem through orthodox and heterodox uses of standard techniques.

In stunning, full-color photographs and evocative text, Samper and Arhem celebrate the natural surroundings, domestic life, and vibrant rituals of a rain-forest people whose future is being jeopardized by outsiders' destruction of their lands.

Two theses are proposed; regarding the future evolution of the value systems of advanced AGI systems. The Value Learning Thesis is a semi-formalized version of the idea that; if an AGI system is taught human values in an interactive and experiential way as its intelligence increases toward human level; it will likely adopt these human values in a genuine way. The Value Evolution Thesis is a semi-formalized version of the idea that if an AGI system begins with human-like values; and (...) then iteratively modifies itself; it will end up in roughly the same future states as a population of human beings engaged with progressively increasing their own intelligence. Taken together; these theses suggest a worldview in which raising young AGIs to have human-like values is a sensible thing to do; and likely to produce a future that is generally desirable in a human sense. While these two theses are far from definitively proven; I argue that they are more solid and more relevant to the actual future of AGI than Bostrom’s “Instrumental Convergence Thesis” and “Orthogonality Thesis” which are core to the basis of his argument for fearing ongoing AGI development and placing AGI R&D under strict governmental control. In the context of fleshing out this argument; previous publications and discussions by Richard Loosemore and Kaj Sotala are discussed in some detail. (shrink)

Special Issue “Risks of artificial general intelligence”, Journal of Experimental and Theoretical Artificial Intelligence, 26/3 (2014), ed. Vincent C. Müller. http://www.tandfonline.com/toc/teta20/26/3# - Risks of general artificial intelligence, Vincent C. Müller, pages 297-301 - Autonomous technology and the greater human good - Steve Omohundro - pages 303-315 - - - The errors, insights and lessons of famous AI predictions – and what they mean for the future - Stuart Armstrong, Kaj Sotala & Seán S. Ó hÉigeartaigh - pages 317-342 - (...) - - The path to more general artificial intelligence - Ted Goertzel - pages 343-354 - - - Limitations and risks of machine ethics - Miles Brundage - pages 355-372 - - - Utility function security in artificially intelligent agents - Roman V. Yampolskiy - pages 373-389 - - - GOLEM: towards an AGI meta-architecture enabling both goal preservation and radical self-improvement - Ben Goertzel - pages 391-403 - - - Universal empathy and ethical bias for artificial general intelligence - Alexey Potapov & Sergey Rodionov - pages 405-416 - - - Bounding the impact of AGI - András Kornai - pages 417-438 - - - Ethics of brain emulations - Anders Sandberg - pages 439-457. (shrink)

Papers from the conference on AI Risk (published in JETAI), supplemented by additional work. --- If the intelligence of artificial systems were to surpass that of humans, humanity would face significant risks. The time has come to consider these issues, and this consideration must include progress in artificial intelligence (AI) as much as insights from AI theory. -- Featuring contributions from leading experts and thinkers in artificial intelligence, Risks of Artificial Intelligence is the first volume of collected chapters dedicated to (...) examining the risks of AI. The book evaluates predictions of the future of AI, proposes ways to ensure that AI systems will be beneficial to humans, and then critically evaluates such proposals. 1 Vincent C. Müller, Editorial: Risks of Artificial Intelligence - 2 Steve Omohundro, Autonomous Technology and the Greater Human Good - 3 Stuart Armstrong, Kaj Sotala and Sean O’Heigeartaigh, The Errors, Insights and Lessons of Famous AI Predictions - and What they Mean for the Future - 4 Ted Goertzel, The Path to More General Artificial Intelligence - 5 Miles Brundage, Limitations and Risks of Machine Ethics - 6 Roman Yampolskiy, Utility Function Security in Artificially Intelligent Agents - 7 Ben Goertzel, GOLEM: Toward an AGI Meta-Architecture Enabling Both Goal Preservation and Radical Self-Improvement - 8 Alexey Potapov and Sergey Rodionov, Universal Empathy and Ethical Bias for Artificial General Intelligence - 9 András Kornai, Bounding the Impact of AGI - 10 Anders Sandberg, Ethics and Impact of Brain Emulations 11 Daniel Dewey, Long-Term Strategies for Ending Existential Risk from Fast Takeoff - 12 Mark Bishop, The Singularity, or How I Learned to Stop Worrying and Love AI -. (shrink)

»Me, ženske«, kaj hočemo? je izraz, ki v pričujočem članku označuje dvoje: lacanovsko »ne-vse« ženskega užitka, ki odgovarja na staro freudovsko vprašanje, »kaj hoče ženska?«, in »me, ženske« kot enega izmed primerov univerzalne enakosti, kot jo je pojmoval Rancière. Vprašanje, ki si ga tu zastavljamo, je torej: kako ženski užitek spremeni koncept za napačno štetje enakosti, kako postavlja v ospredje problem samega številskega elementa? Ne gre namreč zgolj za nerazmerje med enakostjo in neenakostjo, ki ji stori krivico, napačno štetje. Gre (...) za nerazmerje znotraj same enakosti, ki označuje enakost med moškim in žensko, ki nikoli ne more biti vključeno v nobeno štetje. Takšna enakost je tematizirana s pomočjo analize feministične razsežnosti alžirske osamosvojitvene vojne. (shrink)

Tematiko estetike vsakdanjosti so pred nedavnim načeli številni avtorji. Vendar pa vprašanje kaj je dejansko narava vsakdanjosti – v nasprotju z nevsakdanjostjo – in kako ta narava učinkuje na estetiko vsakdanjosti, ni bilo zadovoljivo razdelano. Namen tega eseja je razjasniti vsakdanjost vsakdanjika in združiti obče pojme vsakdanjosti s ključnimi točkami estetike vsakdanjosti.