This paper attempts to formalize and to address the ‘leakproofing’ of the Singularity problem presented by David Chalmers. The paper begins with the definition of the Artificial Intelligence Confinement Problem. After analysis of existing solutions and their shortcomings, a protocol is proposed aimed at making a more secure confinement environment which might delay potential negative effect from the technological singularity while allowing humanity to benefit from the superintelligence.

Various authors have argued that in the future not only will it be technically feasible for human minds to be transferred to other substrates, but this will become, for most humans, the preferred option over the current biological limitations. It has even been claimed that such a scenario is inevitable in order to solve the challenging, but imperative, multi-agent value alignment problem. In all these considerations, it has been overlooked that, in order to create a suitable environment for a particular (...) mind – for example, a personal universe in a computational substrate – numerous other potentially sentient beings will have to be created. These range from non-player characters to subroutines. This article analyzes the additional suffering and mind crimes that these scenarios might entail. We offer a partial solution to reduce the suffering by imposing on the transferred mind the perception of indicators to measure potential suffering in non-player characters. This approach can be seen as implementing literal empathy through enhanced cognition. (shrink)

Purpose This paper aims to formalize long-term trajectories of human civilization as a scientific and ethical field of study. The long-term trajectory of human civilization can be defined as the path that human civilization takes during the entire future time period in which human civilization could continue to exist. -/- Design/methodology/approach This paper focuses on four types of trajectories: status quo trajectories, in which human civilization persists in a state broadly similar to its current state into the distant future; catastrophe (...) trajectories, in which one or more events cause significant harm to human civilization; technological transformation trajectories, in which radical technological breakthroughs put human civilization on a fundamentally different course; and astronomical trajectories, in which human civilization expands beyond its home planet and into the accessible portions of the cosmos. -/- Findings Status quo trajectories appear unlikely to persist into the distant future, especially in light of long-term astronomical processes. Several catastrophe, technological transformation and astronomical trajectories appear possible. -/- Originality/value Some current actions may be able to affect the long-term trajectory. Whether these actions should be pursued depends on a mix of empirical and ethical factors. For some ethical frameworks, these actions may be especially important to pursue. (shrink)

For any choice of initial state and weak assumptions about the Hamiltonian, large isolated quantum systems undergoing Schrödinger evolution spend most of their time in macroscopic superposition states. The result follows from von Neumann’s 1929 Quantum Ergodic Theorem. As a specific example, we consider a box containing a solid ball and some gas molecules. Regardless of the initial state, the system will evolve into a quantum superposition of states with the ball in macroscopically different positions. Thus, despite their seeming fragility, (...) macroscopic superposition states are ubiquitous consequences of quantum evolution. We discuss the connection to many worlds quantum mechanics. (shrink)

This paper attempts to formalize and to address the 'leakproofing' of the Singularity problem presented by David Chalmers. The paper begins with the definition of the Artificial Intelligence Confinement Problem. After analysis of existing solutions and their shortcomings, a protocol is proposed aimed at making a more secure confinement environment which might delay potential negative effect from the technological singularity while allowing humanity to benefit from the superintelligence.

Special Issue “Risks of artificial general intelligence”, Journal of Experimental and Theoretical Artificial Intelligence, 26/3 (2014), ed. Vincent C. Müller. http://www.tandfonline.com/toc/teta20/26/3# - Risks of general artificial intelligence, Vincent C. Müller, pages 297-301 - Autonomous technology and the greater human good - Steve Omohundro - pages 303-315 - - - The errors, insights and lessons of famous AI predictions – and what they mean for the future - Stuart Armstrong, Kaj Sotala & Seán S. Ó hÉigeartaigh - pages 317-342 - - (...) - The path to more general artificial intelligence - Ted Goertzel - pages 343-354 - - - Limitations and risks of machine ethics - Miles Brundage - pages 355-372 - - - Utility function security in artificially intelligent agents - Roman V. Yampolskiy - pages 373-389 - - - GOLEM: towards an AGI meta-architecture enabling both goal preservation and radical self-improvement - Ben Goertzel - pages 391-403 - - - Universal empathy and ethical bias for artificial general intelligence - Alexey Potapov & Sergey Rodionov - pages 405-416 - - - Bounding the impact of AGI - András Kornai - pages 417-438 - - - Ethics of brain emulations - Anders Sandberg - pages 439-457. (shrink)

Machine ethics and robot rights are quickly becoming hot topics in artificial intelligence and robotics communities. We will argue that attempts to attribute moral agency and assign rights to all intelligent machines are misguided, whether applied to infrahuman or superhuman AIs, as are proposals to limit the negative effects of AIs by constraining their behavior. As an alternative, we propose a new science of safety engineering for intelligent artificial agents based on maximizing for what humans value. In particular, we challenge (...) the scientific community to develop intelligent systems that have human-friendly values that they provably retain, even under recursive self-improvement. (shrink)

One of the primary, if not most critical, difficulties in the design and implementation of autonomous systems is the black-boxed nature of the decision-making structures and logical pathways. How human values are embodied and actualised in situ may ultimately prove to be harmful if not outright recalcitrant. For this reason, the values of stakeholders become of particular significance given the risks posed by opaque structures of intelligent agents (IAs). This paper explores how decision matrix algorithms, via the belief-desire-intention model for (...) autonomous vehicles, can be designed to minimize the risks of opaque architectures. Primarily through an explicit orientation towards designing for the values of explainability and verifiability. In doing so, this research adopts the Value Sensitive Design (VSD) approach as a principled framework for the incorporation of such values within design. VSD is recognized as a potential starting point that offers a systematic way for engineering teams to formally incorporate existing technical solutions within ethical design, while simultaneously remaining pliable to emerging issues and needs. It is concluded that the VSD methodology offers at least a strong enough foundation from which designers can begin to anticipate design needs and formulate salient design flows that can be adapted to the changing ethical landscapes required for utilisation in autonomous vehicles. (shrink)

An artificial general intelligence (AGI) might have an instrumental drive to modify its utility function to improve its ability to cooperate, bargain, promise, threaten, and resist and engage in blackmail. Such an AGI would necessarily have a utility function that was at least partially observable and that was influenced by how other agents chose to interact with it. This instrumental drive would conflict with the strong orthogonality thesis since the modifications would be influenced by the AGI’s intelligence. AGIs in highly (...) competitive environments might converge to having nearly the same utility function, one optimized to favorably influencing other agents through game theory. Nothing in our analysis weakens arguments concerning the risks of AGI. (shrink)

A new conceptual framework, “energy justice,” provides a more comprehensive and, po­tentially, better way to assess and resolve energy-related dilemmas. This new framework of energy justice builds on four fundamental assumptions and consists of two key principles: a prohibitive principle which states that “energy systems must be designed and constructed in such a way that they do not unduly interfere with the ability of people to acquire those basic goods to which they are justly entitled,” and an affirmative principle which (...) states that “if any of the basic goods to which people are justly entitled can only be secured by means of energy services, then in that case there is also a derivative entitlement to the energy services.” These two principles are premised on the notion that energy serves as a material prerequisite for many of the basic goods to which people are entitled. They also recognize that the externalities associated with energy systems often interfere with the enjoyment of such fundamental goods as security and welfare. They acknowledge that the structuring of energy systems has profound ramifications for human societies, providing historically unprecedented benefits for some, and taking from others the possibility of living a life of basic human dignity. (shrink)

As AI technologies increase in capability and ubiquity, AI accidents are becoming more common. Based on normal accident theory, high reliability theory, and open systems theory, we create a framework for understanding the risks associated with AI applications. This framework is designed to direct attention to pertinent system properties without requiring unwieldy amounts of accuracy. In addition, we also use AI safety principles to quantify the unique risks of increased intelligence and human-like qualities in AI. Together, these two fields give (...) a more complete picture of the risks of contemporary AI. By focusing on system properties near accidents instead of seeking a root cause of accidents, we identify where attention should be paid to safety for current generation AI systems. (shrink)

This volume contains a selection of authoritative essays exploring the central questions raised by the conjectured technological singularity. In informed yet jargon-free contributions written by active research scientists, philosophers and sociologists, it goes beyond philosophical discussion to provide a detailed account of the risks that the singularity poses to human society and, perhaps most usefully, the possible actions that society and technologists can take to manage the journey to any singularity in a way that ensures a positive rather than a (...) negative impact on society. The discussions provide perspectives that cover technological, political and business issues. The aim is to bring clarity and rigor to the debate in a way that will inform and stimulate both experts and interested general readers. (shrink)

The concept of sustainable development considers environmental, social and economic issues in general. And the goals of resource conservation and socio-economic development do not contradict each other, but contribute to mutual reinforcement. The purpose of this study is to build and test an economic and mathematical model for the formation of strategies for the behavior of an economic entity with an increase in the impact of negative environmental factors. The proposed strategies and their models are based on the income-expenditure balance (...) equation, which takes into account both quantitative and qualitative characteristics. The constructed models are considered in the state space. The research methodology is based on building models in the form of linear combinations of functions of a homogeneous external impact and various spatial combinations of economic sources (sinks). The study makes it possible to assess the dependence of the amount of resources used for life support on the chosen adaptive strategy. Within the framework of the proposed model, it was found that the criterion for the effectiveness of the applied strategy can be an indicator of satisfaction with the state, the preservation of which, simultaneously with the preservation of the size of resources used, corresponds to the direction of optimization. This approach is consistent with the concept of sustainable development. (shrink)

"The idea that human history is approaching a singularity - that ordinary humans will someday be overtaken by artificially intelligent machines or cognitively enhanced biological intelligence, or both - has moved from the realm of science fiction to serious debate. Some singularity theorists predict that if the field of artificial intelligence continues to develop at its current dizzying rate, the singularity could come about in the middle of the present century. Murray Shanahan offers an introduction to the idea of the (...) singularity and considers the ramifications of such a potentially seismic event. Shanahan's aim is not to make predictions but rather to investigate a range of scenarios. Whether we believe that singularity is near or far, likely or impossible, apocalypse or utopia, the very idea raises crucial philosophical and pragmatic questions, forcing us to think seriously about what we want as a species. Shanahan describes technological advances in AI, both biologically inspired and engineered from scratch. Once human-level AI - theoretically possible, but difficult to accomplish - has been achieved, he explains, the transition to superintelligent AI could be very rapid. Shanahan considers what the existence of superintelligent machines could mean for such matters as personhood, responsibility, rights, and identity. Some superhuman AI agents might be created to benefit humankind; some might go rogue. The singularity presents both an existential threat to humanity and an existential opportunity for humanity to transcend its limitations. Shanahan makes it clear that we need to imagine both possibilities if we want to bring about the better outcome. (shrink)

SummaryThe present analysis compares the distribution of surnames by means of spatial autocorrelation analysis in the Spain–Portugal border region. The Spanish National Institute of Statistics provides a database of surnames of residents in the western Spanish provinces of Zamora, Salamanca, Cáceres, Badajoz and Huelva. The Spanish and Portuguese patterns of surname distribution were established according to various geographic axes. The results obtained show a low diversity of surnames in this region – especially in the centre – which can be explained (...) by the absence of any major geographic barriers, with the exception of the mountain ranges between hydrographic basins, and by the presence of traditional roads that have existed since Roman times. The latter have resulted in a constant migratory flow over short–median distances, which, as can be deduced from the surnames, fits two north/south territorial axes running parallel to the border between Spain and Portugal. The distribution patterns of Portuguese and Spanish surnames differ with regard to their frequencies in the five provinces studied, which can be attributed to their respective historical, economic and social conditions. It is concluded that the border delimiting these two countries has affected the migratory flow, thereby conditioning the demographic and genetic structure of the western Spanish regions. (shrink)

In the last years, artificial intelligence (AI) safety gained international recognition in the light of heterogeneous safety-critical and ethical issues that risk overshadowing the broad beneficial impacts of AI. In this context, the implementation of AI observatory endeavors represents one key research direction. This paper motivates the need for an inherently _transdisciplinary_ AI observatory approach integrating diverse retrospective and counterfactual views. We delineate aims and limitations while providing hands-on-advice utilizing _concrete practical examples_. Distinguishing between unintentionally and intentionally triggered AI risks (...) with diverse socio-psycho-technological impacts, we exemplify a _retrospective descriptive analysis_ followed by a _retrospective counterfactual risk analysis_. Building on these AI observatory tools, we present near-term transdisciplinary guidelines for AI safety. As further contribution, we discuss _differentiated_ and tailored long-term directions through the lens of two disparate modern AI safety paradigms. For simplicity, we refer to these two different paradigms with the terms _artificial stupidity_ (AS) and _eternal creativity_ (EC) respectively. While both AS and EC acknowledge the need for a hybrid cognitive-affective approach to AI safety and overlap with regard to many short-term considerations, they differ fundamentally in the nature of multiple envisaged long-term solution patterns. By compiling relevant underlying _contradistinctions_, we aim to provide _future-oriented_ incentives for constructive dialectics in practical and theoretical AI safety research. (shrink)

The article looks into the issues, outlined in M. Baker's The Atoms of Language: The Mind's Hidden Rules of Grammar. This work is notable for the parametric theory of the languages, set out in it, according to which languages are different, nevertheless retaining the ability to be compared. That can be further supported by the assertion that the differences among languages are determined by "a smallish number of discreet elements, called parameters."What is more, the diversity of language reveals a certain (...) regularity, very much resembling that of Mendeleev's periodic table of chemical elements. Our research team of professional linguists and philosophers put this claim to a critical analysis, the results of which are featured in this article. One of the major ones among them is the supposition that Baker, in accordance with the traditions of Chomsky generative linguistics, turns temporal continuums into special relations. He did that without discussing the consequences of such move, which made it impossible to develop the psychological and linguistic aspect of the subject raised by him. (shrink)

Roman Murawski; V*—The Development of Symbolism in Logic and its Philosophical Background, Proceedings of the Aristotelian Society, Volume 89, Issue 1, 1 June 1.

Au milieu du bouillonnement intellectuel des années vingt en U.R.S.S., Mikhaïl Bakhtine, philosophe et critique littéraire, sʹinterroge sur les rapports entre lʹidéologie, le langage et le psychisme. Refusant la dichotomie saussurienne langue / parole, qui vide la pratique linguistique de sa substance, il affirme la nature sociale du signe et pose les fondements dʹune linguistique de lʹénonciation en tant que manifestation sociale et non individuelle. Au signe figé, réduit à nʹêtre quʹun "signal", il oppose le signe mouvant, changeant, arène où (...) se jouent les conflits sociaux. Publié en 1929 à Leningrad sous le nom de Volochinov, élève de Bakhtine, cet ouvrage paraît pour la première fois sous le nom de son véritable auteur. -- Back cover. (shrink)

In Roman Catholic Political Philosophy author James V. Schall tries to demonstrate that Roman Catholicism and political philosophy—-revelation and reason—are not contradictory. It is his contention that political philosophy, the primary focus of the book, asks certain questions about human purpose and destiny that it cannot, by itself, answer. Revelation is the natural complement to these important questions about God, human being, and the world. Schall manages to avoid polemicism or triumphalism as he shows that revelation and political (...) thought contribute to a fuller understanding of each other. (shrink)

Ekaterina II (romanized)--Denis Diderot.--Didro v gosti︠a︡kh u Ekaterina (romanized)--Prilozhenii︠a︡ (romanized)--Primi︠e︡chanii︠a︡ (romanized).

Antonio Argandoña, Norbert Bilbeny, Victòria Camps, Miquel Calsina, Àngel Castiñeira, Cristian Palazzi, Ferran Requejo, Raimon Ribera, Begoña Román, Ferran Sàez, Miquel Seguró, Francesc Torralba, Josep Maria Vallès, Rosamund Thomas Ramon Llull Journal of Applied Ethics 2012 3(3):9-16.

Adding the phrase “Roman Catholic” to “political philosophy” implies that political philosophy is a work of reason that, in its own order, reaches legitimate issues and problems that it cannot itself resolve. This phrase suggests that, contained within revelation, are responses to the unanswered issues as posed in political philosophy. These responses suggest that there is a coherent relation between reason and revelation that arises directly out of political philosophy as such.

Nauka o středu představuje jeden ze stěžejních pilířů Aristotelovy etiky a je úzce provázána s jeho pojetím etických zdatností. Ty jsou podle Aristotela flexibilní s ohledem na kontext praktické situace. Pojetí statečnosti se však od ostatních etických zdatností liší. Předně je zde problém dvou emocí, které Aristotelés přisuzuje zdatnosti statečnosti. Dále omezuje její oblast výhradně na válečnictví. Toto paradigma válečnictví má pak za následek, že statečnost postrádá flexibilitu etických zdatností a stává se rigidní. Tyto klíčové prvky ohrožují plausibilitu a koherenci (...) Aristotelovy nauky o středu. Chyba ovšem není v nauce o středu jako takové, ale chyby se dopouští sám Aristotelés nesprávnou aplikací nauky o středu na statečnost. (shrink)

Nauka o středu představuje jeden ze stěžejních pilířů Aristotelovy etiky a je úzce provázána s jeho pojetím etických zdatností. Ty jsou podle Aristotela flexibilní s ohledem na kontext praktické situace. Pojetí statečnosti se však od ostatních etických zdatností liší. Předně je zde problém dvou emocí, které Aristotelés přisuzuje zdatnosti statečnosti. Dále omezuje její oblast výhradně na válečnictví. Toto paradigma válečnictví má pak za následek, že statečnost postrádá flexibilitu etických zdatností a stává se rigidní. Tyto klíčové prvky ohrožují plausibilitu a koherenci (...) Aristotelovy nauky o středu. Chyba ovšem není v nauce o středu jako takové, ale chyby se dopouští sám Aristotelés nesprávnou aplikací nauky o středu na statečnost. (shrink)

In Roman Catholic Political Philosophy author James V. Schall tries to demonstrate that Roman Catholicism and political philosophy—-revelation and reason—are not contradictory. It is his contention that political philosophy, the primary focus of the book, asks certain questions about human purpose and destiny that it cannot, by itself, answer. Revelation is the natural complement to these important questions about God, human being, and the world. Schall manages to avoid polemicism or triumphalism as he shows that revelation and political (...) thought contribute to a fuller understanding of each other. (shrink)

The study analyzes the theory presented in the book Critical Theory and Social Media: Between Emancipation and Commodification by Thomas Allmer. The primary goal of the study is to place this work in the broader context of the critical theory of technology. The first part analyzes the context and the requirement for the philosophy of technology in the current digital age. Subsequently, Allmer’s methodology is described as an offshoot of critical theory. This theory is set in the context of the (...) book’s primary sources of thought, especially the critical theory of technology and Andrew Feenberg’s theory. Based on this theoretical understanding, research areas in critical media and technology theory are defined. The critical theory of technology shows that in the society of big data, there are similar contradictions of capitalism as we can find in the material world. Finally, there requirement for a political theory of technology is theorized, contrary to the widespread view that the current contradictions of digital capitalism can be solved by the ethics (design) of new technologies. In this context, critical theory is compared with the – so-called – ethics of new technologies. (shrink)

Aristotle's views on the fundamental nature of reality are usually taken to be inconsistent. The two main sources for these views are the Categories and the central books of the Metaphysics, particularly book Zeta. In the early theory of the Categories the basic entities of the world are concrete objects such as Socrates: Aristotle calls them 'primary substances'. But the later theory awards this title to the forms of concrete objects. Michael Wedin proposes a compatibilist solution to this long-standing puzzle, (...) arguing that Aristotle is engaged in quite different projects in the two works. The theory of Metaphysics Zeta is meant to explain central features of the standing doctrine of the Categories, and so presupposes the essential truth of the early theory. The Categories offers a theory of underlying ontological configurations, while book Zeta gives form the status of primary substance because it is primarily the form of a concrete object that explains its nature, and this form is the substance of the object. So when the late theory identifies primary substance with form, it appeals to an explanatory primacy that is quite distinct from the ontological primacy that dominates the Categories. Wedin's new interpretation thus allows us to see the two treatises as complementing each other: they are parts of a unified history of substance. (shrink)

Aristotle's views on the fundamental nature of reality are usually taken to be inconsistent. The two main sources for these views are the Categories and the central books of the Metaphysics, particularly book Zeta. In the early theory of the Categories the basic entities of the world are concrete objects such as Socrates: Aristotle calls them 'primary substances'. But the later theory awards this title to the forms of concrete objects. Michael Wedin proposes a compatibilist solution to this long-standing puzzle, (...) arguing that Aristotle is engaged in quite different projects in the two works. The theory of Metaphysics Zeta is meant to explain central features of the standing doctrine of the Categories, and so presupposes the essential truth of the early theory. The Categories offers a theory of underlying ontological configurations, while book Zeta gives form the status of primary substance because it is primarily the form of a concrete object that explains its nature, and this form is the substance of the object. So when the late theory identifies primary substance with form, it appeals to an explanatory primacy that is quite distinct from the ontological primacy that dominates the Categories. Wedin's new interpretation thus allows us to see the two treatises as complementing each other: they are parts of a unified history of substance. (shrink)

Roman Murawski; V*—The Development of Symbolism in Logic and its Philosophical Background, Proceedings of the Aristotelian Society, Volume 89, Issue 1, 1 June 1.