Machine ethics and robot rights are quickly becoming hot topics in artificial intelligence and robotics communities. We will argue that attempts to attribute moral agency and assign rights to all intelligent machines are misguided, whether applied to infrahuman or superhuman AIs, as are proposals to limit the negative effects of AIs by constraining their behavior. As an alternative, we propose a new science of safety engineering for intelligent artificial agents based on maximizing for what humans value. In particular, we challenge (...) the scientific community to develop intelligent systems that have human-friendly values that they provably retain, even under recursive self-improvement. (shrink)

This paper attempts to formalize and to address the ‘leakproofing’ of the Singularity problem presented by David Chalmers. The paper begins with the definition of the Artificial Intelligence Confinement Problem. After analysis of existing solutions and their shortcomings, a protocol is proposed aimed at making a more secure confinement environment which might delay potential negative effect from the technological singularity while allowing humanity to benefit from the superintelligence.

One of the primary, if not most critical, difficulties in the design and implementation of autonomous systems is the black-boxed nature of the decision-making structures and logical pathways. How human values are embodied and actualised in situ may ultimately prove to be harmful if not outright recalcitrant. For this reason, the values of stakeholders become of particular significance given the risks posed by opaque structures of intelligent agents (IAs). This paper explores how decision matrix algorithms, via the belief-desire-intention model for (...) autonomous vehicles, can be designed to minimize the risks of opaque architectures. Primarily through an explicit orientation towards designing for the values of explainability and verifiability. In doing so, this research adopts the Value Sensitive Design (VSD) approach as a principled framework for the incorporation of such values within design. VSD is recognized as a potential starting point that offers a systematic way for engineering teams to formally incorporate existing technical solutions within ethical design, while simultaneously remaining pliable to emerging issues and needs. It is concluded that the VSD methodology offers at least a strong enough foundation from which designers can begin to anticipate design needs and formulate salient design flows that can be adapted to the changing ethical landscapes required for utilisation in autonomous vehicles. (shrink)

As AI technologies increase in capability and ubiquity, AI accidents are becoming more common. Based on normal accident theory, high reliability theory, and open systems theory, we create a framework for understanding the risks associated with AI applications. This framework is designed to direct attention to pertinent system properties without requiring unwieldy amounts of accuracy. In addition, we also use AI safety principles to quantify the unique risks of increased intelligence and human-like qualities in AI. Together, these two fields give (...) a more complete picture of the risks of contemporary AI. By focusing on system properties near accidents instead of seeking a root cause of accidents, we identify where attention should be paid to safety for current generation AI systems. (shrink)

An artificial general intelligence (AGI) might have an instrumental drive to modify its utility function to improve its ability to cooperate, bargain, promise, threaten, and resist and engage in blackmail. Such an AGI would necessarily have a utility function that was at least partially observable and that was influenced by how other agents chose to interact with it. This instrumental drive would conflict with the strong orthogonality thesis since the modifications would be influenced by the AGI’s intelligence. AGIs in highly (...) competitive environments might converge to having nearly the same utility function, one optimized to favorably influencing other agents through game theory. Nothing in our analysis weakens arguments concerning the risks of AGI. (shrink)

Various authors have argued that in the future not only will it be technically feasible for human minds to be transferred to other substrates, but this will become, for most humans, the preferred option over the current biological limitations. It has even been claimed that such a scenario is inevitable in order to solve the challenging, but imperative, multi-agent value alignment problem. In all these considerations, it has been overlooked that, in order to create a suitable environment for a particular (...) mind – for example, a personal universe in a computational substrate – numerous other potentially sentient beings will have to be created. These range from non-player characters to subroutines. This article analyzes the additional suffering and mind crimes that these scenarios might entail. We offer a partial solution to reduce the suffering by imposing on the transferred mind the perception of indicators to measure potential suffering in non-player characters. This approach can be seen as implementing literal empathy through enhanced cognition. (shrink)

"The idea that human history is approaching a singularity - that ordinary humans will someday be overtaken by artificially intelligent machines or cognitively enhanced biological intelligence, or both - has moved from the realm of science fiction to serious debate. Some singularity theorists predict that if the field of artificial intelligence continues to develop at its current dizzying rate, the singularity could come about in the middle of the present century. Murray Shanahan offers an introduction to the idea of the (...) singularity and considers the ramifications of such a potentially seismic event. Shanahan's aim is not to make predictions but rather to investigate a range of scenarios. Whether we believe that singularity is near or far, likely or impossible, apocalypse or utopia, the very idea raises crucial philosophical and pragmatic questions, forcing us to think seriously about what we want as a species. Shanahan describes technological advances in AI, both biologically inspired and engineered from scratch. Once human-level AI - theoretically possible, but difficult to accomplish - has been achieved, he explains, the transition to superintelligent AI could be very rapid. Shanahan considers what the existence of superintelligent machines could mean for such matters as personhood, responsibility, rights, and identity. Some superhuman AI agents might be created to benefit humankind; some might go rogue. The singularity presents both an existential threat to humanity and an existential opportunity for humanity to transcend its limitations. Shanahan makes it clear that we need to imagine both possibilities if we want to bring about the better outcome. (shrink)

Purpose This paper aims to formalize long-term trajectories of human civilization as a scientific and ethical field of study. The long-term trajectory of human civilization can be defined as the path that human civilization takes during the entire future time period in which human civilization could continue to exist. -/- Design/methodology/approach This paper focuses on four types of trajectories: status quo trajectories, in which human civilization persists in a state broadly similar to its current state into the distant future; catastrophe (...) trajectories, in which one or more events cause significant harm to human civilization; technological transformation trajectories, in which radical technological breakthroughs put human civilization on a fundamentally different course; and astronomical trajectories, in which human civilization expands beyond its home planet and into the accessible portions of the cosmos. -/- Findings Status quo trajectories appear unlikely to persist into the distant future, especially in light of long-term astronomical processes. Several catastrophe, technological transformation and astronomical trajectories appear possible. -/- Originality/value Some current actions may be able to affect the long-term trajectory. Whether these actions should be pursued depends on a mix of empirical and ethical factors. For some ethical frameworks, these actions may be especially important to pursue. (shrink)

This volume contains a selection of authoritative essays exploring the central questions raised by the conjectured technological singularity. In informed yet jargon-free contributions written by active research scientists, philosophers and sociologists, it goes beyond philosophical discussion to provide a detailed account of the risks that the singularity poses to human society and, perhaps most usefully, the possible actions that society and technologists can take to manage the journey to any singularity in a way that ensures a positive rather than a (...) negative impact on society. The discussions provide perspectives that cover technological, political and business issues. The aim is to bring clarity and rigor to the debate in a way that will inform and stimulate both experts and interested general readers. (shrink)

Models are of central importance in many scientific contexts. The centrality of models such as inflationary models in cosmology, general-circulation models of the global climate, the double-helix model of DNA, evolutionary models in biology, agent-based models in the social sciences, and general-equilibrium models of markets in their respective domains is a case in point (the Other Internet Resources section at the end of this entry contains links to online resources that discuss these models). Scientists spend significant amounts of time building, (...) testing, comparing, and revising models, and much journal space is dedicated to interpreting and discussing the implications of models. In short, models are one of the principal instruments of modern science. (shrink)

Die Frage nach der Seinsweise der realen Welt gehört zu den zentralen und am meisten umstrittenen Themen der europäischen Philosophie. Weder die Argumente des Idealismus noch die des Realismus haben das Problem gelöst. Auch die Frage nach dem Wesen und dem Schicksal des Menschen und seiner Stellung in der Welt ist nicht ablösbar von der Grundfrage nach dem Wesen der Natur und der Existenzweise der realen Welt. Eine kritische Prüfung der Problemsituation ergibt, daß die seit mehr als zweihundert Jahren herrschende (...) Neigung, das Problem der Existenz der Welt erkenntnistheoretisch aufzufassen, eine Verschiebung und Verfälschung des eigentlichen Problems mit sich gebracht hat, das kein erkenntnistheoretisches, sondern im Kern ein echt metaphysisches ist. Seine Lösung kann deshalb nur durch eine ontologische Untersuchung vorbereitet werden. Das ist das Ziel von Roman Ingardens »Streit um die Existenz der Welt«. (shrink)

Models and theories are of central importance in science, and scientists spend substantial amounts of time building, testing, comparing and revising models and theories. It is therefore not surprising that the nature of scientific models and theories has been a widely debated topic within the philosophy of science for many years. The product of two decades of research, in this book Roman Frigg provides an accessible yet critical introduction to the debates about models and theories within analytical philosophy of (...) science since the 1920s. Models and Theories is the first book to address the topic from a philosophical perspective, making it essential reading for advanced undergraduates, researchers, and professional philosophers working in philosophy of science, philosophy of mathematics, and philosophy of technology. It will also be of interest to philosophically minded readers working in physics, computer sciences and STEM fields more broadly. (shrink)

The aim of this book is to present and analyze philosophical conceptions concerning mathematics and logic as formulated by Polish logicians, mathematicians and philosophers in the 1920s and 1930s. It was a remarkable period in the history of Polish science, in particular in the history of Polish logic and mathematics. Therefore, it is justified to ask whether and to what extent the development of logic and mathematics was accompanied by a philosophical reflection. We try to answer those questions by analyzing (...) both works of Polish logicians and mathematicians who have a philosophical temperament as well as their research practice. Works and philosophical views of the following Polish scientists will be analyzed: Wacław Sierpiński, Zygmunt Janiszewski, Stefan Mazurkiewicz, Stefan Banach Hugo Steinhaus, Eustachy Żylińsk and Leon Chwistek, Jan Łukasiewicz, Zygmunt Zawirski, Stanisław Leśniewski, Tadeusz Kotarbiński, Kazimierz Ajdukiewicz, Alfred Tarski, Andrzej Mostowski and Henryk Mehlberg, Jan Sleszyński, Stanisław Zaremba and Witold Wilkosz. To indicate the background of scientists being active in the 1920s and 1930s we consider in Chapter 1 some predecessors, in particular: Jan Śniadecki, Józef Maria Hoene-Wroński, Samuel Dickstein and Edward Stamm. (shrink)

Why do systems prepared in a non-equilibrium state approach, and eventually reach, equilibrium? An important contemporary version of the Boltzmannian approach to statistical mechanics answers this question by an appeal to the notion of typicality. The problem with this approach is that it comes in different versions, which are, however, not recognised as such, much less clearly distinguished, and we often find different arguments pursued side by side. The aim of this paper is to disentangle different versions of typicality-based explanations (...) of thermodynamic behaviour and evaluate their respective success. My conclusion will be that the boldest version fails for technical reasons, while more prudent versions leave unanswered essential questions. (shrink)

This is the second of three parts of an introduction to the philosophy of climate science. In this second part about modelling climate change, the topics of climate modelling, confirmation of climate models, the limits of climate projections, uncertainty and finally model ensembles will be discussed.

Determinism and chance seem to be irreconcilable opposites: either something is chancy or it is deterministic but not both. Yet there are processes which appear to square the circle by being chancy and deterministic at once, and the appearance is backed by well-confirmed scientific theories such as statistical mechanics which also seem to provide us with chances for deterministic processes. Is this possible, and if so how? In this essay I discuss this question for probabilities as they occur in the (...) empirical sciences, setting aside metaphysical questions in connection with free will, divine intervention and determinism in history. (shrink)

Roman Ingardens Werk über das Kausalproblem führt entscheidend über den Problemstand hinaus, wie er von John Stuart Mill und seinen Nachfolgern gekennzeichnet und seither kaum mehr verändert worden war. Anknüpfend an deren Analyse von Bedingungszusammenhängen unternimmt Ingarden es, die Bereiche und Verteilungen ursächlicher Beziehungen im Sinne relativ isolierter Systeme innerhalb des einen Weltzusammenhanges zu interpretieren. Es gelingt ihm mittels einer formalen Analyse, verschiedene Typen möglicher kausaler Beziehungen zu unterscheiden und insbesondere das Determinismusproblem aus der leidigen Alternative "Zufall oder Notwendigkeit" (...) herauszuführen. (shrink)

This is the first of three parts of an introduction to the philosophy of climate science. In this first part about observing climate change, the topics of definitions of climate and climate change, data sets and data models, detection of climate change, and attribution of climate change will be discussed.

The present collection takes stock of posthumanism and its theoretical development and impact in the field of Anglophone literary and cultural studies, with a particular focus on its role in education and the practice of teaching English. Posthumanism informs work in environmental or ecological criticism, climate change research, or human-animal studies - and poses an educational challenge since it also affects curricular and pedagogic theory and practice. Moreover, humanist idea(l)s of subject formation and individually acquired competences have a direct bearing (...) on conceptions of education. This is why the volume interrogates the potentials and pitfalls of posthumanist pedagogies and its connections with digitization, multiliteracies, non-European and non-anthropocentric thinking, and the role of literature pedagogy more generally, presenting case studies of teaching the posthuman from primary to tertiary levels. (shrink)

Transformácia politického systému -- Aktuálne problémy a riešenia -- Alternatívy súčasného kapitalizmu -- Cynizmus ako princíp -- Appendix o školstve.

Der thematisch scharf umgrenzte Sammelband ist von grundlegender Bedeutung füuuml;r die Ästhetik der Gegenwart und vervollstäauml;ndigt Ingardens großen Entwurf einer philosophisch begründeten Theorie des Kunstwerks. Im Mittelpunkt der Eröouml;rterungen stehen das ästhetische Erlebnis, das Form-Inhalt-Problem im literarischen Kunstwerk und vor allem der Fragenkomplex des ästhetischen Wertes.

We reconsider the Nagelian theory of reduction and argue that, contrary to a widely held view, it is the right analysis of intertheoretic reduction. The alleged difficulties of the theory either vanish upon closer inspection or turn out to be substantive philosophical questions rather than knock-down arguments.

Im zweiten Halbband der Formalontologie wird zunächst das Problem der Identität eines individuellen zeitlich bedingten Gegenstandes erörtert, sodann die Form eines Seinsgebiets und die Form der Welt betrachtet und schließlich, nach der vorbereitenden Analyse seines materialen Wesens, die Form des reinen Bewußtseins untersucht, das als Strom eines reinen Ichs kein Seinsgebiet, sondern ein individueller Gegenstand ist. Erst auf dieser Grundlage werden die möglichen existentialen Beziehungen zwischen dem reinen Bewußtsein und der realen Welt diskutiert. Dabei fällt neues Licht auf die eigentümliche (...) Verkoppelung der Frage nach der Existenz der Welt mit dem Problem des Verhältnisses von Leib, Seele und Bewußtsein. (shrink)

Im ersten Teil der »Formalontologie« werden zunächst alle in Frage kommenden Begriffe der Form, die häufig genug in der Philosophie ohne genügende Klärung verwendet werden, geschieden, analysiert und genau definiert. Die Aufklärung der Grundform des seinsautonomen individuellen Gegenstandes und seiner Abwandlungen - des Ereignisses, des Vorgangs und des in der Zeit verharrenden Gegenstandes - bildet das erste Hauptthema der formalontologischen Untersuchung. Sodann werden die Formen des rein intentionalen Gegenstandes, der Idee, des Sachverhalts und des Verhältnisses analysiert. Die Gegenüberstellung schließlich des (...) Wesens eines zeitlich bedingten Gegenstandes und seiner veränderlichen Bestimmtheiten ermöglicht es, das schwierige Problem der Identität des in der Zeit verharrenden Gegenstandes zu fassen und eine Lösung vorzubereiten, die im zweiten Halbband gegeben wird, ehe das Problem der Form eines Seinsgebietes und insbesondere einer Welt aufgeworfen werden kann. (shrink)

Translated excerpts from works by various authors; original titles and names of the translators given in captions.

Between the zone of certainty beyond all doubt and the zone of incomprehensible uncertainty, the sources of which are nothing but chance, we need to use solid results from a vast interdisciplinarity. We wish to give here a sense of the factors in play and the state of the debate and advance in the territory of how interdisciplinarity may help to solve problems which are common in many areas of knowledge. Chaos and complexity certainly put limits on what we can (...) know. High complexity, asymmetry and/or non-linearity are universal types of imprecision. Can hazard have purpose and direction?The idea is that the more effort we put into project design to cover as many details and possible consequences as possible we can grasp in our in-depth analysis aiming to create the project (in art or science or society), the greater the chances that the random occurrence of the unpredictable event will settle on the project's purpose and direction and not on contrary to them. There is no vicious circle here. This kind of method can explain many good results already obtained in such circumstances. Simplicity, beauty, rationalistic optimism, are features of unshakeable scientific results We may call this feature of scientific theory or art _uniqueness. _Uniqueness is strongly correlated with _essentialization. _Science is working in that sense: to simplify a phenomenon to its essence in order to study it easily without losing anything important in the analysis. That is _essentialization. _Why and how complex systems move to the edge of chaos? And what do they do to stay there? They are in constant struggle to create or keep order in complexity. That is the pattern of self-organization, the specific feature of human nature. That is why our action is meant to build resilience to deal better with unpredictable events and prevent the emergence of a critical threshold. Uncertainty, indeterminacy, randomness, and contradictions appear, not as non-essential substances of debate to be eliminated by explanation, but as everlasting ingredients of our conception of reality. There are compelling reasons to believe that it is impossible to make accurate, nontrivial predictions concerning human behavior. Logic and reason are and remain priority, but unpredictability forces us to imagination and creative thinking. Indeed we are confronted with a new human landscape. The anomalies become the new normal. (shrink)

The earliest writer who deserves to be called a psychologist is Hobbes; and if we consider the time when he wrote, we cannot fail to be surprised at what I may term his prevision of the most important results which have now been established by science. He was the first clearly to sound the note which has ever since constituted the bass, or fundamental tone, of scientific thought. Let us listen to it through the clear instrumentality of his own language:-.

Il est commun, aujourd'hui, d'associer la démocratie au consensus, et ce d'une double manière : d'une part en admettant qu'elle est le meilleur régime politique possible, d'autre part en considérant que l'accord vaut intrinsèquement mieux que le désaccord, et l'entente que le conflit: La qualité de la démocratie tiendrait à ses débats publics, qui à la fois rendent possible la confrontation des points de vue, tout en y mettant fin par l'obtention de consensus éclairés et légitimés par la règle de (...) la majorité. Et si le conflit, au contraire, dans certaines conditions, devait servir de principe à la vie politique? Il ne suffit pas de vivre en démocratie pour rendre la démocratie vivante. La démocratie n'est pas un régime mais un questionnement. Elle exige des citoyens une interrogation continue sur le bien commun à suivre. Machiavel n'était pas un démocrate. Mais c'est étrangement en actualisant sa pensée, dans le sillage des travaux de Lefort, qu'il est possible d'associer le conflit civil avec l'imaginaire social pour redynamiser la démocratie par la tension conflictuelle entre l'idéologie et l'utopie. Penser la démocratie à partir de ce que donne à penser Machiavel : voilà ce que s'efforce de faire Sébastien Roman, pour proposer dans une perspective républicaine le modèle d'un espace public dissensuel."--Page 4 of cover. (shrink)