Wie sollen sich autonome Fahrzeuge verhalten, wenn ein Unfall nicht mehr abwendbar ist? Die Komplexität spezifischer moralischer Dilemmata, die in diesem Kontext auftreten können, lässt bewährte ethische Denktraditionen an ihre Grenzen stoßen. Dieser Aufsatz versteht sich als Versuch, neue Lösungsperspektiven mithilfe einer risikoethischen Sichtweise auf die Problematik zu eröffnen und auf diese Weise deren Relevanz für die Programmierung von ethischen Unfallalgorithmen aufzuzeigen. Im Zentrum steht dabei die Frage, welche Implikationen sich aus einer Auffassung von Dilemma-Situationen als risikoethische Verteilungsprobleme im (...) Hinblick auf die Zulässigkeit von entsprechenden Risikoübertragungen ergeben. Dabei wird zunächst eine risikoethische Interpretation des zugrundeliegenden Entscheidungsproblems skizziert, welches durch seine dilemmatische Struktur eine besondere Risikokonstellation begründet. Ausgehend von den Positionen von Sven Ove Hansson und Julian Nida-Rümelin wird für einen deontologisch-risikoethischen Ansatz argumentiert, der auf Individualrechten einerseits und einer interpersonell gerechten Verteilung der entstehenden Schadensrisiken anderseits basiert. Diese beiden Kriterien werden für den Anwendungskontext des autonomen Fahrens konkretisiert. Zum einen wird in Bezug auf das erste Kriterium argumentiert, dass individuelle Rechte genau dann als angemessen gewahrt gelten können, wenn die resultierenden Risikoübertragungen auf die Einzelnen in ihrer absoluten Höhe jeweils zumutbar sind. Zum anderen werden Schwierigkeiten skizziert, die sich hinsichtlich der konkreten Umsetzung des zweiten Kriteriums der Verteilungsgerechtigkeit ergeben. In diesem Zusammenhang werden beispielsweise ethische Herausforderungen in Bezug auf einen möglichen Vorteilsausgleich, das Prinzip der Schadensminimierung sowie individuell unterschiedliche Ausgangsbedingungen der persönlichen Schadensreduktion kritisch in den Blick genommen. (shrink)

The world of artificial intelligence appears to be in rapid transition, and claims that artificial general intelligence is impossible are competing with concerns that we may soon be seeing Artificial Godlike Intelligence and that we should be very afraid of this prospect. This article discusses the issues from a psychological and social perspective and suggests that with the advent of Generative Artificial Intelligence, something that looks to humans like Artificial General Intelligence has become a distinct possibility as is the idea (...) of making it semi-autonomous: not just responding to discrete external inputs or performing specific tasks but able to prompt itself to create an ongoing stream of cognition that can possess something akin to a ‘purpose’. Add to that the ability of computers to be connected in vast networks, and we can envisage intelligences with staggering amounts of knowledge and reasoning capability, engaging with humans to anticipate and grant wishes. Such Semi-Autonomous Godlike Artificial Intelligences (SAGAIs—meaning ‘engagements’ in Hindi) could end up like Kali, wreaking death and destruction on our species or like Thor, acting as a saviour and protector of humanity. Which of these our SAGAIs most resemble could depend on whose wishes it is designed to serve: a rich oligarchy seeking ever greater wealth and power whatever the cost to others, or a populace that has compassion for each other and for life on the planet. (shrink)

The possibility that autonomous weapons will be deployed on the battlefields of the future raises the challenge of determining who can be held responsible for how these weapons act. Robert Sparrow has argued that it would be impossible to attribute responsibility for autonomous robots' actions to their creators, their commanders, or the robots themselves. This essay reaches a much different conclusion. It argues that the problem of determining responsibility for autonomous robots can be solved by addressing it within the context (...) of the military chain of command. The military hierarchy is a system of distributing responsibility between decision makers on different levels and constraining autonomy. If autonomous weapons are employed as agents operating within this system, then responsibility for their actions can be attributed to their creators and their civilian and military superiors. (shrink)

While Autonomous Weapons Systems have obvious military advantages, there are prima facie moral objections to using them. By way of general reply to these objections, I point out similarities between the structure of law and morality on the one hand and of automata on the other. I argue that these, plus the fact that automata can be designed to lack the biases and other failings of humans, require us to automate the formulation, administration, and enforcement of law as much as (...) possible, including the elements of law and morality that are operated by combatants in war. I suggest that, ethically speaking, deploying a legally competent robot in some legally regulated realm is not much different from deploying a more or less well-armed, vulnerable, obedient, or morally discerning soldier or general into battle, a police officer onto patrol, or a lawyer or judge into a trial. All feature automaticity in the sense of deputation to an agent we do not then directly control. Such relations are well understood and well-regulated in morality and law; so there is not much challenging philosophically in having robots be some of these agents — excepting the implications of the limits of robot technology at a given time for responsible deputation. I then consider this proposal in light of the differences between two conceptions of law. These are distinguished by whether each conception sees law as unambiguous rules inherently uncontroversial in each application; and I consider the prospects for robotizing law on each. Likewise for the prospects of robotizing moral theorizing and moral decision-making. Finally I identify certain elements of law and morality, noted by the philosopher Immanuel Kant, which robots can participate in only upon being able to set ends and emotionally invest in their attainment. One conclusion is that while affectless autonomous devices might be fit to rule us, they would not be fit to vote with us. For voting is a process for summing felt preferences, and affectless devices would have none to weigh into the sum. Since they don't care which outcomes obtain, they don't get to vote on which ones to bring about. (shrink)

Autonomous Agents addresses the related topics of self-control and individual autonomy. "Self-control" is defined as the opposite of akrasia-weakness of will. The study of self-control seeks to understand the concept of its own terms, followed by an examination of its bearing on one's actions, beliefs, emotions, and personal values. It goes on to consider how a proper understanding of self-control and its manifestations can shed light on personal autonomy and autonomous behaviour. Perspicuous, objective, and incisive throughout, Alfred Mele makes a (...) convincing case for the value of individual autonomy. (shrink)

One of the several reasons given in calls for the prohibition of autonomous weapons systems (AWS) is that they are against human dignity (Asaro, 2012; Docherty, 2014; Heyns, 2017; Ulgen, 2016). However there have been criticisms of the reliance on human dignity in arguments against AWS (Birnbacher, 2016; Pop, 2018; Saxton, 2016). This paper critically examines the relationship between human dignity and autonomous weapons systems. Three main types of objection to AWS are identified; (i) arguments based on technology and the (...) ability of AWS to conform to International Humanitarian Law; (ii) deontological arguments based on the need for human judgement and meaningful human control, including arguments based on human dignity; (iii) consequentialist reasons about their effects on global stability and the likelihood of going to war. An account is provided of the claims made about human dignity and AWS, of the criticisms of these claims, and of the several meanings of ‘dignity’. It is concluded that although there are several ways in which AWS can be said to be against human dignity, they are not unique in this respect. There are other weapons, and other technologies, that also compromise human dignity. Given this, and the ambiguities inherent in the concept, it is wiser to draw on several types of objections in arguments against AWS, and not to rely exclusively on human dignity. (shrink)

Autonomous Knowledge: Radical Enhancement, Autonomy, and the Future of Knowing motivates and develops a new research programme in epistemology that is centred around the concept of epistemic autonomy.

Lethal Autonomous Weapons (LAWs) have becomes the subject of continuous debate both at national and international levels. Arguments have been proposed both for the development and use of LAWs as well as their prohibition from combat landscapes. Regardless, the development of LAWs continues in numerous nation-states. This paper builds upon previous philosophical arguments for the development and use of LAWs and proposes a design framework that can be used to ethically direct their development. The conclusion is that the philosophical arguments (...) that underpin the adoption of LAWs rather than not, although prima facie insufficient, can be actualized through the proposed Value Sensitive Design (VSD) approach. Hence, what is proposed is a principled design approach that can be used to embed stakeholder values into a design, encourage stakeholder cooperation and coordination and as a result promote social acceptance of LAWs as a preferable future fact of war. (shrink)

While autonomous vehicles (AVs) are not designed to harm people, harming people is an inevitable by-product of their operation. How are AVs to deal ethically with situations where harming people is inevitable? Rather than focus on the much-discussed question of what choices AVs should make, we can also ask the much less discussed question of who gets to decide what AVs should do in such cases. Here there are two key options: AVs with a personal ethics setting (PES) or an (...) “ethical knob” that end users can control or AVs with a mandatory ethics setting (MES) that end users cannot control. Which option, a PES or an MES, is best and why? This chapter argues, by drawing on the choice architecture literature, in favor of a hybrid view that requires mandated default choice settings while allowing for limited end user control. (shrink)

Autonomous weapons systems (AWS), sometimes referred to as “killer robots”, are receiving evermore attention, both in public discourse as well as by scholars and policymakers. Much of this interest is connected with emerging ethical and legal problems linked to increasing autonomy in weapons systems, but there is a general underappreciation for the ways in which existing law might impact on these new technologies. In this paper, we argue that as AWS become more sophisticated and increasingly more capable than flesh-and-blood soldiers, (...) it will increasingly be the case that such soldiers are “in the power” of those AWS which fight against them. This implies that such soldiers ought to be considered hors de combat, and not targeted. In arguing for this point, we draw out a broader conclusion regarding hors de combat status, namely that it must be viewed contextually, with close reference to the capabilities of combatants on both sides of any discreet engagement. Given this point, and the fact that AWS may come in many shapes and sizes, and can be made for many different missions, we argue that each particular AWS will likely need its own standard for when enemy soldiers are deemed hors de combat. We conclude by examining how these nuanced views of hors de combat status might impact on meaningful human control of AWS. (shrink)

Autonomy is a vital concept in much of modern theory, defining the Subject as capable of self-governance. Democratic theory relies on the concept of autonomy to provide justification for participatory government and the normative goal of democratic governance, which is to protect the ability of the individual to self-govern. Offering the first examination of the concept of autonomy from a postfoundationalist perspective, _The Autonomous Animal _analyzes how the ideal of self-governance has shaped everyday life. Claire E. Rasmussen begins by considering (...) the academic terrain of autonomy, then focusing on specific examples of political behavior that allow her to interrogate these theories. She demonstrates how the adolescent—a not-yet-autonomous subject—highlights how the ideal of self-governance generates practices intended to cultivate autonomy by forming the individual’s relationship to his or her body. She points up how the war on drugs rests on the perception that drug addicts are the antithesis of autonomy and thus must be regulated for their own good. Showing that the animal rights movement may challenge the distinction between human and animal, Rasmussen also examines the place of the endurance athlete in fitness culture, where self-management of the body is the exemplar of autonomous subjectivity. (shrink)

In order to be a self-governing agent, a person must govern the process by means of which she acquires the intention to act as she does. But what does governing this process require? The standard compatibilist answers to this question all assume that autonomous actions differ from nonautonomous actions insofar as they are a more perfect expression of the agent’s agency. I challenge this conception of autonomous agents as super agents. The distinguishing feature of autonomous agents is, I argue, the (...) nonagential role they play in the formation of their intentions. I offer an account of the relevant role. (shrink)

Enhancement of autonomous choice may be considered as an important reason for facilitating the use of genetic tests such as preimplantation genetic diagnosis. The principle of respect for autonomy is a crucial component not only of Western liberal traditions but also of Western bioethics. This is especially so in bioethical discussions and analyses of clinical encounters within medicine. On the basis of an analysis of qualitative research interviews performed with British, Italian and Swedish geneticists and gynaecologists on ethical aspects of (...) preimplantation genetic diagnosis, the plausibility of the notion of autonomy within reproductive medicine is discussed. The analysis of interviews indicates not only that there is a gap between theoretical discussions and concrete practice, but also that an increase in choice — paradoxically — can hamper couples' choice. (shrink)

To many, the idea of autonomous weapons systems (AWS) killing human beings is grotesque. Yet critics have had difficulty explaining why it should make a significant moral difference if a human combatant is killed by an AWS as opposed to being killed by a human combatant. The purpose of this paper is to explore the roots of various deontological concerns with AWS and to consider whether these concerns are distinct from any concerns that also apply to long- distance, human-guided weaponry. (...) We suggest that at least one major driver of the intuitive moral aversion to lethal AWS is that their use disrespects their human targets by violating the martial contract between human combatants. On our understanding of this doctrine, service personnel cede a right not to be directly targeted with lethal violence to other human agents alone. Artificial agents, of which AWS are one example, cannot understand the value of human life. A human combatant cannot transfer his privileges of targeting enemy combatants to a robot. Therefore, the human duty-holder who deploys AWS breaches the martial contract between human combatants and disrespects the targeted combatants. We consider whether this novel deontological objection to AWS forms the foundation of several other popular yet imperfect deontological objections to AWS. (shrink)

In this paper, we argue that solutions to normative challenges associated with autonomous driving, such as real-world trolley cases or distributions of risk in mundane driving situations, face the problem of reasonable pluralism: Reasonable pluralism refers to the fact that there exists a plurality of reasonable yet incompatible comprehensive moral doctrines within liberal democracies. The corresponding problem is that a politically acceptable solution cannot refer to only one of these comprehensive doctrines. Yet a politically adequate solution to the normative challenges (...) of autonomous driving need not come at the expense of an ethical solution, if it is based on moral beliefs that are (1) shared in an overlapping consensus and (2) systematized through public reason. Therefore, we argue that a Rawlsian justificatory framework is able to adequately address the normative challenges of autonomous driving and elaborate on how such a framework might be employed for this purpose. (shrink)

Due to advances in military technology, there has been an outpouring of research on what are known as autonomous weapon systems (AWS). However, it is common in this literature for arguments to be made without first making clear exactly what definitions one is employing, with the detrimental effect that authors may speak past one another or even miss the targets of their arguments. In this article I examine the U.S. Department of Defense and International Committee of the Red Cross definitions (...) of AWS, showing that these definitions are far broader than some recognize, and that they therefore classify a much larger set of weapons as AWS. I then show that these broader views of AWS have implications for what moral and legal rules we might argue should be applied to such systems. I conclude by arguing there is a greater need for precision and clarity within AWS debates, in order to ensure that researchers are discussing the same weapon systems (autonomous or otherwise) when they argue for or against particular points. The purpose of this article is not to defend any specific view of AWS, nor to further any general endorsement or objection to such systems, but rather to show the importance of argumentative clarity in this debate. (shrink)

Ryan Tonkens has issued a seemingly impossible challenge, to articulate a comprehensive ethical framework within which artificial moral agents satisfy a Kantian inspired recipe—"rational" and "free"—while also satisfying perceived prerogatives of machine ethicists to facilitate the creation of AMAs that are perfectly and not merely reliably ethical. This series of papers meets this challenge by landscaping traditional moral theory in resolution of a comprehensive account of moral agency. The first paper established the challenge and set out autonomy in Aristotelian terms. (...) The present paper interprets Kantian moral theory on the basis of the preceding introduction, argues contra Tonkens that an engineer does not violate the categorical imperative in creating Kantian AMAs, and proposes that a Kantian AMA is not only a possible goal for Machine ethics research, but a necessary one. (shrink)

The digital revolution, in the form of autonomous driving, is changing the very essence of mobility. This paper discusses four different ways in which these transformations are taking place and argues that public policies and business strategies need to focus on innovating and re-engineering (enveloping) whole environments. Only then will autonomous vehicles become an ordinary – and environmentally sustainable – reality. -/- .

A classic objection to autonomous weapon systems (AWS) is that these could create so-called responsibility gaps, where it is unclear who should be held responsible in the event that an AWS were to violate some portion of the law of armed conflict (LOAC). However, those who raise this objection generally do so presenting it as a problem for AWS as a whole class of weapons. Yet there exists a rather wide range of systems that can be counted as “autonomous weapon (...) systems”, and so the objection is too broad. In this article I present a taxonomic approach to the objection, examining a number of systems that would count as AWS under the prevalent definitions provided by the United States Department of Defense and the International Committee of the Red Cross, and I show that for virtually all such systems there is a clear locus of responsibility which presents itself as soon as one focuses on specific systems, rather than general notions of AWS. In developing these points, I also suggest a method for dealing with near-future types of AWS which may be thought to create situations where responsibility gaps can still arise. The main purpose of the arguments is, however, not to show that responsibility gaps do not exist or can be closed where they do exist. Rather, it is to highlight that any arguments surrounding AWS must be made with reference to specific weapon platforms imbued with specific abilities, subject to specific limitations, and deployed to specific times and places for specific purposes. More succinctly, the arguments show that we cannot and should not aim to treat AWS as if all of these shared all morally relevant features, but instead on a case-by-case basis. Thus, we must contend with the realities of weapons development and deployment, and tailor our arguments and conclusions to those realities, and with an eye to what facts obtain for particular systems fulfilling particular combat roles. (shrink)

Will future lethal autonomous weapon systems (LAWS), or ‘killer robots’, be a threat to humanity? The European Parliament has called for a moratorium or ban of LAWS; the ‘Contracting Parties to the Geneva Convention at the United Nations’ are presently discussing such a ban, which is supported by the great majority of writers and campaigners on the issue. However, the main arguments in favour of a ban are unsound. LAWS do not support extrajudicial killings, they do not take responsibility away (...) from humans; in fact they increase the abil-ity to hold humans accountable for war crimes. Using LAWS in war would probably reduce human suffering overall. Finally, the availability of LAWS would probably not increase the probability of war or other lethal conflict—especially as compared to extant remote-controlled weapons. The widespread fear of killer robots is unfounded: They are probably good news. (shrink)

The phenomenological goal of grounding the content of conceptual thought in the background understanding of everyday, skillful coping was approached using evolutionary autonomous agent methodology. The behavior of an EAA evolved to perform a specified motor task was identified with skillful coping. Changes in the dynamics of the EAA controller occurred when the EAA encountered an unexpected obstacle with loss of longer time scale components in its hierarchical temporal organization. These temporal changes are consistent with the phenomenological changes which we (...) experience with breakdown during equipment use with our adoption of a more immediate, determinate stance. Since this latter experience is the basis of conceptual thought, the EAA paradigm goes some way in providing a naturalized explanation for the grounding of the content of conceptual thought in everyday, skillful coping in a manner that is physiologically plausible and phenomenologically accurate. (shrink)

The prospective introduction of autonomous cars into public traffic raises the question of how such systems should behave when an accident is inevitable. Due to concerns with self-interest and liberal legitimacy that have become paramount in the emerging debate, a contractarian framework seems to provide a particularly attractive means of approaching this problem. We examine one such attempt, which derives a harm minimisation rule from the assumptions of rational self-interest and ignorance of one’s position in a future accident. We contend, (...) however, that both contractarian approaches and harm minimisation standards are flawed, due to a failure to account for the fundamental difference between those ‘involved’ and ‘uninvolved’ in an impending crash. Drawing from classical works on the trolley problem, we show how this notion can be substantiated by reference to either the distinction between negative and positive rights, or to differences in people’s claims. By supplementing harm minimisation with corresponding constraints, we can develop crash algorithms for autonomous cars which are both ethically adequate and promise to overcome certain significant practical barriers to implementation. (shrink)

In this article, we focus on the scholarly and policy debate on autonomous weapon systems and particularly on the objections to the use of these weapons which rest on jus ad bellum principles of proportionality and last resort. Both objections rest on the idea that AWS may increase the incidence of war by reducing the costs for going to war or by providing a propagandistic value. We argue that whilst these objections offer pressing concerns in their own right, they suffer (...) from important limitations: they overlook the difficulties of calculating ad bellum proportionality; confuse the concept of proportionality of effects with the precision of weapon systems; disregard the ever-changing nature of war and of its ethical implications; mistake the moral obligation imposed by the principle of last resort with the impact that AWS may have on political decision to resort to war. Our analysis does not entail that AWS are acceptable or justifiable, but it shows that ad bellum principles are not the best set of ethical principles for tackling the ethical problems raised by AWS; and that developing adequate understanding of the transformations that the use of AWS poses to the nature of war itself is a necessary, preliminary requirement to any ethical analysis of the use of these weapons. (shrink)

Several recent lines of inquiry have pointed to the amygdala as a potential lesion site in autism. Because one function of the amygdala may be to produce autonomic arousal at the sight of a significant face, we compared the responses of autistic children to their mothers’ face and to a plain paper cup. Unlike normals, the autistic children as a whole did not show a larger response to the person than to the cup. We also monitored sympathetic activity in autistic (...) children as they engaged in a wide range of everyday behaviours. The children tended to use self-stimulation activities in order to calm hyper-responsive activity of the sympathetic (`fight or flight’) branch of the autonomic nervous system. A small percentage of our autistic subjects had hyporesponsive sympathetic activity, with essentially no electrodermal responses except to self-injurious behaviour. We sketch a hypothesis about autism according to which autistic children use overt behaviour in order to control a malfunctioning autonomic nervous system and suggest that they have learned to avoid using certain processing areas in the temporal lobes. (shrink)

Autonomous vehicles have the potential to save tens of thousands of lives, but legal and social barriers may delay or even deter manufacturers from offering fully automated vehicles and thereby cost lives that otherwise could be saved. Moral philosophers use “thought experiments” to teach us about what ethics might say about the ethical behavior of AVs. If a manufacturer designing an AV decided to make what it believes is an ethical choice to save a large group of lives by steering (...) away from the large group towards a single individual, could the manufacturer be liable to that single individual? I believe the answer is yes. This article discusses famous “trolley problem” thought experiments in moral philosophy, which news articles have recently applied to AVs. After establishing a hypothetical case, applying product liability law to AV behavior may show a way, in some jurisdictions, that will permit a manufacturer to implement an ethical choice without triggering liability, but liability risk remains. I then turn to possible traditional defenses to see if they prevent liability for a manufacturer making what it believes is an ethical design choice—necessity, defense of self, and the sudden emergency doctrine. None of them provides an effective defense. Under current law, maximizing collision avoidance appears to minimize legal risk. I conclude that the only way to provide effective protection to a manufacturer seeking to implement ethical choices about AV behavior is through special legislation or regulation. (shrink)

This chapter discusses how research in situationist social psychology may pose largely undiscussed threats to autonomous agency, free will, and moral responsibility.

Predictions about autonomous weapon systems are typically thought to channel fears that drove all the myths about intelligence embodied in matter. One of these is the idea that the technology can get out of control and ultimately lead to horrifi c consequences, as is the case in Mary Shelley’s classic Frankenstein. Given this, predictions about AWS are sometimes dismissed as science-fiction fear-mongering. This paper considers several analogies between AWS and other weapon systems and ultimately offers an argument that nuclear weapons (...) and their effect on the development of modern asymmetrical warfare are the best analogy to the introduction of AWS. The fi nal section focuses on this analogy and offers speculations about the likely consequences of AWS being hacked. These speculations tacitly draw on myths and tropes about technology and AI from popular fi ction, such as Frankenstein, to project a convincing model of the risks and benefi ts of AWS deployment. (shrink)

When a computer system causes harm, who is responsible? This question has renewed significance given the proliferation of autonomous systems enabled by modern artificial intelligence techniques. At the root of this problem is a philosophical difficulty known in the literature as the responsibility gap. That is to say, because of the causal distance between the designers of autonomous systems and the eventual outcomes of those systems, the dilution of agency within the large and complex teams that design autonomous systems, and (...) the impossibility of fully predicting how autonomous systems will behave once deployed, determining who is morally responsible for harms caused by autonomous systems is unclear at a conceptual level. I review past work on this topic, criticizing prior works for suggesting workarounds rather than philosophical answers to the conceptual problem presented by the responsibility gap. The view I develop, drawing on my earlier work on vicarious moral responsibility, explains why computing professionals are ethically required to take responsibility for the systems they design, despite not being blameworthy for the harms these systems may cause. (shrink)

The introduction of Autonomous Military Systems (AMS) onto contemporary battlefields raises concerns that they will bring with them the possibility of a techno-responsibility gap, leaving insecurity about how to attribute responsibility in scenarios involving these systems. In this work I approach this problem in the domain of applied ethics with foundational conceptual work on autonomy and responsibility. I argue that concerns over the use of AMS can be assuaged by recognising the richly interrelated context in which these systems will most (...) likely be deployed. This will allow us to move beyond the solely individualist understandings of responsibility at work in most treatments of these cases, toward one that includes collective responsibility. This allows us to attribute collective responsibility to the collectives of which the AMS form a part, and to account for the distribution of burdens that follows from this attribution. I argue that this expansion of our responsibility practices will close at least some otherwise intractable techno-responsibility gaps. (shrink)

Unlike human soldiers, autonomous weapons systems are unaffected by psychological factors that would cause them to act outside the chain of command. This is a compelling moral justification for their development and eventual deployment in war. To achieve this level of sophistication, the software that runs AWS will have to first solve two problems: the frame problem and the representation problem. Solutions to these problems will inevitably involve complex software. Complex software will create security risks and will make AWS critically (...) vulnerable to hacking. I claim that the political and tactical consequences of hacked AWS far outweigh the purported advantages of AWS not being affected by psychological factors and always following orders. Therefore, one of the moral justifications for the deployment of AWS is undermined. (shrink)

Introduction It is increasingly considered important that people make an autonomous and informed decision concerning colorectal cancer screening. However, the realisation of autonomy within the concept of informed decision-making might be interpreted too narrowly. Additionally, relatively little is known about what the eligible population believes to be a 'good' screening decision. Therefore, we aimed to explore how the concepts of autonomous and informed decision-making relate to how the eligible CRC screening population makes their decision and when they believe to have (...) made a 'good' screening decision. Methods We conducted 27 semi-structured interviews with the eligible CRC screening population. The general topics discussed concerned how people made their CRC screening decision, how they experienced making this decision and when they considered they had made a 'good' decision. Results Most interviewees viewed a 'good' CRC screening decision as one based on both reasoning and feeling/intuition, and that is made freely. However, many CRC screening non-participants experienced a certain social pressure to participate. All CRC screening non-participants viewed making an informed decision as essential. This appeared to be the case to a lesser extent for CRC screening participants. For most, experiences and values were involved in their decision-making. Conclusion Our sample of the eligible CRC screening population viewed aspects related to the concepts of autonomous and informed decision-making as important for making a 'good' CRC screening decision. However, in particular the existence of a social norm may be affecting a true autonomous decision-making process. Additionally, the present concept of informed decision-making with its strong emphasis on making a fully informed and well-considered decision does not appear to be entirely reflective of the process in practice. More efforts could be made to attune to the diverse values and factors that are involved in deciding about CRC screening participation. (shrink)

We propose that the prevalent moral aversion to AWS is supported by a pair of compelling objections. First, we argue that even a sophisticated robot is not the kind of thing that is capable of replicating human moral judgment. This conclusion follows if human moral judgment is not codifiable, i.e., it cannot be captured by a list of rules. Moral judgment requires either the ability to engage in wide reflective equilibrium, the ability to perceive certain facts as moral considerations, moral (...) imagination, or the ability to have moral experiences with a particular phenomenological character. Robots cannot in principle possess these abilities, so robots cannot in principle replicate human moral judgment. If robots cannot in principle replicate human moral judgment then it is morally problematic to deploy AWS with that aim in mind. Second, we then argue that even if it is possible for a sufficiently sophisticated robot to make ‘moral decisions’ that are extensionally indistinguishable from (or better than) human moral decisions, these ‘decisions’ could not be made for the right reasons. This means that the ‘moral decisions’ made by AWS are bound to be morally deficient in at least one respect even if they are extensionally indistinguishable from human ones. Our objections to AWS support the prevalent aversion to the employment of AWS in war. They also enjoy several significant advantages over the most common objections to AWS in the literature. (shrink)

In many evolutionary/functionalist theories, emotions organize the activity of the autonomic nervous system and other physiological systems. Two kinds of patterned activity are discussed: coherence, and specificity. For each kind of patterning, significant methodological obstacles are considered that need to be overcome before empirical studies can adequately test theories and resolve controversies. Finally, links that coherence and specificity have with health and well-being are considered.

The question of whether new rules or regulations are required to govern, restrict, or even prohibit the use of autonomous weapon systems has been the subject of debate for the better part of a decade. Despite the claims of advocacy groups, the way ahead remains unclear since the international community has yet to agree on a specific definition of Lethal Autonomous Weapon Systems and the great powers have largely refused to support an effective ban. In this vacuum, the public has (...) been presented with a heavily one-sided view of Killer Robots. This interdisciplinary volume presents a more nuanced approach to autonomous weapon systems that recognizes the need to progress beyond a discourse framed by the Terminator and HAL 9000. Re-shaping the discussion around this emerging military innovation requires a new line of thought and a willingness to challenge the orthodoxy. Lethal Autonomous Weapons focuses on exploring the moral and legal issues associated with the design, development and deployment of lethal autonomous weapons. The volume brings together some of the most prominent academics and academic-practitioners in the lethal autonomous weapons space and seeks to return some balance to the debate. As part of this effort, it recognizes that society needs to invest in hard conversations that tackle the ethics, morality, and law of these new digital technologies and understand the human role in their creation and operation. (shrink)

"A runaway trolley is speeding down a track" So begins what is perhaps the most fecund thought experiment of the past several decades since its invention by Philippa Foot. Since then, moral philosophers have applied the "trolley problem" as a thought experiment to study many different ethical conflicts - and chief among them is the programming of autonomous vehicles. Nowadays, however, very few philosophers accept that the trolley problem is a perfect analogy for driverless cars or that the situations autonomous (...) vehicles face will resemble the forced choice of the unlucky bystander in the original thought experiment. This book represents a substantial and purposeful effort to move the academic discussion beyond the trolley problem to the broader ethical, legal, and social implications that autonomous vehicles present. There are still urgent questions waiting to be addressed, for example: how AVs might interact with human drivers in mixed or "hybrid" traffic environments; how AVs might reshape our urban landscapes; what unique security or privacy concerns are raised by AVs as connected devices in the "Internet of Things"; how the benefits and burdens of this new technology, including mobility, traffic congestion, and pollution, will be distributed throughout society; and more. An attempt to map the landscape of these next-generation questions and to suggest preliminary answers, this volume draws on the disciplines of philosophy, sociology, economics, urban planning and transportation engineering, business ethics and more, and represents a global range of perspectives. (shrink)

The recent progress in the development of autonomous cars has seen ethical questions come to the forefront. In particular, life and death decisions regarding the behavior of self-driving cars in trolley dilemma situations are attracting widespread interest in the recent debate. In this essay we want to ask whether we should implement a mandatory ethics setting for the whole of society or, whether every driver should have the choice to select his own personal ethics setting. While the consensus view seems (...) to be that people would not be willing to use an automated car that might sacrifice themselves in a dilemma situation, we will defend the somewhat contra-intuitive claim that this would be nevertheless in their best interest. The reason is, simply put, that a PES regime would most likely result in a prisoner’s dilemma. (shrink)

This article examines how people with type 2 diabetes perceive autonomous decision making and which moral capacities they consider important in diabetes nurses' support of autonomous decision making. Fifteen older adults with type 2 diabetes were interviewed in a nurse-led unit. First, the data were analysed using the grounded theory method. The participants described a variety of decision-making processes in the nurse and family care-giver context. Later, descriptions of the decision-making processes were analysed using hermeneutic text interpretation. We suggest first- (...) and second-order moral capacities that nurses specializing in diabetes need to promote the autonomous decision making of their patients. We recommend nurses to engage in ongoing, interactive reflective practice to further develop these moral capacities. (shrink)

Effective robots and autonomous systems must be trustworthy. This chapter examines models of trustworthiness from a philosophical and empirical perspective to inform the design and adoption of autonomous systems. Trustworthiness is a property of trusted agents or organisations that engenders trust in other agent or organisations. Trust is a complex phenomena defined differently depending on the discipline. This chapter aims to bring different approaches under a single framework for investigation with three sorts of questions: Who or what is trustworthy?–metaphysics. How (...) do we know who or what is trustworthy?–epistemology. What factors influence what or who should we trust?–normativity. A two-component model of trust is used that incorporates competence (skills, reliability and experience) and integrity (motives, honesty and character). It is supposed that human levels of competence yield the highest trust whereas trust is reduced at sub-human and super-human levels. The threshold for trustworthiness of an agent or organisation in a particular context is a function of their relationship with the truster and potential impacts of decisions. Building trustworthy autonomous systems requires obeying the norms of logic, rationality and ethics under pragmatic constraints–even though there is disagreement on these principles by experts. Autonomous systems may need sophisticated social identities including empathy and reputational concerns to build human-like trust relationships. Ultimately transdisciplinary research drawing on metaphysical, epistemological and normative human and machine theories of trust are needed to design trustworthy autonomous systems for adoption. (shrink)

In 2017, the German ethics commission for automated and connected driving released 20 ethical guidelines for autonomous vehicles. It is now up to the research and industrial sectors to enhance the development of autonomous vehicles based on such guidelines. In the current state of the art, we find studies on how ethical theories can be integrated. To the best of the authors’ knowledge, no framework for motion planning has yet been published which allows for the true implementation of any practical (...) ethical policies. This paper makes four contributions: Firstly, we briefly present the state of the art based on recent works concerning unavoidable accidents of autonomous vehicles (AVs) and identify further need for research. While most of the research focuses on decision strategies in moral dilemmas or crash optimization, we aim to develop an ethical trajectory planning for all situations on public roads. Secondly, we discuss several ethical theories and argue for the adoption of the theory “ethics of risk.” Thirdly, we propose a new framework for trajectory planning, with uncertainties and an assessment of risks. In this framework, we transform ethical specifications into mathematical equations and thus create the basis for the programming of an ethical trajectory. We present a risk cost function for trajectory planning that considers minimization of the overall risk, priority for the worst-off and equal treatment of people. Finally, we build a connection between the widely discussed trolley problem and our proposed framework. (shrink)

A number of companies including Google and BMW are currently working on the development of autonomous cars. But if fully autonomous cars are going to drive on our roads, it must be decided who is to be held responsible in case of accidents. This involves not only legal questions, but also moral ones. The first question discussed is whether we should try to design the tort liability for car manufacturers in a way that will help along the development and improvement (...) of autonomous vehicles. In particular, Patrick Lin’s concern that any security gain derived from the introduction of autonomous cars would constitute a trade-off in human lives will be addressed. The second question is whether it would be morally permissible to impose liability on the user based on a duty to pay attention to the road and traffic and to intervene when necessary to avoid accidents. Doubts about the moral legitimacy of such a scheme are based on the notion that it is a form of defamation if a person is held to blame for causing the death of another by his inattention if he never had a real chance to intervene. Therefore, the legitimacy of such an approach would depend on the user having an actual chance to do so. The last option discussed in this paper is a system in which a person using an autonomous vehicle has no duty of interfering, but is still held responsible for possible accidents. Two ways of doing so are discussed, but only one is judged morally feasible. (shrink)

_Autonome Praxis und intelligible Welt_ provides a reconstruction of Kant’s theory of freedom including the concept of transcendental-practical freedom as a specific type of action based on principles and reasons.

To many, the idea of autonomous weapons systems (AWS) killing human beings is grotesque. Yet critics have had difficulty explaining why it should make a significant moral difference if a human combatant is killed by an AWS as opposed to being killed by a human combatant. The purpose of this paper is to explore the roots of various deontological concerns with AWS and to consider whether these concerns are distinct from any concerns that also apply to long-distance, human-guided weaponry. We (...) suggest that at least one major driver of the intuitive moral aversion to lethal AWS is that their use disrespects their human targets by violating the martial contract between human combatants. On our understanding of this doctrine, service personnel cede a right not to be directly targeted with lethal violence to other human agents alone. Artificial agents, of which AWS are one example, cannot understand the value of human life. A human combatant cannot transfer his privileges of targeting enemy combatants to a robot. Therefore, the human duty-holder who deploys AWS breaches the martial contract between human combatants and disrespects the targeted combatants. We consider whether this novel deontological objection to AWS forms the foundation of several other popular yet imperfect deontological objections to AWS. (shrink)

Despite resistance from various societal actors, the development and deployment of lethal autonomous weaponry to warzones is perhaps likely, considering the perceived operational and ethical advantage such weapons are purported to bring. In this paper, it is argued that the deployment of truly autonomous weaponry presents an ethical danger by calling into question the ability of such weapons to abide by the Laws of War. This is done by noting the resonances between battlefield target identification and the process of ontic-ontological (...) investigation detailed in Martin Heidegger’s Being and Time, before arguing that the nature of lethal autonomous weaponry precludes them from being able to engage in such investigations—a key requisite for abiding by the relevant legislation that governs battlefield conduct. (shrink)

Autonomous vehicles (AVs) are expected to improve road traffic safety and save human lives. It is also expected that some AVs will encounter so-called dilemmatic situations, like choosing between saving two passengers by sacrificing one pedestrian or choosing between saving three pedestrians by sacrificing one passenger. These expectations fuel the extensive debate over the ethics settings of AVs: the way AVs should be programmed to act in dilemmatic situations and who should decide about the nature of this programming in the (...) first place. In the article, the ethics settings problem is analyzed as a trilemma between AVs with personal ethics setting (PES), AVs with mandatory ethics setting (MES) and AVs with no ethics settings (NES). It is argued that both PES and MES, by being programmed to choose one human life over the other, are bound to cause serious moral damage resulting from the violation of several principles central to deontology and utilitarianism. NES is defended as the only plausible solution to this trilemma, that is, as the solution that sufficiently minimizes the number of traffic fatalities without causing any comparable moral damage. (shrink)

This paper concerns the question of whether any normative commitments necessarily accompany autonomous agency. Substantive theories claim that they do; content-neutral theories deny this. In this paper I argue that it is possible to defend a substantive account without arguing in favor of any particular normative commitments that must accompany autonomous agency. A proper appreciation of what it means for an account to be normatively substantive, coupled with an understanding of what is involved in any putatively content-neutral account of autonomy, (...) implies that all content-neutral autonomy accounts necessarily involve substantive normative commitments, in at least one important sense. On almost all accounts, the development of autonomy requires an agent to satisfy certain conditions and master certain skills. Yet it would not be possible to satisfy the conditions or master those skills unless the agent possesses, or at least possessed, normative commitments to ways of life that render their development possible. (shrink)