La culture judéo-chrétienne poussant l’homme à se méfier de sa créature, la question se pose de savoir comment le protéger contre les robots. Cette protection passe tout d’abord par les règles juridiques susceptibles de s’appliquer en robotique. Aujourd’hui, nous disposons d’un certain nombre d’outils juridiques qui permettent d’ores et déjà de protéger l’homme contre les dangers pour sa santé ou sa sécurité que le robot pourrait présenter. Toutefois, les progrès de la robotique auront une influence considérable sur l’homme (...) et la société. Ainsi, l’examen de la protection de l’homme contre le robot ne saurait évincer la question portant sur les risques éthiques de la machine, pour lesquels le législateur pourrait être beaucoup moins préparé. (shrink)

L’intelligence artificielle (IA) est une notion propice aux fantasmes. En pratique, elle désigne notamment une technologie permettant à des machines de réaliser des choses que les humains qualifient d’intelligentes. Le rapport que l’intelligence artificielle entretient avec le droit se situe essentiellement à deux niveaux. D’une part on peut traiter, grâce à l’intelligence artificielle, le droit comme un objet mathématique, ce qui permet de quantifier l’ aléa judiciaire. Dans ce cadre, la machine ne singe pas le raisonnement du juge mais permet (...) de mieux mesurer les issues possibles et leurs probabilités, dans l’espoir de favoriser les solutions amiables. D’autre part, l’intelligence artificielle est un domaine du droit naissant dont les juristes doivent se saisir. Le droit n’est pas démuni face aux multiples enjeux qui existent en ce domaine, qu’il s’agisse de robotique autonome ou de systèmes experts. La responsabilité du fait des choses et la responsabilité du fait des produits défectueux sont les deux voies à explorer principalement. Les juges devront traiter ces sujets nouveaux dans les prochaines années, en comblant certaines lacunes du droit, lequel évoluera à son tour. (shrink)

Des objets connectés aux choses intelligentes, les artefacts qui assistent ou supplantent l’action humaine invitent l’assureur à réinventer son métier. De fait, ces technologies lui offre de traiter des données massives en fonction desquelles il pourra affiner ses prestations jusqu’à les individualiser, égratignant au passage les canons traditionnels de l’assurance, dont la mutualisation des risques. L’identification de ces risques est également bousculée par la robotique et ses déclinaisons. À mesure que l’individu abdique son pouvoir de contrôle au profit de (...) machines autonomes, le risque saisi par l’assurance se transforme et se déplace, tout comme évolue en contrepoint le droit de la responsabilité civile. (shrink)

En s’appuyant sur les résultats de la psychologie évolutionniste, nous examinons les différentes fonctions importantes que puisse remplir la conscience dans les robots autonomes : action contrôlée, prise de conscience, conscience de soi, métacognition, conscience du moi. Nous distinguons l’intentionnalité intrinsèque de la conscience, mais soutenons également l’importance de la compréhension de la cognition robotique. Enfin, nous étudions le « Hard Problem » concernant les robots, c’est-à-dire la question de savoir s’ils peuvent connaître une prise de conscience subjective, dans (...) une perspective de la théorie du protophénomène. (shrink)

En 1996, le terme de « cobot », contraction de « robotique collaborative », apparut sous la plume de deux chercheurs américains travaillant pour l’industrie automobile. Il s’applique aujourd’hui à un nouveau champ de la recherche en robotique, la « cobotique », qui s’attache à concevoir des machines asservies ou pseudo-autonomes susceptibles d’être utilisées au sein d’un environnement humain. Le cobot se différencie donc essentiellement du robot par son absence d’autonomie puisque, par définition, il ne peut pas fonctionner (...) sans l’action d’un opérateur. L’approche collaborative, tout en dépassant la simple « utilisation » qui pourrait être faite d’un outil, valorise le travail de l’humain et laisse présager d’une meilleure acceptabilité sociale du cobot, qui n’aurait pas pour vocation de remplacer l’homme, mais de l’épauler. (shrink)

Lethal Autonomous Weapons (LAWs) have becomes the subject of continuous debate both at national and international levels. Arguments have been proposed both for the development and use of LAWs as well as their prohibition from combat landscapes. Regardless, the development of LAWs continues in numerous nation-states. This paper builds upon previous philosophical arguments for the development and use of LAWs and proposes a design framework that can be used to ethically direct their development. The conclusion is that the philosophical arguments (...) that underpin the adoption of LAWs rather than not, although prima facie insufficient, can be actualized through the proposed Value Sensitive Design (VSD) approach. Hence, what is proposed is a principled design approach that can be used to embed stakeholder values into a design, encourage stakeholder cooperation and coordination and as a result promote social acceptance of LAWs as a preferable future fact of war. (shrink)

The possibility that autonomous weapons will be deployed on the battlefields of the future raises the challenge of determining who can be held responsible for how these weapons act. Robert Sparrow has argued that it would be impossible to attribute responsibility for autonomous robots' actions to their creators, their commanders, or the robots themselves. This essay reaches a much different conclusion. It argues that the problem of determining responsibility for autonomous robots can be solved by addressing it within the context (...) of the military chain of command. The military hierarchy is a system of distributing responsibility between decision makers on different levels and constraining autonomy. If autonomous weapons are employed as agents operating within this system, then responsibility for their actions can be attributed to their creators and their civilian and military superiors. (shrink)

One of the several reasons given in calls for the prohibition of autonomous weapons systems (AWS) is that they are against human dignity (Asaro, 2012; Docherty, 2014; Heyns, 2017; Ulgen, 2016). However there have been criticisms of the reliance on human dignity in arguments against AWS (Birnbacher, 2016; Pop, 2018; Saxton, 2016). This paper critically examines the relationship between human dignity and autonomous weapons systems. Three main types of objection to AWS are identified; (i) arguments based on technology and the (...) ability of AWS to conform to International Humanitarian Law; (ii) deontological arguments based on the need for human judgement and meaningful human control, including arguments based on human dignity; (iii) consequentialist reasons about their effects on global stability and the likelihood of going to war. An account is provided of the claims made about human dignity and AWS, of the criticisms of these claims, and of the several meanings of ‘dignity’. It is concluded that although there are several ways in which AWS can be said to be against human dignity, they are not unique in this respect. There are other weapons, and other technologies, that also compromise human dignity. Given this, and the ambiguities inherent in the concept, it is wiser to draw on several types of objections in arguments against AWS, and not to rely exclusively on human dignity. (shrink)

In this paper, we argue that solutions to normative challenges associated with autonomous driving, such as real-world trolley cases or distributions of risk in mundane driving situations, face the problem of reasonable pluralism: Reasonable pluralism refers to the fact that there exists a plurality of reasonable yet incompatible comprehensive moral doctrines within liberal democracies. The corresponding problem is that a politically acceptable solution cannot refer to only one of these comprehensive doctrines. Yet a politically adequate solution to the normative challenges (...) of autonomous driving need not come at the expense of an ethical solution, if it is based on moral beliefs that are (1) shared in an overlapping consensus and (2) systematized through public reason. Therefore, we argue that a Rawlsian justificatory framework is able to adequately address the normative challenges of autonomous driving and elaborate on how such a framework might be employed for this purpose. (shrink)

Autonomous Agents addresses the related topics of self-control and individual autonomy. "Self-control" is defined as the opposite of akrasia-weakness of will. The study of self-control seeks to understand the concept of its own terms, followed by an examination of its bearing on one's actions, beliefs, emotions, and personal values. It goes on to consider how a proper understanding of self-control and its manifestations can shed light on personal autonomy and autonomous behaviour. Perspicuous, objective, and incisive throughout, Alfred Mele makes a (...) convincing case for the value of individual autonomy. (shrink)

While autonomous vehicles (AVs) are not designed to harm people, harming people is an inevitable by-product of their operation. How are AVs to deal ethically with situations where harming people is inevitable? Rather than focus on the much-discussed question of what choices AVs should make, we can also ask the much less discussed question of who gets to decide what AVs should do in such cases. Here there are two key options: AVs with a personal ethics setting (PES) or an (...) “ethical knob” that end users can control or AVs with a mandatory ethics setting (MES) that end users cannot control. Which option, a PES or an MES, is best and why? This chapter argues, by drawing on the choice architecture literature, in favor of a hybrid view that requires mandated default choice settings while allowing for limited end user control. (shrink)

Autonomous vehicles have the potential to save tens of thousands of lives, but legal and social barriers may delay or even deter manufacturers from offering fully automated vehicles and thereby cost lives that otherwise could be saved. Moral philosophers use “thought experiments” to teach us about what ethics might say about the ethical behavior of AVs. If a manufacturer designing an AV decided to make what it believes is an ethical choice to save a large group of lives by steering (...) away from the large group towards a single individual, could the manufacturer be liable to that single individual? I believe the answer is yes. This article discusses famous “trolley problem” thought experiments in moral philosophy, which news articles have recently applied to AVs. After establishing a hypothetical case, applying product liability law to AV behavior may show a way, in some jurisdictions, that will permit a manufacturer to implement an ethical choice without triggering liability, but liability risk remains. I then turn to possible traditional defenses to see if they prevent liability for a manufacturer making what it believes is an ethical design choice—necessity, defense of self, and the sudden emergency doctrine. None of them provides an effective defense. Under current law, maximizing collision avoidance appears to minimize legal risk. I conclude that the only way to provide effective protection to a manufacturer seeking to implement ethical choices about AV behavior is through special legislation or regulation. (shrink)

Autonomous weapons systems (AWS), sometimes referred to as “killer robots”, are receiving evermore attention, both in public discourse as well as by scholars and policymakers. Much of this interest is connected with emerging ethical and legal problems linked to increasing autonomy in weapons systems, but there is a general underappreciation for the ways in which existing law might impact on these new technologies. In this paper, we argue that as AWS become more sophisticated and increasingly more capable than flesh-and-blood soldiers, (...) it will increasingly be the case that such soldiers are “in the power” of those AWS which fight against them. This implies that such soldiers ought to be considered hors de combat, and not targeted. In arguing for this point, we draw out a broader conclusion regarding hors de combat status, namely that it must be viewed contextually, with close reference to the capabilities of combatants on both sides of any discreet engagement. Given this point, and the fact that AWS may come in many shapes and sizes, and can be made for many different missions, we argue that each particular AWS will likely need its own standard for when enemy soldiers are deemed hors de combat. We conclude by examining how these nuanced views of hors de combat status might impact on meaningful human control of AWS. (shrink)

Will future lethal autonomous weapon systems (LAWS), or ‘killer robots’, be a threat to humanity? The European Parliament has called for a moratorium or ban of LAWS; the ‘Contracting Parties to the Geneva Convention at the United Nations’ are presently discussing such a ban, which is supported by the great majority of writers and campaigners on the issue. However, the main arguments in favour of a ban are unsound. LAWS do not support extrajudicial killings, they do not take responsibility away (...) from humans; in fact they increase the abil-ity to hold humans accountable for war crimes. Using LAWS in war would probably reduce human suffering overall. Finally, the availability of LAWS would probably not increase the probability of war or other lethal conflict—especially as compared to extant remote-controlled weapons. The widespread fear of killer robots is unfounded: They are probably good news. (shrink)

Currently, the central questions in the philosophical debate surrounding the ethics of automated warfare are (1) Is the development and use of autonomous lethal robotic systems for military purposes consistent with (existing) international laws of war and received just war theory?; and (2) does the creation and use of such machines improve the moral caliber of modern warfare? However, both of these approaches have significant problems, and thus we need to start exploring alternative approaches. In this paper, I ask whether (...) autonomous robots ought to be programmed to be pacifists. The answer arrived at is “Yes”, if we decide to create autonomous robots, they ought to be pacifists. This is to say that robots ought not to be programmed to willingly and intentionally kill human beings, or, by extension, participate in or promote warfare, as something that predictably involves the killing of humans. Insofar as we are the ones that will be determining the content of the robot’s value system, then we ought to program robots to be pacifists, rather than ‘warists’. This is (in part) because we ought to be pacifists, and creating and programming machines to be “autonomous lethal robotic systems” directly violates this normative demand on us. There are no mitigating reasons to program lethal autonomous machines to contribute to or participate in warfare. Even if the use of autonomous lethal robotic systems could be consistent with received just war theory and the international laws of war, and even if their involvement could make warfare less inhumane in certain ways, these reasons do not compensate for the ubiquitous harms characteristic of modern warfare. In this paper, I provide four main reasons why autonomous robots ought to be pacifists, most of which do not depend on the truth of pacifism. The strong claim being argued for here is that automated warfare ought not to be pursued. The weaker claim being argued for here is that automated warfare ought not to be pursued, unless it is the most pacifist option available at the time, and other alternatives have been reasonably explored, and we are simultaneously promoting a (long term) pacifist agenda in (many) other ways. Thus, the more ambitious goal of this paper is to convince readers that automated warfare is something that we ought not to promote or pursue, while the more modest—and I suspect, more palatable—goal is to spark sustained critical discussion about the assumptions underlying the drive towards automated warfare, and to generate legitimate consideration of its pacifist alternatives,in theory, policy, and practice. (shrink)

Autonomous Knowledge: Radical Enhancement, Autonomy, and the Future of Knowing motivates and develops a new research programme in epistemology that is centred around the concept of epistemic autonomy.

A venerable view, still very much alive, holds that human action is to be explained at least in part in terms of beliefs and desires. Those who advocate the view expect that the psychological theory which explains human behavior will invoke the concepts of belief and desire in a substantive way. I will call this expectation the belief-desire thesis. Though there would surely be a quibble or a caveat here and there, the thesis would be endorsed by an exceptionally heterogeneous (...) collection of psychologists and philosophers ranging from Freud and Hume, to Thomas Szasz and Richard Brandt. Indeed, a number of philosophers have contended that the thesis, or something like it, is embedded in our ordinary, workaday concept of action. If they are right, and I think they are, then insofar as we use the concept of action we are all committed to the belief-desire thesis. My purpose in this paper is to explore the tension between the belief-desire thesis and a widely held assumption about the nature of explanatory psychological theories, an assumption that serves as a fundamental regulative principle for much of contemporary psychological theorizing. This assumption, which for want of a better term I will call the principle of psychological autonomy, will be the focus of the first of the sections below. In the second section I will elaborate a bit on how the belief-desire thesis is to be interpreted, and try to extract from it a principle that will serve as a premise in the argument to follow. In the third section I will set out an argument to the effect that large numbers of belief-desire explanations of action, indeed perhaps the bulk of such explanations, are incompatible with the principle of autonomy. Finally, in the last section, I will fend off a possible objection to my argument. In the process, I will try to make clear just why the argument works and what price we should have to pay if we were resolved to avoid its consequences. (shrink)

To many, the idea of autonomous weapons systems (AWS) killing human beings is grotesque. Yet critics have had difficulty explaining why it should make a significant moral difference if a human combatant is killed by an AWS as opposed to being killed by a human combatant. The purpose of this paper is to explore the roots of various deontological concerns with AWS and to consider whether these concerns are distinct from any concerns that also apply to long- distance, human-guided weaponry. (...) We suggest that at least one major driver of the intuitive moral aversion to lethal AWS is that their use disrespects their human targets by violating the martial contract between human combatants. On our understanding of this doctrine, service personnel cede a right not to be directly targeted with lethal violence to other human agents alone. Artificial agents, of which AWS are one example, cannot understand the value of human life. A human combatant cannot transfer his privileges of targeting enemy combatants to a robot. Therefore, the human duty-holder who deploys AWS breaches the martial contract between human combatants and disrespects the targeted combatants. We consider whether this novel deontological objection to AWS forms the foundation of several other popular yet imperfect deontological objections to AWS. (shrink)

Due to advances in military technology, there has been an outpouring of research on what are known as autonomous weapon systems (AWS). However, it is common in this literature for arguments to be made without first making clear exactly what definitions one is employing, with the detrimental effect that authors may speak past one another or even miss the targets of their arguments. In this article I examine the U.S. Department of Defense and International Committee of the Red Cross definitions (...) of AWS, showing that these definitions are far broader than some recognize, and that they therefore classify a much larger set of weapons as AWS. I then show that these broader views of AWS have implications for what moral and legal rules we might argue should be applied to such systems. I conclude by arguing there is a greater need for precision and clarity within AWS debates, in order to ensure that researchers are discussing the same weapon systems (autonomous or otherwise) when they argue for or against particular points. The purpose of this article is not to defend any specific view of AWS, nor to further any general endorsement or objection to such systems, but rather to show the importance of argumentative clarity in this debate. (shrink)

In 2017, the German ethics commission for automated and connected driving released 20 ethical guidelines for autonomous vehicles. It is now up to the research and industrial sectors to enhance the development of autonomous vehicles based on such guidelines. In the current state of the art, we find studies on how ethical theories can be integrated. To the best of the authors’ knowledge, no framework for motion planning has yet been published which allows for the true implementation of any practical (...) ethical policies. This paper makes four contributions: Firstly, we briefly present the state of the art based on recent works concerning unavoidable accidents of autonomous vehicles (AVs) and identify further need for research. While most of the research focuses on decision strategies in moral dilemmas or crash optimization, we aim to develop an ethical trajectory planning for all situations on public roads. Secondly, we discuss several ethical theories and argue for the adoption of the theory “ethics of risk.” Thirdly, we propose a new framework for trajectory planning, with uncertainties and an assessment of risks. In this framework, we transform ethical specifications into mathematical equations and thus create the basis for the programming of an ethical trajectory. We present a risk cost function for trajectory planning that considers minimization of the overall risk, priority for the worst-off and equal treatment of people. Finally, we build a connection between the widely discussed trolley problem and our proposed framework. (shrink)

The digital revolution, in the form of autonomous driving, is changing the very essence of mobility. This paper discusses four different ways in which these transformations are taking place and argues that public policies and business strategies need to focus on innovating and re-engineering (enveloping) whole environments. Only then will autonomous vehicles become an ordinary – and environmentally sustainable – reality. -/- .

Adam Carter (2022) recently proposed that a successful analysis of knowledge needs to include an autonomy condition. Autonomy, for Carter, requires a lack of a compulsion history. A compulsion history bypasses one’s cognitive competences and results in a belief that is difficult to shed. I argue that Carter’s autonomy condition does not cover partially autonomous beliefs properly. Some belief-forming processes are partially bypassing one’s competences, but not bypassing them completely. I provide a case for partially autonomous belief based on processing (...) fluency effects and argue that partially autonomous beliefs only amount to knowledge in some cases. I finally suggest how to adjust the autonomy condition to capture partially autonomous belief properly. (shrink)

We propose that the prevalent moral aversion to AWS is supported by a pair of compelling objections. First, we argue that even a sophisticated robot is not the kind of thing that is capable of replicating human moral judgment. This conclusion follows if human moral judgment is not codifiable, i.e., it cannot be captured by a list of rules. Moral judgment requires either the ability to engage in wide reflective equilibrium, the ability to perceive certain facts as moral considerations, moral (...) imagination, or the ability to have moral experiences with a particular phenomenological character. Robots cannot in principle possess these abilities, so robots cannot in principle replicate human moral judgment. If robots cannot in principle replicate human moral judgment then it is morally problematic to deploy AWS with that aim in mind. Second, we then argue that even if it is possible for a sufficiently sophisticated robot to make ‘moral decisions’ that are extensionally indistinguishable from (or better than) human moral decisions, these ‘decisions’ could not be made for the right reasons. This means that the ‘moral decisions’ made by AWS are bound to be morally deficient in at least one respect even if they are extensionally indistinguishable from human ones. Our objections to AWS support the prevalent aversion to the employment of AWS in war. They also enjoy several significant advantages over the most common objections to AWS in the literature. (shrink)

Enhancement of autonomous choice may be considered as an important reason for facilitating the use of genetic tests such as preimplantation genetic diagnosis. The principle of respect for autonomy is a crucial component not only of Western liberal traditions but also of Western bioethics. This is especially so in bioethical discussions and analyses of clinical encounters within medicine. On the basis of an analysis of qualitative research interviews performed with British, Italian and Swedish geneticists and gynaecologists on ethical aspects of (...) preimplantation genetic diagnosis, the plausibility of the notion of autonomy within reproductive medicine is discussed. The analysis of interviews indicates not only that there is a gap between theoretical discussions and concrete practice, but also that an increase in choice — paradoxically — can hamper couples' choice. (shrink)

The introduction of Autonomous Military Systems (AMS) onto contemporary battlefields raises concerns that they will bring with them the possibility of a techno-responsibility gap, leaving insecurity about how to attribute responsibility in scenarios involving these systems. In this work I approach this problem in the domain of applied ethics with foundational conceptual work on autonomy and responsibility. I argue that concerns over the use of AMS can be assuaged by recognising the richly interrelated context in which these systems will most (...) likely be deployed. This will allow us to move beyond the solely individualist understandings of responsibility at work in most treatments of these cases, toward one that includes collective responsibility. This allows us to attribute collective responsibility to the collectives of which the AMS form a part, and to account for the distribution of burdens that follows from this attribution. I argue that this expansion of our responsibility practices will close at least some otherwise intractable techno-responsibility gaps. (shrink)

While Autonomous Weapons Systems have obvious military advantages, there are prima facie moral objections to using them. By way of general reply to these objections, I point out similarities between the structure of law and morality on the one hand and of automata on the other. I argue that these, plus the fact that automata can be designed to lack the biases and other failings of humans, require us to automate the formulation, administration, and enforcement of law as much as (...) possible, including the elements of law and morality that are operated by combatants in war. I suggest that, ethically speaking, deploying a legally competent robot in some legally regulated realm is not much different from deploying a more or less well-armed, vulnerable, obedient, or morally discerning soldier or general into battle, a police officer onto patrol, or a lawyer or judge into a trial. All feature automaticity in the sense of deputation to an agent we do not then directly control. Such relations are well understood and well-regulated in morality and law; so there is not much challenging philosophically in having robots be some of these agents — excepting the implications of the limits of robot technology at a given time for responsible deputation. I then consider this proposal in light of the differences between two conceptions of law. These are distinguished by whether each conception sees law as unambiguous rules inherently uncontroversial in each application; and I consider the prospects for robotizing law on each. Likewise for the prospects of robotizing moral theorizing and moral decision-making. Finally I identify certain elements of law and morality, noted by the philosopher Immanuel Kant, which robots can participate in only upon being able to set ends and emotionally invest in their attainment. One conclusion is that while affectless autonomous devices might be fit to rule us, they would not be fit to vote with us. For voting is a process for summing felt preferences, and affectless devices would have none to weigh into the sum. Since they don't care which outcomes obtain, they don't get to vote on which ones to bring about. (shrink)

A classic objection to autonomous weapon systems (AWS) is that these could create so-called responsibility gaps, where it is unclear who should be held responsible in the event that an AWS were to violate some portion of the law of armed conflict (LOAC). However, those who raise this objection generally do so presenting it as a problem for AWS as a whole class of weapons. Yet there exists a rather wide range of systems that can be counted as “autonomous weapon (...) systems”, and so the objection is too broad. In this article I present a taxonomic approach to the objection, examining a number of systems that would count as AWS under the prevalent definitions provided by the United States Department of Defense and the International Committee of the Red Cross, and I show that for virtually all such systems there is a clear locus of responsibility which presents itself as soon as one focuses on specific systems, rather than general notions of AWS. In developing these points, I also suggest a method for dealing with near-future types of AWS which may be thought to create situations where responsibility gaps can still arise. The main purpose of the arguments is, however, not to show that responsibility gaps do not exist or can be closed where they do exist. Rather, it is to highlight that any arguments surrounding AWS must be made with reference to specific weapon platforms imbued with specific abilities, subject to specific limitations, and deployed to specific times and places for specific purposes. More succinctly, the arguments show that we cannot and should not aim to treat AWS as if all of these shared all morally relevant features, but instead on a case-by-case basis. Thus, we must contend with the realities of weapons development and deployment, and tailor our arguments and conclusions to those realities, and with an eye to what facts obtain for particular systems fulfilling particular combat roles. (shrink)

Predictions about autonomous weapon systems are typically thought to channel fears that drove all the myths about intelligence embodied in matter. One of these is the idea that the technology can get out of control and ultimately lead to horrifi c consequences, as is the case in Mary Shelley’s classic Frankenstein. Given this, predictions about AWS are sometimes dismissed as science-fiction fear-mongering. This paper considers several analogies between AWS and other weapon systems and ultimately offers an argument that nuclear weapons (...) and their effect on the development of modern asymmetrical warfare are the best analogy to the introduction of AWS. The fi nal section focuses on this analogy and offers speculations about the likely consequences of AWS being hacked. These speculations tacitly draw on myths and tropes about technology and AI from popular fi ction, such as Frankenstein, to project a convincing model of the risks and benefi ts of AWS deployment. (shrink)

This paper concerns the question of whether any normative commitments necessarily accompany autonomous agency. Substantive theories claim that they do; content-neutral theories deny this. In this paper I argue that it is possible to defend a substantive account without arguing in favor of any particular normative commitments that must accompany autonomous agency. A proper appreciation of what it means for an account to be normatively substantive, coupled with an understanding of what is involved in any putatively content-neutral account of autonomy, (...) implies that all content-neutral autonomy accounts necessarily involve substantive normative commitments, in at least one important sense. On almost all accounts, the development of autonomy requires an agent to satisfy certain conditions and master certain skills. Yet it would not be possible to satisfy the conditions or master those skills unless the agent possesses, or at least possessed, normative commitments to ways of life that render their development possible. (shrink)

This chapter discusses how research in situationist social psychology may pose largely undiscussed threats to autonomous agency, free will, and moral responsibility.

In this single-blind within-subject study, autonomic and EEG variables were compared during 10-min, order-balanced eyes-closed rest and Transcendental Meditation (TM) sessions. TM sessions were distinguished by (1) lower breath rates, (2) lower skin conductance levels, (3) higher respiratory sinus arrhythmia levels, and (4) higher alpha anterior-posterior and frontal EEG coherence. Alpha power was not significantly different between conditions. These results were seen in the first minute and were maintained throughout the 10-min sessions. TM practice appears to (1) lead to a (...) state fundamentally different than eyes-closed rest; (2) result in a cascade of events in the central and autonomic nervous systems, leading to a rapid change in state (within a minute) that was maintained throughout the TM session; and (3) be best distinguished from other conditions through autonomic and EEG alpha coherence patterns rather than alpha power. Two neural networks that may mediate these effects are suggested. The rapid shift in physiological functioning within the first minute might be mediated by a ''neural switch'' in prefrontal areas inhibiting activity in specific and nonspecific thalamocortical circuits. The resulting ''restfully alert'' state might be sustained by a basal ganglia-corticothalamic threshold regulation mechanism automatically maintaining lower levels of cortical excitability. (shrink)

The recent progress in the development of autonomous cars has seen ethical questions come to the forefront. In particular, life and death decisions regarding the behavior of self-driving cars in trolley dilemma situations are attracting widespread interest in the recent debate. In this essay we want to ask whether we should implement a mandatory ethics setting for the whole of society or, whether every driver should have the choice to select his own personal ethics setting. While the consensus view seems (...) to be that people would not be willing to use an automated car that might sacrifice themselves in a dilemma situation, we will defend the somewhat contra-intuitive claim that this would be nevertheless in their best interest. The reason is, simply put, that a PES regime would most likely result in a prisoner’s dilemma. (shrink)

Shapiro and Sober claim that Walsh, Ariew, Lewens, and Matthen give a mistaken, a priori defense of natural selection and drift as epiphenomenal. Contrary to Shapiro and Sober’s claims, we first argue that WALM’s explanatory doctrine does not require a defense of epiphenomenalism. We then defend WALM’s explanatory doctrine by arguing that the explanations provided by the modern genetical theory of natural selection are ‘autonomous-statistical explanations’ analogous to Galton’s explanation of reversion to mediocrity and an explanation of the diffusion ofgases. (...) We then argue that whereas Sober’s theory of forces is an adequate description of Darwin’s theory, WALM’s explanatory doctrine is required to understand how themodern genetical theory of natural selection explains large-scale statistical regularities. 1 Introduction2 Shapiro and Sober’s ‘Epiphenomenalism Do’s and Don’ts’3 WALM’s Explanatory Doctrine4 Galton’s Autonomous-Statistical Explanation5 A Second Example: The Statistical Explanation of the Diffusion of Gases6 Distinguishing Two Theories of Evolution by Natural Selection7 A Possible Objection: Are Statistical Laws Sufficient for Explanation?8 Conclusion. (shrink)

ChatGPT launched in November 2022, triggering a global debate on the use of artificial intelligence (AI). A debate on AI-enabled lethal autonomous weapon systems (LAWS) has been underway far longer. Two sides have emerged: one in favor and one opposed to an international law ban on LAWS. This essay explains the position of advocates of a ban without attempting to persuade opponents. Supporters of a ban believe LAWS are already unlawful and immoral to use without the need of a new (...) treaty or protocol. They nevertheless seek an express prohibition to educate and publicize the threats these weapons pose. Foremost among their concerns is the “black box” problem. Programmers cannot know what a computer operating a weapons system empowered with AI will “learn” from the algorithm they use. They cannot know at the time of deployment if the system will comply with the prohibition on the use of force or the human right to life that applies in both war and peace. Even if they could, mechanized killing affronts human dignity. Ban supporters have long known that “AI models are not safe and no one knows how to reliably make them safe” or morally acceptable in taking human life. (shrink)

In recent educational reforms in New Zealand, a central assumption has been the existence of a free and autonomous chooser acting as a consumer of education. The present paper examines and critiques this notion of autonomy, as developed within liberal theory. Both Foucault and Lyotard provide materials for this critique of such a self, a self independent of the laws and principles of a community.

The prospective introduction of autonomous cars into public traffic raises the question of how such systems should behave when an accident is inevitable. Due to concerns with self-interest and liberal legitimacy that have become paramount in the emerging debate, a contractarian framework seems to provide a particularly attractive means of approaching this problem. We examine one such attempt, which derives a harm minimisation rule from the assumptions of rational self-interest and ignorance of one’s position in a future accident. We contend, (...) however, that both contractarian approaches and harm minimisation standards are flawed, due to a failure to account for the fundamental difference between those ‘involved’ and ‘uninvolved’ in an impending crash. Drawing from classical works on the trolley problem, we show how this notion can be substantiated by reference to either the distinction between negative and positive rights, or to differences in people’s claims. By supplementing harm minimisation with corresponding constraints, we can develop crash algorithms for autonomous cars which are both ethically adequate and promise to overcome certain significant practical barriers to implementation. (shrink)

"A runaway trolley is speeding down a track" So begins what is perhaps the most fecund thought experiment of the past several decades since its invention by Philippa Foot. Since then, moral philosophers have applied the "trolley problem" as a thought experiment to study many different ethical conflicts - and chief among them is the programming of autonomous vehicles. Nowadays, however, very few philosophers accept that the trolley problem is a perfect analogy for driverless cars or that the situations autonomous (...) vehicles face will resemble the forced choice of the unlucky bystander in the original thought experiment. This book represents a substantial and purposeful effort to move the academic discussion beyond the trolley problem to the broader ethical, legal, and social implications that autonomous vehicles present. There are still urgent questions waiting to be addressed, for example: how AVs might interact with human drivers in mixed or "hybrid" traffic environments; how AVs might reshape our urban landscapes; what unique security or privacy concerns are raised by AVs as connected devices in the "Internet of Things"; how the benefits and burdens of this new technology, including mobility, traffic congestion, and pollution, will be distributed throughout society; and more. An attempt to map the landscape of these next-generation questions and to suggest preliminary answers, this volume draws on the disciplines of philosophy, sociology, economics, urban planning and transportation engineering, business ethics and more, and represents a global range of perspectives. (shrink)

In this article, we focus on the scholarly and policy debate on autonomous weapon systems and particularly on the objections to the use of these weapons which rest on jus ad bellum principles of proportionality and last resort. Both objections rest on the idea that AWS may increase the incidence of war by reducing the costs for going to war or by providing a propagandistic value. We argue that whilst these objections offer pressing concerns in their own right, they suffer (...) from important limitations: they overlook the difficulties of calculating ad bellum proportionality; confuse the concept of proportionality of effects with the precision of weapon systems; disregard the ever-changing nature of war and of its ethical implications; mistake the moral obligation imposed by the principle of last resort with the impact that AWS may have on political decision to resort to war. Our analysis does not entail that AWS are acceptable or justifiable, but it shows that ad bellum principles are not the best set of ethical principles for tackling the ethical problems raised by AWS; and that developing adequate understanding of the transformations that the use of AWS poses to the nature of war itself is a necessary, preliminary requirement to any ethical analysis of the use of these weapons. (shrink)

Theories of collective intentionality and theories of relational autonomy share a common interest in analyzing the social dynamics of agency. However, whereas theories of collective intentionality conceive of social groups primarily as intentional and voluntarily willed, theories of relational autonomy claim that autonomous agency is both scaffolded and constrained by social forces and structures, including the constraints imposed by nonvoluntary group membership. The question raised by this difference in view is whether social theorizing that overlooks the effects of nonvoluntary social (...) group membership on individual and joint agency overlooks crucial aspects of the social dynamics of agency. To explore this question, this article first evaluates Michael Bratman's planning analysis of individual agency from the perspective of relational autonomy theory and compares it with a narrative self‐constitution account of temporally extended agency. It then evaluates Bratman's analysis of shared agency and discusses Shaun Gallagher and Deborah Tollefsen's concept of we‐narratives, which extends the notion of narrative construction to shared agency. Overall, the argument aims to show that if we are interested in understanding the social dynamics of agency, it is critical to attend to the way that agents exercise their intentional agency in relation to internalized and external social constraints. (shrink)

In recent work, Callender and Cohen (2009) and Hoefer (2007) have proposed variants of the account of chance proposed by Lewis (1994). One of the ways in which these accounts diverge from Lewis’s is that they allow special sciences and the macroscopic realm to have chances that are autonomous from those of physics and the microscopic realm. A worry for these proposals is that autonomous chances may place incompatible constraints on rational belief. I examine this worry, and attempt to determine (...) (i) what kinds of conflicts would be problematic, and (ii) whether these proposals lead to problematic conflicts. After working through a pair of cases, I conclude that these proposals do give rise to problematic conflicts. (shrink)

When a computer system causes harm, who is responsible? This question has renewed significance given the proliferation of autonomous systems enabled by modern artificial intelligence techniques. At the root of this problem is a philosophical difficulty known in the literature as the responsibility gap. That is to say, because of the causal distance between the designers of autonomous systems and the eventual outcomes of those systems, the dilution of agency within the large and complex teams that design autonomous systems, and (...) the impossibility of fully predicting how autonomous systems will behave once deployed, determining who is morally responsible for harms caused by autonomous systems is unclear at a conceptual level. I review past work on this topic, criticizing prior works for suggesting workarounds rather than philosophical answers to the conceptual problem presented by the responsibility gap. The view I develop, drawing on my earlier work on vicarious moral responsibility, explains why computing professionals are ethically required to take responsibility for the systems they design, despite not being blameworthy for the harms these systems may cause. (shrink)

In October 2011, the “2nd European Network for Cognitive Systems, Robotics and Interaction”, EUCogII, held its meeting in Groningen on “Autonomous activity in real-world environments”, organized by Tjeerd Andringa and myself. This is a brief personal report on why we thought autonomy in real-world environments is central for cognitive systems research and what I think I learned about it. --- The theses that crystallized are that a) autonomy is a relative property and a matter of degree, b) increasing autonomy of (...) an artificial system from its makers and users is a necessary feature of increasingly intelligent systems that can deal with the real-world and c) more such autonomy means less control but at the same time improved interaction with the system. (shrink)

Corporate responsibility requires a conception of collective agency on which collective agents are able to form moral judgments and act on them. In spite of claims to the contrary, existing accounts of collective agency fall short of this kind of corporate autonomy, as they fail to explain how collective agents might be responsive to moral reasons. I discuss how a recently proposed conception of shared valuing can be used for developing a solution to this problem. Although the resulting conception of (...) corporate autonomy is useful for making sense of corporate responsibility, it also gives rise to what I call ‘the Corporate Autonomy Problem’. Autonomous collective agents are in principle entitled to the same rights as autonomous individual agents. However, at least some individual rights, such as the right to vote, the right to life, and the right not to be enslaved cannot plausibly be attributed to collective agents. This intuition is supported by normative individualism, the position according to which corporate agents are not entitled to non-derivative rights at all. I argue that without a proper solution to this problem—I sketch the available options—saving corporate responsibility requires giving up on normative individualism. (shrink)

This article examines how people with type 2 diabetes perceive autonomous decision making and which moral capacities they consider important in diabetes nurses' support of autonomous decision making. Fifteen older adults with type 2 diabetes were interviewed in a nurse-led unit. First, the data were analysed using the grounded theory method. The participants described a variety of decision-making processes in the nurse and family care-giver context. Later, descriptions of the decision-making processes were analysed using hermeneutic text interpretation. We suggest first- (...) and second-order moral capacities that nurses specializing in diabetes need to promote the autonomous decision making of their patients. We recommend nurses to engage in ongoing, interactive reflective practice to further develop these moral capacities. (shrink)

In order to be a self-governing agent, a person must govern the process by means of which she acquires the intention to act as she does. But what does governing this process require? The standard compatibilist answers to this question all assume that autonomous actions differ from nonautonomous actions insofar as they are a more perfect expression of the agent’s agency. I challenge this conception of autonomous agents as super agents. The distinguishing feature of autonomous agents is, I argue, the (...) nonagential role they play in the formation of their intentions. I offer an account of the relevant role. (shrink)

The phenomenological goal of grounding the content of conceptual thought in the background understanding of everyday, skillful coping was approached using evolutionary autonomous agent methodology. The behavior of an EAA evolved to perform a specified motor task was identified with skillful coping. Changes in the dynamics of the EAA controller occurred when the EAA encountered an unexpected obstacle with loss of longer time scale components in its hierarchical temporal organization. These temporal changes are consistent with the phenomenological changes which we (...) experience with breakdown during equipment use with our adoption of a more immediate, determinate stance. Since this latter experience is the basis of conceptual thought, the EAA paradigm goes some way in providing a naturalized explanation for the grounding of the content of conceptual thought in everyday, skillful coping in a manner that is physiologically plausible and phenomenologically accurate. (shrink)

The truth of the matter is that our deficiency does not lie in the want of well-verified "facts." What we lack is our bearings. The contemporary experience of things technological has repeatedly confounded our vision, our expectations, and our capacity to make intelligent judgments. Categories, arguments, conclusions, and choices that would have been entirely obvious in earlier times are obvious no longer. Patterns of perceptive thinking that were entirely reliable in the past now lead us systematically astray. Many of our (...) standard conceptions of technology reveal a disorientation that borders on dissociation from reality. And as long as we lack the ability to make our situation intelligible, all of the "data" in the world will make no difference.;From the Introduction. (shrink)