In a series of publications, Ronald Arkin and his team have proposed the concept of a deontologically programmed 'ethical governor,' which is supposed to effectively control and enforce the ethical use of lethal force by robots on the battlefield. This paper attempts to analyse the concept of an ethical governor in the context of a more general criticism of algorithmic robot morality implementations. It is argued that the metaphor of the ethical governor is dangerously misleading in multiple respects: the governor, (...) as proposed by Arkin, overlooks a fundamental clash of interests of the robot designer/operator, that is not present in the original governor, and that can be shown to make effective robot control in the proposed implementation impossible. The concept also suggests that ethics control is a matter of correcting behavioural deviations from a 'reference ethical action' by a negative feedback loop, although it can be shown that this does not lead to an appropriate description of moral behaviour, and that in particular it overlooks the central role of conscience and dissent in morality. Finally, the concept as proposed is based on a fundamental confusion of the properties of laws, rules of just war, terms of engagement, and moral rules. At the same time, experimental implementations of 'moral' robot controllers threaten to produce an ad-hoc regulation of ethical issues on the battlefield, which is removed from public scrutiny and democratic control. Considering these issues, the concept of an ethical governor, and, more generally, the existing attempts to handle robot morality by algorithmic means can be shown to be both misleading and dangerous, and to not appropriately address the moral problems they are supposed to solve. Consequently, such attempts in their present form must be questioned and re-examined, and a more critical approach to artefact morality should be adopted. (shrink)

This collection of 17 essays by the author offers a comprehensive theory of mind, encompassing traditional issues of consciousness and free will.

The U.S. military has started to construct and deploy robotic weapons systems. Although human controllers may still be monitoring the functioning of the technology, the next logical step is to transfer incrementally more of the decision-making power to the robots themselves. Thus, this article seeks to examine the ethical implications of the creation and use of "autonomous weapons systems.".

Computers are already approving financial transactions, controlling electrical supplies, and driving trains. Soon, service robots will be taking care of the elderly in their homes, and military robots will have their own targeting and firing protocols. Colin Allen and Wendell Wallach argue that as robots take on more and more responsibility, they must be programmed with moral decision-making abilities, for our own safety. Taking a fast paced tour through the latest thinking about philosophical ethics and artificial intelligence, the authors argue (...) that even if full moral agency for machines is a long way off, it is already necessary to start building a kind of functional morality, in which artificial moral agents have some basic ethical sensitivity. But the standard ethical theories don't seem adequate, and more socially engaged and engaging robots will be needed. As the authors show, the quest to build machines that are capable of telling right from wrong has begun. -/- Moral Machines is the first book to examine the challenge of building artificial moral agents, probing deeply into the nature of human decision making and ethics. (shrink)

This paper makes the case for arms control regimes to govern the development and deployment of autonomous weapon systems and long range uninhabited aerial vehicles.