Face-to-face interaction is a primordial site for human activity and intersubjectivity. Empirical studies have shown how people reflexively exhibit a face orientation and work to establish a formation in which everyone is facing each other in local participation frameworks. The Face has also been described by, e.g., Levinas as the basis for a first ethical philosophy. Humans have established these Face-formations when interacting since time immemorial, but what happens when one of the participants is present through a telepresence (...) class='Hi'>robot? Based on ethnomethodology, Peircean/goodwinian semiotics, multimodal conversation analysis and video data from a Danish residential rehabilitation center, the article shows the ways in which participants manage to interactively, cooperatively, and moment by moment achieve an F-formation in situ. The article contributes a detailed analysis and discussion of the kind of participant a telepresence robot is, in and through situated interactions: I propose that we term this participant the RoboDoc, given that it is an assemblage of a doctor who controls a robot. By focusing on the affordances of mobility, the article contributes to a renewed understanding of the importance and relevance of establishing Face-orientations in an increasingly technofied telepresence world. (shrink)

In this paper, we focus on spatial formations when interacting via mobile robotic telepresence systems. Previous research has found that those who used a MRP system to make a remote visit tended to use different spatial formations from what is typical in human-human interaction. In this paper, we present the results of a study where a pilot user interacted with ten elderly via a MRP system. Intentional deviations from known accepted spatial formations were made in order to study their (...) effect on interaction quality from the local user perspective. Using a retrospective interviews technique, the elderly commented on the interaction and confirmed the importance of adhering to acceptable spatial configurations. The results show that there is a mismatch between pilot user behaviour and local user preference and that it is important to evaluate a MRP system from two perspectives, the pilot user’s and the local user’s. Keywords: F-formations; Mobile Robotic Telepresence; MRP systems; Quality of Interaction; Retrospective Interview; Spatial Formations; Spatial Configurations. (shrink)

In this paper, we focus on spatial formations when interacting via mobile robotic telepresence systems. Previous research has found that those who used a MRP system to make a remote visit tended to use different spatial formations from what is typical in human-human interaction. In this paper, we present the results of a study where a pilot user interacted with ten elderly via a MRP system. Intentional deviations from known accepted spatial formations were made in order to study their (...) effect on interaction quality from the local user perspective. Using a retrospective interviews technique, the elderly commented on the interaction and confirmed the importance of adhering to acceptable spatial configurations. The results show that there is a mismatch between pilot user behaviour and local user preference and that it is important to evaluate a MRP system from two perspectives, the pilot user’s and the local user’s. Keywords: F-formations; Mobile Robotic Telepresence; MRP systems; Quality of Interaction; Retrospective Interview; Spatial Formations; Spatial Configurations. (shrink)

In this paper, we focus on spatial formations when interacting via mobile robotic telepresence systems. Previous research has found that those who used a MRP system to make a remote visit tended to use different spatial formations from what is typical in human-human interaction. In this paper, we present the results of a study where a pilot user interacted with ten elderly via a MRP system. Intentional deviations from known accepted spatial formations were made in order to study their (...) effect on interaction quality from the local user perspective. Using a retrospective interviews technique, the elderly commented on the interaction and confirmed the importance of adhering to acceptable spatial configurations. The results show that there is a mismatch between pilot user behaviour and local user preference and that it is important to evaluate a MRP system from two perspectives, the pilot user’s and the local user’s. Keywords: F-formations; Mobile Robotic Telepresence; MRP systems; Quality of Interaction; Retrospective Interview; Spatial Formations; Spatial Configurations. (shrink)

Superficially, the robots of early SF appears to be a prediction that is on target. In factories all over the world "robots" are replacing human workers at production lines that assemble everything from Toyotas to Macintoshes. Surely it's only a matter of time before these robots walk out of the factories and into shops and business offices, replacing human workers everywhere with more efficient mechanical substitutes. Indeed, many SF writers have based stories on just such premises.

Current uses of robots in classrooms are reviewed and used to characterise four scenarios: Robot as Classroom Teacher; Robot as Companion and Peer; Robot as Care-eliciting Companion; and Telepresence Robot Teacher. The main ethical concerns associated with robot teachers are identified as: privacy; attachment, deception, and loss of human contact; and control and accountability. These are discussed in terms of the four identified scenarios. It is argued that classroom robots are likely to impact children’s’ (...) privacy, especially when they masquerade as their friends and companions, when sensors are used to measure children’s responses, and when records are kept. Social robots designed to appear as if they understand and care for humans necessarily involve some deception, and could increase the risk of reduced human contact. Children could form attachments to robot companions, or robot teachers and this could have a deleterious effect on their social development. There are also concerns about the ability, and use of robots to control or make decisions about children’s behaviour in the classroom. It is concluded that there are good reasons not to welcome fully fledged robot teachers, and that robot companions should be given a cautious welcome at best. The limited circumstances in which robots could be used in the classroom to improve the human condition by offering otherwise unavailable educational experiences are discussed. (shrink)

Social technology can improve the quality of older adults' social lives and mitigate negative mental and physical health outcomes associated with loneliness, but it should be designed collaboratively with this population. In this paper, we used participatory design methods to investigate how robots might be used as social facilitators for middle-aged and older adults in both the US and Japan. We conducted PD workshops in the US and Japan because both countries are concerned about the social isolation of these older (...) adults due to their rapidly aging populations. We developed a novel approach to participatory design of future technologies that spends 2/3 of the PD session asking participants about their own life experiences as a foundation. This grounds the conversation in reality, creates rapport among the participants, and engages them in creative critical thinking. Then, we build upon this foundation, pose an abstract topic, and ask participants to brainstorm on the topic based on their previous discussion. In both countries, participants were eager to actively discuss design ideas for socially facilitative robots and imagine how they might improve their social lives. US participants suggested design ideas for telepresence robots, social distancing robots, and social skills artificial intelligence programs, while Japanese participants suggested ideas for pet robots, robots for sharing experiences, and easy-to-operate instructor robots. Comparing these two countries, we found that US participants saw robots as tools to help facilitate their social connections, while Japanese participants envisioned robots to function as surrogate companions for their parents and distract them from loneliness when they were unavailable. With this paper, we contribute to the literature in two main ways, presenting: A novel approach to participatory design of future technologies that grounds participants in their everyday experience, and Results of the study indicating how middle-aged and older adults from the US and Japan wanted technologies to improve their social lives. Although we conducted the workshops during the COVID-19 pandemic, many findings generalized to other situations related to social isolation, such as older adults living alone. (shrink)

This article studies perceptual differences of three social robots by elementary school children of ages 6–13 years at research fairs. The autonomous humanoid robot Pepper, an advanced social robot primarily designed as a personal assistant with movement and mobility, is compared to the teleoperated AV1 robot—designed to help elementary school children who cannot attend school to have a telepresence through the robot—and the flowerpot robot Tessa, used in the eWare system as an avatar for (...) a home sensor system and dedicated to people with dementia living alone. These three robots were shown at the Norwegian national research fair, held in every major Norwegian city annually, where children were able to interact with the robots. Our analysis is based on quantitative survey data of the school children concerning the robots and qualitative discussions with them. By comparing three different types of social robots, we found that presence can be differently understood and conceptualized with different robots, especially relating to their function and “aliveness.” Additionally, we found a strong difference when relating robots to personal relations to one’s own grandparents versus older adults in general. We found children’s perceptions of robots to be relatively positive, curious and exploratory and that they were quite reflective on their own grandparent having a robot. (shrink)

There are a number of reasons to be interested in building humanoid robots. They include (1) since almost all human artifacts have been designed to easy for humans to interact with, humanoid robots provide backward compatibility with the existing human constructed world, (2) humanoid robots provide a natural form for humans to operate through telepresence since they have the same kinematic design as humans themselves, (3) by building humanoid robots that model humans directly they will be a useful tool (...) in understanding how humans develop and operate as they provide a platform for experimenting with different hypotheses about humans and (4) humanoid robots, given su cient abilities, will present a natural interface to people and people will be able to use their instinctive and culturally developed subconscious techniques for communicating with other people to communicate with humanoid robots. In this paper we take reason (4) seriously, and examine some of the technologies that are necessary to make this hope a reality. (shrink)

Nel 1956, in piena guerra fredda, una conferenza di scienziati al Dartmouth College negli Stati Uniti annunciò il lancio di un audace progetto scientifico, l’Intelligenza Artificiale (I.A.). Dopo l’iniziale fallimento degli sforzi della “Hard AI” di produrre un’intelligenza simile a quella umana, alla fine del XX secolo è emerso il movimento della “Soft AI”. Invece di essere orientato a imitare il comportamento umano in relazione a compiti specifici, ha preferito cercare modi alternativi di eseguire i compiti basati sulle particolari funzioni (...) e strutture della macchina. Il fattore decisivo è stata la combinazione della tecnologia di apprendimento automatico con le comunicazioni digitali online, l’incontro tra l’IA e Internet. Le applicazioni dell’IA “soft” sono quelle che vediamo nel mondo dei dispositivi automatici “intelligenti” che informano la nostra vita sociale digitale. Nel seguente articolo mi concentrerò su una particolare applicazione dell’IA per le discussioni online con utenti umani, ChatGPT, per mostrare le implicazioni della tecnologia digitale online nelle modalità storico-sociali dell’esistenza umana. ChatGPT è un’applicazione che combina l’IA con Internet, le possibilità della corrispondenza tra macchine e le potenzialità della tele-comunicazione umana. Il mio approccio si concentra sulle implicazioni fenomenologiche e storico-sociali della proliferazione della tecnologia AI per quanto riguarda la coscienza e la socialità umana. -/- Abstract (english) -/- In 1956, amidst the Cold War, a conference of scientists at Dartmouth College in the United States announced the launch of a bold, scientific project, Artificial Intelligence (A.I.). After the initial failure of “Hard AI” efforts to produce a human-like intelligence, the “Soft AI” movement emerged in the late 20th century. Instead of being oriented towards imitating human behaviour concerning specific tasks, it preferred to seek alternative ways of performing tasks based on the particular functions and structures of the machine. The decisive factor was the combination of Machine Learning technology with Digital Online Communications, the meeting between AI and the Internet. The applications of “Soft” AI are those we see in the world of “smart”, “intelligent” automatic devices that inform our digital social life. In the following article, I will focus on a particular application of AI for online discussions with human users, ChatGPT, in order to show the implications of online digital technology in the social-historical modalities of human existence. ChatGPT is an application that combines AI with the Internet, the possibilities of Machine correspondence with the potentialities of human telecommunications. My approach focuses on the phenomenological and social-historical implications of the proliferation of AI technology as regards human consciousness and sociality. (shrink)

You don a comfortable jacket lined with sensors and muscle-like motors. Each motion of your arm, hand, and fingers is reproduced at another place by mobile, mechanical hands. Light, dexterous, and strong, these hands have their own sensors through which you see and feel what is happening. Using this instrument, you can "work" in another room, in another city, in another country, or on another planet. Your remote presence possesses the strength of a giant or the delicacy of a surgeon. (...) Heat or pain is translated into informative but tolerable sensation. Your dangerous job becomes safe and pleasant. (shrink)

Trust is central to our social lives in both epistemic and practical ways. Often, it is rational only given evidence for trustworthiness, and with that evidence is made available by communication. New technologies are changing our practices of communication, enabling increasing rich and diverse ways of ‘being there’, but at a distance. This paper asks: how does telepresent communication support evidence-constrained trust? In answering it, I reply to the leading pessimists about the possibility of the digital mediation of trust, Philip (...) Pettit and Hubert Dreyfus. I also rebut Media Richness Theory, which proposes a linear relationship between the volume of mediated information and the quality of communication. Positively, I develop a speech-act theory of digitally mediated communication, drawing on Austen’s identification of the illocutionary act. The choice of a particular technology of communication constitutes part of what is communicated, including a setting of the social ‘frame’, and thus the possibilities for trust to be sustained or eroded. How something is said is part of what it is that is said. (shrink)

Can robots have significant moral status? This is an emerging topic of debate among roboticists and ethicists. This paper makes three contributions to this debate. First, it presents a theory – ‘ethical behaviourism’ – which holds that robots can have significant moral status if they are roughly performatively equivalent to other entities that have significant moral status. This theory is then defended from seven objections. Second, taking this theoretical position onboard, it is argued that the performative threshold that robots need (...) to cross in order to be afforded significant moral status may not be that high and that they may soon cross it (if they haven’t done so already). Finally, the implications of this for our procreative duties to robots are considered, and it is argued that we may need to take seriously a duty of ‘procreative beneficence’ towards robots. (shrink)

In the same way that humans have always had the need for inventing fictional and virtual worlds, they have also experimented an attraction for the threatening and fascinating ideas of the doppelgänger, automata, and by the related phenomena of desembodiment, ubiquity, remote viewing, bilocation, splitting personalities. The phenomenon of bilocation, for instance, has been widely mentioned in different philosophical and religious systems such as Shamanism, Christian mysticism, Hinduism, Paganism and others as the ability that some individuals (often saints, monks or (...) mystics) would have of being in two, or more, places at the same time. The advent of the Internet, new technologies and social networks has opened up new and unexpected possibilities in this respect, enabling one to expand oneself. If not long ago, these experiences had to be ‘lived’ through cinema and literature; today, it is possible to undergo them in first person: everyone is allowed to create other selves, other profiles, avatars, entities or doppelgängers that can operate in the world (remotely) as extensions of him or her. Consequently, the image has also undergone a change in function and status, opening new possibilities through its digitalization. The present work intends to explore the relationship between presence, telepresence, images and the self. (shrink)

If a robot sends a deceptive signal to a human user, is this always and everywhere an unethical act, or might it sometimes be ethically desirable? Building upon previous work in robot ethics, this article tries to clarify and refine our understanding of the ethics of robotic deception. It does so by making three arguments. First, it argues that we need to distinguish between three main forms of robotic deception (external state deception; superficial state deception; and hidden state (...) deception) in order to think clearly about its ethics. Second, it argues that the second type of deception – superficial state deception – is not best thought of as a form of deception, even though it is frequently criticised as such. And third, it argues that the third type of deception is best understood as a form of betrayal because doing so captures the unique ethical harm to which it gives rise, and justifies special ethical protections against its use. (shrink)

We are living through an era of increased robotisation. Some authors have already begun to explore the impact of this robotisation on legal rules and practice. In doing so, many highlight potential liability gaps that might arise through robot misbehaviour. Although these gaps are interesting and socially significant, they do not exhaust the possible gaps that might be created by increased robotisation. In this article, I make the case for one of those alternative gaps: the retribution gap. This gap (...) arises from a mismatch between the human desire for retribution and the absence of appropriate subjects of retributive blame. I argue for the potential existence of this gap in an era of increased robotisation; suggest that it is much harder to plug this gap than it is to plug those thus far explored in the literature; and then highlight three important social implications of this gap. (shrink)

Robots are increasingly envisaged as our future cohabitants. However, while considerable progress has been made in recent years in terms of their technological realization, the ability of robots to inter-act with humans in an intuitive and social way is still quite limited. An important challenge for social robotics is to determine how to design robots that can perceive the user’s needs, feelings, and intentions, and adapt to users over a broad range of cognitive abilities. It is conceivable that if robots (...) were able to adequately demonstrate this, humans would eventually accept them as social companions. We argue that the best way to achieve this is using a systematic experimental approach based on behavioral and physiological neuroscience methods such as motion/eye tracking, electroencephalography (EEG), or functional near-infrared spectroscopy (fNIRS) embedded in interactive human-robot paradigms. This approach requires understanding how humans interact with each other, how they perform tasks together and how they develop feelings of social connection over time, and using these insights to formulate design principles that make social robots attuned to the workings of the human brain. In this review, we put forward the argument that the likelihood of artificial agents being perceived as social companions can be increased by designing them in a way that they are perceived as intentional agents that activate areas in the human brain involved in social-cognitive processing. We first review literature related to social-cognitive mechanisms involved in human-human interactions, and high-light the importance of perceiving others as intentional agents to activate these brain areas. We then discuss how attribution of intentionality can positively affect human-robot interaction by (a) fostering feelings of social connection, empathy and prosociality, and by (b) enhancing performance on joint human-robot tasks. Lastly, we describe circumstances under which attribution of intentionality to robot agents might be disadvantageous, and discuss challenges associated with designing social robots that are inspired by neuroscientific principles. (shrink)

Sex robots are likely to play an important role in shaping public understandings of sex and of relations between the sexes in the future. This paper contributes to the larger project of understanding how they will do so by examining the ethics of the “rape” of robots. I argue that the design of realistic female robots that could explicitly refuse consent to sex in order to facilitate rape fantasy would be unethical because sex with robots in these circumstances is a (...) representation of the rape of a woman, which may increase the rate of rape, expresses disrespect for women, and demonstrates a significant character defect. Even when the intention is not to facilitate rape, the design of robots that can explicitly refuse consent is problematic due to the likelihood that some users will experiment with raping them. Designing robots that lack the capacity to explicitly refuse consent may be morally problematic depending on which of two accounts of the representational content of sex with realistic humanoid robots is correct. (shrink)

The prospective robots in healthcare intended to be included within the conclave of the nurse-patient relationship—what I refer to as care robots—require rigorous ethical reflection to ensure their design and introduction do not impede the promotion of values and the dignity of patients at such a vulnerable and sensitive time in their lives. The ethical evaluation of care robots requires insight into the values at stake in the healthcare tradition. What’s more, given the stage of their development and lack of (...) standards provided by the International Organization for Standardization to guide their development, ethics ought to be included into the design process of such robots. The manner in which this may be accomplished, as presented here, uses the blueprint of the Value-sensitive design approach as a means for creating a framework tailored to care contexts. Using care values as the foundational values to be integrated into a technology and using the elements in care, from the care ethics perspective, as the normative criteria, the resulting approach may be referred to as care centered value-sensitive design. The framework proposed here allows for the ethical evaluation of care robots both retrospectively and prospectively. By evaluating care robots in this way, we may ultimately ask what kind of care we, as a society, want to provide in the future. (shrink)

The development of autonomous, robotic weaponry is progressing rapidly. Many observers agree that banning the initiation of lethal activity by autonomous weapons is a worthy goal. Some disagree with this goal, on the grounds that robots may equal and exceed the ethical conduct of human soldiers on the battlefield. Those who seek arms-control agreements limiting the use of military robots face practical difficulties. One such difficulty concerns defining the notion of an autonomous action by a robot. Another challenge concerns (...) how to verify and monitor the capabilities of rapidly changing technologies. In this article we describe concepts from our previous work about autonomy and ethics for robots and apply them to military robots and robot arms control. We conclude with a proposal for a first step toward limiting the deployment of autonomous weapons capable of initiating lethal force. (shrink)

The United States Army’s Future Combat Systems Project, which aims to manufacture a “robot army” to be ready for deployment by 2012, is only the latest and most dramatic example of military interest in the use of artificially intelligent systems in modern warfare. This paper considers the ethics of a decision to send artificially intelligent robots into war, by asking who we should hold responsible when an autonomous weapon system is involved in an atrocity of the sort that would (...) normally be described as a war crime. A number of possible loci of responsibility for robot war crimes are canvassed; the persons who designed or programmed the system, the commanding officer who ordered its use, the machine itself. I argue that in fact none of these are ultimately satisfactory. Yet it is a necessary condition for fighting a just war, under the principle of jus in bellum, that someone can be justly held responsible for deaths that occur in the course of the war. As this condition cannot be met in relation to deaths caused by an autonomous weapon system it would therefore be unethical to deploy such systems in warfare. (shrink)

Sex robots are already a reality: in this provocative text, Maurizio Balistreri explores the fascinating world of future sex, exploring the ethical questions raised by the existence of a sex robot industry.

This paper explores the relationship between dignity and robot care for older people. It highlights the disquiet that is often expressed about failures to maintain the dignity of vulnerable older people, but points out some of the contradictory uses of the word ‘dignity’. Certain authors have resolved these contradictions by identifying different senses of dignity; contrasting the inviolable dignity inherent in human life to other forms of dignity which can be present to varying degrees. The Capability Approach (CA) is (...) introduced as a different but tangible account of what it means to live a life worthy of human dignity. It is used here as a framework for the assessment of the possible effects of eldercare robots on human dignity. The CA enables the identification of circumstances in which robots could enhance dignity by expanding the set of capabilities that are accessible to frail older people. At the same time, it is also possible within its framework to identify ways in which robots could have a negative impact, by impeding the access of older people to essential capabilities. It is concluded that the CA has some advantages over other accounts of dignity, but that further work and empirical study is needed in order to adapt it to the particular circumstances and concerns of those in the latter part of their lives. (shrink)

Social robots are robots that can interact socially with humans. As social robots and the artificial intelligence that powers them becomes more advanced, they will likely take on more social and work roles. This has many important ethical implications. In this paper, we focus on one of the most central of these, the impacts that social robots can have on human autonomy. We argue that, due to their physical presence and social capacities, there is a strong potential for social robots (...) to enhance human autonomy as well as several ways they can inhibit and disrespect it. We argue that social robots could improve human autonomy by helping us to achieve more valuable ends, make more authentic choices, and improve our autonomy competencies. We also argue that social robots have the potential to harm human autonomy by instead leading us to achieve fewer valuable ends ourselves, make less authentic choices, decrease our autonomy competencies, make our autonomy more vulnerable, and disrespect our autonomy. Whether the impacts of social robots on human autonomy are positive or negative overall will depend on the design, regulation, and use we make of social robots in the future. (shrink)

Soon there will be sex robots. The creation of such devices raises a host of social, legal and ethical questions. In this article, I focus in on one of them. What if these sex robots are deliberately designed and used to replicate acts of rape and child sexual abuse? Should the creation and use of such robots be criminalised, even if no person is harmed by the acts performed? I offer an argument for thinking that they should be. The argument (...) consists of two premises. The first claims that it can be a proper object of the criminal law to regulate wrongful conduct with no extrinsically harmful effects on others. The second claims that the use of robots that replicate acts of rape and child sexual abuse would be wrongful, even if such usage had no extrinsically harmful effects on others. I defend both premises of this argument and consider its implications for the criminal law. I do not offer a conclusive argument for criminalisation, nor would I wish to be interpreted as doing so; instead, I offer a tentative argument and a framework for future debate. This framework may also lead one to question the proposed rationales for criminalisation. (shrink)

This paper offers a theoretical framework that can be used to derive viable engineering strategies for the design and development of robots that can nudge people towards moral improvement. The framework relies on research in developmental psychology and insights from Stoic ethics. Stoicism recommends contemplative practices that over time help one develop dispositions to behave in ways that improve the functioning of mechanisms that are constitutive of moral cognition. Robots can nudge individuals towards these practices and can therefore help develop (...) the dispositions to, for example, extend concern to others, avoid parochialism, etc. (shrink)

The development of highly humanoid sex robots is on the technological horizon. If sex robots are integrated into the legal community as “electronic persons”, the issue of sexual consent arises, which is essential for legally and morally permissible sexual relations between human persons. This paper explores whether it is conceivable, possible, and desirable that humanoid robots should be designed such that they are capable of consenting to sex. We consider reasons for giving both “no” and “yes” answers to these three (...) questions by examining the concept of consent in general, as well as critiques of its adequacy in the domain of sexual ethics; the relationship between consent and free will; and the relationship between consent and consciousness. Additionally we canvass the most influential existing literature on the ethics of sex with robots. (shrink)

Robots are becoming an increasingly pervasive feature of our personal lives. As a result, there is growing importance placed on examining what constitutes appropriate behavior when they interact with human beings. In this paper, we discuss whether companion robots should be permitted to “nudge” their human users in the direction of being “more ethical”. More specifically, we use Rawlsian principles of justice to illustrate how robots might nurture “socially just” tendencies in their human counterparts. Designing technological artifacts in such a (...) way to influence human behavior is already well-established but merely because the practice is commonplace does not necessarily resolve the ethical issues associated with its implementation. (shrink)

The uncanny valley—the unnerving nature of humanlike robots—is an intriguing idea, but both its existence and its underlying cause are debated. We propose that humanlike robots are not only unnerving, but are so because their appearance prompts attributions of mind. In particular, we suggest that machines become unnerving when people ascribe to them experience, rather than agency. Experiment 1 examined whether a machine’s humanlike appearance prompts both ascriptions of experience and feelings of unease. Experiment 2 tested whether a machine capable (...) of experience remains unnerving, even without a humanlike appearance. Experiment 3 investigated whether the perceived lack of experience can also help explain the creepiness of unfeeling humans and philosophical zombies. These experiments demonstrate that feelings of uncanniness are tied to perceptions of experience, and also suggest that experience—but not agency—is seen as fundamental to humans, and fundamentally lacking in machines. (shrink)

A growing body of research can be found in which roboticists are designing for reciprocity as a key construct for successful human–robot interaction (HRI). Given the centrality of reciprocity as a component for our moral lives (for moral development and maintaining the just society), this paper confronts the possibility of what things would look like if the benchmark to achieve perceived reciprocity were accomplished. Through an analysis of the value of reciprocity from the care ethics tradition the richness of (...) reciprocity as an inherent value is revealed: on the micro-level, as mutual care for immediate care givers, and on the macro-level, as foundational for a just society. Taking this understanding of reciprocity into consideration, it becomes clear that HRI cannot achieve this bidirectional value of reciprocity; a robot must deceive users into believing it is capable of reciprocating to humans or is deserving of reciprocation from humans. Moreover, on the macro-level, designing social robots for reciprocity threatens the ability and willingness to reciprocate to human care workers across society. Because of these concerns, I suggest re-thinking the goals of reciprocity in social robotics. Designing for reciprocity in social robotics should be dedicated to the design of robots to enhance the ability to mutually care for those that provide us with care, as opposed to designing for reciprocity between human and robot. (shrink)

Should we grant rights to artificially intelligent robots? Most current and near-future robots do not meet the hard criteria set by deontological and utilitarian theory. Virtue ethics can avoid this problem with its indirect approach. However, both direct and indirect arguments for moral consideration rest on ontological features of entities, an approach which incurs several problems. In response to these difficulties, this paper taps into a different conceptual resource in order to be able to grant some degree of moral consideration (...) to some intelligent social robots: it sketches a novel argument for moral consideration based on social relations. It is shown that to further develop this argument we need to revise our existing ontological and social-political frameworks. It is suggested that we need a social ecology, which may be developed by engaging with Western ecology and Eastern worldviews. Although this relational turn raises many difficult issues and requires more work, this paper provides a rough outline of an alternative approach to moral consideration that can assist us in shaping our relations to intelligent robots and, by extension, to all artificial and biological entities that appear to us as more than instruments for our human purposes. (shrink)

Robots today serve in many roles, from entertainer to educator to executioner. As robotics technology advances, ethical concerns become more pressing: Should robots be programmed to follow a code of ethics, if this is even possible? Are there risks in forming emotional bonds with robots? How might society--and ethics--change with robotics? This volume is the first book to bring together prominent scholars and experts from both science and the humanities to explore these and other questions in this emerging field. Starting (...) with an overview of the issues and relevant ethical theories, the topics flow naturally from the possibility of programming robot ethics to the ethical use of military robots in war to legal and policy questions, including liability and privacy concerns. The contributors then turn to human-robot emotional relationships, examining the ethical implications of robots as sexual partners, caregivers, and servants. Finally, they explore the possibility that robots, whether biological-computational hybrids or pure machines, should be given rights or moral consideration. Ethics is often slow to catch up with technological developments. This authoritative and accessible volume fills a gap in both scholarly literature and policy discussion, offering an impressive collection of expert analyses of the most crucial topics in this increasingly important field. (shrink)

Technological developments involving robotics and artificial intelligence devices are being employed evermore in elderly care and the healthcare sector more generally, raising ethical issues and practical questions warranting closer considerations of what we mean by “care” and, subsequently, how to design such software coherently with the chosen definition. This paper starts by critically examining the existing approaches to the ethical design of care robots provided by Aimee van Wynsberghe, who relies on the work on the ethics of care by Joan (...) Tronto. In doing so, it suggests an alternative to their non-principled approach, an alternative suited to tackling some of the issues raised by Tronto and van Wynsberghe, while allowing for the inclusion of two orientative principles. Our proposal centres on the principles of autonomy and vulnerability, whose joint adoption we deem able to constitute an original revision of a bottom-up approach in care ethics. Conclusively, the ethical framework introduced here integrates more traditional approaches in care ethics in view of enhancing the debate regarding the ethical design of care robots under a new lens. (shrink)

Responsible Robotics is about developing robots in ways that take their social implications into account, which includes conceptually framing robots and their role in the world accurately. We are now in the process of incorporating robots into our world and we are trying to figure out what to make of them and where to put them in our conceptual, physical, economic, legal, emotional and moral world. How humans think about robots, especially humanoid social robots, which elicit complex and sometimes disconcerting (...) reactions, is not predetermined. The animal–robot analogy is one of the most commonly used in attempting to frame interactions between humans and robots and it also tends to push in the direction of blurring the distinction between humans and machines. We argue that, despite some shared characteristics, when it comes to thinking about the moral status of humanoid robots, legal liability, and the impact of treatment of humanoid robots on how humans treat one another, analogies with animals are misleading. (shrink)

In this paper, we theoretically address the relevance of unintentional and inconsistent interactional elements in human–robot interactions. We argue that elements failing, or poorly succeeding, to reproduce a humanlike interaction create significant consequences in human–robot relational patterns and may affect human–human relations. When considering social interactions as systems, the absence of a precise interactional element produces a general reshaping of the interactional pattern, eventually generating new types of interactional settings. As an instance of this dynamic, we study the (...) absence of metacommunicative abilities in social artifacts. Then, we analyze the pragmatic consequences of the aforementioned absence through the lens of Paul Watzlawick’s interactionist theory. We suggest that a fixed complementary interactional setting may be produced because of the asymmetric understanding, between robots and humans, of metacommunication. We highlight the psychological implications of this interactional asymmetry within Jessica Benjamin’s concept of “mutual recognition”. Finally, we point out the possible shift of dysfunctional interactional patterns from human–robot interactions to human–human ones. (shrink)

An elderly patient in a care home only wants human nurses to provide her care – not robots. If she selected her carers based on skin colour, it would be seen as racist and morally objectionable, but is choosing a human nurse instead of a robot also morally objectionable and speciesist? A plausible response is that it is not, because humans provide a better standard of care than robots do, making such a choice justifiable. In this paper, I show (...) why this response is incorrect, because robots can theoretically care as well as human nurses can. I differentiate between practical caring and emotional caring, and I argue that robots can match the standard of practical care given by human nurses, and they can simulate emotional care. There is growing evidence that people respond positively to robotic creatures and carebots, and AI software is apt to emotionally support patients in spite of the machine’s own lack of emotions. I make the case that the appearance of emotional care is sufficient, and need not be linked to emotional states within the robot. After all, human nurses undoubtedly ‘fake’ emotional care and compassion sometimes, yet their patients still feel adequately cared for. I show that it is a mistake to claim that ‘the human touch’ is in itself a contributor to a higher standard of care; ‘the robotic touch’ will suffice. Nevertheless, it is not speciesist to favour human nurses over carebots, because carebots do not suffer as the result of such a choice. (shrink)

Computers are already approving financial transactions, controlling electrical supplies, and driving trains. Soon, service robots will be taking care of the elderly in their homes, and military robots will have their own targeting and firing protocols. Colin Allen and Wendell Wallach argue that as robots take on more and more responsibility, they must be programmed with moral decision-making abilities, for our own safety. Taking a fast paced tour through the latest thinking about philosophical ethics and artificial intelligence, the authors argue (...) that even if full moral agency for machines is a long way off, it is already necessary to start building a kind of functional morality, in which artificial moral agents have some basic ethical sensitivity. But the standard ethical theories don't seem adequate, and more socially engaged and engaging robots will be needed. As the authors show, the quest to build machines that are capable of telling right from wrong has begun. -/- Moral Machines is the first book to examine the challenge of building artificial moral agents, probing deeply into the nature of human decision making and ethics. (shrink)

This paper offers an ethical framework for the development of robots as home companions that are intended to address the isolation and reduced physical functioning of frail older people with capacity, especially those living alone in a noninstitutional setting. Our ethical framework gives autonomy priority in a list of purposes served by assistive technology in general, and carebots in particular. It first introduces the notion of “presence” and draws a distinction between humanoid multi-function robots and non-humanoid robots to suggest that (...) the former provide a more sophisticated presence than the latter. It then looks at the difference between lower-tech assistive technological support for older people and its benefits, and contrasts these with what robots can offer. This provides some context for the ethical assessment of robotic assistive technology. We then consider what might need to be added to presence to produce care from a companion robot that deals with older people’s reduced functioning and isolation. Finally, we outline and explain our ethical framework. We discuss how it combines sometimes conflicting values that the design of a carebot might incorporate, if informed by an analysis of the different roles that can be served by a companion robot. (shrink)

As robots slip into more domains of human life - from the operating room to the bedroom - they take on our morally important tasks and decisions, as well as create new risks from psychological to physical. This book answers the urgent call to study their ethical, legal, and policy impacts.

There is increasing speculation within military and policy circles that the future of armed conflict is likely to include extensive deployment of robots designed to identify targets and destroy them without the direct oversight of a human operator. My aim in this paper is twofold. First, I will argue that the ethical case for allowing autonomous targeting, at least in specific restricted domains, is stronger than critics have acknowledged. Second, I will attempt to uncover, explicate, and defend the intuition that (...) even in this context there would be something ethically problematic about such targeting. I argue that an account of the non-consequentialist foundations of the principle of distinction suggests that the use of autonomous weapon systems is unethical by virtue of failing to show appropriate respect for the humanity of our enemies. However, the success of the strongest form of this argument depends upon understanding the robot itself as doing the killing. To the extent that we believe that, on the contrary, AWS are only the means whereby those who order them into action kill, the idea that the use of AWS fails to respect the humanity of our enemy will turn upon an account of what is required by respect that is essentially conventional. Thus, while the theoretical foundations of the idea that AWS are weapons that are “evil in themselves” are weaker than critics have sometimes maintained, they are nonetheless sufficient to the task of demanding a prohibition of the development and deployment of such weapons. (shrink)

In this paper I describe a future in which persons in advanced old age are cared for entirely by robots and suggest that this would be a dystopia, which we would be well advised to avoid if we can. Paying attention to the objective elements of welfare rather than to people’s happiness reveals the central importance of respect and recognition, which robots cannot provide, to the practice of aged care. A realistic appreciation of the current economics of the aged care (...) sector suggests that the introduction of robots into an aged care setting will most likely threaten rather than enhance these goods. I argue that, as a result, the development of robotics is likely to transform aged care in accordance with a trajectory of development that leads towards this dystopian future even when this is not the intention of the engineers working to develop robots for aged care. While an argument can be made for the use of robots in aged care where the people being cared for have chosen to allow robots in this role, I suggest that over-emphasising this possibility risks rendering it a self-fulfilling prophecy, depriving those being cared for of valuable social recognition, and failing to provide respect for older persons by allowing the options available to them to be shaped by the design choices of others. (shrink)

The status and functioning of shame is contested in moral psychology. In much of anglophone philosophy and psychology, it is presumed to be largely destructive, while in Confucian philosophy and many East Asian communities, it is positively associated with moral development. Recent work in human-robot interaction offers a unique opportunity to investigate how shame functions while controlling for confounding variables of interpersonal interaction. One research program suggests a Confucian strategy for using robots to rebuke participants, but results from experiments (...) with educational technologies imply a different and potentially opposing account of shame’s role in personal development. By digging deeper into the details of Confucian theorizing about shame, I identify a unifying explanation for these apparently conflicting results. I conclude by offering suggestions for future empirical research in human-robot interactions to further investigate shame’s role in moral development. (shrink)