Empirical research on human–robot interaction has demonstrated how humans tend to react to social robots with empathic responses and moral behavior. How should we ethically evaluate such responses to robots? Are people wrong to treat non-sentient artefacts as moral patients since this rests on anthropomorphism and ‘over-identification’ —or correct since spontaneous moral intuition and behavior toward nonhumans is indicative for moral patienthood, such that social robots become our ‘Others’?. In this research paper, I weave extant HRI studies that demonstrate empathic (...) responses toward robots with the recent debate on moral status for robots, on which the ethical evaluation of moral behavior toward them is dependent. Patienthood for robots has standardly been thought to obtain on some intrinsic ground, such as being sentient, conscious, or having interest. But since these attempts neglect moral experience and are curbed by epistemic difficulties, I take inspiration from Coeckelbergh and Gunkel’s ‘relational approach’ to explore an alternative way of accounting for robot patienthood based on extrinsic premises. Based on the ethics of Danish theologian K. E. Løgstrup I argue that empathic responses can be interpreted as sovereign expressions of life and that these expressions benefit human subjects—even if they emerge from social interaction afforded by robots we have anthropomorphized. I ultimately develop an argument in defense of treating robots as moral patients. (shrink)

This article addresses the problematic perspectives of drone culture. In critiquing focus on the drone’s apparent ‘autonomy’, it argues that such devices function as part of a socio-technical network. They are relational parts of human–machine interaction that, in our changing geopolitical realities, have a powerful influence on politics, reputation and warfare. Drawing on Žižek’s conception of parallax, the article stresses the importance of culture and perception in forming the role of the drone in widening power asymmetries. It examines how perceptions (...) of autonomy are evoked by drones, to claim that this misperception is a smokescreen that obscures the relational socio-technical realities of the drone. The article therefore argues that a more critical culture of the drone emerges by shifting the focus and perception from autonomy to anonymity. This allows us to engage more fully with the distributed agency and decision-making that define how drones are developed and deployed. Rather than focusing on the drone as a singular, fetishised, technical object, a relational approach to the drone assemblage is proposed that highlights the competing human interests that define and resist drones in global politics and culture. (shrink)

This paper argues that there is a need to critically assess bias in the representations of older adults in the field of Human–Robot Interaction. This need stems from the recognition that technology development is a socially constructed process that has the potential to reinforce problematic understandings of older adults. Based on a qualitative content analysis of 96 academic publications, this paper indicates that older adults are represented as; frail by default, independent by effort; silent and technologically illiterate; burdensome; and problematic (...) for society. Within these documents, few counternarratives are present that do not take such essentialist representations. In these texts, the goal of social robots in elder care is to “enable” older adults to “better” themselves. The older body is seen as “fixable” with social robots, reinforcing an ageist and neoliberal narrative: older adults are reduced to potential care receivers in ways that shift care responsibilities away from the welfare state onto the individual. (shrink)

Profit-oriented service sectors such as tourism, hospitality, and entertainment are increasingly looking at how professional service robots can be integrated into the workplace to perform socio-cognitive tasks that were previously reserved for humans. This is a work in which social and labor sciences recognize the principle role of emotions. However, the models and narratives of emotions that drive research, design, and deployment of service robots in human–robot interaction differ considerably from how emotions are framed in the sociology of labor and (...) feminist studies of service work. In this paper, we explore these tensions through the concepts of affective and emotional labor, and outline key insights these concepts offer for the design and evaluation of professional service robots. Taken together, an emphasis on interactionist approaches to emotions and on the demands of affective labor, leads us to argue that service employees are under-represented in existing studies in human–robot interaction. To address this, we outline how participatory design and value-sensitive design approaches can be applied as complimentary methodological frameworks that include service employees as vital stakeholders. (shrink)

The false attribution of autonomy and related concepts to artificial agents that lack the attributed levels of the respective characteristic is problematic in many ways. In this article, we contrast this view with a positive viewpoint that emphasizes the potential role of such false attributions in the context of robotic language acquisition. By adding emotional displays and congruent body behaviors to a child-like humanoid robot’s behavioral repertoire, we were able to bring naïve human tutors to engage in so called intent (...) interpretations. In developmental psychology, intent interpretations can be hypothesized to play a central role in the acquisition of emotion, volition, and similar autonomy-related words. The aforementioned experiments originally targeted the acquisition of linguistic negation. However, participants produced other affect- and motivation-related words with high frequencies too and, as a consequence, these entered the robot’s active vocabulary. We will analyze participants’ non-negative emotional and volitional speech and contrast it with participants’ speech in a non-affective baseline scenario. Implications of these findings for robotic language acquisition in particular and artificial intelligence and robotics more generally will also be discussed. (shrink)

To integrate social robots in real-life contexts, it is crucial that they are accepted by the users. Acceptance is not only related to the functionality of the robot but also strongly depends on how the user experiences the interaction. Established design principles from usability and user experience research can be applied to the realm of human–robot interaction, to design robot behavior for the comfort and well-being of the user. Focusing the design on these aspects alone, however, comes with certain ethical (...) challenges, especially regarding the user’s privacy and autonomy. Based on an example scenario of human–robot interaction in elder care, this paper discusses how established design principles can be used in social robotic design. It then juxtaposes these with ethical considerations such as privacy and user autonomy. Combining user experience and ethical perspectives, we propose adjustments to the original design principles and canvass our own design recommendations for a positive and ethically acceptable social human–robot interaction design. In doing so, we show that positive user experience and ethical design may be sometimes at odds, but can be reconciled in many cases, if designers are willing to adjust and amend time-tested design principles. (shrink)

This paper extends Mori’s uncanny valley-hypothesis to include technologies that fail its basic criterion that uncanniness arises when the subject experiences a discrepancy in a machine’s human likeness. In so doing, the paper considers Mori’s hypothesis about the uncanny valley as an instance of what Heidegger calls the ‘challenging revealing’ nature of modern technology. It introduces seeming autonomy and heteronomy as phenomenological categories that ground human being-in-the-world including our experience of things and people. It is suggested that this categorical distinction (...) is more foundational than Heidegger’s existential structures and phenomenological categories. Having introduced this novel phenomenological distinction, the paper considers the limits of Mori’s hypothesis by drawing on an example from science fiction that showcases that uncanniness need not only be caused by machines that resemble human beings. In so doing, it explores how the seeming autonomy-heteronomy distinction clarifies the uncanniness that can arise when humans encounter advanced technology which is irreducible to the anthropocentrism that shapes Mori’s original hypothesis. (shrink)

Advanced technologies such as drones, intelligent algorithms and androids have grave implications for human existence. With the purpose of exploring their basis for doing so, the paper proposes a framework for investigating the complex relationship between such devices and human practices and language-mediated cognition. Specifically, it centers on the importance of the typically neglected intermediate layer of culture which not only drives both technophobia and philia but also, more fundamentally, connects pre-reflective experience and socio-material practices by placing advanced technologies in (...) the loop. Theoretically, the paper draws on contributions from performativist Science and Technology Studies and Radically Embodied Cognitive Science and pushes new grounds by stressing their compatibility. Yet, it also emphasizes the importance of the enlanguaged side of cognition which is a requirement for human-style socio-material practices and, hence, the emergence of cultures that fetishizes certain technologies. (shrink)

Current research in human–robot interaction often focuses on rendering communication between humans and robots more ‘natural’ by designing machines that appear and behave humanlike. Communication, in this human-centric approach, is often understood as a process of successfully transmitting information in the form of predefined messages and gestures. This article introduces an alternative arts-led, movement-centric approach, which embraces the differences of machinelike robotic artefacts and, instead, investigates how meaning is dynamically enacted in the encounter of humans and machines. Our design approach (...) revolves around a novel embodied mapping methodology, which serves to bridge between human–machine asymmetries and socioculturally situate abstract robotic artefacts. Building on concepts from performativity, material agency, enactive sense-making and kinaesthetic empathy, our Machine Movement Lab project opens up a performative-relational model of human–machine communication, where meaning is generated through relational dynamics in the interaction itself. (shrink)

In this paper, the aim is to study how the work organization in one specific company for one specific trade has changed over time and with these changes, the presence and absence of alienation of employees in this trade. Blauner’s U-shaped alienation development trend has been a reference in discussions on alienation. It displays a connection between the degree of alienation and technological development. The findings from this study verify the trend and the connection in the case company. However, although (...) the development trend may look similar to that of Blauner’s model, it is differently founded. Where previous studies highlight the production system, including technology, as crucial to the presence of alienation, this study documents that external conditions outside or partly outside the company’s control—such as digital information availability, product complexity, and quality requirements—will determine the presence of alienation. Thus, researchers should adjust the content of the concept of alienation accordingly. (shrink)

While facing cuts, downsizing and revenue losses, media organizations experience paradoxical demands in being organized for print or linear production with daily deadlines and simultaneously striving to be ‘digital first’ and produce and publish stories online on a continuous basis throughout the day. In this paper, we describe efforts applied when introducing the metaphor flowline in a medium-sized newspaper organization in Norway with the aim of aligning their production and publishing processes to readers’ consumption of online news. Both the production (...) volume of journalistic content, reader consumption and the newsroom workers’ experience of mastering their everyday work life increased dramatically in a very short time. The involvement of a temporary autonomous team in the planning and designing of a test pilot aiming to make flowline “as practice”, was integral to the digital transformation success, allowing for participative action across newsroom boundaries. Based on the empirical findings from the local newspaper organization and drawing on theories on liminality and metaphorical work, this article presents a set of six interrelated steps incorporating a structure for autonomous teams and their role in enabling lasting change in organizations facing digital transformation. (shrink)

This article makes the case for including frameworks of media ecology and mobilities research in the shaping of critical robotics research for a human-centered and holistic lens onto robot technologies. The two meta-disciplines, which align in their attention to relational processes of communication and movement, provide useful tools for critically exploring emerging human–robot dimensions and dynamics. Media ecology approaches human-made technologies as media that can shape the way we think, feel, and act. Relatedly, mobilities research highlights various kinds of influential (...) movement and stillness of people, things, and ideas. The emerging field of critical robotics research can benefit from such attention to the ways of thinking, feeling, and moving robotic forms and environments encourage and discourage. Drawing on various studies into robotics, I illustrate those conceptual alignments of media ecology, mobilities, and critical robotics research and point to the value of this interdisciplinary approach to robots as media and robotics as socio-cultural environments. (shrink)

In this paper, I develop a view about machine autonomy grounded in the theoretical frameworks of 4E cognition and PF Strawson’s reactive attitudes. I begin with critical discussion of White, and conclude that his view is strongly committed to functionalism as it has developed in mainstream analytic philosophy since the 1950s. After suggesting that there is good reason to resist this view by appeal to developments in 4E cognition, I propose an alternative view of machine autonomy. Namely, machines count as (...) autonomous when we members of the moral community adopt reactive attitudes in response to their actions. I distinguish this view from White’s and suggest assets and liabilities of this approach. (shrink)

When the social relevance of robotic applications is addressed today, the use of assistive technology in care settings is almost always the first example. So-called care robots are presented as a solution to the nursing crisis, despite doubts about their technological readiness and the lack of concrete usage scenarios in everyday nursing practice. We inquire into this interconnection of social robotics and care. We show how both are made available for each other in three arenas: innovation policy, care organization, and (...) robotic engineering. First, we analyze the discursive “logics” of care robotics within European innovation policy, second, we disclose how care robotics is encountering a historically grown conflict within health care organization, and third we show how care scenarios are being used in robotic engineering. From this diagnosis, we derive a threefold critique of robotics in healthcare, which calls attention to the politics, historicity, and social situatedness of care robotics in elderly care. (shrink)

The urban environment is increasingly engaging with artificial intelligence, a focus on the automation of urban processes, whether it be singular artefacts or city-wide systems. The impact of such technological innovation on the social dynamics of the urban environment is an ever changing and multi-faceted field of research. In this paper, the space and time defined by the autonomous vehicle is used as a window to view the way in which a shift in urban transport dynamics can impact the temporal (...) experience of an individual. Using the finite window of time created by an autonomous vehicle, a theoretical framework is put forward that seeks to show how contrasting narratives exist regarding the experience of the window of time within the autonomous vehicle. By taking a theoretical approach informed by social theory, the dissolution of barriers between separate spheres of life is explored to highlight the increased commodification of time. In focusing on both the space and time created by the autonomous vehicle this approach seeks to highlight how artificial intelligence can provide a contemporary space in the urban environment while also opening a new window of time. The cognitive dissonance observed when comparing the narratives of autonomous vehicle stakeholders and the historical shift in time use leads to a belief that technology makes the user more free in terms of time. With this paper the autonomous vehicle is shown to be an ideal space and time to view the way in which the use of such technology does not increase free-time, but further dissolves the boundaries between what is and what is not work-time. (shrink)

Robotics is currently not only a cutting-edge research area, but is potentially disruptive to all domains of our lives—for better and worse. While legislation is struggling to keep pace with the development of these new artifacts, our intellectual limitations and physical laws seem to present the only hard demarcation lines, when it comes to state-of-the-art R&D. To better understand the possible implications, the paper at hand critically investigates underlying processes and structures of robotics in the context of Heidegger’s and Nishitani’s (...) accounts of science and technology. Furthermore, the analysis draws on Bauman’s theory of modernity in an attempt to assess the potential risk of large-scale robot integration. The paper will highlight undergirding mechanisms and severe challenges imposed upon our socio-cultural lifeworlds by massive robotic integration. Admittedly, presenting a mainly melancholic account, it will, however, also explore the possibility of robotics forcing us to reassess our position and to solve problems, which we seem unable to tackle without facing existential crises. (shrink)

Social robots are gradually entering children’s lives in a period when children learn about social relationships and exercise prosocial behaviors with parents, peers, and teachers. Designed for long-term emotional engagement and to take the roles of friends, teachers, and babysitters, such robots have the potential to influence how children develop empathy. This article presents a review of the literature in the fields of human–robot interaction, psychology, neuropsychology, and roboethics, discussing the potential impact of communication with social robots on children’s social (...) and emotional development. The critical analysis of evidence behind these discussions shows that, although robots theoretically have high chances of influencing the development of empathy in children, depending on their design, intensity, and context of use, there is no certainty about the kind of effect they might have. Most of the analyzed studies, which showed the ability of robots to improve empathy levels in children, were not longitudinal, while the studies observing and arguing for the negative effect of robots on children’s empathy were either purely theoretical or dependent on the specific design of the robot and the situation. Therefore, there is a need for studies investigating the effects on children’s social and emotional development of long-term regular and consistent communication with robots of various designs and in different situations. (shrink)

The organizational theory literature is reasonably unanimous that team autonomy is a key factor for employee well-being and motivation as well as organizational performance. However, team autonomy is challenged when its processes and outputs need to be aligned with actors and factors external to a team. There are likely challenges and conflicts between team autonomy and the need for coherence in the wider system. Team autonomy has a range of implications and is challenged by a number of factors, such as (...) knowledge complexity and decision-making, learning, large-scale problems, product and technical interdependencies, the use of platforms, virtual collaboration and diversity. Alignment with the external is particularly necessary in multi-team environments with many technical interdependencies, where a single team’s failure to deliver a sufficient level of quality may lead to system-wide consequences. Therefore, teams in complex environments increasingly need to regulate and manage their work in cooperation with internal and external partners and systems. Such dependencies challenge team autonomy. In this special issue of AI&S, we want to address these topics in more detail, particularly in the context of software-intensive organizations and digital transformations. The scope and, thus, the consequences of a team’s work can be far-reaching when the team’s effort and output take place partially or completely in fully digitized contexts and processes. The articles in this special issue show various ways of dealing with the challenge of balancing autonomy and alignment with the external. A key focus is to show the buffering function: how teams, with the help of processes, technology, new organizational forms and time and space are able to find the buffer needed for maintaining team autonomy. (shrink)

The role of software architecture in large-scale Agile development is important because several teams need to work together to release a single software product while helping to maximise teams’ autonomy. Governing and aligning Agile architecture across autonomous squads, when using the Spotify model, is a challenge because the Spotify model lacks practices for addressing Agile architecture governance. To explore how software architecture can be governed and aligned by scaling the Spotify model, we conducted a longitudinal embedded case study in a (...) multinational FinTech organisation. Then, we developed and evaluated an approach for architectural governance by conducting an embedded case study. The collected data was analysed using Thematic Analysis and informed by selected Grounded Theory techniques such as memoing, open coding, constant comparison, and sorting. Our approach for architectural governance comprises an organisational structure change and an architecture change management process. The benefits reported by the practitioners include devolving architectural decision-making to the operational level, enhancing architectural knowledge sharing among squads, minimising wasted effort in architectural refactoring, and other benefits. The practitioners in our case study realised an improved squad autonomy by the ability to govern and align architectural decisions. We provide two key contributions in this paper. First, we present the characteristics of our proposed architectural governance approach, its evaluation, benefits, and challenges. Second, we present how the novel Heterogeneous Tailoring model was enhanced to accommodate our architectural governance approach. (shrink)

To operate in an unpredictable environment, a vehicle with advanced driving assistance systems, such as a robot or a drone, not only needs to register its surroundings but also to combine data from different sensors into a world model, for which it employs filter algorithms. Such world models, as this article argues with reference to the SLAM problem in robotics, consist of nothing other than probabilities about states and events arising in the environment. The model, thus, contains a virtuality of (...) possible worlds that are the basis for adaptive behavior. The article shows that the current development of these technologies requires new concepts because their complex adaptive behaviors cannot be explained by referring them to mere algorithmic processes. Instead, it proposes the heuristic instrument of microdecisions to designate the temporality of decisions between alternatives that are created by probabilistic procedures of world modeling. Microdecisions are more than the implementation of deterministic processes—they decide between possibilities and, thus, always open up the potential of their otherness. By describing autonomous adaptive technologies with this heuristic, the question of sovereignty inevitably arises. It forces us to re-think what autonomy means when decisions can be automated. (shrink)

This study seeks to gain knowledge about key conditions in the process of digitalization using a socio-technical systems design as a theoretical framework and a case-study approach. Semi-structured interviews with 15 relevant stakeholders are conducted to learn about barriers to and enablers of the development and implementation process in a manufacturing company. After conducting a thematic analysis, eight higher-ranked themes relevant to the digitalization process are identified. These are grouped to describe the overarching phenomena, resulting in four enablers and four (...) barriers. The study takes a holistic view of digitalization in its investigation of the development and subsequent implementation processes. The findings contribute to the literature via three key takeaways for stakeholders of a digitalization process in manufacturing. First, it is vital to understand and strengthen the role of the key enablers identified in this paper. Second, managers should observe and identify barriers in their own organizations, related both to technical and social aspects. Third, some of the enablers described in this paper can serve managers as helpful tools to approach the expected barriers to digitalization. This paper also challenges the research literature by arguing that research conducted on digitalization that sets new standards and premises for the working life in industry needs to use up-to-date socio-technical design concepts and theories. (shrink)

A growing body of research can be found in which roboticists are designing for reciprocity as a key construct for successful human–robot interaction. Given the centrality of reciprocity as a component for our moral lives, this paper confronts the possibility of what things would look like if the benchmark to achieve perceived reciprocity were accomplished. Through an analysis of the value of reciprocity from the care ethics tradition the richness of reciprocity as an inherent value is revealed: on the micro-level, (...) as mutual care for immediate care givers, and on the macro-level, as foundational for a just society. Taking this understanding of reciprocity into consideration, it becomes clear that HRI cannot achieve this bidirectional value of reciprocity; a robot must deceive users into believing it is capable of reciprocating to humans or is deserving of reciprocation from humans. Moreover, on the macro-level, designing social robots for reciprocity threatens the ability and willingness to reciprocate to human care workers across society. Because of these concerns, I suggest re-thinking the goals of reciprocity in social robotics. Designing for reciprocity in social robotics should be dedicated to the design of robots to enhance the ability to mutually care for those that provide us with care, as opposed to designing for reciprocity between human and robot. (shrink)

Putting laypeople in an active role as direct expert contributors in the design of service robots becomes more and more prominent in the research fields of human–robot interaction and social robotics. Currently, though, HRI is caught in a dilemma of how to create meaningful service robots for human social environments, combining expectations shaped by popular media with technology readiness. We recapitulate traditional stakeholder involvement, including two cases in which new intelligent robots were conceptualized and realized for close interaction with humans. (...) Thereby, we show how the robot narrative together with aspects of power balancing stakeholders, such as hardware constraints and missing perspectives beyond primary users, and the adaptivity of robots through machine learning that creates unpredictability, pose specific challenges for participatory design processes in HRI. We conclude with thoughts on a way forward for the HRI community in developing a culture of participation that considers humans when conceptualizing, building, and using robots. (shrink)

Ryan Tonkens has issued a seemingly impossible challenge, to articulate a comprehensive ethical framework within which artificial moral agents satisfy a Kantian inspired recipe—"rational" and "free"—while also satisfying perceived prerogatives of machine ethicists to facilitate the creation of AMAs that are perfectly and not merely reliably ethical. This series of papers meets this challenge by landscaping traditional moral theory in resolution of a comprehensive account of moral agency. The first paper established the challenge and set out autonomy in Aristotelian terms. (...) The present paper interprets Kantian moral theory on the basis of the preceding introduction, argues contra Tonkens that an engineer does not violate the categorical imperative in creating Kantian AMAs, and proposes that a Kantian AMA is not only a possible goal for Machine ethics research, but a necessary one. (shrink)

Tonkens has issued a seemingly impossible challenge, to articulate a comprehensive ethical framework within which artificial moral agents satisfy a Kantian inspired recipe—"rational" and "free"—while also satisfying perceived prerogatives of machine ethicists to facilitate the creation of AMAs that are perfectly and not merely reliably ethical. Challenges for machine ethicists have also been presented by Anthony Beavers and Wendell Wallach. Beavers pushes for the reinvention of traditional ethics to avoid "ethical nihilism" due to the reduction of morality to mechanical causation. (...) Wallach pushes for redoubled efforts toward a comprehensive account of ethics to guide machine ethicists on the issue of artificial moral agency. Options, thus, present themselves: reinterpret traditional ethics in a way that affords a comprehensive account of moral agency inclusive of both artificial and natural agents, or give up on the possibility and “muddle through” regardless. This series of papers pursues the first option, meets Tonkens' "challenge" and pursues Wallach's ends through Beavers’ proposed means, by "landscaping" traditional moral theory in resolution of a comprehensive account of moral agency. This first paper sets out the challenge and establishes the tradition that Kant had inherited from Aristotle, briefly entertains an Aristotelian AMA, fields objections, and ends with unanswered questions. The next paper in this series responds to the challenge in Kantian terms, and argues that a Kantian AMA is not only a possibility for Machine ethics research, but a necessary one. (shrink)

Distributed agile teams are increasingly employed in organizations, partly due to the increased focus on digital transformation. However, research findings about the performance of such teams appear to be inconsistent, calling for more research to investigate the conditions under which distributed agile teams may thrive. Given that task coordination is particularly challenging when team members are not co-located, the present study investigates the roles of the two types of task interdependence, i.e., initiated versus received task interdependence. Survey results from 191 (...) participants working in distributed agile teams within three companies in Norway confirm our hypotheses. Specifically, we show that high initiated task interdependence is associated with higher role clarity of others, while received task interdependence is associated with higher role clarity of self, and that both subsequently result in higher team performance in distributed agile teams. Thus, we argue that each type of task interdependence contributes in a unique way to team performance in distributed agile teams. (shrink)

In this paper, we explore how the choices of boundary work in software development influence the team autonomy enacted by team members. Boundary work is when people protect their professional individual autonomy, when they downplay that autonomy to collaborate over professional boundaries, and when they create new boundaries. Team autonomy is here defined as a team using their autonomy to collaborate in deciding their own output. We use an action research design, with varied methodologies carried out through three action cycles. (...) Our findings show that when collective, collaborative boundary work is not performed, a sort of individualized zone occurs where individuals either try to do collaborative boundary work by themselves or seek individual autonomy. We propose that individual autonomy can be divided into professional individual autonomy and situationally dependent individual autonomy. This research contributes theoretically by showing how the absence of collaborative boundary work can lead to an individualized zone. Practically, it can improve team autonomy by enhancing the understanding of why teams should perform collaborative boundary work. The value of the concept of boundary work used in this setting involves studying the intentions for collaboration, not whether collaboration actually takes place. (shrink)

As robots increasingly become part of our everyday lives, questions arise with regards to how to approach them and how to understand them in social contexts. The Western history of human–robot relations revolves around competition and control, which restricts our ability to relate to machines in other ways. In this study, we take a relational approach to explore different manners of socializing with robots, especially those that exceed an instrumental approach. The nonhuman subjects of this study are built to explore (...) non-purposeful behavior, in an attempt to break away from the assumptions of utility that underlie the hegemonic human–machine interactions. This breakaway is accompanied by ‘learning to be attuned’ on the side of the human subjects, which is facilitated by continuous relations at the level of everyday life. Our paper highlights this ground for the emergence of meanings and questions that could not be subsumed by frameworks of control and domination. The research-creation project Machine Ménagerie serves as a case study for these ideas, demonstrating a relational approach in which the designer and the machines co-constitute each other through sustained interactions, becoming attuned to one another through the performance of research. Machine Ménagerie attempts to produce affective and playful—if not unruly—nonhuman entities that invite interaction yet have no intention of serving human social or physical needs. We diverge from other social robotics research by creating machines that do not attempt to mimic human social behaviours. (shrink)

The importance of web designs for commercial and informational use has been a focus of research for over a decade and a half. At present, findings concerning the influence of news website designs on the perception and recall of information are rather contradictory. This study aims to identify how the basic web designs aesthetically affect users. A total of 214 students from Arab universities were shown three news sites with different designs and asked to complete two tests to determine their (...) levels of perception and recall. The results revealed that interactive sites with multiple aesthetic elements representing the message of the news item enable users to perceive and remember the information better. The findings of this study can be useful in creating news website templates that improve user comprehension and recall. (shrink)

Recent AI ethics has focused on applying abstract principles downward to practice. This paper moves in the other direction. Ethical insights are generated from the lived experiences of AI-designers working on tangible human problems, and then cycled upward to influence theoretical debates surrounding these questions: 1) Should AI as trustworthy be sought through explainability, or accurate performance? 2) Should AI be considered trustworthy at all, or is reliability a preferable aim? 3) Should AI ethics be oriented toward establishing protections for (...) users, or toward catalyzing innovation? Specific answers are less significant than the larger demonstration that AI ethics is currently unbalanced toward theoretical principles, and will benefit from increased exposure to grounded practices and dilemmas. (shrink)

One of the sectors for which Artificial Intelligence applications have been considered as exceptionally promising is the healthcare sector. As a public-facing sector, the introduction of AI applications has been subject to extended news coverage. This article conducts a quantitative and qualitative data analysis of English news media articles covering AI systems that allow the automation of tasks that so far needed to be done by a medical expert such as a doctor or a nurse thereby redistributing their agency. We (...) investigated in this article one particular framing of AI systems and their agency: the framing that positions AI systems as replacing and outperforming the human medical expert, and in which AI systems are personified and/or addressed as a person. The analysis of our data set consisting of 365 articles written between the years 1980 and 2019 will show that there is a tendency to present AI systems as outperforming human expertise. These findings are important given the central role of news coverage in explaining AI and given the fact that the popular frame of ‘outperforming’ might place AI systems above critique and concern including the Hippocratic oath. Our data also showed that the addressing of an AI system as a person is a trend that has been advanced only recently and is a new development in the public discourse about AI. (shrink)

The potential use, relevance, and application of AI and other technologies in the democratic process may be obvious to some. However, technological innovation and, even, its consideration may face an intuitive push-back in the form of algorithm aversion :114–126, 2015). In this paper, I confront this intuition and suggest that a more ‘extreme’ form of technological change in the democratic process does not necessarily result in a worse outcome in terms of the fundamental concepts of democracy and the Rule of (...) Law. To provoke further consideration and illustrate that initial intuitions regarding democratic innovation may not always be accurate, I pose and explore four ways that AI and other forms of technology could be used to augment the representative democratic process. The augmentations range from voting online to the wholesale replacement of the legislature’s human representatives with algorithms. After first noting the intuition that less invasive forms of augmented democracy may be less objectionable than more extreme forms, I go on to critically assess whether the augmentation of existing systems satisfies or enhances ideas associated with democracy and the Rule of Law. By imagining a future in a democratic society, my conclusion is that, when it comes to democracy and the Rule of Law, intuitions regarding technology may lead us astray. (shrink)

We continuously talk about autonomous technologies. But how can words qualifying technologies be the very same words chosen by Kant to define what is essentially human, i.e. being autonomous? The article focuses on a possible answer by reflecting upon both etymological and philosophical issues, as well as upon the case of autonomous vehicles. Most interestingly, on the one hand, we have the notion of “autonomy”, meaning that there is a “law” that is “self-given”, and, on the other hand, we have (...) the notion of “automation”, meaning that there is something “offhand” that is “self-given”. Yet, we are experiencing a kind of twofold shift: on the one hand, the shift from defining technologies in terms of automation to defining technologies in terms of autonomy and, on the other hand, the shift from defining humans in terms of autonomy to defining humans in terms of automation. From a philosophical perspective, the shift may mean that we are trying to escape precisely from what autonomy founds, i.e. individual responsibility of humans that, in the Western culture, have been defined for millennia as rational and moral decision-makers, even when their decisions have been the toughest. More precisely, the shift may mean that we are using technologies, and in particular emerging algorithmic technologies, as scapegoats that bear responsibility for us by making decisions for us. Moreover, if we consider the kind of emerging algorithmic technologies that increasingly surround us, starting from autonomous vehicles, then we may argue that we also seem to create a kind of technological divine that, by being always with us through its immanent omnipresence, omniscience, omnipotence and inscrutability, can always be our technological scapegoat freeing us from the most unbearable burden of individual responsibility resulting from individual autonomy. (shrink)

There is general consensus that explainable artificial intelligence is valuable, but there is significant divergence when we try to articulate why, exactly, it is desirable. This question must be distinguished from two other kinds of questions asked in the XAI literature that are sometimes asked and addressed simultaneously. The first and most obvious is the ‘how’ question—some version of: ‘how do we develop technical strategies to achieve XAI?’ Another question is specifying what kind of explanation is worth having in the (...) first place. As difficult and important as the challenges are in answering these questions, they are distinct from a third question: why do we want XAI at all? There is vast literature on this question as well, but I wish to explore a different kind of answer. The most obvious way to answer this question is by describing a desirable outcome that would likely be achieved with the right kind of explanation, which would make the explanation valuable instrumentally. That is, XAI is desirable to attain some other value, such as fairness, trust, accountability, or governance. This family of arguments is obviously important, but I argue that explanations are also intrinsically valuable, because unexplainable systems can be dehumanizing. I argue that there are at least three independently valid versions of this kind of argument: an argument from participation, from knowledge, and from actualization. Each of these arguments that XAI is intrinsically valuable is independently compelling, in addition to the more obvious instrumental benefits of XAI. (shrink)

The debates about ethics in the context of artificial intelligence have been recently focusing primarily on various types of utilitarianisms. This article suggests a categorization of the various presented utilitarianisms into static utilitarianisms and dynamic utilitarianisms. It explains the main features of both. Then, it presents the challenges the utilitarianisms in each group need to be able to deal with. Since it appears that those cannot be overcome in the context of each group alone, the article suggests a possibility of (...) using a combination of the two categories of utilitarianisms to resolve most of the challenges without the need to abandon the concept of utilitarianisms as such. Even this possibility comes with its own issues that might not be resolved within the boundaries of utilitarianisms, however. Therefore, another potential alternative based on a combination of various ethical systems is suggested and briefly explored. (shrink)

Algorithmic decision making is used in an increasing number of fields. Letting automated processes take decisions raises the question of their accountability. In the field of computational journalism, the algorithmic accountability framework proposed by Diakopoulos formalizes this challenge by considering algorithms as objects of human creation, with the goal of revealing the intent embedded into their implementation. A consequence of this definition is that ensuring accountability essentially boils down to a transparency question: given the appropriate reverse-engineering tools, it should be (...) feasible to extract design criteria and to identify intentional biases. General limitations of this transparency ideal have been discussed by Ananny and Crawford :973–989, 2018). We further focus on its technical limitations. We show that even if reverse-engineering concludes that the criteria embedded into an algorithm correspond to its publicized intent, it may be that adversarial behaviors make the algorithm deviate from its expected operation. We illustrate this issue with an automated news recommendation system, and show how the classification algorithms used in such systems can be fooled with hard-to-notice modifications of the articles to classify. We therefore suggest that robustness against adversarial behaviors should be taken into account in the definition of algorithmic accountability, to better capture the risks inherent to algorithmic decision making. We finally discuss the various challenges that this new technical limitation raises for journalism practice. (shrink)

This theoretical paper elucidates the nature of educational technology and, in the process, sheds light on a number of phenomena in educational systems, from the no-significant-difference phenomenon to the singular lack of replication in studies of educational technologies. Its central thesis is that we are not just users of technologies but coparticipants in them. Our participant roles may range from pressing power switches to designing digital learning systems to performing calculations in our heads. Some technologies may demand our participation only (...) to enact fixed, predesigned orchestrations correctly. Other technologies leave gaps that we can or must fill with novel orchestrations, which we may perform more or less well. Most are a mix of the two, and the mix varies according to context, participant, and use. This participative orchestration is highly distributed: in educational systems, coparticipants include the learner, the teacher, and many others, from textbook authors to LMS programmers, as well as the tools and methods they use and create. From this perspective, all learners and teachers are educational technologists. The technologies of education are seen to be deeply, fundamentally, and irreducibly human, complex, situated and social in their constitution, their form, and their purpose, and as ungeneralizable in their effects as the choice of paintbrush is to the production of great art. (shrink)

Although true in some aspects, the suggested characterization of today’s science as a dichotomy between traditional science and data-driven science misses some of the nuance, complexity, and possibility that exists between the two positions. Part of the problem is the claim that Data Science works without theories. There are many theories behind the data that are used in science. However, for data science, the only theories that matter are those in mathematics, statistics, and computer science. In this conceptual paper, we (...) add two other philosophy of science tenets, experiments and data, to the discussion to create a more nuanced view of how data science uses theories. Following Ihde’s concept of technoscience and the incessant quest for more precision, magnification, and resolution, we argue that technology-driven science created a need for more technology-driven science, culminating in data science. Further, we adapt Hacking and Galison’s views on physics to argue that data science is also an experimental science, which uses data objects in experiments. Drawing from Heelan, we called these objects “data-objects-for-knowing”. Finally, we conclude that data science is a science to study artificially created phenomena—a science to study the data manipulated by the equations and operations of AI. It disregards the connections between data and the real world that were carefully built by the theories from other sciences. In the experiments of data science, data are the world itself. The knowledge created by data science is purposely disconnected from any theory from other sciences; it is a knowledge for the sake of itself. (shrink)

We have examined the attitude and moral perception of 228 college students towards artificial intelligence in an international university in Japan. The students were asked to select a single most significant ethical issue associated with AI in the future from a list of nine ethical issues suggested by the World Economic Forum, and to explain why they believed that their chosen issues were most important. The majority of students chose unemployment as the major ethical issue related to AI. The second (...) largest group of students were concerned with ethical issues related to emotional AI, including the impact of AI on human behavior and emotion. The paper discusses the results in detail and concludes that, while policymakers must consider how to ameliorate the impact of AI on employment, AI engineers need to consider the emotional aspects of AI in research and development, as well. (shrink)

Should decision-making algorithms be held to higher standards of transparency than human beings? The way we answer this question directly impacts what we demand from explainable algorithms, how we govern them via regulatory proposals, and how explainable algorithms may help resolve the social problems associated with decision making supported by artificial intelligence. Some argue that algorithms and humans should be held to the same standards of transparency and that a double standard of transparency is hardly justified. We give two arguments (...) to the contrary and specify two kinds of situations for which higher standards of transparency are required from algorithmic decisions as compared to humans. Our arguments have direct implications on the demands from explainable algorithms in decision-making contexts such as automated transportation. (shrink)

In this paper, I examine whether the use of artificial intelligence and automated decision-making aggravates issues of discrimination as has been argued by several authors. For this purpose, I first take up the lively philosophical debate on discrimination and present my own definition of the concept. Equipped with this account, I subsequently review some of the recent literature on the use AI/ADM and discrimination. I explain how my account of discrimination helps to understand that the general claim in view of (...) the aggravation of discrimination is unwarranted. Finally, I argue that the use of AI/ADM can, in fact, increase issues of discrimination, but in a different way than most critics assume: it is due to its epistemic opacity that AI/ADM threatens to undermine our moral deliberation which is essential for reaching a common understanding of what should count as discrimination. As a consequence, it turns out that algorithms may actually help to detect hidden forms of discrimination. (shrink)

Programming artificial intelligence to make fairness assessments of texts through top-down rules, bottom-up training, or hybrid approaches, has presented the challenge of defining cross-cultural fairness. In this paper a simple method is presented which uses vectors to discover if a verb is unfair or fair. It uses already existing relational social ontologies inherent in Word Embeddings and thus requires no training. The plausibility of the approach rests on two premises. That individuals consider fair acts those that they would be willing (...) to accept if done to themselves. Secondly, that such a construal is ontologically reflected in Word Embeddings, by virtue of their ability to reflect the dimensions of such a perception. These dimensions being: responsibility vs. irresponsibility, gain vs. loss, reward vs. sanction, joy vs. pain, all as a single vector. The paper finds it possible to quantify and qualify a verb as fair or unfair by calculating the cosine similarity of the said verb’s embedding vector against FairVec—which represents the above dimensions. We apply this to Glove and Word2Vec embeddings. Testing on a list of verbs produces an F1 score of 95.7, which is improved to 97.0. Lastly, a demonstration of the method’s applicability to sentence measurement is carried out. (shrink)

In recent years, the gastronomy industry has increased the demand for rigorous and reliable tools to evaluate culinary creativity; but conceptually, creativity is difficult to define and even more difficult to measure. In this paper, we propose an AI-based method for assessing culinary product creativity by using the renowned high cuisine restaurant elBulli as a case study to understand the proliferation and scale of an entity’s creativity and innovation. To achieve so, we trained a Random Forest Classifier to assess the (...) level of creativity within the restaurant’s recipes. The application of this model to elBulli’s recipes allowed us to answer the following questions: how can creativity in a culinary product be characterized? Is there a single trait that is the key to culinary creativity? Is the creative culinary product a truly original outcome? Our key findings are although ingredients and preparation techniques prove to be suitable attributes to characterize creativity in a recipe, none of them nor an elite subset clearly identifies creative cuisine, new products are not radically novel with respect to previous creations, creativity is more related to new uses and combinations of existing ingredients and techniques rather than to new ingredients or techniques. We believe that our method can find practical applications in supporting and guiding the creation of culinary products, identifying their strengths and weaknesses, and helping restaurants maintain a sustainable competitive advantage. (shrink)

In this article, we shed light on the emergence, diffusion, and use of socio-technological future visions. The artificial intelligence future vision of the German federal government is examined and juxtaposed with the respective news media coverage of the German media. By means of a content analysis of frames, it is demonstrated how the German government strategically uses its AI future vision to uphold the status quo. The German media largely adapt the government´s frames and do not integrate alternative future narratives (...) into the public debate. These findings are substantiated in the framing of AI futures in policy documents of the German government and articles of four different German newspapers. It is shown how the German past is mirrored in the German AI future envisioned by the government, safeguarding the present power constellation that is marked by a close unity of politics and industry. The German media partly expose the government´s frames and call for future visions that include fundamentally different political designs less influenced by the power structures of the past and present. (shrink)

Increasingly, innovation in artificial intelligence technologies portends the re-conceptualization of human existentiality along the paradigm of posthumanism. An exposition of this through a critical culturo-historical methodology uncloaks the Eurocentric genitive basis of the philosophical anthropology that underpins this technological posthumanism, as well as its dystopian possibilities. As a contribution to obviating the latter, an Africanist civilizational humanism proclaimed by Pixley ka Isaka Seme is proffered as a plausible alternative paradigm for humanity’s technological advancement. Seme, a pan-Africanist thinker of the early (...) twentieth century, proclaimed humanistic-spirituality as the indispensable gift African Civilisation-in-its-renaissance is yet to offer global humanity. His postulation is being provided as a contribution to the archive on cross-cultural ethics of artificial intelligence. (shrink)

This article questions the effects on urban research dynamics of the Big Data and AI turn in urban management. Increasing access to large datasets collected in real time could make certain mathematical models developed in research fields related to the management of urban systems obsolete. These ongoing evolutions are the subject of numerous works whose main angle of reflection is the future of cities rather than the transformations at work in the academic field. Our article proposes grasp the scientific dynamics (...) in areas of research related to two urban systems: transportation and water. The article demonstrates the importance of grasping these dynamics if we want to be able to apprehend what the urban management of tomorrow's cities will be like. To analyse these research areas’ dynamics, we use two complementary materials: bibliometric data and interviews. The interviews conducted in 2018 with academics and higher education officials in Paris and Edinburgh suggest avenues for hybridization between traditional modelling approaches and research in machine learning, artificial intelligence and Big Data. The bibliometric analysis highlight the trends at work: it shows that traffic flow as well as transportation studies are focussing more and more on AI and Big Data and that traffic flow studies are arousing a growing interest among computer scientists, while, so far, this interest is less pronounced in the water research area, and more especially regarding water quality. The differences observed between research on transportation and that on water confirm the multifaceted nature of the developments at work and encourage us to reject overly hasty and simplistic generalisations about the transformations underway. (shrink)

Information of high evidentiary quality plays a crucial role in forensic investigations. Research shows that information provided by witnesses and victims often provide major leads to an inquiry. As such, statements should be obtained in the shortest possible time following an incident. However, this is not achieved in many incidents due to demands on resources. This intersectional study examined the effectiveness of a chatbot, that uses artificial intelligence and a cognitive interview to help record statements following an incident. After viewing (...) a sexual harassment video, the present study tested recall accuracy in participants using AICI compared to other tools. Measuring correct items and incorrect items, it was found that the AI CI elicited more accurate information than the other tools. The implications on society include AI CI provides an alternative means of effectively and efficiently recording high-quality evidential statements from victims and witnesses. (shrink)

Although Japanese society has become aware of some types of robots, social acceptance of robots is still not widespread. This study conducted an online questionnaire survey to investigate the relationships between experiences with and knowledge of vacuum, pet-type, and communication robots and acceptance of these robots, including the intention to use and trust. The results suggested that experiences with, knowledge of functions, and acceptance of the robots differed depending on the type of robot, and the influence of these factors on (...) acceptance of the robots also differed depending on the robot types. (shrink)

In the age of ubiquitous computing and artificially intelligent applications, social machines serves as a powerful framework for understanding and interpreting interactions in socio-algorithmic ecosystems. Although researchers have largely used it to analyze the interactions of individuals and algorithms, limited attempts have been made to investigate the politics in social machines. In this study, I claim that social machines are per se political machines, and introduce a five-point framework for classifying influence processes in socio-algorithmic ecosystems. By drawing from scholars from (...) political theory, I use a notion of influence that functions as a meta-concept for connecting and comparing different conceptions of politics. In this way, I can associate multiple political aspects of social machines from a cybernetic perspective. I show that the framework efficiently categorizes dimensions of influence that shape interactions between individuals and algorithms. These categories are symbolic influence, political conduct, algorithmic influence, design, and regulatory influence. Using case studies, I describe how they interact with each other on online social networks and in algorithmic decision-making systems and illustrate how the framework is able to guide scientists in further research. (shrink)

This paper reflects on the qualities of living and learning in digital cultures, the design of digital technologies and the philosophical history that has informed that design. It takes as its critical perspective the field of embodied cognition as it has developed over the last three decades, in concert with emerging neurophysiology and neurocognitive research. From this perspective the paper considers cognitive, neurological and physiological effects that are increasingly becoming noticed in user populations, especially young populations. I call this class (...) of conditions ‘sensorimotor debility’, to distinguish it from other psychological, social, cultural and political symptoms associated with computer, internet and social media use. (shrink)

There may be a limit on our capacity to suppress anthropocentric tendencies toward non-human others. Normally, we do not reach this limit in our dealings with animals, the environment, etc. Thus, continued striving to overcome anthropocentrism when confronted with these non-human others may be justified. Anticipation of super artificial intelligence may force us to face this limit, denying us the ability to free ourselves completely of anthropocentrism. This could be for our own good.

The exponential growth of algorithms has made establishing a trusted relationship between human and artificial intelligence increasingly important. Algorithm systems such as chatbots can play an important role in assessing a user’s credibility on algorithms. Unless users believe the chatbot’s information is credible, they are not likely to be willing to act on the recommendation. This study examines how literacy and user trust influence perceptions of chatbot information credibility. Results confirm that algorithmic literacy and users’ trust play a pivotal role (...) in how users form perceptions of the credibility of chatbot messages and recommendations. Insights on how user trust is related to credibility provide a useful perspective on the conceptualization of algorithmic credibility. Algorithmic information processing that has been identified provides better foundations for algorithm design and development and a stronger basis for the design of sense-making chatbot journalism. (shrink)

Biometric facial recognition is an artificial intelligence technology involving the automated comparison of facial features, used by law enforcement to identify unknown suspects from photographs and closed circuit television. Its capability is expanding rapidly in association with artificial intelligence and has great potential to solve crime. However, it also carries significant privacy and other ethical implications that require law and regulation. This article examines the rise of biometric facial recognition, current applications and legal developments, and conducts an ethical analysis of (...) the issues that arise. Ethical principles are applied to mediate the potential conflicts in relation to this information technology that arise between security, on the one hand, and individual privacy and autonomy, and democratic accountability, on the other. These can be used to support appropriate law and regulation for the technology as it continues to develop. (shrink)

The ethics of artificial intelligence is a widely discussed topic. There are numerous initiatives that aim to develop the principles and guidance to ensure that the development, deployment and use of AI are ethically acceptable. What is generally unclear is how organisations that make use of AI understand and address these ethical issues in practice. While there is an abundance of conceptual work on AI ethics, empirical insights are rare and often anecdotal. This paper fills the gap in our current (...) understanding of how organisations deal with AI ethics by presenting empirical findings collected using a set of ten case studies and providing an account of the cross-case analysis. The paper reviews the discussion of ethical issues of AI as well as mitigation strategies that have been proposed in the literature. Using this background, the cross-case analysis categorises the organisational responses that were observed in practice. The discussion shows that organisations are highly aware of the AI ethics debate and keen to engage with ethical issues proactively. However, they make use of only a relatively small subsection of the mitigation strategies proposed in the literature. These insights are of importance to organisations deploying or using AI, to the academic AI ethics debate, but maybe most valuable to policymakers involved in the current debate about suitable policy developments to address the ethical issues raised by AI. (shrink)

In this paper I critically evaluate the value neutrality thesis regarding technology, and find it wanting. I then introduce the various ways in which artifacts can come to influence moral value, and our evaluation of moral situations and actions. Here, following van de Poel and Kroes, I introduce the idea of value sensitive design. Specifically, I show how by virtue of their designed properties, artifacts may come to embody values. Such accounts, however, have several shortcomings. In agreement with Michael Klenk, (...) I raise epistemic and metaphysical issues with respect to designed properties embodying value. The concept of an affordance, borrowed from ecological psychology, provides a more philosophically fruitful grounding to the potential way in which artifacts might embody values. This is due to the way in which it incorporates key insights from perception more generally, and how we go about determining possibilities for action in our environment specifically. The affordance account as it is presented by Klenk, however, is insufficient. I therefore argue that we understand affordances based on whether they are meaningful, and, secondly, that we grade them based on their force. (shrink)

Research on the ethics of algorithms has grown substantially over the past decade. Alongside the exponential development and application of machine learning algorithms, new ethical problems and solutions relating to their ubiquitous use in society have been proposed. This article builds on a review of the ethics of algorithms published in 2016, 2016). The goals are to contribute to the debate on the identification and analysis of the ethical implications of algorithms, to provide an updated analysis of epistemic and normative (...) concerns, and to offer actionable guidance for the governance of the design, development and deployment of algorithms. (shrink)

It has been well documented that children perceive robots as social, mental, and moral others. Studies on child-robot interaction may encourage this perception of robots, first, by using a Wizard of Oz set-up and, second, by having robots engage in self-description. However, much remains unknown about the effects of transparent teleoperation and self-description on children’s perception of, and relationship formation with a robot. To address this research gap initially, we conducted an experimental study with a 2 × 2 between-subject design (...) in which 168 children aged 7–10 interacted with a Nao robot once. Transparency about the teleoperation procedure decreased children’s perceptions of the robot’s autonomy and anthropomorphism. Self-description reduced the degree to which children perceived the robot as being similar to themselves. Transparent teleoperation and self-description affected neither children’s perceptions of the robot’s animacy and social presence nor their closeness to and trust in the robot. (shrink)

This paper reflects on the problem of endowing Artificial Intelligence with legal subjectivity, especially with regard to civil law. It is necessary to reject the myth that the criteria of legal subjectivity are sentience and reason. Arguing that AI may have potential legal subjectivity based on an analogy to animals or juristic persons suggests the existence of a single hierarchy or sequence of entities, organized according to their degree of similarity to human beings; also, that the place of an entity (...) in this hierarchy determines the scope of subjectivity attributed to it. Rather, it is participation or presence in social life, whatever the role, that is the true criterion of subjectivity. In addition, it is clear that even if AI is not currently a significant participant in social life, it will be in the nearest future. Despite the potential dangers associated with endowing AI with some kind of subjectivity, such a course is inescapable, and should be considered sooner rather than later. (shrink)