There are plenty of intelligent machines in our world today: digital computers and autonomous robots. At the heart of each of these machines there are automatic formal systems (programs running on a digital computer). Now, if the interpretation of a formal system does not belong to the formal system itself, if the interpretation has to be added, it is worth asking: in the case of these intelligent machines that are massively interspersed in our social interactions, where does the interpretation (...) come from? In this paper, we analyse what we call the invisibility of interpretation. Dealing with various types of formal systems (computers, robots, formalist approaches to Economics), the human source of the interpretation of these systems is sometimes concealed by a formalist restriction. To show how the formalist restriction produces the invisibility of interpretation allows us to underline our responsibility, as human agents, for all this interpretative work—and its importance for us as human beings. (shrink)

It is highly likely that, to achieve full human–machine symbiosis, truly intelligent cognitive systems—human-like —may have to be developed first. Such systems should not only be capable of performing human-like thinking, reasoning, and problem solving, but also be capable of displaying human-like motivation, emotion, and personality. In this opinion article, I will argue that such systems are indeed possible and needed to achieve true and full symbiosis with humans. A computational cognitive architecture is used in this (...) article to illustrate, in a preliminary way, what can be achieved in this regard. It is shown that Clarion involves complex structures, representations, and mechanisms, and is capable of capturing human cognitive performance as well as human motivation, emotion, personality, and other relevant aspects. It is further argued that the cognitive architecture can enable and facilitate true human–machine symbiosis. (shrink)

Artificial agents have become increasingly prevalent in human social life. In light of the diversity of new human–machine interactions, we face renewed questions about the distribution of moral responsibility. Besides positions denying the mere possibility of attributing moral responsibility to artificial systems, recent approaches discuss the circumstances under which artificial agents may qualify as moral agents. This paper revisits the discussion of how responsibility might be distributed between artificial agents and human interaction partners (including producers of artificial agents) (...) and raises the question of whether attributions of responsibility should remain entirely on the human side. While acknowledging a crucial difference between living human beings and artificial systems culminating in an asymmetric feature of human–machine interactions, this paper investigates the extent to which artificial agents may reasonably be attributed a share of moral responsibility. To elaborate on criteria that can justify a distribution of responsibility in certain human–machine interactions, the role of types of criteria (interaction-related criteria and criteria that can be deferred from socially constructed responsibility relationships) is examined. Thereby, the focus will lay on the evaluation of potential criteria referring to the fact that artificial agents surpass in some aspects the capacities of humans. This is contrasted with socially constructed responsibility relationships that do not take these criteria into account. In summary, situations are examined in which it seems plausible that moral responsibility can be distributed between artificial and human agents. (shrink)

Interaction between drivers and pedestrians is often facilitated by informal communicative cues, like hand gestures, facial expressions, and eye contact. In the near future, however, when semi- and fully autonomous vehicles are introduced into the traffic system, drivers will gradually assume the role of mere passengers, who are casually engaged in non-driving-related activities and, therefore, unavailable to participate in traffic interaction. In this novel traffic environment, advanced communication interfaces will need to be developed that inform pedestrians of the current state (...) and future behavior of an autonomous vehicle, in order to maximize safety and efficiency for all road users. The aim of the present review is to provide a comprehensive account of empirical work in the field of external human–machine interfaces for autonomous vehicle-to- pedestrian communication. In the great majority of covered studies, participants clearly benefited from the presence of a communication interface when interacting with an autonomous vehicle. Nevertheless, standardized interface evaluation procedures and optimal interface specifications are still lacking. (shrink)

The urban traffic environment is characterized by the presence of a highly differentiated pool of users, including vulnerable ones. This makes vehicle automation particularly difficult to implement, as a safe coordination among those users is hard to achieve in such an open scenario. Different strategies have been proposed to address these coordination issues, but all of them have been found to be costly for they negatively affect a range of human values (e.g. safety, democracy, accountability…). In this paper, we claim (...) that the negative value impacts entailed by each of these strategies can be interpreted as lack of what we call Meaningful Human Control over different parts of a sociotechnical system. We argue that Meaningful Human Control theory provides the conceptual tools to reduce those unwanted consequences, and show how “designing for meaningful human control” constitutes a valid strategy to address coordination issues. Furthermore, we showcase a possible application of this framework in a highly dynamic urban scenario, aiming to safeguard important values such as safety, democracy, individual autonomy, and accountability. Our meaningful human control framework offers a perspective on coordination issues that allows to keep human actors in control while minimizing the active, operational role of the drivers. This approach makes ultimately possible to promote a safe and responsible transition to full automation. (shrink)

The necessity and opportunity for face-to-face contact with other colleagues is being increasingly reduced as a result of factory automation (FA) or office automation (OA). This means that human functions which are a result of human contact and relationships are substituted for by the function of machine systems. This “transfer of relations” from the human “system” to the machine system causes isolation of the individual in the process of work. This chapter considers some reasons for “isolation” with (...) particular reference to the computerisation of production systems. The paper addresses the serious consequences for the environmental situation in Japan and the fabric of Japanese society. (shrink)

Does the human mind resemble the machines that can behave like it? Biologically inspired machine-learning systems approach “human-level” accuracy in an astounding variety of domains, and even predict human brain activity—raising the exciting possibility that such systems represent the world like we do. However, even seemingly intelligent machines fail in strange and “unhumanlike” ways, threatening their status as models of our minds. How can we know when human–machine behavioral differences reflect deep disparities in their underlying capacities, (...) vs. when such failures are only superficial or peripheral? This article draws on a foundational insight from cognitive science—the distinction between performance and competence—to encourage “species-fair” comparisons between humans and machines. The performance/competence distinction urges us to consider whether the failure of a system to behave as ideally hypothesized, or the failure of one creature to behave like another, arises not because the system lacks the relevant knowledge or internal capacities (“competence”), but instead because of superficial constraints on demonstrating that knowledge (“performance”). I argue that this distinction has been neglected by research comparing human and machine behavior, and that it should be essential to any such comparison. Focusing on the domain of image classification, I identify three factors contributing to the species-fairness of human–machine comparisons, extracted from recent work that equates such constraints. Species-fair comparisons level the playing field between natural and artificial intelligence, so that we can separate more superficial differences from those that may be deep and enduring. (shrink)

Acquiring perceptual expertise is slow and effortful. However, untrained novices can accurately make difficult classification decisions by reformulating the task as similarity judgment. Given a query image and a set of reference images, individuals are asked to select the best matching reference. When references are suitably chosen, the procedure yields an implicit classification of the query image. To optimize reference selection, we develop and evaluate a predictive model of similarity-based choice. The model builds on existing psychological literature and accommodates stochastic, (...) dynamic shifts of attention among visual feature dimensions. We perform a series of human experiments with two stimulus types and nine classification tasks to validate the model and to demonstrate the model's potential to boost performance. Our system achieves high accuracy for participants who are naive as to the classification task, even when the classification task switches from trial to trial. (shrink)

Human contact is a key issue in social interactions for autonomous systems since robots are increasingly appearing everywhere, which has led to a higher risk of conflict. Particularly in the real world, collisions between humans and machines may result in catastrophic accidents or damaged goods. In this paper, a novel stop strategy related to autonomous systems is proposed. This control method can eliminate the vibrations produced by a system’s movement by analysing the poles and zeros in the model (...) of autonomous vehicles and goods. Using the pole placement technique, the motion of a system is guaranteed to be more stable, more flexible and smoother. Moreover, several control profiles are employed in the switching mechanism to choose the proper vibration-free effect. The main contributions of this paper are the recommendation of an active stopping planner using different smooth generators from a modelling study, the validation of their physical characteristics and the launching of a switching algorithm based on the socially aware navigation framework of a robot. This theoretical work is based on the virtual environment of MATLAB, and the experiment is implemented in the practical platform of an automated guided vehicle. From these results, it can be seen that the proposed approach is robust, effective and feasible for applications in storehouse management, public transportation or factory manufacturing. (shrink)

Systems, machines and organisation of forms developed in the Engineering and Manufacturing sectors frequently lay the basis for systems design philosophy at a general level. An analysis of technological change in these sectors reveals that the resultant deskilling is not limited to the shop floor and is now spreading to intellectual work. The impact of ‘machine based systems’ on designers is explored in some detail and suggests the need for alternatives which are based on ‘human centred (...) systems’. Some attempts to design sub-systems are described. (shrink)

Clinical medicine is an inexact science. In situations of uncertainty, we often ask an experienced colleague for a second opinion. But what if one could effectively call upon the experience of thou...

Therapeutic strategies capable of inducing and enhancing prosthesis embodiment are a key point for better adaptation to and acceptance of prosthetic limbs. In this study, we developed a training protocol using an EMG-based human-machine interface that was applied in the preprosthetic rehabilitation phase of people with amputation. This is a case series with the objective of evaluating the induction and enhancement of the embodiment of a virtual prosthesis. Six men and a woman with unilateral transfemoral traumatic amputation without previous (...) use of prostheses participated in the study. Participants performed a training protocol with the EMG-based HMI, composed of six sessions held twice a week, each lasting 30 mins. This system consisted of myoelectric control of the movements of a virtual prosthesis immersed in a 3D virtual environment. Additionally, vibrotactile stimuli were provided on the participant’s back corresponding to the movements performed. Embodiment was investigated from the following set of measurements: skin conductance response, crossmodal congruency effect, ability to control the virtual prosthesis, and reports before and after the training. The increase in the skin conductance response in conditions where the virtual prosthesis was threatened, recalibration of the peripersonal space perception identified by the crossmodal congruency effect, ability to control the virtual prosthesis, and participant reports consistently showed the induction and enhancement of virtual prosthesis embodiment. Therefore, this protocol using EMG-based HMI was shown to be a viable option to achieve and enhance the embodiment of a virtual prosthetic limb. (shrink)

In this study, we explore the future of work by examining differences in productivity when teams are composed of only humans or both humans and machine agents. Our objective was to characterize the similarities and differences between human and human–machine teams as they work to coordinate across their specialized roles. This form of research is increasingly important given that machine agents are becoming commonplace in sociotechnical systems and playing a more active role in collaborative work. One (...) particular class of machine agents, bots, is being introduced to these systems to facilitate both taskwork and teamwork. We investigated the association between bots and productivity outcomes in open source software development through an analysis of hundreds of project teams. The presence of bots in teams was associated with higher levels of productivity and higher work centralization in addition to greater amounts of observed communication. The adoption of bots in software teams may have tradeoffs, in that doing so may increase productivity, but could also increase workload. We discuss the theoretical and practical implications of these findings for advancing human–machine teaming research. (shrink)

In this study, we explore the future of work by examining differences in productivity when teams are composed of only humans or both humans and machine agents. Our objective was to characterize the similarities and differences between human and human–machine teams as they work to coordinate across their specialized roles. This form of research is increasingly important given that machine agents are becoming commonplace in sociotechnical systems and playing a more active role in collaborative work. One (...) particular class of machine agents, bots, is being introduced to these systems to facilitate both taskwork and teamwork. We investigated the association between bots and productivity outcomes in open source software development through an analysis of hundreds of project teams. The presence of bots in teams was associated with higher levels of productivity and higher work centralization in addition to greater amounts of observed communication. The adoption of bots in software teams may have tradeoffs, in that doing so may increase productivity, but could also increase workload. We discuss the theoretical and practical implications of these findings for advancing human–machine teaming research. (shrink)

If our choices make us who we are, then what does that mean when these choices are made in the human-machine interface? Developing a clear understanding of how human decision making is influenced by automated systems in the environment is critical because, as human-machine interfaces and assistive robotics become even more ubiquitous in everyday life, many daily decisions will be an emergent result of the interactions between the human and the machine – not stemming solely from (...) the human. For example, choices can be influenced by the relative locations and motor costs of the response options, as well as by the timing of the response prompts. In drift diffusion model simulations of response-prompt timing manipulations, we find that it is only relatively equibiased choices that will be successfully influenced by this kind of perturbation. However, with drift diffusion model simulations of motor cost manipulations, we find that even relatively biased choices can still show some influence of the perturbation. We report the results of a two-alternative forced-choice experiment with a computer mouse modified to have a subtle velocity bias in a pre-determined direction for each trial, inducing an increased motor cost to move the cursor away from the pre-designated target direction. With queries that have each been normed in advance to be equibiased in people’s preferences, the participant will often begin their mouse movement before their cognitive choice has been finalized, and the directional bias in the mouse velocity exerts a small but significant influence on their final choice. With queries that are not equibiased, a similar influence is observed. By exploring the synergies that are developed between humans and machines and tracking their temporal dynamics, this work aims to provide insight into our evolving decisions. (shrink)

Generative art theory involves any artistic practice where an artist uses external systems (rules, algorithms, organic processes) to complete an artwork. Commonly utilized in video game design, gen...

Based on detailed descriptions of human–machine ensembles, this article explores how humans and machines work together to see specific things and unsee others, and how they come to co-configure one another. For seeing is not an automated function; whether one is a human or a machine, vision is gradually enskilled and mutually co-constituted. The analysis intersects three different ways of human–machine seeing to shed further light on the workings of each one: an airport, where facial recognition algorithms (...) collaborate with border guards to grant passage to particular travellers and not to others; a luggage-scanning system, where potential security threats are assessed by a complex of X-rays and human intro-spection; and a hospital operating room, where human–machinic surgical robots find their way and operate on the insides of human bodies, touching only by seeing. In these examples, human and machine ways of seeing merge together, seeing in particular apparatuses of material, political, organisational, economic and fleshy components. The article analyses the practical work of human–machinic collaboration and explores how the different material and social constituents, not necessarily always working from the same agenda, come to configure what can be seen and sensed and what cannot. (shrink)

Although even very advanced artificial systems do not meet the demanding conditions which are required for humans to be a proper participant in a social interaction, we argue that not all human-machine interactions (HMIs) can appropriately be reduced to mere tool-use. By criticizing the far too demanding conditions of standard construals of intentional agency we suggest a minimal approach that ascribes minimal agency to some artificial systems resulting in the proposal of taking minimal joint actions as a (...) case of a social HMI. Analyzing such HMIs, we utilize Dennett’s stance epistemology, and argue that taking either an intentional stance or design stance can be misleading for several reasons, and instead propose to introduce a new stance that is able to capture social HMIs—the AI-stance. (shrink)

Social robots are designed to perform intelligent, emotional, and autonomous behavior in order to establish intimate relationships with humans, for instance, in the context of elderly care. However, the imitation of qualities usually assumed to be necessary for human reciprocal interaction may impact our understanding of social interaction. Against this background, we compare the technical operations based on which social robots imitate human-like behavior with the concepts of emotionality, intelligence, and autonomy as usually attached to humans. In doing so, we (...) aim at making a conceptual contribution to the intuition that the technical imitation of emotional, intelligent, and autonomous behavior differs qualitatively from human forms of emotionality, intelligence, and autonomy. We conclude that the increasing tendency of social robots to imitate human characteristics and the thus increased human tendency of anthropomorphizing technical systems put forth new forms of human–machine interactions (HMI) that call for a critical examination. Thus, the emerging forms of interaction may lead, for instance, to false, reinforced, and perplexing assumptions regarding reciprocity. Therefore, studies are needed that critically examine the potential consequences and psychological effects that may be associated with the use of social robots, especially with regard to vulnerable groups such as children or the elderly. (shrink)

Human decisions are increasingly supported by decision support systems (DSS). Humans are required to remain “on the loop,” by monitoring and approving/rejecting machine recommendations. However, use of DSS can lead to overreliance on machines, reducing human oversight. This paper proposes “reflection machines” (RM) to increase meaningful human control. An RM provides a medical expert not with suggestions for a decision, but with questions that stimulate reflection about decisions. It can refer to data points or suggest counterarguments that are (...) less compatible with the planned decision. RMs think against the proposed decision in order to increase human resistance against automation complacency. Building on preliminary research, this paper will (1) make a case for deriving a set of design requirements for RMs from EU regulations, (2) suggest a way how RMs could support decision-making, (3) describe the possibility of how a prototype of an RM could apply to the medical domain of chronic low back pain, and (4) highlight the importance of exploring an RM’s functionality and the experiences of users working with it. (shrink)

Rapid developments in Artificial Intelligence are leading to an increasing human reliance on machine decision making. Even in collaborative efforts with Decision Support Systems (DSSs), where a human expert is expected to make the final decisions, it can be hard to keep the expert actively involved throughout the decision process. DSSs suggest their own solutions and thus invite passive decision making. To keep humans actively ‘on’ the decision-making loop and counter overreliance on machines, we propose a ‘reflection (...) class='Hi'>machine’ (RM). This system asks users questions about their decision strategy and thereby prompts them to evaluate their own decisions critically. We discuss what forms RMs can take and present a proof-of-concept implementation of a RM that can produce feedback on users’ decisions in the medical and law domains. We show that the prototype requires very little domain knowledge to create reasonably intelligent critiquing questions. With this prototype, we demonstrate the technical feasibility to develop RMs and hope to pave the way for future research into their effectiveness and value. (shrink)

This paper uses a proof of Gödels theorem, implemented on a computer, to explore how a person or a computer can examine such a proof, understand it, and evaluate its validity. It is argued that, in order to recognize it (1) as Gödel's theorem, and (2) as a proof that there is an undecidable statement in the language of PM, a person must possess a suitable semantics. As our analysis reveals no differences between the processes required by people and machines (...) to understand Gödel's theorem and manipulate it symbolically, an effective way to characterize this semantics is to model the human cognitive system as a Turing Machine with sensory inputs. La logistique n'est plus stérile: elle engendre la contradicion! – Henri Poincaré ‘Les mathematiques et la logique’. (shrink)

Ethical dissonance arises from conflicts between beliefs or behaviors and affects ethical factors such as normality or conformity. This paper proposes a weak signal-oriented framework to investigate ethical dissonance from experiences linked to human–machine interactions. It is based on a systems engineering principle called human-systems inclusion, which considers any experience feedback of weak signals as beneficial to learn. The framework studies weak signal-based scenarios from testimonies of individual experiences and these scenarios are assessed by other people. For (...) this purpose, the framework proposes several databases as sources of weak signals, formalization tools of experience feedback of weak signals, models of references of conformity, ethical factors, and a list of examples of ethical dissonance. It also includes sequential steps to make the latter credible regarding the results from the experimental protocols. The framework was used to investigate ethical dissonance by analyzing experiences pertaining to achieving inclusive mobility. The first example focuses on ethical dissonance in terms of hindrance that goes against autonomous mobility due to a misunderstanding of how the system functions in terms of negative and positive emotions. Two other examples present possible ethical dissonance when the use of safety systems such as car driver-assistance systems, may create danger. Investigating ethical dissonance can then help system-inclusive design or evaluation processes by taking into account scenarios from weak signal-based experiences and making them credible. (shrink)

Machine learning systems are making considerable inroads in society owing to their ability to recognize and predict patterns. However, the decision-making logic of some widely used machine learning models, such as deep neural networks, is characterized by opacity, thereby rendering them exceedingly difficult for humans to understand and explain and, as a result, potentially risky to use. Considering the importance of addressing this opacity, this paper calls for research that studies empirically and theoretically how machine learning (...) experts and users seek to attain machine learning explainability. Focusing on automated trading, we take steps in this direction by analyzing a trading firm’s quest for explaining its deep neural network system’s actionable predictions. We demonstrate that this explainability effort involves a particular form of human–machine interaction that contains both anthropomorphic and technomorphic elements. We discuss this attempt to attain machine learning explainability in light of reflections on cross-species companionship and consider it an example of human–machine companionship. (shrink)

Rational social theorists have failed to confirm that observations of social reality equal social reality. Yet they argue that teams, organizations and social systems should minimize interdependence and competition, echoed by social psychologists to make data iid. But the evidence indicates that competitive teams maximize interdependence; self-reports of social reality correlate poorly with social behavior; and only competition measures interdependent social states. Rational expectations aside, we report progress towards a science of interdependence for human–machine teams. Our model of (...) interdependence works like an uncertainty principle in the sense that tradeoffs arise from the uncertainty caused by measuring interdependent actors in orthogonal roles; e.g., in the tradeoff between teams and individuals, teams are more productive but more opaque. Previously, we described interdependence as bistable stories of social reality; the motivation to reject alternative interpretations, increasing uncertainty and errors; and the inability to factor social states. Now we explore education as a surrogate for intelligence in teams. We hypothesized that teams rely on the education of its members to produce more patents. We found that the average schooling in a nation is significantly related to its total patents produced. (shrink)

Rational social theorists have failed to confirm that observations of social reality equal social reality. Yet they argue that teams, organizations and social systems should minimize interdependence and competition, echoed by social psychologists to make data iid. But the evidence indicates that competitive teams maximize interdependence; self-reports of social reality correlate poorly with social behavior; and only competition measures interdependent social states. Rational expectations aside, we report progress towards a science of interdependence for human–machine teams. Our model of (...) interdependence works like an uncertainty principle in the sense that tradeoffs arise from the uncertainty caused by measuring interdependent actors in orthogonal roles; e.g., in the tradeoff between teams and individuals, teams are more productive but more opaque. Previously, we described interdependence as bistable stories of social reality; the motivation to reject alternative interpretations, increasing uncertainty and errors; and the inability to factor social states. Now we explore education as a surrogate for intelligence in teams. We hypothesized that teams rely on the education of its members to produce more patents. We found that the average schooling in a nation is significantly related to its total patents produced. (shrink)

Rational social theorists have failed to confirm that observations of social reality equal social reality. Yet they argue that teams, organizations and social systems should minimize interdependence and competition, echoed by social psychologists to make data iid. But the evidence indicates that competitive teams maximize interdependence; self-reports of social reality correlate poorly with social behavior; and only competition measures interdependent social states. Rational expectations aside, we report progress towards a science of interdependence for human–machine teams. Our model of (...) interdependence works like an uncertainty principle in the sense that tradeoffs arise from the uncertainty caused by measuring interdependent actors in orthogonal roles; e.g., in the tradeoff between teams and individuals, teams are more productive but more opaque. Previously, we described interdependence as bistable stories of social reality; the motivation to reject alternative interpretations, increasing uncertainty and errors; and the inability to factor social states. Now we explore education as a surrogate for intelligence in teams. We hypothesized that teams rely on the education of its members to produce more patents. We found that the average schooling in a nation is significantly related to its total patents produced. (shrink)

Consciousness is widely perceived as one of the most fundamental, interesting and difficult problems of our time. However, we still know next to nothing about the relationship between consciousness and the brain and we can only speculate about the consciousness of animals and machines. Human and Machine Consciousness presents a new foundation for the scientific study of consciousness. It sets out a bold interpretation of consciousness that neutralizes the philosophical problems and explains how we can make scientific predictions about (...) the consciousness of animals, brain-damaged patients and machines. Gamez interprets the scientific study of consciousness as a search for mathematical theories that map between measurements of consciousness and measurements of the physical world. We can use artificial intelligence to discover these theories and they could make accurate predictions about the consciousness of humans, animals and artificial systems. Human and Machine Consciousness also provides original insights into unusual conscious experiences, such as hallucinations, religious experiences and out-of-body states, and demonstrates how 'designer' states of consciousness could be created in the future. Gamez explains difficult concepts in a clear way that closely engages with scientific research. His punchy, concise prose is packed with vivid examples, making it suitable for the educated general reader as well as philosophers and scientists. Problems are brought to life in colourful illustrations and a helpful summary is given at the end of each chapter. The endnotes provide detailed discussions of individual points and full references to the scientific and philosophical literature."--Publisher's website. (shrink)

Can autonomous systems replace humans in the performance of their activities? How does the answer to this question inform the design of autonomous systems? The study of technical systems and their features should be preceded by the study of the activities in which they play roles. Each activity can be described by its overall goals, governing norms and the intermediate steps which are taken to achieve the goals and to follow the norms. This paper uses the activity (...) realist approach to conceptualize autonomous systems in the context of human activities. By doing so, it first argues for epistemic and logical conditions that illustrate the limitations of autonomous systems in tasks which they can and cannot perform, and then, it discusses the ramifications of the limitations of system autonomy on the design of autonomous systems. (shrink)

Human-extended machine cognition is a specific form of artificial intelligence in which the casually-active physical vehicles of machine-based cognitive states and processes include one or more human agents. Human-extended machine cognition is thus a specific form of extended cognition that sees human agents as constituent parts of the physical fabric that realizes machine-based cognitive capabilities. This idea is important, not just because of its impact on current philosophical debates about the extended character of human cognition, but (...) also because it helps to focus scientific attention on the potential role of the human social environment in realizing novel forms of artificial intelligence. The present paper provides an overview of human-extended machine cognition and situates the concept within the broader theoretical framework of active externalism. The paper additionally shows how the concept of human-extended machine cognition can be applied to existing forms of human–machine interaction, especially those that occur in the context of the contemporary Internet and Web. (shrink)

Autonomy has been central to moral and political philosophy for millenia, and has been positioned as a critical aspect of both justice and wellbeing. Research in psychology supports this position, providing empirical evidence that autonomy is critical to motivation, personal growth and psychological wellness. Responsible AI will require an understanding of, and ability to effectively design for, human autonomy (rather than just machine autonomy) if it is to genuinely benefit humanity. Yet the effects on human autonomy of digital experiences (...) are neither straightforward nor consistent, and are complicated by commercial interests and tensions around compulsive overuse. This multi-layered reality requires an analysis that is itself multidimensional and that takes into account human experience at various levels of resolution. We borrow from HCI and psychological research to apply a model (“METUX”) that identifies six distinct spheres of technology experience. We demonstrate the value of the model for understanding human autonomy in a technology ethics context at multiple levels by applying it to the real-world case study of an AI-enhanced video recommender system. In the process we argue for the following three claims: 1) There are autonomy-related consequences to algorithms representing the interests of third parties, and they are not impartial and rational extensions of the self, as is often perceived; 2) Designing for autonomy is an ethical imperative critical to the future design of responsible AI; and 3) Autonomy-support must be analysed from at least six spheres of experience in order to approriately capture contradictory and downstream effects. (shrink)

As we increasingly delegate decision-making to algorithms, whether directly or indirectly, important questions emerge in circumstances where those decisions have direct consequences for individual rights and personal opportunities, as well as for the collective good. A key problem for policymakers is that the social implications of these new methods can only be grasped if there is an adequate comprehension of their general technical underpinnings. The discussion here focuses primarily on the case of enforcement decisions in the criminal justice system, but (...) draws on similar situations emerging from other algorithms utilised in controlling access to opportunities, to explain how machine learning works and, as a result, how decisions are made by modern intelligent algorithms or 'classifiers'. It examines the key aspects of the performance of classifiers, including how classifiers learn, the fact that they operate on the basis of correlation rather than causation, and that the term 'bias' in machine learning has a different meaning to common usage. An example of a real world 'classifier', the Harm Assessment Risk Tool (HART), is examined, through identification of its technical features: the classification method, the training data and the test data, the features and the labels, validation and performance measures. Four normative benchmarks are then considered by reference to HART: (a) prediction accuracy (b) fairness and equality before the law (c) transparency and accountability (d) informational privacy and freedom of expression, in order to demonstrate how its technical features have important normative dimensions that bear directly on the extent to which the system can be regarded as a viable and legitimate support for, or even alternative to, existing human decision-makers. (shrink)

The diagnosis of a new geological epoch, The 'Anthropocene', has implications far beyond geological science. If human activity has disrupted the planet, then this diagnosis potentially disrupts socio-political conventions. This article assesses the implications the Anthropocene has for democratic politics, by delineating three challenges: challenges of knowledge, time and boundary. In contrast to the claim that democratic institutions are unable to adequately respond to these challenges, I suggest that they might be strengthened through an engagement with them. Following an 'agonistic' (...) understanding of politics, I argue that the contestation instigated by the challenges of the Anthropocene is key to democratic renewal. Just as democracy in the Anthropocene can be enhanced through an agonistic approach, agonistic theory can be enriched through an engagement with the Anthropocene. (shrink)

In the field of machine consciousness, it has been argued that in order to build human-like conscious machines, we must first have a computational model of qualia. To this end, some have proposed a framework that supports qualia in machines by implementing a model with three computational areas (i.e., the subconceptual, conceptual, and linguistic areas). These abstract mechanisms purportedly enable the assessment of artificial qualia. However, several critics of the machine consciousness project dispute this possibility. For instance, Searle, (...) in his Chinese room objection, argues that however sophisticated a computational system is, it can never exhibit intentionality; thus, would also fail to exhibit consciousness or any of its varieties. This paper argues that the proposed architecture mentioned above answers the problem posed by Searle, at least in part. Specifically, it argues that we could reformulate Searle’s worries in the Chinese room in terms of the three-stage artificial qualia model. And by doing so, we could see that the person doing all the translations in the room could realize the three areas in the proposed framework. Consequently, this demonstrates the actualization of self-consciousness in machines. (shrink)

Intelligence is not a property unique to the human brain; rather it represents a spectrum of phenomena. An understanding of the evolution of intelligence makes it clear that the evolution of machine intelligence has no theoretical limits — unlike the evolution of the human brain. Machine intelligence will outpace human intelligence and very likely will do so during the lifetime of our children. The mix of advanced machine intelligence with human individual and communal intelligence will create an (...) evolutionary discontinuity as profound as the origin of life. It will presage the end of the human species as we know it. The question, in the author's view, is not whether this will happen, but when, and what should be our response. (shrink)

It is held that the quality of the working environment afforded to an individual critically affects the health and well-being of that individual. This has consequences for both the quality of work which that individual can actually perform, and for the quality of the society in which that individual has a place. Conceptions of a fit working environment have led to the idea of a human-centred system, and this idea is applicable to the area of knowledge-based systems (KBS). A (...) system structure is discussed, which permits a human-centred approach to be adopted towards KBS design. It is held that the performance of such a system will generally exceed that of unaided KBS operation. (shrink)

This paper addresses two methodological paths in Artificial Intelligence: the paths of Babbage and anti-Cartesianism. While those researchers who have followed the latter have attempted to reverse the Cartesian dictum according to which machines cannot think in principle, Babbage’s path, which has been partially neglected, implies that the replacement of humans—and not the creation of minds—should provide the foundation of AI. In view of the examined paths, the claim that we support here is this: in line with Babbage, AI researchers (...) have recently concentrated upon the replacement of human labour, and thus upon the creation of Machine Learning systems. After presenting and analysing the paths, we characterise Machine Learning via its developments and an illustrative example. Then, we put forward an argument that shows that total replacement of human labour will not be feasible for practical and conceptual reasons despite the successful developments in recent AI systems. Our discussion finally leads to optimism and awareness: AI’s advances allow humans to dedicate themselves to higher level tasks, but these advances also require that we be vigilant about the responsibilities granted to ML-based systems. (shrink)

Clinical ethics can be viewed as a practical discipline that provides a structured approach to assist healthcare practitioners in identifying, analysing and resolving ethical issues that arise in practice. Clinical ethics can therefore promote ethically sound clinical and organisational practices and decision-making, thereby contributing to health organisation and system quality improvement. In order to develop students’ decision-making skills, as well as prepare them for practice, we decided to introduce a clinical ethics strand within an undergraduate medical curriculum. We designed a (...) programme of clinical ethics activities for teaching and assessment purposes that involved using ethical frameworks to analyse hypothetical and real-life cases in uni- and inter- professional groups. In this paper, we draw on medical student feedback collected over 6 years to illustrate the appeal to students of learning clinical ethics. We also outline the range of benefits for students, healthcare organisations, and the field of clinical ethics arising from tomorrow’s doctors experiencing clinical ethics early in their training. We conclude by briefly reflecting on how including clinical ethics within tomorrow’s doctors curricular can secure and continue future engagement in clinical ethics support services in the UK, alongside the dangers of preparing students for organisational cultures that might not exist. We anticipate the findings presented in the paper will contribute to wider debates examining the impact of ethics teaching, and its ability to inform future doctors’ practice. (shrink)

It has become common to find diagrams and flow-charts used in our organizations to illustrate the nature of processes, what is involved and how it happens, or to show how parts of the organization interrelate to each other and work together. Such diagrams are used as they are thought to help visualization and simplify things in order to represent the essence of a particular situation, the core features. In this paper, using a social semiotic approach, we show that we need (...) to develop a much more critical sense of how these diagrams and flowcharts can easily abstract, conceal and substitute actual causalities, work roles and relationships. We demonstrate this using the example of a series of interrelated flows-charts used to implement a new system of target-based learning in preschool/kindergartens in Sweden – a system which works highly in favor of a rapidly privatizing education sector. Here, the flow charts shape how school processes and learning are presented to devalue the former system and value the new. (shrink)

The United Nations ‘Transforming our world: the 2030 Agenda for Sustainable Development’ lays out 17 Sustainable Development Goals to address a range of global issues related to the future of the planet and human well-being. Critics, however, argue that the Agenda, a complex product of multi-stakeholder governance, in its drive to accommodate many competing voices, is overloaded with weakly defined, overlapping and contradictory issues, concepts and buzzwords. These serve to gloss over actual concrete global problems and forces, concealing an underlying (...) free-trade ideology. In this paper, using Multimodal Critical Discourse Analysis, we draw attention to the nature of the documents used to communicate the Agenda. These documents comprise an edifice of self-referential texts that rely heavily on infographics, bullet points, charts and tables. Such formats appear to helpfully simplify, distil information and break things down into workable components. But, we show, through the affordances of these formats, the the vagueness of buzzwords, contradictions and lack of clear causalities can be glossed over, presenting the Agenda as a highly technical, engaging, and above all moral process. These formats are important, therefore, for the legitimization and rhetorical power of the Agenda, necessary for its take-up by governments and organizations around the world. (shrink)

Radical democratic thinking is becoming intrigued by the material situatedness of its political agents and by the role of nonhuman participants in political interaction. At stake here is the displacement of narrow anthropocentrism that currently guides democratic theory and practice, and its repositioning into what we call ‘the nonhuman condition’. This Critical Exchange explores the nonhuman condition. It asks: What are the implications of decentering the human subject via a new materialist reading of radical democracy? Does this reading dilute political (...) agency? Or should this be seen, on the contrary, as an invitation for new voices and demands to enter into democratic assemblages? How might engagement with the more-than-human disrupt or extend theories of radical democracy? Hans Asenbaum and Amanda Machin discuss the human democratic subject both through radical democratic and new materialist lenses. They suggest that a new materialist decentred subject does not lose agency but further gains political responsibility in radical democracy. Jean-Paul Gagnon highlights the possibility of becoming through loss. In losing our anthropocentric arrogance—our understanding of being other and better than animal—we become more connected and discover our place in human-nonhuman assemblages. Melissa Orlie agrees that something can be gained through renouncing dominant human fantasies and presents a ‘radical democratic naturalism’. By renouncing land violence and acknowledging nature’s subjectivity, we can further nonexploitative radical democratic politics. This is where the notion of ‘tidalectic’ processes introduced by James L. Smith is helpful. Focusing on water and the Indigenous knowledges around rivers, he considers how democracy and community can be reimagined as plural, cyclical and attentive to the nonhuman with which the human is inevitably entangled. Diana Leong offers a different approach. Considering the nonhuman from the perspective of Black Studies demands an awareness to how blackness has long been constituted as non- or partially human. (shrink)

We are living in a time of meta-organics and post-biology, where we perceive everything in our world as customizable and changeable. Modelling biology within a technological context allows us to investigate GEO-volutionary alternatives/alterations to our original natural systems, where augmentation and transmutation become standards in search of overall betterment (Genetically Engineered Organics). Our expectations for technology exceeds ubiquitous access and functional perfection and enters the world of technoetics, where our present hyper-functional, immersively multi-apped, borderline-prosthetic, global village devices fail to (...) satiate our desires to be synaptically surpassed. Most real-time interactive behavioural systems in art utilize two and three dimensions. Artificial neural networks and prediction (Latin: from pr- before plus dicere to say) systems give rise to experimentation within the third-plus-one (3+1) dimension of the spacetime continuum. Spacetime in accordance with string theory requires the where and when to describe something in existence, rather than mere points in space. It explains the workings of the universe from both super-galactic and subatomic levels. Physical cosmology studies the motions of the celestial bodies in relation to the first cause (ie. primum movens) or the source of all-being. In book 12 of Metaphysics, Aristotle spoke of something which moves without (itself) being moved (by anything), and referred to being as motion. In quantum mechanics, a particle is described by a wave. Physiognomy is an evolving area of psychological research that describes a direct correlation between human gesture (or movement) and thought. Early twentieth-century Persian philosopher Abdul-Baha mentioned that the reality of man is his thought, not his material body. Prediction systems apply models of the mind, or artificial neural networks and machine learning strategies, to use the recorded past with the present to anticipate the future. This article investigates existing human and artificial psychic systems in hopes of identifying tools necessary in building a gesture prediction system. The relationship of intent to gesture and whether intent can be perceived without the evidence of gesture are two factors that must be tested. (shrink)

There is at present a widespread unease about the direction in which our technology is taking us, apparently against our will. Promising advances seem to carry with them unforeseen negative consequences, including damage to the environment and the reduction of work to the trivial mechanical repetition of actions which have no human meaning. However, attempts to design a better, human-centered technology--one that complements rather than rejects human skills--are all too often frustrated by the prevailing belief that "man is a (...) class='Hi'>machine," and one, moreover, that compares badly in terms of performance and durability. This contentious and stimulating book offers a new approach, one that refutes four centuries of science based on strictly causal explanations. It shows that man and nature can be viewed as "machines with a purpose," and that the "purpose" can be the advancement of technology to the benefit and not the detriment of the human race and its environment. This fascinating work is accessible to a wide range of readers, scientists and nonspecialists alike. It will interest anyone concerned about the impact of technology and the way it is shaping our world. (shrink)

As a first step in involving user emotion in human‐computer interaction, a memory‐based expert system (JANUS; Kearney, 1991) was designed to interpret facial expression in terms of the signaled emotion. Anticipating that a VDU‐mounted camera will eventually supply face parameters automatically, JANUS now accepts manually made measurements on a digitized full‐face photograph and returns emotion labels used by college students. An intermediate representation in terms of face actions (e.g., mouth open) is also used. Production rules convert the geometry into these. (...) A dynamic memory (Kolodner, 1984; Schank, 1982) interprets the face actions in terms of emotion labels. The memory is dynamic in the sense that new emotion labels can be learned with experience. A prototype system has been implemented on a Sun 2/120 system using POPLOG. Validation studies on the prototype suggest that the interpretations achieved are generally consistent with those of college students without formal instruction in emotion signals. (shrink)

This paper examines Harold Garfinkel’s work with ELIZA and a related program LYRIC from 1967 to 1969. AI researchers have tended to treat successful human–machine interaction as if it relied primarily on non-human machine characteristics, and thus the often-reported attribution of human-like qualities to communication with computers has been criticized as a misperception—and humans who make such reports referred to as “deluded.” By contrast Garfinkel, building on two decades of prior research on information and communication, argued that the (...) ELIZA and the LYRIC “chatbots” were achieving interactions that felt human to many users by exploiting human sense-making practices. In keeping with his long-term practice of using “trouble” as a way of discovering the taken-for-granted practices of human sense-making, Garfinkel designed scripts for ELIZA and LYRIC that he could disrupt in order to reveal how their success depended on human social practices. Hence, the announcement “Machine Down” by the chatbot was a desired result of Garfinkel’s interactions with it. This early (but largely unknown) research has implications not only for understanding contemporary AI chatbots, but also opens possibilities for respecifying current information systems design and computational practices to provide for the design of more flexible information objects. (shrink)

I will review the main problems concerning commonsense reasoning in machines and I will present resent two different applications - namaly: the Dual PECCS linguistic categorization system and the TCL reasoning framework that have been developed to address, respectively, the problem of typicality effects and the one of commonsense compositionality, in a way that is integrated or compliant with different cognitive architectures thus extending their knowledge processing capabilities In doing so I will show how such aspects are better dealt with (...) at different levels of representation and will discuss how the adoption of a cognitively inspired approach be useful in the design and implementation of the next generation AI systems mastering commonsense. (shrink)

In this paper I provide an exposition and critique of Johnson and Noorman’s (2014) three conceptualizations of the agential roles artificial systems can play. I argue that two of these conceptions are unproblematic: that of causally efficacious agency and “acting for” or surrogate agency. Their third conception, that of “autonomous agency,” however, is one I have reservations about. The authors point out that there are two ways in which the term “autonomy” can be used: there is, firstly, the engineering (...) sense of the term, which simply refers to the ability of some system to act independently of substantive human control. Secondly, there is the moral sense of the term, which has traditionally grounded many notions of human mor-al responsibility. I argue that the continued usage of “autonomy” in discussions of artificial agency complicates matters unnecessarily. This occurs in two ways: firstly, the condition of autonomy, even in its engineering sense, fails to accurately describe the way “autonomous” systems are developed in practice. Secondly, the continued usage of autonomy in the moral sense introduces unnecessary meta-physical baggage form the free will debate into discussions about moral agency. In order to understand the debate surrounding autonomy, we would therefore first need to settle many seemingly intractable metaphysical questions regarding the existence of free will in human beings. (shrink)

The paper presents a framework to realise “meaningful human control” over Automated Driving Systems. The framework is based on an original synthesis of the results of the multidisciplinary research project “Meaningful Human Control over Automated Driving Systems” lead by a team of engineers, philosophers, and psychologists at Delft University of the Technology from 2017 to 2021. Meaningful human control aims at protecting safety and reducing responsibility gaps. The framework is based on the core assumption that human persons and (...) institutions, not hardware and software and their algorithms, should remain ultimately—though not necessarily directly—in control of, and thus morally responsible for, the potentially dangerous operation of driving in mixed traffic. We propose an Automated Driving System to be under meaningful human control if it behaves according to the relevant reasons of the relevant human actors (tracking), and that any potentially dangerous event can be related to a human actor (tracing). We operationalise the requirements for meaningful human control through multidisciplinary work in philosophy, behavioural psychology and traffic engineering. The tracking condition is operationalised via a proximal scale of reasons and the tracing condition via an evaluation cascade table. We review the implications and requirements for the behaviour and skills of human actors, in particular related to supervisory control and driver education. We show how the evaluation cascade table can be applied in concrete engineering use cases in combination with the definition of core components to expose deficiencies in traceability, thereby avoiding so-called responsibility gaps. Future research directions are proposed to expand the philosophical framework and use cases, supervisory control and driver education, real-world pilots and institutional embedding. (shrink)

"Entre mythe, science et technique il existe une longue tradition de l'homme artificiel, des jaquemarts au Golem, de Frankenstein aux robots, comme si nous nous étions longuement complus, par le jeu des métaphores, à nous contempler dans le miroir de nos machines. Il en est résulté une philosophie mécaniste, de Descartes à La Mettrie qu'il faut bien évoquer. Avec la cybernétique et l'informatique, le vivant, l'esprit, la machine sont entrés dans des chevauchements beaucoup plus complexes qui ouvrent sur un (...) néo-mécanisme. Ce terme marque la volonté, au-delà de ce premier mécanisme, de penser la vie et l'intelligence artificielles, la bionique et le cyborg, l'avenir incertain de l'humain vers ce qu'il faudra peut-être appeler le post-humain. Il fallait pour cela un examen minutieux de toutes ces techniques nouvelles. La machine n'est plus seulement le support d'une vague analogie de la vie et de la pensée ; à travers l'homme réparé, augmenté par des prothèses de plus en plus intimement mêlées à la mécanique de l'organisme, elle vit, elle pense, elle raisonne. Nous assistons à la rencontre d'une pensée de l'homme-machine et de la machine humanisée, rencontre que cet ouvrage tente de penser." [Source : 4e de couv.]. (shrink)