The increasing use of artificial intelligence (AI) by public actors has led to a push for more transparency. Previous research has conceptualized AI transparency as knowledge that empowers citizens and experts to make informed choices about the use and governance of AI. Conversely, in this paper, we critically examine if transparency-as-knowledge is an appropriate concept for a public realm where private interests intersect with democratic concerns. We conduct a practice-based design research study in which we prototype and evaluate a transparent (...) smart electric vehicle charge point, and investigate experts’ and citizens’ understanding of AI transparency. We find that citizens experience transparency as burdensome; experts hope transparency ensures acceptance, while citizens are mostly indifferent to AI; and with absent means of control, citizens question transparency’s relevance. The tensions we identify suggest transparency cannot be reduced to a product feature, but should be seen as a mediator of debate between experts and citizens. (shrink)

Are wealthy neighborhoods visually more attractive than poorer neighborhoods? Past studies provided a positive answer to this question for characteristics such as green space and visible pollution. The condition of streets is one of the characteristics that can not only contribute to neighborhoods’ aesthetics, but can also affect residents’ health and mobility. In this study, we investigate whether street condition of wealthy neighborhoods is different from poorer neighborhoods. We resolved the difficulty of data collection using a dataset that utilized artificial (...) intelligence and laser imaging techniques to collect the data of street condition from 98 zip codes in Los Angeles, CA, and later, we conducted correlations between the metrics of neighborhood affluence and their street condition. Our results showed no positive correlation between neighborhood affluence and the condition of streets. On the contrary, the results favored a negative correlation, indicating that poorer neighborhoods had better streets than wealthy neighborhoods. By discussing possible reasons for these results, we call for future research that would show the direction and the extent of correlation between neighborhood affluence and street condition for other cities and in larger scales. Additionally, we discuss how artificial intelligence and automatic data collection techniques enable us to gather data of street condition for urban planning and management. (shrink)

Consequential historical decisions that shaped transportation systems and their influence on society have many valuable lessons. The decisions we learn from and choose to make going forward will play a key role in shaping the mobility landscape of the future. This is especially pertinent as artificial intelligence (AI) becomes more prevalent in the form of autonomous vehicles (AVs). Throughout urban history, there have been cyclical transport oppressions of previous-generation transportation methods to make way for novel transport methods. These cyclical oppressions (...) can be identified in the baroque and modernist periods, and a third oppression may occur in the contemporary period. To explore the idea of a third oppression, we focus on the bicycle and outline the history of cycling to understand how historical mode oppression unfolded. We then present several social and political factors that contributed to the oppression of cycling and share recommendations for how to avoid future oppressions including political, social, and design actions for researchers and policymakers to take. This paper argues that priorities for AI-enabled mobility and cyclist needs be advanced in proportion to the extent that they contribute to societal goals of urban containment, public realm, and proximal cities. Additionally, future mobility evolutions should prioritise mobility justice and mode choice over inducing a singular transportation method. (shrink)

Focused on city-scale automation, and using self-driving cars (SDCs) as a case study, this article reflects on the role of AI—and in particular, computer vision systems used for mapping and navigation—as a catalyst for urban transformation. Urban research commonly presents AI and cities as having a one-way cause-and-effect relationship, giving undue weight to AI’s impact on cities and overlooking the role of cities in shaping AI. Working at the intersection of data science and social research, this paper aims to counter (...) this trend by exploring the reverse perspective: how do cities affect the development, and expose the present limits, of SDCs? The contribution of this paper is threefold. First, by comparing urban and nonurban environments and thoroughly examining the relationship between computer vision and city-specific sociality and form, it defines machine autonomy/automation as a function of the sociotechnical milieu in which an AI system operates. Second, and related, the paper problematizes the notion of SDCs as autonomous technologies and the role it plays in envisioning contending policy arrangements and technical solutions for achieving full driving automation. Finally, the article offers insight into a materialist and spatialized understanding of AI—namely, not as an abstract quality susceptible to replication within discrete machines, but rather as a distributed property emerging through embodied interactions among a multiplicity of agents (human, non-human, and technological) within/with their environments. (shrink)

Artificial intelligence (AI) is embedded in a wide variety of Smart City applications and infrastructures, often without the citizens being aware of the nature of their “intelligence”. AI can affect citizens’ lives concretely, and thus, there may be uncertainty, concerns, or even fears related to AI. To build acceptable futures of Smart Cities with AI-enabled functionalities, the Human-Centered AI (HCAI) approach offers a relevant framework for understanding citizen perceptions. However, only a few studies have focused on clarifying the citizen perceptions (...) of AI in the context of smart city research. To address this gap, we conducted a two-phased study. In the pre-study, we explored citizen perceptions and experiences of AI with a short survey (N = 91). Second, scenario-based interviews (N = 7) were utilized to gain in-depth insights of citizen perceptions of AI in the Smart City context. Five central themes were recognized: (1) I don’t like them monitoring me, (2) I want maximum gain for minimum effort, (3) I don’t want AI to mimic people, (4) I’ll avoid using AI if I consider the risk too high, and (5) I don’t need to be concerned about AI. These offer an idea of human-centered requirements worth considering while designing AI applications for future Smart Cities. (shrink)

To support the sustainability of future cities, residents’ living spaces need to be built and used efficiently, while supporting residents’ communal wellbeing. Nordic superblock is a new planning, housing, and living concept in which residents of a neighborhood—a combination of city blocks—share yards, common spaces and utilities. Sharing living spaces is an essential element of this approach. In this study, our goal was to study the ways in which intelligent technology solutions—such as proactive, data-driven Artificial Intelligence (AI) applications—could support and (...) even motivate the use of common areas in superblocks. To this end, we conducted a two-phase qualitative study: in the first phase, potential superblock residents (N = 12) shared their perspectives of sharing of living spaces in general, and more specifically of how intelligent technologies could support sharing spaces. In the second phase, two workshops with experts (N = 7) were held to gather understanding of possibilities of intelligent technologies in meeting the residents’ expectations of space sharing. The results illustrate space sharing and communality as supportive factors for one another, enabled but also complicated by social interaction. Major possibilities for intelligent technologies to advance space sharing were seen in organizing the use of spaces and facilitating social interaction in the community. As an outcome, four roles incorporating several use purposes of intelligent technologies were found. The findings can inform the Human-Centered AI (HCAI) research and design improving sustainable living in future urban neighborhoods. (shrink)

The urban traffic environment is characterized by the presence of a highly differentiated pool of users, including vulnerable ones. This makes vehicle automation particularly difficult to implement, as a safe coordination among those users is hard to achieve in such an open scenario. Different strategies have been proposed to address these coordination issues, but all of them have been found to be costly for they negatively affect a range of human values (e.g. safety, democracy, accountability…). In this paper, we claim (...) that the negative value impacts entailed by each of these strategies can be interpreted as lack of what we call Meaningful Human Control over different parts of a sociotechnical system. We argue that Meaningful Human Control theory provides the conceptual tools to reduce those unwanted consequences, and show how “designing for meaningful human control” constitutes a valid strategy to address coordination issues. Furthermore, we showcase a possible application of this framework in a highly dynamic urban scenario, aiming to safeguard important values such as safety, democracy, individual autonomy, and accountability. Our meaningful human control framework offers a perspective on coordination issues that allows to keep human actors in control while minimizing the active, operational role of the drivers. This approach makes ultimately possible to promote a safe and responsible transition to full automation. (shrink)

Emotional AI is an emerging technology used to make probabilistic predictions about the emotional states of people using data sources, such as facial (micro)-movements, body language, vocal tone or the choice of words. The performance of such systems is heavily debated and so are the underlying scientific methods that serve as the basis for many such technologies. In this article I will engage with this new technology, and with the debates and literature that surround it. Working at the intersection of (...) criminology, policing, surveillance and the study of emotional AI this paper explores and offers a framework of understanding the various issues that these technologies present particularly to liberal democracies. I argue that these technologies should not be deployed within public spaces because there is only a very weak evidence-base as to their effectiveness in a policing and security context, and even more importantly represent a major intrusion to people’s private lives and also represent a worrying extension of policing power because of the possibility that intentions and attitudes may be inferred. Further to this, the danger in the use of such invasive surveillance for the purpose of policing and crime prevention in urban spaces is that it potentially leads to a highly regulated and control-oriented society. I argue that emotion recognition has severe impacts on the right to the city by not only undertaking surveillance of existing situations but also making inferences and probabilistic predictions about future events as well as emotions and intentions. (shrink)

Cities today are dynamic urban ecosystems with evolving physical, socio-cultural, and technological infrastructures. Many contestations arise from the effects of inequitable access and intersecting crises currently faced by cities, which may be amplified by the algorithmic and data-centric infrastructures being introduced in urban contexts. In this article, I argue for a critical lens into how inter-related urban technologies, big data and policies, constituted as Urban AI, offer both challenges and opportunities. I examine scenarios of contestations in _urban mobility_, defined broadly (...) to include equitable access, movement, and liberty to engage with the socio-cultural, political, and urban fabric of cities. I anchor my arguments through a framework of _rights, risks,_ and _responsibilities_ for critically examining and configuring the roles, values and ethical implications for all stakeholders including human, AI and non-human entities within an urban ecosystem. As a way forward, I examine the European Commission’s proposed regulations on AI systems through an illustrative case study of an automated parking control system introduced by the City of Amsterdam. In moving beyond the city to broader urban ecosystems, I highlight the role of engaging Indigenous perspectives for designing and reconciling the implications of equitable and sustainable Urban AI ecosystems in the future. (shrink)

Smart city discourses often invoke the Panopticon, a disciplinary architecture designed by Jeremy Bentham and popularly theorized by Michel Foucault, as a model for understanding the social impact of AI technologies. This framing focuses attention almost exclusively on the negative ramifications of Urban AI, correlating ubiquitous surveillance, centralization, and data consolidation with AI development, and positioning technologies themselves as the driving factor shaping privacy, sociality, equity, access, and autonomy in the city. This paper describes an alternative diagram for Urban AI—the (...) Polyopticon: a distributed, polyvalent, multi-modal network of synthetic intelligences. It posits that fourth industrial revolution technologies change the political, social, and psychodynamic relationships of sentience and witness in the city, shifting the effects of watching and watched beyond the exclusive domain of top-down surveillance and discipline. The Polyopticon poses a more expansive and ambivalent spectrum of possibilities for Urban AI scenarios, one that undermines the totalizing, singular, and cerebral notion of intelligence that so often characterizes Urban AI and smart city critiques. (shrink)

This paper seeks to bypass assumptions that researchers in critical algorithmic studies and urban studies find it difficult to study algorithmic systems due to their black-boxed nature. In addition, it seeks to work against the assumption that advocating for transparency in algorithms is, therefore, the key for achieving an enhanced understanding of the role of algorithmic technologies on modern life. Drawing on applied assemblage thinking via the concept of the urban assemblage, I demonstrate how the notion of urban assemblage can (...) work as an alternative way to explore the distributed and potential dimensions of what has been termed as Urban AI phenomena. Rather than seeing Urban AI phenomena as black-boxed, unknown and opaque, the notion of urban assemblage locates such entities within the wider contests of the city: urban places, communities and politics, where human-algorithmic relationships gather and disperse. In addition, this approach focuses on the potentialities of Urban AI phenomena—how algorithmic systems can operate differently through different aspects of the city—which can be seen to manifest new forms of resistance, collective actions and democracy. I use a case study of an algorithmic system designed to facilitate digital democracy—vTaiwan—to exemplify how assemblage methodology foregrounds the role of cities as spaces and places for exploring the democratic possibilities of algorithmic systems. This paper concludes with discussion of how the assemblage methodology contributes to serve as a bridge between critical algorithm studies and recent studies of platform urbanism. (shrink)

Increasing computational power and improving deep learning methods have made computer vision technologies pervasively common in urban environments. Their applications in policing, traffic management, and documenting public spaces are increasingly common (Ridgeway 2018, Coifman et al. 1998, Sun et al. 2020). Despite the often-discussed biases in the algorithms' training and unequally borne benefits (Khosla et al. 2012), almost all applications similarly reduce urban experiences to simplistic, reductive, and mechanistic measures. There is a lack of context, depth, and specificity in these (...) practices that enables semantic knowledge or analysis within urban contexts, especially within the context of using and occupying urban space. This paper will critique existing uses of artificial intelligence and computer vision in urban practices to propose a new framework for understanding people, action, and public space. This paper revisits Geertz's (1973) use of thick descriptions in generating interpretive theories of culture and activity and uses this lens to establish a framework to approach evaluating the varied uses of computer vision technologies that weigh meaning. By discussing cases of implemented examples of urban computer vision—from LinkNYC and Numina's urban measurements to the Detroit Police's use of DataWorks Plus's facial recognition technology—it proposes a framework for evaluating the thickness of the algorithm's conclusions against the computational method's complexity required to produce that outcome. Further, we discuss how the framework's positioning may differ (and conflict) between different users of the technology, from engineer to urban planner and policymaker, to citizen. This paper also discusses how the current use and training of deep learning algorithms and how this process limits semantic learning and proposes three potential methodologies toward gaining a more contextually specific, urban-semantic, description of urban space relevant to urbanists. This paper contributes to the critical conversations regarding the proliferation of artificial intelligence by challenging the current applications of these technologies in the urban environment by highlighting their failures within this context while also proposing an evolution of these algorithms that may ultimately make them sensitive and useful within this spatial and cultural milieu. (shrink)

Highly sophisticated capabilities of artificial intelligence (AI) have skyrocketed its popularity across many industry sectors globally. The public sector is one of these. Many cities around the world are trying to position themselves as leaders of urban innovation through the development and deployment of AI systems. Likewise, increasing numbers of local government agencies are attempting to utilise AI technologies in their operations to deliver policy and generate efficiencies in highly uncertain and complex urban environments. While the popularity of AI is (...) on the rise in urban policy circles, there is limited understanding and lack of empirical studies on the city manager perceptions concerning urban AI systems. Bridging this gap is the rationale of this study. The methodological approach adopted in this study is twofold. First, the study collects data through semi-structured interviews with city managers from Australia and the US. Then, the study analyses the data using the summative content analysis technique with two data analysis software. The analysis identifies the following themes and generates insights into local government services: AI adoption areas, cautionary areas, challenges, effects, impacts, knowledge basis, plans, preparedness, roadblocks, technologies, deployment timeframes, and usefulness. The study findings inform city managers in their efforts to deploy AI in their local government operations, and offer directions for prospective research. (shrink)

Our fascination with artificial intelligence (AI), robots and sentient machines has a long history, and references to such humanoids are present even in ancient myths and folklore. The advancements in digital and computational technology have turned this fascination into apprehension, with the machines often being depicted as a binary to the human. However, the recent domains of academic enquiry such as transhumanism and posthumanism have produced many a literature in the genre of science fiction (SF) that endeavours to alter this (...) antagonistic notion of AI. In his novel Klara and the Sun, Kazuo Ishiguro explores this notion of AI as a caring machine capable of nursing an ailing young girl back to health. Through this portrayal of AI as a sentient being capable of empathy and cognition, Ishiguro is attempting to usher in a new perception of AI: a posthuman perception that challenges the conventional notions of AI as a machine devoid of emotions. The novel further expands on the idea of self, soul and human consciousness and ponders on the question, what makes humans human, and if it is possible to imbibe these qualities onto an AI. Owing to the novelty of this notion, an unexplored avenue that deserves further exploration, this paper examines the plausibility of this new notion of AI through a careful exegesis of the novel. The paper also attempts to chart the impact of SF in society and culture. The study reveals a positive shift in perception towards AI, and there seems to be much scope for interdisciplinary and transdisciplinary research. (shrink)

In this article we present a new approach to practical artificial intelligence (AI) ethics in heavy industry, which was developed in the context of an EU Horizons 2020 multi partner project. We begin with a review of the concept of Industry 4.0, discussing the limitations of the concept, and of iterative categorization of heavy industry generally, for a practical human centered ethical approach. We then proceed to an overview of actual and potential AI ethics approaches to heavy industry, suggesting that (...) current approaches with their emphasis on broad high-level principles are not well suited to AI ethics for industry. From there we outline our own approach in two sections. The first suggests tailoring ethics to the time and space situation of the shop floor level worker from the ground up, including giving specific and evolving ethical recommendations. The second describes the ethicist’s role as an ethical supervisor immersed in the development process and interpreting between industrial and technological (tech) development partners. In presenting our approach we draw heavily on our own experiences in applying the method in the Use Cases of our project, as examples of what can be done. (shrink)

As the COVID-19 outbreak remains an ongoing issue, there are concerns about its disruption, the level of its disruption, how long this pandemic is going to last, and how innovative technological solutions like Artificial Intelligence (AI) and expert systems can assist to deal with this pandemic. AI has the potential to provide extremely accurate insights for an organization to make better decisions based on collected data. Despite the numerous advantages that may be achieved by AI, the use of AI can (...) be perceived differently by society, where moral and ethical issues may be raised, especially in regards to accessing and exploiting public data gathered from social media platforms. To better comprehend the concerns and ethical challenges, utilitarianism and deontology were used as business ethics frameworks to explore the aforementioned challenges of AI in society. The framework assists in determining whether the AI’s deployment is ethically acceptable or not. The paper lays forth policy recommendations for public and private organizations to embrace AI-based decision-making processes to avoid data privacy violations and maintain public trust. (shrink)

There is a deluge of AI-assisted decision-making systems, where our data serve as proxy to our actions, suggested by AI. The closer we investigate our data (raw input, or their learned representations, or the suggested actions), we begin to discover “bugs”. Outside of their test, controlled environments, AI systems may encounter situations investigated primarily by those in other disciplines, but experts in those fields are typically excluded from the design process and are only invited to attest to the ethical features (...) of the resulting system or to comment on demonstrations of intelligence and aspects of craftmanship after the fact. This communicative impasse must be overcome. Our idea is that philosophical and engineering considerations interact and can be fruitfully combined in the AI design process from the very beginning. We embody this idea in the role of a philosopher engineer. We discuss the role of philosopher engineers in the three main design stages of an AI system: deployment management (what is the system’s intended use, in what environment?); objective setting (what should the system be trained to do, and how?); and training (what model should be used, and why?). We then exemplify the need for philosopher engineers with an illustrative example, investigating how the future decisions of an AI-based hiring system can be fairer than those contained in the biased input data on which it is trained; and we briefly sketch the kind of interdisciplinary education that we envision will help to bring about better AI. (shrink)

Recent work in AI ethics often calls for AI to advance human values and interests. The concept of “AI for people” is one notable example. Though commendable in some respects, this work falls short by excluding the moral significance of nonhumans. This paper calls for a shift in AI ethics to more inclusive paradigms such as “AI for the world” and “AI for the universe”. The paper outlines the case for more inclusive paradigms and presents implications for moral philosophy and (...) computer science work on AI ethics. (shrink)

Everything we do in life involves a connection with information, experience and know-how: together these represent the most valuable of intangible human assets encompassing our history, cultures and wisdom. However, the more easily new technologies gather information, the more we are confronted with our limited capacity to distinguish between what is essential, important or merely ‘nice-to-have’. This article presents the case study of a multilingual Knowledge Management System, the Business enabling e-Platform that gathers and protects tacit knowledge, as the key (...) to developing structured intellectual capital, while acknowledging the urgent need here to integrate Ethics-by-design alongside AI-by-design, in view of the far-reaching consequences involved, for good or ill. It also explains how a beneficial Circular Economy of Knowledge depends on evidence-based answers, and how harmonising taxonomies, terminology and standards promotes global trust as the basis for the unhindered transfer of tacit knowledge between generations in a way that benefits everyone. (shrink)

Because of its practical advantages, machine learning (ML) is increasingly used for decision-making in numerous sectors. This paper demonstrates that the integral characteristics of ML, such as semi-autonomy, complexity, and non-deterministic modeling have important ethical implications. In particular, these characteristics lead to a lack of insight and lack of comprehensibility, and ultimately to the loss of human control over decision-making. Errors, which are bound to occur in any decision-making process, may lead to great harm and human rights violations. It is (...) important to have a principled way of assigning responsibility for such errors. The integral characteristics of ML, however, pose serious difficulties in defining responsibility and regulating ML decision-making. First, we elaborate on these characteristics and their epistemic and ethical implications. We then analyze possible general strategies for resolving the assignment of moral responsibility and show that, due to the specific way in which ML functions, each potential solution is problematic, whether we assign responsibility to humans, machines, or using hybrid models. Then, we shift focus on an alternative approach that bypasses moral responsibility and attempts to define legal liability independently through solutions such as informed consent and the no-fault compensation system. Both of these solutions prove unsatisfactory because they leave too much room for potential abuses of ML decision-making. We conclude that both ethical and legal solutions are fraught with serious difficulties. These difficulties prompt us to re-weigh the costs and benefits of using ML for high-stake decisions. (shrink)

As artificial intelligence (AI) thrives and propagates through modern life, a key question to ask is how to include humans in future AI? Despite human involvement at every stage of the production process from conception and design through to implementation, modern AI is still often criticized for its “black box” characteristics. Sometimes, we do not know what really goes on inside or how and why certain conclusions are met. Future AI will face many dilemmas and ethical issues unforeseen by their (...) creators beyond those commonly discussed (e.g., trolley problems and variants of it) and to which solutions cannot be hard-coded and are often still up for debate. Given the sensitivity of such social and ethical dilemmas and the implications of these for human society at large, when and if our AI make the “wrong” choice we need to understand how they got there in order to make corrections and prevent recurrences. This is particularly true in situations where human livelihoods are at stake (e.g., health, well-being, finance, law) or when major individual or household decisions are taken. Doing so requires opening up the “black box” of AI; especially as they act, interact, and adapt in a human world and how they interact with other AI in this world. In this article, we argue for the application of cognitive architectures for ethical AI. In particular, for their potential contributions to AI transparency, explainability, and accountability. We need to understand how our AI get to the solutions they do, and we should seek to do this on a deeper level in terms of the machine-equivalents of motivations, attitudes, values, and so on. The path to future AI is long and winding but it could arrive faster than we think. In order to harness the positive potential outcomes of AI for humans and society (and avoid the negatives), we need to understand AI more fully in the first place and we expect this will simultaneously contribute towards greater understanding of their human counterparts also. (shrink)

Providing meaningful and actionable explanations for end-users is a situated problem requiring the intersection of multiple disciplines to address social, operational, and technical challenges. However, the explainable artificial intelligence community has not commonly adopted or created tangible design tools that allow interdisciplinary work to develop reliable AI-powered solutions. This paper proposes a formative architecture that defines the explanation space from a user-inspired perspective. The architecture comprises five intertwined components to outline explanation requirements for a task: (1) the end-users’ mental models, (...) (2) the end-users’ cognitive process, (3) the user interface, (4) the Human-Explainer Agent, and (5) the agent process. We first define each component of the architecture. Then, we present the Abstracted Explanation Space, a modeling tool that aggregates the architecture’s components to support designers in systematically aligning explanations with end-users’ work practices, needs, and goals. It guides the specifications of what needs to be explained (content: end-users’ mental model), why this explanation is necessary (context: end-users’ cognitive process), to delimit how to explain it (format: Human-Explainer Agent and user interface), and when the explanations should be given. We then exemplify the tool’s use in an ongoing case study in the aircraft maintenance domain. Finally, we discuss possible contributions of the tool, known limitations or areas for improvement, and future work to be done. (shrink)

Over the last decade, humans have produced each year as much data as were produced throughout the entire history of humankind. These data, in quantities that exceed current analytical capabilities, have been described as “the new oil,” an incomparable source of value. This is true for healthcare, as well. Conducting analyses of large, diverse, medical datasets promises the detection of previously unnoticed clinical correlations and new diagnostic or even therapeutic possibilities. However, using Big Data poses several problems, especially in terms (...) of representing the uniqueness of each patient and expressing the differences between individuals, primarily gender and sex differences. The first two sections of the paper provide a definition of “Big Data” and illustrate the uses of Big Data in medicine. Subsequently, the paper explores the struggle to represent exhaustively the uniqueness of the patient through Big Data is highlighted prior to a deeper investigation of the digital representation of gender in personalized medicine. The final part of the paper put forward a series of recommendations for better approaching the complexity of gender in medical and clinical research involving Big Data for the creation or enhancement of personalized medicine services. (shrink)

The data science era is characterized by data-driven automated decision systems (ADS) enabling, through data analytics and machine learning, automated decisions in many contexts, deeply impacting our lives. As such, their downsides and potential risks are becoming more and more evident: technical solutions, alone, are not sufficient and an interdisciplinary approach is needed. Consequently, ADS should evolve into data-informed ADS, which take humans in the loop in all the data processing steps. Data-informed ADS should deal with data responsibly, guaranteeing nondiscrimination (...) with respect to protected groups of individuals. Nondiscrimination can be characterized in terms of different types of properties, like fairness and diversity. While fairness, i.e., absence of bias against minorities, has been widely investigated in machine learning, only more recently this issue has been tackled by considering all the steps of data processing pipelines at the basis of ADS, from data acquisition to analysis. Additionally, fairness is just one point of view of nondiscrimination to be considered for guaranteeing equity: other issues, like diversity, are raising interest from the scientific community due to their relevance in society. This paper aims at critically surveying how nondiscrimination has been investigated in the context of complex data science pipelines at the basis of data-informed ADS, by focusing on the specific data processing tasks for which nondiscrimination solutions have been proposed. (shrink)

Artificial Intelligence (AI) is taking centre stage in economic growth and business operations alike. Public discourse about the practical and ethical implications of AI has mainly focussed on the societal level. There is an emerging knowledge base on AI risks to human rights around data security and privacy concerns. A separate strand of work has highlighted the stresses of working in the gig economy. This prevailing focus on human rights and gig impacts has been at the expense of a closer (...) look at how AI may be reshaping traditional workplace relations and, more specifically, workplace health and safety. To address this gap, we outline a conceptual model for developing an AI Work Health and Safety (WHS) Scorecard as a tool to assess and manage the potential risks and hazards to workers resulting from AI use in a workplace. A qualitative, practice-led research study of AI adopters was used to generate and test a novel list of potential AI risks to worker health and safety. Risks were identified after cross-referencing Australian AI Ethics Principles and Principles of Good Work Design with AI ideation, design and implementation stages captured by the AI Canvas, a framework otherwise used for assessing the commercial potential of AI to a business. The unique contribution of this research is the development of a novel matrix itemising currently known or anticipated risks to the WHS and ethical aspects at each AI adoption stage. (shrink)

With the growing influence of artificial intelligence (AI) in our lives, the ethical implications of AI have received attention from various communities. Building on previous work on trust in people and technology, we advance a multidimensional, multilevel conceptualization of trust in AI and examine the relationship between trust and ethics using the data from a survey of a national sample in the U.S. This paper offers two key dimensions of trust in AI—human-like trust and functionality trust—and presents a multilevel conceptualization (...) of trust with dispositional, institutional, and experiential trust each significantly correlated with trust dimensions. Along with trust in AI, we examine perceptions of the importance of seven ethics requirements of AI offered by the European Commission’s High-Level Expert Group. Then the association between ethics requirements and trust is evaluated through regression analysis. Findings suggest that the ethical requirement of societal and environmental well-being is positively associated with human-like trust in AI. Accountability and technical robustness are two other ethical requirements, which are significantly associated with functionality trust in AI. Further, trust in AI was observed to be higher than trust in other institutions. Drawing from our findings, we offer a multidimensional framework of trust that is inspired by ethical values to ensure the acceptance of AI as a trustworthy technology. (shrink)

As Artificial Intelligence (AI) becomes more and more pervasive in our everyday life, new questions arise about its ethical and social impacts. Such issues concern all stakeholders involved in or committed to the design, implementation, deployment, and use of the technology. The present document addresses these preoccupations by introducing and discussing a set of practical obligations and recommendations for the development of applications and systems based on AI techniques. With this work we hope to contribute to spreading awareness on the (...) many social challenges posed by AI and encouraging the establishment of good practices throughout the relevant social areas. As points of novelty, the paper elaborates on an integrated view that combines both human rights and ethical concepts to reap the benefits of the two approaches. Moreover, it proposes innovative recommendations, such as those on redress and governance, which add further insight to the debate. Finally, it incorporates a specific focus on the Italian Constitution, thus offering an example of how core legislations of Member States might contribute to further specify and enrich the EU normative framework on AI. (shrink)

Recent events have highlighted large-scale systemic racial disparities in U.S. criminal justice based on race and other demographic characteristics. Although criminological datasets are used to study and document the extent of such disparities, they often lack key information, including arrestees’ racial identification. As AI technologies are increasingly used by criminal justice agencies to make predictions about outcomes in bail, policing, and other decision-making, a growing literature suggests that the current implementation of these systems may perpetuate racial inequalities. In this paper, (...) we argue that AI technologies should be investigated to understand how they recognize racial categories and whether they can be harnessed to fill missing race data. By bridging this gap, we can work towards better understanding racial inequalities in a wide range of contexts, most notably criminal justice. Using a multidisciplinary perspective, we rethink the design and methodology used in facial processing technology (FPT) based on supervised deep learning model (DLM) image classification. By modifying standard FPT pipelines to tackle multiple sources of DLM bias, we propose an experimental methodology based on ethical AI principles to generate binary (Black and White) racial categories using mugshots. We go beyond simply reporting DLM accuracies and address fundamental issues such as generalizability and interpretability by using a “self-auditing” approach. First, we evaluate the inference performances of 42 fine-tuned DLMs using unseen test images from the same dataset but subject to varying data augmentations. Next, to interpret and validate our methodological approach, we apply gradient-based saliency maps to assess the consistency of facial region relevance and attribution. Finally, drawing upon insights from three areas (computer science, sociology, and law), we investigate the efficacy of our DLM-based method as a tool for detecting racial inequalities in criminal justice. (shrink)

To support the trustworthiness of AI systems, it is essential to have precise methods to determine what or who is to account for the behaviour, or the outcome, of AI systems. The assignment of responsibility to an AI system is closely related to the identification of individuals or elements that have caused the outcome of the AI system. In this work, we present an overview of approaches that aim at modelling responsibility of AI systems, discuss their advantages and shortcomings to (...) deal with various aspects of the notion of responsibility, and present research gaps and ways forward. (shrink)

In the contemporary digital age, recommender systems (RSs) play a fundamental role in managing information on online platforms: from social media to e-commerce, from travels to cultural consumptions, automated recommendations influence the everyday choices of users at an unprecedented scale. RSs are trained on users’ data to make targeted suggestions to individuals according to their expected preference, but their ultimate impact concerns all the multiple stakeholders involved in the recommendation process. Therefore, whilst RSs are useful to reduce information overload, their (...) deployment comes with significant ethical challenges, which are still largely unaddressed because of proprietary constraints and regulatory gaps that limit the effects of standard approaches to explainability and transparency. In this context, I address the ethical and social implications of automated recommendations by proposing a pro-ethical design framework aimed at reorienting the influence of RSs towards societal interest. In particular, after highlighting the problem of explanation for RSs, I discuss the application of beneficent informational nudging to the case of conversational recommender systems (CRSs), which rely on user-system dialogic interactions. Subsequently, through a comparison with standard recommendations, I outline the incentives for platforms and providers in adopting this approach and its benefits for both individual users and society. (shrink)

Recently, scholars across disciplines raised ethical, legal and social concerns about the notion of human intervention, control, and oversight over Artificial Intelligence (AI) systems. This observation becomes particularly important in the age of ubiquitous computing and the increasing adoption of AI in everyday communication infrastructures. We apply Nicholas Garnham's conceptual perspective on mediation to users who are challenged both individually and societally when interacting with AI-enabled systems. One way to increase user agency are mechanisms to contest faulty or flawed AI (...) systems and their decisions, as well as to request redress. Currently, however, users structurally lack such mechanisms, which increases risks for vulnerable communities, for instance patients interacting with AI healthcare chatbots. To empower users in AI-mediated communication processes, this article introduces the concept of active human agency. We link our concept to contestability and redress mechanism examples and explain why these are necessary to strengthen active human agency. We argue that AI policy should introduce rights for users to swiftly contest or rectify an AI-enabled decision. This right would empower individual autonomy and strengthen fundamental rights in the digital age. We conclude by identifying routes for future theoretical and empirical research on active human agency in times of ubiquitous AI. (shrink)

Artificial Intelligence (AI) has become a driving force in modern research, industry and public administration and the European Union (EU) is embracing this technology with a view to creating societal, as well as economic, value. This effort has been shared by EU Member States which were all encouraged to develop their own national AI strategies outlining policies and investment levels. This study focuses on how EU Member States are approaching the promise to develop and use AI for the good of (...) society through the lens of their national AI strategies. In particular, we aim to investigate how European countries are investing in AI and to what extent the stated plans contribute to the good of people and society as a whole. Our contribution consists of three parts: (i) a conceptualization of AI for social good highlighting the role of AI policy, in particular, the one put forward by the European Commission (EC); (ii) a qualitative analysis of 15 European national strategies mapping investment plans and suggesting their relation to the social good (iii) a reflection on the current status of investments in socially good AI and possible steps to move forward. Our study suggests that while European national strategies incorporate money allocations in the sphere of AI for social good (e.g. education), there is a broader variety of underestimated actions (e.g. multidisciplinary approach in STEM curricula and dialogue among stakeholders) that can boost the European commitment to sustainable and responsible AI innovation. (shrink)

In recent years, the work of organizations in the area of digitization has intensified significantly. This trend is also evident in the field of recruitment where job application tracking systems (ATS) have been developed to allow job advertisements to be published online. However, recent studies have shown that recruiting in most organizations is not inclusive, being subject to human biases and prejudices. Most discrimination activities appear early but subtly in the hiring process, for instance, exclusive phrasing in job advertisement discourages (...) qualified applicants from minority groups from applying. The existing works are limited to analyzing, categorizing and highlighting the occurrence of bias in the recruitment process. In this paper, we go beyond this and develop machine learning models for identifying and classifying biased and discriminatory language in job descriptions. We develop and evaluate a machine learning system for identifying five major categories of biased and discriminatory language in job advertisements, i.e., masculine-coded, feminine-coded, exclusive, LGBTQ-coded, demographic and racial language. We utilized the combination of linguistic features with recent state-of-the-art word embeddings representations as input features for various machine learning classifiers. Our results show that the machine learning classifiers were able to identify all the five categories of biased and discriminatory language with a decent accuracy. The Random Forest classifier with FastText word embeddings achieved the best performance with tenfolds cross-validation. Our system directly addresses the bias in the attraction phase of hiring by identifying and classifying biased and discriminatory language and thus encouraging recruiters to write more inclusive job advertisements. (shrink)

The increasing implementation of and reliance on machine-learning (ML) algorithms to perform tasks, deliver services and make decisions in health and healthcare have made the need for fairness in ML, and more specifically in healthcare ML algorithms (HMLA), a very important and urgent task. However, while the debate on fairness in the ethics of artificial intelligence (AI) and in HMLA has grown significantly over the last decade, the very concept of fairness as an ethical value has not yet been sufficiently (...) explored. Our paper aims to fill this gap and address the AI ethics principle of fairness from a conceptual standpoint, drawing insights from accounts of fairness elaborated in moral philosophy and using them to conceptualise fairness as an ethical value and to redefine fairness in HMLA accordingly. To achieve our goal, following a first section aimed at clarifying the background, methodology and structure of the paper, in the second section, we provide an overview of the discussion of the AI ethics principle of fairness in HMLA and show that the concept of fairness underlying this debate is framed in purely distributive terms and overlaps with non-discrimination, which is defined in turn as the absence of biases. After showing that this framing is inadequate, in the third section, we pursue an ethical inquiry into the concept of fairness and argue that fairness ought to be conceived of as an ethical value. Following a clarification of the relationship between fairness and non-discrimination, we show that the two do not overlap and that fairness requires much more than just non-discrimination. Moreover, we highlight that fairness not only has a distributive but also a socio-relational dimension. Finally, we pinpoint the constitutive components of fairness. In doing so, we base our arguments on a renewed reflection on the concept of respect, which goes beyond the idea of equal respect to include respect for individual persons. In the fourth section, we analyse the implications of our conceptual redefinition of fairness as an ethical value in the discussion of fairness in HMLA. Here, we claim that fairness requires more than non-discrimination and the absence of biases as well as more than just distribution; it needs to ensure that HMLA respects persons both as persons and as particular individuals. Finally, in the fifth section, we sketch some broader implications and show how our inquiry can contribute to making HMLA and, more generally, AI promote the social good and a fairer society. (shrink)

For decision making in government, it is necessary to have well-structured sources of information. In several countries, it is difficult to access government data as the information are dispersed, disconnected, and poorly structured. For this reason, this work presents a framework to gather, unify, and enrich missing person data from distributed web sources. The framework allows inserting new tasks specific to the user’s domain to improve data quality. In this study, Brazilian missing person data from non-governmental organizations (NGOs) and governmental (...) websites were collected and semantically enriched. To enhance the understanding of the gathered missing people cases, we create interpretive models using machine learning techniques to extract knowledge and to encourage the use of standards for publishing the data that are frequently ignored by organizations, hindering analysis and decision-making on data. After the collection and semantic enrichment process, there was an increase of approximately 11% in the data present in the base. Also, the mining process evidenced the disappearance and reappearance of a person in Brazil according to several factors such as age, state initiatives, skin tone, hair colors, etc. (shrink)

This article presents our experience as a multidisciplinary team systematizing and analyzing the transcripts from a large-scale (1.775 conversations) series of conversations about Chile’s future. This project called “Tenemos Que Hablar de Chile” [We have to talk about Chile] gathered more than 8000 people from all municipalities, achieving gender, age, and educational parity. In this sense, this article takes an experiential approach to describe how certain interdisciplinary methodological decisions were made. We sought to apply analytical variables derived from social science (...) theories and operationalize them through modern linguistics to guide a more theoretically informed natural language processing. The analysis was divided into three stages: (1) a descriptive analysis adapting descriptions of computational grounded theory, (2) a futurization analysis operationalizing concepts from futures studies, and (3) an argumentative analysis operationalizing concepts from argumentation theory. Overall, our methodological experimentation shed light on potential learnings for integrating a multidisciplinary perspective on NLP analysis with sensitive social content. Firstly, we developed a strategy for translation of knowledge based on the construction of what we called "analytical categories” in which a normative expectation or descriptive dimension was identified in the body of literature, operationalized through linguistics, and programmed in Python or R. Ultimately, we seek to reflect on the importance interdisciplinarity not only as means to find new analysis ideas but rather, to incorporate the critical, political and epistemological points of view to understand analysis as complex socio-technical processes. (shrink)

One of the moral questions concerning autonomous vehicles (henceforth AVs) is the choice between types that differ in their built-in algorithms for dealing with rare situations of unavoidable lethal collision. It does not appear to be possible to avoid questions about how these algorithms should be designed. We present the results of our study of moral preferences (N = 2769) with respect to three types of AVs: (1) selfish, which protects the lives of passenger(s) over any number of bystanders; (2) (...) altruistic, which minimizes the number of casualties, even if this leads to death of passenger(s); and (3) conservative, which abstains from interfering in such situations. We differentiate between scenarios in which participants are to make their decisions privately or publicly, and for themselves or for their offspring. We aim to answer two research questions: (1) whether the public visibility of the choice of an AV type choice make this choice more altruistic and (2) which type of situation makes it more difficult to choose altruistically: when choosing for society as a whole, when choosing only for oneself, or when choosing only for one’s offspring. Our results show that respondents exhibit a preference for an altruistic strategy for AVs and that it is reinforced when signaled to others. The altruistic preference is strongest when applies to everybody else, weaker when it reflects a solely personal choice, and weakest when choosing for one’s own child. We conclude that a public choice is considerably more likely to pressure consumers into accepting a more socially beneficial solution. (shrink)

Machine learning classifiers are increasingly used to inform, or even make, decisions significantly affecting human lives. Fairness concerns have spawned a number of contributions aimed at both identifying and addressing unfairness in algorithmic decision-making. This paper critically discusses the adoption of group-parity criteria (e.g., demographic parity, equality of opportunity, treatment equality) as fairness standards. To this end, we evaluate the use of machine learning methods relative to different steps of the decision-making process: assigning a predictive score, linking a classification to (...) the score, and adopting decisions based on the classification. Throughout our inquiry we use the COMPAS system, complemented by a radical simplification of it (our SAPMOC I and SAPMOC II models), as our running examples. Through these examples, we show how a system that is equally accurate for different groups may fail to comply with group-parity standards, owing to different base rates in the population. We discuss the general properties of the statistics determining the satisfaction of group-parity criteria and levels of accuracy. Using the distinction between scoring, classifying, and deciding, we argue that equalisation of classifications/decisions between groups can be achieved thorough group-dependent thresholding. We discuss contexts in which this approach may be meaningful and useful in pursuing policy objectives. We claim that the implementation of group-parity standards should be left to competent human decision-makers, under appropriate scrutiny, since it involves discretionary value-based political choices. Accordingly, predictive systems should be designed in such a way that relevant policy goals can be transparently implemented. Our paper presents three main contributions: (1) it addresses a complex predictive system through the lens of simplified toy models; (2) it argues for selective policy interventions on the different steps of automated decision-making; (3) it points to the limited significance of statistical notions of fairness to achieve social goals. (shrink)

Biases in cognition are ubiquitous. Social psychologists suggested biases and stereotypes serve a multifarious set of cognitive goals, while at the same time stressing their potential harmfulness. Recently, biases and stereotypes became the purview of heated debates in the machine learning community too. Researchers and developers are becoming increasingly aware of the fact that some biases, like gender and race biases, are entrenched in the algorithms some AI applications rely upon. Here, taking into account several existing approaches that address the (...) problem of implicit biases and stereotypes, we propose that a strategy to cope with this phenomenon is to unmask those found in AI systems by understanding their cognitive dimension, rather than simply trying to correct algorithms. To this extent, we present a discussion bridging together findings from cognitive science and insights from machine learning that can be integrated in a state-of-the-art semantic network. Remarkably, this resource can be of assistance to scholars (e.g., cognitive and computer scientists) while at the same time contributing to refine AI regulations affecting social life. We show how only through a thorough understanding of the cognitive processes leading to biases, and through an interdisciplinary effort, we can make the best of AI technology. (shrink)

Theories related to cognitive sciences, Human-in-the-loop Cyber-physical systems, data analysis for decision-making, and computational ethics make clear the need to create transdisciplinary learning, research, and application strategies to bring coherence to the paradigm of a truly human-oriented technology. Autonomous objects assume more responsibilities for individual and collective phenomena, they have gradually filtered into routines and require the incorporation of ethical practice into the professions related to the development, modeling, and design of algorithms. To make this possible, it is pertinent and (...) urgent to bring them closer to the problems and approaches of the humanities. Increasingly transdisciplinary research must be part of the construction of systems that provide developers and scientists with the necessary bases to understand the ethical debate and therefore their commitment to society. This article considers two theories as articulating axes: Blumenberg’s, coming from the field of philosophy, for whom the process of technification and especially the implementation of mathematical models in their algorithmic form leads to an emptying of meaning and therefore makes programmers who implement their functions to be alien to the concerns that gave them origin; Daston’s, belonging to the field of the history of science and according to which the division of labor in the processes of technification of the calculation implies a kind of subordination in which those who implement the inventions of a small group of privileged mathematicians ignore the procedures that put them into operation. Given these two theories, the black box models prevalent in AI development, and the urgency of establishing explanatory frameworks for the development of computational ethics, this article exposes the need to give a voice to the cultural history of consciousness for promoting the discussions around the implementation of mathematical algorithms. The paper takes as a reference the different points of view that have emerged around the study of technological ethics, its applicability, management, and design. It criticizes the current state of studies from a humanistic perspective and explains how the historical perspective allows promoting the training of software engineers, developers and creators so that they assume intuitions and moral values in the development of their work. Specifically, it aims to expose how cultural history, applied to the study of consciousness and its phenomena, makes those involved in this technological revolution aware of the effect that they, through their algorithms, have on society in general and on human beings in particular. (shrink)

Human organizations’ adoption of the paradigm of the Fourth Industrial Revolution is associated with the growth of techno-empowerment, which is the process of transferring autonomy in decision-making to intelligent machines. Particular persuasive strategies have been identified that may coax people to use intelligent devices. However, there is a substantial research gap regarding what antecedents influence human intention to assign decision-making autonomy to artificial agents. In this study, ethological and evolutionary concepts are applied to explain the drivers for autonomous assistants’ techno-empowerment. (...) The method used in the study was a 4 × 2 between-subject experiment made with 278 persons. The research tool used to collect the data was an online survey. The results show that more positive attitudes and higher trust, perceived usefulness, and perceived ease of use are correlated with higher intention to allow the autonomous assistant independence in decision-making. Second, the results suggest that the more human-like a non-human agent is, the higher the intention to empower it—but only if this agent simultaneously provides functional and visual anthropomorphic cues explainable by the mimicry effect. (shrink)

Implications of algorithmic mediation can be studied through the artefact itself, peoples’ practices, and the social/political/economical arrangements that affect and are affected by such interactions. Most studies in Academic social media (ASM) focus on one of these elements at a time, either examining design elements or the users’ behaviour on and perceptions of such platforms. We take a multi-faceted approach using affordances as a lens to analyze practices and arrangements traversed by algorithmic mediation. Following our earlier studies that examined the (...) artefact, this study’s aim is to understand how algorithmic mediation in ASM may shape researchers’ perceptions. We conducted online in-depth interviews with show and tell (n = 11) with ASM users from four countries, about their use of ASM. Data were analyzed using thematic analysis, and the codes were clustered in themes and validated via peer debriefing process. Four themes—related to exposure to content, visibility, ethical or legal infringements, and engagement—are discussed considering implications of datafication and findability. We conclude that algorithmic mediation constructs a narration of the relevant other in ASM, configuring the other as participatory and productive. (shrink)

Since some AI algorithms with high predictive power have impacted human integrity, safety has become a crucial challenge in adopting and deploying AI. Although it is impossible to prevent an algorithm from failing in complex tasks, it is crucial to ensure that it fails safely, especially if it is a critical system. Moreover, due to AI’s unbridled development, it is imperative to minimize the methodological gaps in these systems’ engineering. This paper uses the well-known Box-Jenkins method for statistical modeling as (...) a framework to identify engineering pitfalls in the adjustment and validation of AI models. Step by step, we point out state-of-the-art strategies and good practices to tackle these engineering drawbacks. In the final step, we integrate an internal and external validation scheme that might support an iterative evaluation of the normative, perceived, substantive, social, and environmental safety of all AI systems. (shrink)

This paper investigates the importance of standardising and maintaining the transparency of advanced driver-assistance systems (ADAS) functions nomenclature, designs, and operations in all categories up until fully autonomous vehicles. The aim of this paper is to reveal the discrepancies in ADAS functions across automakers and discuss the underlying issues and potential solutions. In this pilot study, user manuals of various brands are reviewed systematically and critical analyses of common ADAS functions are conducted. The result shows that terminologies used to describe (...) ADAS functions vary widely across manufacturers and sometimes do not reflect their fundamental functions intuitively. Operational conditions and control procedures also vary across the selected models under this study. Due to this lack of consensus across the industry, drivers are not aware or well informed about ADAS functions in their vehicles, leading to a very low utilization rate and may lead to misuse of those functions. This paper provides insightful suggestions for the transport industry, Artificial Intelligence (AI) experts, and regulators to design frameworks and guidelines in governing the naming convention, operating conditions, control procedures, and information disclosure of ADAS. Such guidelines can be the foundations for regulating future AI-based self-driving functions. (shrink)

Job seekers find themselves increasingly duped and misled by fraudulent job advertisements, posing a threat to their privacy, security and well-being. There is a clear need for solutions that can protect innocent job seekers. Existing approaches to detecting fraudulent jobs do not scale well, function like a black-box, and lack interpretability, which is essential to guide applicants’ decision-making. Moreover, commonly used lexical features may be insufficient as the representation does not capture contextual semantics of the underlying document. Hence, this paper (...) explores to what extent different categorizations of fraudulent jobs can be classified. In addition, this paper seeks to find what type of features are most relevant in classifying the type of fraudulent job. In this paper, we develop and validate a machine learning system for identifying identity theft, corporate identity theft and multi-level marketing amongst fraudulent job advertisements. We utilized four classes of features: empirical rule set-based features, bag-of-word models, most recent state-of-the-art word embeddings and transformer models for various machine learning classifiers. The machine learning models were validated by evaluating them on a publicly available job description dataset. Our results indicate that the word embeddings and transformer-based features consistently outperformed the handcrafted rule-set based features class. Ultimately, a Gradient Boosting classifier with a combination of empirical rule-set based features, parts-of-speech tags and bag-of-words vectors achieved the best performance with an F1-score of 0.88. (shrink)

Cultural influences are pervasive throughout human behaviour, and as human–robot interactions become more common, roboticists are increasingly focusing attention on how to build robots that are culturally competent and culturally sustainable. The current treatment of culture in robotics, however, is largely limited to the definition of culture as national culture. This is problematic for three reasons: it ignores subcultures, it loses specificity and hides the nuances in cultures, and it excludes refugees and stateless persons. We propose to shift the focus (...) of cultural robotics to redefine culture as an emergent phenomenon. We make use of three research programmes in the social and cognitive sciences to justify this definition. Consequently, cultural behaviour cannot be explicitly programmed into a robot, rather, a robot must be designed with the capability to participate in the interactions that lead to the arising of cultural behaviour. In the final part of the paper, we explore which capacities and abilities are the most salient for a robot to do this. (shrink)

Strategies for improving the explainability of artificial agents are a key approach to support the understandability of artificial agents’ decision-making processes and their trustworthiness. However, since explanations are not inclined to standardization, finding solutions that fit the algorithmic-based decision-making processes of artificial agents poses a compelling challenge. This paper addresses the concept of trust in relation to complementary aspects that play a role in interpersonal and human–agent relationships, such as users’ confidence and their perception of artificial agents’ reliability. Particularly, this (...) paper focuses on non-expert users’ perspectives, since users with little technical knowledge are likely to benefit the most from “post-hoc”, everyday explanations. Drawing upon the explainable AI and social sciences literature, this paper investigates how artificial agent’s explainability and trust are interrelated at different stages of an interaction. Specifically, the possibility of implementing explainability as a trust building, trust maintenance and restoration strategy is investigated. To this extent, the paper identifies and discusses the intrinsic limits and fundamental features of explanations, such as structural qualities and communication strategies. Accordingly, this paper contributes to the debate by providing recommendations on how to maximize the effectiveness of explanations for supporting non-expert users’ understanding and trust. (shrink)

The justification and rationality of this paper is to present some fundamental principles, theories, and concepts that we believe moulds the nucleus of a good artificial intelligence (AI) society. The morally accepted significance and utilitarian concerns that stems from the inception and realisation of an AI’s structural foundation are displayed in this study. This paper scrutinises the structural foundation, fundamentals, and cardinal righteous remonstrations, as well as the gaps in mechanisms towards novel prospects and perils in determining resilient fundamentals, accountability, (...) and AI’s convoluted and responsible implications. We outline a number of salient and practical benefits, in which to place moral norms within the mise en scène of AI, to delineate the rudimentary ethical dilemmas and decorous directions within the realms of AI. (shrink)

From Curriculum Vitae parsing to web search and recommendation systems, Word2Vec and other word embedding techniques have an increasing presence in everyday interactions in human society. Biases, such as gender bias, have been thoroughly researched and evidenced to be present in word embeddings. Most of the research focuses on discovering and mitigating gender bias within the frames of the vector space itself. Nevertheless, whose bias is reflected in word embeddings has not yet been investigated. Besides discovering and mitigating gender bias, (...) it is also important to examine whether a feminine or a masculine-centric view is represented in the biases of word embeddings. This way, we will not only gain more insight into the origins of the before mentioned biases, but also present a novel approach to investigating biases in Natural Language Processing systems. Based on previous research in the social sciences and gender studies, we hypothesize that masculine-centric, otherwise known as androcentric, biases are dominant in word embeddings. To test this hypothesis we used the largest English word association test data set publicly available. We compare the distance of the responses of male and female participants to cue words in a word embedding vector space. We found that the word embedding is biased towards a masculine-centric viewpoint, predominantly reflecting the worldviews of the male participants in the word association test data set. Therefore, by conducting this research, we aimed to unravel another layer of bias to be considered when examining fairness in algorithms. (shrink)

This article aims to present the problem of the impact of artificial intelligence on respect for human dignity in the sphere of care for people who, for various reasons, are described as particularly vulnerable, especially seniors and people with various disabilities. In recent years, various initiatives and works have been undertaken on the European scene to define the directions in which the development and use of artificial intelligence should go. According to the human-centric approach, artificial intelligence should be developed, used (...) and monitored with people in mind, their needs and rights. It is artificial intelligence that should adapt to the rules set by people, not the other way around. The source of all human rights and freedoms is respect for human dignity. This is evidenced by numerous European, international, national regulations and documents. Respecting this value is also one of the works on the AI development. One of the areas of our life into which AI enters more and more boldly and which in the near future, due to demographic reasons and aging population, may be almost dominated by modern technologies, is the medical and care system. The usefulness of industrial co-robots made us think about the possibility of using similar devices in the non-industrial sphere, including in the sphere of care, nursing and therapy. Actually, despite the impressive development of technology and AI, intelligent robots/devices used for care, nursing or therapy (so-called care/nursing or therapy robots) perform rather simple activities. They provide information, navigate, bring something and give it (e.g. medicines, food), help to get up. They are an important support for medical staff in this respect. Performing tasks that are more complex in terms of technology and movement, such as feeding, washing, intimate hygiene, dressing or undressing, is still beyond the reach of the currently used robots. The question we must ask ourselves is whether, in the future, care robots will be able to perform such tasks, and should they do so? Will this lead to the replacement of human medical personnel in the performance of the above-mentioned activities with such robots. Would anyone want to be "looked after" by a soulless machine? Should potential wards/patients, in other words all of us in fact, have the right to object to being taken into the care of an intelligent robot? There is no doubt that intelligent robots have great potential, especially when it comes to ensuring or maintaining the independence or mobility of people with various health limitations. However, we must not forget about the risks and dangers they may generate. Even a simple robot generates serious legal and ethical problems. Who should be liable for damage caused in connection with improper care performed with the participation of a robot? Robots based on AI systems are able to collect a significant amount of sensitive data, for example through the face and speech recognition function. There is considerable scope for abuse in this area, not only in terms of personal data protection but also in terms of informational self-determination, privacy and dignity. Bearing in mind the above risks, the creation of a new right to object to being looked after by a robot should be considered. (shrink)

We are moving towards a future where Artificial Intelligence (AI) based agents make many decisions on behalf of humans. From healthcare decision-making to social media censoring, these agents face problems, and make decisions with ethical and societal implications. Ethical behaviour is a critical characteristic that we would like in a human-centric AI. A common observation in human-centric industries, like the service industry and healthcare, is that their professionals tend to break rules, if necessary, for pro-social reasons. This behaviour among humans (...) is defined as pro-social rule breaking. To make AI agents more human-centric, we argue that there is a need for a mechanism that helps AI agents identify when to break rules set by their designers. To understand when AI agents need to break rules, we examine the conditions under which humans break rules for pro-social reasons. In this paper, we present a study that introduces a ‘vaccination strategy dilemma’ to human participants and analyzes their response. In this dilemma, one needs to decide whether they would distribute COVID-19 vaccines only to members of a high-risk group (follow the enforced rule) or, in selected cases, administer the vaccine to a few social influencers (break the rule), which might yield an overall greater benefit to society. The results of the empirical study suggest a relationship between stakeholder utilities and pro-social rule breaking (PSRB), which neither deontological nor utilitarian ethics completely explain. Finally, the paper discusses the design characteristics of an ethical agent capable of PSRB and the future research directions on PSRB in the AI realm. We hope that this will inform the design of future AI agents, and their decision-making behaviour. (shrink)

Deepening and digging into the social side of AI is a novel but emerging requirement within the AI community. Future research should invest in an “AI for people”, going beyond the undoubtedly much-needed efforts into ethics, explainability and responsible AI. The article addresses this challenge by problematizing the discussion around AI shifting the attention to individuals and their awareness, knowledge and emotional response to AI. First, we outline our main argument relative to the need for a socio-technical perspective in the (...) study of AI social implications. Then, we illustrate the main existing narratives of hopes and fears associated with AI and robots. As building blocks of broader “sociotechnical imaginaries”, narratives are powerful tools that shape how society sees, interprets and organizes technology. An original empirical study within the University of Bologna collects the data to examine the levels of awareness, knowledge and emotional response towards AI, revealing interesting insights to be carried on in future research. Replete with exaggerations, both utopian and dystopian narratives are analysed with respect to some relevant socio-demographic variables (gender, generation and competence). Finally, focusing on two issues—the state of AI anxiety and the point of view of non-experts—opens the floor to problematizing the discourse around AI, sustaining the need for a sociological perspective in the field of AI and discussing future comparative research. (shrink)

For humans, Artificial Intelligence operates more like a Rorschach test, as it is expected that intelligent machines will reflect humans' cognitive and physical behaviours. The concept of intelligence, however, is often confused with consciousness, and it is believed that the progress of intelligent machines will eventually result in them becoming conscious in the future. Nevertheless, what is overlooked is how the exploration of Artificial Intelligence also pertains to the development of human consciousness. An excellent example of this can be seen (...) in the film Being John Malkovich (1999). In the film, different characters have their perceptions altered as a result of hacking into the mind of John Malkovich, which produces sensations that may have remained hidden to their consciousness due to their dis-abilities. This article engages with the research question: Can the symbiotic relationship between humans and machines trigger an artificial consciousness for humans? An artificially created consciousness is the premise that a machine can generate knowledge about an individual that is not already present in the person. For the same purpose, the article takes the cinematic text Being John Malkovich by Spike Jonze for exploring concepts such as human/robot rights, virtual sex, virtual rape, and bodily disability, which are essential topics in the midst of increasing human- Artificial Intelligence interaction. The purpose of this article is to contribute towards the creation of a better understanding of Artificial Intelligence, particularly from the perspective of film studies and philosophy, by highlighting the potential of Artificial Intelligence as a vessel for exploring human consciousness. (shrink)

This paper offers three contributions to the burgeoning movements of AI for Social Good (AI4SG) and AI and the United Nations Sustainable Development Goals (SDGs). First, we introduce the SDG-Intense Evaluation framework (SDGIE) that aims to situate variegated automated/AI models in a larger ecosystem of computational approaches to advance the SDGs. To foster knowledge collaboration for solving complex social and environmental problems encompassed by the SDGs, the SDGIE framework details a benchmark structure of data-algorithm-output to effectively standardize AI approaches to (...) the SDGs. Second, as a specific instantiation of the SDGIE framework, the SDG Impact Intensity Model (SDGIIM) is theoretically and operationally established. SDGIIM embeds expert decision-making and SDG keyword banks in textual data processing to determine overall SDG “impact intensity.” Ideally, SDGIIM can be applied to textual data sets from any sector or discipline: academia, business, government, non-profit, civil society, etc. Third, the SDGIIM instantiation is applied to the specific domain of academic journal rating systems as a case study. Traditionally, academic journals have been evaluated on loosely conceived and empirically shaky notions of ‘quality.’ Aligned with the trend of AI4SG and broader calls to action, ‘impact’ is rapidly becoming the primary normative consideration for assessing academic journals. We hypothesize and demonstrate that SDGIIM is capable of producing evaluations aligned with experts’ expectations of SDG impact intensity; the consistent analysis and rating of textual data sets that embody the SDGs with varying degrees of meaning and, ultimately, promote positive impact on the actual material conditions of the world. (shrink)

In the last few years, we have witnessed a surge in scholarly interest and scientific evidence of how algorithms can produce discriminatory outcomes, especially with regard to gender and race. However, the analysis of fairness and bias in AI, important for the debate of AI for social good, has paid insufficient attention to the category of age and older people. Ageing populations have been largely neglected during the turn to digitality and AI. In this article, the concept of AI ageism (...) is presented to make a theoretical contribution to how the understanding of inclusion and exclusion within the field of AI can be expanded to include the category of age. AI ageism can be defined as practices and ideologies operating within the field of AI, which exclude, discriminate, or neglect the interests, experiences, and needs of older population and can be manifested in five interconnected forms: (1) age biases in algorithms and datasets (technical level), (2) age stereotypes, prejudices and ideologies of actors in AI (individual level), (3) invisibility of old age in discourses on AI (discourse level), (4) discriminatory effects of use of AI technology on different age groups (group level), (5) exclusion as users of AI technology, services and products (user level). Additionally, the paper provides empirical illustrations of the way ageism operates in these five forms. (shrink)

This Open Forum contribution critically interrogates the use of space race rhetoric in current discussions about artificial intelligence (AI). According to this rhetoric, similar to the space race of the twentieth century, AI development is portrayed as a rivalry among superpowers where one country will win and reap major benefits, while others will be left behind. Using this rhetoric to frame AI development tends to prioritize narrow and short-term economic interests over broader and longer-term societal needs. Three particularly problematic aspects (...) of using space race narrative in AI discussions are highlighted: first, perceiving technology development globally as a zero-sum game; second, pressuring governments to regulate less; and third, prioritising high technologies over social issues. This contribution invites to challenge underlying political assumptions of the AI space race discourse and to open up conversations about alternative futures. (shrink)

AI for social good is a thriving research topic and a frequently declared goal of AI strategies and regulation. This article investigates the requirements necessary in order for AI to actually serve a public interest, and hence be socially good. The authors propose shifting the focus of the discourse towards democratic governance processes when developing and deploying AI systems. The article draws from the rich history of public interest theory in political philosophy and law, and develops a framework for ‘public (...) interest AI’. The framework consists of (1) public justification for the AI system, (2) an emphasis on equality, (3) deliberation/ co-design process, (4) technical safeguards, and (5) openness to validation. This framework is then applied to two case studies, namely SyRI, the Dutch welfare fraud detection project, and UNICEF’s Project Connect, that maps schools worldwide. Through the analysis of these cases, the authors conclude that public interest is a helpful and practical guide for the development and governance of AI for the people. (shrink)

Throughout Mary Shelley’s early life, she was exposed to numerous well-known and influential people regarding cultural, political, and socio-economic matters. As she began writing, these influences undoubtedly played a role in her narrative. Her novel, _Frankenstein_, written during the time of the first Industrial Revolution in Britain, was one such novel that exhibited her political and economic influences through science fiction. This article addresses many of those influences, including the introduction of the machine into manufacturing. It further addresses how Frankenstein’s (...) Monster may have been one of the first created forms of artificial intelligence (AI). We further expound upon many economic concepts that have persisted through time and are relevant today given the faciliatory aspects, as well as the uncertainty, of AI. We relate these through the literary piece _Frankenstein_ to explore how a two-century-year-old tale provides a blueprint for understanding the conflict among humans and machines and provides a roadmap for harmonization in the past, present, and future. (shrink)

About three decades ago, AI theory underwent a sharp turn as a consequence of criticism that pointed out the problem of externalism in the cognitivist position. Hubert Dreyfus, undoubtedly the main exponent of this criticism, opened the possibility of a Heideggerian reading using the frame problem to bring to light obscurities that otherwise would have been very difficult to detect. However, the question still remains of whether or not Heidegger’s philosophy can serve as the source of a positive contribution to (...) AI. In this paper, we argue that in the small measure in which such a task has been attempted, its orientation has been hampered by the omission of what, for Heidegger, was the central issue to be pondered: the question for being and the ontological difference. To propose a possible direction in which AI can be headed as a consequence of this novel perspective, we undertake a brief and schematic review of two published projects suggesting that they both manage to avoid the frame problem and also bear this Heideggerian outlook. (shrink)

This paper traces the empiricist program from early debates between nativism and behaviorism within philosophy, through debates about early connectionist approaches within the cognitive sciences, and up to their recent iterations within the domain of deep learning. We demonstrate how current debates on the nature of cognition via deep network architecture echo some of the core issues from the Chomsky/Quine debate and investigate the strength of support offered by these various lines of research to the empiricist standpoint. Referencing literature from (...) both computer science and philosophy, we conclude that the current state of deep learning does not offer strong encouragement to the empiricist side despite some arguments to the contrary. (shrink)

In this article, we analyse the role that artificial intelligence (AI) could play, and is playing, to combat global climate change. We identify two crucial opportunities that AI offers in this domain: it can help improve and expand current understanding of climate change, and it can contribute to combatting the climate crisis effectively. However, the development of AI also raises two sets of problems when considering climate change: the possible exacerbation of social and ethical challenges already associated with AI, and (...) the contribution to climate change of the greenhouse gases emitted by training data and computation-intensive AI systems. We assess the carbon footprint of AI research, and the factors that influence AI’s greenhouse gas (GHG) emissions in this domain. We find that the carbon footprint of AI research may be significant and highlight the need for more evidence concerning the trade-off between the GHG emissions generated by AI research and the energy and resource efficiency gains that AI can offer. In light of our analysis, we argue that leveraging the opportunities offered by AI for global climate change whilst limiting its risks is a gambit which requires responsive, evidence-based, and effective governance to become a winning strategy. We conclude by identifying the European Union as being especially well-placed to play a leading role in this policy response and provide 13 recommendations that are designed to identify and harness the opportunities of AI for combatting climate change, while reducing its impact on the environment. (shrink)

The purpose of this study is to investigate the relationship between a firm’s strategy and consumers’ decisions in the presence of the paradox of choice and sharing personal information. The paradox of choice implies that having too many choices does not necessarily ensure happiness and sometimes having less is more. A new model is constructed introducing a factor of information sharing into the model of a previous study that embedded the paradox of choice only (Kinjo and Ebina in AI Soc (...) 30(2):291–297, 2015). A key feature of the model is its disutility function. It is demonstrated that if the sign of the cross derivative of the function is positive (negative) at the optimum, there is a positive (negative) correlation between the degree of sharing personal information chosen by the consumers and the number of products offered by the firm in its recommendation systems. It is also numerically indicated that the profit function of the firm becomes convex or concave depending on the shape of the disutility function. These results suggest that firms should carefully investigate the shape of the disutility function, under the paradox of choice and sharing personal information. (shrink)

Policymakers need to start considering the impact smart connected toys (SCTs) have on children. Equipped with sensors, data processing capacities, and connectivity, SCTs targeting children increasingly penetrate pervasively personal environments. The network of SCTs forms the Internet of Toys (IoToys) and often increases children's engagement and playtime experience. Unfortunately, this young part of the population and, most of the time, their parents are often unaware of SCTs’ far-reaching capacities and limitations. The capabilities and constraints of SCTs create severe side effects (...) at the technical, individual, and societal level. These side effects are often unforeseeable and unexpected. They arise from the technology's use and the interconnected nature of the IoToys, without necessarily involving malevolence from their creators. Although existing regulations and new ethical guidelines for artificial intelligence provide remedies to address some of the side effects, policymakers did not develop these redress mechanisms having children and SCTs in mind. This article provides an analysis of the arising side effects of SCTs and contrasts them with current regulatory redress mechanisms. We thereby highlight misfits and needs for further policymaking efforts. (shrink)

Law and the legal system through which law is effected are very powerful, yet the power of the law has always been limited by the laws of nature, upon which the law has now direct grip. Human law now faces an unprecedented challenge, the emergence of a second limit on its grip, a new “species” of intelligent agents (AI machines) that can perform cognitive tasks that until recently only humans could. What happens, as a matter of law, when another species (...) interacts with us, can be integrated into human minds and bodies, makes “real-world” decisions—not through human proxies, but directly—and does all this “intelligently”, with what one could call autonomous agency or even a “mind” of its own? The article starts from the clear premise that control cannot be exercised directly on AI machines through human law. That control can only be effected through laws that apply to humans. This has several regulatory implications. The article’s first discusses what, in any attempt to regulate AI machines, the law can achieve. Having identified what the law can do, the article then canvases what the law should aim to achieve overall. The article encapsulate its analysis in a list of both doctrinal and normative principles that should underpin any regulation aimed at AI machines. Finally, the article compares three transnational options to implement the proposed regulatory approach. (shrink)

Industry involvement in the machine learning (ML) community seems to be increasing. However, the quantitative scale and ethical implications of this influence are rather unknown. For this purpose, we have not only carried out an informed ethical analysis of the field, but have inspected all papers of the main ML conferences NeurIPS, CVPR, and ICML of the last 5 years—almost 11,000 papers in total. Our statistical approach focuses on conflicts of interest, innovation, and gender equality. We have obtained four main (...) findings. (1) Academic–corporate collaborations are growing in numbers. At the same time, we found that conflicts of interest are rarely disclosed. (2) Industry papers amply mention terms that relate to particular trending machine learning topics earlier than academia does. (3) Industry papers are not lagging behind academic papers with regard to how often they mention keywords that are proxies for social impact considerations. (4) Finally, we demonstrate that industry papers fall short of their academic counterparts with respect to the ratio of gender diversity. We believe that this work is a starting point for an informed debate within and outside of the ML community. (shrink)

In the face of massively increased technological complexity, it is striking that so many of today’s computational and networked things follow design ideals honed decades ago in a much different context. These strong ideals prescribe a presentation of things as useful tools through design and a withdrawal of aspects of their functionality and complexity. Beginning in the mid-twentieth century, we trace this ‘withdrawal program’ as it has persisted in the face of increasing computational complexity. Currently, design is in a dilemma (...) where computational products can be seen as brilliantly designed and engaging to use yet can also be considered very problematic in how they support hidden agendas and often seem less than trustworthy. In this article, we analyse factors shaping this emergent ethical dilemma and reveal the concept of _a widening rift_ between what computational _things actually are and do_ and _the ways in which they are presented as things for use_. Against this backdrop, we argue that there is a need for a new orientation in design programs to adequately address this deepening rupture between the aesthetics and ethics in the design of computational things. (shrink)

Science-fiction (SF) has become a reference point in the discourse on the ethics and risks surrounding artificial intelligence (AI). Thus, AI in SF—science-fictional AI—is considered part of a larger corpus of ‘AI narratives’ that are analysed as shaping the fears and hopes of the technology. SF, however, is not a foresight or technology assessment, but tells dramas for a human audience. To make the drama work, AI is often portrayed as human-like or autonomous, regardless of the actual technological limitations. Taking (...) science-fictional AI too literally, and even applying it to science communication, paints a distorted image of the technology's current potential and distracts from the real-world implications and risks of AI. These risks are not about humanoid robots or conscious machines, but about the scoring, nudging, discrimination, exploitation, and surveillance of humans by AI technologies through governments and corporations. AI in SF, on the other hand, is a trope as part of a genre-specific mega-text that is better understood as a dramatic means and metaphor to reflect on the human condition and socio-political issues beyond technology. (shrink)

This paper addresses the gap between familiar popular narratives describing Artificial Intelligence (AI), such as the trope of the killer robot, and the realistic near-future implications of machine intelligence and automation for technology policy and society. The authors conducted a series of interviews with technologists, science fiction writers, and other experts, as well as a workshop, to identify a set of key themes relevant to the near future of AI. In parallel, they led the analysis of almost 100 recent works (...) of science fiction stories with AI themes to develop a preliminary taxonomy of AI in science fiction. These activities informed the commissioning of six original works of science fiction and non-fiction response essays on the themes of “intelligence” and “justice” that were published as part of the Slate Future Tense Fiction series in 2019 and 2020. Our findings indicate that artificial intelligence remains deeply ambiguous both in the policy and cultural contexts: we struggle to define the boundaries and the agency of machine intelligence, and consequently find it difficult to govern or interact with such systems. However, our findings also suggest more productive avenues of inquiry and framing that could foster both better policy and better narratives around AI. (shrink)

With the development of increasingly sophisticated sociable robots, robot-human relationships are being transformed. Not only can sociable robots furnish emotional support and companionship for humans, humans can also form relationships with robots that they value highly. It is natural to ask, do robots that stand in close relationships with us have any moral standing over and above their purely instrumental value as means to human ends. We might ask our question this way, ‘Are there ways we can act towards robots (...) that would be wrong to the robot?’ To address this, Part I lays out standard approaches to moral standing: appealing to intrinsic properties, human responses, and values inhering in relationships. Part II explores the third, relational strategy in detail. Looking beyond Western analyses, it considers Eastern philosophy and the environmental philosophy of 'deep ecology' and extends these approaches to sociable robots. Part III examines practical implications for the case of Samantha, a sex robot that was allegedly raped. Part IV identifies and replies to objections. (shrink)

The squared paper or graphs are grid-based design representations used in engineering, industrial and craft design practices wherein designs are drawn over symmetrical grids. This paper reports grid-processing strategies undertaken by actors in a native craft practice, viz. Kashmiri carpet-weaving having three task contexts: (1) _design_, wherein designs are drawn on graph sheets and color scheme given by assigning practice-specific symbolic codes to the motifs by designers; (2) _coding_, wherein a cryptic script, called _talim_, is generated from these encoded graphs (...) by talim-writers; and (3) _weaving_, wherein this script is read, decoded and communicated in an equally cryptic trade-language by weavers among their teams. 32 video-recorded think-aloud sessions were conducted with talim-writers to understand their graph-processing and resultant coding strategies. The observations and qualitative analysis of transcripts revealed highly _situated_ strategies undertaken by experts keen on imbibing visuality of design embedded in the grids, in contrast to _embodied_ strategies undertaken by less-experienced coders keen on processing grids’ structural features and getting overwhelmed by grid-clutter in the process. In this landscape, the findings revealed a negotiated nature of errors instead of being deviations from the underlying grid and thereby objectively assessable. The paper makes recommendations for CAD systems to include more of those grid features exploited by experts during their graph processing to facilitate designers. (shrink)

Artificial intelligence is likely to undermine the anthropocentrism of humanism, the master narrative that undergirds the modern world. Humanity will need a new story to structure our beliefs and cooperation around. As different regions explore posthumanist alternatives through fiction, they bring with them distinct traditions of thought. The Swedish TV series _Real Humans_ (2012–2014) and its British remake, _Humans_ (2015–2018), dramatize the challenge of freeing oneself from cultural presumptions. When negotiating personhood with humanoid robots, the Swedish protagonist family presupposes a (...) social-democratic ethos, which is a trace of Scandinavian humanism that carries into the family’s posthumanist beliefs. Using Heideggerian and related perspectives, I analyze these series to make a case for a _dataist_ ontology with potential to re-enchant the modern world and bring forth a new epoch of being. Such a master narrative of _algorithmic universality_ could be facilitated by a new level of interconnectedness made possible by AI. This ontology fulfills the requirements of Robbins and Horta (Introduction, Cosmopolitanisms. New York University Press, New York, pp 1–17, 2017) who call for a cosmopolitanism of inclusivity with room for overlapping conceptions to remedy our present era’s international dysfunction. The Swedish and British TV series suggest that even if humanity’s uniting around a dataist master narrative were to be driven by intercultural competition, the decisive choice might be out of human hands. Paradoxically, such disempowering in terms of agency is portrayed as necessary for human _re-enchantment_. (shrink)

Biometric technologies are becoming more pervasive in the workplace, augmenting managerial processes such as hiring, monitoring and terminating employees. Until recently, these devices consisted mainly of GPS tools that track location, software that scrutinizes browser activity and keyboard strokes, and heat/motion sensors that monitor workstation presence. Today, however, a new generation of biometric devices has emerged that can sense, read, monitor and evaluate the affective state of a worker. More popularly known by its commercial moniker, Emotional AI, the technology stems (...) from advancements in affective computing. But whereas previous generations of biometric monitoring targeted the exterior physical body of the worker, concurrent with the writings of Foucault and Hardt, we argue that emotion-recognition tools signal a far more invasive disciplinary gaze that exposes and makes vulnerable the inner regions of the worker-self. Our paper explores attitudes towards empathic surveillance by analyzing a survey of 1015 responses of future job-seekers from 48 countries with Bayesian statistics. Our findings reveal affect tools, left unregulated in the workplace, may lead to heightened stress and anxiety among disadvantaged ethnicities, gender and income class. We also discuss a stark cross-cultural discrepancy whereby East Asians, compared to Western subjects, are more likely to profess a trusting attitude toward EAI-enabled automated management. While this emerging technology is driven by neoliberal incentives to optimize the worksite and increase productivity, ultimately, empathic surveillance may create more problems in terms of algorithmic bias, opaque decisionism, and the erosion of employment relations. Thus, this paper nuances and extends emerging literature on emotion-sensing technologies in the workplace, particularly through its highly original cross-cultural study. (shrink)

The societal and ethical implications of artificial intelligence (AI) have sparked discussions among academics, policymakers and the public around the world. What has gone unnoticed so far are the likewise vibrant discussions in China. We analyzed a large sample of discussions about AI ethics on two Chinese social media platforms. Findings suggest that participants were diverse, and included scholars, IT industry actors, journalists, and members of the general public. They addressed a broad range of concerns associated with the application of (...) AI in various fields. Some even gave recommendations on how to tackle these issues. We argue that these discussions are a valuable source for understanding the future trajectory of AI development in China as well as implications for global dialogue on AI governance. (shrink)

Organisations increasingly use automated decision-making systems (ADMS) to inform decisions that affect humans and their environment. While the use of ADMS can improve the accuracy and efficiency of decision-making processes, it is also coupled with ethical challenges. Unfortunately, the governance mechanisms currently used to oversee human decision-making often fail when applied to ADMS. In previous work, we proposed that ethics-based auditing (EBA)—that is, a structured process by which ADMS are assessed for consistency with relevant principles or norms—can (a) help organisations (...) verify claims about their ADMS and (b) provide decision-subjects with justifications for the outputs produced by ADMS. In this article, we outline the conditions under which EBA procedures can be feasible and effective in practice. First, we argue that EBA is best understood as a ‘soft’ yet ‘formal’ governance mechanism. This implies that the main responsibility of auditors should be to spark ethical deliberation at key intervention points throughout the software development process and ensure that there is sufficient documentation to respond to potential inquiries. Second, we frame AMDS as parts of larger sociotechnical systems to demonstrate that to be feasible and effective, EBA procedures must link to intervention points that span all levels of organisational governance and all phases of the software lifecycle. The main function of EBA should, therefore, be to inform, formalise, assess, and interlink existing governance structures. Finally, we discuss the policy implications of our findings. To support the emergence of feasible and effective EBA procedures, policymakers and regulators could provide standardised reporting formats, facilitate knowledge exchange, provide guidance on how to resolve normative tensions, and create an independent body to oversee EBA of ADMS. (shrink)

To assess—from a qualitative perspective—the perceptions and attitudes of Spanish rehabilitation professionals (e.g. rehabilitation doctors, speech therapists, physical therapists) about Brain–Computer Interface (BCI) technology. A qualitative, exploratory and descriptive study was carried out by means of interviews and analysis of textual content with mixed generation of categories and segmentation into frequency of topics. We present the results of three in-depth interviews that were conducted with Spanish speaking individuals who had previously completed a survey as part of a larger, 3-country/language, survey (...) on BCI perceptions. 11 out of 15 of these Spanish respondents (survey) either strongly or somewhat accept the use of BCI in rehabilitation therapy. However, the results of our three in-depth interviews show how, due to a strong inertia of attitudes and perceptions about BCI technology, most professionals feel reluctant to use BCI technology in their daily practice (interview). (shrink)

By mid-2019 there were more than 80 AI ethics guides available in the public domain. Despite this, 2020 saw numerous news stories break related to ethically questionable uses of AI. In part, this is because AI ethics theory remains highly abstract, and of limited practical applicability to those actually responsible for designing algorithms and AI systems. Our previous research sought to start closing this gap between the ‘what’ and the ‘how’ of AI ethics through the creation of a searchable typology (...) of tools and methods designed to translate between the five most common AI ethics principles and implementable design practices. Whilst a useful starting point, that research rested on the assumption that _all_ AI practitioners are aware of the ethical implications of AI, understand their importance, and are actively seeking to respond to them. In reality, it is unclear whether this is the case. It is this limitation that we seek to overcome here by conducting a mixed-methods qualitative analysis to answer the following four questions: what do AI practitioners understand about the need to translate ethical principles into practice? What motivates AI practitioners to embed ethical principles into design practices? What barriers do AI practitioners face when attempting to translate ethical principles into practice? And finally, what assistance do AI practitioners want and need when translating ethical principles into practice? (shrink)

With the increased use of Artificial Intelligence (AI) in wildlife conservation, issues around whether AI-based monitoring tools in wildlife conservation comply with standards regarding AI Ethics are on the rise. This review aims to summarise current debates and identify gaps as well as suggest future research by investigating (1) current AI Ethics and AI Ethics issues in wildlife conservation, (2) Initiatives Stakeholders in AI for wildlife conservation should consider integrating AI Ethics in wildlife conservation. We find that the existing literature (...) weakly focuses on AI Ethics and AI Ethics in wildlife conservation while at the same time ignores AI Ethics integration in AI systems for wildlife conservation. This paper formulates an ethically aligned AI system framework and discusses pre-eminent on-demand AI systems in wildlife conservation. The proposed framework uses agile software life cycle methodology to implement guidelines towards the ethical upgrade of any existing AI system or the development of any new ethically aligned AI system. The guidelines enforce, among others, the minimisation of intentional harm and bias, diversity in data collection, design compliance, auditing of all activities in the framework and ease of code inspection. This framework will inform AI developers, users, conservationists, and policymakers on what to consider when integrating AI Ethics into AI-based systems for wildlife conservation. (shrink)

Posthumanism is one of the well-known and significant concepts in the present day. It impacted numerous contemporary fields like philosophy, literary theories, art, and culture for the last few decades. The movement has been concentrated around the technological development of present days due to industrial advancement in society and the current proliferated daily usage of technology. Posthumanism indicated a deconstruction of our radical conception of ‘human’, and it further shifts our societal value alignment system to a novel dimension. The majority (...) of our population is getting deeply involved in virtual reality in daily life. Sooner or later, we shall get a different conception of ‘biological human being’ through the advancement of artificial intelligence (AI) technology. If an automated artificial system could replace the human brain and repair any physical loss of our biological body, it will certainly become a journey towards immortality for scientists. However, we must analyze whether posthumanism will consider ‘hybrid human beings’ as moral agents, similar to biological humans. This is why, in the future, the relation between biological human beings and posthumans will play an active role in designing artificial moral agents. Whether the future posthumans would overpower biological humanity or both of them would work as peers to form a digital utopian society and create new dimensions of rationality is still a case of anticipation. Our aim in this paper is to critically analyze the authenticity of the posthuman cyborg as an agent, their relations with humans and the emergence of ‘AI ethics’. (shrink)

The possibility of AI consciousness depends much on the correct answer to the mind–body problem: how our materialistic brain generates subjective consciousness? If a materialistic answer is valid, machine consciousness must be possible, at least in principle, though the actual instantiation of consciousness may still take a very long time. If a non-materialistic one (either mentalist or dualist) is valid, machine consciousness is much less likely, perhaps impossible, as some mental element may also be required. Some recent advances in neurology (...) (despite the separation of the two hemispheres, our brain as a whole is still able to produce only one conscious agent; the negation of the absence of a free will, previously thought to be established by the Libet experiments) and many results of parapsychology (on medium communications, memories of past lives, near-death experiences) suggestive of survival after our biological death, strongly support the non-materialistic position and hence the much lower likelihood of AI consciousness. Instead of being concern about AI turning conscious and machine ethics, and trying to instantiate AI consciousness soon, we should perhaps focus more on making AI less costly and more useful to society. (shrink)

Big data and Machine learning Techniques are reshaping the way in which food safety risk assessment is conducted. The ongoing ‘datafication’ of food safety risk assessment activities and the progressive deployment of probabilistic models in their practices requires a discussion on the advantages and disadvantages of these advances. In particular, the low level of trust in EU food safety risk assessment framework highlighted in 2019 by an EU-funded survey could be exacerbated by novel methods of analysis. The variety of processed (...) data raises unique questions regarding the interplay of multiple regulatory systems alongside food safety legislation. Provisions aiming to preserve the confidentiality of data and protect personal information are juxtaposed to norms prescribing the public disclosure of scientific information. This research is intended to provide guidance for data governance and data ownership issues that unfold from the ongoing transformation of the technical and legal domains of food safety risk assessment. Following the reconstruction of technological advances in data collection and analysis and the description of recent amendments to food safety legislation, emerging concerns are discussed in light of the individual, collective and social implications of the deployment of cutting-edge Big Data collection and analysis techniques. Then, a set of principle-based recommendations is proposed by adapting high-level principles enshrined in institutional documents about Artificial Intelligence to the realm of food safety risk assessment. The proposed set of recommendations adopts Safety, Accountability, Fairness, Explainability, Transparency as core principles (SAFETY), whereas Privacy and data protection are used as a meta-principle. (shrink)

We motivate the desire for self-driving and explain its potential and limitations, and explore the need for—and potential implementation of—morals, ethics, and other value systems as complementary “capabilities” to the Deep Technologies behind self-driving. We consider how the incorporation of such systems may drive or slow adoption of high automation within vehicles. First, we explore the role for morals, ethics, and other value systems in self-driving through a representative hypothetical dilemma faced by a self-driving car. Through the lens of engineering, (...) we explain in simple terms common moral and ethical frameworks including utilitarianism, deontology, and virtue ethics before characterizing their relationship to the fundamental algorithms enabling self-driving. The concepts of behavior cloning, state-based modeling, and reinforcement learning are introduced, with some algorithms being more suitable for the implementation of value systems than others. We touch upon the contemporary cross-disciplinary landscape of morals and ethics in self-driving systems from a joint philosophical and technical perspective, and close with considerations for practitioners and the public, particularly as individuals may not appreciate the nuance and complexity of using imperfect information to navigate diverse scenarios and tough-to-quantify value systems, while “typical” software development reduces complex problems to black and white decision-making. (shrink)

We examine Van Wynsberghe and Robbins (JAMA 25:719-735, 2019) critique of the need for Artificial Moral Agents (AMAs) and its rebuttal by Formosa and Ryan (JAMA 10.1007/s00146-020-01089-6, 2020) set against a neo-Aristotelian ethical background. Neither Van Wynsberghe and Robbins (JAMA 25:719-735, 2019) essay nor Formosa and Ryan’s (JAMA 10.1007/s00146-020-01089-6, 2020) is explicitly framed within the teachings of a specific ethical school. The former appeals to the lack of “both empirical and intuitive support” (Van Wynsberghe and Robbins 2019, p. 721) for (...) AMAs, and the latter opts for “argumentative breadth over depth”, meaning to provide “the essential groundwork for making an all things considered judgment regarding the moral case for building AMAs” (Formosa and Ryan 2019, pp. 1–2). Although this strategy may benefit their acceptability, it may also detract from their ethical rootedness, coherence, and persuasiveness, characteristics often associated with consolidated ethical traditions. Neo-Aristotelian ethics, backed by a distinctive philosophical anthropology and worldview, is summoned to fill this gap as a standard to test these two opposing claims. It provides a substantive account of moral agency through the theory of voluntary action; it explains how voluntary action is tied to intelligent and autonomous human life; and it distinguishes machine operations from voluntary actions through the categories of poiesis and praxis respectively. This standpoint reveals that while Van Wynsberghe and Robbins may be right in rejecting the need for AMAs, there are deeper, more fundamental reasons. In addition, despite disagreeing with Formosa and Ryan’s defense of AMAs, their call for a more nuanced and context-dependent approach, similar to neo-Aristotelian practical wisdom, becomes expedient. (shrink)

Departing from popular imaginations around artificial intelligence (AI), this article engages in the I in the AI acronym but from perspectives outside of mathematics, computer science and machine learning. When intelligence is attended to here, it most often refers to narrow calculating tasks. This connotation to calculation provides AI an image of scientificity and objectivity, particularly attractive in societies with a pervasive desire for numbers. However, as is increasingly apparent today, when employed in more general areas of our messy socio-cultural (...) realities, AI- powered automated systems often fail or have unintended consequences. This article will contribute to this critique of AI by attending to Nicholas of Cusa and his treatment of intelligence. According to him, intelligence is equally dependent on an ability to handle the unknown as it unfolds in the present moment. This suggests that intelligence is organic which ties Cusa to more contemporary discussions in tech philosophy, neurology, evolutionary biology, and cognitive sciences in which it is argued that intelligence is dependent on having—and acting through—an organic body. Understanding intelligence as organic thus suggests an oxymoronic relationship to artificial. (shrink)

The dependence of socio-political stability on the emotional expectations of voters is investigated. For this, a model of a socio-political system consisting of a society of voters and a democratically elected politician is considered. The neuropsychological model of the voter takes into account his emotional expectations. The social stability is guaranteed by the expectations of positive emotions of all voters. Socio-political stability means both the social stability and the re-election of politician. One type of voter is a Progressist who seeks (...) to fulfil his desires. It is shown that for the socio-political stability of the Progressist society, is enough a supportive environment. Another type of voter—a Phobic works in a fearful environment. It is shown that for the socio-political stability of the Phobic’s society, regular impacts that support their phobias are sufficient. As an example, emotional expectations, socio-political stability and information management in Eastern Europe are considered. The management of phobias in a weak economy is investigated. It is shown that in the absence of regular impacts supporting phobias a Phobic turns into a Progressist. Then the socio-political system becomes unstable with a weak economy and growth limits. The classification of the main social threats and phobias is given. The socio-political consequences of creating phobias, including corporate psychopaths and toxic leaders, are examined. Ways are proposed to resolve the contradiction between increased consumption and growth limits without the use of phobias, using high humanitarian technologies. (shrink)

A recently developed model of general collective intelligence defines a method for organizing humans or artificially intelligent agents that is believed to create the potential to exponentially increase the general problem-solving ability of groups of such entities over that of any individual entity. An analysis based on this model suggests that many and perhaps all “wicked problems” are collective optimization problems that cannot reliably be addressed without a system of collective optimization, but that might be reliably addressed through such a (...) system. This paper briefly introduces the concept of GCI as well as why it is a system of collective optimization, and explores why “wicked problems” from the perspective of GCI are collective optimization problems, and therefore why such problems might require GCI to be reliably solvable. (shrink)

The three main kinds of theory in normative ethics, namely, consequentialism, deontology, and virtue ethics, are often presented as the ‘palette’ from which we may choose, or use as a starting point for an investigation. However, this way of doing ethics and philosophy, by the palette, may be leading some of us astray. It has led some to believe that all that there is to ethics, and to ethics of AI, is given in terms of these already devised petrified categories (...) of theory. It has also led others to abandon normative ethics and philosophy altogether and to resort to descriptive methods that are then used to justify action. I wish to argue that (1) we should not abandon traditional philosophical approaches, but (2a) this does not entail that the petrified palette should constitute the beginning of our philosophical investigations. Further, (2b) I recommend a non-methodological approach in which it is instead radical questions that spur these investigations, which arise through consideration of the practical actions (potential or otherwise) of machines and their programmers. (shrink)

This paper provides the first comprehensive analysis of ethical issues raised by artificial intelligence (AI) in veterinary medicine for companion animals. Veterinary medicine is a socially valued service, which, like human medicine, will likely be significantly affected by AI. Veterinary AI raises some unique ethical issues because of the nature of the client–patient–practitioner relationship, society’s relatively minimal valuation and protection of nonhuman animals and differences in opinion about responsibilities to animal patients and human clients. The paper examines how these distinctive (...) features influence the ethics of AI systems that might benefit clients, veterinarians and animal patients—but also harm them. It offers practical ethical guidance that should interest ethicists, veterinarians, clinic owners, veterinary bodies and regulators, clients, technology developers and AI researchers. (shrink)

The use of AI algorithms in criminal trials has been the subject of very lively ethical and legal debates recently. While there are concerns over the lack of accuracy and the harmful biases that certain algorithms display, new algorithms seem more promising and might lead to more accurate legal decisions. Algorithms seem especially relevant for bail decisions, because such decisions involve statistical data to which human reasoners struggle to give adequate weight. While getting the right legal outcome is a strong (...) desideratum of criminal trials, advocates of the relational theory of procedural justice give us good reason to think that fairness and perceived fairness of legal procedures have a value that is independent from the outcome. According to this literature, one key aspect of fairness is trustworthiness. In this paper, I argue that using certain algorithms to assist bail decisions could increase three diferent aspects of judges’ trustworthiness: (1) actual trustworthiness, (2) rich trustworthiness, and (3) perceived trustworthiness. (shrink)

The ethics of artificial intelligence (AI) is a research topic with both theoretical and practical significance. However, the ethical and moral aspects of conceptual, ontological, semantic, and knowledge modeling, more specifically, and which are sometimes found in AI applications, is not being given sufficient attention. I argue that it should. Whether considering using or developing these meaning-focused models, there are ethical aspects. This paper offers a preliminary outline about this potentially new research field, discussing: some questions and areas of concern, (...) their significance; scenarios of ethical import, and initial ethical guidelines. A focus area, potential case study, and lens through which to see the ethical significance at hand, is ontologies, with emphasis on the most abstract ontologies (so-called generic, foundational, top-level or upper ontologies). This would aim to show the ethical import of highly abstract (often philosophical) ontological choices, assumptions, and their effects on data, developers, users, and society. In particular, I stress the need for critical examination of such models, their content, their intended meanings, assumptions, ideologies, as well as the development process. Both the ethics of, and ethics in, these activities are, therefore, of interest. Topics in the ethics of AI that are relevant include: transparency, bias, data-sharing, privacy, control over data, etc. This paper thereby contributes to the ethics of AI, as well as the ethics of information, of knowledge managment and relevant topics by developing and discussing the ethics of ontology (and similar systems). Future development will refine and add to the ideas expressed in this paper. (shrink)

Discoverability: the urgent need of an ecology of human creativity from the prolific Lorenzo Magnani is worthy of direct attention. The message may be of special interest to philosophers, ethicists and organizing scientists involved in the development of AI and related technologies which are increasingly directed at reinforcing conditions against which Magnani directly warns, namely the “overcomputationalization” of life marked by the gradual encroachment of technologically “locked strategies” into everyday decision-making until “freedom, responsibility, and ownership of our destinies” are ceded (...) and we, in parallel, build a future fit for artifacts over human beings. Professional educators - teachers and administrators serious about teaching - and policy-makers including the concerned public, parents and social activists concerned about the effects of technologies on development and well-being may benefit, as well. (shrink)