Abstract

Through the lens of feminist speech act theory, this paper argues that artificial intelligence romance systems objectify and subordinate nonvirtual women. AI romance systems treat their users as consumers, offering them relational invulnerability and control over their (usually feminized) digital romantic partner. This paper argues that, though the output of AI chatbots may not generally constitute speech, the framework offered by an AI romance system communicates an unjust perspective on intimate relationships. Through normalizing controlling one’s intimate partner, these systems operate as speakers that rank women as non-player characters and license their oppression, which is unjust even in the absence of empirical harms. Understanding AI romance systems as speakers has implications for policymakers. First, this account helps close the so-called responsibility gap in the operation of an AI system. Second, it places these systems under the purview of institutions’ policies regarding hate speech, suggesting one avenue for arguing that these systems may violate extant policies. Finally, it provides support for the pursuit of empirical research into AI romance systems’ effects on users.