Abstract
In 2021, 193 Member States at UNESCO’s General Conference adopted the Recommendation on the Ethics of Artificial Intelligence as the first important step towards a future global standard-setting instrument on the subject. The text reflects an emerging consensus among the international community about the growing ethical concerns with artificial intelligence (AI). Among these concerns are also serious risks and dangers attributed to the manipulative effects of AI, which can be further exacerbated by the creative combination of AI with other innovative technologies or applications, such as brain–computer interfaces (BCIs), functional magnetic resonance imaging (fMRI), robotics, and big data. The risks for individuals and society as a whole caused by manipulation through AI are already well known and have recently also been addressed by the European Union having released a proposal for an Artificial Intelligence Act (AIA). Among multiple risks related to AI, the AIA singles out the specific dangers related to AI systems that deploy “subliminal techniques beyond a person’s consciousness to materially distort a person’s behaviour in a manner that causes or is likely to cause that person or another person physical or psychological harm”. The present article thus aims to highlight the known and potential dangers related to AI systems manipulating human thoughts and behaviour through subliminal and supraliminal means and methods. To this end, it advocates the joint study of law and the senses captured by the concept of legal synaesthesia to correspond to the need for an interdisciplinary debate covering the complexity of the links between AI, related technologies, human perception based on the senses and the mind, as well as the role and instruments of law in the future organization of societies in this world.
Similar content being viewed by others
Data Availability
Data sharing is not applicable to this article as no datasets were generated or analysed during the current study.
Notes
UNESCO General Conference, Draft Text of the Recommendation on the Ethics of Artificial Intelligence, 41st session, Paris, 2021, 41 C/73 (22 November 2021) 2; https://unesdoc.unesco.org/ark:/48223/pf0000378931.
European Commission, Proposal for a Regulation Laying Down Harmonised Rules on Artificial Intelligence (Artificial Intelligence Act), COM (2021) 206 final (21 April 2021).
United States, H.R.6580—Algorithmic Accountability Act of 2022.
European Commission, Impact Assessment Accompanying the Proposal for a Regulation of the European Parliament and of the Council Laying Down Harmonised Rules on Artificial Intelligence (artificial Intelligence Act) and Amending Certain Union Legislative Acts, SWD(2021) 84 final (21 April 2021) 17.
References
Aardema F et al (2010) Virtual reality induces dissociation and lowers sense of presence in objective reality. Cyberpsychol Behav Soc Netw 13:1–7
Ackerman D (1990) A natural history of the senses. Vintage Books, New York
Arendt F, Markiewitz A, Scherr S (2021) Investigating suicide-related subliminal messages on instagram: a frame-by-frame analysis of video posts. Crisis 42(4):263–269. https://doi.org/10.1027/0227-5910/a000717
Bargh JA, Chartrand TA (1999) The unbearable automaticity of being. Am Psychol 54:462–479
Baudrillard J (1993) Symbolic Exchange and Death. Los Angeles: SAGE
Bauer, Gill A (2021) Mirror, Mirror on the Wall: Machine Predictions and Self-Fulfilling Prophecies. Leibniz Institute for Financial Research SAFE Working Paper No. 313. https://fif.hebis.de/xmlui/bitstream/handle/123456789/2419/313_SSRN-id3829772.pdf?sequence=1&isAllowed=y
Bennis W (2009) The essential Bennis. Jossey-Bass, San Francisco
Bently L (1996) Introduction. In: Bently L, Flynn L (eds) Law and the senses: sensational jurisprudence. Pluto Press, London, pp 1–17
Bently L, Flynn L (eds) (1996) Law and the senses: sensational jurisprudence. Pluto Press, London
Berger E (2022) Context blindness digital technology and the next stage of human evolution. Peter Lang, New York
Boudry M, Pigliucci M (2013) The mismeasure of machine: synthetic biology and the trouble with engineering metaphors. Stud Hist Philos Biol Biomed Sci 44:660–668
Bozzo-Rey M (2017) Indirect legislation: it is just a question of time. Hist Eur Ideas 43(1):106–121
Broby D, Daly A, Legg D (2022) Towards secure and intelligent regulatory technology (Regtech): a research agenda. TechReg 2022:88–99. https://doi.org/10.26116/techreg.2022.009
Canning V, Tombs S (2021) From social harm to zemiology. Routledge, London
Cao Y et al. (2019) Adversarial Objects Against LiDAR-Based Autonomous Driving Systems. arXiv:1907.05418v1. https://doi.org/10.48550/arXiv.1907.05418
Chartrand TL, Fitzsimons GJ (2011) Nonconscious consumer psychology. J Consum Psychol 21:1–3
Cheok AD, Karunanayaka K (2018) Virtual taste and smell technologies for multisensory internet and virtual reality. Springer, Cham
Cohen Kadosh R, Henik A (2007) Can synaesthesia research inform cognitive science? Trends Cogn Sci 11(4):177–184
Coleman L (2004) The copycat effect: how the media and popular culture trigger the mayhem in tomorrow’s headlines. Paraview Pocket Books, New York
Csicsery-Ronay I (2008) The seven beauties of science fiction. Wesleyan University Press, Middletown
Culpan T (2022) The Next Cybersecurity Crisis: Poisoned AI. The Washington Post. https://www.washingtonpost.com/business/the-next-cybersecurity-crisis-poisoned-ai/2022/04/24/9615126e-c426-11ec-8cff-33b059f4c1b7_story.html
Cytowic RE (1989) Synesthesia: a union of the senses. Springer, New York
Cytowic RE (1995) Synesthesia: phenomenology and neuropsychology: a review of current knowledge. Psyche Interdiscip J Res Conscious 2(10):1–22
Daltrozzo J et al (2011) Subliminal semantic priming in speech. PLoS ONE 6(5):e20273. https://doi.org/10.1371/journal.pone.0020273
Day S (1996) Synaesthesia and synaesthetic metaphors. Psyche 2(32):1–19
Deroy O (2017) Sensory blending: on synaesthesia and related phenomena. Oxford University Press, Oxford
Deroy O, Spence C (2013) Are we all born synaesthetic? Examining the neonatal synaesthesia hypothesis. Neurosci Biobehav Rev 27:1240–1253
Draaisma D (2000) Metaphors of memory: a history of ideas about the mind. Cambridge University Press
Driver J, Eimer M, Macaluso E (2005) Cross-modal consequences of human spatial attention. In Neurobiology of Attention, edited Laurent Itti, Geraint Rees, John K. Tsotsos, 187–196. Amsterdam: Elsevier
Epstein R, Robertson RE (2015) The search engine manipulation effect (SEME) and its possible impact on the outcomes of elections. Proc Natl Acad Sci (PNAS) 112(33):E4512–E4521
Erwine B (2017) Creating sensory spaces: the architecture of the invisible. Routledge, New York
Faris E (1937) The nature of human nature and other essays in social psychology. McGraw-Hill, New York
Feigenson N (2006) Too real? The future of virtual reality evidence. Law & Policy 28(2):271–293
Feigenson N, Spiesel C (2009) Law on display: the digital transformation of legal persuasion and judgment. New York University Press, New York
Fromer JC (2010) A psychology of intellectual property. Northwest Univ Law Rev 104(4):1441–1510
Garrett BL (2011) Convicting the innocent: where criminal prosecutions go wrong. Harvard University Press, Cambridge
Gentili PL (2014) The human sensory system as a collection of specialized fuzzifiers: a conceptual framework to inspire new artificial intelligent systems computing with words. J Intell Fuzzy Syst 27:2137–2151
Gill KS (ed) (1996) Human machine symbiosis: the foundations of human-centred systems design. Springer, London
Gladwell M (2005) Blink: the power of thinking without thinking. Penguin, London
Govier T (2003) Problems with false dichotomies. Humanist in Canada 36(146):31
Gross H (1906) Criminal investigation: a practical handbook for magistrates, police officers and lawyers. Madras: Krishnamachari
Halpin A, Roeben V (2009) Introduction. In: Halpin A, Roeben V (eds) Theorising the global legal order. Hart, Oxford, pp 1–24
Hamilton S et al (eds) (2017) Sensing law. Routledge, New York
Handy C (1995) The age of paradox. Harvard Business School Press, Boston
Hawkes T (2003) Structuralism and semiotics. Routledge, London
Heawood J (2018) Pseudo-public political speech: democratic implications of the Cambridge Analytica scandal. Information Polity 23:429–434
Helbing D (2021) Next civilization: digital democracy and socio-ecological finance—how to avoid dystopia and upgrade society by digital means, 2nd edn. Springer, Cham
Helbing D et al (2019) Will democracy survive big data and artificial intelligence? In: Helbing D (ed) Towards digital enlightenment: essays on the dark and light sides of the digital revolution. Springer, Cham, pp 73–98
Holder Wheeler RR, Cutsforth TD (1928) Synaesthesia in judging and choosing. J Gen Psychol 1(3–4):497–519
Howes D (2011) Cultural synaesthesia: neuropsychological versus anthropological approaches to the study of intersensoriality. Intellectica – Revue de l'Association pour la Recherche Cognitive 55:139–157. https://doi.org/10.3406/intel.2011.1164
Howes D (ed) (1991) The varieties of sensory experience: a sourcebook in the anthropology of the senses. University of Toronto, Toronto
Hsu L, Chen Y-J (2020) Neuromarketing, subliminal advertising, and hotel selection: an EEG study. Aust Mark J 28:200–208
Huygebaert S et al (eds) (2018) Sensing the nation’s law: historical inquiries into the aesthetics of democratic legitimacy. Springer, Cham
Jääskeläinen JP (2012) Introduction to cognitive neuroscience. Bookboon.com, London
Johnson S (1989) Wildfire: igniting the she/volution. Wildfire Books, Albuquerque
Jütte R (2005) A history of the senses: from antiquity to cyberspace. Polity, Cambridge
Kampik T, Najjar A (2019) Technology-facilitated Societal Consensus. UMAP'19 Adjunct: Adjunct Publication of the 27th Conference on User Modeling, Adaptation and Personalization 2019:3–7. https://doi.org/10.1145/3314183.3323451
Kapur N (2011) The paradoxical nature of nature. In: Kapur N (ed) The paradoxical brain. Cambridge University Press, Cambridge, pp 1–13
Kjelldahl L (1992) Multimedia: systems, interaction and applications. Springer, Berlin
Klein E (1966) A comprehensive etymological dictionary of the english language, vol I. Elsevier, Amsterdam
Korsmeyer C (1999) Making sense of taste: food & philosophy. Cornell University Press, Ithaca
Krishna A (ed) (2009) Sensory marketing: research on the sensuality of products. Routledge, London
Kulikov SB, Shirokova AV (2021) Artificial intelligence, culture and education. AI & Soc 36:305–318. https://doi.org/10.1007/s00146-020-01026-7
Lakoff G, Johnson M (1980) Metaphors we live by. The University of Chicago Press, Chicago
Laplace P-S (1995) Philosophical essay on probabilities. Springer, New York
Le Breton D (2017) Sensing the world: an anthropology of the senses. Bloomsbury Academic, London
Lepaulle P (1922) The function of comparative law with a critique of sociological jurisprudence. Harv Law Rev 35:838–858
Luo L (2021) Principles of neurobiology, 2nd edn. CRC Press, Boca Raton
MacPherson F (ed) (2011a) The senses: classic and contemporary philosophical perspectives. Oxford University Press, Oxford
Macpherson F (2011b) Taxonomising the senses. Philos Stud: Int J Philos Anal Tradit 153(1):123–142
Malapi-Nelson A (2017) The nature of the machine and the collapse of cybernetics: a transhumanist lesson for emerging technologies. Palgrave Macmillan, Cham
Malcolm D (2021) Post-truth society? An Eliasian sociological analysis of knowledge in the 21st century. Sociology 55:1063–1079
Martin SJ (2015) Michael Jackson’s Gesamtkunstwerk: Artistic Interrelation, Immersion, and Interactivity: From the Studio to the Stadium. Liminalities: A Journal of Performance Studies 11(5):1–34
Martinovic I et al. (2012) On the feasibility of side-channel attacks with brain-computer interfaces. Proceedings of the 21st USENIX Security Symposium 143–158. https://www.usenix.org/conference/usenixsecurity12/technical-sessions/presentation/martinovic
Marusek S (2017a) Exploring layers of law and the sensory at the Volcano. In: Marusek S (ed) Synesthetic legalities: sensory dimensions of law and jurisprudence. Routledge, Oxon, pp 1–8
Marusek S (ed) (2017b) Synesthetic legalities: sensory dimensions of law and jurisprudence. Routledge, Oxon
Masciandaro N (2018) Synaesthesia: the mystical sense of law. In: Philippopoulos-Mihalopoulos A (ed) Routledge Research Handbook on Law and Theory. Routledge, London, pp 179–201
Mazur J (2020) The clock mirage: our myth of measured time. Yale University Press, New Haven
McCredie S (2007) Balance: In Search of the Lost Sense. New York: Little, Brown and Company
McDaniel JLM, Pease KG (eds) (2021) Predictive policing and artificial intelligence. Routledge, Oxon
McGurk H, MacDonald J (1976) Hearing lips and seeing voices. Nature 264:746–748
Merleau-Ponty M (1962) Phenomenology of perception. Routledge & Keagan Paul, London
Mish FC (ed.) (2004) The Merriam-Webster Dictionary. Springfield: Merriam-Webster
Mlodinow L (2012) Subliminal: how your unconscious mind rules your behaviour. Vintage Books, New York
Mökander J, Floridi L (2022) From algorithmic accountability to digital governance. Nat Mach Intell 4:508–509. https://doi.org/10.1038/s42256-022-00504-5
Murphy E (2012) Biolinguistics and philosophy: insights and obstacles. Lulu, London
Nemitz P (2018) Constitutional democracy and technology in the age of artificial intelligence. Philos Trans R Soc A 76(2133):20180089. https://doi.org/10.1098/rsta.2018.0089
Neuwirth RJ (2018) Law in the time of oxymora: a synaesthesia of language, logic and law. Routledge, New York
Neuwirth RJ (2020) The ‘letter’ and ‘spirit’ of comparative law in the time of ‘artificial intelligence’ and other oxymora. Canterbury Law Rev 26(1):1–31
Neuwirth RJ (2021) The global regulation of “fake news” in the time of oxymora: facts and fictions about the covid-19 pandemic as coincidences or predictive programming? Int J Semiot Law 35(3):831–857. https://doi.org/10.1007/s11196-021-09840-y
Neuwirth RJ (2022) Future law, the power of prediction, and the disappearance of time. Law Technol Hum 4(2):38–59. https://doi.org/10.5204/lthj.2376
Neuwirth RJ (2023) The European Union Artificial Intelligence Act: Regulating Subliminal AI Systems. Routledge, London
Nguyen CT (2020) Echo chambers and epistemic bubbles. Episteme 17:141–161
Organisation for Economic Co-operation and Development (OECD) (2022) Dark Commercial Patterns. OECD: Paris. https://www.oecd.org/digital/dark-commercial-patterns-44f5e846-en.htm
Pasquet L (2018) De-Fragmentation Techniques. In Max Planck Encyclopedia of International Procedural Law (MPEiPro), edited by Hélène Ruiz Fabri, 1–28. Oxford: Oxford University Press
Packard V (1957) The hidden persuaders. Ig Publishing, New York
Pavoni A (2019) Law’s sensorial turn. Sens Soc 14(3):363–367
Pearce TC et al (2003) Handbook of machine olfaction: electronic nose technology. Wiley-VCH Verlag, Weinheim
Peters U (2020) What is the function of confirmation bias? Erkenntnis. https://doi.org/10.1007/s10670-020-00252-1
Proulx MJ (2010) Synthetic synaesthesia and sensory substitution. Conscious Cogn 19:501–503
Ranisch R, Sorgner SL (2014) Introducing Post- and Transhumanism. In Post- and Transhumanism: An Introduction, edited by Robert Ranisch and Stefan Lorenz Sorgner. Frankfurt am Main, Peter Lang
Reichherzer C et al (2021) Bringing the Jury to the Scene of the Crime: Memory and Decision-Making in a Simulated Crime Scene. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems 709:1–12. https://doi.org/10.1145/3411764.3445464
Ren K et al (2020) Adversarial attacks and defenses in deep learning. Engineering 6:346–360. https://doi.org/10.1016/j.eng.2019.12.012
Rodrigues JMF et al (2019) Mobile five senses augmented reality system: technology acceptance study. IEEE Access 7:163022–163033. https://doi.org/10.1109/ACCESS.2019.2953003
Rothen N, Wantz A-L, Meier B (2011) Training synaesthesia. Perception 40:1248–1250
Rovelli C (2018) The order of time. Riverhead Books, New York
Ruch S, Züst MA, Henke K (2016) Subliminal messages exert long-term effects on decision-making. Neurosci Conscious 1:1–9. https://doi.org/10.1093/nc/niw013
Sacks O (1987) The man who mistook his wife for a hat and other clinical tales. Harper & Row, New York
Sacks O (1990) Seeing voices: a journey into the world of the deaf. Harper, New York
Sadowsky J, Massof RW (1994) Sensory engineering: the science of synthetic environments. J Hopkins APL Tech Dig 15(2):99–109
Sagiv N (2005) Synesthesia in Perspective. In: Robertson LC, Sagiv N (eds) Synesthesia: Perspectives from Cognitive Neuroscience. Oxford University Press, Oxford, pp 3–10
Sagiv N, Dean RT, Bailes F (2009) Algorithmic synesthesia. In: Dean RT (ed) The oxford handbook of computer music. Oxford University Press, Oxford, pp 294–311
Schlaffke L et al (2015) The brain’s dress code: how the dress allows to decode the neuronal pathway of an optical illusion. Cortex 73:271–275
Shanahan M (2015) The technological singularity. The MIT Press, Cambridge
Shen Y, Cohen M (1998) How come silence is sweet but sweetness is not silent: a cognitive account of directionality in poetic synaesthesia. Lang Lit 7(1):123–140
Shi B et al (2020) Electronic skins and machine learning for intelligent soft robots. Sci Robot 5(41):1–11. https://doi.org/10.1126/scirobotics.aaz9239
Sieberth T et al (2019) Applying virtual reality in forensics – a virtual scene walkthrough. Forensic Sci Med Pathol 15:41–47
Skeates R, Day J (eds) (2020) The routledge handbook of sensory archaeology. Routledge, London
Smith PK, McCulloch K (2012) Subliminal Perception. In Encyclopedia of Human Behavior, edited by V.S. Ramachandran, 551–557, Vol. 1., 2nd edn. Academic Press, London
Smuha N et al. (2021) How the EU Can Achieve Legally Trustworthy AI: A Response to the European Commission’s Proposal for an Artificial Intelligence Act. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3899991
Statt DA (ed) (2003) The concise dictionary of psychology, 3rd edn. Routledge, London
Steinhagen D, Kettani H (2020) An Inventory of Existing Neuroprivacy Controls. ICISDM 2020: Proceedings of the 2020 the 4th International Conference on Information System and Data Mining 77–83. https://doi.org/10.1145/3404663.3404664
Stilman BC (2002) Making sense of proprioception: the meaning of proprioception. Kinaesthesia Relat Terms Physiotherap 88(11):667–676
Svensson J (2021) Artificial intelligence is an oxymoron: The importance of an organic body when facing unknown situations as they unfold in the present moment. AI & Soc. https://doi.org/10.1007/s00146-021-01311-z
Swets JA (1961) Is there a sensory threshold? Science 134:168–177
‘t Hooft G (2018) Time, the arrow of time, and quantum mechanics. Front Phys 6(81):1–10. https://doi.org/10.3389/fphy.2018.00081
Tan J, Xu J (2020) Applications of electronic nose (e-nose) and electronic tongue (e-tongue) in food quality-related properties determination: a review. Artif Intell Agric 4:104–115. https://doi.org/10.1016/j.aiia.2020.06.003
Thomas J (2019) An overview of emerging disruptive technologies and key issues. Development 62(1–4):5–12
Thompson D (1993) The oxford dictionary of current english, 2nd edn. Oxford University Press, Oxford
Tiefenbrun S (2010) Decoding International Law: Semiotics and the Humanities. Oxford University Press, Oxford
Trahndorff KFE (1827) Aesthetik oder Lehre von der Weltanschauung und Kunst. Maurer, Berlin
Travis M (2022) Jurisprudence, Temporality and Science Fiction. Law, Technology and Humans 4(2):5–23. https://doi.org/10.5204/lthj.2485
Uuk R (2022) Manipulation and the AI act. Future of Life Institute. https://futureoflife.org/wp-content/uploads/2022/01/FLIManipulation_AI_Act.pdf
Vaidhyanathan S (2018) Antisocial Media: How Facebook Disconnects Us and Undermines Democracy. Oxford University Press, Oxford
van Campen C (2007) The Hidden Sense: Synesthesia in Art and Science. The MIT Press, Cambridge
VandenBos GR (ed) (2015) APA dictionary of psychology, 2nd edn. American Psychological Association, Washington
Von Hayek FA (1952) The sensory order: an inquiry into the foundations of theoretical psychology. University of Chicago Press, Chicago
Von Neumann J (1958) Computer and the brain. Yale University Press, New Haven
Wagner AD, Koutstaal W (2002) Priming. In Encyclopedia of the Human Brain, edited by V. S. Ramachandran, 27–46. Vol. 4. San Diego: Academic Press
Walsh Matthews S, Danesi M (2019) AI: a semiotic Perspective. Chin Semiot Stud 15(2):199–216
Wang C, Pan C, Wang Z (2019) Electronic skin for closed-loop systems. ACS nano 13:12287–12293
Whitelaw M (2008) Synesthesia and cross-modality in contemporary audiovisuals. Sens Soc 3(3):259–276
Winter B (2019) Sensory Linguistics: Language, Perception and Metaphor. John Benjamins, Amsterdam
Wu T (2019) Will artificial intelligence eat the law? The rise of hybrid social-ordering systems. Columbia Law Rev 119(7):2001–2028
Yang X, Li Y, Lyu S (2018) Exposing deep fakes using inconsistent head poses. Comput Vis Pattern Recognit. https://arxiv.org/pdf/1811.00661.pdf
Yeung K (2017) ‘Hypernudge’: big data as a mode of regulation by design. Inf Commun Soc 20(1):118–136. https://doi.org/10.1080/1369118X.2016.1186713
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The corresponding author states that there is no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Neuwirth, R.J. Law, artificial intelligence, and synaesthesia. AI & Soc (2022). https://doi.org/10.1007/s00146-022-01615-8
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00146-022-01615-8