1 Introduction

It is my pleasure and honour to be here today in BragaFootnote 1 with many of you in the room, and many others connecting online for the first ever hybrid ICAIL conference. We live in exciting times for AI and Law. First, GPT4 passes the US bar exam (Katz et al. 2023), and not long after this a US lawyer is reprimanded for referring to non-existent cases GPT has hallucinated in his GPT-generated brief.Footnote 2 More generally, many feel that generative language models like GPT can finally deliver on AI’s promises, whereas others – including 2019 ICAIL keynote speaker Yoshua Bengio – are pointing to the dangers of such models, urging for the development of robust AI governance and regulation.Footnote 3

At this ICAIL, we have seen many great presentations on completely different subjects, from trauma detection to crime simulation, to formal legal argumentationFootnote 4. And we have heard two invited speakers with inspiring, but also cautionary tales. Natalie Byrom showed us the effects of lay people not having access to justice.Footnote 5 Daniel Ho very vividly demonstrated what happens if the administrative state clogs up, with rows upon rows of documents in the cafeteria of government organisations.Footnote 6

So many dramatic developments, illustrating both the positive and the negative sides of AI & Law. The question is, how can we, the AI & Law community, deal with this “algorithmic drama” we are experiencing? I will talk about three important aspects of a way forward for AI & Law: combining knowledge & data in AI, evaluating how AI & Law is used in practice, and combining multiple disciplines such as law, AI and beyond. In the rest of this address, I will show examples of how we have been tackling these points head-on in our research at the Netherlands National Police Lab AI, and I will discuss whether and how we as an AI & Law community have been engaging with these points, providing examples from this year’s ICAIL conference.

2 35 years of AI & Law

But before looking ahead, let’s briefly reflect on the past, as many presidents have done before me.Footnote 7 ICAIL started in 1987 with a well-attended conference in Boston. During the 1990s, it was a solid conference with around 50 submissions and just under 100 participants (Fig. 1). By the year 2000, the AI winter being truly over, we saw a rise in the number of participants, but as then-president Karl Branting noted already in 2005,Footnote 8 AI & Law had a difficult time emulating the successes of general AI. There were developments such as IBM’s Watson (High 2012) and the application of deep learning to computer vision and language processing (LeCun et al. 2015), but AI and Law very much stuck to its ways – the focus was still on good-old fashioned knowledge-based approaches, such as argumentation and case-based reasoning (Fig. 2).

Fig. 1
figure 1

ICAIL participants and submissions (left) and topics of accepted papers (right). Note that ICAIL 2021 was streamed online for free because of the Covid pandemic

Full size image

The first significant increase in both participants and submissions was in 2017, due to a new-found hype surrounding AI and Law. This hype was partly due to the data revolution and technical developments in NLP, such as Transformers (Vaswani et al. 2017), making 2017 the first year that more papers on data-driven AI were published than papers on knowledge-driven AI (Fig. 1). “Legal prediction” became a thing (Ashley 2017), and legal tech was once again cool.Footnote 9 Developments in data protection law such as the EU GDPR also led to renewed interest from legal practitioners and scholars. This led to an increase in papers on legal aspects of AI (Fig. 1), with 2019’s best student paper award going to such a paper for the first time (Almada 2019).

And here we are in the beautiful summer of AI & Law, at the first post-Covid, post-ChatGPT ICAIL, with a record number of 134 submissions and more than 300 participants. There are many papers on data-driven AI, and even a few on GPT (Blair-Stanek et al. 2023; Jiang and Yang 2023; Savelka 2023). We also see a stable core of publications on knowledge based-AI, and an increase of papers that combine data-driven and knowledge-based AI. And there is a further increase in papers on law and legal aspects (Hulstijn 2023; Nielsen et al. 2023; Unver 2023). So, from an academic perspective, AI & Law is doing great. In addition to the conference, our journal has also been performing well, ranking consistently in the top quartile of journals for both the field of Artificial Intelligence and the field of Law.Footnote 10 There are many new related workshops and journals – like the recurring workshop on Natural Legal Language Processing (NLLP)Footnote 11 and the journal for Cross-Disciplinary Research in Computational LawFootnote 12 – and new connections – the Society for Empirical Legal StudiesFootnote 13 has a special track at this year’s ICAIL. Furthermore, many of the community are involved in big national and international projects.Footnote 14

AI & Law practice and applications – legal tech - is also on the rise. The number of Legal Tech companies in the Codex Techindex grew from 700 to more than 2000 in the last five years.Footnote 15 ChatGPT is being actively used by, for example, judgesFootnote 16, and countries like China are investing heavily in legal AI and NLP for courts.Footnote 17 Legal Tech companies are looking to further capitalise on the ChatGPT hype by developing derivative products for legal servicesFootnote 18. And we see an increasing number of collaborations between universities on the one hand, and law enforcement, law firms and courts on the other hand.Footnote 19

So, AI & Law is doing great by all accounts, right? Well, that depends. There have been serious worries about the use of predictive AI in courts, particularly about fairness, transparency and the effects on judicial authority (Stern et al. 2020).Footnote 20 Amnesty International is “Sensing Trouble” with respect to predictive policing in the Netherlands (Amnesty International 2020). There have been many discussions on ChatGPT, with the “out of the box” usage of the technology by lawyers being questioned.Footnote 21 Even if the tech is improved, we are still dealing with technology that is far from transparent and we have seen a pushback against OpenAI on privacy violations.Footnote 22 And finally, many prominent AI researchers – including Geoffrey HintonFootnote 23 and the earlier mentioned Yoshua Bengio - have been warning about the dangers ahead if we let such generative AI systems run loose.Footnote 24

3 Algorithmic drama in AI & law

It seems we are in the middle of what Ziewitz (2016) calls an “algorithmic drama”. Like any good drama, there are protagonists and antagonists: autonomous Robojudge and Robocop as a threat versus supporting AI systems for judges and police officers as a friendly aid. These two sides of the issue we see more in AI. For example, we have on the one hand the deep learning adepts (e.g., LeCun et al. 2015) – all intelligent behaviour can be learnt by computers – and on the other hand those who argue that complex reasoning cannot be learnt but should be hardwired in the system (e.g., Marcus and Davis 2019). We also see two sides in the discussion on what AI will bring us. On the one hand, we have the techno-optimists who argue that AI can be used for good – it can help us in building a sustainable, fair society (e.g., Sætra 2022). On the other hand, we have the techno sceptics, who paint a picture of a “black box society”, in which data and algorithms are being used to control people and information (e.g., Pasquale 2015). And finally, there are the different academic fields focussed on, on the one hand, building and applying AI responsibly – the “AI” in AI and Law – and on the other hand, regulating and governing AI – the “Law” in AI and Law.Footnote 25

While a bit of drama is good, too much drama is not helpful. Even when we disagree on content, we want to work with each other, instead of against each other. Be open to other viewpoints and, more importantly, open to fundamentally different ways of looking at the world and AI’s role in it. But how can we do that?

First, by combining research on knowledge-based AI with research on data-driven AI: using new deep learning techniques, without forgetting about good old-fashioned AI & Law. Purely data-driven techniques are not always suited for legal AI, which involves making complex legal decisions in a way that is transparent, contestable and in line with the law. We have a strong tradition in (legal) computational argumentation (Prakken and Sartor 2015), case-based reasoning (Rissland et al. 2005), and semantic web technologies for the law (Casanovas et al. 2016). New community members – many of whom come with a machine learning background – have to be informed about this important and still relevant work.

Second, we must put AI & Law into practice. Developing systems for practice is hard, but it is the only way to fully evaluate the impact of the AI techniques we research. Of course, we already encourage applications via the innovative application award, and also numerous workshops focused on applications, but we see that applications are often stuck in the prototype stage without a proper user evaluation. Only by implementing systems at scale, with real users, can we figure out what their real impact is.

Finally, we need work together across disciplines: bring together those who think about how to build AI and those who think about how to govern and regulate it. We have many community members who work at law schools as well those who are from AI and computer science departments. But we can go beyond AI and Law, reaching out to other disciplines such as public administration, philosophy or communication studies. With AI becoming commonplace in today’s society, the application of AI to the law is no longer just of interest to one community.

4 Research and development in the national police lab AI

Let us now look at some examples of how we have incorporated the above three points in our research. Much of this research takes place in the National Police lab AI (NPAI), a collaboration between multiple universities and the Netherlands National Police.Footnote 26 At the lab, we research and develop AI tools and systems for real police problems, in an actual police context: of the 20 PhD candidates in the lab, the majority work part-time at the police while writing their thesis. We started in 2019 to develop AI tools for the police, so many PhD candidates have a computer science or AI background. Over the years, however, we have also involved PhD candidates from other disciplinesFootnote 27 to broadly evaluate these AI tools: How are they used at the police? Which legal safeguards are required when the police use them?

4.1 AI for citizen complaint intake

The first example of research in the NPAI is about an AI system for citizen complaint intake (Odekerken et al. 2022). Such complaints are about online trade fraud, for example, false web shops or malicious traders on eBay not delivering products to people. The police receive about 60,000 complaint reports of alleged fraud each year, but not all of these are actual criminal fraud – someone might have, for example, accidentally received the wrong product. The problem was that the police needed to manually check all these reports. To solve this, we developed a recommender system that, given a complaint form, determines whether a case is possibly fraud, and then only recommends filing an official report if it is. This system was implemented at the police and is still in use today.Footnote 28

For the intake system, we wanted to combine knowledge- and data-driven AI. Knowledge-driven AI is used because the domain is bounded and the rules are known, because whether something is fraud or not depends on Article 326 of the Dutch Criminal Code and police policy rules, which can be directly modelled. We therefore made a legal model of the domain, as structured arguments in ASPIC+ (Prakken 2010). Figure 2 (middle) shows a simplified example of the legal model that was implemented at the police. Here, something is fraud if the product was paid for but not sent and some form of deception was used. Two instances of deception are that the supposed seller used a false location, or a false website. We also include exceptions so, for example, if there was a delivery failure, we cannot say the product was not sent.

The complaint reporting form also contains a free text field where the citizen can tell their story, so data-driven AI is needed to extract the basic observations that act as the rule antecedents from this free text. In Fig. 2, these basic observations are underlined. We experimented with various machine learning NLP approaches to extract, for example, entities and relations from the text (Schraagen et al. 2017; Schraagen and Bex 2019). While results were acceptable, the final implementation mainly depends on regular expressions to extract observations. Using these regular expressions, we can extract basic information – in the case in Fig. 2 (left), the complainant has paid, the seller used a false location, and the product was not delivered. With this basic information, we can try and infer a conclusion. Here, this is not yet possible. Often the complainant does not give all the necessary information directly in the form, also because they do not know exactly what is relevant.

Fig. 2
figure 2

Steps in the AI for citizen complaint intake process

Full size image

To find missing observations, the system can ask the complainant questions. The system will first try to determine which observations can still change the conclusion. In the case of Fig. 2 (right), there are three observations the system can ask for: was a false website used, was there a delivery failure, and did the complainant wait? Only the latter observation will allow us to possibly infer the conclusion “fraud”, as we already have a form of deception, namely false location, and we have no argument for “not sent” that can be undercut by the delivery failure. Determining whether the conclusion can still change, and which observations are still relevant for such a change, is computationally quite expensive, so we developed argument approximation algorithms for this (Odekerken et al. 2022).

The next important issue was how to explain the system’s conclusions to the complainant. It is often assumed that knowledge-based AI methods are “inherently explainable”, but there are many different explanations given a complex, rule-based system. In our case, we defined various types of explanations for the acceptance or non-acceptance of a conclusion (Borg and Bex 2020). If, for example, the complainant was to answer negatively to the questions in Fig. 2, then the system would say that the conclusion is not accepted because the “waited” observation is missing.

The intake system has been evaluated internally at the police on various aspects, such as accuracy and user satisfaction.Footnote 29 In our ALGOPOL project, we also wanted to further evaluate the system’s effect on human trust: would citizens mind that they received recommendations from a computer? And would it matter if they received an explanation for the recommendation or not? We performed a controlled experiment with more than 1700 participants, together with colleagues from public management studies (Nieuwenhuizen et al. 2023).

So here we had a situation where the system told the participants it was probably not criminal fraud in their case. We then asked them whether they trusted the system’s conclusion. More importantly, we also measured their trusting behaviour: the system told them it was probably not criminal fraud, but did they still file an official report? We compared two groups. The control group received no explanation – “it is probably not criminal fraud, so the system recommends you don’t file a report”. 40–60% still filed a report, so quite a large number of respondents from the control group listened to “computer says no”. With an explanation similar to the one just discussed, however, only 20–35% still filed a report, so significantly more people followed the recommendation if it was accompanied by an explanation. From this we concluded that citizen trust increases with explanations.

What this shows is how AI can be designed and evaluated from different perspectives, and how these different perspectives can inform each other. Explanations are important for citizen trust, and only this type of system can give explanations based on legal and policy rules. Here we evaluated the influence of being transparent about a single decision, taken by one AI system. This type of transparency about a single decision or a single system is what we traditionally associate with XAI – Explainable Artificial Intelligence. But it is also possible to, for example, explain how systems are being used by police officers in the organisation, or how the organisation adheres to more general regulation on data and AI. In future research, we want to test the effects of these other types of explanations and transparency about AI at the police.

4.2 Explainable AI

The second example concerns data-driven natural language processing. The police generate, use and analyse lots of text data: citizen reports like the ones from the intake system, incident reports filed by officers, forensic lab reports, intercepted communications and seized data carriers. This enormous amount of data has overwhelmed crime investigators: How can we find evidence about a certain suspect or certain event in millions of intercepted messages?

One technique for this is text classification, which can be used for searching in large document sets. For example, a classification model can indicate which out of the millions of messages was probably written by the suspect. But text classification can also be used in AI systems: for example, for finding observations in reports – does this report contain a mention of the fact that a product was delivered? Text classification models at the police need to be able to explain their output, as explanations can help to test and improve the model. Furthermore, new AI regulations will require the police to perform assessments of deployed models, where increasing demands on transparency require that the police understand and explain model behaviour. And if the outcome is to be used as evidence in a criminal case, explanations are also needed: “why did the algorithm mark exactly this message out of 10.000 as being very probably written by my client?”, a lawyer could argue.

One specific explanation technique that we developed recently at the NPAI concerns generating human-like rationales, or reasons, for the output of a classifier (Herrewijnen et al. 2021). In the example in Fig. 3, the model classified the top message as “paid” because it contains the sentence “I paid him in good faith”. Similarly, it classifies the bottom message as “not paid” because it contains the sentence “I haven’t transferred the money yet”. Here, the model itself has generated the rationales, and sentences instead of just individual words are highlighted, so we generate faithful rationales that make sense to humans. Another technique we have developed at the NPAI is that of generating counterfactual input text that would lead to a different classification (Robeer et al. 2021). So, for example, if the original message was classified as “paid”, the model will change the message so that it will be classified as “not paid” – in the example in Fig. 3, for example, it changes the phrase “I paid him” to “I did not pay him”, which causes the message to be classified differently. Here, we have realistic and perceptible counterfactuals.

Fig. 3
figure 3

Highlighted rationales that explain the “paid” classification (top), and a generated counterfactual for the opposite class “not paid”(top)

Full size image

Rationales and counterfactuals are specific explanation techniques, of which there are many for language processing, including the now-standard LIME (Ribeiro et al. 2016) and SHAP (Lundberg and Lee 2017) techniques. In AI & Law, explainable text processing has also attracted interest (e.g., Branting et al. 2021; Tan et al. 2020). With many of these specific techniques, however, the question remains exactly how they are to be used for testing, explaining and improving models?

As a first step of using such specific explanation techniques in a coherent way towards the explanation goals of model improvement, assessment and transparency, we have developed the Explabox, a collection of libraries and a toolkit for AI model inspection (Robeer et al. 2023).Footnote 30 In addition to allowing for explanations via techniques such as rationales, LIME or SHAP, the Explabox allows for exploration of the data by generating basic data statistics, and for testing the robustness of a model by changing the data. For example, does the behaviour and performance of the model change when we introduce spelling mistakes, when we change all the names from Dutch to English names, or when we replace every pronoun with “she/her”? The Explabox is thus meant to give a data scientist a “holistic” view of the AI system: what kind of data was used, and what is the behaviour of the system using this and other similar data?

Issues like model behaviour, bias and fairness have become important, also in AI & Law (Alikhademi et al. 2022; Tolan et al. 2019). For some years now, there has been a special ACM conference on fairness, accountability and transparency.Footnote 31 With respect to accountability, there is the upcoming EU AI act,Footnote 32 which will – among other things - require AI in law enforcement to be certified. Regular impact assessments of AI systems will need to be performed using auditing tools like the Dutch government’s Fundamental Rights and Algorithms Impact Assessment (FRAIA)Footnote 33, which can be used to assess why and how AI is being developed and, importantly, what the impact of the AI on fundamental rights such as privacy or non-discrimination might be. The information that can be generated using Explabox can directly be used in impact assessments such as FRAIA to answer questions like “what kind of data are you using?”, “is there a bias in the data?”, “how accurate is your AI model?”, “can you explain what your model does?”.

In addition to technical research and development, we also want to further investigate the effects of the various tools and metrics to assess the impact of AI. Do they really lead to better (use of) AI? Or to a better weighing of the fundamental rights and values at stake? In the Algosoc project,Footnote 34 we will empirically investigate what the intended and actual effects of the current “AI audit explosion” are (cf. Power 1994). One thing we already see at the police is that new roles and responsibilities appear: instead of just the builder and user of an AI system, there is now also the auditor and the examiner of AI systems. Furthermore, we also want to look at what the law tells us about AI, transparency and contestability (Almada 2019; Bibal et al. 2021). How can legal decisions based partly on AI be motivated in a way that they are contestable and transparent? We know, for example, that argument-, scenario- and case-based reasoning are all used when motivating decisions (Atkinson et al. 2020; Bex 2011), but can AI also be explained in this way?

4.3 Evaluating AI in practice at the police

The next two examples tell us something about the importance of evaluating in a real user context, which was already indicated by Conrad and Zeleznikow (2013, 2015). The first of these extensive user evaluation projects is about a police system that is meant to detect drivers who are using their mobile phone hands-on while driving. Here, image recognition software does initial filtering for pictures of drivers who seem to be holding something that looks like a mobile phone in their hands. Whenever there is a “hit”, a human police officer checks whether the driver is really holding a phone – it might be, for example, that the phone is mounted on the dashboard or the windscreen.

During the evaluation (Fest et al. 2024) the system was found to be a best-practice in value-sensitive design. Data minimalization was considered by not storing pictures that are not tagged by the system, and only showing the driver’s side of the car. The machine learning models were trained with representative datasets, and soft- and hardware was developed in-house, so that control lies with the police and not with external commercial partners - recall that the Compass recidivism system was black box exactly because it was proprietary technology (Angwin et al. 2022).

In practice, however, there were some unexpected surprises. Many new cars had a sun-blocking windscreen foil that made it hard for the AI to detect whether someone was holding a phone. So, according to some metrics we could say the system was being “unfair” to people with older cars. Also, whenever the human officer was unsure about exactly whether the driver was holding a phone, they took a picture of the screen with their own phone and sent this to a colleague to ask for a second opinion. This was all in good faith, but it does run contrary to the data minimalization principles designed into the system at the start. So designing responsible AI, requires continuous training of the system – in the case of new windscreen foils – and the human users – in the case of assessing photographs.

A second project that led to unexpected user behaviour is AI for police interception (van Droffelaar et al. 2022). Whenever there is a crime like a robbery or a smash and grab and the suspects flee using a motorized vehicle, this system predicts the suspect’s route using knowledge about, for example, roads and suspect behaviour. This is then relayed to the dispatchers, who can tell the police cars where to best intercept the suspect. The question was whether dispatchers care about what such a system says: expert dispatchers have their own experience and knowledge about how typical suspects flee.

During the evaluation (Selten et al. 2023), it became clear that police dispatchers only followed the recommendation – the prediction – of the system when it coincided with their own intuitions. And interestingly, unlike the citizens who trusted the intake system more when they received an explanation (Sect. 4.1), the police officers where hardly influenced by explanations. So, we see that there are no “one size fits all” solutions in XAI - it is very hard to generalise over different types of users and tasks. And what we also see is that in human-AI teams, it is just as important to retrain the human as it is to retrain or redesign the AI – if, for example, this interception prediction system is more accurate or faster than humans in some cases, we would want the dispatchers to follow it.

5 AI, law and beyond

Recall that earlier (Sect. 3), I mentioned three points that are in my opinion central to a way forward for AI & Law: (1) combine research on knowledge-based AI with research on data-driven AI; (2) evaluate how AI & Law is being used in practice; and (3) combine multiple disciplines. I have shown how in the Police lab, we take these points seriously (Sect. 4). For example, in the trade fraud complaint intake system we combine knowledge-based AI and data-driven AI. We have put specific XAI-NLP-techniques into practice via a general tool like the Explabox. We evaluated different systems, including the trade fraud intake system, in practice, showing positive and negative, expected and unexpected effects of these systems. In these evaluations, we have worked with researchers from computer science, AI, law, public management, and media studies, with more upcoming projects also taking a multi- and interdisciplinary angle.

But where do we stand on each of these three points as a broader AI & Law community? Let’s take a look at 2023’s ICAIL conference to see whether, and how, the three points return in the accepted papers.

5.1 Combining knowledge-based and data-driven AI

Combining knowledge and data has been on the AI community’s agenda for some time now (Marcus and Davis 2019; Sarker et al. 2021), and researchers in AI & law have also made first steps. First, there is the work on legal information extraction, where information that can be used in knowledge-based systems – rules, factors, arguments, cases – is extracted from unstructured data, usually text. We have seen examples of this at ICAIL 2023: Santin et al. (2023) and Zhang et al. (2023) mine argument structures from legal texts, Gray et al. (2023) automatically identify legal factors in legal cases, and finally Zin et al. (2023) and Servantez et al. (2023) extract logical formulas from legal texts. Second, there is work that uses non-statistical, knowledge-based techniques to reason with data, performing tasks such as classification, generalization or explanation (Blass and Forbus 2023; Odekerken et al. 2023; Peters et al. 2023). Finally, we have systems where data-driven and knowledge-based AI are combined in a single system. For example, when machine learning is used for information retrieval, and knowledge-based techniques are then used to reason with this information (Mumford et al. 2023) – this was also what we saw earlier in the complaint intake example for the police (Odekerken et al. 2022). Another approach is to use a combination of machine learning and knowledge-based techniques to perform one task – for example, improving court forms (Steenhuis et al. 2023). And then there are combination approaches we do not see in AI & Law or at ICAIL, yet. The first of these involves using machine learning architectures to solve typical knowledge problems, like argumentation or case-based reasoning (Craandijk and Bex 2021; Li et al. 2018). The second involves constraining what machine learning models learn, or can learn, using symbolically represented knowledge (Gan et al. 2021).

The advancements made in machine learning, and particularly in language processing and language generation, are impressive. But it can be argued that these new techniques are not always suited for legal AI that involves making complex legal decisions in a way that is transparent, contestable and in line with the law. As argued before, we should not forget about the important work on knowledge-based AI that has been done in AI & Law. Why should we learn correlations when explicit rules and regulations already exist? And how can we guide the next generation of large language models to take existing law into account? Devising solutions to these questions is at the core of AI & Law.

5.2 Evaluating AI & law in practice

We next turn to evaluating AI & Law applications in practice. ICAIL 2023 once again has a nice amount of innovative application papers (Fuchs et al. 2023; Haim and Kesari 2023; Hillebrand et al. 2023; Steenhuis et al. 2023; Westermann and Benyekhlef 2023). However, of all of these, only Westermann et al. (2023) and Steenhuis et al. (2023) engage with humans for their evaluation, and of these two only Westermann evaluates the implemented system with actual users. So, the innovative applications are not evaluated in an operational context, on their usability or on the impact they have on legal decision making.

So, it seems that not much has changed: In 2013 and 2015, Conrad and Zeleznikow indicated that human performance or operational-usability evaluations are only presented in about 10% of papers at ICAIL and in the AI & Law journal that present some sort of application.Footnote 35 Work on an application together with domain users is not easy. For example, a lot of time goes into practical solutions that are not interesting for an academic publication, such as the regular expression-based information extraction in the complaint intake system (Sect. 4.1). Expert user such as law enforcement officers, judges and lawyers are busy people with little time for iterative research and development of an AI prototype system that might not be further implemented. And as we have seen in the examples in Sect. 4.3, users have their own behaviour that might give problems for even the best-designed applications.

That all being said, I firmly believe that working with stakeholders from practice is necessary in an “applied” field such as AI & Law. We cannot rightly claim we develop AI for the legal field, if ultimately only very few in that field can use our systems and techniques (or at least derivatives of them). Even if it is not possible to work with practitioners on a day-to-day basis like in the police lab, we should try to evaluate with “proxy-users” such as students. Furthermore, we can develop for user groups that are not as pressed for time as police officers and lawyers – for example, systems for legal education to students (Aleven and Ashley 1997), or for other academics such as our colleagues in empirical legal studies.

5.3 Working with different disciplines

This brings me to my final point – working across different disciplines. AI & Law is inherently multi- and interdisciplinary. Of course, we apply AI techniques to the legal field. But we also use AI, such as agent-based simulations, to study law enforcement (van Leeuwen et al. 2023) and the law (Fratrič et al. 2023). At ICAIL 2023, the special Empirical Legal Studies track has led to a further increase of papers in which AI techniques are applied to legal data to study the law (Habba et al. 2023; Piccolo et al. 2023; Riera et al. 2023; Schirmer et al. 2023). And while we are not a “Law & Tech” conference that is mainly visited by legal scholars, we do have legally oriented papers at ICAIL. For example, there are articles on “law-by-design” – how legal concepts can be directly implemented in AI systems (Hulstijn 2023) – on legal aspects of our kind of AI, that is, AI for the legal sector (Unver 2023), and on the effects of AI on the legal process (Nielsen et al. 2023).

Lawyers are, in a way, still close to computer scientists. They are mathematicians with words, or social engineers. For the field of AI & Law to mature, we need to look beyond just Law and Computer Science to other disciplines. People from management or information sciences allow us to zoom out and see the bigger picture: like the socio-technical system architectures Daniel Ho talked about in his invited address at ICAIL 2023.Footnote 36 More critical humanities, such as philosophy but also media studies theory and science and technology studies, question some of the core behaviours and ways of communicating that we in our community take for granted (cf. the evaluation of “value-sensitive by design” in Sect. 4.3). Researchers from, for example, public administration look at our technology with an empirical lens (cf. the experiments on citizen and police expert trust in system recommendations in Sect. 4.1 and 4.3, respectively). Further strengthening ties with disciplines beyond AI and Law will ultimately benefit the entire “AI & Law” ecosystem that we are a part of.

6 Conclusion

It is the aforementioned ecosystem that I would like to conclude with. AI and Law started out in 1987 with researchers from two fields, AI or computer science, and law, studying AI for the law, using knowledge- and data driven methods. Over the years, we have involved the legal tech community and practitioners such as lawyers and educators, and started work on innovative applications and the legal aspects of our applications. The importance of broader evaluations was argued for, and more stakeholders and academic disciplines joined the field. And here we are today, with an AI & Law community – or ecosystem – that includes many more disciplines and stakeholders, and studies AI for Law and Law for AI in a broad societal framework. I am excited for the future of our field, and hope that you will help me in strengthening and further expanding this transdisciplinary ecosystem for AI & Law.