This article describes the Vaccine/Injury Project Corpus, a collection of legal decisions awarding or denying compensation for health injuries allegedly due to vaccinations, together with models of the logical structure of the reasoning of the factfinders in those cases. This unique corpus provides useful data for formal and informal logic theory, for natural-language research in linguistics, and for artificial intelligence research. More importantly, the article discusses lessons learned from developing protocols for manually extracting the logical structure and generating the logic (...) models. It identifies sub-tasks in the extraction process, discusses challenges to automation, and provides insights into possible solutions for automation. In particular, the framework and strategies developed here, together with the corpus data, should allow “top–down” and contextual approaches to automation, which can supplement “bottom-up” linguistic approaches. Illustrations throughout the article use examples drawn from the Corpus. (shrink)

In a criminal trial, evidence is used to draw conclusions about what happened concerning a supposed crime. Traditionally, the three main approaches to modeling reasoning with evidence are argumentative, narrative and probabilistic approaches. Integrating these three approaches could arguably enhance the communication between an expert and a judge or jury. In previous work, techniques were proposed to represent narratives in a Bayesian network and to use narratives as a basis for systematizing the construction of a Bayesian network for a legal (...) case. In this paper, these techniques are combined to form a design method for constructing a Bayesian network based on narratives. This design method is evaluated by means of an extensive case study concerning the notorious Dutch case of the Anjum murders. (shrink)

Evidential reasoning is hard, and errors can lead to miscarriages of justice with serious consequences. Analytic methods for the correct handling of evidence come in different styles, typically focusing on one of three tools: arguments, scenarios or probabilities. Recent research used Bayesian networks for connecting arguments, scenarios, and probabilities. Well-known issues with Bayesian networks were encountered: More numbers are needed than are available, and there is a risk of misinterpretation of the graph underlying the Bayesian network, for instance as a (...) causal model. The formalism presented here models presumptive arguments about coherent hypotheses that are compared in terms of their strength. No choice is needed between qualitative or quantitative analytic styles, since the formalism can be interpreted with and without numbers. The formalism is applied to key concepts in argumentative, scenario and probabilistic analyses of evidential reasoning, and is illustrated with a fictional crime investigation example based on Alfred Hitchcock’s film ‘To Catch A Thief’. (shrink)

This paper is one in a series of rational analyses of the Dutch Simonshaven case, each using a different theoretical perspective. The theoretical perspectives discussed in the literature typically use arguments, scenarios, and probabilities, in various combinations. The theoretical perspective on evidential reasoning used in this paper has been designed to connect arguments, scenarios, and probabilities in a single formal modeling approach, in an attempt to investigate bridges between qualitative and quantitative analytic styles. The theoretical perspective uses the recently proposed (...) logical formalism of case models, where cases represent possible combinations of evidence and events, ordered by an ordering relation. In the context of evidential reasoning, the ordering relation can be represented by a probability function. As an ordering relation is qualitative in nature, the theoretical perspective is in a formally precise sense simultaneously with and without probabilities. (shrink)

Information technology is so ubiquitous and AI’s progress so inspiring that also legal professionals experience its benefits and have high expectations. At the same time, the powers of AI have been rising so strongly that it is no longer obvious that AI applications (whether in the law or elsewhere) help promoting a good society; in fact they are sometimes harmful. Hence many argue that safeguards are needed for AI to be trustworthy, social, responsible, humane, ethical. In short: AI should be (...) good for us. But how to establish proper safeguards for AI? One strong answer readily available is: consider the problems and solutions studied in AI & Law. AI & Law has worked on the design of social, explainable, responsible AI aligned with human values for decades already, AI & Law addresses the hardest problems across the breadth of AI (in reasoning, knowledge, learning and language), and AI & Law inspires new solutions (argumentation, schemes and norms, rules and cases, interpretation). It is argued that the study of AI as Law supports the development of an AI that is good for us, making AI & Law more relevant than ever. (shrink)

Legal probabilism is the view that juridical fact-finding should be modeled using Bayesian methods. One of the alternatives to it is the narration view, according to which instead we should conceptualize the process in terms of competing narrations of what happened. The goal of this paper is to develop a reconciliatory account, on which the narration view is construed from the Bayesian perspective within the framework of formal Bayesian epistemology.

In recent times, there have been different attempts to make an interesting use of the concept of script (as inherited from the fields of psychology and cognitive sciences) within argumentation theory. Although, in many cases, what we find under this label are computerized routines mainly used in e-learning collaborative proceses involving argumentation, either as an educational means or an educational goal, there are also other studies in which the concept of script plays a more theoretical role as the kind of (...) commonly human cognitive structure that could account for the way in which argumentation might develop in ordinary language and ordinary settings. We aim at exploring these latter possibilities, differentiating between the global ascription of the script concept to argumentation practices as procedural and regulated actions from the somewhat more suggestive association between socially shared scripts (expected narratives, plausible sequences, customary experiences, etc.) and the way some enthymemes work from an interactive, rhetorical perspective. The concept of script could help us understand some more procedural than propositional aspects of the cognitive sets shared by arguer and audience and account for the communicative success of apparently defective argumentation. (shrink)

Bayesian models of legal arguments generally aim to produce a single integrated model, combining each of the legal arguments under consideration. This combined approach implicitly assumes that variables and their relationships can be represented without any contradiction or misalignment, and in a way that makes sense with respect to the competing argument narratives. This paper describes a novel approach to compare and ‘average’ Bayesian models of legal arguments that have been built independently and with no attempt to make them consistent (...) in terms of variables, causal assumptions or parameterization. The approach involves assessing whether competing models of legal arguments are explained or predict facts uncovered before or during the trial process. Those models that are more heavily disconfirmed by the facts are given lower weight, as model plausibility measures, in the Bayesian model comparison and averaging framework adopted. In this way a plurality of arguments is allowed yet a single judgement based on all arguments is possible and rational. (shrink)

Disputes over causes play a central role in legal argumentation and liability attribution. Legal approaches to causation often struggle to capture cause-in-fact in complex situations, e.g. overdetermination, preemption, omission. In this paper, we first assess three current theories of causation to illustrate their strengths and weaknesses in capturing cause-in-fact. Secondly, we introduce a semi-formal framework for modelling causal arguments through strict and defeasible rules. Thirdly, the framework is applied to the Althen vaccine injury case. And lastly, we discuss the need (...) for new criteria based on a common causal argumentation framework and propose ideas on how to integrate the current theories of causation to assess the strength of causal arguments, while also acknowledging the tension between evidence-based and policy-based causal analysis in law. (shrink)

Disputes over causes play a central role in legal argumentation and liability attribution. Legal approaches to causation often struggle to capture cause-in-fact in complex situations, e.g. overdetermination, preemption, omission. In this paper, we first assess three current theories of causation to illustrate their strengths and weaknesses in capturing cause-in-fact. Secondly, we introduce a semi-formal framework for modelling causal arguments through strict and defeasible rules. Thirdly, the framework is applied to the Althen vaccine injury case. And lastly, we discuss the need (...) for new criteria based on a common causal argumentation framework and propose ideas on how to integrate the current theories of causation to assess the strength of causal arguments, while also acknowledging the tension between evidence-based and policy-based causal analysis in law. (shrink)

Disputes over causes play a central role in legal argumentation and liability attribution. Legal approaches to causation often struggle to capture cause-in-fact in complex situations, e.g. overdetermination, preemption, omission. In this paper, we first assess three current theories of causation to illustrate their strengths and weaknesses in capturing cause-in-fact. Secondly, we introduce a semi-formal framework for modelling causal arguments through strict and defeasible rules. Thirdly, the framework is applied to the Althen vaccine injury case. And lastly, we discuss the need (...) for new criteria based on a common causal argumentation framework and propose ideas on how to integrate the current theories of causation to assess the strength of causal arguments, while also acknowledging the tension between evidence-based and policy-based causal analysis in law. (shrink)

When we talk about the coherence of a story, we seem to think of how well its individual pieces fit together—how to explicate this notion formally, though? We develop a Bayesian network based coherence measure with implementation in _R_, which performs better than its purely probabilistic predecessors. The novelty is that by paying attention to the network structure, we avoid simply taking mean confirmation scores between all possible pairs of subsets of a narration. Moreover, we assign special importance to the (...) weakest links in a narration, to improve on the other measures’ results for logically inconsistent scenarios. We illustrate and investigate the performance of the measures in relation to a few philosophically motivated examples, and (more extensively) using the real-life example of the Sally Clark case. (shrink)

Bayesian networks (BN) and argumentation diagrams (AD) are two predominant approaches to legal evidential reasoning, that are often treated as alternatives to one another. This paper argues that they are, instead, complimentary and proposes the beginnings of a method to employ them in such a manner. The Bayesian approach tends to be used as a means to analyse the findings of forensic scientists. As such, it constitutes a means to perform evidential reasoning. The design of Bayesian networks that accurately and (...) comprehensively represent the relationships between investigative hypotheses and evidence remains difficult and sometimes contentious, however. Argumentation diagrams are representations of reasoning, and are used as a means to scrutinise reasoning (among other applications). In evidential reasoning, they tend to be used to represent and scrutinise the way humans reason about evidence. This paper examines how argumentation diagrams can be used to scrutinise Bayesian evidential reasoning by developing a method to extract argument diagrams from BN. (shrink)

It is well known that Bayes’ theorem (with likelihood ratios) can be used to calculate the impact of evidence, such as a ‘match’ of some feature of a person. Typically the feature of interest is the DNA profile, but the method applies in principle to any feature of a person or object, including not just DNA, fingerprints, or footprints, but also more basic features such as skin colour, height, hair colour or even name. Notwithstanding concerns about the extensiveness of databases (...) of such features, a serious challenge to the use of Bayes in such legal contexts is that its standard formulaic representations are not readily understandable to non-statisticians. Attempts to get round this problem usually involve representations based around some variation of an event tree. While this approach works well in explaining the most trivial instance of Bayes’ theorem (involving a single hypothesis and a single piece of evidence) it does not scale up to realistic situations. In particular, even with a single piece of match evidence, if we wish to incorporate the possibility that there are potential errors (both false positives and false negatives) introduced at any stage in the investigative process, matters become very complex. As a result we have observed expert witnesses (in different areas of speciality) routinely ignore the possibility of errors when presenting their evidence. To counter this, we produce what we believe is the first full probabilistic solution of the simple case of generic match evidence incorporating both classes of testing errors. Unfortunately, the resultant event tree solution is too complex for intuitive comprehension. And, crucially, the event tree also fails to represent the causal information that underpins the argument. In contrast, we also present a simple-to-construct graphical Bayesian Network (BN) solution that automatically performs the calculations and may also be intuitively simpler to understand. Although there have been multiple previous applications of BNs for analysing forensic evidence—including very detailed models for the DNA matching problem, these models have not widely penetrated the expert witness community. Nor have they addressed the basic generic match problem incorporating the two types of testing error. Hence we believe our basic BN solution provides an important mechanism for convincing experts—and eventually the legal community—that it is possible to rigorously analyse and communicate the full impact of match evidence on a case, in the presence of possible errors. (shrink)

Fenton et al. present a Bayesian‐network analysis of the case, using their previously developed set of building blocks (‘idioms’). They claim that these idioms, combined with their opportunity‐based method for estimating the prior probability of guilt, reduce the subjectivity of their analysis. Although their Bayesian model is less cognitively feasible than scenario‐ or argumentation‐based models, they claim that it does model the standard approach to legal proof, which is to continually revise beliefs under new evidence.

A Bayesian network (BN) is a graphical model of uncertainty that is especially well suited to legal arguments. It enables us to visualize and model dependencies between different hypotheses and pieces of evidence and to calculate the revised probability beliefs about all uncertain factors when any piece of new evidence is presented. Although BNs have been widely discussed and recently used in the context of legal arguments, there is no systematic, repeatable method for modeling legal arguments as BNs. Hence, where (...) BNs have been used in the legal context, they are presented as completed pieces of work, with no insights into the reasoning and working that must have gone into their construction. This means the process of building BNs for legal arguments is ad hoc, with little possibility for learning and process improvement. This article directly addresses this problem by describing a method for building useful legal arguments in a consistent and repeatable way. The method complements and extends recent work by Hepler, Dawid, and Leucari (2007) on object-oriented BNs for complex legal arguments and is based on the recognition that such arguments can be built up from a small number of basic causal structures (referred to as idioms). We present a number of examples that demonstrate the practicality and usefulness of the method. (shrink)

This paper arose out of the 2017 international conference on AI and law doctoral consortium. There were five students who presented their Ph.D. work, and each of them has contributed a section to this paper. The paper offers a view of what topics are currently engaging students, and shows the diversity of their interests and influences.

In this paper, we continue our research on a hybrid narrative-argumentative approach to evidential reasoning in the law by showing the interaction between factual reasoning (providing a proof for ‘what happened’ in a case) and legal reasoning (making a decision based on the proof). First we extend the hybrid theory by making the connection with reasoning towards legal consequences. We then emphasise the role of legal stories (as opposed to the factual stories of the hybrid theory). Legal stories provide a (...) coherent, holistic legal perspective on a case. They steer what needs to be proven but are also selected on the basis of what can be proven. We show how these legal stories can be used to model a shift of the legal perspective on a case, and we discuss how gaps in a legal story can be filled using a factual story (i.e. the process of reasoning with circumstantial evidence). Our model is illustrated by a discussion of the Dutch Wamel murder case. (shrink)

In this paper, we look at reasoning with evidence and facts in criminal cases. We show how this reasoning may be analysed in a dialectical way by means of critical questions that point to typical sources of doubt. We discuss critical questions about the evidential arguments adduced, about the narrative accounts of the facts considered, and about the way in which the arguments and narratives are connected in an analysis. Our treatment shows how two different types of knowledge, represented as (...) schemes, play a role in reasoning with evidence: argumentation schemes and story schemes. (shrink)

We provide a retrospective of 25 years of the International Conference on AI and Law, which was first held in 1987. Fifty papers have been selected from the thirteen conferences and each of them is described in a short subsection individually written by one of the 24 authors. These subsections attempt to place the paper discussed in the context of the development of AI and Law, while often offering some personal reactions and reflections. As a whole, the subsections build into (...) a history of the last quarter century of the field, and provide some insights into where it has come from, where it is now, and where it might go. (shrink)

In this paper, I have two primary goals. First, I show that the causal-based story approach in A hybrid formal theory of arguments, stories and criminal evidence is ill suited to negative causation. In the literature, the causal-based approach requires that hypothetical stories be causally linked to the explanandum. Many take these links to denote physical or psychological causation, or temporal precedence. However, understanding causality in those terms, as I will show, cannot capture cases of negative causation, which are of (...) interest to the Law. In keeping with this, I also discuss some of the difficulties Hybrid Theory invites by remaining silent on the nature of the causal links. In my second aim, I sketch a way for Hybrid Theory to overcome this problem. By replacing the original, underlying causal structure with contrastive causation in the law, Hybrid Theory can represent reasoning in which the evidence that is appealed to is causally linked via negative causation to the explananda. (shrink)

The first issue of _Artificial Intelligence and Law_ journal was published in 1992. This paper discusses several topics that relate more naturally to groups of papers than a single paper published in the journal: ontologies, reasoning about evidence, the various contributions of Douglas Walton, and the practical application of the techniques of AI and Law.