Evaluating a legal argument program: The BankXX experiments [Book Review]

Artificial Intelligence and Law 5 (1-2):1-74 (1997)


In this article we evaluate the BankXX program from several perspectives. BankXX is a case-based legal argument program that retrieves cases and other legal knowledge pertinent to a legal argument through a combination of heuristic search and knowledge-based indexing. The program is described in detail in a companion article in Artificial Intelligence and Law 4: 1--71, 1996. Three perspectives are used to evaluate BankXX:(1) classical information retrieval measures of precision and recall applied against a hand-coded baseline; (2) knowledge-representation and case-based reasoning, where the baseline is provided by the functionality of a well-known case-based argument program, HYPO (Ashley, 1990); and (3) search, in which the performance of BankXX run with various parameter settings, for instance, resource limits, is compared. In this article we report on an extensive series of experiments performed to evaluate the program. We also describe two additional experiments concerning(1) the program's search behavior; and (2) the use of a modified form of precision and recall based on case similarity. Finally we offer some general conclusions that might be drawn from these particular experiments.

Download options


    Upload a copy of this work     Papers currently archived: 72,766

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library


Added to PP

71 (#165,630)

6 months
1 (#386,989)

Historical graph of downloads
How can I increase my downloads?

References found in this work

The Uses of Argument.Stephen E. Toulmin - 1958 - Cambridge University Press.
The New Rhetoric: A Treatise on Argumentation.Chaïm Perelman & Lucie Olbrechts-Tyteca - 1969 - Notre Dame, IN, USA: Notre Dame University Press.
The Uses of Argument.Stephen E. Toulmin - 1958 - Philosophy 34 (130):244-245.

View all 9 references / Add more references