Artificial Intelligence and Law 18 (4):431-457 (2010)

Retrieval of relevant unstructured information from the ever-increasing textual communications of individuals and businesses has become a major barrier to effective litigation/defense, mergers/acquisitions, and regulatory compliance. Such e-discovery requires simultaneously high precision with high recall (high-P/R) and is therefore a prototype for many legal reasoning tasks. The requisite exhaustive information retrieval (IR) system must employ very different techniques than those applicable in the hyper-precise, consumer search task where insignificant recall is the accepted norm. We apply Russell, et al.’s cognitive task analysis of sensemaking by intelligence analysts to develop a semi-autonomous system that achieves high IR accuracy of F1 ≥ 0.8 compared to F1 < 0.4 typical of computer-assisted human-assessment (CAHA) or alternative approaches such as Roitblat, et al.’s. By understanding the ‘Learning Loop Complexes’ of lawyers engaged in successful small-scale document review, we have used socio-technical design principles to create roles, processes, and technologies for scalable human-assisted computer-assessment (HACA). Results from the NIST-TREC Legal Track’s interactive task from both 2008 and 2009 validate the efficacy of this sensemaking approach to the high-P/R IR task.
Keywords e-discovery  Sensemaking  Information retrieval
Categories (categorize this paper)
DOI 10.1007/s10506-010-9100-1
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

Our Archive

Upload a copy of this paper     Check publisher's policy     Papers currently archived: 50,342
External links

Setup an account with your affiliations in order to access resources via your University's proxy server
Configure custom proxy (use this if your affiliation does not provide a proxy)
Through your library

References found in this work BETA

No references found.

Add more references

Citations of this work BETA

Afterword: Data, Knowledge, and E-Discovery. [REVIEW]David D. Lewis - 2010 - Artificial Intelligence and Law 18 (4):481-486.

Add more citations

Similar books and articles

A Quantum-Mechanical Automation.David Z. Albert - 1987 - Philosophy of Science 54 (4):577-585.
Review of P. Wahlgren, Automation of Legal Reasoning. [REVIEW]Michael Clark - 1997 - Information and Communications Technology Law 6.
Unblinking Eyes: The Ethics of Automating Surveillance.Kevin Macnish - 2012 - Ethics and Information Technology 14 (2):151-167.
Ethical Blindness.Guido Palazzo, Franciska Krings & Ulrich Hoffrage - 2012 - Journal of Business Ethics 109 (3):323-338.
Structuring Legal Institutions.P. W. - 1998 - Law and Philosophy 17 (3):215-232.
Structuring Legal Institutions.Dick W. P. Ruiter - 1998 - Law and Philosophy 17 (3):215 - 232.
Freedom an D Uncertainty.Ingrid Molderez - 1999 - Emergence: Complexity and Organization 1 (3):84-91.
Causation in AI and Law.Jos Lehmann, Joost Breuker & Bob Brouwer - 2004 - Artificial Intelligence and Law 12 (4):279-315.


Added to PP index

Total views
44 ( #212,071 of 2,326,047 )

Recent downloads (6 months)
10 ( #63,629 of 2,326,047 )

How can I increase my downloads?


My notes