Evaluation of information retrieval for E-discovery

Artificial Intelligence and Law 18 (4):347-386 (2010)

Stephen Tomlinson
University of Alabama
The effectiveness of information retrieval technology in electronic discovery (E-discovery) has become the subject of judicial rulings and practitioner controversy. The scale and nature of E-discovery tasks, however, has pushed traditional information retrieval evaluation approaches to their limits. This paper reviews the legal and operational context of E-discovery and the approaches to evaluating search technology that have evolved in the research community. It then describes a multi-year effort carried out as part of the Text Retrieval Conference to develop evaluation methods for responsive review tasks in E-discovery. This work has led to new approaches to measuring effectiveness in both batch and interactive frameworks, large data sets, and some surprising results for the recall and precision of Boolean and statistical information retrieval methods. The paper concludes by offering some thoughts about future research in both the legal and technical communities toward the goal of reliable, effective use of information retrieval in E-discovery
Keywords E-discovery  Information retrieval  Interactive search  Evaluation
Categories (categorize this paper)
DOI 10.1007/s10506-010-9093-9
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

Our Archive

Upload a copy of this paper     Check publisher's policy     Papers currently archived: 49,066
External links

Setup an account with your affiliations in order to access resources via your University's proxy server
Configure custom proxy (use this if your affiliation does not provide a proxy)
Through your library

References found in this work BETA

No references found.

Add more references

Citations of this work BETA

Afterword: Data, Knowledge, and E-Discovery. [REVIEW]David D. Lewis - 2010 - Artificial Intelligence and Law 18 (4):481-486.

Add more citations

Similar books and articles

Innovative Techniques for Legal Text Retrieval.Marie-Francine Moens - 2001 - Artificial Intelligence and Law 9 (1):29-57.
The Structuring of Legal Knowledge in Lois.Wim Peters, Maria-Teresa Sagri & Daniela Tiscornia - 2007 - Artificial Intelligence and Law 15 (2):117-135.
Text Retrieval in the Legal World.Howard Turtle - 1995 - Artificial Intelligence and Law 3 (1-2):5-54.
Task Unrelated Thought Whilst Encoding Information.M. J., F. S., M. Lowe & M. Obonsawin - 2003 - Consciousness and Cognition 12 (3):452-484.
Retrieval Dynamics and Brain Mechanisms.Douglas L. Hintzman - 1999 - Behavioral and Brain Sciences 22 (3):453-454.


Added to PP index

Total views
76 ( #119,181 of 2,311,196 )

Recent downloads (6 months)
12 ( #59,045 of 2,311,196 )

How can I increase my downloads?


My notes

Sign in to use this feature