Evaluating high accuracy retrieval techniques

Chirag Shah, W. Bruce Croft

Research output: Chapter in Book/Report/Conference proceedingConference contribution

49 Scopus citations

Abstract

Although information retrieval research has always been concerned with improving the effectiveness of search, in some applications, such as information analysis, a more specific requirement exists for high accuracy retrieval. This means that achieving high precision in the top document ranks is paramount. In this paper we present work aimed at achieving high accuracy in ad-hoc document retrieval by incorporating approaches from question answering (QA). We focus on getting the first relevant result as high as possible in the ranked list and argue that traditional precision and recall are not appropriate measures for evaluating this task. We instead use the mean reciprocal rank (MRR) of the first relevant result. We evaluate three different methods for modifying queries to achieve high accuracy. The experiments done on TREC data provide support for the approach of using MRR and incorporating QA techniques for getting high accuracy in ad-hoc retrieval task.

Original languageEnglish (US)
Title of host publicationProceedings of Sheffield SIGIR - Twenty-Seventh Annual International ACM SIGIR Conference on Research and Development in Information Retrieval
PublisherAssociation for Computing Machinery
Pages2-9
Number of pages8
ISBN (Print)1581138814, 9781581138818
DOIs
StatePublished - 2004
Externally publishedYes
EventProceedings of Sheffield SIGIR - Twenty-Seventh Annual International ACM SIGIR Conference on Research and Development in Information Retrieval - Sheffield, United Kingdom
Duration: Jul 25 2004Jul 29 2004

Publication series

NameProceedings of Sheffield SIGIR - Twenty-Seventh Annual International ACM SIGIR Conference on Research and Development in Information Retrieval

Other

OtherProceedings of Sheffield SIGIR - Twenty-Seventh Annual International ACM SIGIR Conference on Research and Development in Information Retrieval
Country/TerritoryUnited Kingdom
CitySheffield
Period7/25/047/29/04

All Science Journal Classification (ASJC) codes

  • Engineering(all)

Keywords

  • Ad-hoc retrieval
  • High accuracy retrieval
  • Question answering

Fingerprint

Dive into the research topics of 'Evaluating high accuracy retrieval techniques'. Together they form a unique fingerprint.

Cite this