Journal article

A pipelined architecture for distributed text query evaluation

Alistair Moffat, William Webber, Justin Zobel, Ricardo Baeza-Yates

INFORMATION RETRIEVAL | SPRINGER | Published : 2007

Abstract

Two principal query-evaluation methodologies have been described for cluster-based implementation of distributed information retrieval systems: document partitioning and term partitioning. In a document-partitioned system, each of the processors hosts a subset of the documents in the collection, and executes every query against its local sub-collection. In a term-partitioned system, each of the processors hosts a subset of the inverted lists that make up the index of the collection, and serves them to a central machine as they are required for query evaluation. In this paper we introduce a pipelined query-evaluation methodology, based on a term-partitioned index, in which partially evaluated..

View full abstract