Revisiting Spam Filtering in Web Search
Luke Gallagher, Joel Mackenzie, J Shane Culpepper
ADCS'18: PROCEEDINGS OF THE 23RD AUSTRALASIAN DOCUMENT COMPUTING SYMPOSIUM | ASSOC COMPUTING MACHINERY | Published : 2018
The Waterloo spam scores are now a commonly used static document feature in web collections such as ClueWeb. This feature can be used as a post-retrieval filter, as a document prior, or as one of many features in a Learning-to-Rank system. In this work, we highlight the risks associated with using spam scores as a post-retrieval filter, which is now common practice in experiments with the ClueWeb test collection. While it increases the average evaluation score and boosts the performance of some topics, it can significantly harm the performance of others. Through a detailed failure analysis, we show that simple spam filtering is a high risk practice that should be avoided in future work, part..View full abstract
Awarded by Australian Research Council
This work was supported by the Australian Research Council's Discovery Projects Scheme (DP170102231), and an Australian Government Research Training Program Scholarship.