Conference Proceedings

Revisiting Spam Filtering in Web Search

Luke Gallagher, Joel Mackenzie, J Shane Culpepper

ADCS'18: PROCEEDINGS OF THE 23RD AUSTRALASIAN DOCUMENT COMPUTING SYMPOSIUM | ASSOC COMPUTING MACHINERY | Published : 2018

Abstract

The Waterloo spam scores are now a commonly used static document feature in web collections such as ClueWeb. This feature can be used as a post-retrieval filter, as a document prior, or as one of many features in a Learning-to-Rank system. In this work, we highlight the risks associated with using spam scores as a post-retrieval filter, which is now common practice in experiments with the ClueWeb test collection. While it increases the average evaluation score and boosts the performance of some topics, it can significantly harm the performance of others. Through a detailed failure analysis, we show that simple spam filtering is a high risk practice that should be avoided in future work, part..

View full abstract

Grants

Awarded by Australian Research Council


Funding Acknowledgements

This work was supported by the Australian Research Council's Discovery Projects Scheme (DP170102231), and an Australian Government Research Training Program Scholarship.