Journal article

A bayesian approach to discovering truth from conflicting sources for data integration

B Zhao, BIP Rubinstein, J Gemmell, J Han

Proceedings of the VLDB Endowment | Published : 2012

Abstract

In practical data integration systems, it is common for the data sources being integrated to provide conflicting information about the same entity. Consequently, a major challenge for data integration is to derive the most complete and accurate integrated records from diverse and sometimes conflicting sources. We term this challenge the truth finding problem. We observe that some sources are generally more reliable than others, and therefore a good model of source quality is the key to solving the truth finding problem. In this work, we propose a probabilistic graphical model that can automatically infer true records and source quality without any supervision. In contrast to previous methods..

View full abstract

University of Melbourne Researchers

Grants

Awarded by U.S. Army Research Laboratory


Funding Acknowledgements

We thank Ashok Chandra, Duo Zhang, Sahand Negahban and three anonymous reviewers for their valuable comments. The work was supported in part by the U.S. Army Research Laboratory under Cooperative Agreement No. W911NF-09-2-0053 (NS-CTA).