Conference Proceedings

ParaMetric: An automatic evaluation metric for paraphrasing

C Callison-Burch, T Cohn, M Lapata

Coling 2008 - 22nd International Conference on Computational Linguistics, Proceedings of the Conference | Published : 2008

Abstract

We present ParaMetric, an automatic evaluation metric for data-driven approaches to paraphrasing. ParaMetric provides an objective measure of quality using a collection of multiple translations whose paraphrases have been manually annotated. ParaMetric calculates precision and recall scores by comparing the paraphrases discovered by automatic paraphrasing techniques against gold standard alignments of words and phrases within equivalent sentences. We report scores for several established paraphrasing techniques. © 2008 Licensed under the Creative Commons.

Citation metrics