Google Research

XSum Hallucination Annotations

Description

The dataset consists of faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" at ACL 2020. We have crowdsourced 3 judgements for each of 500x5 document-system pairs.