This archive contains the IDs of all 167,728 comparable text pairs extracted from the English Gigaword Fifth Edition (Parker et al., 2011). Each file lists all such documents for a given pair of newswire sources. In addition to the document IDs, the files contain corresponding similarity scores of a document pairing in the first column each.

If you want to use the data for your own work, please cite Roth and Frank (2012). In case of questions, please do not hesitate to get in touch with the first author at mroth@cl.uni-heidelberg.de.

--
Michael Roth and Anette Frank (2012). Aligning predicate argument structures in monolingual comparable texts: A new corpus for a new task. Proceedings of the First Joint Conference on Lexical and Computational Semantics (*SEM), Montreal, Canada.

Robert Parker, David Graff, Junbo Kong, Ke Chen and Kazuaki Maeda (2011). English Gigaword Fifth Edition. Linguistic Data Consortium, Philadelphia.