Missing evidence passages

[yumoxu]

Hello authors, thank you for the great work!

Quick question regarding the released data data/r2_compiled_anon.jsonl: it seems many entries have URLs only for claim["evidence"], rather than URL+ passage.

I was wondering if this means the evidence is inaccessible and the claim thus falls into the support=="N/A" category. But this does not seem to be always true after further inspection.

Evidence passages are necessary for model evaluation (please correct me if I am wrong). Could you share the best way to retrieve them for these URLs? Thank you!

[chaitanyamalaviya]

Hi @yumoxu , thanks for your interest! We added the file with all evidence passages at data/r2_compiled_all_evidences_autoais_anon.jsonl. Let us know if you have any more questions.