Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Data format questions #8

Closed
danieldeutsch opened this issue Oct 8, 2020 · 2 comments
Closed

Data format questions #8

danieldeutsch opened this issue Oct 8, 2020 · 2 comments

Comments

@danieldeutsch
Copy link

This is very interesting work! Thanks for sharing the data.

I have two questions about the data:

  1. Is the original reference summary always the first summary in the references list in the jsonl file with the human annotations?
  2. Several of the model outputs have multiple aligned files (e.g., M23). Is there an easy way to identify which file contains the summaries which were judged?
@Alex-Fabbri
Copy link
Contributor

Hi Daniel,
Thanks for your interest and sorry for the delay!

  1. Yes.
  2. I'm attaching the mapping from model number to path: human_annotation_mapping.txt.

@danieldeutsch
Copy link
Author

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@Alex-Fabbri @danieldeutsch