Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

questions about the test set of 43 queries #20

Open
33hzs opened this issue May 31, 2024 · 1 comment
Open

questions about the test set of 43 queries #20

33hzs opened this issue May 31, 2024 · 1 comment

Comments

@33hzs
Copy link

33hzs commented May 31, 2024

I want to find the test set file of 43 queries, but I can't find it. For example, for paragraph retrieval, the document mentions that there is a reusable test set containing 43 queries. Which of the following compressed packages should I find it in?
collection.tar.gz
queries.tar.gz
qrels.dev.tsv
grels.train.tsv
collectionandqueries.tar.gz
triples.train.small.tar.gz
triples.train.full.tsv.gz
qidpidtriples.train.full.2.tsv.gz
top1000.train.tar.gz
top 1000.dev.tar.gz
msmarco-test2019-queries.tsv
msmarco-passagetest2019-
top 1000.tsv
2019grels-pass.txt

@bmitra-msft
Copy link
Member

bmitra-msft commented Jun 10, 2024

2019qrels-pass and 2019qrels-docs are the correct files to look at the for the two tasks in the 2019 TREC DL track, respectively.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants