Skip to content

Commit

Permalink
Unicoil reproduction (#699)
Browse files Browse the repository at this point in the history
add reproduction log
  • Loading branch information
ArthurChen189 authored Jul 14, 2021
1 parent a3613c3 commit ed88e4c
Showing 1 changed file with 4 additions and 3 deletions.
7 changes: 4 additions & 3 deletions docs/experiments-unicoil.md
Original file line number Diff line number Diff line change
Expand Up @@ -56,16 +56,16 @@ We can now run retrieval:

```bash
$ python -m pyserini.search --topics collections/topics.msmarco-passage.dev-subset.unicoil.tsv \
--index indexes/lucene-index.msmarco-passage-deepimpact-b8 \
--output runs/run.msmarco-passage-deepimpact-b8.tsv \
--index indexes/lucene-index.msmarco-passage-unicoil-b8 \
--output runs/run.msmarco-passage-unicoil-b8.tsv \
--impact \
--hits 1000 --batch 36 --threads 12 \
--output-format msmarco
```

Evaluate:
```bash
$ python -m pyserini.eval.msmarco_passage_eval msmarco-passage-dev-subset runs/run.msmarco-passage-deepimpact-b8.tsv
$ python -m pyserini.eval.msmarco_passage_eval msmarco-passage-dev-subset runs/run.msmarco-passage-unicoil-b8.tsv
```

The results should be as follows:
Expand All @@ -79,3 +79,4 @@ QueriesRanked: 6980


## Reproduction Log[*](reproducibility.md)
+ Results reproduced by [@ArthurChen189](https://github.com/ArthurChen189) on 2021-07-13 (commit [`228d5c9`](https://github.com/castorini/pyserini/commit/228d5c9c4ae0810702feccf8829b71682dd4955c))

0 comments on commit ed88e4c

Please sign in to comment.