Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replication for MS MARCO Passage and Doc #1369

Merged
merged 1 commit into from
Sep 8, 2020
Merged

Replication for MS MARCO Passage and Doc #1369

merged 1 commit into from
Sep 8, 2020

Conversation

qguo96
Copy link
Contributor

@qguo96 qguo96 commented Sep 8, 2020

Replication is successful.

Environment:
OS: Ubuntu-18.04.4 LTS
Java: 11.0.8
Maven: 3.6.3

results are shown below:

  • MS MARCO Passage
    Screenshot (1154)

  • MS MARCO Doc
    Screenshot (1151)
    Screenshot (1153)

@qguo96
Copy link
Contributor Author

qguo96 commented Sep 8, 2020

When I followed the Anserini Notebooks, I found the path to trec_eval is outdated. Instead, it should be tools/eval/trec_eval.9.0.4/trec_eval.

@codecov
Copy link

codecov bot commented Sep 8, 2020

Codecov Report

Merging #1369 into master will decrease coverage by 0.18%.
The diff coverage is n/a.

Impacted file tree graph

@@             Coverage Diff              @@
##             master    #1369      +/-   ##
============================================
- Coverage     53.64%   53.46%   -0.19%     
+ Complexity      828      820       -8     
============================================
  Files           154      154              
  Lines          8627     8627              
  Branches       1224     1224              
============================================
- Hits           4628     4612      -16     
- Misses         3622     3637      +15     
- Partials        377      378       +1     
Impacted Files Coverage Δ Complexity Δ
...java/io/anserini/ltr/feature/CountBigramPairs.java 70.12% <0.00%> (-19.49%) 26.00% <0.00%> (-7.00%)
...anserini/ltr/feature/base/PMIFeatureExtractor.java 84.61% <0.00%> (-1.93%) 12.00% <0.00%> (-1.00%)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e16b3c1...577855c. Read the comment docs.

@lintool lintool merged commit 0f9a8ec into castorini:master Sep 8, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants