Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

BERTScore Implementation #365

Closed
satyajitghana opened this issue Jul 10, 2021 · 4 comments · Fixed by #424
Closed

BERTScore Implementation #365

satyajitghana opened this issue Jul 10, 2021 · 4 comments · Fixed by #424
Labels
enhancement New feature or request help wanted Extra attention is needed topic: Text
Milestone
v0.5

Comments

@satyajitghana
Copy link

🚀 Feature

BertScore Implementation for TextGeneration in NLP

Motivation

BERTScore computes a similarity score for each token in the candidate sentence with each token in the reference sentence. However, instead of exact matches, we compute token similarity using contextual embeddings.

Pitch

need an api like bert_score(translate_corpus, reference_corpus, ...)

Related Paper: https://arxiv.org/abs/1904.09675

A Really Good Explanation: https://wiki.math.uwaterloo.ca/statwiki/index.php?title=BERTScore:_Evaluating_Text_Generation_with_BERT

Alternatives

This is an implementation: https://github.com/Tiiiger/bert_score
@satyajitghana satyajitghana added enhancement New feature or request help wanted Extra attention is needed labels Jul 10, 2021
@github-actions
Copy link

Hi! thanks for your contribution!, great first issue!

@Borda Borda added this to the v0.5 milestone Jul 10, 2021
@gagan3012
Copy link
Contributor

Can I work on this?

@SkafteNicki
Copy link
Member

@gagan3012 still interested in implementing this?

@gagan3012
Copy link
Contributor

Yes I am!

@gagan3012 gagan3012 mentioned this issue Aug 3, 2021
Merged
4 tasks
@Borda Borda closed this as completed in #424 Aug 8, 2021
@Borda Borda added this to the v0.5 milestone Aug 18, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request help wanted Extra attention is needed topic: Text
Projects
None yet
Milestone
v0.5
Development

Successfully merging a pull request may close this issue.

Adding BERTScore metric gagan3012/metrics
4 participants
@Borda @satyajitghana @SkafteNicki @gagan3012