Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve AMR alignment / ConceptNet output #39

Open
namednil opened this issue Jul 14, 2019 · 3 comments
Open

Improve AMR alignment / ConceptNet output #39

namednil opened this issue Jul 14, 2019 · 3 comments
Labels
mrp2019 Issues related to the MRP 2019 shared task nice-to-have Not essential

Comments

@namednil
Copy link
Contributor

While our results using ConceptNet (+ CoreNLP) are still ok, the data seems to be much more noisy, resulting in a drop in supertagging accuracy and LAS.

What ways are there to improve this?

  • can we count calls of ConceptNet with input, output pairs and see if there are frequent calls that have unexpected or suboptimal outputs and fix the most frequent ones by handwritten rules?

Is that feasible in a reasonable amount of time?

@namednil namednil added essential Essential for MRP shared task nice-to-have Not essential mrp2019 Issues related to the MRP 2019 shared task and removed essential Essential for MRP shared task labels Jul 14, 2019
@alexanderkoller
Copy link
Contributor

It is easy to count the calls, but the problem is that ConceptNet only provides options for the aligner. Which ones the aligner ends up choosing is much harder to count, and I don't have a clear idea how to do it.

Can we meet tomorrow (Mon) and talk about it?

@namednil
Copy link
Contributor Author

I see.

Can we meet tomorrow (Mon) and talk about it?

Sure, I'm available from 16:00 (I have an exam before).

@namednil
Copy link
Contributor Author

Would it help I compiled a small corpus where our decomposition got worse?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
mrp2019 Issues related to the MRP 2019 shared task nice-to-have Not essential
Projects
None yet
Development

No branches or pull requests

2 participants