Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Paloma release #19

Merged
merged 77 commits into from
Dec 13, 2023
Merged

Paloma release #19

merged 77 commits into from
Dec 13, 2023

Conversation

IanMagnusson
Copy link
Contributor

@IanMagnusson IanMagnusson commented Dec 5, 2023

This is a PR of the minimal code needed to run inference on Paloma and get results out in the format used by the Paloma benchmark. For the time being this is still dependent on downloading the files locally from the HF dataset.

I tested that this runs and outputs results in the correct format. It does depend on some changes I am still trying to get access to push to the Paloma HF Hub repo.

I think this PR should be sufficient for the initial Paloma release.

Changes proposed in this pull request:

  • minimal example of how to run Paloma from HF hub as well as step to output results in jsonl.gz format

Before submitting

  • I've read and followed all steps in the Making a pull request
    section of the CONTRIBUTING docs.
  • I've updated or added any relevant docstrings following the syntax described in the
    Writing docstrings section of the CONTRIBUTING docs.
  • If this PR fixes a bug, I've added a test that will fail without my fix.
  • If this PR adds a new feature, I've added tests that sufficiently cover my new functionality.

@IanMagnusson IanMagnusson marked this pull request as ready for review December 5, 2023 19:33
@IanMagnusson IanMagnusson requested a review from AkshitaB December 5, 2023 19:33
@AkshitaB AkshitaB merged commit 0c43f87 into main Dec 13, 2023
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants