Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PEFT template #4

Merged
merged 21 commits into from
May 23, 2024
Merged

PEFT template #4

merged 21 commits into from
May 23, 2024

Conversation

avishniakov
Copy link
Contributor

@avishniakov avishniakov commented May 16, 2024

Describe changes

This is a PEFT-driven template for LLM fine-tuning.

I had to heavily cut down the testing coverage since it is way too much workload to run fine-tuning of even small LLMs on GH runners.

Pre-requisites

Please ensure you have done the following:

  • If my change requires a change to docs, I have updated the documentation accordingly.
  • I have added tests to cover my changes.
  • I have updated ref-zenml in .github/workflows/ci.yml accordingly (if you don't know - main would be a solid choice)

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)
  • Other (add details above)

Copy link
Contributor

Images automagically compressed by Calibre's image-actions

Compression reduced images by 37.8%, saving 83.97 KB.

Filename Before After Improvement Visual comparison
template/.assets/model.png 148.06 KB 92.78 KB -37.3% View diff
template/.assets/pipeline.png 73.97 KB 45.28 KB -38.8% View diff

@avishniakov avishniakov requested review from strickvl and schustmi May 16, 2024 17:00
@avishniakov avishniakov requested a review from strickvl May 23, 2024 12:23
@avishniakov avishniakov mentioned this pull request May 23, 2024
9 tasks
@avishniakov avishniakov merged commit 0dc4bfd into main May 23, 2024
14 checks passed
@avishniakov avishniakov deleted the feature/OSSK-521-peft-template branch May 23, 2024 14:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants