New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Finetune LLM model for Classification task #1839

Open

Mustehsen-AI opened this issue Nov 27, 2024 · 0 comments

Labels

question

Mustehsen-AI commented Nov 27, 2024

I am following your book content Build a Large Language Model (From Scratch)
Its really great if anybody want to get
https://www.amazon.com/Build-Large-Language-Model-Scratch/dp/1633437167

I did not find much resources / examples for classification fine tuning using litgpt let me know if you have made?

How to change final layer from vocab size to 2 for spam message spam classification
How to adjust code for data with Text and Labels instead of json type custom dataset for instruction
which files i need to modified to get results

Mustehsen-AI added the question label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment