Is it possible to do inference on CPU for this model trained using PEFT? #296
Unanswered
vatsalsaglani
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I was successful in fine-tuning the model on my dataset. But is it possible to do inference using the fine-tuned PEFT model on CPU? If so, could any one point me to an official guide or a jupyter notebook or something?
Beta Was this translation helpful? Give feedback.
All reactions