Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Selected Model is Unsupported #3

Closed
xavierallem opened this issue Apr 12, 2023 · 6 comments
Closed

Selected Model is Unsupported #3

xavierallem opened this issue Apr 12, 2023 · 6 comments
Labels
documentation Improvements or additions to documentation enhancement New feature or request ux-improvements Improvements to the app's UI or UX
Milestone

Comments

@xavierallem
Copy link

xavierallem commented Apr 12, 2023

Using Alpaca and gpt4all

Have the following

  • ggml-alpaca-7b-q4.bin
  • gpt4all-lora-quantized.bin

After selecting the path it shows Selected model is of an unsupported version

image

@alexrozanski
Copy link
Owner

Hey @xavierallem, sorry - the docs and UI aren't super clear on this yet. Looks like you have one of the slightly older model versions. I'm going to add native flows for these cases, but for now you can use:

from the llama.cpp repo to upgrade the models to the new format required by llama.cpp (which LlamaChat uses internally). Lmk if this works!

@alexrozanski alexrozanski added documentation Improvements or additions to documentation enhancement New feature or request labels Apr 12, 2023
@alexrozanski
Copy link
Owner

added some details to the README for now

@danieldunderfelt
Copy link

danieldunderfelt commented Apr 12, 2023

The instructions are quite obtuse. It took me a while to figure out that the tokenizer.model is found among the Llama files.

@alexrozanski
Copy link
Owner

@danieldunderfelt good feedback. I added some more notes in https://github.com/alexrozanski/LlamaChat/blob/main/README.md#-models, but this should really be better supported/documented in the conversion flow

@alexrozanski alexrozanski added the ux-improvements Improvements to the app's UI or UX label Apr 13, 2023
@alexrozanski alexrozanski added this to the v1.3 milestone Apr 17, 2023
@alexrozanski alexrozanski self-assigned this Apr 17, 2023
@alexrozanski alexrozanski moved this to Todo in LlamaChat Apr 17, 2023
@danieldunderfelt
Copy link

@danieldunderfelt good feedback. I added some more notes in https://github.com/alexrozanski/LlamaChat/blob/main/README.md#-models, but this should really be better supported/documented in the conversion flow

Epic, thanks!

@alexrozanski
Copy link
Owner

This is fixed in v1.2.0 -- older models are now supported directly in LlamaChat.

@alexrozanski alexrozanski moved this from Todo to Done in LlamaChat Apr 21, 2023
@alexrozanski alexrozanski removed their assignment Apr 21, 2023
@alexrozanski alexrozanski modified the milestones: v1.3, v1.2 Apr 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation enhancement New feature or request ux-improvements Improvements to the app's UI or UX
Projects
Status: Done
Development

No branches or pull requests

3 participants