You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The last piece of the puzzle. Textgeneration webui uses this library, and because of the rope factors are added as a tensor, an error is returned saying it received the incorrect number of tensors. When trying to load a model converted to gguf using the latest llama.cpp code.
llama.cpp release b3472 added support for llama 3.1.
Could you please bump the llama.cpp version?
The text was updated successfully, but these errors were encountered: