Adding options to us local LLM's like GPT4all, or alpaca #141
CreeperNinjaYT
started this conversation in
Ideas
Replies: 1 comment
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I think it would be fantastic if the Smart Connections plugin could utilize a local language model (LLM) on our own computers for searching and smart connections.
One idea is to incorporate the alpaca.cpp program into Smart Connections and provide a way for users to direct the plugin to the LLM they've downloaded on their own PC.
This would give users the flexibility to switch to more advanced LLMs as they become available, without requiring significant changes in the code of the plugin.
Beta Was this translation helpful? Give feedback.
All reactions