Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add LLM locally #117

Closed
JdFSilva opened this issue Oct 7, 2024 · 0 comments · Fixed by #123
Closed

Add LLM locally #117

JdFSilva opened this issue Oct 7, 2024 · 0 comments · Fixed by #123
Assignees
@JdFSilva
Milestone
Code Monkey - alpha5

Comments

@JdFSilva
Copy link
Contributor

JdFSilva commented Oct 7, 2024

Currently we create requests to LLM APIs for local development. The purpose of this is to find a solution that doesn't involve making calls to LLM APIs
@kenvontucky kenvontucky added this to the Code Monkey - alpha5 milestone Oct 7, 2024
@JdFSilva JdFSilva self-assigned this Oct 16, 2024
@JdFSilva JdFSilva mentioned this issue Oct 16, 2024
Merged
JdFSilva added a commit that referenced this issue Oct 22, 2024
@JdFSilva
[#117] Add LLM locally (#123)
f5a86bd 
* Remove unused RequestLiteLLM.completion() method

* Add LocalLLM class

* Install ollama

* Add makefile commands to run llama3.2 locally

* Add test for local LLM connection

* Add environment variable for LOCAL_LLM connection

* Patch LOCAL_LLM settings variable

* Move LOCAL_LLM host to env variable

* Create test specific to check if local_llm class is redirecting properly

* Trigger run-tests

* Trigger run-tests
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@JdFSilva JdFSilva

Labels
None yet
Projects
None yet
Milestone
Code Monkey - alpha5
Development

Successfully merging a pull request may close this issue.

[#117] Add LLM locally runtimerevolution/labs
2 participants
@kenvontucky @JdFSilva