Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add support for using dynamic threads #756

Merged
merged 1 commit into from
Sep 20, 2023
Merged

Add support for using dynamic threads #756

merged 1 commit into from
Sep 20, 2023

Conversation

gaby
Copy link
Member

@gaby gaby commented Sep 20, 2023

Dynamically determine how many threads are available for the process and pass those to llama-cpp

@gaby gaby merged commit 646daa6 into main Sep 20, 2023
9 checks passed
@gaby gaby deleted the dynamic-threads branch September 20, 2023 03:10
@gaby gaby restored the dynamic-threads branch September 25, 2023 15:57
gaby added a commit that referenced this pull request Sep 25, 2023
@gaby
Revert "Add support for using dynamic threads (#756)"
065f778 
This reverts commit 646daa6.
@gaby gaby mentioned this pull request Sep 25, 2023
Merged
gaby added a commit that referenced this pull request Sep 26, 2023
@gaby
Revert "Add support for using dynamic threads" (#770)
bc50e7b 
* Revert "Add support for using dynamic threads (#756)"

This reverts commit 646daa6.

* Update llm.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
✏️ Feature
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@gaby