Sync dev to main 1.0.5 #1817
Closed
Sync dev to main 1.0.5 #1817
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
chore: cleanup httplib
* feat: model estimation * fix: cleanup and improve * chore: cleanup * chore: API docs * chore: CLI docs * fix: correct calculation * fix: handle macOS * chore: typo --------- Co-authored-by: vansangpfiev <[email protected]>
fix: floating point for models endpoint
Co-authored-by: vansangpfiev <[email protected]>
…cumentation Chore/update structured output documentation
* chore: config_yaml_utils * chore: file_manager_utils * chore: curl_utils * chore: system_info_utils * chore: clean e2e tests * fix: build macos * fix: docker e2e tests * fix: e2e docker * fix: e2e tests --------- Co-authored-by: vansangpfiev <[email protected]>
feat: add messages api
docs: fix tools should be array not object
* fix: support ctx_len for model start cli * chore: docs * fix: guard max ctx_len
* Init remote engine * Fix: CI build windows * Fix: CI build windows * Fix: CI build windows * Fix: CI build windows * feat: new db schema for model and template for engine * Add remote model * Add Get, List, Update support for remote models * change model_id to model in remote engine * fix: mac compatibility * chore: some refactors before making big changes * feat: db ops for engines * chore: small refactor before more changes * Update engine * refine db schema, composite key for engines * add entry definition for engine at db layer * complete add, get engine operations * engine managements * Integrate with remote engine to run remote model * error handling and response transform * Support for stream request * chore: fix conflicts * feat: anthropic * feat: support anthropic * feat: support anthropic * chore: rename * chore: cleanup and fix unit tests * fix: issue with db * chore: refactor remote engine * fix: e2e tests * fix: e2e tests * chore: API docs * fix: use different interface for remote engine --------- Co-authored-by: Luke Nguyen <[email protected]> Co-authored-by: vansangpfiev <[email protected]> Co-authored-by: vansangpfiev <[email protected]>
feat: add thread
* fix: deadlock when unload engine * fix: add lock
* feat: add assistants * add pagination messages * allow edit content of message
Co-authored-by: Hien To <[email protected]>
* fix: create assistant * fix ci
* feat: prioritize GPUs * fix: migrate db * fix: add priority * fix: db * fix: more * fix: migration --------- Co-authored-by: vansangpfiev <[email protected]>
* chore: add document * feat: update engine interface
* fix: stop inflight chat completion * chore: bypass docker e2e test * fix: comments --------- Co-authored-by: vansangpfiev <[email protected]>
Co-authored-by: Hien To <[email protected]>
* feat: add files api * add backward support * add db support * fix link issue on windows
* feat: prioritize GPUs * fix: migrate db * fix: add priority * fix: db * fix: more * feat: model sources * feat: support delete API * feat: cli: support models sources add * feat: cli: model source delete * feat: cli: add model source list * feat: sync cortex.db * chore: cleanup * feat: add metadata for model * fix: migration * chore: unit tests: cleanup * fix: add metadata * fix: pull model * chore: unit tests: update * chore: add e2e tests for models sources * chore: add API docs * chore: rename --------- Co-authored-by: vansangpfiev <[email protected]>
Signed-off-by: James <[email protected]>
* fix: load engine linux * fix linux --------- Co-authored-by: vansangpfiev <[email protected]>
Co-authored-by: vansangpfiev <[email protected]>
* fix: improve streaming message for remote engine * feat: improve remote engine * chore: cleanup * fix: correct remote engine check * chore: add unit tests * fix: cleanup * chore: cleanup --------- Co-authored-by: vansangpfiev <[email protected]>
* fix: check cpu info size * fix: sort gpus
* fix: only use dll search path if ENGINE_PATH is not set * chore: remove unused
* fix: check cpu info size * fix: sort gpus * chore: add log for cpu instructions * fix: add guard
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Describe Your Changes
Self Checklist