[pull] master from mudler:master #83
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![pull[bot]](https://avatars.githubusercontent.com/in/12910?s=60&v=4){kind=small}
Signed-off-by: Ettore Di Giacinto <[email protected]>
* Wip p2p enhancements * get online state * Pass-by token to show in the dashboard Signed-off-by: Ettore Di Giacinto <[email protected]> * Style * Minor fixups * parametrize SearchID * Refactoring * Allow to expose/bind more services Signed-off-by: Ettore Di Giacinto <[email protected]> * Add federation * Display federated mode in the WebUI Signed-off-by: Ettore Di Giacinto <[email protected]> * Small fixups Signed-off-by: Ettore Di Giacinto <[email protected]> * make federated nodes visible from the WebUI * Fix version display * improve web page * live page update * visual enhancements * enhancements * visual enhancements --------- Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <[email protected]>
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
This allows LocalAI to be less noisy avoiding to connect outside. Needed if e.g. there is no plan into using p2p across separate networks. Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
fix: disable abseil tests Signed-off-by: Dave Lee <[email protected]>
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <[email protected]> Co-authored-by: Ettore Di Giacinto <[email protected]>
* ci(grpc): disable ABSEIL tests Signed-off-by: Ettore Di Giacinto <[email protected]> * debug Signed-off-by: Ettore Di Giacinto <[email protected]> --------- Signed-off-by: Ettore Di Giacinto <[email protected]>
* start by checking /scan during the checksum update Signed-off-by: Dave Lee <[email protected]> * add back in golang side features: downloader/uri gets struct and scan function, gallery uses it, and secscan/models calls it. Signed-off-by: Dave Lee <[email protected]> * add a param to scan specific urls - useful for debugging Signed-off-by: Dave Lee <[email protected]> * helpful printouts Signed-off-by: Dave Lee <[email protected]> * fix offsets Signed-off-by: Dave Lee <[email protected]> * fix error and naming Signed-off-by: Dave Lee <[email protected]> * expose error Signed-off-by: Dave Lee <[email protected]> * fix json tags Signed-off-by: Dave Lee <[email protected]> * slight wording change Signed-off-by: Dave Lee <[email protected]> * go mod tidy - getting warnings Signed-off-by: Dave Lee <[email protected]> * split out python to make editing easier, add some simple code to delete contaminated entries from gallery Signed-off-by: Dave Lee <[email protected]> * o7 to my favorite part of our old name, go-skynet Signed-off-by: Dave Lee <[email protected]> * merge fix Signed-off-by: Dave Lee <[email protected]> * merge fix Signed-off-by: Dave Lee <[email protected]> * merge fix Signed-off-by: Dave Lee <[email protected]> * address review comments Signed-off-by: Dave Lee <[email protected]> * forgot secscan could accept multiple URL at once Signed-off-by: Dave Lee <[email protected]> * invert naming and actually use it Signed-off-by: Dave Lee <[email protected]> * missed cli/models.go Signed-off-by: Dave Lee <[email protected]> * Update .github/check_and_update.py Co-authored-by: Ettore Di Giacinto <[email protected]> Signed-off-by: Dave <[email protected]> --------- Signed-off-by: Dave Lee <[email protected]> Signed-off-by: Dave <[email protected]> Co-authored-by: Ettore Di Giacinto <[email protected]>
* Revert "ci(grpc): disable ABSEIL tests (#2759)" This reverts commit cbb93bd. * Revert "fix: arm builds via disabling abseil tests (#2758)" This reverts commit 8d046de. * Revert "ci(arm64): fix gRPC build by adding googletest to CMakefile (#2754)" This reverts commit 401ee55. * ci(gmock): install libgmock-dev Signed-off-by: Ettore Di Giacinto <[email protected]> --------- Signed-off-by: Ettore Di Giacinto <[email protected]>
fix(model-list): be consistent, skip known files from listing This changeset does two things: - Removes the dependency of listing models from the OpenAI schema. - Tries to reduce confusion between ListModels() in model loader and in the service - now there is only one ListModels which is in services and does not depend anymore on the OpenAI schema - The OpenAI-schema functions were moved nearby the OpenAI specific endpoints that needs the schema - Drops the ListModel Service structure as there was no real need for it. Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
* use a sed hack to jam a missing line in place for grpc's abseil version. Signed-off-by: Dave Lee <[email protected]> --------- Signed-off-by: Dave Lee <[email protected]>
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <[email protected]> Co-authored-by: Dave <[email protected]>
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <[email protected]> Co-authored-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <[email protected]> Co-authored-by: Ettore Di Giacinto <[email protected]>
* feat(models): pull models from urls When using `run` now we can point directly to hf models via URL, for instance: ```bash local-ai run huggingface://TheBloke/TinyLlama-1.1B-Chat-v0.3-GGUF/tinyllama-1.1b-chat-v0.3.Q2_K.gguf ``` Will pull the gguf model and place it in the models folder - of course this depends on the fact that the gguf file should be automatically detected by our guesser mechanism in order to this to make effective. Similarly now galleries can refer to single files in the API requests. This also changes the download code and `yaml` files now are treated in the same way, so now config files are saved with the appropriate name (and not hashed anymore). Signed-off-by: Ettore Di Giacinto <[email protected]> * Adapt tests Signed-off-by: Ettore Di Giacinto <[email protected]> --------- Signed-off-by: Ettore Di Giacinto <[email protected]>
* ci: Do not test the full matrix on PR Hipblas and sycl take long time to build from scratch as for now. Until we find a way to speedup image building we are going to test these only on master, and not for every open PR. Signed-off-by: Ettore Di Giacinto <[email protected]> * ci: do not run release workflow twice Signed-off-by: Ettore Di Giacinto <[email protected]> --------- Signed-off-by: Ettore Di Giacinto <[email protected]>
…2772) Signed-off-by: Ettore Di Giacinto <[email protected]>
⬆️ Update ggerganov/llama.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <[email protected]>
…/sentencetransformers (#2838) chore(deps): Bump setuptools in /backend/python/sentencetransformers Bumps [setuptools](https://github.com/pypa/setuptools) from 69.5.1 to 70.3.0. - [Release notes](https://github.com/pypa/setuptools/releases) - [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst) - [Commits](pypa/setuptools@v69.5.1...v70.3.0) --- updated-dependencies: - dependency-name: setuptools dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
deps: update edgevpn dependency Signed-off-by: Ettore Di Giacinto <[email protected]>
* docs(swagger): comment LocalAI gallery endpoints and rerankers Signed-off-by: Ettore Di Giacinto <[email protected]> * Update core/http/endpoints/jina/rerank.go Co-authored-by: Dave <[email protected]> Signed-off-by: Ettore Di Giacinto <[email protected]> * Update core/http/endpoints/jina/rerank.go Co-authored-by: Dave <[email protected]> Signed-off-by: Ettore Di Giacinto <[email protected]> * Update core/http/endpoints/localai/gallery.go Co-authored-by: Dave <[email protected]> Signed-off-by: Ettore Di Giacinto <[email protected]> * Update core/http/endpoints/localai/gallery.go Co-authored-by: Dave <[email protected]> Signed-off-by: Ettore Di Giacinto <[email protected]> --------- Signed-off-by: Ettore Di Giacinto <[email protected]> Signed-off-by: Ettore Di Giacinto <[email protected]> Co-authored-by: Dave <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
Add a note on LocalAI defaults and benchmarks in our FAQ section. See also #2780 Signed-off-by: Ettore Di Giacinto <[email protected]>
⬆️ Checksum updates in gallery/index.yaml Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <[email protected]>
⬆️ Update ggerganov/llama.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
* feat(llama.cpp): add embeddings Also enable embeddings by default for llama.cpp models Signed-off-by: Ettore Di Giacinto <[email protected]> * fix(Makefile): prepare llama.cpp sources only once Otherwise we keep cloning llama.cpp for each of the variants Signed-off-by: Ettore Di Giacinto <[email protected]> * do not set embeddings to false Signed-off-by: Ettore Di Giacinto <[email protected]> * docs: add embeddings to the YAML config reference Signed-off-by: Ettore Di Giacinto <[email protected]> --------- Signed-off-by: Ettore Di Giacinto <[email protected]>
⬆️ Checksum updates in gallery/index.yaml Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <[email protected]>
#2873) Bumps [langchain](https://github.com/langchain-ai/langchain) from 0.2.7 to 0.2.8. - [Release notes](https://github.com/langchain-ai/langchain/releases) - [Commits](langchain-ai/langchain@langchain==0.2.7...langchain==0.2.8) --- updated-dependencies: - dependency-name: langchain dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Ettore Di Giacinto <[email protected]>
…n/langchainpy-localai-example (#2874) chore(deps): Bump langchain Bumps [langchain](https://github.com/langchain-ai/langchain) from 0.2.7 to 0.2.8. - [Release notes](https://github.com/langchain-ai/langchain/releases) - [Commits](langchain-ai/langchain@langchain==0.2.7...langchain==0.2.8) --- updated-dependencies: - dependency-name: langchain dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…n/langchainpy-localai-example (#2877) chore(deps): Bump numexpr Bumps [numexpr](https://github.com/pydata/numexpr) from 2.10.0 to 2.10.1. - [Release notes](https://github.com/pydata/numexpr/releases) - [Changelog](https://github.com/pydata/numexpr/blob/master/RELEASE_NOTES.rst) - [Commits](pydata/numexpr@v2.10.0...v2.10.1) --- updated-dependencies: - dependency-name: numexpr dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <[email protected]>
⬆️ Update ggerganov/whisper.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <[email protected]>
⬆️ Update ggerganov/llama.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <[email protected]>
Signed-off-by: Chris Jowett <[email protected]>
Signed-off-by: Chris Jowett <[email protected]>
…langchainpy-localai-example (#2878) chore(deps): Bump debugpy Bumps [debugpy](https://github.com/microsoft/debugpy) from 1.8.1 to 1.8.2. - [Release notes](https://github.com/microsoft/debugpy/releases) - [Commits](microsoft/debugpy@v1.8.1...v1.8.2) --- updated-dependencies: - dependency-name: debugpy dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…s/langchain/langchainpy-localai-example (#2875) chore(deps): Bump langchain-community Bumps [langchain-community](https://github.com/langchain-ai/langchain) from 0.2.5 to 0.2.7. - [Release notes](https://github.com/langchain-ai/langchain/releases) - [Commits](langchain-ai/langchain@langchain-community==0.2.5...langchain-community==0.2.7) --- updated-dependencies: - dependency-name: langchain-community dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…n-chroma (#2872) chore(deps): Bump langchain in /examples/langchain-chroma Bumps [langchain](https://github.com/langchain-ai/langchain) from 0.2.7 to 0.2.8. - [Release notes](https://github.com/langchain-ai/langchain/releases) - [Commits](langchain-ai/langchain@langchain==0.2.7...langchain==0.2.8) --- updated-dependencies: - dependency-name: langchain dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…n/langchainpy-localai-example (#2876) chore(deps): Bump openai Bumps [openai](https://github.com/openai/openai-python) from 1.33.0 to 1.35.13. - [Release notes](https://github.com/openai/openai-python/releases) - [Changelog](https://github.com/openai/openai-python/blob/main/CHANGELOG.md) - [Commits](openai/openai-python@v1.33.0...v1.35.13) --- updated-dependencies: - dependency-name: openai dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
See Commits and Changes for more details.
Created by
pull[bot]
Can you help keep this open source service alive? 💖 Please sponsor : )