Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: share models by url #1522

Merged
merged 6 commits into from
Jan 1, 2024
Merged

feat: share models by url #1522

merged 6 commits into from
Jan 1, 2024

Conversation

mudler
Copy link
Owner

@mudler mudler commented Dec 31, 2023

Description

This PR allows to start local-ai with a list of model config files URLs or our short-handed format (e.g. huggingface://. github://). It works by passing the urls as arguments or environment variable, for example:

local-ai github://owner/repo/file.yaml@branch

# Env
MODELS="github://owner/repo/file.yaml@branch,github://owner/repo/file.yaml@branch" local-ai

# Args
local-ai --models github://owner/repo/file.yaml@branch --models github://owner/repo/file.yaml@branch

For example, to start localai with phi-2, now it's possible for instance (config file from gists):

./local-ai https://gist.githubusercontent.com/mudler/ad601a0488b497b69ec549150d9edd18/raw/a8a8869ef1bb7e3830bf5c0bae29a0cce991ff8d/phi-2.yaml

The file should be a valid YAML configuration file. Note this works well with the last feature #1452. Note this is different from model galleries as that supports up to now also downloading multiple assets. This is for now an attempt to ease out the ux (see also #1373)

Copy link

netlify bot commented Dec 31, 2023

Deploy Preview for localai canceled.

Name Link
🔨 Latest commit df1a461
🔍 Latest deploy log https://app.netlify.com/sites/localai/deploys/659279a343cd3300081e7f85

@mudler mudler added the enhancement New feature or request label Jan 1, 2024
@mudler mudler merged commit 66fa4f1 into master Jan 1, 2024
30 checks passed
@mudler mudler deleted the share_models_by_url branch January 1, 2024 09:31
@mudler
Copy link
Owner Author

mudler commented Jan 2, 2024

to some extents this PR enhanced messages of model loading (see #1416)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant