Skip to content
This repository has been archived by the owner on Jan 24, 2024. It is now read-only.

Commit

Permalink
build(docker): rename bundle directory (#19)
Browse files Browse the repository at this point in the history
  • Loading branch information
fardeon authored Mar 8, 2023
1 parent 2c7eda5 commit 5d12fd9
Show file tree
Hide file tree
Showing 5 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,7 @@ For GPU acceleration, you also need to install the [NVIDIA Driver](https://docs.
Basaran's image can be used in three ways:

* **Run directly**: By specifying the `MODEL="user/repo"` environment variable, the corresponding model can be downloaded from Hugging Face Hub during the first startup.
* **Pre-packaging**: Create a new Dockerfile to [preload a public model](https://github.com/hyperonym/basaran/blob/master/deployments/bundles/bloomz-560m.Dockerfile) or [bundle a private model](https://github.com/hyperonym/basaran/blob/master/deployments/bundles/private.Dockerfile).
* **Bundling**: Create a new Dockerfile to [preload a public model](https://github.com/hyperonym/basaran/blob/master/deployments/bundle/bloomz-560m.Dockerfile) or [bundle a private model](https://github.com/hyperonym/basaran/blob/master/deployments/bundle/private.Dockerfile).
* **Bind mount**: Mount a model from the local file system into the container and point the `MODEL` environment variable to the corresponding path.

### Basic Usage
Expand Down
2 changes: 1 addition & 1 deletion utils/download.py
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
"""
Use this script to download a model without loading it into memory.
This allows memory-constrained CI/CD runners to build container images
with large bundled models. See ../deployments/bundles/ for examples.
with large bundled models. See ../deployments/bundle/ for examples.
"""
import os
import sys
Expand Down

0 comments on commit 5d12fd9

Please sign in to comment.