Skip to content

Commit

Permalink
docs: add http feature
Browse files Browse the repository at this point in the history
  • Loading branch information
OlivierDehaene committed Mar 12, 2024
1 parent 7efa697 commit 2d1776f
Show file tree
Hide file tree
Showing 4 changed files with 9 additions and 9 deletions.
8 changes: 4 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -392,9 +392,9 @@ Then run:

```shell
# On x86
cargo install --path router -F candle -F mkl
cargo install --path router -F mkl
# On M1 or M2
cargo install --path router -F candle -F metal
cargo install --path router -F metal
```

You can now launch Text Embeddings Inference on CPU with:
Expand Down Expand Up @@ -429,10 +429,10 @@ Then run:
# This can take a while as we need to compile a lot of cuda kernels

# On Turing GPUs (T4, RTX 2000 series ... )
cargo install --path router -F candle-cuda-turing --no-default-features
cargo install --path router -F candle-cuda-turing -F http --no-default-features

# On Ampere and Hopper
cargo install --path router -F candle-cuda --no-default-features
cargo install --path router -F candle-cuda -F http --no-default-features
```

You can now launch Text Embeddings Inference on GPU with:
Expand Down
4 changes: 2 additions & 2 deletions docs/source/en/local_cpu.md
Original file line number Diff line number Diff line change
Expand Up @@ -33,13 +33,13 @@ Depending on your machine's architecture, run one of the following commands:
### For x86 Machines

```shell
cargo install --path router -F candle -F mkl
cargo install --path router -F mkl
```

### For M1 or M2 Machines

```shell
cargo install --path router -F candle -F accelerate
cargo install --path router -F metal
```

## Step 3: Launch Text Embeddings Inference
Expand Down
4 changes: 2 additions & 2 deletions docs/source/en/local_gpu.md
Original file line number Diff line number Diff line change
Expand Up @@ -44,13 +44,13 @@ This step can take a while as we need to compile a lot of cuda kernels.
### For Turing GPUs (T4, RTX 2000 series ... )

```shell
cargo install --path router -F candle-cuda-turing --no-default-features
cargo install --path router -F candle-cuda-turing -F http --no-default-features
```

### For Ampere and Hopper

```shell
cargo install --path router -F candle-cuda --no-default-features
cargo install --path router -F candle-cuda -F http --no-default-features
```

## Step 4: Launch Text Embeddings Inference
Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/local_metal.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh
## Step 2: Install with Metal support

```shell
cargo install --path router -F candle -F metal
cargo install --path router -F metal
```

## Step 3: Launch Text Embeddings Inference
Expand Down

0 comments on commit 2d1776f

Please sign in to comment.