Skip to content

Commit

Permalink
Adding separate reqiorements to avoid GPU depencies issues
Browse files Browse the repository at this point in the history
  • Loading branch information
haixuanTao committed Apr 3, 2024
1 parent 191f779 commit c5a1c1a
Show file tree
Hide file tree
Showing 2 changed files with 12 additions and 1 deletion.
4 changes: 3 additions & 1 deletion examples/python-operator-dataflow/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,7 @@ The [`dataflow.yml`](./dataflow.yml) defines a simple dataflow graph with the fo
## Getting started

```bash
pip install -r requirements.txt
cargo run --example python-operator-dataflow
```

Expand All @@ -22,6 +23,7 @@ cargo run --example python-operator-dataflow
conda create -n example_env python=3.11
conda activate test_env
pip install -r requirements.txt
pip install -r requirements_llm.txt
```

## Run the dataflow
Expand All @@ -32,7 +34,7 @@ pip install -r requirements.txt
dora start dataflow.yml
```

- Start the llm dataflow:
- Start the llm dataflow (Only works on Windows and Linux):

```bash
dora start dataflow_llm.yml
Expand Down
9 changes: 9 additions & 0 deletions examples/python-operator-dataflow/requirements_llm.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
openai-whisper
sounddevice
pynput
sentence-transformers
transformers
pylcs
accelerate
optimum
auto-gptq>=0.7.1

0 comments on commit c5a1c1a

Please sign in to comment.