Skip to content

Commit

Permalink
minor change
Browse files Browse the repository at this point in the history
  • Loading branch information
Qingwei Li committed Sep 12, 2022
1 parent 850c795 commit 428e5d1
Showing 1 changed file with 2 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -189,13 +189,13 @@
"source": [
"### Setup serving.properties\n",
"\n",
"User needs to add engine Rubikon as shown below. If you would like to control how many worker groups, you can set\n",
"User needs to add engine Rubikon as shown below. If you would like to control how many worker groups, you can set by adding these lines in the below file.\n",
"\n",
"```\n",
"gpu.minWorkers=1\n",
"gpu.maxWorkers=1\n",
"```\n",
"By adding these lines in the below file. By default, we will create as much worker group as possible based on `gpu_numbers/tensor_parallel_degree`."
"By default, we will create as much worker group as possible based on `gpu_numbers/tensor_parallel_degree`."
]
},
{
Expand Down

0 comments on commit 428e5d1

Please sign in to comment.