-
Notifications
You must be signed in to change notification settings - Fork 198
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update README.md to notify two gaudi cards needed #293
Conversation
6391c01
to
12644be
Compare
@louie-tsai Thank you for your PR. Yet I don't think ChatQnA requires at least 2 gaudi cards, because I've run ChatQnA successfully using 1 Gaudi card. I don't agree with your changes. |
@daisy-ycguo While I tried to restart it with "docker compose -f docker_compose.yaml up tgi-service", I saw below issue. However, everything works fine if I used 8 cards IDC instance. |
once I changed tei-embedding-server from gaudi to cpu, it works. |
@louie, please fix DCO |
5651251
to
d5802f8
Compare
ChatQnA needs two gaudi cards. put a note to inform users. Signed-off-by: Tsai, Louie <[email protected]>
Signed-off-by: Tsai, Louie <[email protected]>
@kevinintel |
looks like it has conflicts |
Signed-off-by: Tsai, Louie <[email protected]>
* Support https for microservice Signed-off-by: lvliang-intel <[email protected]> --------- Signed-off-by: lvliang-intel <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
ChatQnA needs two gaudi cards. put a note to inform users.
Description
ChatQnA needs two gaudi cards. put a note to inform users.
Issues
N/A
Type of change
List the type of change like below. Please delete options that are not relevant.
Dependencies
NA
Tests
Describe the tests that you ran to verify your changes.