New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(cli): support multi-gpus when running inference locally #249

Merged

heiruwu merged 1 commit into main from heiru/INS-7090

Dec 6, 2024

Member

heiruwu commented Dec 6, 2024

Because

currently its limit to single gpu for local model inference

This commit

support multi-gpus when running inference locally


          feat(cli): allow multi-gpus when running inference locally

f4d25cf

linear bot commented Dec 6, 2024

INS-7090 [SDK] support num_of_gpu greater than 1

droplet-bot added the instill core label

heiruwu merged commit 6760651 into main

7 checks passed

heiruwu deleted the heiru/INS-7090 branch

December 6, 2024 18:23

droplet-bot mentioned this pull request

chore(main): release 0.16.0 #241

Merged

heiruwu pushed a commit that referenced this pull request


          chore(main): release 0.16.0 (#241)

8aeaf3b

🤖 I have created a release *beep* *boop*
---


##
[0.16.0](v0.15.1...v0.16.0)
(2024-12-06)


### Features

* **cli:** support multi-gpus when running inference locally
([#249](#249))
([6760651](6760651))
* **proto:** update protogen
([#240](#240))
([5fd0db1](5fd0db1))
* **vdp:** return dict type instead of proto type in trigger pipeline
([#242](#242))
([8e6b3a7](8e6b3a7))


### Bug Fixes

* **cli:** align timezone between host and model container
([#247](#247))
([aa84a1c](aa84a1c))
* **cli:** fix curl script
([444b210](444b210))
* **cli:** replace fix wait time with curl loop
([#245](#245))
([3f62de1](3f62de1))
* **cli:** update run command shmsize
([#246](#246))
([d08cf37](d08cf37))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels