New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use GPU tensors in Triton ensemble operators #29

Open

3 tasks

jperez999 opened this issue Mar 14, 2022 · 0 comments

Assignees

Collaborator

jperez999 commented Mar 14, 2022 •

edited by karlhigley

Loading

Use DLpack to leverage GPU memory between triton models in ensemble
Upgrade numpy in containers and see if dlpack works with Triton tensors
Try to build a repro of transferring cupy tensors to Triton with dlpack (re: issue with contiguous arrays)

karlhigley transferred this issue from NVIDIA-Merlin/NVTabular

karlhigley assigned jperez999

karlhigley mentioned this issue

Measure and optimize serving performance #8

Closed

3 tasks

karlhigley added this to the Merlin 22.05 milestone

karlhigley modified the milestones: Merlin 22.05, Future

karlhigley removed this from the Future milestone

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment