Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA]: Prototype a design to ensure asynchronous operations on different streams work nicely with cuda::launch #2143

Open
2 tasks
miscco opened this issue Jul 31, 2024 · 0 comments
Assignees
Labels
2.7.0 Targeted for 2.7.0 release CUDA Next Feature intended for the Cuda Next experimental library feature request New feature or request.

Comments

@miscco
Copy link
Collaborator

miscco commented Jul 31, 2024

Asynchronous operations are notoriously difficult.

We need to ensure that any memory allocation that we got from cudaMallocAsync is actually valid when we are trying to access it.

Furthermore, we could have different streams interacting with a kernel, so we need to come up with a design that allows cuda::launch to synchronize when neccessary

Tasks

@github-project-automation github-project-automation bot moved this to Todo in CCCL Jul 31, 2024
@miscco miscco self-assigned this Jul 31, 2024
@miscco miscco added feature request New feature or request. CUDA Next Feature intended for the Cuda Next experimental library 2.7.0 Targeted for 2.7.0 release labels Jul 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
2.7.0 Targeted for 2.7.0 release CUDA Next Feature intended for the Cuda Next experimental library feature request New feature or request.
Projects
Status: Todo
Development

No branches or pull requests

1 participant