-
-
Notifications
You must be signed in to change notification settings - Fork 1.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Compute multiple dask backed arrays at once #804
Comments
It would be nice to be able to use
Yeah, this is somewhat unfortunate, but convenient (though somewhat obsolete with dask's cachey). Perhaps adding a dedicated |
I'm fine with the duck typing, and could make that work fairly easily. The mutation is a bit trickier though. I see two good options here for what
I'm slightly partial to option 2, as it seems to mesh more with how xarray currently uses dask. Thoughts? |
I would lean towards keeping |
I believe this should have been close by #1674. Anyone object or am I missing something? |
agreed, this is fixed now by |
In dask, a user can compute multiple arrays in a single scheduler run using the
dask.compute
function:This is nice for when
a
andb
might share intermediates. The same can be done currently in xarray ifa
andb
are first put into a dataset:This is fine, but it might also be nice to be able to do this without first putting everything into a dataset. I'm not sure what a good api is here, as xarray objects mutate when computed. Perhaps just adding an
xr.compute(*args)
function that fully realizes all dask backed variables.The text was updated successfully, but these errors were encountered: