Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Map distribution over MPI processes #292

Open
paganol opened this issue Feb 24, 2024 · 4 comments
Open

Map distribution over MPI processes #292

paganol opened this issue Feb 24, 2024 · 4 comments
Assignees
Labels
enhancement New feature or request

Comments

@paganol
Copy link
Member

paganol commented Feb 24, 2024

It would be nice to have a function that reads maps (or generates maps with MBS) and spreads it over all the MPI processes.

@paganol paganol self-assigned this Feb 24, 2024
@paganol paganol added the enhancement New feature or request label Feb 24, 2024
@mreineck
Copy link
Collaborator

Are you thinking about an approach like this (pseudocode!)?

def generate_and_broadcast(generator, comm):
    result = generator() if comm.rank == 0 else None
    return comm.bcast(result)

generator can be a lambda or a function that either loads maps from disk or computes them on the fly.

@paganol
Copy link
Member Author

paganol commented Feb 27, 2024

Hi @mreineck, as first implementation, yes I was thinking to something like that. Than, probably, we should write something more refined for broadcasting properly maps, alms or other quantities based on the detector distribution across the mpi tasks.

@paganol paganol mentioned this issue Mar 7, 2024
@paganol
Copy link
Member Author

paganol commented Oct 23, 2024

I think this is addressed by #334, right?

@ziotom78
Copy link
Member

I think this is addressed by #334, right?

#334 addresses the distribution of detectors, so if MBS generates maps according to which detectors are available on an MPI node, then yes, that PR addresses this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

When branches are created from issues, their pull requests are automatically linked.

3 participants