Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

shard_map parallel nested sampling #172

Closed
Joshuaalbert opened this issue May 29, 2024 · 1 comment
Closed

shard_map parallel nested sampling #172

Joshuaalbert opened this issue May 29, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@Joshuaalbert
Copy link
Owner

Implement sharded parallel nested sampling applicable to multi-node, multi-device with SIMD and sharded computation.

@Joshuaalbert Joshuaalbert added the enhancement New feature or request label May 29, 2024
Joshuaalbert added a commit that referenced this issue May 29, 2024
@Joshuaalbert
Copy link
Owner Author

Following discussion at MaxEnt 2024 with John Skilling JAXNS's parallel implementation will be updated. It will perform parallel NS by discarding M points per step and replacing them all in parallel. This will impose a global synchronisation on the speed of the slowest sample replacement before the next shell can be discarded but ultimately this will still perform well on distributed hardward and make use of accelerator meshes. The sharded axis shall be the frontier of samples (representing the live points). This will improve on the current parallel NS which uses totally independent samplers (at reduced resolution), but uses a secondary phase to align the depths. Our sample tree implementation will be preserved for posterity and dynamic refinement, but I'll ultimately choose whatever structure is the most performant, in line with JAXNS's mission.

Joshuaalbert added a commit that referenced this issue Sep 23, 2024
* Implement mixed precision for #189
* Code cleanup (much more to do)
* Breaking low-level API, but maintaining public API
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant