We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Describe the bug The IVF-PQ method has an argument to specify memor allocator used for temporary buffers. https://github.com/rapidsai/raft/blob/branch-23.08/cpp/include/raft/neighbors/ivf_pq-inl.cuh#L407
This allocator is ignored for some of the internal allocations (See #1557), and that decreases the performance.
Expected behavior
We plan to deprecate explicit MR argument for IVF-PQ search. Ideally the workspace allocator shall control the temporary allocations.
Workaround
rmm::mr::pool_memory_resource<rmm::mr::device_memory_resource> mr(rmm::mr::get_current_device_resource(), 1024 * 1024 * 1024ull); rmm::mr::set_current_device_resource(&mr); ivf_pq::search(res, search_params, index, queries, neighbors_view, distances_view);
The text was updated successfully, but these errors were encountered:
Set pool memory resource for raft IVF ANN benchmarks (#1625)
58631df
This PR fixes perf issues by #1558 Authors: - Tamas Bela Feher (https://github.com/tfeher) Approvers: - Corey J. Nolet (https://github.com/cjnolet) URL: #1625
No branches or pull requests
Describe the bug
The IVF-PQ method has an argument to specify memor allocator used for temporary buffers. https://github.com/rapidsai/raft/blob/branch-23.08/cpp/include/raft/neighbors/ivf_pq-inl.cuh#L407
This allocator is ignored for some of the internal allocations (See #1557), and that decreases the performance.
Expected behavior
We plan to deprecate explicit MR argument for IVF-PQ search. Ideally the workspace allocator shall control the temporary allocations.
Workaround
The text was updated successfully, but these errors were encountered: