-
Notifications
You must be signed in to change notification settings - Fork 540
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
remove faiss from cuml #5293
remove faiss from cuml #5293
Conversation
Co-authored-by: Dante Gama Dessavre <[email protected]>
Remove faiss from cuml, by changing the mutual reachability code to use the new tiled_brute_force_knn code in RAFT - instead of using faiss calls
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Approving ops-codeowner
file changes
// or __host__ __device__ lambda` | ||
auto post_process = ReachabilityPostProcess<value_t>{handle, core_dists, alpha}; | ||
|
||
raft::neighbors::detail::tiled_brute_force_knn(handle, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We can even set an identity_op for the default epilogue setting here just so we instantiate that by default.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks great! Very minor things as usual.
@@ -47,7 +47,6 @@ HELP="$0 [<target> ...] [<flag> ...] | |||
and profiling enabled (WARNING: Impacts performance) | |||
--ccache - Use ccache to cache previous compilations | |||
--nocloneraft - CMake will clone RAFT even if it is in the environment, use this flag to disable that behavior | |||
--static-faiss - Force CMake to use the FAISS static libs, cloning and building them if necessary |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yay!!!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This side looks great!
Add the ability for a user to specify an epilogue function to run after the distance in the brute_force::knn call. This lets us remove faiss from cuml, by updating the hdbscan reachability code (rapidsai/cuml#5293) Authors: - Ben Frederickson (https://github.com/benfred) - Corey J. Nolet (https://github.com/cjnolet) Approvers: - Corey J. Nolet (https://github.com/cjnolet) URL: #1371
/merge |
Remove faiss from cuml, by changing the mutual reachability code to use the new
tiled_brute_force_knn code in RAFT - instead of using faiss calls