Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] API to set random seed for IVF subsampling #2105

Open
tfeher opened this issue Jan 22, 2024 · 0 comments
Open

[FEA] API to set random seed for IVF subsampling #2105

tfeher opened this issue Jan 22, 2024 · 0 comments
Labels
feature request New feature or request Vector Search

Comments

@tfeher
Copy link
Contributor

tfeher commented Jan 22, 2024

In IVF-Flat and IVF-PQ, we generate random indices and shuffle or subsample the dataset using these indices before training. Currently a fixed seed is used to generate random indices.

This issue requests an option to control the random seed. PR #2077 had planned to add a parameter, but it was removed, because we were considerin alternative options (see discussion here).

Alternatively, we could consider random sampling seed as an implementation detail, and decide not to expose a user knob for it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request Vector Search
Projects
None yet
Development

No branches or pull requests

1 participant