Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create/find a byte quantized vector dataset #408

Open
Tracked by #84324
benwtrent opened this issue Jun 12, 2023 · 0 comments
Open
Tracked by #84324

Create/find a byte quantized vector dataset #408

benwtrent opened this issue Jun 12, 2023 · 0 comments

Comments

@benwtrent
Copy link
Member

All our vector benchmarks use float. It would be good to benchmark byte linearly quantized along side of float.

We need to measure indexing & search speed for byte vs float.

I think the thing to do here is take the so_vectors or dense_vectors data set and linearly quantize all of it into byte values and upload a new copy that rally can use.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant