Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Initial support for vector search. #22

Merged
merged 46 commits into from
Mar 23, 2024
Merged

Initial support for vector search. #22

merged 46 commits into from
Mar 23, 2024

Conversation

tombatron
Copy link
Owner

No description provided.

@tombatron
Starting work on Vector support.
2a82076
@tombatron
Getting started on vector support by defining the vector schema field.
01d5801
@tombatron
Starting on HNSW index definition.
3785670
@tombatron
Added in a bunch of documentation. No real implementation yet.
5d40d06
@tombatron
Added in a class to encapsulate the flat index spec.
906c230 
Wired up the parent GenerateArguments method. Still need to implement
the downstream classes though.
@tombatron
Roughed in the constructor here.
7dfbff9
@tombatron
Added in some documentation.
875f448
@tombatron
Added in a bunch of tests to make pass.
2665777
@tombatron
Initial implementation of the flat vector index algo.
faef305
@tombatron
Added in initial implementation for defining hnsw indexes.
19a3346
@tombatron
Added in a vector schema field builder method.
d4b0629
@tombatron
Wired up the schema field for hnsw vector including aliases.
f45d7ce
@tombatron
I think I'm finished with the hash based index definitions here.
c098255
@tombatron
Wired up the alias builder as well as the JSON builder for vector
57fbf34 
fields.
@tombatron
Fixed documentation here.
b505469
@tombatron
Outlined some integration tests.
2aef62e
@tombatron
Finished sketching out the initial integration tests.
f40cbf4 
Going to transform them into a single theory I think.

Fixed bug with array parameter assignment. Thanks integration tests!
@tombatron
Fixed a few more issues with the tests and field generation logic.
03751aa
@tombatron
Minor formating here.
2d16da2
@tombatron
Updated the documentation here.
71140ea
@tombatron
Replaced a bunch of redundant stuff with test theory.
3925c93
@tombatron
Added in some sample data to use with vector query integration tests.
2c8ebc7
@tombatron
Fixed deprecation issue.
3d8e7f2
@tombatron
Now writing sample vector data.
77ca822
@tombatron
Now adding test vectors and creating test indexes.
b71a188
@tombatron
Moved the sample vector data stuff into the SampleData static class just
7f7fa2d 
to try and clean things up.
@tombatron
Getting started building the vector query builders and what not.
9b25fc9
@tombatron
Roughed in the surface of the fluent interface.
6711ad8 
Need to wire up the actual build method next.
@tombatron
I think that I've sketched in all of the builder methods that I need for
7016d32 
an initial version.
@tombatron
Created failing unit test for building a KNN query.
0f14cac
@tombatron
I think the initial tests are done now.
1be825b
@tombatron
Initial build method is implemented.
c796771
@tombatron
Well... all the unit tests are passing now... I wonder if this stuff
08ac235 
actually works...
@tombatron
A little bit of cleanup and a slight expansion of the vector query API..
b3c6d3d 
I think we should be able to name the score field as well as specify the
return fields, otherwise we'll be returning all of the matched vectors
with the search results.
@tombatron
Added in the ability to specify return fields and their aliases for the
9a44823 
KNN search query.
@tombatron
I think we're good for basic knn vector query.
8d5c611
@tombatron
A little bit of clean up here.
ece3d04
@tombatron
Added in some tests to demonstrate simple vector querying and sorting.
17a44f2
@tombatron
Tried to make the API for KNN and Range queries the same-ish.
f278da6
@tombatron
Added in ability to specify additional filters for range queries.
bbe5feb 
Added additional integration test.
@tombatron
Upgraded test projects to .NET 8.
5cbdf48
@tombatron
Updated the Github Actions configuration here.
ce34b3e
@tombatron
Upped the version here.
b7ccf0e
@tombatron
Reference to new documentation.
9225682
@tombatron
Updated the Redis docker image used for testing.
853e253
@tombatron
Fixed some integration tests here.
4b713b9
@tombatron tombatron merged commit 52d9c1c into main Mar 23, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@tombatron