feat(server): CLIP search integration #1939
Conversation
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
| } | ||
|
|
||
| try { | ||
| const clip = await this.machineLearning.encodeImage({ thumbnailPath: asset.resizePath }); |
There was a problem hiding this comment.
I think we should be able to pass in a full-size image and the library will resize it appropriately, that might yield slightly better results than using an already-resized thumb?
There was a problem hiding this comment.
Yea agreed, we should have each service do the resize itself imo so they get the exact size they need for optional recognition
| const { results } = await this.client.multiSearch.perform({ | ||
| searches: [ | ||
| { | ||
| collection: alias.collection_name, | ||
| q: '*', | ||
| vector_query: `smartInfo.clip:([${input.join(',')}], k:100)`, | ||
| } as any, | ||
| ], | ||
| }); |
There was a problem hiding this comment.
I think this search currently doesn't scope by userId, is that right?
There was a problem hiding this comment.
Ah, yeah forgot to add that back in
There was a problem hiding this comment.
Also, from playing around on the preview a little: It seems like we're always returning 10 results exactly, and not bounding by a minimum score, is that correct?
There was a problem hiding this comment.
Great question, will have to research what the default page size is here
There was a problem hiding this comment.
Scoped by user id, an no idea what minimum distance for cutting off results, limited to 100 results though.
bo0tzz
changed the title
|
Searching currently errors out pretty hard if typesense hasn't been initialized yet, we should probably handle that a little bit better. Error
Things were reindexed by running the metadata extract job, but this error kept happening until I restarted the server container - not sure why that was. |
jrasm91
force-pushed
the
feat/clips-integration
branch
from
bfa3511 to
e03d921
Compare
jrasm91
force-pushed
the
feat/clips-integration
branch
from
983e12c to
042bfe1
Compare
No description provided.