You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The current indexer uses the full set of vectors to generate the trees. The advantage is that the split planes represent the vectors in the database. The cons is that it takes a lot of memory, even if it is memory-mapped.
So, to reduce the memory used to index the vectors, we should only use a subset of the vectors to generate the tree and then add the other vectors, those not used to create the planes, back into the tree. With or without refining the planes, I don't know, but probably without. Those vectors can be added by using incremental insertion.
The text was updated successfully, but these errors were encountered:
The current indexer uses the full set of vectors to generate the trees. The advantage is that the split planes represent the vectors in the database. The cons is that it takes a lot of memory, even if it is memory-mapped.
So, to reduce the memory used to index the vectors, we should only use a subset of the vectors to generate the tree and then add the other vectors, those not used to create the planes, back into the tree. With or without refining the planes, I don't know, but probably without. Those vectors can be added by using incremental insertion.
The text was updated successfully, but these errors were encountered: