Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

raft index supports cosine similarity by normalizing the input data. #924

Merged
merged 1 commit into from
Nov 5, 2024

Conversation

Presburger
Copy link
Collaborator

No description provided.

Copy link

mergify bot commented Nov 4, 2024

@Presburger 🔍 Important: PR Classification Needed!

For efficient project management and a seamless review process, it's essential to classify your PR correctly. Here's how:

  1. If you're fixing a bug, label it as kind/bug.
  2. For small tweaks (less than 20 lines without altering any functionality), please use kind/improvement.
  3. Significant changes that don't modify existing functionalities should be tagged as kind/enhancement.
  4. Adjusting APIs or changing functionality? Go with kind/feature.

For any PR outside the kind/improvement category, ensure you link to the associated issue using the format: “issue: #”.

Thanks for your efforts and contribution to the community!.

Copy link

codecov bot commented Nov 4, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 79.25%. Comparing base (3c46f4c) to head (dab6b4a).
Report is 233 commits behind head on main.

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff            @@
##           main     #924       +/-   ##
=========================================
+ Coverage      0   79.25%   +79.25%     
=========================================
  Files         0       81       +81     
  Lines         0     6350     +6350     
=========================================
+ Hits          0     5033     +5033     
- Misses        0     1317     +1317     

see 81 files with indirect coverage changes

Copy link
Collaborator

@alexanderguzhva alexanderguzhva left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just a nit

@foxspy
Copy link
Collaborator

foxspy commented Nov 5, 2024

/kind improvement

@sre-ci-robot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: alexanderguzhva, Presburger

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@alexanderguzhva
Copy link
Collaborator

/lgtm

@sre-ci-robot sre-ci-robot merged commit fe1a223 into zilliztech:main Nov 5, 2024
13 of 14 checks passed
foxspy pushed a commit to foxspy/knowhere that referenced this pull request Nov 18, 2024
foxspy pushed a commit to foxspy/knowhere that referenced this pull request Nov 18, 2024
sre-ci-robot pushed a commit that referenced this pull request Nov 18, 2024
* update raft to 24.10 (#914)

Signed-off-by: yusheng.ma <[email protected]>
Signed-off-by: xianliang.li <[email protected]>

* fix Index parameters handling and anniterator (#913)

Signed-off-by: Alexandr Guzhva <[email protected]>
Signed-off-by: xianliang.li <[email protected]>

* add range check (#915)

Signed-off-by: xianliang.li <[email protected]>

* fix knowhere ut (#918)

Signed-off-by: xianliang.li <[email protected]>

* raft index supports cosine similarity by normalizing the input data. (#924)

Signed-off-by: yusheng.ma <[email protected]>
Signed-off-by: xianliang.li <[email protected]>

* compensate for the missing acceleration functions in ARM NEON. (#922)

Signed-off-by: yusheng.ma <[email protected]>
Signed-off-by: xianliang.li <[email protected]>

* improve sparse vector index mmap: to mmap almost everything (#928)

Signed-off-by: Buqian Zheng <[email protected]>
Signed-off-by: xianliang.li <[email protected]>

* move sparse index Add to build pool (#933)

Add SparseInvertedIndexNodeCC to allow being thread safe growing index

Signed-off-by: Buqian Zheng <[email protected]>
Signed-off-by: xianliang.li <[email protected]>

* sparse mmap on disk (#935)

Signed-off-by: Buqian Zheng <[email protected]>
Signed-off-by: xianliang.li <[email protected]>

* use MAP_PRIVATE for mmapped file (#938)

Signed-off-by: Buqian Zheng <[email protected]>
Signed-off-by: xianliang.li <[email protected]>

* sparse RangeSearch/AnnIterator to return raw distance (#944)

* sparse: make the distance returned by RangeSearch and AnnIterator to be the raw instead of the quantized distance

Signed-off-by: Buqian Zheng <[email protected]>

* sparse: remove mutex in the index: we now use CC index if concurrent read/write is needed

Signed-off-by: Buqian Zheng <[email protected]>

---------

Signed-off-by: Buqian Zheng <[email protected]>
Signed-off-by: xianliang.li <[email protected]>

* Add optimized distance functions for PowerPC (#894)

Added the PowerPC vector functions in src/simd/distances_powerpc.cc,
src/simd/distances_powerpc.h.  The hooks to the PowerPC functions are
added in src/simd/hook.cc.

Signed-off-by: Carl Love <[email protected]>
Co-authored-by: Carl Love <[email protected]>
Signed-off-by: xianliang.li <[email protected]>

* enhance: optimize get norms function (#950)

Signed-off-by: cqy123456 <[email protected]>
Signed-off-by: xianliang.li <[email protected]>

---------

Signed-off-by: yusheng.ma <[email protected]>
Signed-off-by: xianliang.li <[email protected]>
Signed-off-by: Alexandr Guzhva <[email protected]>
Signed-off-by: Buqian Zheng <[email protected]>
Signed-off-by: Carl Love <[email protected]>
Signed-off-by: cqy123456 <[email protected]>
Co-authored-by: presburger <[email protected]>
Co-authored-by: Alexander Guzhva <[email protected]>
Co-authored-by: Buqian Zheng <[email protected]>
Co-authored-by: carll99 <[email protected]>
Co-authored-by: Carl Love <[email protected]>
Co-authored-by: cqy123456 <[email protected]>
lowener pushed a commit to lowener/knowhere that referenced this pull request Jan 30, 2025
cqy123456 pushed a commit to cqy123456/zilliztech-knowhere that referenced this pull request Feb 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants