Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RAG: apply auto-cut off ranked retrievals #17

Open
MrCsabaToth opened this issue Aug 9, 2024 · 0 comments
Open

RAG: apply auto-cut off ranked retrievals #17

MrCsabaToth opened this issue Aug 9, 2024 · 0 comments
Labels
enhancement New feature or request RAG Retrieval Augmented Generation related

Comments

@MrCsabaToth
Copy link
Member

MrCsabaToth commented Aug 9, 2024

Weaviate applies a technique called auto-cut. That's when there's a noticeable drop happens as we walk along the scores of the retrievals in reverse order fashion. When that drop happens it's better to drop all the rest of the retrievals. See:

@MrCsabaToth MrCsabaToth added the enhancement New feature or request label Aug 9, 2024
@MrCsabaToth MrCsabaToth added the RAG Retrieval Augmented Generation related label Aug 21, 2024
@MrCsabaToth MrCsabaToth changed the title RAG: apply auto-cut of ranked retrievals RAG: apply auto-cut off ranked retrievals Sep 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request RAG Retrieval Augmented Generation related
Projects
None yet
Development

No branches or pull requests

1 participant