Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[META] ML Inference Processor Flexibility Enhancements II #2878

Closed
3 tasks done
mingshl opened this issue Sep 3, 2024 · 2 comments
Closed
3 tasks done

[META] ML Inference Processor Flexibility Enhancements II #2878

mingshl opened this issue Sep 3, 2024 · 2 comments
Assignees
Labels
enhancement New feature or request Roadmap:Vector Database/GenAI Project-wide roadmap label v2.18.0 Issues targeting release v2.18.0

Comments

@mingshl
Copy link
Collaborator

mingshl commented Sep 3, 2024

Is your feature request related to a problem?

  • Currently, search response processor can add prediction results to new fields to extensions. Try to enable option to save the model prediction to the extension part in the search response.
  • For rerank use cases, we need to pass on the query_text to the model input dataset along with the documents in the search response. Try to enable reading value from query body in model config.
  • For rerank use cases, we also need a rescore processor that can rank the search hit and update the new scores.

All META Issues for ML Inference Processor:
#2839

What solution would you like?
A clear and concise description of what you want to happen.

What alternatives have you considered?
A clear and concise description of any alternative solutions or features you've considered.

Do you have any additional context?
Add any other context or screenshots about the feature request here.

@andrross
Copy link
Member

[Catch All Triage - 1, 2, 3]

@mingshl
Copy link
Collaborator Author

mingshl commented Oct 23, 2024

closing this issue as features are implemented in 2.18

@mingshl mingshl closed this as completed Oct 23, 2024
@github-project-automation github-project-automation bot moved this from In Progress to Done in ml-commons projects Oct 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Roadmap:Vector Database/GenAI Project-wide roadmap label v2.18.0 Issues targeting release v2.18.0
Projects
Status: New
Development

No branches or pull requests

3 participants