Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[META] ML Inference Processor Enhancements III #3054

Open
4 tasks
mingshl opened this issue Oct 2, 2024 · 2 comments
Open
4 tasks

[META] ML Inference Processor Enhancements III #3054

mingshl opened this issue Oct 2, 2024 · 2 comments
Assignees
Labels
enhancement New feature or request Roadmap:Vector Database/GenAI Project-wide roadmap label v2.19.0 Issues targeting release v2.19.0 v2.20.0

Comments

@mingshl
Copy link
Collaborator

mingshl commented Oct 2, 2024

Is your feature request related to a problem?

  • template query --targeting 2.19
  • ml inference search request extension --targeting 2.19
    load image from url function in Connector (PIL.image) -- supporting image search and CLIP
  • save memory --- supporting conversational search --targeting 2.20
  • hide/remove field search response processor --targeting 2.20

All META Issues for ML Inference Processor:
#2839
#2878

What alternatives have you considered?
A clear and concise description of any alternative solutions or features you've considered.

Do you have any additional context?
#2173

@brianf-aws
Copy link
Contributor

Linking #3152 as it relates to image support

@brianf-aws
Copy link
Contributor

brianf-aws commented Dec 9, 2024

Hi, for the load image from url function in Connector (PIL.image) -- supporting image search and CLIP task we have to put on pause as it has security concern.

Currently ML Commons supports for base64 strings that are used to invoke multi-modal models. Full end to end workflows were done to see that this is possible, without downloading from URL

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Roadmap:Vector Database/GenAI Project-wide roadmap label v2.19.0 Issues targeting release v2.19.0 v2.20.0
Projects
Status: New
Status: In Progress
Development

No branches or pull requests

3 participants