Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Extend the REST API to create/delete/start/stop/list LLM servers (= containers) #2190

Open
cmoulliard opened this issue Dec 3, 2024 · 3 comments
Assignees
Labels
kind/epic⚡ Issue describing an epic
Milestone

Comments

@cmoulliard
Copy link

cmoulliard commented Dec 3, 2024

Is your feature request related to a problem? Please describe

As a developer/coder developing applications using AI (langchain4j, etc) it is not so simple locally to play with LLM (server, model, etc). Even if podman desktop allows to list/install models like to create/delete servers, the users should use the UI for that purpose and cannot use an API

The purpose of this feature is to extend the Podman AI Lab API to create/delete/start/stop/list LLM servers (= containers)

Describe the solution you'd like

n/a

Describe alternatives you've considered

n/a

Additional context

n/a

@cmoulliard cmoulliard added the kind/feature 💡 Issue for requesting a new feature label Dec 3, 2024
@slemeur slemeur added kind/epic⚡ Issue describing an epic and removed kind/feature 💡 Issue for requesting a new feature labels Dec 6, 2024
@slemeur slemeur added this to the 1.6 milestone Dec 6, 2024
@slemeur
Copy link
Contributor

slemeur commented Dec 6, 2024

Planning this in 1.6 milestone

@jeffmaury jeffmaury changed the title [Feature] Extend the podman API to create/delete/start/stop/list LLM servers (= containers) [Feature] Extend the REST API to create/delete/start/stop/list LLM servers (= containers) Dec 17, 2024
@slemeur
Copy link
Contributor

slemeur commented Dec 23, 2024

cc @maxandersen

@maxandersen
Copy link

Cool - any plan of enabling #1787 ? Main diff is that this issue just talks about creating/stopping ai services that is on different ports - #1787 is about proxying so paths and ports are stable.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/epic⚡ Issue describing an epic
Projects
Status: 📋 Backlog
Development

No branches or pull requests

4 participants