Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support AQLM model #1699

Closed
lihan opened this issue Apr 3, 2024 · 3 comments
Closed

Support AQLM model #1699

lihan opened this issue Apr 3, 2024 · 3 comments
Labels
Stale

Comments

@lihan
Copy link

lihan commented Apr 3, 2024

Feature request

Is it possible to add AQLM support?

Transformers now supporting this.

Motivation

Allow more models to be served by TGI

Your contribution

Helping you to test
@github-actions GitHub Actions
Copy link

github-actions bot commented May 4, 2024

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

@github-actions github-actions bot added the Stale label May 4, 2024
@Nehc
Copy link

Nehc commented May 7, 2024

necessary feature

@github-actions github-actions bot removed the Stale label May 8, 2024
@github-actions GitHub Actions
Copy link

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

@github-actions github-actions bot added the Stale label Jun 23, 2024
@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Jul 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Stale
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@lihan @Nehc