Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

epic: Jan supports TensorRT-LLM Models #3637

Closed
dan-menlo opened this issue Sep 11, 2024 · 1 comment
Closed

epic: Jan supports TensorRT-LLM Models #3637

dan-menlo opened this issue Sep 11, 2024 · 1 comment
Labels
category: cortex.cpp Related to cortex.cpp category: providers Local & remote inference providers move to Cortex

Comments

@dan-menlo
Copy link
Contributor

dan-menlo commented Sep 11, 2024

Goal

  • Jan supports TensorRT-LLM models

Prereqs

Tasklist

  • TensorRT-LLM Settings page
  • Hub has models with TensorRT-LLM tags (compiled, etc)
@gabrielle-ong
Copy link
Contributor

Closing all open TensorRT-LLM stories, the upstream team is not focusing on tensorrt-llm on windows
Parent issue here: janhq/cortex.cpp#1742

@github-project-automation github-project-automation bot moved this to Review + QA in Menlo Nov 28, 2024
@gabrielle-ong gabrielle-ong moved this from Review + QA to Completed in Menlo Nov 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: cortex.cpp Related to cortex.cpp category: providers Local & remote inference providers move to Cortex
Projects
Archived in project
Development

No branches or pull requests

4 participants