Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

bug: cortex models list incorrectly starts server (regression 172-176) #1509

Closed
2 of 6 tasks
gabrielle-ong opened this issue Oct 17, 2024 · 1 comment
Closed
2 of 6 tasks

bug: cortex models list incorrectly starts server (regression 172-176) #1509

gabrielle-ong opened this issue Oct 17, 2024 · 1 comment
Labels
type: bug Something isn't working

Comments

@gabrielle-ong
Copy link
Contributor

Cortex version

v176

Describe the Bug

Worked correctly for v172, regression for v176

  1. server is not running
  2. cortex models list
    starts server - is this expected?
    then successfully lists models

Steps to Reproduce

No response

Screenshots / Logs

image

What is your OS?

  • MacOS
  • Windows
  • Linux

What engine are you running?

  • cortex.llamacpp (default)
  • cortex.tensorrt-llm (Nvidia GPUs)
  • cortex.onnx (NPUs, DirectML)
@gabrielle-ong gabrielle-ong added the type: bug Something isn't working label Oct 17, 2024
@github-project-automation github-project-automation bot moved this to Investigating in Menlo Oct 17, 2024
@vansangpfiev
Copy link
Contributor

@gabrielle-ong It is expected. I mentioned it here #1492 (comment)

@vansangpfiev vansangpfiev moved this from Investigating to Review + QA in Menlo Oct 23, 2024
@gabrielle-ong gabrielle-ong moved this from Review + QA to Completed in Menlo Nov 22, 2024
@gabrielle-ong gabrielle-ong removed this from Menlo Nov 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
type: bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@vansangpfiev @gabrielle-ong @louis-menlo