Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug: v1.0.0-169 returns "Error: ≤B÷" but starts model #1486

Closed
2 of 6 tasks
dan-menlo opened this issue Oct 15, 2024 · 2 comments
Closed
2 of 6 tasks

bug: v1.0.0-169 returns "Error: ≤B÷" but starts model #1486

dan-menlo opened this issue Oct 15, 2024 · 2 comments
Assignees
Labels
type: bug Something isn't working
Milestone

Comments

@dan-menlo
Copy link
Contributor

dan-menlo commented Oct 15, 2024

Cortex version

v1.0.0-169

Describe the Bug

  1. Run cortex run tinyllama
  2. Get a "Error: ≤B÷" in the logs
  3. Model still starts
  4. There is no error in the logs (only in cortex-cli)

There clearly is an error somewhere, that doesn't seem to affect model running.

Steps to Reproduce

No response

Screenshots / Logs

cortex.log
cortex-cli.log

image

This behavior also persists when I do not start the cortex server beforehand:

image

What is your OS?

  • MacOS
  • Windows
  • Linux

What engine are you running?

  • cortex.llamacpp (default)
  • cortex.tensorrt-llm (Nvidia GPUs)
  • cortex.onnx (NPUs, DirectML)
@dan-menlo dan-menlo added the type: bug Something isn't working label Oct 15, 2024
@github-project-automation github-project-automation bot moved this to Investigating in Menlo Oct 15, 2024
@dan-menlo dan-menlo added this to the v1.0.1 milestone Oct 21, 2024
@gabrielle-ong gabrielle-ong moved this from Investigating to Planning in Menlo Oct 21, 2024
@vansangpfiev
Copy link
Contributor

@gabrielle-ong Can you please help to check again? This should be solved by the latest nightly.

@vansangpfiev vansangpfiev moved this from Planning to Review + QA in Menlo Oct 21, 2024
@gabrielle-ong
Copy link
Contributor

Thanks Sang, marking as complete,- fixed on Windows v178
image

@gabrielle-ong gabrielle-ong moved this from Review + QA to Completed in Menlo Oct 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: bug Something isn't working
Projects
Archived in project
Development

No branches or pull requests

4 participants