Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug: cortex models stop "Failed to stop models" but actually works #643

Closed
freelerobot opened this issue Jun 2, 2024 · 0 comments · Fixed by #652
Closed

bug: cortex models stop "Failed to stop models" but actually works #643

freelerobot opened this issue Jun 2, 2024 · 0 comments · Fixed by #652
Assignees
Labels
P0: critical Mission critical type: bug Something isn't working

Comments

@freelerobot
Copy link
Contributor

  1. start model
  2. stop model
  3. get error msg
  4. but model was successfuly stopped
❯ cortex ps
┌─────────┬───────────────────────────────────────────────┬───────────────────┬───────────┬──────────┬─────┬──────┐
│ (index) │                    modelId                    │      engine       │  status   │ duration │ ram │ vram │
├─────────┼───────────────────────────────────────────────┼───────────────────┼───────────┼──────────┼─────┼──────┤
│    0    │ 'bartowski/Llama-3-8B-Instruct-Coder-v2-GGUF''cortex.llamacpp''running''1m 22s''-''-'  │
└─────────┴───────────────────────────────────────────────┴───────────────────┴───────────┴──────────┴─────┴──────┘
❯ cortex models start bartowski/Llama-3-8B-Instruct-Coder-v2-GGUF --attach
{
  message: 'Model already loaded',
  modelId: 'bartowski/Llama-3-8B-Instruct-Coder-v2-GGUF'
}
❯ cortex models stop bartowski/Llama-3-8B-Instruct-Coder-v2-GGUF
{
  message: 'Failed to stop model',
  modelId: 'bartowski/Llama-3-8B-Instruct-Coder-v2-GGUF'
}
❯ cortex ps
┌─────────┐
│ (index) │
├─────────┤
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
P0: critical Mission critical type: bug Something isn't working
Projects
Archived in project
Development

Successfully merging a pull request may close this issue.

3 participants