Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug: cortex pull persists an incorrect model ID #649

Closed
louis-jan opened this issue Jun 3, 2024 · 0 comments · Fixed by #652
Closed

bug: cortex pull persists an incorrect model ID #649

louis-jan opened this issue Jun 3, 2024 · 0 comments · Fixed by #652
Labels
type: bug Something isn't working

Comments

@louis-jan
Copy link
Contributor

Describe the bug

  • cortex pull janhq/TinyLlama-1.1B-Chat-v1.0-GGUF persists wrong model ID janhq/TinyLlama-1.1B-Chat-v1.0-GGUF/main so I could not start the model.
[
  ModelEntity {
    id: 'janhq/TinyLlama-1.1B-Chat-v1.0-GGUF/main',
    object: 'model',
    version: '',
    format: 'gguf',
    sources: [ [Object] ],
    name: 'janhq/TinyLlama-1.1B-Chat-v1.0-GGUF/main',
    created: 1717385664598,
    description: '',
    settings: {
      prompt_template: '<|system|>\n{system_message}</s>\n<|user|>\n{prompt}</s>\n<|assistant|>\n'
    },
    parameters: { stop: [Array] },
    metadata: { author: 'janhq', size: 548404256, tags: [] },
    engine: 'cortex'
  }
]

To Reproduce
Steps to reproduce the behavior:

  1. Try cortex pull janhq/TinyLlama-1.1B-Chat-v1.0-GGUF
  2. Run cortex run janhq/TinyLlama-1.1B-Chat-v1.0-GGUF
  3. See error

Expected behavior
It should persist with the same ID as I pull it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: bug Something isn't working
Projects
Archived in project
Development

Successfully merging a pull request may close this issue.

1 participant