Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug: Download models/engine failed cause api server stop #1010

Closed
hiento09 opened this issue Aug 12, 2024 · 3 comments
Closed

bug: Download models/engine failed cause api server stop #1010

hiento09 opened this issue Aug 12, 2024 · 3 comments
Assignees
Labels
category: model management Model pull, yaml, model state P1: important Important feature / fix type: bug Something isn't working

Comments

@hiento09
Copy link
Contributor

hiento09 commented Aug 12, 2024

Describe the bug
When I download a model or engine with a timeout error, api server then will be stopped

To Reproduce
Steps to reproduce the behavior:

  1. Install cortex npm install -g cortexso
  2. Start cortex cortex
  3. Download engine cortex engines tensorrt-llm init
  4. Just turn off your internet connection and run cortex again, you will see the error cortex

Expected behavior
Model or engine should be retried download and api server should not be stopped

Screenshots
If applicable, add screenshots to help explain your problem.
image

Desktop (please complete the following information):

  • OS: [e.g. iOS] Ubuntu 22.04
  • Browser [e.g. chrome, safari]
  • Version [e.g. 22]

Smartphone (please complete the following information):

  • Device: [e.g. iPhone6]
  • OS: [e.g. iOS8.1]
  • Browser [e.g. stock browser, safari]
  • Version [e.g. 22]

Additional context
Add any other context about the problem here.

@hiento09 hiento09 added the type: bug Something isn't working label Aug 12, 2024
@imtuyethan imtuyethan moved this to Planned in Menlo Aug 28, 2024
@dan-menlo
Copy link
Contributor

@vansangpfiev I am reassigning this to the Cortex team - if this issue does not exist for the C++ implementation, you can proceed to close this ticket

@freelerobot freelerobot moved this from Scheduled to Need Investigation in Menlo Sep 6, 2024
@freelerobot freelerobot added P1: important Important feature / fix category: model management Model pull, yaml, model state labels Sep 6, 2024
@dan-menlo
Copy link
Contributor

Let's close this ticket as it's Cortex JS related.

@github-project-automation github-project-automation bot moved this from Need Investigation to Completed in Menlo Sep 6, 2024
@dan-menlo dan-menlo moved this from Completed to Discontinued in Menlo Sep 6, 2024
@dan-menlo
Copy link
Contributor

Referencing this in main issue #1077 and #1072

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: model management Model pull, yaml, model state P1: important Important feature / fix type: bug Something isn't working
Projects
Archived in project
Development

No branches or pull requests

5 participants