Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

bug: Models loading onto wrong GPU in multi-GPU setup #1468

Open
1 of 3 tasks
ericdfrazer opened this issue Oct 10, 2024 · 3 comments
Open
1 of 3 tasks

bug: Models loading onto wrong GPU in multi-GPU setup #1468

ericdfrazer opened this issue Oct 10, 2024 · 3 comments
Assignees
@vansangpfiev @louis-jan
Labels
category: hardware management Related to hardware & compute type: bug Something isn't working

Comments

@ericdfrazer
Copy link

Jan version

v0.5.6

Describe the Bug

When I select just the 4060 GPU, models load onto the 2070.
When I select just the 2070, models load onto the 4060.

Steps to Reproduce

No response

Screenshots / Logs

Screenshot 2024-10-10 132054
Screenshot 2024-10-10 132120

What is your OS?

  • MacOS
  • Windows
  • Linux
@ericdfrazer ericdfrazer added the type: bug Something isn't working label Oct 10, 2024
@freelerobot freelerobot transferred this issue from janhq/jan Oct 14, 2024
@freelerobot freelerobot added the category: hardware management Related to hardware & compute label Oct 14, 2024
@dan-menlo
Copy link
Contributor

@vansangpfiev Assigning to you, as this will be closely related to Hardware API

@gabrielle-ong gabrielle-ong mentioned this issue Nov 6, 2024
Closed
18 tasks
@gabrielle-ong gabrielle-ong mentioned this issue Nov 28, 2024
Closed
@gabrielle-ong
Copy link
Contributor

gabrielle-ong commented Nov 28, 2024 •
edited
Loading

Cortex has implemented Hardware detection and activation API (Single GPU)
https://cortex.so/api-reference/#tag/hardware/post/v1/hardware/activate

@louis-jan might need your help to investigate further / implement in Jan
Image

@dan-menlo dan-menlo assigned vansangpfiev and louis-jan and unassigned louis-jan Dec 15, 2024
@louis-jan
Copy link
Contributor

Scoped in #1165

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@vansangpfiev vansangpfiev

@louis-jan louis-jan

Labels
category: hardware management Related to hardware & compute type: bug Something isn't working
Projects
Menlo
Status: Investigating
Milestone
No milestone
Development

No branches or pull requests
6 participants
@vansangpfiev @gabrielle-ong @freelerobot @dan-menlo @ericdfrazer @louis-jan