Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Examples] Add NVIDIA Nim example #1748

Closed
Tracked by #1782 ...
peterschmidt85 opened this issue Oct 1, 2024 · 7 comments
Closed
Tracked by #1782 ...

[Examples] Add NVIDIA Nim example #1748

peterschmidt85 opened this issue Oct 1, 2024 · 7 comments
Assignees
Labels

Comments

@peterschmidt85
Copy link
Contributor

No description provided.

@AKASH722
Copy link

AKASH722 commented Oct 2, 2024

Hi @peterschmidt85 ,

I’ve worked with NVIDIA Nim before and would love to take on this issue. Could you please assign it to me?

@peterschmidt85
Copy link
Contributor Author

Hi @peterschmidt85 ,

I’ve worked with NVIDIA Nim before and would love to take on this issue. Could you please assign it to me?

Would be great!

We'd like to have it as a separate example under the Deployment category (in addition to other categories such as Fine-tuning, Accelerators, etc.).

The example should feature most essential information around using NIM with dstack.

Note, dstack allows to use NIM with both tasks and services. Should we show both, also explaining briefly the difference?

@peterschmidt85
Copy link
Contributor Author

@AKASH722 Contributing to documentation might be tricky as we don't explain how to do this. Let me know if you need help with it.

@peterschmidt85
Copy link
Contributor Author

The sourcecode must be in examples/examples/deployment/nim/README.md (it's copied to the docs when docs are built). See other cards on https://dstack.ai/examples/ to follow the structure and style.

@AKASH722
Copy link

AKASH722 commented Oct 2, 2024

Thanks, @peterschmidt85!

I’ll add the example to examples/examples/deployment/nim/README.md and follow the structure from dstack. I’ll include both tasks and services, with a brief explanation.

I’ll reach out if I need help with the docs.

@peterschmidt85 peterschmidt85 mentioned this issue Oct 3, 2024
49 tasks
@KaranSingh36752
Copy link

@peterschmidt85 do you need all the examples in the frontend UI of the website here - https://dstack.ai/examples/ ?
If yes I would like to make changes

@r4victor
Copy link
Collaborator

#1853

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants