Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for Nvidia Nemotron and NVLM 1.0 #1007

Open
vlbosch opened this issue Oct 1, 2024 · 1 comment
Open

Support for Nvidia Nemotron and NVLM 1.0 #1007

vlbosch opened this issue Oct 1, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@vlbosch
Copy link

vlbosch commented Oct 1, 2024

Nvidia recently released a few Nemotron models, like Llama-3_1-Nemotron-51B-Instruct. Converting it with MLX gives the following error: "Model type nemotron-nas not supported." Can the Nemotron-family be added, since they're bases on llama3.1 which is supported?

Furthermore, today they released NVLM-72b-D. I'm still downloading this model, but I suppose this one also needs to be added?

@awni
Copy link
Member

awni commented Oct 2, 2024

Regarding the multimodal vision model, I'd recommend filing an issue on https://github.com/Blaizzy/mlx-vlm

Regarding the nemotron 51B, we could add it. I will mark this as a feature request.

Just FYI you can already use the nemotron 72B: nvidia/Llama-3.1-Nemotron-70B-Reward-HF since it has a supported model type.

@awni awni added the enhancement New feature or request label Oct 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants