New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support QWen？ #96

Open

Vincent131499 opened this issue Feb 5, 2024 · 1 comment

Vincent131499 commented Feb 5, 2024

Great job!
QWen is an open-source model widely used by the community. Does it support the training of this model?

Contributor

martinjaggi commented Feb 7, 2024

good idea, it would be nice if someone could make a PR to support Qwen 1.5 or later Qwen 2.

it should be quite easy as the architecture seems very similar to the ones we already support in the current code

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment