New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add rwkv.cpp support (RWKV is a 100% RNN Language Model) #253

Closed

BlinkDL opened this issue May 1, 2023 · 1 comment

BlinkDL commented May 1, 2023

RWKV Raven 7B Gradio Demo: https://huggingface.co/spaces/BlinkDL/Raven-RWKV-7B

Use rwkv.cpp for CPU INT4 / INT8: https://github.com/saharNooby/rwkv.cpp

Github project: https://github.com/BlinkDL/ChatRWKV

Sample code using rwkv pip package: https://github.com/BlinkDL/ChatRWKV/blob/main/v2/benchmark_more.py

Please let me know if you have any questions :)

fishscene commented May 11, 2023 •

edited

Loading

Is this a model that should go on the model wish list?
#217

Looks like download is at: https://huggingface.co/BlinkDL/rwkv-4-raven

gaby closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment