We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
No description provided.
The text was updated successfully, but these errors were encountered:
在命令行中测试会直接打印速度的
Sorry, something went wrong.
怎么测试了?不同的手机配置和参数不同,我理解 prefill:xx tok/s decode:xx tok/s 生成的数值应该都不同?求大佬指教
adb shell "cd /data/local/tmp && export LD_LIBRARY_PATH=. && ./cli_demo ./Qwen2-1.5B-Instruct-MNN/config.json"
README里有介绍的,直接使用adb运行demo就可以打印性能
No branches or pull requests
No description provided.
The text was updated successfully, but these errors were encountered: