You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Observed less than < 1 token per second generation for model >7B parameters using 32.0.100.3053 driver with latest ipex-llm[npu] on LNL 226V series laptop.
Description
Observed less than < 1 token per second generation for model >7B parameters using 32.0.100.3053 driver with latest ipex-llm[npu] on LNL 226V series laptop.
Model tested:
ipex-llm[npu] = 2.2.0b20241022
npu driver = 32.0.10.3053
The text was updated successfully, but these errors were encountered: