Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Misc. bug: webui: extreme sluggish performance typing into textarea with long-context conversations #11813

Open
woof-dog opened this issue Feb 12, 2025 · 0 comments

Comments

@woof-dog
Copy link
Contributor

Name and Version

version: 4690 (4078c77)
built with cc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0 for x86_64-linux-gnu

Operating systems

Linux

Which llama.cpp modules do you know to be affected?

llama-server

Command line

llama-server -m <any model>

Problem description & steps to reproduce

The user textarea has extreme sluggish performance when typing when the conversation above has a lot of context.

  1. Write a very long message (16K+ tokens) and send.
  2. Try typing into the textarea. Sluggish performance. Are we rerendering a component like ChatScreen on each keystroke and doing complex computations on the previous messages? I can't easily spot it myself if we are.

First Bad Commit

New React UI commit but not entirely sure

Relevant log output

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant