-
-
Notifications
You must be signed in to change notification settings - Fork 201
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Bug]: App crush Version 1.6.7 (46) with DeepSeek-R1-Distill-Qwen-1.5B #180
Comments
Yeah, these 1.5B models seem to be challenging to run. Which Q4 are you using? anyway, I’m not expecting great results with Q4, it seems Q8 is supposed to be okay-ish. |
Regarding the settings this the recommendation: https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-32B#usage-recommendations |
Now I download Q8 model:
Later on laptop I try R1 1.5B on Ollama, and check results. |
On laptop I pull with ollama R1 model 1.5B and work good, answer my all questions (joke, 2+2 and summary) and make good summary text. Then model work on pc, maybe on mobile is some bugs. |
I am using the 1.6.6 iOS version and have not encountered this situation. 2 plus 2 equals 4. Solution: To solve the addition problem (2 + 2):
Final Answer: [ |
App crush Version 1.6.7 (46) with DeepSeek-R1-Distill-Qwen-1.5B
Model (Q4) download via app with default setting: https://huggingface.co/bartowski/DeepSeek-R1-Distill-Qwen-1.5B-GGUF
I give summary text. Chat generate random stuff and app crash.
If I give simple stuff like "2+2" or "tell joke" app don't crush but generate random stuff and generate random text and don't stop.
Example:
<think> Alright, the the user wants me to to to tell a joke. I should need make to keep it the response. Hmm, Let me think of a a Maybe I can can think of. why. any Wait, no. Maybe I'm not in a I can't. I'm I'm. Maybe, no. I'm in. I'm. I'm I'm in. I. I'm. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I.. I. I.. I. I. I. Okay. I'm I. I. I. I. I. I. I. I. I. I. I.. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I.. I. I.. I. I. I.. I. I. I. I... I. I. I. I. I. I. I.. I. I. I...... I. I I. I. I. I. I. I. I.. I. I. I I I I I I I I I I. I. I. I. I. I. I. I. I. I. I.. I I. I I I I I I.. I I I I I I2 I0 I I I I1. I I I I0 I I I1 I I0 I I0 I0 I I. I. I I I I I I I I I I I I I I I I I I I I I I I I I
App Version 1.6.7 (46)
How You set up this model template or settings?
The text was updated successfully, but these errors were encountered: