Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: App crush Version 1.6.7 (46) with DeepSeek-R1-Distill-Qwen-1.5B #180

Open
bi4key opened this issue Jan 23, 2025 · 5 comments
Open
Labels
bug Something isn't working

Comments

@bi4key
Copy link

bi4key commented Jan 23, 2025

App crush Version 1.6.7 (46) with DeepSeek-R1-Distill-Qwen-1.5B

Model (Q4) download via app with default setting: https://huggingface.co/bartowski/DeepSeek-R1-Distill-Qwen-1.5B-GGUF

I give summary text. Chat generate random stuff and app crash.
If I give simple stuff like "2+2" or "tell joke" app don't crush but generate random stuff and generate random text and don't stop.

Example:

<think> Alright, the the user wants me to to to tell a joke. I should need make to keep it the response. Hmm, Let me think of a a Maybe I can can think of. why. any Wait, no. Maybe I'm not in a I can't. I'm I'm. Maybe, no. I'm in. I'm. I'm I'm in. I. I'm. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I.. I. I.. I. I. I. Okay. I'm I. I. I. I. I. I. I. I. I. I. I.. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I.. I. I.. I. I. I.. I. I. I. I... I. I. I. I. I. I. I.. I. I. I...... I. I I. I. I. I. I. I. I.. I. I. I I I I I I I I I I. I. I. I. I. I. I. I. I. I. I.. I I. I I I I I I.. I I I I I I2 I0 I I I I1. I I I I0 I I I1 I I0 I I0 I0 I I. I. I I I I I I I I I I I I I I I I I I I I I I I I I


App Version 1.6.7 (46)

How You set up this model template or settings?


type: crash
osVersion: google/bluejay/bluejay:15/AP4A.250105.002/2025011500:user/release-keys
userType: full.secondary
flags: dev options enabled
package: com.pocketpalai:46, targetSdk 35
process: com.pocketpalai
installer: dev.imranr.obtainium

signal 11 (SIGSEGV), code 2 (SEGV_ACCERR), fault addr 0xb400006453d4c000

backtrace:
      #00 pc 000000000005c7dc  /apex/com.android.runtime/lib64/bionic/libc.so (__memcpy_aarch64_simd+284) (BuildId: 6da77815db33dd5f45155da4abb6f173)
      #01 pc 000000000009dbac  /data/app/~~2saTGSLSmuWcHBpk2Mks2w==/com.pocketpalai-8cs9PyzyMbNIbZ_bMpAqdg==/base.apk!librnllama_v8_2_dotprod.so (offset 0x16f4000) (BuildId: 86839a9f051d9b4988957e2b3f1e44cf25c1c505)
      #02 pc 00000000000ba6fc  /data/app/~~2saTGSLSmuWcHBpk2Mks2w==/com.pocketpalai-8cs9PyzyMbNIbZ_bMpAqdg==/base.apk!librnllama_v8_2_dotprod.so (offset 0x16f4000) (BuildId: 86839a9f051d9b4988957e2b3f1e44cf25c1c505)
      #03 pc 0000000000075d34  /apex/com.android.runtime/lib64/bionic/libc.so (__pthread_start(void*)+132) (BuildId: 6da77815db33dd5f45155da4abb6f173)
      #04 pc 0000000000066890  /apex/com.android.runtime/lib64/bionic/libc.so (__start_thread+64) (BuildId: 6da77815db33dd5f45155da4abb6f173)
@bi4key bi4key added the bug Something isn't working label Jan 23, 2025
@a-ghorbani
Copy link
Owner

Yeah, these 1.5B models seem to be challenging to run. Which Q4 are you using?
On some phones, I noticed that 4_0 crashes, but Q4_K_M works well, could you try: https://huggingface.co/bartowski/DeepSeek-R1-Distill-Qwen-1.5B-GGUF/blob/main/DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M.gguf if you haven't?

anyway, I’m not expecting great results with Q4, it seems Q8 is supposed to be okay-ish.

@a-ghorbani
Copy link
Owner

Regarding the settings this the recommendation: https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-32B#usage-recommendations

@bi4key
Copy link
Author

bi4key commented Jan 23, 2025

Image
This model I use.


Now I download Q8 model:

Please reason step by step, and put your final answer within \boxed{}. Give me result 2+2

<think>
Okay, so I have this22. Hmm, Let me try I have29. Hmm, I am 22. Hmm. I am 2. Hmm. Wait. I'm 8. Hmm. I. I. I. I.3. I. 2. Hmm. I. I.2 Hmm. I. I. I. I. I. 2 I..2. I. I. I.. I.. I.. I. I I. I. I2.2. I. I. I I. I. I.. I. I. I I. I. I. I I. I. I I. I. I. I I. I. I. I. I.. I. I. I. I. I. I. I.. I. I. I. I..

Wait, the user I'm... I.2. I. I.. I. I.. I. I. I I. I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I. I I.

Hmm,This is getting me confused. it.. actually I. is I I I I I I. I.Wait, I have to think this through.. is actually I I I2.  I. is it is I is I.

IWait, I I I I. I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I.

Wait,IIWait am I I I it is II I I I I I is I

Later on laptop I try R1 1.5B on Ollama, and check results.

@bi4key
Copy link
Author

bi4key commented Jan 23, 2025

On laptop I pull with ollama R1 model 1.5B and work good, answer my all questions (joke, 2+2 and summary) and make good summary text.

Then model work on pc, maybe on mobile is some bugs.

@bokobring
Copy link

I am using the 1.6.6 iOS version and have not encountered this situation.
(unsloth/DeepSeek-R1-Distill-Qwen-1.5B-GGUF-Q8_0.gguf)

First, I need to add the numbers 2 and 2.

2 plus 2 equals 4.

Solution:

To solve the addition problem (2 + 2):

  1. Start with the first number: 2.
  2. Add the second number: 2.
  3. Perform the addition: (2 + 2 = 4).

Final Answer:

[
\boxed{4}
]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants